I had a similar problem and couldn't pinpoint it for a long time. I did find the problem to be the bumper rubbing on the quarter-panel driver side. When I moved the bumper I could see the nipple that sticks into the quarter panel rubbing. I shot some WD-40 and it took care of it. Maybe that may be it.
