I've had this problem with different sets of speakers/subwoofers, usually a speaker that's about to/already has died. either voice coil is failing or the speaker is just falling apart (recent set of infinitys, the tweeter was hanging off the speaker, held on only by the wires when I took off the door panel

)