Does your shifter have any play in it? Could be the shift tower causing you problems ...