That almost sounds like the alternator has a bad diode in it. If you can remove it without too much trouble, take it off the car and take it back to Autozone and have them test it in the store on their alternator testing machine.