The ignition switch activates a "high current capacity" solenoid switch which is supposed to disengage when the ignition switch is released from the start position. The solenoid switch is what actually connects the battery to the starter. Sounds like your solenoid switch is hanging up and not releasing properly.