Ya, your car really shouldn't run much, if at all, after pulling the fuse. You're essentially cutting off fuel supply to your engine, no fuel=no starting. There will be a small amount in the lines, but nothing pumping that fuel. You did everything fine, don't worry.
