the bolt in the center is for the spindle itself
the parking brake is self adjusting and it keeps the shoes right against the drum, you need to remove the little rubber cover on the bottom of the backing plate and back off the parking brake adjuster, then the drum will come off
you shouldn't need to hit it, and if you do I think it is best to do it lightly as it should be hit hard iirc