Nope, there's no need to remove the bumper cover. There are three star-head screws that hold the healight assembly in place. Two are visible on the top of the assembly, one on each side. The third is behind the headlight, towards the bottom. Once you remove the three screws the only thing left to do is pull off the clips for each of the three bulbs, and the whole assembly should pull out.
EDIT: Whoops, I didn't see that this was for a pre-98. I doubt that my directions would work for you... sorry.