OK,
I did manage to get the panel off. To do it I removed the four nuts. I then pryed the panel off carefully. There are 6 push pins (3 on each side) that hold the panel on at the outboard ends. These pins are for ease of assembly at the factory. I found it easiest to get the tips of my fingers over the top of the panel and pull but it still came off hard.
