Just as a sum up I found that prying up on the side edge did not work for me. I tried untill almost breaking it. Maybe b/c it was the 1st time these trim pieces were pulled off so they were on there good.
BUT, I did find that if you stick the tip of a flat head screw driver underneath the bottom edge right in the middle of the trim piece right under where the groove is and pry up there, it pops off pretty easy. There are two very tiny tabs that hook into the the metal latch and by prying here it pops them out. Figured I'd add this for anyone else that was having trouble w/ it.
