I happened to have just worked on that the other day. My problem was that it got pushed INDSIDE when I was plugging in.
You have to take off he screws on the left side of console and the screw on the right, closest to the firewall.
Then, pull the console far enough to stick your left hand inside of the console housing. Reach all of the way to the lighter and there are two wires that are attached to the lighter. Gently pull the wires out and then hold the lighter housing and start unscrewing while at the same time, use your right hand to hold the ring in front while your are unscrewing. It is actually two pieces. Do you plan on putting the lighter back?
Good Luck