Thanks for all the advice.
Tape did not work for me but weather stripping did (the foam strips that you line around windows and doors etc). Any sticky stuff will work.
Just cut a piece that is the same width as the plug. Pulled the plug out on first try.