Running the engine with the fuel pump fuse removed only relieves the fuel pressure. It does not suck the fuel out of the filter or fuel lines. Another way to relieve the pressure is to depress the schreider valve on the fuel rail on the engine. The fuel rail has a tap for installing a fuel pressure gauge for testing. The valve looks a bit like a tire valve stem. It even has a cap that resembles a valve stem cap. Remove the cap and depress the valve for a moment until fuel quits spurting.
Personally, I don't bother to relieve the fuel pressure. It doesn't make much difference.
Aussie, you need to check your fuel source. My fuel filter has always had clean fuel in it when I change it. You may want to reconsider where you are buying your gas.
