Yes, if the filter is hand tightened when put on, and not more than 3/4 turn after contact with the gasket, it should come off by hand with no problems. The only times I've ever had problems getting a filter off was when I didn't put it on to begin with, on my car and other cars.
To keep hot oil off the exhaust, you can put some tin foil over everything.
