Sounds exactly like what my car does too. Been like that since I did the 3L swap. Never had a problem and never got any louder or quieter. Too lazy to figure out the problem and fix it though. I'll keep my eye on this thread to see what you find.
Tony
1998 SVT Contour (B/MB) #542 3L
1998 SVT Contour (SF/MB) #1266 parts car
2000 SVT Contour (SF/MB) #1533 3L swap to begin!