Sounds like the IAC is intermittently sticking. Try cleaning it out (or replace). A much lesser possibility is the fuel pump but I've never seen one demonstrate this kind of problem.

Dave Keller
1995 Contour SE
1999 Contour SVT