Memorial day weekend will make travel more of a bear, and interfere with many family activites. Really early May gets dicier with the weather (late April Rotary meets have been freeze events).
I would shoot for the middle two, IMHO, depending on how everthing else fits.