I just found what the problem was.
The selector switch for the fan and a/c mode is bad.
There is no 12 volts coming off the purple wire coming out of the switch. I ran a jumper from purple/blue wire to the purple wire and the fan worked.
I replaced the selector switch and it now works fine.
I was getting 12volts across the wires going into the fan, but that was coming from the relay coil, when I hooked the fan back up, the coil would drop out.
Thanks for the help guys.