Yeah, if your water pump was bad you'd have the car overheating and no heat coming out of vents. Bad news!
However if your light is going on then it is indeed just a simple matter of filling about 1.0 to 1.5 inches above the full line.
About the water pump. It is very to replace but if your's is okay then no worries