If it wiggles side to side only, it's usually a tierod end. Up and down and it could be the ball joint. Rocking it in any direction and you have a bad bearing. That coupled with your grinding noises makes me think it's the bearing. A bad CV joint will grind and click but won't cause the wheel to rock as is the case here.
