There'a a steel sleeve that gets rusted on with age. That's probably the reason it doesn't come off. If you don't plan on replacing the swaybar endlink, just remove the bottom nut and it'll separate from the lower control arm.
It IS recommended that the end links get replaced as they take a beating.
