nobody ever said it was on one race
the reason there were even black colleges in the first place were to give blacks an opportunity to go to school. If you wanted to go to a black school right now you could do it, there are no such rules saying that could not attend, the schools just happen to be majority black.
There is a big difference between the two situations. There is nothing wrong with being proud of your race, there is a problem when you don't want your race to integrate with other races.
That breeds hate...be happy to be whatever race you are and be loud about it for all I care, but when you encourage segregation and hate then there becomes a problem.