I fully agree that these sorts of segregation are ultimately bad things. I merely disagree that we should label them "wrong", since I think that doing so expects too much of the individuals. Society will certainly become better off if Athiests spend more time with theists, however I cannot in good conscious really fault them (say that it is 'wrong') for their decision.
I think we pretty much agree in other words ;)