Correct, they are not going to the same buildings.

It is true. Pretty much everything in the south was racially segregated until they were forced to stop by the federal government. It is a big topic, basically after the end of slavery white southerners would not allow black Americans to use the same facilities as them. Schools, churches, restaurants, even drinking fountains. It was/is a problem all across the country but very extreme in the ex-confederate states. Here is the wiki for the US civil rights movement, https://en.wikipedia.org/wiki/Civil_rights_movement . They are no longer segregated as a matter of law but the effects of slavery and Jim Crow still have their mark on our society. Racism in general is an ongoing and systemic issue.