Ugh, I've just read the complaint, and PD's brother is an absolute pig.
As for the bathrooms, I have no problems with staff being required to use their own bathrooms; the complaint alleges, however, that only black staff were required to so do, while white staff were allowed to use customer bathrooms.
In addition, the complaint claims that there were other times PD used the racial epithet in question: in business meetings, for example, in 2007. It seems more like a pattern and less like a mistake.
However, it's clear that the brother is both a deeply sexist and racist man, down to the core, and that this was not only tolerated by Paula Deen but regularly humored. The quotes are too explicit and offensive to list here, but if true they're genuinely outrageous: every epithet under the book; violence; overt racism ("don't you wish you could rub all the black off you and be like me" is probably the least explicit turn of phrase); overt sexism, including refusing to listen to female managers and paying female staff less for the same work; racist jokes about the president; sexual harassment; racist comments made to vendors; anti-semitic comments; the works.
Entirely gross.