A pharmacy. They may have to order it for you from the regional warehouse, so call ahead and ask.
In grocery stores that have it, alum is normally shelved in the spice aisle. It's used in traditional-method pickling.
PS: Those "crystal" deodorant sticks are made of alum, as are styptic pencils for when you cut yourself shaving.