I do both.
Fannypack is for my park pass, room key, money, ID, cell phone, sunglasses, lip balm, sanitizer etc....
Backpack is when we need to bring stuff like water bottles, ponchos, video camera etc...
We just put the backpack between our legs on rides.