Even on a ride like Rock n' Roller Coaster (which goes upside down), I bring my backpack. I just set it at my feet and loop the strap around my ankle, so it won't fall out when the ride goes upside down. Unless you have a huge backpack (which would be a pain to lug around, anyways!), you should be okay.