I think Saturday is your best bet because of the rain. Sunday it's supposed to clear, and although I've gone on a few Super Bowl Sundays - it's hit or miss with crowd size - so, pretty much like every other Sunday. I'm going myself on Sunday as an AP holder, but if I had a choice, I'd definitely rather go Saturday this weekend.
Tracy