Doc's Seafood and Original Oyster House are the two places that we always eat at there.
Honestly, with a three day trip I wouldn't try and go up to Mobile or Pensacola. Just enjoy the beach, maybe hit up Waterville.
http://www.docsseafoodshack.com/
http://www.originaloysterhouse.com/