Darn, I forgot the name of the place. I think it's Captain's Seafood, but can't be sure. When you drove out of HHI resort, you make a right turn onto the main road. The place is on your right, after the mini golf.
That's the only place I found to have decent seafood and opened for lunch. Been there twice in a week, and we also bought mussells back to our room for dinner.