Hey guys ... come on now. When you're visiting the Straw Market you're not going to Macy's! You won't be ignored. Promise!
The Straw Market is ... and is meant to be ... a bit of a "cultural" experience. People have to make a living, and this is the way some people do it ... and many, many visitors find the whole experience entertaining and profitable.
When my wife and I were in Honolulu we visited an open market on the north side of the strip along Waikiki ("International" something). The experience was largely similar to the straw market here, except with brown faces rather than black ones. We felt quite at home, but I will admit that the woman who chased us all around for 1/2 hour because we had shown an interest in some hibiscus earrings was a little overbearing.
Remember that when you leave US shores cultures are different. Enjoy the differences - you won't have to endure it for long.
Castaway Cay is a controlled experience ... it's not the Bahamas though it may be located here. I love it ... but it's definitely Imagineered to the max.
There are many more beautiful and spectacular spots in the Bahamas that put Castaway Cay (I knew it as Gorda Cay growing up ... and it has a rather checkered past) to shame ... for my money Eleuthera is heaven on earth, and I've travelled pretty well the whole of Europe and the Americas.
So ... if you visit the Straw Market don't fear for you life.

As far as I know there's never been a case of physical abuse of a tourist there in my long memory.