The whole thing about a tattoo is that it doesn't matter what everyone else thinks - it's something that has meaning to YOU and nobody else. If you like it and it means something to you, who cares what it is? It could be hearts and butterflies under a rainbow, but if it had some special meaning to you, it shouldn't matter what anyone thinks.
But if you are thinking that you are going to care if people think it is feminine or not masculine, it's a sign that maybe you're not really ready for it in the first place. You have to want it 100% no matter what anyone says or thinks about it, because it's YOURS and is for LIFE.
If you want it, get it! But if you think comments might bother you, I'd say skip it.