Honestly, no, as long as it's done respectfully/affectionately.
I must have a "Honey" face.
When I worked at the courthouse, I was always called that by people older than me. Often, they said I reminded them of their daughter or granddaughter.
The biggest adjustment was being pregnant (twice!) while working as a district attorney. Besides being called "Honey", the words "public servant" took on new meaning!
Total strangers would touch my expanding stomach as I rode the elevator! Luckily, I had relatively easy pregnancies and I knew that the "touchers" genuinely meant well, so it wasn't an issue for me.