I have never done it. I am not afraid of heights, but it's kind of "low on my list" of things I'd want to do. If it was free, then sure, I'd try it... but I'd rather spend money on other things. (And, it makes me nervous that they can't really steer, I like a plan.)
I have been to several balloon launches, and they are very beautiful. And when I was young, we had several balloons land in our yard (my parents had several acres in grass -- no trees, just an open grassy field.)
This year, there was a balloon festival in our local park. It ended up being too windy to launch any... so at twilight, they did a "balloon glow" where all the balloons would fire their burners and make the balloons light up. That was pretty cool, too... since you don't normally see hot air balloons at night.