I'm 6'6" and rode it without any problems... (well... besides kicking a dementor or something the first time I rode it when I just let my legs dangle and it thru me around a bit.).
I think the bigger issue is the going to be your general build and the old 3 click problem. I'm in the traditional "beanpole" type build (although i've started to put on some weight so I don't think I truly qualify as a beanpole anymore), so my chest/shoulder's aren't as bulky as some guys who may have a more athletic build.