We tent camped on my first trip there (I was 5). I don't remember anything particularly traumatic about it - don't remember being miserably hot or freezing, but we went in the early part of May since my parents had no kids in school yet. I do remember that Ft. Wilderness was a totally fun place to stay, and I do hope to talk my DH into tent camping there some day.
Good luck!