Hello Jeff90!
We live in Southeastern NC, only 5 minutes from I-95, and 45 minutes from the SC border. It takes us approx. 9 1/2 hours from our home to the main entrance of WDW. We make 2 stops for gas, food, and restroom breaks. We do average about 20--30 minutes during these stops, sometimes a little longer, depending on where we eat. Sometimes we make a third, very brief, stop if needed. We leave at about 5:30 AM and arrive every time at about 3:00 PM. Normally only encounter 1 small traffic jam around noon, in Jacksonville, and a small one as we enter Orlando. It appears the rush hour traffic has just started in Orlando around that time, but hasn't hit it's major potential yet. If we encounter problems like heavy rains or construction, I can't remember it ever getting us too far behind. I believe our longest trip ever, due to major road construction, was maybe 10 hours at the most.
I hope this helps a bit as you are coming from a different part of the state. I also hope you will make the trip to Disney, it's great and we love it there. We have made the trip 5 times in the past 8 years, always drive down, and have never grown tired of it!