We went that same week the last two years, and are going again this year but for a bit longer (11th-20th).
In 2009, it was our first full week at WDW with our kids, I think we were there the 13th-20th. We had a blast. We stayed at BCV, the crowds were very low, as in ride whatever you want as many times as you want, with little--if any--waiting. The weather was absurd, probably 82 and sunny every day, if not a bit warmer, and we were in the pool a lot. We had so much fun, we returned last year the same week (12th-19th last year). Again, BCV. Weather was a bit cooler, probably closer to 70-75, with some mid-afternoons getting up to around 80ish. We needed sweatshirts at night. The crowd levels had definitely increased, but still very manageable. We did wait for rides, but never more than 20-30 minutes at most. I remember Splash Mountain said 15 minutes but was more like 5-10.
We are going back again this year, and are curious as to what we'll get bother weather and crowd-wise, but can reasonably expect very manageable crowds. Even a repeat of last year would be just fine with us.
As to availability with points, we booked inside of 7 months but with a little luck and a few waitlists, we ended up with pretty much ideal accommodations. Try waitlisting, maybe to do a split stay. I bet you'd have some luck, especially at AKV. Try for 2-3 days and if it comes through, keep trying to add on.
We finally just ended up with 6 nights at BCV for November after originally only booking 2. We had 2 waitlists come through. AKV will give you a better chance than VWL b/c of availability.
To answer your original concern, based on our last two years I can pretty much assure you that you will find the crowds more than manageable. Don't panic when you arrive on the 12th; that's the Saturday of Veterans Day weekend, it's the end of Jersey Week, and it's the last weekend for the F&W festival. Sort of a perfect storm; you will find that monday much quieter.
We are hoping for the 2009 November weather, but will take anything that's warm enough to swim! Overall it is a great week to go in my opinion.