It will be faster to take the bus direct to the Magic Kingdom, then boat (or monorail, but the boat goes directly there) to the Grand Floridian.
Downtown Disney is off in the wrong direction, is typically congested in the evenings, and involves a change of buses.