Yes especially now. In the "before times" as my husband calls them, I would say no, because there is not a ton to do outside of Pandora, and it was impossible to get a fastpass for flight of passage unless you were staying on site with a long-ish stay. Now, you can ride flight of passage with zero wait. It is such an amazing ride, that makes it absolutely worth it, especially since you don't have it over in CA.
Edited to add: Also, Tiffins is the best restaurant in Disney World, in my opinion.