It's not so bad as all of that.
1. California is farther from here than London. Hawaii and Alaska are even farther. I can travel to all kinds of places without a passport. That's much less true in European countries. Many of those countries are smaller than some of our states, even if you exclude Alaska and Texas.
2. According to the Bureau of Labor & Statistics, the average American worker gets 10-14 vacation days per year and that number increases to 15-19 days per year after 10 years of service. That's not too far off from most European countries, which offer around 20-25 days.
3. Americans actually do have more disposable income than anyone else. Here's a simple chart:
https://en.wikipedia.org/wiki/Disposable_household_and_per_capita_income