In case you're planning to road-trip across the US, I'll answer the whole question, not just as it pertains to Florida.
As some people said, it varies from state to state. Places that sell alcohol in one state will not necessarily sell it in others.
Albertsons is a chain of grocery stores (one of dozens of major chains). In my state it sells alcohol, in other states it does not--the same can be said of any other chain of grocery stores. I don't remember there being any Albertsons in Florida when I lived there; if there are Albertsons stores there, then yes, they should sell alcohol.
Some states allow any sort of alcohol to be sold in grocery stores; some don't allow it at all; most allow beer, wine coolers, and sometimes wine to be sold in grocery stores, but require specialized stores (either private or goverment-run) to sell hard liquor.
The Super
Walmart nearest WDW does sell alcohol (beer, wine, wine coolers, and what my British husband calls "alco-pops," things like the fruit flavored Smirnoff drinks), as does the convenience store at the Hess gas station on property. But Super Walmart in other states may or may not sell it.
In states where only the state government can sell alcohol, or only the state can sell hard liquor, those things are available at what's called the ABC Store (Alcoholic Beverage Commission). In other states, there are simply separate privately owned liquor stores. I can't remember whether Florida has ABC stores for hard liquor, or just regular liquor stores.