Goodness no, definitely not possible and not safe.
According to this taxi fare estimator
http://www.taxifarefinder.com/main.php?city=Orlando it's about $35 one way. That includes tip. However, you'd also have to pay for wait time or arrange a second cab to pick you up there and take you back.
I assume you are flying to Orlando and using Magical Express so you won't have a car? If so, you might consider using a town car service for the trip from the airport to the hotel. Most will include a grocery stop in the price of the service, and it'll be very comparably priced.
FL Tours charges $65 (plus tip) for one-way service to AKV, including a 30-minute grocery stop.
Another option is to use Garden Grocer or WeGoShop to order your groceries online ahead of time and have them delivered. There is a delivery fee, but it will pale in comparison to cab fare or car service charges.