No. If you don't have a dining reservation there, and you aren't staying at Contemporary or BLT, they'll turn you away. Maybe take a bus to the Magic Kingdom, and from there, it is either a short walk or resort monorail ride to the Contemporary.
I think that an Uber could take you to the TTC, but the resort monorail goes all the way around Poly, GF, MK, and then Contemporary when starting at the TTC.