we do this all the time. Every time we go to WDW, our first night is always off-site, but we always go eat a nice dinner at one of the resorts. Never had a problem driving up and parking, just tell the guard you have a ps and they'll give you a 3 hr permit.