Philly is about 35 miles north and west of Pilesgrove. It would depend on where you're staying in Philly as to how rough the commute would be. I-95 traffic around the airport is tough in both directions at any time of day. From Center City or Old City you would have to get to one of the bridges into NJ (Ben Franklin, the Walt Whitman or Commodore Barry). Just getting to any of those would require either traveling eastward on city streets or southward thru the city to I-95 and then dealing with that traffic. I really recommend staying on the Jersey side of the river and saving visits into the city for weekends.
I am not as familiar with traffic heading from Wilmington into South Jersey. In all likelihood, you would take the Delaware Memorial Bridge, which means getting on I-295 northbound, which could also be a headache during rush hour.