We drove from the Raleigh/Durham area of NC to central MA in May and per my EZ Pass account, we paid $17.80 in tolls for the Maryland to northern NJ stretch on I-95/NJTP. Here's the breakdown:
MD - Fort McHenry Tunnel - $2.00
MD - Kennedy Memorial Highway tolls - $5.00
DE - Newark Plaza tolls - $4.00
NJ - Full length of NJ turnpike - $6.80
Looking at the same trip last August going south, add the Delaware Memorial Bridge toll for $3.00. Going south, the NJTP is $9.05. Both trips on the NJTP were from exit 1 to exit 18W, I'm not sure why the southbound is more expensive.
In your case from Albany, I assume you'd take I-87 south to I-287 to NJ and meetup wit hthe NJTP near Perth Amboy (exit 11 I think) that will save you about $2-$3 on the NJTP tolls.
If you take the inland route, you can take I-78 west off of I-287 and then pickup the I-81/I-77 inland route to I-95 in SC. The only toll on that route is at the PA border. It's about an hour longer driving-wise, but less stressful in general than I-95.