I am another advocate of Bill Paying online. I just started using this service just over a year ago even though it was free at my bank. I don't know why I resisted using it for so long. I only decided to start using it because Suze Orman recommended it in her Women and Finance (I think) book.
This has cut back so much on paper. Most of my bills are delivered via "ebill" to my bank. I can view my bill online and schedule payments. I get email notification every time my ebill is "delivered." For those bills who don't use the ebill system, I can set up reminders or schedule a recurring payment.
Also, it is so much easier to go to Bill Pay and pull up a Biller to quickly see how much I have paid each month. So much better than flipping thru a check register or pulling out old bills from the filing cabinet.
I highly recommend using your bank's Bill Pay feature. If your bank doesn't have it or offer it for free, find another bank. At the very least, try to make your payments directly to your creditor. Most credit card companies and utilities services have an option to pay your account online.