Pay bills by credit card.
If you don't want to pay directly from your bank account, pay your bills by credit card. In fact, this might be easier. Not every business accepts e-payments yet, but almost all take plastic.
You get the same great environment-saving advantages of paying electronically while also earning yourself some financial perks. Set up an automatic credit card payment; that way you'll never face another late fee. Make sure the card is one with a low or no interest rate. If it's a rewards card, all the better. Your eco-friendly payment method will earn you extra points.