If you reach a point where you can pay off the rest of your unpaid taxes, you can pay directly to cover what you owe. Individuals and businesses can select this option and pay electronically or by phone through the Electronic Federal Tax Payment System (EFTPS). To use this system, you will need to enroll first. You may also pay by phone, mail or money order. With this option, you will have no future penalties or interest.