Do you owe money to the IRS? Chances are if you owe back taxes, you have been hit with penalties by the IRS. The good news is, if you qualify, you can have those penalties removed. The IRS allows for penalties abatements in cases where people owe a large amount of back taxes. You can sometimes get the full penalty amount removed, while other times you can get a portion.