Got Penalties? How to Reduce or Even Remove IRS Tax Penalties 23 Feb 2021 It is bad enough to owe the IRS taxes, but the IRS is very quick to slap penalties on top of the tax, make matters worse.