A former IRS agent reveals the legal framework that governs every audit — and the penalty relief strategies most taxpayers never use.
Most business owners walk into an IRS dispute without understanding one critical fact: the IRS does not create tax law. Congress does. And that distinction — knowing exactly where the rules come from and how they rank — can be the difference between winning and losing an audit.
As a former IRS agent who now represents taxpayers in IRS disputes, I’ve seen how knowledge of the tax law hierarchy can be weaponized in your favor. Chapter 4 of my book, The IRS Survival Guide, covers exactly this: where federal tax law originates, how it’s structured, and — critically — the penalties that catch most people completely off guard.
“The IRS interprets the law. They don’t write it. And their interpretation isn’t always correct.”
The federal tax law hierarchy
Tax law isn’t a single document. It’s a layered system of authority, and knowing the hierarchy helps you understand why some arguments succeed in disputes while others fail immediately.
In any tax dispute, a skilled representative searches every level of this hierarchy, and not just the IRC, for arguments and precedents that support your case.
The five IRS penalties that hurt most
Penalties are where an additional tax assessment can spiral from manageable to devastating. Here are the five I encounter most frequently in practice:
The most important takeaway on failure-to-file vs. failure-to-pay: filing late costs 10x more per month (5% vs. 0.5%) than simply not paying. If you can’t write the check on April 15th, file anyway and set up a payment plan. The failure-to-file penalty is one of the most easily avoided and punishing in the entire tax code.
Penalty abatement: how to get penalties waived
Here’s what the IRS doesn’t advertise: penalties are not always final. In my practice, I’ve seen six-figure penalty balances fully abated when the right argument was made correctly. There are two main routes.
- Reasonable cause — A legitimate reason outside your control: serious illness, natural disaster, death of a family member, overseas military service, or demonstrated reliance on incorrect professional advice.
- First-time penalty abatement (FTA) — If you have a clean compliance history (filed and paid on time for the three prior tax years), the IRS will typically waive penalties for a first offense. This is widely underutilized.
Reliance on a CPA or tax professional can be a gray area — it doesn’t automatically excuse a penalty, but under the right circumstances it can support a reasonable cause argument. The key is documenting your reliance and showing it was reasonable given your situation.
Don’t assume a penalty assessment is the end of the conversation. It very often isn’t.
Key takeaways for business owners
Whether you’re currently facing an audit or simply trying to stay compliant, understanding the structure of tax law puts you in a fundamentally stronger position. A few principles worth keeping:
Always file on time, even if you can’t pay. The cost of late filing is ten times higher per month than late payment.
The IRS interprets tax law — it doesn’t author it. Their position on Treasury Regulations and revenue rulings can be challenged, and courts have overruled IRS positions many times.
Penalty abatement exists and works. If you’ve had a clean compliance history for the past three years, first-time abatement is available and frequently approved. Most taxpayers never ask.
The trust fund recovery penalty is personal. If your business has unpaid payroll taxes, your personal assets may be at risk even if you operate through an LLC, partnership, or corporation.