No. Putting 3–5% down instead of 20% is not automatically a mistake — it's a tradeoff, and depending on your situation, it can be the smarter move. You'll pay private mortgage insurance (PMI) until you hit roughly 20% equity, and your monthly payment will be higher because you're financing more. In exchange, you keep tens of thousands of dollars that aren't nailed to a house — money you can invest, use as an emergency fund, or just not have to scrape together from three different accounts and a very understanding relative. Whether that trade is "smart" depends entirely on what you'd otherwise do with the cash, not on some rule that 20% is the responsible-adult number.

That last part is worth saying directly: 20% down isn't a moral default. It's a legacy underwriting convention that stuck around as a cultural rule of thumb long after low-down-payment programs became mainstream. Some buyers put 5% down because 20% simply isn't in reach yet — and that's a completely legitimate way to buy a house. Other buyers could write the 20% check tomorrow and choose not to, because they'd rather keep the liquidity, buy down their rate, or put the difference into a brokerage account. Both are normal. Neither one is cheating.

How common is a small down payment, actually?

Pretty common — common enough that it's not a fringe move, it's close to standard practice.

Using HMDA (Home Mortgage Disclosure Act) data — specifically the local hmda_2025.sqlite loan-level file, filtered to originated loans (action_taken = '1'), home-purchase loans (loan_purpose = '1'), and principal-residence properties (occupancy_type = '1') — of the roughly 2.93 million 2025 purchase loans with a reported combined loan-to-value (CLTV) ratio:

  • ~36% closed at 95% LTV or higher — meaning 5% down or less.
  • ~37.6% closed at 80% LTV or below — meaning 20% down or more.

In other words, small-down-payment buyers and big-down-payment buyers are almost evenly split at the two ends of the spectrum, with everyone else spread across 80–95% LTV in between. 2024 HMDA data shows nearly the same split (about 35.0% at 95%+ LTV, 37.9% at 80% or below), so this isn't a one-year fluke.

And it's not just an FHA thing. Looking at just the 95%+ LTV group in the 2025 data, the loan type breaks down as:

  • Conventional: 42.5%
  • FHA: 40.0%
  • VA: 15.2%
  • USDA/RHS: 2.3%

Conventional loans — the kind that come with a plain private-lender PMI policy, not a government insurance premium — are actually the largest single slice of low-down-payment purchases, edging out FHA. Putting down close to nothing isn't a last-resort, credit-challenged move; it's a mainstream financing choice across loan types.

What PMI actually costs, and when it goes away

If you put down less than 20% on a conventional loan, the lender requires private mortgage insurance — insurance that protects them, not you, if you default. It typically runs 0.46% to 1.50% of the loan amount per year, depending on your credit score, down payment size, and loan term (Bankrate, as of 2026). On a $380,000 loan (5% down on a $400,000 home), that's roughly $146–$475 a month — with good credit, you're likely toward the lower end of that range.

The good news: PMI isn't forever. Under the federal Homeowners Protection Act:

  • You can request cancellation once your balance is scheduled to hit 80% of the home's original value.
  • Your servicer must automatically terminate PMI at 78% of original value, or at the midpoint of your amortization schedule (year 15 on a standard 30-year loan), whichever comes first — as long as you're current on payments.

So PMI is a temporary tax on financing more than 80% of the home, not a permanent penalty for not putting 20% down. Paying extra toward principal, or getting a new appraisal if your home has appreciated, can speed up the exit.

FHA loans work differently and less generously. FHA mortgage insurance (MIP) means an upfront premium of 1.75% of the loan amount plus an ongoing annual premium of roughly 0.45%–1.05% (Rocket Mortgage, as of 2026). If your down payment is 10% or more, that annual MIP drops off after 11 years. Put down less than 10%, and it rides with the loan for its entire life — the only way out is to refinance into a conventional loan once you have enough equity.

FHA, VA, and USDA: the other low-and-no-down-payment paths

  • Conventional 97: as little as 3% down, available to borrowers who meet standard conventional underwriting, generally requiring at least one borrower to be a first-time buyer (defined as not owning a home in the past three years). No program-specific income cap. PMI applies and cancels per the rules above (Lower, as of 2026).
  • FHA: 3.5% down with a credit score of 580+ (lower scores may still qualify with more down), open to repeat buyers too, but carries the less-forgiving MIP structure above.
  • VA loans: 0% down for eligible service members, veterans, and some surviving spouses. Instead of PMI, there's a one-time VA funding fee — 2.3% of the loan amount for a first-time, zero-down purchase — which is waived entirely for veterans receiving VA disability compensation (Veterans United, as of 2026).
  • USDA loans: 0% down in eligible rural and some suburban areas, subject to income limits. Instead of PMI, there's a 1% upfront guarantee fee plus a 0.35% annual fee on the average remaining balance (Amerisave, as of 2026).

Point being: "low down payment" isn't one product with one cost structure. It's four or five different products, each with its own insurance math, and the right one depends on your service history, location, and credit — not just how much cash you have sitting around.

The actual math: what a bigger down payment buys you

Say you're buying a $400,000 home, financing at the average 30-year rate of 6.61% as of August 14, 2026:

20% down5% down
Down payment$80,000$20,000
Loan amount$320,000$380,000
Principal & interest~$2,046/mo~$2,429/mo
PMI (est., good credit)$0~$190/mo
Total monthly cost~$2,046~$2,619

Putting 20% down instead of 5% saves you roughly $573 a month in this example — real money, and it also means less total interest paid over the loan's life. That's the honest case for 20%.

But it costs you $60,000 in cash, upfront, that could otherwise go to work elsewhere. If you invested that $60,000 instead — say, in a diversified portfolio averaging a historical 7% annual return (not guaranteed, and a genuinely aggressive assumption for money you might need access to) — it would grow to roughly $118,000 after 10 years and $457,000 after 30. Even stacking the full $573/month extra cost of the 5%-down loan against that for 10 straight years (about $69,000, which overstates it since PMI typically drops off well before then), the investment scenario still comes out tens of thousands of dollars ahead in this illustration.

That's not a guarantee — markets don't move in a straight line, and a mortgage payment you can't miss is a very different kind of obligation than a portfolio you could, in theory, ride out a downturn in. But it's the actual tradeoff: a bigger down payment is a guaranteed, modest return (avoided interest and PMI) in exchange for locking up capital. A smaller down payment is a bet that your money does more working in the market — or sitting liquid for emergencies — than it does buried in home equity you can't spend without selling or refinancing.

So when does 20% actually make sense?

  • You don't have a strong risk tolerance for market swings and would rather have a guaranteed "return" in the form of a lower payment and no PMI.
  • You're close to 20% anyway and the gap between "5% down with PMI" and "20% down, no PMI" is small enough that the extra cash isn't doing much for you elsewhere.
  • You want the lowest possible monthly payment for cash flow reasons, full stop.

And when does 3–5% down make sense?

  • You'd rather keep a real emergency fund than drain it for a down payment.
  • You have somewhere better to put the extra capital — investments, paying off higher-interest debt, a rate buydown — and you're comfortable carrying PMI as a temporary cost.
  • 20% simply isn't realistic on your timeline, and waiting years to save it means losing years of appreciation and paying rent instead of building equity.

There's no universally correct answer here — anyone who tells you there is hasn't run your numbers. Run yours.

Sources

Note: The investment-growth figures in the math example use a 7% average annual return as an illustrative assumption, not a guaranteed or projected rate — actual market returns vary and aren't assured.