Qualified buyers may put as little as 3% down, but larger down payments can help secure better interest rates, lower monthly payments, and potentially avoid PMI altogether.