You did the hard part: you saved real money. Now comes the part that feels unfair—small-looking decisions can quietly cost (or save) six figures.
With $500,000 to $5 million invested, you’re in a “messy middle” that most retirement advice ignores. You’re not ultra-wealthy with a family office. But you’re also not living entirely on Social Security. You have options, and options create tradeoffs.
Here’s the tension I see every week at Grape Wealth Management: you want reliable income and peace of mind, but you also don’t want to overpay taxes, trigger higher Medicare premiums, or take more market risk than you can stomach. And once certain choices are made—claiming Social Security, enrolling in Medicare, letting IRAs grow until RMDs hit—they’re hard to undo.
This guide is a decision-focused retirement planning playbook for households with $500K–$5M in investable assets. It’s not about picking the next hot investment. It’s about coordinating the handful of moves that drive most after-tax outcomes.
I’m going to walk you through the “big seven” decisions and how they connect:
- Your retirement paycheck design (income plan)
- Your portfolio risk plan (especially early retirement)
- Your withdrawal order (which accounts to spend first)
- Your Roth conversion window (and when not to use it)
- Social Security timing (and how taxes change the math)
- Medicare and IRMAA (the premium cliffs that surprise people)
- RMDs and estate coordination (so your future self and heirs aren’t stuck)
Along the way I’ll give plain-English definitions, “when this applies / when it doesn’t” notes, and a practical action list.
The decisions that actually move the needle (and why this asset range is different)
If you have $500K–$5M invested, you typically have at least three “levers” that average retirement articles don’t address well:
Account mix. You may have money in taxable brokerage accounts, traditional IRAs/401(k)s (pre-tax), and possibly Roth accounts (tax-free). Each bucket is taxed differently.
Timing flexibility. You can often choose when to take income, when to realize capital gains, when to convert to Roth, and when to claim Social Security.
Medicare exposure. Many households in this range accidentally trigger higher Medicare premiums because of how income is measured.
The biggest misconception is that retirement planning is mostly an investment problem. For many households with meaningful assets, it’s a coordination problem.
Here’s my fiduciary take: investment returns matter, but the most common avoidable mistakes are tax and timing mistakes.
What tends to be overrated
Chasing a “safe” dividend portfolio without understanding taxes, concentration risk, and inflation.
Trying to time the market as your main retirement strategy.
Obsessing over a 0.20% fee difference while ignoring a six-figure tax issue.
What tends to be underrated
A written withdrawal plan that coordinates taxable, IRA, and Roth accounts.
Managing your tax bracket intentionally in the years between retirement and age 73.
Medicare IRMAA planning (it’s a stealth tax for higher-income retirees).
Sequence-of-returns risk: the danger of big market losses early in retirement.
A quick orientation: the three “tax buckets” in plain English
Taxable account (brokerage)
You already paid income tax on the money you invested. When you sell, you may owe capital gains tax on the growth. Qualified dividends and long-term gains often get lower tax rates than IRA withdrawals.
Traditional IRA / 401(k)
You got a tax break when you contributed. Withdrawals are generally taxed as ordinary income. At age 73, required minimum distributions (RMDs) begin for most people.
Roth IRA / Roth 401(k)
You paid taxes up front. Qualified withdrawals are generally tax-free. Roth IRAs do not have RMDs during the original owner’s lifetime.
Most retirement plans go sideways because people treat these accounts as three separate worlds. In reality, they’re one system.
Designing your retirement paycheck: income first, investments second
Retirement income planning is not “How much can I withdraw?” It’s “How do I create a paycheck that can survive a long life, inflation, and a bad market early on?”
Start by separating needs from wants
I like to use three layers:
Baseline spending: the bills you must pay to feel secure (housing, utilities, food, insurance, basic travel, healthcare).
Lifestyle spending: the things that make retirement enjoyable (bigger travel, hobbies, gifts, dining out).
Legacy/extra: money you’d like to leave behind or spend on major one-time goals.
Why this matters: your baseline spending should be funded by your most reliable sources first.
Reliable income sources usually include
Social Security
Pensions (if you have one)
Annuity income (sometimes appropriate, sometimes not)
A bond ladder or cash reserves designed for near-term spending
Then your portfolio becomes the “flexible engine” that fills the gap.
A realistic example (within the $500K–$5M range)
Let’s say Mark (66) and Diane (64) have $1.8 million invested:
$650,000 in a taxable brokerage account
$1,050,000 in traditional IRAs/401(k)s
$100,000 in Roth
They want to spend $110,000 per year after taxes. Mark plans to retire now; Diane will retire in two years. They’re healthy, and longevity runs in the family.
Their biggest risks are not “Will the S&P 500 do well?” Their biggest risks are:
Claiming Social Security too early and locking in a smaller lifetime benefit
Pulling too much from IRAs early and paying high taxes (and higher Medicare premiums later)
Waiting too long and getting crushed by RMDs in their 70s
Taking too much market risk in the first 5–7 years of retirement
A good plan for them is a coordinated timeline, not a single “withdrawal rate.”
My advisor note: withdrawal rates are a starting point, not a plan
Rules of thumb (like 4%) can be useful for quick estimates. But for $500K–$5M households, the better question is: “What is my after-tax income plan across different market and tax scenarios?”
Portfolio risk in retirement: the danger isn’t volatility, it’s bad timing
If you’re close to retirement, you can be right about the long-term market and still have a bad outcome.
Sequence-of-returns risk (plain English)
This is the risk that the market drops early in your retirement while you’re taking withdrawals. When you sell during a downturn to fund spending, you lock in losses and reduce the shares available for the recovery.
Two retirees can earn the same average return over 20 years and end up with very different results depending on when the bad years hit.
That’s why retirement asset allocation is not just “aggressive vs conservative.” It’s about matching risk to your spending timeline.
A practical way to think about it: time-segment your money
You don’t need your entire portfolio to be “safe.” You need the money you’ll spend soon to be stable.
Many retirees use a version of a bucket strategy: near-term cash for spending, intermediate-term bonds for stability, and long-term stocks for growth. The point is not the buckets themselves—it’s the discipline to avoid selling long-term growth assets at the worst time.
If you want a deeper dive on this, we built a supporting guide on sequence-of-returns risk and retirement asset allocation here: /post/blog-asset-allocation-retirement-sequence-risk
When more stock risk is appropriate
If your baseline spending is largely covered by Social Security/pension and your portfolio is mostly for lifestyle and legacy.
If you have strong flexibility to reduce spending temporarily.
If you have a clear cash reserve plan so you’re not forced to sell stocks in a downturn.
When “playing it safe” can backfire
If you move too much into cash and low-yield bonds and inflation quietly erodes purchasing power.
If you’re likely to live 25–35 years in retirement (which is common for healthy couples).
Protecting retirement assets from inflation (without gambling)
Inflation protection usually comes from a mix of:
Stocks for long-term growth
Treasury Inflation-Protected Securities (TIPS) or inflation-aware bond positioning
Real assets exposure (often through diversified funds)
A spending plan that adjusts, rather than pretending expenses will stay flat
The goal isn’t to “beat inflation every year.” The goal is to keep your lifestyle purchasing power intact over decades.
Withdrawal order: where your retirement income really gets made or lost
Once you retire, you’re no longer just an investor. You’re a tax manager.
Tax-efficient withdrawal strategy (plain English)
It’s the order and timing of pulling money from taxable, traditional IRA/401(k), and Roth accounts to create the income you need while keeping lifetime taxes as low as reasonably possible.
This is one of the highest-impact planning areas for $500K–$5M households.
Why? Because you can often choose which tax bucket to draw from each year.
The common mistake
People spend from the IRA first because it “feels like retirement money,” while leaving taxable accounts untouched. That can push them into higher tax brackets, increase taxation of Social Security later, and raise Medicare premiums.
The other common mistake is the opposite: spending only from taxable accounts for years, then hitting age 73 with a huge IRA and huge RMDs.
The better approach: coordinate withdrawals with your tax bracket
In many plans, we aim to:
Use taxable assets strategically (especially when capital gains rates are favorable)
Use IRA withdrawals intentionally to “fill up” a target tax bracket
Preserve Roth assets for later years or for heirs (often, but not always)
The exact order depends on your goals, your account sizes, and your tax situation.
If you want the full “order of operations” framework, see our supporting article here: /post/blog-tax-efficient-withdrawal-strategies-order-of-operations
A simple decision tree you can use right now
Ask yourself:
- Do I need income before age 65 (pre-Medicare) or before Social Security starts?
If yes, taxable assets and/or IRA withdrawals may be the bridge.
- Am I in a temporarily low tax bracket right now?
If yes, it may be a good year for IRA withdrawals or Roth conversions.
- Am I trying to avoid Medicare IRMAA premium surcharges?
If yes, we need to watch how “income” is defined for Medicare.
- Do I have large traditional IRA balances that will create big RMDs later?
If yes, we may want to reduce future RMDs with planned withdrawals or conversions.
Tax planning is not about paying zero tax. It’s about paying tax on purpose.
The Roth conversion window: powerful, but easy to misuse
Roth conversions are one of the most talked-about strategies in retirement planning—and also one of the most misunderstood.
Roth conversion (plain English)
You move money from a traditional IRA to a Roth IRA. You pay income tax on the amount converted today. In exchange, future qualified Roth withdrawals are generally tax-free.
Why retirees consider it
To reduce future RMDs
To create tax-free income later
To potentially leave heirs a more tax-efficient asset
To manage future tax bracket risk
The “gap-year” opportunity (often ages 60–73)
Many households have a window after they stop working but before:
RMDs begin at 73
Social Security is fully turned on (if delayed)
Large pensions start (if applicable)
During that window, taxable income can be lower than it will be later. That can be a sweet spot for partial Roth conversions.
We built a detailed guide on this exact topic here: /post/blog-roth-conversions-gap-years-60-73
When Roth conversions tend to be a good fit
You expect higher tax rates later (because of RMDs, widow/widower tax brackets, or policy risk).
You have the cash to pay the conversion tax without draining the IRA itself.
You want more control over taxable income later (especially for Medicare IRMAA management).
When Roth conversions can be overrated or harmful
If converting pushes you into a much higher tax bracket than you’ll likely face later.
If it triggers Medicare IRMAA surcharges that outweigh the benefits.
If you need the converted money soon (Roth is best when it has time to compound).
If you’re charitably inclined and plan to use Qualified Charitable Distributions (QCDs) later, which can reduce IRA taxes after age 70½.
My advisor note: “Do conversions” is not a strategy
A strategy is a multi-year conversion plan with a target bracket, a Medicare premium check, and a clear reason tied to your future RMDs and estate goals.
Social Security for high-net-worth households: the decision isn’t about need
If you have substantial savings, Social Security can feel optional. But the claiming decision is still one of the most permanent moves you’ll make.
The basic rule that matters
If you delay Social Security past full retirement age, your benefit generally increases about 8% per year until age 70.
That’s a meaningful, government-backed increase. For many couples, delaying the higher earner’s benefit is also a form of longevity insurance: it can raise the survivor benefit for the spouse who lives longer.
So why doesn’t everyone delay?
Because the decision is not just math. It’s also:
Health and longevity expectations
Cash flow needs
Tax coordination with IRA withdrawals and Roth conversions
Spousal benefit planning
The taxation of Social Security benefits
Social Security taxation (plain English)
Depending on your total income, up to 85% of your Social Security benefits can be included in taxable income. This doesn’t mean you lose 85% of the benefit—it means that portion may be taxed.
For $500K–$5M households, the planning opportunity is often to coordinate Social Security timing with your withdrawal plan so you don’t accidentally create a high-tax “pile-up” later.
If you want a deeper guide built specifically for higher-asset households, see: /post/blog-social-security-optimization-high-net-worth
A practical way to frame the decision
If you don’t need Social Security to pay the bills, the question becomes:
Do I want a larger, inflation-adjusted check later (and potentially a larger survivor benefit), even if it means drawing more from my portfolio now?
There’s no universal right answer. But there is a right answer for your household.
Medicare and IRMAA: the premium cliffs that catch retirees off guard
Most people think Medicare is simple: “I turn 65, I sign up.” The reality is that Medicare is full of timing rules and income-related costs.
Medicare basics (plain English)
Part A: hospital coverage (often premium-free if you have enough work history)
Part B: doctor/outpatient coverage (monthly premium)
Part D: prescription coverage (monthly premium)
Medigap or Medicare Advantage: supplemental coverage choices that affect out-of-pocket costs and provider flexibility
IRMAA (plain English)
IRMAA is an extra surcharge added to your Medicare Part B and Part D premiums if your income is above certain levels.
Here’s the part that surprises retirees: Medicare looks back at your income from two years ago to determine IRMAA.
So a big Roth conversion, a large IRA withdrawal, or a one-time capital gain can raise your Medicare premiums later.
This is why Medicare planning is not just a healthcare decision—it’s a tax planning decision.
If you want the full explanation and planning tactics, see: /post/blog-medicare-irmaa-planning-higher-income-premiums
Common IRMAA triggers for $500K–$5M households
Large Roth conversions done without an IRMAA check
Selling a business, property, or concentrated stock position
High RMDs starting at 73
Taking a big IRA withdrawal for a one-time purchase
When IRMAA planning matters most
Ages 63–67: because the two-year lookback can hit right as you enroll
Years with one-time income events
The early RMD years if your IRA is large
My advisor note: don’t let the tail wag the dog
We don’t avoid a good tax move solely because of IRMAA. But we do quantify it. Sometimes paying a bit more for Medicare is worth it to reduce lifetime taxes. Sometimes it’s not.
RMDs and estate coordination: the “future tax bill” you can see coming
If you have significant traditional IRA/401(k) balances, required minimum distributions are not a small detail. They’re a major driver of taxes in your 70s and beyond.
RMDs (plain English)
Starting at age 73 for most retirees, the IRS requires you to withdraw a minimum amount each year from traditional retirement accounts. The amount is based on your age and account balance.
If you don’t take the RMD, the penalty can be 25% of the amount you should have withdrawn.
The planning issue isn’t just the rule. It’s the ripple effects:
RMDs increase taxable income
Higher taxable income can increase taxes on Social Security
Higher income can trigger Medicare IRMAA surcharges
Large RMDs can push you into higher tax brackets later in life
This is why we often talk about “tax bracket creep” in your 70s.
We built a supporting guide on RMD planning here: /post/blog-rmd-planning-avoid-tax-bracket-creep
Estate planning considerations for $500K–$5M households (what actually matters)
At this asset level, estate planning is usually less about federal estate tax and more about:
Making sure assets transfer cleanly and privately
Avoiding accidental disinheritance or beneficiary mistakes
Coordinating IRA beneficiary rules (which can create big tax bills for heirs)
Planning for incapacity (powers of attorney, healthcare directives)
Reducing family friction with clear instructions
A few high-impact estate checkpoints
Beneficiary forms beat your will for retirement accounts. If your IRA beneficiary form is outdated, your will won’t fix it.
Traditional IRA dollars are “tax-loaded.” Your heirs may owe income tax as they withdraw inherited IRA funds.
Roth dollars are often more “heir-friendly” from a tax standpoint.
Trusts can be helpful, but they must be coordinated carefully with retirement accounts.
My advisor note: the best estate plan is coordinated, not expensive
A simple, well-coordinated plan (beneficiaries, titling, powers of attorney, and a clear intent) often beats a complex plan that isn’t maintained.
The retiree questions that matter most right now (straight answers)
How can I create a tax-efficient withdrawal strategy for my retirement?
Start by mapping your income needs and your three tax buckets (taxable, traditional IRA/401(k), Roth). Then decide, year by year, which bucket to draw from to meet spending while managing your tax bracket and Medicare IRMAA exposure. For many households, the “best” strategy changes over time—especially before and after Social Security and RMDs.
For a deeper framework, see /post/blog-tax-efficient-withdrawal-strategies-order-of-operations.
What are the required minimum distributions for my retirement accounts?
RMDs are mandatory withdrawals from traditional IRAs and most 401(k)s starting at age 73 for most retirees. The amount is calculated using IRS life expectancy tables and your year-end account balance. Missing an RMD can trigger a 25% penalty on the amount not withdrawn.
If you’re trying to avoid future tax bracket creep, see /post/blog-rmd-planning-avoid-tax-bracket-creep.
How can I optimize my Social Security benefits given my substantial savings?
If you can afford to delay, delaying benefits (especially for the higher earner in a couple) can increase lifetime income and improve the survivor benefit. The key is coordinating the delay with your portfolio withdrawals and tax plan so you don’t create a higher-tax problem later.
For a tailored guide, see /post/blog-social-security-optimization-high-net-worth.
What estate planning steps should I take with $500K to $5M in assets?
Prioritize the basics that prevent expensive mistakes: updated beneficiary designations, correct account titling, powers of attorney, healthcare directives, and a will or trust that matches your intent. Then coordinate IRA beneficiary strategy with your tax plan so heirs aren’t surprised by taxable inherited IRA withdrawals.
How can I protect my retirement assets from inflation?
Inflation protection is usually a portfolio-and-spending plan, not a single product. Keep long-term growth exposure (often stocks), stabilize near-term spending with cash/bonds, and avoid locking your entire plan into low-yield assets. The right mix depends on how much of your spending is flexible and how much is covered by guaranteed income.
If you want to go deeper on the risk side, see /post/blog-asset-allocation-retirement-sequence-risk.
Your timeline: three planning phases that change the rules
Retirement planning isn’t one season. It’s three different games.
Phase 1: Ages 55–65 (the runway)
This is where you can still shape the future.
Key moves:
Stress-test your retirement date and spending plan
Decide how you’ll fund the gap to Medicare and Social Security
Review account structure and investment risk before the “sequence risk” years
Start tax planning with an eye toward future RMDs
Watch-outs:
Retiring without a clear healthcare cost plan
Taking too much risk because “I can’t afford to be conservative”
Phase 2: Ages 65–73 (Medicare + the conversion window)
This is the coordination phase.
Key moves:
Choose Medicare coverage intentionally and review annually
Manage IRMAA exposure when doing conversions or large withdrawals
Consider partial Roth conversions if you’re in a lower bracket than your future self
Plan Social Security timing as part of the tax plan, not separate from it
Watch-outs:
Large one-time income events that create Medicare premium surprises
Turning on Social Security without understanding tax interactions
Phase 3: Age 73+ (RMD era)
This is where the IRS starts “choosing” your income.
Key moves:
Integrate RMDs into your withdrawal plan
Use charitable strategies if appropriate (like QCDs)
Revisit asset location (which assets sit in which account type)
Update estate and beneficiary coordination as accounts change
Watch-outs:
Letting RMDs push you into higher brackets without a plan
Ignoring beneficiary designations as life changes
A practical action list: what I’d do in the next 30 days
If you’re within 10 years of retirement (or already retired) and you have $500K–$5M invested, here’s a high-impact checklist that doesn’t require you to become a tax expert.
- Write down your “retirement paycheck” target
One number for baseline spending.
One number for comfortable spending.
- List your accounts by tax bucket
Taxable brokerage total
Traditional IRA/401(k) total
Roth total
Include approximate cost basis for taxable if you know it (what you paid vs what it’s worth).
- Identify your next three irreversible decisions
Most households have some combination of:
Social Security start date
Medicare enrollment and plan choice
Roth conversion plan (yes/no and how much)
When to start RMD planning moves
- Run a simple “bad early market” test
Ask: If markets drop 20–30% in the first two years of retirement, what would we spend from so we’re not forced to sell stocks at a loss?
If you don’t have a clear answer, your portfolio risk plan needs work.
- Do an IRMAA check before any big income year
If you’re doing a large Roth conversion, selling a property, or taking a big IRA withdrawal, confirm whether it could raise Medicare premiums two years later.
- Clean up beneficiaries and powers of attorney
Make sure retirement accounts, bank accounts, and insurance policies have updated beneficiaries.
Confirm you have durable power of attorney and healthcare directives.
- Draft a one-page withdrawal roadmap
Not a perfect plan—just a draft:
What will we spend from first?
When do we turn on Social Security?
Do we plan Roth conversions before 73?
How will RMDs fit in later?
This one page will expose gaps fast.
My closing perspective as a fiduciary
If you’re in the $500K–$5M range, retirement planning is less about finding a magic investment and more about avoiding unforced errors.
The households who retire well usually do three things consistently:
They coordinate taxes, Medicare, and Social Security instead of treating them as separate projects.
They build an income plan that can survive a rough market early on.
They keep the plan simple enough to follow, and they revisit it as rules and life change.
If you want help turning your accounts and goals into a clear, tax-aware withdrawal and Roth conversion roadmap—with Medicare and Social Security coordination—schedule a Retirement Readiness & Tax-Aware Withdrawal Plan review with Grape Wealth Management.
Book an appointment here: http://grapewealthmanagement.salesmate.io/meetings/#/grapewealthmanagement/user/1