Is Cloud Migration Worth the Cost, Really?

by Daniel Reeves
Is Cloud Migration Worth the Cost, Really?

Three years ago, a friend of mine who ran a mid-sized logistics company called me in something close to a panic. His IT director had just handed him a migration proposal — forty-seven pages, dense with architecture diagrams and acronyms — and a price tag that made him set the document down slowly, the way you set down a glass you're afraid of spilling. The number wasn't outrageous by enterprise standards. But it was real money, and he wanted someone to tell him whether it was money well spent.

I didn't have a clean answer for him then. I'm not sure I have one now. But I've spent enough time watching companies make this move — some gracefully, some in a slow-motion stumble — that I've developed a few strong opinions about what the honest accounting actually looks like. So let's have that conversation properly, because the question of whether cloud migration is worth the cost deserves more than a vendor's slide deck.

The Promise That Sold a Generation of CTOs

The pitch has always been elegant in its simplicity: stop paying for servers you own, start paying for capacity you use. Trade capital expenditure for operational expenditure. Let someone else worry about the hardware refresh cycle, the cooling bills, the 3 a.m. disk failures. On paper, the math flatters the cloud every time.

And for a certain class of company — early-stage startups, organizations with wildly variable workloads, teams without the headcount to maintain serious on-premise infrastructure — the math holds up reasonably well in practice too. I've watched small engineering teams ship products at a pace that would have been impossible if they'd had to requisition physical servers first. That's a genuine, measurable advantage, and I don't want to wave it away.

But the pitch was also sold to companies for whom it was never quite the right fit. Enterprises with steady, predictable workloads. Organizations with compliance requirements that made multi-tenant environments complicated. Businesses that had already amortized their hardware over a decade and were running it efficiently. For them, the elegant simplicity of the pitch concealed a more tangled reality.

Where the Budget Goes to Hide

The migration cost itself is rarely the whole story — it's the opening act. What follows is what catches people off guard.

There's the retraining. Your infrastructure team, the people who spent years learning to manage your on-premise environment, now need to become fluent in a cloud provider's particular flavor of networking, identity management, and cost tooling. That's not a weekend seminar. That's months of reduced productivity, external consultants filling gaps, and the quiet exodus of engineers who decide this isn't the career pivot they signed up for.

There's the refactoring. The applications that were designed to run on hardware you owned don't always behave well when you lift them into the cloud unchanged. The classic lift-and-shift approach — take what you have, move it as-is — tends to produce cloud bills that shock finance teams, because applications built for dedicated servers often idle inefficiently when billed by the millisecond. To capture real savings, you frequently need to re-architect, and re-architecting costs money and time before it saves either.

And then there's the bill itself, which has a way of expanding in directions no one quite anticipated. Data egress fees. The cost of logging and monitoring at scale. The support tier you had to upgrade because a production outage needed a human on the phone. Cloud pricing is genuinely complex — deliberately so, some would argue — and organizations that didn't invest in dedicated FinOps practices often find themselves paying for capacity they don't need, running resources they forgot to turn off, and discovering that the reserved instance discounts they planned around require a commitment that no longer matches their actual usage.

A 2023 survey by Andreessen Horowitz found that cloud costs had become one of the top three infrastructure concerns for software companies, and that a meaningful percentage of those companies were actively repatriating workloads — moving them back on-premise — after finding that the economics didn't pan out. That's not a fringe phenomenon anymore. It's a pattern.

The Counter-Argument You Have to Sit With

Here's where I have to be honest about the other side, because it would be too easy to write a piece that just validates everyone who ever felt burned by a cloud bill.

The companies that struggle most with cloud costs are often the ones that migrated without a strategy. They moved because a consultant told them to, or because a competitor announced they had, or because the board had heard the word "modernization" enough times that it started to feel like a mandate. They didn't ask hard questions about which workloads actually benefit from elasticity. They didn't build the internal competency to manage cloud spend before they incurred it. They treated migration as a destination rather than a practice.

The companies I've seen get genuine value from the cloud — durable, compounding value — tend to share a few qualities. They moved incrementally, starting with workloads that were genuinely cloud-native in character. They invested in the unglamorous work of tagging resources, setting budget alerts, and building internal tooling to surface waste before it accumulated. They treated the cloud not as a place to put their existing infrastructure but as a different model of computing that required different habits.

When those habits are in place, the advantages are real. The ability to spin up a new environment for testing in minutes, not weeks. The capacity to absorb a sudden spike in traffic without a capital conversation. The geographic distribution that would have required multiple data center leases now available as a configuration option. These aren't trivial. For the right organization, they're worth paying for.

The honest answer to whether cloud migration is worth the cost, then, is that it depends almost entirely on whether you're buying the capability or just buying the bill.

What My Friend Eventually Did

He didn't migrate. Not all the way, not yet.

What he did instead was spend six months doing something the forty-seven-page proposal hadn't suggested: auditing what he actually had. It turned out that roughly a third of his on-premise workloads were good candidates for cloud migration — variable in their demand, tolerant of the refactoring work, and currently running on hardware that was approaching end-of-life anyway. Another third were steady-state systems that had been running efficiently for years and would cost more in the cloud than they did on-premise. The final third were somewhere in the middle, and the right answer for them depended on decisions the business hadn't made yet about product direction.

He migrated the first third. He refreshed the hardware on the second. He left the third alone until the picture clarified.

His cloud bill is real. His on-premise costs didn't disappear. But he's not paying for a migration that didn't need to happen, and he's not running a hybrid environment held together by regret. The savings aren't dramatic. The stability is.

I think about that outcome when I hear the question framed as a binary — cloud or not cloud, worth it or not worth it. The framing itself is part of the problem. Cloud migration is worth the cost when it's scoped to the workloads where it earns its keep, managed with the discipline that any significant infrastructure investment demands, and treated as a continuous operational practice rather than a one-time project you hand off and forget.

The companies that got burned didn't necessarily make the wrong technology choice. Many of them made the right technology choice at the wrong scope, at the wrong speed, without the right habits in place to manage what they'd bought.

Is cloud migration worth the cost? Ask me again after you've looked hard at what you're actually migrating, and why, and who's going to manage the bill once the consultants have gone home.