Shaping the Future: The Transformation of the Server Industry

### Unpacking the True Cost of Servers: It’s Not Just About the Chips

Hey there! Have you ever paused to wonder about all the buzz around AI, data centers, and this seemingly magical “cloud” everyone’s talking about? Well, let me share something that might just add a bit more to your wonder. When you hear folks talk about the cost of servers, what’s the first thing that pops up in your mind? If you’re like most, you’d probably think processors – you know, GPUs and CPUs – are the wallet-busters. But, surprise, surprise, they account for only about 20% of a server’s upfront cost. Those shiny chips might hog the limelight, being the first pick in the server build draft, but there’s so much more to the story.

### The Unsung Heroes: Beyond the Brain of the Server

And then there’s memory, tagging along at another 20%. But hold on, because we’ve barely scraped the surface. The bulk of the server cost – yes, we’re talking more than half – is all about the less glamorous but equally crucial components. Picture this: printed circuit boards (PCBs), those humble passive components, the labyrinth of cables, power supplies, hard drives, and the racks cradling them all. And let’s not forget about networking – a titan in its own right, but we’ll save that saga for another day. So, who’s behind the curtain selling all this gear, and where’s the real value cooking?

### The Tale of Two Vendors: OEMs and ODMs

In this grand server theater, we have two leading roles – OEMs and ODMs. Now, I could throw at you what these acronyms stand for, but let’s not get tangled in alphabet soup. In the simplest terms, OEMs are the brand chiefs holding the reins to customer relationships, while ODMs are the master builders, the ones giving physical form to all this tech. The lines between them? Blurry, with a lot of back-and-forth in design and systems integration.

#### A Quick Stroll Down Memory Lane

This whole setup didn’t just pop up overnight. It dates back to the 90s, when PC manufacturing took a long haul flight from the US to Asia. Initially, PC brands outsourced manufacturing to contract manufacturers in Taiwan, which eventually evolved, scaling up the value chain to become ODMs. They started adding their own flair with design capabilities and, eventually, some branched out as OEMs themselves. And this, my friends, is the blueprint for how high-volume electronics roll off the production lines today.

#### Servers: A Different Beat

Servers danced to a different tune, with OEMs clinging to design and sometimes manufacturing duties for an extra while. Cloud computing, however, changed the game, bringing the hyperscalers into the limelight. These giants, with their massive economies of scale, started designing their own servers and sourcing directly from ODMs, sidelining traditional OEMs.

#### The Divide: Hyperscalers vs. The Rest

Today, big names like HP, Dell, and Lenovo dominate the OEM landscape, with a myriad of ODMs, mainly based in Taiwan, pulling the strings behind the scenes. But there’s a growing divide – hyperscalers versus, well, everyone else. While the likes of massive corporations still partner with OEMs for their server needs, hyperscalers play by their own rules, designing servers to meet their bespoke needs and going straight to ODMs for the build.

#### The Chip Conundrum

But here’s a twist – convincing someone to buy your chip is no walk in the park. It’s not just about the chip; it’s about the whole system. Designing a system that meets customers’ specific needs isn’t cheap, and the costs can skyrocket. And with the rise of AI and a growing list of CPU designers, the complexity, and the stakes, are higher than ever.

### Looking Ahead: Navigating the Chaos

The server landscape is undergoing a seismic shift, forcing everyone, from chip designers to component vendors, to take calculated risks. Some chase every deal, while others might stick to familiar grounds with AMD, Intel, and Nvidia. The smart ones? They’re taking a portfolio approach, closely monitoring their choices like savvy investors. Despite the current turbulence, it’s just the tech world doing its thing – evolving. Rest assured, a new equilibrium is on the horizon, but brace yourself for a bit of chaos in the meantime.

So, the next time you hear about the costs of servers, remember, there’s a whole universe beyond those flashy processors. It’s a complex, interconnected ecosystem that keeps our digital world spinning.

Scroll to Top