AI Accelerators Push Power Delivery Closer to the Load

November 19, 2026

AI Accelerators Push Power Delivery Closer to the Load

Image: ChatGPT

Power delivery has become a major limiter in data-center chips as AIartificial intelligenceAI stands for artificial intelligence accelerators and GPUgraphics processing unitA GPU is a parallel graphics processor widely used for AI acceleration.s push toward lower supply voltages and much higher current levels. At around 0.7 V, a 600 W GPUgraphics processing unitA GPU is a parallel graphics processor widely used for AI acceleration. can demand 1000 A or more, making resistive losses, voltage droop, and power-integrity constraints increasingly difficult to control. Multi-chiplet designs intensify the problem further by raising current density and adding routing complexity.

The response is a shift to vertical power delivery networks, where voltage regulator modules are moved much closer to the load. Depending on the design, the regulator can sit under the PCBprinted circuit boardBoard that mechanically supports components and electrically interconnects them with copper traces., inside the accelerator package, or within the silicon interposer. This reduces the distance between conversion and load and limits the amount of low-voltage, high-current routing that has to be carried across the board or package.

The trend builds on backside power delivery networks on the wafer backside, which route power more directly to transistors and reduce IRinfrared drop across on-chip interconnect levels. That approach is being extended with on-die decoupling capacitors formed in deep trenches, but package, interposer, substrate, and rack-level effects are now just as important. Compact inductors and other passive devices are also opening the door to moving voltage conversion further into the package stack.

These architectures are no longer a single-discipline problem. Power delivery now has to be co-designed across the PDNpower delivery networkThe on-chip network that distributes supply current and voltage to logic blocks., interposer, PMICs, integrated voltage regulators, DC-DCdirect current to direct currentA converter that changes one DC voltage level to another. converters, capacitors, and other passives, together with custom HPC1. High Performance ComputingCompute applications with particularly high performance demands2. high-performance computingHPC denotes compute-intensive chips that require advanced testing support. devices, memory, and interconnects. The design task also expands simulation requirements, with OSAT1. Outsourced Semiconductor Assembly and TestA business model in which assembly and test services are provided by a specialized external supplier.2. outsourced assembly and testAn OSAT provider assembles, packages, and tests chips for other companies.s taking on a larger role in electrical validation, package-level modeling, and power-integrity co-simulation.

Integrated voltage regulators are becoming a central building block in that transition. Distributed IVRIntegrated Voltage RegulatorA regulator integrated close to the load to improve power delivery and transient response.s reduce IRinfrared drop by placing regulation much closer to the chip and can react to voltage droop events far faster than conventional approaches, with control-loop response times falling from milliseconds to microseconds. That finer-grained control also makes it possible to tune voltage more precisely across different areas of a chip.

The packaging side is moving in parallel. Intel Foundry’s 18 A was the first leading-edge high-volume manufacturing node to move backside wafer processing into production, while Samsung and TSMCTaiwan Semiconductor Manufacturing CompanyTSMC is named as a founding partner of the EPIC Center. plan backside PDNpower delivery networkThe on-chip network that distributes supply current and voltage to logic blocks.s for future advanced nodes. ASEAdvanced Semiconductor EngineeringASE is a semiconductor assembly and packaging company involved in the joint research program., Marvell, Empower, and others are also pushing voltage regulation closer to the processor, using increasingly compact capacitors and inductors to shrink the conversion path.

There are still important trade-offs. Bringing power structures into the backside, package, or interposer changes thermal paths and can introduce stress, warpage, and noise-coupling issues. High-current AIartificial intelligenceAI stands for artificial intelligence systems also require careful budgeting across die, package, and board, with foundries, fabless teams, substrate suppliers, and OSAT1. Outsourced Semiconductor Assembly and TestA business model in which assembly and test services are provided by a specialized external supplier.2. outsourced assembly and testAn OSAT provider assembles, packages, and tests chips for other companies.s each owning different parts of the power-delivery stack. In advanced AIartificial intelligenceAI stands for artificial intelligence accelerators, power integrity has become a first-order design constraint rather than a late-stage optimization target.

Source: Semiconductor Engineering

More background: How It Works

← All posts