Proceedings · Session S-181 · filed September 26, 2026

AI & Emerging Tech in R&DSession paper

AI Workloads Push Silicon Past Monolithic Limits: The Case for Co-Design

AI workloads are pushing silicon past monolithic limits, driving a shift to 2.5D and 3D multi-die stacks where overdesign gives way to co-designed logic, memory and interconnect.

By Sophie Lindqvist3 min read673 words

Summary

  • AI training and inference demand simultaneous gains in compute, memory bandwidth and energy efficiency that monolithic chips cannot deliver
  • The industry is shifting from monolithic architectures to 2.5D and 3D multi-die designs stacking logic, memory and data pathways vertically
  • The analysis argues overdesign-based engineering must give way to co-design of dies and interconnects as physics becomes the binding constraint
AI chips are stressing the laws of physics: Why overdesign must yield to co-design
FigureAI chips are stressing the laws of physics: Why overdesign must yield to co-design — AI-generated

The AI era is changing what the industry asks of silicon. Training and inference workloads now demand semiconductors that deliver more compute, greater memory bandwidth and better energy efficiency simultaneously — three requirements that monolithic chip architectures are increasingly unable to satisfy together.

The industry's response, as laid out in a new analysis from Research & Development World, is a structural shift: a move away from monolithic designs toward 2.5D and 3D multi-die architectures that stack logic, memory, and the data pathways between them vertically.

For R&D managers tracking semiconductor roadmaps, the significance is portfolio-level. The monolithic approach — fabricating a full processor as a single large die — bundles every function onto one piece of silicon. That model carried the industry through decades of scaling. AI workloads have broken the assumption behind it. When models require data to move constantly between compute and memory, the bottleneck is no longer transistor count alone. It is bandwidth between logic and memory, and the energy cost of moving data across a chip. Stacking dies vertically shortens those pathways.

The framing in the source analysis is blunt: physics itself is the constraint. AI chips, in the piece's phrasing are "stressing the laws of physics." That claim deserves the same scrutiny any vendor or institute claim would. It is an engineering claim, not a measured result — but it reflects a widely documented trend: as performance targets climb, the margins that overdesign once bought have narrowed to the point where brute-force redundancy no longer pays for itself.

Overdesign versus co-design

The central argument turns on two words in the title: overdesign must yield to co-design.

Overdesign is the traditional risk-management strategy. Engineers specify components with headroom — more margin, more redundancy, more capability than the expected workload requires — to guarantee the design survives worst-case conditions. Under AI-era constraints, that headroom carries costs that no longer fit within power and bandwidth budgets.

Co-design, by contrast, means designing the components of the system — logic dies, memory dies, and the interconnects between them — jointly rather than independently. In a multi-die stack, each element is optimized against the others. Memory sits closer to compute. Data pathways are engineered as part of the architecture, not routed around a monolithic layout after the fact.

What this means for lab and engineering budgets

For R&D managers, the shift raises concrete planning questions. Multi-die architectures change procurement, qualification and validation workflows. A stacked system is not a single die with known specifications; it is an assembly of dies whose combined behavior depends on interconnect quality, thermal management across layers, and yield across multiple components rather than one.

The move also changes where engineering effort concentrates. If memory bandwidth and interconnect efficiency are the binding constraints, then tooling, simulation and test investments that target those interfaces will return more than additional spending on raw logic performance. Teams that still budget around monolithic metrics may be optimizing a parameter that no longer sets system performance.

Caveats on the source

The Research & Development World piece is an analytical argument, not a report of a specific measured result, trial or funding milestone. It names no vendors, cites no sample data and reports no benchmark figures in the summary available. Readers evaluating the thesis should treat it as a synthesis of an industry direction — the turn toward 2.5D and 3D stacking and co-design methodology — rather than as primary evidence of any single architecture's measured performance.

The claims it advances, however, align with the observable architectural direction of major AI accelerator programs, and the underlying physics argument — that data movement costs increasingly dominate — has support across the field.

The analysis positions co-design not as an option but as the successor model: as AI workloads continue to demand more compute, bandwidth and efficiency from the same silicon, the industry's next generation of chips will be defined less by how much engineers can add to a design, and more by how tightly they can design the pieces together.

via R&D World (Source)

Filed under

  • semiconductors
  • ai-workloads
  • chip-architecture
  • 2-5d-3d-stacking
  • co-design
Share this article:

More from Sophie Lindqvist

Sophie Lindqvist

Show full bio

Correspondent covering business strategy at Hypothesis Wire.

86 articles

References

  1. SK hynix takes IEEE corporate innovation award for HBM work
  2. AMD Commits £2 Billion to UK AI and Research Infrastructure
  3. SK Hynix Takes IEEE Corporate Innovation Award for HBM Leadership
  4. AI Data Center Buildout Runs on Debt: Nearly $500 Billion Issued
  5. SK hynix Takes IEEE Corporate Innovation Award for AI Memory

Next article »