Sessions Index

PL1 Plenary Speech I Energy-Efficient AI Hardware - Beyond the Exit of the Device Miniaturization Tunnel by Dr. H.-S. Philip Wong

Oct. 19, 2026 09:50 AM - 10:40 AM

Room: 台北漢來飯店鉑金廳B ( Grand Hilai Taipei 3F, Platinum Grand Ballroom B)
Session chair: Shin-Puu Jeng, General Chair, IMPACT-IAAC 2026

Energy-Efficient AI Hardware - Beyond the Exit of the Device Miniaturization Tunnel
發表編號:PL1-1時間:09:50 - 10:40

Invited Speaker

Speaker: H.-S. Philip Wong, Willard R. and Inez Kerr Bell Professor, Stanford University


Bio:

H.-S. Philip Wong is the Willard R. and Inez Kerr Bell Professor in the School of Engineering at Stanford University. He joined Stanford University as Professor of Electrical Engineering in 2004. From 1988 to 2004, he was with the IBM T.J. Watson Research Center. From 2018 to 2020, he was on leave from Stanford and was the Vice President of Corporate Research at TSMC, the largest semiconductor foundry in the world, and since 2020 remains the Chief Scientist of TSMC in a consulting, advisory role. He is a member of the National Academy of Engineering and a Fellow of the IEEE. He received the IEEE Andrew S. Grove Award, the IEEE Technical Field Award to honor individuals for outstanding contributions to solid-state devices and technology, as well as the IEEE Electron Devices Society J.J. Ebers Award, the society’s highest honor to recognize outstanding technical contributions to the field of electron devices that have made a lasting impact. He is the Principal Investigator of the Microelectronics Commons California-Pacific-Northwest AI Hardware Hub, a consortium of over 60 companies and academic institutions funded by the CHIPS Act. He was a member of the US Department of Commerce Industrial Advisory Committee on microelectronics. He serves on the Executive Committee of the UC Berkeley think tank Technology Competitiveness and Industrial Policy (TCIP) Center.



Abstract:

For the past fifty years, researchers of semiconductor technology have felt like walking inside a tunnel. There was a single path forward – two-dimensional down-scaling of device sizes, also referred to as 2D miniaturization. With device features approaching atomic scale, semiconductor technology has reached the exit of this tunnel. The future is bright at the exit of the tunnel as there are many possible paths that create new opportunities for architectures that are extremely difficult (or even impossible) to implement using existing technology approaches that rely mainly on 2D miniaturization. It is no longer possible to draw a clear boundary between design and fabrication, nor can we treat wafer fabrication and advanced packaging as separate technologies. Many innovations across the entire system stack – from architectures to circuits, devices, packaging, fabrication processes, and materials – will provide large multiplicative benefits at the system level. There will be a change to the supplier-integrator and fabless-foundry ecosystems that have been in place for over 30 years.

Specifically, AI computation benefits tremendously simply by having more on-chip memory capacity. To derive the highest energy efficiency, not only the chip architecture needs to be application domain specific, but the memory technologies must also be application domain-specific to capture the highest benefits while incurring the lowest impact on latency, bandwidth and cost. More importantly, these memory technologies can be integrated on Si logic chips to arrive at a computing system that integrates multiple heterogeneous device technologies in a 3D monolithic, stacked, assembled integrated circuit that smoothly transition from wafer level to package level technologies. Advanced packaging technologies have the potential to further increase the memory bandwidth by about 1,000×.

Acknowledgements: This work is supported in part by Department of Defense Microelectronics Commons California-Pacific-Northwest AI Hardware Hub, National Science Foundation (award number 2235329), SRC JUMP 2.0 CHIMES Center and PRISM Center, and member companies of the Stanford SystemX Alliance, Stanford Non-Volatile Memory Technology Research Initiative (NMTRI), and the Stanford Differentiated Access Memory (DAM) industry affiliate programs. We gratefully acknowledge the sustained support of our industry sponsors and collaborators. Abstract prepared with assistance from Shuhan Liu (Stanford, Yale).


 


Organizer

 

 

Co-Organizer

                   

 

 

Partner

           

 

 

Co-hosting Event - TPCA Show 2026