Suvinay Subramanian
Senior Staff Engineer @ Google
Email: suvinay@csail.mit.edu
- 👨💻 Building AI Supercomputers (TPUs)
- 🎓 EECS Ph.D., S.M. @ MIT | EE B.Tech @ IIT-Madras
- 🎙️ Co-host the Computer Architecture Podcast
- 🔖 Interests: Music | Trivia | Word Games
CV • Scholar • LinkedIn • Twitter(X)
About Me
[More]I am a Senior Staff Engineer at Google, building AI supercomputing systems (TPUs). I work at the intersection of hardware, systems research, and performance engineering. Previously, I received my Ph.D. from MIT (EECS, CSAIL) and my undergraduate degree at IIT Madras. My work has been recognized with the ACM SIGMICRO Early Career Award in Computer Architecture and the IIT Madras Young Alumni Achiever Award.
Podcast
[More]I co-host the Computer Architecture Podcast with Lisa Hsu — conversations with leading researchers and practitioners in computer architecture.
Interests
[More]I give technical talks on TPUs at universities and conferences. I am passionate about music: perform with bands, and support the arts through operating roles in Bay Area music organizations (e.g., South India Fine Arts).
Select Publications
[More]-
Learning to Keep a Promise: Scaling Language Model
Decoding Parallelism with Learned Asynchronous Decoding
Tian Jin, Ellie Y. Cheng, Zack Ankner, Nikunj Saunshi, Blake M. Elias, Amir Yazdanbakhsh, Jonathan Ragan-Kelley, Suvinay Subramanian, Michael Carbin
ICML 2025 [X (Twitter) Thread]
-
TPU v4: An Optically Reconfigurable Supercomputer for Machine
Learning with Hardware Support for Embeddings
Norman P. Jouppi, George Kurian, Sheng Li, Peter Ma, Rahul Nagarajan, Lifeng Nai, Nishant Patil, Suvinay Subramanian, Andy Swing, Brian Towles, Cliff Young, Xiang Zhou, Zongwei Zhou, David Patterson
ISCA 2023 (Industry Track)
-
FLAT: An Optimized Dataflow for Mitigating
Attention Bottlenecks
Sheng-Chun Kao, Suvinay Subramanian, Gaurav Agrawal, Amir Yazdanbakhsh, Tushar Krishna
ASPLOS 2023
-
Fractal: An Execution Model
for Fine-Grain Nested Speculative Parallelism
Suvinay Subramanian, Mark C. Jeffrey, Maleen Abeydeera, Hyun Ryong Lee, Victor A. Ying, Joel Emer, Daniel Sanchez
ISCA 2017
MIT News Article, Hacker News Discussion