In this seminar, Mark Russinovich, Azure CTO and Technical Fellow, gave an under-the-hood look at Microsoft’s AI architecture, including the large-scale supercomputers that train foundational models and the infrastructure that efficiently serves small and large pretrained and fine-tuned models. He covered everything from how the company designs servers, to the AI-aware resource management service that schedules training and inference, to the AI-specific techniques it’s developed for maximizing GPU usage. He also gave insight into advancements and opportunities in trending AI research and confidential AI.
This HAI Seminar took place on March 6, 2024. Upcoming HAI Events can be found here: hai.stanford.edu/events