Lightning Talk: Harnessing NVIDIA Tensor Cores: An Exploration of CUTLASS & OpenAI Triton - Matthew Nicely US, NVIDIA
Discover the power of NVIDIA Tensor Cores and accelerate your PyTorch development using two cutting-edge open-source libraries: CUTLASS and OpenAI Triton. This presentation aims to inspire both novice and seasoned PyTorch developers to unlock new efficiencies and capabilities in their work. We delve into the architecture of CUTLASS, revealing its diverse use cases and value proposition. Simultaneously, we explore Triton's transformative capabilities for NVIDIA Tensor Cores, and the roadmaps for these essential tools. I hope to inspire the audience to engage with these tools for their projects, contributing to a high-performing PyTorch community.