1.
Workshop setup
Free CPU and GPU options
2.
What's New in PyTorch 2.0?
3.
Using torch.compile()
3.1 A simple example
3.2 Benchmarking Resnet
3.3 Benchmarking Huggingface
4.
What happens under the hood?
4.1 Inspecting torch.compile()
5.
Profiling your compiled code
5.1 Profiling torch.compile()
Links
Notebooks on GitHub
Contact: shashankprasanna.com
What happens under the hood?
In this section we’ll take a look at what’s happening under the hood
What happens under the hood?
In this section we’ll take a look at what’s happening under the hood
We’ll discuss
How to enable debug mode
Visualize computational graphs before and after optimizations
See generated optimized C++/CUDA code