Why I joined Modular AI?
Friday, June 23, 2023 in Personal Blog
In the past decade, I’ve had the very good fortune of working for companies that make some of the best and proven developer productivity tools. If you’re an engineer who’s built control systems for rockets, cars or robots …
Benchmarking Modular Mojo🔥 and PyTorch torch.compile() on Mandelbrot function
Monday, May 08, 2023 in Personal Blog
Last week, Modular - an startup co-founded by Chris Lattner (of LLVM, Swift, MLIR fame), announced a brand new high-performance language called Mojo🔥. Mojo🔥 looks and reads like Python but that’s only on the surface, underneath the familiar …
How Pytorch 2.0 accelerates deep learning with operator fusion and CPU/GPU code-generation
Sunday, April 30, 2023 in Personal Blog
Computer programming is magical. We write code in human readable languages, and as though by magic, it gets translated into electric currents through silicon transistors making them behave like switches and allowing them to implement complex logic — …
What is an AI accelerator?
Wednesday, January 11, 2023 in Personal Blog
An AI accelerator is a dedicated processor designed to accelerate machine learning computations. Machine learning, and particularly its subset, deep learning is primarily composed of a large number of linear algebra computations, (i.e. …
AI Accelerators and Machine Learning Algorithms: Co-Design and Evolution
Friday, September 09, 2022 in Personal Blog
If you told me a few years ago that data scientists would be using Docker containers in their day to day work, I wouldn’t have believed you. As a member of the broader machine learning (ML) community I always considered Docker, Kubernetes, Swarm …
How Docker Runs Machine Learning on NVIDIA GPUs, AWS Inferentia, and Other Hardware AI Accelerators
Wednesday, August 24, 2022 in Personal Blog
If you told me a few years ago that data scientists would be using Docker containers in their day to day work, I wouldn’t have believed you. As a member of the broader machine learning (ML) community I always considered Docker, Kubernetes, Swarm …
Automatically generate code and documentation using OpenAI CODEX
Monday, August 01, 2022 in Personal Blog
We’ve all dealt with the frustration of poor or incomplete documentation in software projects. In their 2021 state of the Octoverse survey, GitHub found that easy to use documentation, boosted developer productivity by 50% and improved …
AWS GPU instances complete list
Thursday, June 02, 2022 in Personal Blog
Here is a complete list of all Amazon EC2 GPU instance types on AWS that I’ve painstakenly compiled, because you can’t find this information anywhere on AWS. In the tabular format below, you’ll find more detailed information about …
Best GPUs on AWS for Deep Learning
Wednesday, May 11, 2022 in Personal Blog
Here are 5 GPU instance recommendations on AWS that should serve majority of deep learning use-cases. For a complete deep dive into choosing the right GPU for deep learning on AWS, read my blog post: Choosing the right GPU for deep learning on AWS …
A complete guide to AI accelerators for deep learning inference — GPUs, AWS Inferentia and Amazon Elastic Inference
Wednesday, October 21, 2020 in Personal Blog
Let’s start by answering the question “What is an AI accelerator?” An AI accelerator is a dedicated processor designed to accelerate machine learning computations. Machine learning, and particularly its subset, deep learning is primarily composed of …