This is the archive of our weekly newsletter. We are hoping to build the largest ML system design community on the internet! We would love for you to join us.

We provide a weekly round-up of the best Machine learning systems and distributed architecture. Learn how the best engineers scale their ML systems. Delivered every Sunday straight to your inbox!

#4 How Yelp predicts Wait Time for your favourite restaurant?
Introduction In this article, I will describe how Yelp predicts the waiting time for restaurants around the world. In this setting, latency of the system is paramount: when users want to know the current waiting time, they expect an immediate answer. However, they don’t particularly care for the s…
#3 Technical debt in Machine learning systems has very high interest rate.
Introduction The harsh reality of new graduates joining a Machine learning team is that the “model development” part of the job dwarfs in comparison to everything else the team needs to support. The priority of the team is often: improving models’ up-time, optimizing the data pipeline, adding new…
#2 How TikTok Real Time Recommendation algorithm scales to billions?
Introduction In today’s article, I am going to dive deep into the paper [1] published by TikTok engineers describing how TikTok real time recommendation system is built. The paper has many topics that are worth learning in more detail, but I am going to focus on: * How the design supports
#1 What is my plan with Machine learning at scale?
Hey! I am Ludo. I am a machine learning engineer at Google. I have created “Machine learning at scale” to talk about ML systems in the real world. I find that the majority of online ML content is divided in these two groups: * Introduction to model X in Python. * An