Meow reposted this
This founder decided to compete with incumbents worth a combined $10 trillion and build an AI-native cloud provider from scratch: "When I was doing machine learning at Spotify, 90% of the work was just building the infrastructure, not the application. And traditional infrastructure is not built for fast feedback loops. When you're building with AI, it's really annoying to test locally and then deploy into production. You can split it into two environments, but then you run into the problem of switching between them. This wasn't a problem pre-AI. But now, you have GPU's and very large models that take a long time to load. So this initiation step takes a very long time. We built Modal to enable fast feedback loops. I can hit enter, and run immediately in the cloud. This also lends well to running AI apps in the cloud. Because no traditional cloud provider has capacity to handle dynamic GPU scaling needed for running inference. We ultimately ended up creating an entirely new cloud provider, native to AI." Check out my full conversation with Erik Bernhardsson below, going behind the scenes of the great GPU shortage, how Modal solved AI's inference problem, and lessons on hiring and culture from joining Spotify as the 40th employee. YouTube: https://lnkd.in/ehqbPw7s Spotify: https://lnkd.in/eBKnyXki Apple: https://lnkd.in/enxEBZCV