Open-Source Spotlight - dstack - Andrey Cheptsov

dstack is an open-source alternative to Kubernetes, designed to simplify development and deployment of AI. It works with top cloud providers and on-prem servers, and supports NVIDIA, AMD, and TPU. In this demo, Andrey, the founder and CEO of dstack, introduces a new feature called SSH Fleets. This feature automates the developer workflow for running development environments, tasks, and services on a group of on-prem servers. SSH Fleets is a lightweight, universal, and AI-friendly alternative to Kubernetes and Slurm. It can also be combined with cloud fleets, allowing you to use any cloud or multiple clouds with dstack. GitHub repo: https://github.com/dstackai/dstack Documentation: https://dstack.ai/docs/ 00:41 Intro to dstack 02:04 Intro to SSH fleets 02:20 Fleet configuration 04:51 Creating a fleet with dstack apply 05:32 Show the state of the fleet 06:32 Basic scenarios 06:43 Dev environments 12:11 Tasks 16:11 Host requirements 19:43 Services 23:27 Gateways 29:53 Control plane UI 30:24 Model playground 32:04 Joining dstack Community Free ML engineering course: https://github.com/DataTalksClub/machine-learning-zoomcamp Join DataTalks.Club: https://datatalks.club/slack.html Our events: https://datatalks.club/events.html