Local AI Development with Foundry Local

Discover how to run powerful AI models entirely on-device using Foundry Local. We’ll cover the architecture, how to compile Hugging Face models for local execution, and how to integrate everything with LangChain.js. You’ll also see a compact Android demo showcasing low-latency, offline AI experiences. By the end, you’ll know how to set up, optimize, and build local-first AI apps, and how to join the private preview to go deeper. 🔗 The Java Script AI Build-a-thon: https://aka.ms/JSAIBuildathon 📌 This session is a part of a series, learn more here: https://aka.ms/JS-Buildathon Chapters: 0:04 Welcome & Session Housekeeping 0:52 Speaker Introduction & Buildathon Overview 1:33 Audience Roll Call & Global Participation 2:27 What Is the JavaScript AI Buildathon? 3:45 Program Goals & Why JavaScript for AI 4:20 Buildathon Phases & Learning Structure 5:20 Live Stream Schedule & Upcoming Sessions 6:18 Community Spaces: GitHub & Discord 7:30 Today’s Speakers & Session Focus 8:06 Local AI Development Overview 9:25 Why Run AI Locally? Edge, Privacy & Cost 10:36 What Is Foundry Local? 11:13 Foundry Local Architecture Explained 12:43 Self‑Contained Apps & SDK Benefits 15:43 Foundry Local Roadmap & Platform Support 17:01 OS, Language & Hardware Support 18:22 Mac & Windows Optimization Details 20:22 Device‑Specific Model Selection 21:17 Model Catalog & Optimization Standards 22:23 Bringing Custom & Third‑Party Models 23:23 Microsoft Olive & Model Optimization 25:03 JavaScript SDK Walkthrough 27:09 Model Portability & Performance Tuning 29:37 Using External & Fine‑Tuned Models 31:05 Windows AI PCs & Accelerators 33:09 Multi‑Model & Multi‑Agent Scenarios 35:00 Audio, Speech & Real‑Time AI Roadmap 37:53 Foundry Local CLI Demo 42:04 Digital Twin HVAC Demo 47:25 Game Development with Local AI 49:59 Olive Recipes & Model Distillation 52:49 Q&A: Enterprise, Security & Use Cases 59:07 Fine‑Tuning vs RAG vs Prompting 1:00:02 Discord AMA & Buildathon Resources 1:03:36 Wrap‑Up & Feedback #MicrosoftReactor #learnconnectbuild [eventID:26772]