PaLM Pathways Language Model explained | 540 Billion parameters can explain jokes!?

It’s time to explain PaLM, Google AI’s Pathways Language model in a coffee break! ☕ Are you ready for this 540 billion dense parameter model to explain jokes to you? But what about chain of thought reasoning? Or any other cool NLP task like the crazy ones listed in BIG Bench? SPONSOR: Weights & Biases 👉 https://wandb.me/ai-coffee-break 📺 Diffusion models and GLIDE explained: https://youtu.be/344w5h24-h8 Check out our daily #MachineLearning Quiz Questions: https://www.youtube.com/c/AICoffeeBreak/community ➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring.com/ Paper 📜: Chowdhery, Aakanksha, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham et al. "PaLM: Scaling Language Modeling with Pathways." arXiv preprint arXiv:2204.02311 (2022). https://arxiv.org/abs/2204.02311 🔗 PaLM blog: https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html 🔗 Large language models are slightly boring: https://twitter.com/Thom_Wolf/status/1511642282788896769 Outline: 00:00 DALL-E 2 or PaLM? 01:14 Weights&Biases (Sponsor) 02:25 A brief history of boring large language models 03:43 What is PaLM? 05:11 Training PaLM on all TPUs 08:11 PaLM training data 08:49 What it can do 10:31 Few-shot learning explained 13:20 Explaining jokes and Outlook Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 Don Rosenthal, Dres. Trost GbR, banana.dev -- Kyle Morris, Julián Salazar, Edvard Grødem, Vignesh Valliappan, Kevin Tsai, Mike Ton ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research​ Music 🎵 : That's What It Takes (Instrumental) - NEFFEX ✍️ Arabic Subtitles by Ali Haidar Ahmad https://www.linkedin.com/in/ali-ahmad-0706a51bb/ .