How strong is Claude 2?

Claude 2 is a new language model from Anthropic, with a 100K token context window currently available to users (a 200K token context window may become available later). This video describes the details provided by Anthropic in their model card. Timestamps: 00:00 - Claude 2 01:11 - The larger context window 02:33 - Translation abilities 03:44 - Standard benchmarks (HumanEval, MMLU etc.) 05:31 - Multistate Bar Examination results 05:34 - United States Medical Licensing Examination 07:05 - Areas for Improvement 08:43 - Model details 09:02 - Confabulations 10:23 - Claude 2's constitution 10:46 - Red teaming 11:31 - Combined helpful, honest and harmless evaluations Topics: ##ai #anthropic #claude2 #contextwindow Link to the paper: https://www-files.anthropic.com/production/images/Model-Card-Claude-2.pdf For related content: - Twitter: https://twitter.com/SamuelAlbanie - Research lab: https://caml-lab.com/ - personal webpage: https://samuelalbanie.com/ - YouTube: https://www.youtube.com/@SamuelAlbanie1 - TikTok: https://tiktok.com/@samuelalbanie - Instagram: https://instagram.com/samuelalbanie - LinkedIn: https://www.linkedin.com/in/samuel-albanie - Threads: https://www.threads.net/@samuelalbanie - Discord server for filtir: https://discord.gg/FV97NByG2b (Optional) if you'd like to support the channel: - https://www.buymeacoffee.com/samuelalbanie - https://www.patreon.com/samuel_albanie