CheckList Explained! (ACL 2020 Best Paper)

This video explains CheckList, winner of the ACL 2020 best paper award! CheckList is a system to explore the linguistic capabilities of natural language processing models. Rather than relying on accuracy metrics and held-out test sets, CheckList generates explicit tests of linguistic phenomena like temporal understanding, negations, vocabulary, fairness, and more! Thanks for watching, please subscribe! Paper Links: CheckList: https://arxiv.org/pdf/2005.04118.pdf CheckList GitHub Repository: https://github.com/marcotcr/checklist Adversarial Examples for Evaluating Reading Comprehension: https://arxiv.org/pdf/1707.07328.pdf SuperGLUE: https://w4ngatang.github.io/static/papers/superglue.pdf GPT-3 React App Tweet: https://twitter.com/sharifshameem/status/1284095222939451393 HuggingFace NLP Viewer: https://huggingface.co/nlp/viewer/?dataset=quora SQuAD: https://rajpurkar.github.io/SQuAD-explorer/ Microsoft Text Analytics API: https://azure.microsoft.com/en-us/services/cognitive-services/text-analytics/ Pattern-Exploiting Training: https://arxiv.org/pdf/2001.07676.pdf