Artificial Intelligence in 2020

This video recaps developments in AI from 2019! Happy New Year! Thanks for watching! Please Subscribe! Links from Video Below: The Lottery Ticket Hypothesis: https://arxiv.org/pdf/1803.03635.pdf Understanding the generalization of 'lottery tickets' in neural networks: https://ai.facebook.com/blog/understanding-the-generalization-of-lottery-tickets-in-neural-networks Deconstructing Lottery Tickets: https://eng.uber.com/deconstructing-lottery-tickets/ What's Hidden in a Randomly Weighted Network? https://arxiv.org/pdf/1911.13299.pdf Weight Agnostic Neural Networks: https://weightagnostic.github.io/ Exploring Randomly Wired Networks: https://arxiv.org/pdf/1904.01569.pdf StyleGAN2 Github Repo: https://github.com/NVlabs/stylegan2 ThisPersonDoesNotExist.com SinGAN: https://arxiv.org/pdf/1905.01164.pdf GauGAN: https://blogs.nvidia.com/blog/2019/03/18/gaugan-photorealistic-landscapes-nvidia-research/ GauGAN Research Paper: https://arxiv.org/pdf/1903.07291.pdf Realistic Neural Talking Head Models (Tweet): https://twitter.com/alteredq/status/1131869355694809089?lang=en Generative Teaching Networks: https://eng.uber.com/generative-teaching-networks/ Yann LeCun Self-Supervised Learning Tweet: https://twitter.com/ylecun/status/1123235709802905600?lang=en Billlion-Scale Semi-Supervised Learning: https://ai.facebook.com/blog/billion-scale-semi-supervised-learning/ Self-Training with Noisy Student: https://arxiv.org/pdf/1911.04252.pdf Wav2Vec: https://ai.facebook.com/blog/wav2vec-state-of-the-art-speech-recognition-through-self-supervision/ Cloze Task for QA: https://ai.facebook.com/blog/research-in-brief-unsupervised-question-answering-by-cloze-translation/ Revisiting Self-Supervised Visual Representation Learning: http://openaccess.thecvf.com/content_CVPR_2019/papers/Kolesnikov_Revisiting_Self-Supervised_Visual_Representation_Learning_CVPR_2019_paper.pdf Contrastive Predictive Coding: https://arxiv.org/pdf/1905.09272.pdf Unsupervised Data Augmentation: https://arxiv.org/pdf/1904.12848.pdf BigBiGAN: https://arxiv.org/pdf/1907.02544.pdf OpenAI Hide and Seek: https://openai.com/blog/emergent-tool-use/ AlphaStar: https://deepmind.com/blog/article/AlphaStar-Grandmaster-level-in-StarCraft-II-using-multi-agent-reinforcement-learning DeepMind Capture the Flag: https://deepmind.com/blog/article/capture-the-flag-science OpenAI Dota 2 Report: https://cdn.openai.com/dota-2.pdf MuZero: https://deepmind.com/research/publications/Mastering-Atari-Go-Chess-and-Shogi-by-Planning-with-a-Learned-Model EfficientNet: https://arxiv.org/pdf/1905.11946.pdf EfficientDet: https://arxiv.org/pdf/1911.09070.pdf MobileNetV3 & MobileNetEdgeTPU: https://ai.googleblog.com/2019/11/introducing-next-generation-on-device.html From System 1 to System 2 Deep Learning: https://slideslive.com/38921750/from-system-1-deep-learning-to-system-2-deep-learning RAPIDS: https://rapids.ai/ The Bitter Lesson: http://incompleteideas.net/IncIdeas/BitterLesson.html ICML Slideslive: https://slideslive.com/icml nbdev: https://www.fast.ai/2019/12/02/nbdev/ Weights and Biases: https://www.wandb.com/ HuggingFace: https://huggingface.co/ TF 2.0: https://blog.tensorflow.org/2019/09/tensorflow-20-is-now-available.html PyTorch 1.3: https://pytorch.org/blog/pytorch-1-dot-3-adds-mobile-privacy-quantization-and-named-tensors/ State of Machine Learning Frameworks: https://thegradient.pub/state-of-ml-frameworks-2019-pytorch-dominates-research-tensorflow-dominates-industry/ Deepfake Detection Challenge: https://www.kaggle.com/c/deepfake-detection-challenge Rob Mulla's Starter Notebook for Deepfake Detection: https://www.kaggle.com/robikscube/kaggle-deepfake-detection-introduction On the Measure of Intelligence: https://arxiv.org/pdf/1911.01547.pdf AI-GAs: https://arxiv.org/abs/1905.10985 Thanks for watching! Please Subscribe!