Learn about Language Model basics, purpose of Large Language Models (LLMs), pre-training, fine-tuning, Reinforcement Learning with Human Feedback (RLHF), Reinforcement with AI Feedback (RLAIF), Emerging Abilities of LLMs, Encoder- only models, Decoder-only models, Encoder-Decoder models, Masked Language Modeling, Bi-directional Context, Causal Language Modeling, Unidirectional Context, Autoencoding Models, Autoregressive Models, Sequence-to-Sequence models, GPT, Llama, T5, Transformer model, RoBERTA, BLOOM, BART, Catastrophic Forgetting at fine-tuning, Chatbots, Question-answering, Text summarization, Natural Language Translation, Sentiment Analysis, Text Classification, Word Classification, FLAN, Parameter Efficient Fine Tuning, PEFT, LoRA, Soft Prompting, H3, Reinforcement Learning, Proximal Policy Optimization, PPO, Reward Model, Constitutional AI, Retrieval Augment Generation and RAG.
