Mengenal Layer Normalization

Saudaranya Batch Normalization. ============================================= Konten, script, suara: Marcella Astrid Editing, subtitle, ekstra humor: Diaz Jubairy (https://www.linkedin.com/in/diazjubairy/) Link buat yang mau nyawer: saweria.co/marcellaastrid buymeacoffee.com/marcellaastrid #layernorm #deeplearning #anakai ============================================= Sumber-sumber: https://medium.com/@minh.hoque/demystifying-neural-network-normalization-techniques-4a21d35b14f8 https://arxiv.org/pdf/1607.06450.pdf https://paperswithcode.com/method/layer-normalization https://wandb.ai/wandb_fc/LayerNorm/reports/Layer-Normalization-in-Pytorch-With-Examples---VmlldzoxMjk5MTk1 https://medium.com/@ohadrubin/exploring-weight-decay-in-layer-normalization-challenges-and-a-reparameterization-solution-ad4d12c24950 https://leimao.github.io/blog/Layer-Normalization/ https://medium.com/techspace-usict/normalization-techniques-in-deep-neural-networks-9121bf100d8 https://www.pinecone.io/learn/batch-layer-normalization/ https://www.tensorflow.org/api_docs/python/tf/keras/layers/LayerNormalization https://pytorch.org/docs/stable/generated/torch.nn.LayerNorm.html Preliminary video: Batch norm: https://youtu.be/adDTvsEwFYc