2021 High Performance Computing Practical Lecture 10.1 Deep Learning driven by Big Data Part1 👨‍💻

Practical Lecture 10.1 - Deep Learning driven by Big Data 👨‍💻 - Part One Invited Lecture given by Dr. - Ing. Gabriele Cavallaro https://www.gabriele-cavallaro.com/ Advanced Scientific Computing 16 university lectures with additional practical lectures for hands-on exercises in context University of Iceland, School of Engineering and Natural Sciences Faculty of Industrial Engineering, Mechanical Engineering and Computer Science Spring 2021 Course Outline 1. High Performance Computing 2. Parallel Programming with MPI 3. Parallelization Fundamentals 4. Advanced MPI Techniques 5. Parallel Algorithms & Data Structures 6. Parallel Programming with OpenMP 7. Hybrid Programming & Patterns 8. Debugging & Profiling & Performance Analysis 9. Accelerators & Graphical Processing Units 10. Parallel & Scalable Machine & Deep Learning 11. HPC in Health & Neurosciences 12. Computational Fluid Dynamics & Finite Elements 13. Systems Biology & Bioinformatics 14. Molecular Systems & Material Sciences 15. Terrestrial Systems & Climate 16. Epilogue Lecture Outline Part One: Machine Learning Fundamentals Revisited Linear Perceptron Model Limitations in non-linearly separable data sets Multilayer Perceptron Neural Networks Deep learning Part Two: Deep Neural Networks Convolutional Neural Networks (CNNs) Backpropagation Algorithm Big Remote Sensing Data