Training a Neural Network using Gradient-free Optimization | Rust AI / ML tutorial

In this video I demonstrate how 3 different gradient-free optimizers work, viz., the Genetic Algorithm, Differential Evolution and Particle Swarm Optimization with the example of training a simple neural network to learn to approximate the XOR function. I show how to implement all of this from scratch in Rust, and provide insights on the performance of all 3 optimizers. Resources: - Algorithms for Optimization by Mykel J. Kochenderfer and Tim A. Wheeler Connect: - Learn-by-Example Discord : https://discord.gg/QYU5enNkgv - LinkedIn : https://www.linkedin.com/in/himangshu-saikia-phd-a4a4711b/ #optimization #numerical #particle_swarm_optimization #pso #genetic_algorithms #ga #differential_evolution #de #neural_network #training #ml #ai #rust #RustProgramming