Hello network, Over the past couple of years, I have had the opportunity to develop and teach a structured course at IITB on a very topical area of Distributed/Decentralized Optimization with basic Introduction to Federated Learning. The course begins by laying a strong foundation in optimization mathematics, with a particular emphasis on techniques for accelerating optimization processes. From there, we explore fundamental concepts in graph theory and networks before delving into advanced topics such as multi-agent consensus, distributed optimization and learning, decentralized Stochastic Gradient Descent (SGD), and contemporary approaches like the RingAllReduce algorithm. Finally, we offer a glimpse into the essential mathematics of Federated Learning, tying together the various threads of the course. I'm pleased to announce that the recorded lectures, made available through CDEEP (Centre For Distance Engineering Education Programme) at IIT Bombay, are now accessible. Additionally, the course will soon be offered via NPTEL, providing an opportunity for wider engagement and learning. You can access the recorded lectures on YouTube at the following link: https://lnkd.in/ebggkqx7 For hand-written lecture notes and sample codes, please visit my webpage: https://lnkd.in/ezNdG84J . We are continually refining the materials, with an improved version scheduled for release during the NPTEL offering. I eagerly await your feedback and hope you find these resources valuable for your learning journey. Happy exploring! #FedereatedLearning #Optimization #DistributedOptimization #DecentralizedOptimization #NPTEL #AI #ML Indian Institute of Technology, Bombay
Thanks for sharing, Federated Learning is one of the most upcoming areas of research in both academia and industry.
Thanks, Shared with my UG students and would really help them to work on distributed optimization
thank you so much.
Thanks for sharing :)
Thanks for sharing
Thanks for sharing, Mayank!
Thank you sir!
Quantum Computing, Optimisation for ML; TCS Research, PhD Candidate at IISc
8moThis is great, Mayank! I think it would be immensely helpful if the titles of the videos reflect their respective topics