We all love Andrew Ng. We love his posts. 👏
But have you read his 167 page Ph.D. Dissertation from the Graduate Division of the University of California, Berkeley entitled "Shaping and policy search in Reinforcement Learning"?
I was reading "The Alignment Problem - Machine Learning and Human Values" by Brian Christian. On page 168, I read this:
✴ Andrew Ng was ambitious. He would do his PhD thesis on using reinforcement learning to fly an actual un-simulated, nine-foot-long, one-hundred-pound, seventy-thousand-dollar-Yamaha R-50 helicopter.
✅ Page 126 of Dissertation - be amazed by "Model selection and incorporating prior knowledge"
✅ Page 133 of Dissertation - get ready for "Learning to Hover"
Armed with the simulator for the helicopter, Andrew proceeded to use reinforcement learning to make a helicopter hover stably. He was looking for the hardest control problem he could find at that time.
I'm already impressed with Andrew Ng. But now I'm speechless. 🚁
SVP, Head Payments, Intellect Design Arena Ltd
1wAll the best. Quite an interesting topic. Can I get access to some summary of his dissertation? ( On another note... Its a HOT topic, in COLD Helsinki ) 😀