Machine learning and artificial intelligence are taking increasingly important roles in our society. How to write high-quality ML and AI programs has become a key problem. However, writing these programs in conventional programming languages is nontrivial, as they lack built-in support for machine learning and probabilistic models.
Probabilistic programming is an area which rose recently to address this challenge. From the perspective of programming languages, probabilistic programming languages add built-in support for random variables in a general language. From the perspective of ML, probabilistic programming uses expressive language constructs to express probabilistic models, which allows constructing arbitrarily complex models. Thus, probabilistic programming languages are both new programming languages and new machine learning models. They are seen as promising ways to build future ML and AI systems. Top research institutes and companies like MIT, Columbia, Oxford, Google, Facebook and Uber are racing to develop their own probabilistic languages.
In this course, we will study representative probabilistic programming languages and their applications, theories and implementations of probabilistic programming, classical graphical models and inference algorithms, and new frontiers in the area. Having basic knowledge of probabilities and programming is recommended to take the course.
|Sep 16||Introduction||The Five Tribes of Machine Learning with Pedro Domingos|
|Sep 23||Probabilistic Programming Using WebPPL||Introduction to WebPPL|
|Sep 30||Graphical Models 1||Chapter 8 of Pattern Recognition and Machine Learning|
|Oct 14||Graphical Models 2||Chapter 8 of Pattern Recognition and Machine Learning|
|Oct 21||Approximate Inference||Chapter 10&11 of Pattern Recognition and Machine Learning|
|Week 7-8||Theoretical Foundations (Measure Theory and Semantics)||TBD|
|Week 10-11||Inference Algorithms||TBD|
|Week 12||Learning Algorithms||TBD|
|Week 13||Probabilistic Logic Programming||TBD|
|Week 14-15||Advanced Topics||TBD|