Bayesian methods are used in lots of fields: from game development to drug discovery. They give superpowers to many machine learning algorithms: handling missing data, extracting much more information from small datasets. Bayesian methods also allow us to estimate uncertainty in predictions, which is a really desirable feature for fields like medicine.
When Bayesian methods are applied to deep learning, it turns out that they allow you to compress your models 100 folds, and automatically tune hyperparametrs, saving your time and money.
In six weeks we will discuss the basics of Bayesian methods: from how to define a probabilistic model to how to make predictions from it. We will see how one can fully automate this workflow and how to speed it up using some advanced techniques.
We will also see applications of Bayesian methods to deep learning and how to generate new images with it. We will see how new drugs that cure severe diseases be found with Bayesian methods.
Ce cours fait partie de la Spécialisation Advanced Machine Learning
Bayesian Methods for Machine Learning
proposé par
Spécialisation Advanced Machine LearningUniversité nationale de recherche, École des hautes études en sciences économiques
À propos de ce cours
4.6
272 notes
Compétences que vous acquerrez
Bayesian OptimizationGaussian ProcessMarkov Chain Monte Carlo (MCMC)Variational Bayesian Methods
Programme du cours : ce que vous apprendrez dans ce cours
Semaine
1Introduction to Bayesian methods & Conjugate priors
Welcome to first week of our course! Today we will discuss what bayesian methods are and what are probabilistic models. We will see how they can be used to model real-life situations and how to make conclusions from them. We will also learn about conjugate priors — a class of models where all math becomes really simple.
9 vidéos (Total 55 min), 1 lecture, 2 quiz
9 vidéos
Bayesian approach to statistics5 min
How to define a model3 min
Example: thief & alarm11 min
Linear regression10 min
Analytical inference3 min
Conjugate distributions2 min
Example: Normal, precision5 min
Example: Bernoulli4 min
1 lecture
MLE estimation of Gaussian mean10 min
2 exercices pour s'entraîner
Introduction to Bayesian methods20 min
Conjugate priors12 min
Semaine
2Expectation-Maximization algorithm
This week we will about the central topic in probabilistic modeling: the Latent Variable Models and how to train them, namely the Expectation Maximization algorithm. We will see models for clustering and dimensionality reduction where Expectation Maximization algorithm can be applied as is. In the following weeks, we will spend weeks 3, 4, and 5 discussing numerous extensions to this algorithm to make it work for more complicated models and scale to large datasets.
17 vidéos (Total 168 min), 3 quiz
17 vidéos
Latent Variable Models11 min
Probabilistic clustering6 min
Gaussian Mixture Model10 min
Training GMM10 min
Example of GMM training10 min
Jensen's inequality & Kullback Leibler divergence9 min
Expectation-Maximization algorithm10 min
E-step details12 min
M-step details6 min
Example: EM for discrete mixture, E-step10 min
Example: EM for discrete mixture, M-step12 min
Summary of Expectation Maximization6 min
General EM for GMM12 min
K-means from probabilistic perspective9 min
K-means, M-step7 min
Probabilistic PCA13 min
EM for Probabilistic PCA7 min
2 exercices pour s'entraîner
EM algorithm8 min
Latent Variable Models and EM algorithm10 min
Semaine
3Variational Inference & Latent Dirichlet Allocation
This week we will move on to approximate inference methods. We will see why we care about approximating distributions and see variational inference — one of the most powerful methods for this task. We will also see mean-field approximation in details. And apply it to text-mining algorithm called Latent Dirichlet Allocation
11 vidéos (Total 98 min), 2 quiz
11 vidéos
Mean field approximation13 min
Example: Ising model15 min
Variational EM & Review5 min
Topic modeling5 min
Dirichlet distribution6 min
Latent Dirichlet Allocation5 min
LDA: E-step, theta11 min
LDA: E-step, z8 min
LDA: M-step & prediction13 min
Extensions of LDA5 min
2 exercices pour s'entraîner
Variational inference15 min
Latent Dirichlet Allocation15 min
Semaine
4Markov chain Monte Carlo
This week we will learn how to approximate training and inference with sampling and how to sample from complicated distributions. This will allow us to build simple method to deal with LDA and with Bayesian Neural Networks — Neural Networks which weights are random variables themselves and instead of training (finding the best value for the weights) we will sample from the posterior distributions on weights.
11 vidéos (Total 122 min), 2 quiz
11 vidéos
Monte Carlo estimation12 min
Sampling from 1-d distributions13 min
Markov Chains13 min
Gibbs sampling12 min
Example of Gibbs sampling7 min
Metropolis-Hastings8 min
Metropolis-Hastings: choosing the critic8 min
Example of Metropolis-Hastings9 min
Markov Chain Monte Carlo summary8 min
MCMC for LDA15 min
Bayesian Neural Networks11 min
1 exercice pour s'entraîner
Markov Chain Monte Carlo20 min
4.6
77 avis60%
a commencé une nouvelle carrière après avoir terminé ces cours
44%
a bénéficié d'un avantage concret dans sa carrière grâce à ce cours
11%
a obtenu une augmentation de salaire ou une promotion
Meilleurs avis
par JG•Nov 18th 2017
This course is little difficult. But I could find very helpful.\n\nAlso, I didn't find better course on Bayesian anywhere on the net. So I will recommend this if anyone wants to die into bayesian.
par AE•May 9th 2018
Challenging, but well designed course covering cutting edge ML methods. The course assumes high proficency with Tensorflow, Keras, and Python.
Enseignants
Daniil Polykovskiy
ResearcherHSE Faculty of Computer Science
Alexander Novikov
ResearcherHSE Faculty of Computer Science
À propos de Université nationale de recherche, École des hautes études en sciences économiques
National Research University - Higher School of Economics (HSE) is one of the top research universities in Russia. Established in 1992 to promote new research and teaching in economics and related disciplines, it now offers programs at all levels of university education across an extraordinary range of fields of study including business, sociology, cultural studies, philosophy, political science, international relations, law, Asian studies, media and communicamathematics, engineering, and more.
Learn more on www.hse.ru
À propos de la Spécialisation Advanced Machine Learning
This specialization gives an introduction to deep learning, reinforcement learning, natural language understanding, computer vision and Bayesian methods. Top Kaggle machine learning practitioners and CERN scientists will share their experience of solving real-world problems and help you to fill the gaps between theory and practice. Upon completion of 7 courses you will be able to apply modern machine learning methods in enterprise and understand the caveats of real-world data and settings.
Foire Aux Questions
Quand aurai-je accès aux vidéos de cours et aux devoirs ?
Une fois que vous êtes inscrit(e) pour un Certificat, vous pouvez accéder à toutes les vidéos de cours, et à tous les quiz et exercices de programmation (le cas échéant). Vous pouvez soumettre des devoirs à examiner par vos pairs et en examiner vous-même uniquement après le début de votre session. Si vous préférez explorer le cours sans l'acheter, vous ne serez peut-être pas en mesure d'accéder à certains devoirs.
À quoi ai-je droit si je m'abonne à cette Spécialisation ?
Lorsque vous vous inscrivez au cours, vous bénéficiez d'un accès à tous les cours de la Spécialisation, et vous obtenez un Certificat lorsque vous avez réussi. Votre Certificat électronique est alors ajouté à votre page Accomplissements. À partir de cette page, vous pouvez imprimer votre Certificat ou l'ajouter à votre profil LinkedIn. Si vous souhaitez seulement lire et visualiser le contenu du cours, vous pouvez accéder gratuitement au cours en tant qu'auditeur libre.
Quelle est la politique de remboursement ?
Une aide financière est-elle possible ?
What background knowledge is necessary?
Course requires strong background in calculus, linear algebra, probability theory and machine learning.
D'autres questions ? Visitez le Centre d'Aide pour les Etudiants.
Coursera propose un accès universel à la meilleure formation au monde,
en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.
© 2019 Coursera Inc. Tous droits réservés.
