À propos de ce cours : Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more. They are the basis for the state-of-the-art methods in a wide variety of applications, such as medical diagnosis, image understanding, speech recognition, natural language processing, and many, many more. They are also a foundational tool in formulating many machine learning problems. This course is the first in a sequence of three. It describes the two basic PGM representations: Bayesian Networks, which rely on a directed graph; and Markov networks, which use an undirected graph. The course discusses both the theoretical properties of these representations as well as their use in practice. The (highly recommended) honors track contains several hands-on assignments on how to represent some real-world problems. The course also presents some important extensions beyond the basic PGM representation, which allow more complex models to be encoded compactly.
Créé par : Stanford University
Enseigné par : Daphne Koller, Professor
School of Engineering
| Informations de base | Cours 1 de 3 dans Probabilistic Graphical Models Specialization |
| Niveau | Advanced |
| Langue | English |
| Comment réussir | Réussissez tous les devoirs notés pour terminer le cours. |
| Notes des utilisateurs |
Programme de cours
SEMAINE 1
Introduction and Overview
This module provides an overall introduction to probabilistic graphical models, and defines a few of the key concepts that will be used later in the course.
4 vidéos
- Vidéo: Overview and Motivation
- Vidéo: Distributions
- Vidéo: Factors
Noté: Basic Definitions
Bayesian Network (Directed Models)
In this module, we define the Bayesian network representation and its semantics. We also analyze the relationship between the graph structure and the independence properties of a distribution represented over that graph. Finally, we give some practical tips on how to model a real-world situation as a Bayesian network.
15 vidéos, 6 lectures
- Vidéo: Reasoning Patterns
- Vidéo: Flow of Probabilistic Influence
- Vidéo: Conditional Independence
- Vidéo: Independencies in Bayesian Networks
- Vidéo: Naive Bayes
- Vidéo: Application - Medical Diagnosis
- Vidéo: Knowledge Engineering Example - SAMIAM
- Reading: Setting Up Your Programming Assignment Environment
- Reading: Installing Octave/MATLAB on Windows
- Reading: Installing Octave/MATLAB on Mac OS X (10.10 Yosemite and 10.9 Mavericks)
- Reading: Installing Octave/MATLAB on Mac OS X (10.8 Mountain Lion and Earlier)
- Reading: Installing Octave/MATLAB on GNU/Linux
- Reading: More Octave/MATLAB resources
- Vidéo: Basic Operations
- Vidéo: Moving Data Around
- Vidéo: Computing On Data
- Vidéo: Plotting Data
- Vidéo: Control Statements: for, while, if statements
- Vidéo: Vectorization
- Vidéo: Working on and Submitting Programming Exercises
Noté: Bayesian Network Fundamentals
Noté: Bayesian Network Independencies
Noté: Octave/Matlab installation
Noté: Simple BN Knowledge Engineering
SEMAINE 2
Template Models for Bayesian Networks
In many cases, we need to model distributions that have a recurring structure. In this module, we describe representations for two such situations. One is temporal scenarios, where we want to model a probabilistic structure that holds constant over time; here, we use Hidden Markov Models, or, more generally, Dynamic Bayesian Networks. The other is aimed at scenarios that involve multiple similar entities, each of whose properties is governed by a similar model; here, we use Plate Models.
4 vidéos
- Vidéo: Temporal Models - DBNs
- Vidéo: Temporal Models - HMMs
- Vidéo: Plate Models
Noté: Template Models
Structured CPDs for Bayesian Networks
A table-based representation of a CPD in a Bayesian network has a size that grows exponentially in the number of parents. There are a variety of other form of CPD that exploit some type of structure in the dependency model to allow for a much more compact representation. Here we describe a number of the ones most commonly used in practice.
4 vidéos
- Vidéo: Tree-Structured CPDs
- Vidéo: Independence of Causal Influence
- Vidéo: Continuous Variables
Noté: Structured CPDs
Noté: BNs for Genetic Inheritance
Noté: BNs for Genetic Inheritance PA Quiz
SEMAINE 3
Markov Networks (Undirected Models)
In this module, we describe Markov networks (also called Markov random fields): probabilistic graphical models based on an undirected graph representation. We discuss the representation of these models and their semantics. We also analyze the independence properties of distributions encoded by these graphs, and their relationship to the graph structure. We compare these independencies to those encoded by a Bayesian network, giving us some insight on which type of model is more suitable for which scenarios.
7 vidéos
- Vidéo: General Gibbs Distribution
- Vidéo: Conditional Random Fields
- Vidéo: Independencies in Markov Networks
- Vidéo: I-maps and perfect maps
- Vidéo: Log-Linear Models
- Vidéo: Shared Features in Log-Linear Models
Noté: Markov Networks
Noté: Independencies Revisited
Noté: Markov Networks for OCR
SEMAINE 4
Decision Making
In this module, we discuss the task of decision making under uncertainty. We describe the framework of decision theory, including some aspects of utility functions. We then talk about how decision making scenarios can be encoded as a graphical model called an Influence Diagram, and how such models provide insight both into decision making and the value of information gathering.
3 vidéos
- Vidéo: Utility Functions
- Vidéo: Value of Perfect Information
Noté: Decision Theory
Noté: Decision Making
Noté: Decision Making PA Quiz
SEMAINE 5
Knowledge Engineering & Summary
This module provides an overview of graphical model representations and some of the real-world considerations when modeling a scenario as a graphical model. It also includes the course final exam.
1 vidéo
Noté: Representation Final Exam
FAQ
Comment cela fonctionne
Coursework
Each course is like an interactive textbook, featuring pre-recorded videos, quizzes and projects.
Help from Your Peers
Connect with thousands of other learners and debate ideas, discuss course material, and get help mastering concepts.
Certificates
Earn official recognition for your work, and share your success with friends, colleagues, and employers.
Créateurs
Stanford University
The Leland Stanford Junior University, commonly referred to as Stanford University or Stanford, is an American private research university located in Stanford, California on an 8,180-acre (3,310 ha) campus near Palo Alto, California, United States.
Tarification
| Acheter le cours | |
|---|---|
| Accéder au contenu du cours | Disponible |
| Accéder au contenu noté | Disponible |
| Recevoir une Note Finale | Disponible |
| Obtenir un Certificat de Cours partageable | Disponible |
Notation et examens
I really enjoyed this course. Prof Koller presents the material very well, and it's really interesting to see how probabilistic graphical model frameworks are underpinned mathematically. I thought it was a pretty tough course at points, and while the lectures are good I found having a copy of Prof Koller's textbook very useful.
I would give this course 5 stars, but I thought some of the programming assignments involved too much grappling with MATLAB rather than illuminating the principles in the lectures. Also, I think the order of the lectures may have been changed since the course was first run as there are occasional references to things that have not been covered at that point.
Overall though, very enjoyable. I'm looking forward to parts 2 and 3.
This was my first experience with Coursera! Thanks prof. Daphne Koller for this course and Coursera at all.
a bit too hard if you don't have enough probability knowledge
Coursera propose un accès universel à la meilleure formation au monde,
en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.
© 2018 Coursera Inc. Tous droits réservés.
Very informative. The only drawback is lack of rigorous proof and clear definition summaries.