À propos de ce cours : This intermediate-level course introduces the mathematical foundations to derive Principal Component Analysis (PCA), a fundamental dimensionality reduction technique. We'll cover some basic statistics of data sets, such as mean values and variances, we'll compute distances and angles between vectors using inner products and derive orthogonal projections of data onto lower-dimensional subspaces. Using all these tools, we'll then derive PCA as a method that minimizes the average squared reconstruction error between data points and their reconstruction. At the end of this course, you'll be familiar with important mathematical concepts and you can implement PCA all by yourself. If you’re struggling, you'll find a set of jupyter notebooks that will allow you to explore properties of the techniques and walk you through what you need to do to get on track. If you are already an expert, this course may refresh some of your knowledge. The lectures, examples and exercises require: 1. Some ability of abstract thinking 2. Good background in linear algebra (e.g., matrix and vector algebra, linear independence, basis) 3. Basic background in multivariate calculus (e.g., partial derivatives, basic optimization) 4. Basic knowledge in python programming and numpy Disclaimer: This course is substantially more abstract and requires more programming than the other two courses of the specialization. However, this type of abstract thinking, algebraic manipulation and programming is necessary if you want to understand machine learning algorithms.
Les destinataires de ce cours : This is an intermediate level course. You should brush up your linear algebra and python programming before you start this course.
Créé par : Imperial College London
Enseigné par : Marc P. Deisenroth, Lecturer in Statistical Machine Learning
Department of Computing
| Informations de base | Cours 3 de 3 dans Mathematics for Machine Learning Specialization |
| Niveau | Intermédiaire |
| Engagement | 4 weeks of study, 4-5 hours/week |
| Langue | English |
| Comment réussir | Réussissez tous les devoirs notés pour terminer le cours. |
| Notes des utilisateurs |
Programme de cours
SEMAINE 1
Statistics of Datasets
Principal Component Analysis (PCA) is one of the most important dimensionality reduction algorithms in machine learning. In this course, we lay the mathematical foundations to derive and understand PCA from a geometric point of view. In this module, we learn how to summarize datasets (e.g., images) using basic statistics, such as the mean and the variance. We also look at properties of the mean and the variance when we shift or scale the original data set. We will provide mathematical intuition as well as the skills to derive the results. We will also implement our results in code (jupyter notebooks), which will allow us to practice our mathematical understand to compute averages of image data sets.
8 vidéos, 5 lectures, 2 quiz pour s'exercer
- 閱讀: About Imperial College & the team
- 閱讀: How to be successful in this course
- 閱讀: Grading policy
- 閱讀: Additional readings & helpful references
- 討論提示: Nice to meet you!
- 未評分插件: Survey
- Vidéo: Welcome to module 1
- Vidéo: Mean of a dataset
- 練習測驗: Mean of datasets
- Vidéo: Variance of one-dimensional datasets
- 閱讀: Symmetric, positive definite matrices
- Vidéo: Variance of higher-dimensional datasets
- 練習測驗: Covariance matrix of a two-dimensional dataset
- Vidéo: Effect on the mean
- Vidéo: Effect on the (co)variance
- 筆記本: Mean/covariance of a dataset + effect of a linear transformation
- Vidéo: See you next module!
Noté: Variance of 1D datasets
Noté: Mean/covariance of a dataset + effect of a linear transformation
SEMAINE 2
Inner Products
Data can be interpreted as vectors. Vectors allow us to talk about geometric concepts, such as lengths, distances and angles to characterise similarity between vectors. This will become important later in the course when we discuss PCA. In this module, we will introduce and practice the concept of an inner product. Inner products allow us to talk about geometric concepts in vector spaces. More specifically, we will start with the dot product (which we may still know from school) as a special case of an inner product, and then move toward a more general concept of an inner product, which play an integral part in some areas of machine learning, such as kernel machines (this includes support vector machines and Gaussian processes). We have a lot of exercises in this module to practice and understand the concept of inner products.
8 vidéos, 1 lecture, 2 quiz pour s'exercer
- Vidéo: Dot product
- 練習測驗: Dot product
- Vidéo: Inner product: definition
- Vidéo: Inner product: length of vectors
- Vidéo: Inner product: distances between vectors
- 練習測驗: General inner products: lengths and distances
- 閱讀: Basis vectors
- Vidéo: Inner product: angles and orthogonality
- 筆記本: Inner products and angles
- Vidéo: Inner products of functions and random variables (optional)
- Vidéo: Heading for the next module!
Noté: Properties of inner products
Noté: Angles between vectors using a non-standard inner product
Noté: Inner products and angles
SEMAINE 3
Orthogonal Projections
In this module, we will look at orthogonal projections of vectors, which live in a high-dimensional vector space, onto lower-dimensional subspaces. This will play an important role in the next module when we derive PCA. We will start off with a geometric motivation of what an orthogonal projection is and work our way through the corresponding derivation. We will end up with a single equation that allows us to project any vector onto a lower-dimensional subspace. However, we will also understand how this equation came about. As in the other modules, we will have both pen-and-paper practice and a small programming example with a jupyter notebook.
6 vidéos, 1 lecture, 1 quiz pour s'exercer
- Vidéo: Projection onto 1D subspaces
- Vidéo: Example: projection onto 1D subspaces
- Vidéo: Projections onto higher-dimensional subspaces
- 閱讀: Full derivation of the projection
- Vidéo: Example: projection onto a 2D subspace
- 練習測驗: Project 3D data onto a 2D subspace
- 筆記本: Orthogonal projections
- Vidéo: This was module 3!
Noté: Projection onto a 1-dimensional subspace
Noté: Orthogonal projections
SEMAINE 4
Principal Component Analysis
We can think of dimensionality reduction as a way of compressing data with some loss, similar to jpg or mp3. Principal Component Analysis (PCA) is one of the most fundamental dimensionality reduction techniques that are used in machine learning. In this module, we use the results from the first three modules of this course and derive PCA from a geometric point of view. Within this course, this module is the most challenging one, and we will go through an explicit derivation of PCA plus some coding exercises that will make us a proficient user of PCA.
10 vidéos, 5 lectures, 1 quiz pour s'exercer
- 閱讀: Vector spaces
- 閱讀: Orthogonal complements
- Vidéo: Problem setting and PCA objective
- 閱讀: Multivariate chain rule
- 練習測驗: Chain rule practice
- Vidéo: Finding the coordinates of the projected data
- Vidéo: Reformulation of the objective
- 閱讀: Lagrange multipliers
- Vidéo: Finding the basis vectors that span the principal subspace
- Vidéo: Steps of PCA
- Vidéo: PCA in high dimensions
- 筆記本: Principal Components Analysis (PCA)
- Vidéo: Other interpretations of PCA (optional)
- Vidéo: Summary of this module
- Vidéo: This was the course on PCA
- 閱讀: Did you like the course? Let us know!
- 未評分插件: Post-Course Survey
Noté: PCA
FAQ
Comment cela fonctionne
課程作業
每門課程都像是一本互動的教科書，具有預先錄製的視頻、測驗和項目。
來自同學的幫助
與其他成千上萬的學生相聯繫，對想法進行辯論，討論課程材料，並尋求幫助來掌握概念。
證書
獲得正式認證的作業，並與朋友、同事和雇主分享您的成功。
Créateurs
Imperial College London
Imperial College London is a world top ten university with an international reputation for excellence in science, engineering, medicine and business. located in the heart of London. Imperial is a multidisciplinary space for education, research, translation and commercialisation, harnessing science and innovation to tackle global challenges.
Imperial students benefit from a world-leading, inclusive educational experience, rooted in the College’s world-leading research. Our online courses are designed to promote interactivity, learning and the development of core skills, through the use of cutting-edge digital technology.
Tarification
| Acheter le cours | |
|---|---|
| Accéder au contenu du cours | Disponible |
| Accéder au contenu noté | Disponible |
| Recevoir une Note Finale | Disponible |
| Obtenir un Certificat de Cours partageable | Disponible |
Notation et examens
it is good, challenging course. i've learned a lot, but feel that i came away with quite patchy knowledge. This course is a big step up in complexity and delivery form the previous two courses. perhaps my expectations were not right to start with - one cannot learn this level of complexity so quickly. Admittedly there are many gaps between the lectures and course materials and what is asked in programming assignments. i ended up reading a lot online to fill in the gaps (i've learned a lot of python during the course, which is great!).nevertheless, after this course i feel equipped to continue with machine learning.
Teaching pacing is good, and clear in explanation. It will be good if there are some examples about how we should apply all these theories to some real problems.
good thing is it's trying to give you a sense of practically how to do it.downside is it's not really bridging to from maths to that practical sense in python (and the online jupyter notebook is terrible).the teaching staff is actually more responsive than the other 2 in the specialization.a bit more sided on python than maths though.
Coursera propose un accès universel à la meilleure formation au monde,
en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.
© 2018 Coursera Inc. Tous droits réservés.
This is by far the best course I have taken. The Instructor is exceptional in setting the stage to understand the complex topic by letting us know the motivation of every concept, making us understand the fundamentals right, deep diving into the core of the topic and them nicely summarizing the topic along with the applications.