Gaussian processes for regression

Loading...

En provenance du cours de National Research University Higher School of Economics

Addressing Large Hadron Collider Challenges by Machine Learning

12 notes

National Research University Higher School of Economics

Addressing Large Hadron Collider Challenges by Machine Learning

12 notes

Cours 7 sur 7 dans Specialization Advanced Machine Learning

The Large Hadron Collider (LHC) is the largest data generation machine for the time being. It doesn’t produce the big data, the data is gigantic. Just one of the four experiments generates thousands gigabytes per second. The intensity of data flow is only going to be increased over the time. So the data processing techniques have to be quite sophisticated and unique. In this course we’ll introduce students into the main concepts of the Physics behind those data flow so the main puzzles of the Universe Physicists are seeking answers for will be much more transparent. Of course we will scrutinize the major stages of the data processing pipelines, and focus on the role of the Machine Learning techniques for such tasks as track pattern recognition, particle identification, online real-time processing (triggers) and search for very rare decays. The assignments of this course will give you opportunity to apply your skills in the search for the New Physics using advanced data analysis techniques. Upon the completion of the course you will understand both the principles of the Experimental Physics and Machine Learning much better.

À partir de la leçon

Detector optimization

This module covers several cases of detector design optimization in high energy physics experiments using Bayesian optimization with Gaussian processes.

Detector optimization7:05

Normal distribution3:37

Gaussian processes for regression4:26

Bayesian optimization. Part 14:36

Bayesian optimization. Part 25:09

Optimization examples3:29

Rencontrer les enseignants

Andrei Ustyuzhanin
Head of Laboratory for Methods of Big Data Analysis
HSE Faculty of Computer Science
Mikhail Hushchyn
Researcher at Laboratory for Methods of Big Data Analysis
HSE Faculty of Computer Science

In this video, we will talk about Gaussian processes for regression.

In the next video,

we will use Gaussian processes for Bayesian optimization.

Let's start from a regression problem example with a set of observations.

The goal of this example is to learn this function using Gaussian processes.

Suppose that the observations are noisy as it's shown on this slide.

y is a vector of the target observations,

and f is a vector the true function values,

Epsilon is the noise of the distribution.

We also suppose that the noise has normal distribution.

So the vector of the target observations y,

is distributed with a multivariate normal distribution.

Mean of the distribution is a vector of true function values f,

and the covariance matrix is a unit matrix multiplied by a parameter Alpha.

Also, suppose that the vector of

the true function values also has normal distribution with

zero mean and the covariance matrix K.

The matrix K is chosen to express the property that,

for points x_n and x_m that are similar,

the values f(x_n) and f(x_m) will be more strongly correlated than for dissimilar points.

Let's consider this matrix more detailed.

The covariance between two points is based on

the Euclidean distance between these two points,

x_i and x_j as it's shown on the slide,

and this expression expresses the property that for these two points that are similar,

the values of the function will be more strongly correlated than for dissimilar points.

Distributions of the target observations

and the true function values shown on the previous slides,

allow us to calculate distribution of

the observations with zero mean in the following covariance

matrix C. Let's consider how to use

this distribution to estimate the function value for a given point x.

Let's estimate the function value y_N plus 1 for a given point x_N plus 1.

The vector of the target observations with N plus 1 points has a normal distribution,

where mean and covariance matrix have the following structure.

The covariance matrix for the N plus 1 points consists of the covariance matrix for

the previous N points plus one additional row and column as it's shown on the slide.

Mean and covariance for the N points is known.

The conditional distribution of the observation value y_N plus 1 for

a given N previous points has

normal distribution with the following mean and standard deviation values,

as it's shown on the slide.

In this slide, I just would like to remind you one more time

the properties of the conditional distribution for the normal distribution,

and we will use these properties in the next slide.

The conditional distribution properties give us expressions

for the mean and the standard deviation of the observation y_N plus 1,

given N previous points as it's shown on the slide.

Let's plot the mean values for the observation y_N plus 1,

given previous N points.

The mean values are shown as green line in the figure.

This example shows that 10 observations estimates the function very well.

Three Sigma confidence region of

the distribution is shown in the figure as green regions.

In this video, we have learned about Gaussian processes for regression.

In the next video,

we will use them for the Bayesian optimization.

Explorer notre catalogue

Rejoignez-nous gratuitement et obtenez des recommendations, des mises à jour et des offres personnalisées.

Coursera propose un accès universel à la meilleure formation au monde, en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.

© 2018 Coursera Inc. Tous droits réservés.

Télécharger dans l'App Store

Disponible sur Google Play