5. Model Selection

Loading...

En provenance du cours de University of Colorado Boulder

Predictive Modeling and Analytics

150 notes

University of Colorado Boulder

Predictive Modeling and Analytics

150 notes

Cours 2 sur 5 dans Specialization Advanced Business Analytics

Welcome to the second course in the Data Analytics for Business specialization! This course will introduce you to some of the most widely used predictive modeling techniques and their core principles. By taking this course, you will form a solid foundation of predictive analytics, which refers to tools and techniques for building statistical or machine learning models to make predictions based on data. You will learn how to carry out exploratory data analysis to gain insights and prepare data for predictive modeling, an essential skill valued in the business. You’ll also learn how to summarize and visualize datasets using plots so that you can present your results in a compelling and meaningful way. We will use a practical predictive modeling software, XLMiner, which is a popular Excel plug-in. This course is designed for anyone who is interested in using data to gain insights and make better business decisions. The techniques discussed are applied in all functional areas within business organizations including accounting, finance, human resource management, marketing, operations, and strategic planning. The expected prerequisites for this course include a prior working knowledge of Excel, introductory level algebra, and basic statistics.

À partir de la leçon

Predicting a Continuous Variable

This module introduces regression techniques to predict the value of continuous variables. Some fundamental concepts of predictive modeling are covered, including cross-validation, model selection, and overfitting. You will also learn how to build predictive models using the software tool XLMiner.

1. Introduction to Linear Regression8:33

2. Assessing Predictive Accuracy Using Cross-Validation5:18

3. Multiple Regression4:10

4. Improving Model Fit3:45

5. Model Selection3:25

6. Challenges of Predictive Modeling5:06

7. How to Build a Model using XLMiner8:02

Rencontrer les enseignants

Dan Zhang
Professor
Leeds School of Business

Model selection refers to selecting a model among many alternatives and

is essential for particular modelling.

There are several ways to perform model selection.

The first one is subset selection, where we identify a subset of the predictors and

the fit of a model on the reduced set of variables.

The second one is shrinkage, where we fit a model with all predictors.

However in our estimation procedure,

we force the coefficients to move toward zero.

Variables with zero coefficients are then dropped from the model,

hence shrinkage can be viewed as a massive subset selection.

We do not cover shrinkage in this course.

The third one is dimension reduction where we project

the predictors into a lower dimension of subspace.

Principle component analysis we mentioned in the previous module is

an example of this.

In this video, we focus on subset selection.

There are several method for model selection.

We briefly talk about a few of them.

In best subset selection,

we fit all combinations of the predictor variables and choose the best one.

In order to choose the best model, we can use cross validation or

some other criteria.

Notice as the number of combinations to consider grows quickly with the number of

predictor variables.

Except when the number of variables is very small,

there are many combinations to consider.

Even though it is desirable to consider all combination of a predictor variable in

subset selection, we often end up with too many combination to examine.

An alternative is to use the so-called stepwise selection,

which can be viewed as a heuristic method for best subset selection.

Instead of considering all combinations, we choose to add or remove one variable at

a time, which will significantly reduce the number of models we need to evaluate.

There are two variants of stepwise selection.

In forward stepwise selection, we start with a one variable model and

successively add variables, one at a time.

Backward stepwise selection is almost the reverse.

We start with the model containing all variables and

successively remove variables.

Like in best subset selection, we can use cross validation or

some other criteria to choose the best model in each step.

Now consider an example best subset selection using housing data.

In the original dataset, there are 9 predictor variables.

If we choose to consider all possible combinations of variables,

they are 2 to the 9th power which is 512 possible models.

In order to simplify our discussion,

let's consider only three predictor variables, SQFT, PARKING.TYPE, and BEDS.

There are a total of 2 to the 3rd power, which is 8 combinations to consider.

This table, these all combinations of particular variables.

As we mentioned before, there are eight of them,

the first one is a null model containing no variables.

The first column shows the variables included in the model and

the second column shows the sum of squared error on the validation data.

We use a 60-40 split as before where 188 rows are in the training data and

126 rows are in the validation data.

Sum of squared errors were varies considerably across different models.

It can be seen that the model with only SQFT and

BEDS gives the lowest sum of squared error.

Based on the cross-validation result, we choose this model as the best model.

Explorer notre catalogue

Rejoignez-nous gratuitement et obtenez des recommendations, des mises à jour et des offres personnalisées.

Coursera propose un accès universel à la meilleure formation au monde, en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.

© 2018 Coursera Inc. Tous droits réservés.

Télécharger dans l'App Store

Disponible sur Google Play