1.4 Why is Spatial Special? (III) - A Data Perspective

Loading...

En provenance du cours de Yonsei University

Spatial Data Science and Applications

75 notes

Yonsei University

Spatial Data Science and Applications

75 notes

Spatial (map) is considered as a core infrastructure of modern IT world, which is substantiated by business transactions of major IT companies such as Apple, Google, Microsoft, Amazon, Intel, and Uber, and even motor companies such as Audi, BMW, and Mercedes. Consequently, they are bound to hire more and more spatial data scientists. Based on such business trend, this course is designed to present a firm understanding of spatial data science to the learners, who would have a basic knowledge of data science and data analysis, and eventually to make their expertise differentiated from other nominal data scientists and data analysts. Additionally, this course could make learners realize the value of spatial big data and the power of open source software's to deal with spatial data science problems. This course will start with defining spatial data science and answering why spatial is special from three different perspectives - business, technology, and data in the first week. In the second week, four disciplines related to spatial data science - GIS, DBMS, Data Analytics, and Big Data Systems, and the related open source software's - QGIS, PostgreSQL, PostGIS, R, and Hadoop tools are introduced together. During the third, fourth, and fifth weeks, you will learn the four disciplines one by one from the principle to applications. In the final week, five real world problems and the corresponding solutions are presented with step-by-step procedures in environment of open source software's.

À partir de la leçon

Understanding Spatial Data Science

The first module of "Spatial Data Science and Applications" is entitled to "Understanding of Spatial Data Science." This module is composed of four lectures. The first lecture "Introduction to spatial data science" was designed to give learners a solid concept of spatial data science in comparison with science, data science, and spatial data science. For Learner's better understanding, examples of spatial data science problems are also presented. The second, third, and fourth lectures focuses on "what is spatial special? - unique aspects of spatial data science from three perspectives of business, technology, and data, respectively. In the second lecture, learners will learn five reasons why major IT companies are serious about spatial data, in other words, maps. The third lecture will allow learners to understand four issues of dealing with spatial data, including DBMS problems, topology, spatial indexing, and spatial big data problems. The fourth lecture will allow learners to understand another four issues of spatial data including spatial autocorrelation, map projection, uncertainty, and modifiable areal unit problem.

1.4 Why is Spatial Special? (III) - A Data Perspective8:00

Rencontrer les enseignants

Joon Heo
Professor
School of Civil and Environmental Engineering

Hi, everyone. In this lecture,

we'll discuss the answers to the same question.

"Why is spatial special?"

From perspectives of spatial data characteristics and analytics.

I'll give you the answer from four different categories again.

The first law with geography,

which is about spatial autocorrelation issue.

Coordinates systems, issues on transformation between 3D and 2D space.

Uncertainty which is about the fact that spatial data is basically probabilistic.

Modifiable Areal Unit problem,

different aggregations would make

different outcomes in spatial analysis.

Dr. Tobler in 1970, stated the first law of geography,

"Everything is related to everything else,

but near things are more related than distance things."

This is a fundamental concept of

spatial autocorrelation applicable to all spatial variables.

The figure illustrates the concept of spatial autocorrelation.

Which one do you think looks more natural? Left or right?

Yes, the image on the right side looks more natural.

In reality, it's a digital elevation model which is

depicting a small portion of the surface of the earth.

The value of spatial autocorrelation is 0.8.

On the other hand, the left image is

2D random noise which has zero spatial autocorrelation,

and it has no spatial dependence.

Spatial autocorrelation can be defined as the measure of

the degree to which one object is similar to other nearby objects.

So that positive spatial relationship or

spatial autocorrelation is assumed reasonable for spatial phenomena.

On the contrary, in most statistical analyses,

independence of data is generally assumed,

so the strong presence of spatial autocorrelation makes spatial analysis complicated.

Let's take a look at the figure with two examples.

What would be your estimates of the empty cells of A and B?

How about the average value of surrounding eight cells?

If it is applied,

then A is estimated as 25 and B is 65.

It appears reasonable in terms of spatial context.

However, the original dataset of

two examples are identical as given under the figure.

Without consideration of a spatial dependency,

estimates of A and B should be the same.

Inter-dependency of spatial data

should be always considered in any statistical analysis of spatial data.

The next issue is coordinate system.

There are mainly two ways of representing locations with coordinates.

Geographic or 2D Cartesian.

Geographic is based on 3D, longitude lambda, latitude of phi,

and ellipsoidal height with a small h. On the other hand,

2D Cartesian is simply x and y.

When you apply any analytics to your spatial data,

you have to check the coordinates system in the very first step.

Think about the given problem.

If you have spatial data with geographic coordinates,

and the simple distance computation is not an easy task at all.

Moreover, there are thousands and

thousands different map projections and coordinates systems.

So clear understanding of coordinates system is

required for advanced spatial data management and analytics.

Another important aspect of spatial data is uncertainty.

Spatial data is basically measurement and intrinsically prone to error.

As a result, any analysis result of spatial data is stochastic,

in other words, probabilistic.

Let's see the example on the slide.

When you see $1,000 on your bank account,

it is literally $1,000, and in this course, deterministic.

On the other hand,

when you have a human trajectory collected by GPS unit,

the location X, Y inevitably has uncertainty.

As a result, when you conduct any further analysis with the trajectory,

the result is probabilistic.

So we have to understand the nature of a spatial data

and to get used to living with uncertainty in spatial analysis.

Let's take a look at another example.

Hydrological analysis came up with red region of flooding at

the precipitation rate of 1 inch/hr for 3 hours.

Two ways of presenting the analysis result,

either deterministic in the above or probabilistic in the below.

Probabilistic statement in the below is the way of living with uncertainty,

and is more realistic.

Now, let's move to the next issue.

Let's take a look at the figure with

the given dataset depending on the way of aggregation,

the results become quite different.

We call this problem as "Modifiable Aerial Unit Problem",

which is often occuring to cartographic representation.

It can be described as

the same basic data yield different results when aggregated in different ways.

And it can happen with two cases,

scale effect and zoning effects as described on the slide.

One research found that correlations between Republican voting and percentage of

old people could vary from -0.97 to +0.99,

depending on how county in Iowa were aggregated.

So completely the opposite results were produced due to the problem.

Definitely, scale and unit problems

should be carefully considered in spatial data management and analysis.

In this lecture, we have discussed the answer to the question why is spatial is special,

in terms of spatial data characteristics and analytics.

Spatial data analysis have quite a few different issues from data science.

All right, this is the end of the first week,

hopefully you enjoyed it and see you all in the next week.

Explorer notre catalogue

Rejoignez-nous gratuitement et obtenez des recommendations, des mises à jour et des offres personnalisées.

Coursera propose un accès universel à la meilleure formation au monde, en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.

© 2018 Coursera Inc. Tous droits réservés.

Télécharger dans l'App Store

Disponible sur Google Play