Welcome to the course “Augmented Reality & Video Service Emerging Technologies.” The level of AR (Augmented Reality) and advanced video & multimedia technology included in a product is what determines the level of value and luxury. The objective of this course is to teach all important technologies that are used in state-of-the-art AR, Skype, and YouTube video and multimedia products and services. This includes the advanced video and real-time multimedia delivery mechanisms based on H.264/MPEG-4 AVC, MPEG-DASH, CDN, and mobile CDN. If you have knowledge of these core technologies, you can understand the operations that are used in every advanced video and multimedia system in the World. As the future World of business and products are driven to be more and more video and multimedia oriented, having knowledge of these core technologies will enable you to lead your company to become the true World leader in AR and video multimedia technology products, services, and business. Thus, I cordially welcome you into the beautiful and powerful World of advanced AR and video multimedia!
1.1 AR Introduction
Loading...
En provenance du cours de Yonsei University
AR (Augmented Reality) & Video Streaming Services Emerging Technologies
notes
Yonsei University
notes
Cours 4 sur 4 dans Specialization Emerging Technologies: From Smartphones to IoT to Big Data
À partir de la leçon
AR Applications, Products & Business
The first module “AR Applications, Products & Business” focuses on the variety of AR (Augmented Reality) applications, technologies, products, and businesses. The lecture starts with the definitions and characteristics of AR and explains the differences of AR and VR (Virtual Reality). Then the advantages of various AR UI (User Interface) types, which include handheld AR displays (e.g., smartphones), AR eyeglasses, and HMDs (Head-Mounted Displays) are covered. In addition, AR business models and an analysis of the AR market, which includes the AR/VR headset market share, Worldwide AR/VR headset forecast, AR/VR market size by segment, and AR/VR market size forecasts are described.
Rencontrer les enseignants
Jong-Moon ChungProfessor, School of Electrical & Electronic Engineering
Director, Communications & Networking Laboratory
[MUSIC]
This course will begin with the first part of augmented reality
applications products and business.
Where an introduction on augmented reality will be the first
thing we will study about.
The definition of augmented reality.
Augmented reality is a technology that superimposes a user's real wold view with
a computer-generated virtual text, image in real-time.
The types of user interfaces that augmented reality will use will
be a screen, a monitor, a helmet, a facemask, glasses, goggles.
A Head-Mounted Display, a window or like a car windshield,
and there are various other surfaces.
Practically speaking, any surface that you can use in a real-world view.
Is basically one of the surfaces that can be used for augmented reality display.
Handheld augmented reality displays, the best one to use is smartphones.
The initial commercial success of the augmented reality model is the smartphone.
The reason is because smartphones have very good processing capability,
they have good cameras, they have good displays.
And also the portability of these devices make them perfect for augmented reality.
For example, this is one model of augmented reality being used
on a smartphone, augmented reality eyeglasses.
These are the second best platform for implementing argumented reality for
individual users.
The Google Glass is one of the premiere earliest products.
That's shown the potential for argumented reality to be implemented on glasses.
From the outside, other people may not see what is projected on the inside for
the individual user.
And that has true benefits in having privacy of information.
In addition, you can see that it has a camera module right here.
So the information that is picked up by the camera is detected.
And information and various characters are imposed
projected on the inside just for the user.
In addition, there are Head-Mounted Displays,
these are a little bit larger than glasses.
And their capability and functionality, of course, is more enhanced.
As you can see here, this is a mobile augmented reality device that
can provide an immersive AR experience.
An example of Aircraft Maintenance & Aviation is shown right here.
The Augmented Reality Description is what we're going to talk about next.
Virtual text or image can be superimposed on
selected objects in the real world view of the user.
An augmented reality generated superimposed virtual text or
image is about that selected object.
Or what it would mean to the relative objects surrounding it.
And it will be selected in a way such that the text.
Or the other added image will enhance the information that is customized for
the individual user.
Augmented reality, therefore, is based on Context Aware Computing.
Meaning that what is going to be displayed is selected and
it is customized towards the user.
So if you're using augmented reality.
The information that is going to be displayed on the augmented
reality device will be customized to what you want to see.
For an AR user, the Real World and Virtual Objects coexist on the same point of view.
For example, on a smartphone, looking at a picture in a museum.
Well, the augmented reality device could super impose what this picture,
or this art masterpiece is about.
And you can see that information overlaid on the information right here.
Now this is just for a demonstration, in a real augmented reality device,
you will not really cover up the object this much.
However, just so that you can see it on our screen,
we made this a little bit large.
And normally, it will not be such that it would hinder the view,
it would block the view of the original object.
This is an augmented reality development environment that was used in
my laboratory with my grad students.
This is off of one of our earlier models that we tested and
developed augmented reality on.
And as you can see, our test environment, where we measure the power and
the response time of the system is all here in one unit.
Larger units do exist and
now we're doing much more development on various other platforms.
In addition, we're doing it on Head-Mounted Displays,
as well as glasses and, of course, smartphones.
Short history of augmented reality and virtual reality,
because the two coexist, and there are some similarities.
Yet there are much differences we need to know about the two.
In 1901, the author, Frank Baum,
first mentions the idea of character marker.
Which is an electronic display overlaying real life, especially people.
So if there is a person, then on top of him or near him,
would be his name, maybe age.
And other information that would be needed or
useful to people that are looking at that monitor.
This concept was the original concept, this grew where?
In 1989, much, much later, Jaron Lanier coins
the phrase a virtual reality, VR, and its concept model.
As you know, virtual reality is different from augmented reality.
In virtual reality, you have a virtual reality environment,
which is animated, it's not the real world.
The good thing about it is that, that world can be anything that you want
it to be, it can be fully designed, and fully animated.
In addition, the characters of how you interact in
that virtual world would be an avatar.
Or a certain object where you would control based on your movement.
Therefore, everything in a virtual reality world is make believe.
Including yourself, which can be transferred into a certain object,
a certain character, or an avatar.
In 1990, the concept of augmented reality was put together.
And the difference between augmented reality and
virtual reality needs to be looked in further.
Which we will do in the following couple of pages.
Augmented reality, therefore, seems like a pretty old technology,
because in 1990 was when the terminology was put together.
Then why do we learn about it now?
Why is it important now?
Looking into some of the reasons is because higher resolution cameras on
smart devices.
Including Head-Mounted Displays, smartphones, as well as glasses,
can enable accurate image and object identification.
In addition, enhanced processing capability with
the development of very powerful CPUs and GPUs.
And various other software techniques that enable
the accepted image to be processed very, very quickly.
Is one of the other reasons that augmented reality is useful now.
In addition, this is about image processing,
which needs to save images and then process them.
That means that we have to have fast and abundant memory, and
that is one of the true benefits of modern technology.
In addition, there is high definition displays on our smart devices,
and other various Head-Mounted Displays, as well as our glasses.
And because of these very high definition displays that we have,
we can accurately show an additional object.
Or an additional text script,
such that the reality is enhanced in information.
In addition, we cannot do all the processing on the device itself.
Because a smart device, a glass type augmented reality device or
a Head-Mounted Display.
A lot of these devices are portable, and when they're portable,
they are made light and they are made to be limited in battery energy.
That is why when we have a networking connection that we can use,
we do not have to do all the processing.
And all the information retrieval and the character generation on that device.
That device as in terms of smart device, smartphone,
glasses or Head-Mounted Display.
We can rely on a server, a Cloud, an augmented reality computer to help us.
But that would mean that we would need to be connected to it through networking,
wireless and wired networking.
And with the advance of these technologies.
Now augmented reality is coming into its true
potential to become a real service and product.
In addition, there are so many new platforms that we can use for
augmented reality, as I explained in the earlier slides.
Because we now have smartphones that are very powerful, smart devices,
smart glasses, smart watches, wearable IOT devices.
All of these technologies can be used as a platform for augmented reality.
So augmented reality will only get better,
more broader, more frequently used everywhere.
From automobiles to piloting devices to drone control and so much more.
And because of this, technology will evolve to make this faster,
more accurate, more informative.
In addition, the power consumption will drop.
And there will be new methods to save energy such that
the lifeline of the device will be extended.
It will be easier to use, more portable, and much cheaper.
There will be much more functionalities and features, and
it will be much more reliable, and more durable.
All of these features in augmented reality is being enabled.
And I personally am doing research with my grad students to make this
possible as well.
So therefore, expect for augmented reality to come in even stronger,
more abundant in almost every product in every way.
And that's why I recommend for you to look into further details of this course.
Which will explain the details of how augmented reality is made possible.
We will now compare augmented reality with virtual reality to
check their definitions, their similarities and their differences.
The question on augmented reality and virtual reality,
what is the difference of virtual reality and augmented reality?
Virtual reality users will be fully immersed into an artificial and
animated environment that is all make believe.
This is perfect for game playing spaces.
Because you want to have them experience,
the game players experience a totally different world.
The user, the player will commonly use an avatar to exist and
interact inside the virtual reality space.
The user's view in virtual reality is different from the real environment.
Such that fantasies and illusions are easy to create in the virtual world.
Augmented reality is a mixture of real life and virtual reality.
In a way such that augmented reality users are able to obtain useful
information about locations, an object.
And they can interact with virtual contents in the real world.
So augmented reality is based on the real world view where selected objects or
items are either enhanced by adding information.
Or a certain type of description, characterization, or
something is added symbolically such that it helps the user to do a specific task.
Whereas virtual reality is really about a totally made up
environment with made up characters that you can interact with.
An augmented reality user can distinguish the super imposed virtual objects.
And that is important in such a way that you can identify
what has been augmented and added and enhanced.
Augmented reality users may be able to turn on or turn off selected functions.
And this is needed such that you can select what mode you're in and
what information you may need.
In addition, in some cases, there may be too much information on your augmented
reality display, blocking the view of the real world.
You may not want that, in that case, you will need to select what mode.
And what is going to be displayed, and
augmented reality technology should enable you to do that the right way.
In comparison to virtual reality,
augmented reality users commonly feel less separated from the real world.
And this is because they are looking at the real world,
just that they have augmented virtual characters or text added to it.
Such that the real world is augmented, enhanced as in terms of information.
Fantasies and illusions can be created and superimposed on a real world view,
which is the true advantage of augmented reality.
Looking at it from a point of view of augmented reality definition,
this is one way to look at it.
Over there is the real environment, everything is real,
nothing is make believe.
Over here is the virtual environment, which is the virtual reality domain,
in the virtual reality domain, everything is make believe.
In addition, you, your character that exists within the virtual
reality environment is also a make believe character.
Although it may be animated in a way that it looks like you,
but still overall, it is not you.
Looking at this over here in the Mixed Reality domain.
Between the Real Environment and
the Virtual Environment right here is the Augmented Reality domain.
And we can look at it in terms that that domain will have
a composed virtuality based on reality.
Whereas the augmented virtuality is composed of reality based on virtuality.
What does that mean?
What does that mean?
You can think of it like this.
Augmented reality is a real world view, where you have virtual objects or
virtual text added into parts of the real world view.
Then what is this, this augmented virtuality?
Think of it this way, you may have a virtual reality domain,
everything is totally animated.
Although when you open a certain door, or you open a certain box,
you can actually see a part of the real world view.
Based on some type of camera that is really taking pictures someplace.
Then that is like having a real world view inside of a virtual reality domain.
That is augmented virtuality, whereas augmented reality is the real world.
Where parts, text, certain objects, a certain character only is added in
the real world view, and that's the difference we're talking about.
One other definition is based on this.
If there is a domain of combination of real world and virtual reality.
In addition, a combination of a 3D image, a 3D area,
which is really based upon where we can co-exist inside.
In addition, real-time interaction is possible because we're in the real world.
A combination which would be a cross-section area of these three
domains is where augmented reality true features can be expressed.
Based on this definition.
Then, what are the augmented reality based support techniques?
There is sensor based, there is vision based and
hybrid tracking based augmented reality.
As in terms of it, GPS, that is global positioning system to
tell you your location as in terms of longitude and latitude.
A Gyro sensor to show where you're moving,
what movement is actually going on for that device.
An accelerometer, which tells you how fast you are accelerating or
deccelerating in a certain direction.
These type of things are what's sensors pick up.
And they can be used in various devices to make augmented reality more real and
more accurate.
In addition, there is a vision based augmented reality.
And this is a domain in which we will study much more in
the following lectures of this course.
In which computer vision, something like OpenGL, like an open graphics library.
These tools are used such that we create augmented reality
technology to detect what's in there, what are the objects?
What are we interested in among those objects?
And then we find just the right characterization or
the information to display it, near it or on it.
That is what we're talking about here and
some of the tools that you can use to accomplish that is listed here.
Hybrid tracking based AR, this is like the vision and
sensor, this and this added up into one.
For typical applications, like in outdoors augmented reality, yeah, you need both.
You need sensors and you need vision based augmented reality technology support.
These are the references that I used and I recommend them to you.
Thank you.
Explorer notre catalogue
Rejoignez-nous gratuitement et obtenez des recommendations, des mises à jour et des offres personnalisées.
Coursera propose un accès universel à la meilleure formation au monde,
en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.
© 2018 Coursera Inc. Tous droits réservés.
