Gestural Interaction

Loading...

En provenance du cours de University of London

3D Interaction Design in Virtual Reality

44 notes

University of London

3D Interaction Design in Virtual Reality

44 notes

Cours 3 sur 5 dans Specialization Virtual Reality

This course will teach you about one of the most important aspects of VR, how you interact with a VR world. Virtual Reality is completely different from an on screen app or game. You are completely immersed in a VR world, so it doesn't make sense to interact only through buttons or menus. You will get the most out of VR if you can interact with the world just as you would with the real world: with your natural body movements. You will learn about the basic concepts and technologies of VR Interaction. You will then get hands on, learning about how to move around in VR and how to interact with the objects in your world. The course will finish with some advice from experts on VR interaction design and you will do a project where you will get real experience of developing VR Interaction.

À partir de la leçon

Challenges in VR interaction and User Interfaces in VR

Welcome to Week 4! In the final week of this MOOC, we'll be looking at challenges in VR interaction, and user interfaces in VR. You'll begin by learning about graphical user interfaces in VR, including abstract interfaces and diegetic and non-diegetic UI, before moving on to designing VR interaction.

Introduction to Graphical User Interfaces in VR1:00

Abstract Interfaces2:03

Diegetic and Non-Diegetic UI3:32

Unity UI Tutorial4:01

Gestural Interaction2:40

Issues in VR Interaction3:12

Rencontrer les enseignants

Dr Sylvia Xueni Pan
Lecturer, Department of Computing
Goldsmiths, University of London
Dr Marco Gillies
Senior Lecturer
Computing Department, Goldsmiths, University of London

Gestures are a way of interacting that have become

popular with touchscreen phones and tablets.

They're normally movements of your hands,

arms or fingers that have a definite meaning or result.

Classic examples on a touchscreen are swipe gestures to scroll through a list,

or pinch to zoom where moving your fingers apart or together zooms in or out of an image.

In VR, if you have a six-degree-of-freedom controller,

you can interact with your whole body.

You can swipe with your arms or zoom by moving your whole arms in and out.

You can also have gestures with other parts of your body,

like nodding your head or shaking it.

Because gestures can use your whole body and involves movement,

they can feel good,

and a lot of them can also be very natural.

Gestures are likely to feel most natural if they're close to real-world actions.

Swiping feels natural because it's like flicking through clothes on hangers,

and zooming with your hands feels natural

because it's like stretching or squashing something.

That real-world connection makes them easy to learn.

But both of these examples will also feel natural

because we've learnt similar gestures on touchscreens.

So we can also take existing interfaces as a key.

You should design gestures to be like real-world actions.

For example, in Western cultures,

nodding your head means yes,

so it's a natural gesture for confirming an action. But we have to be careful.

If we use gestures that are not linked to real-world actions,

they can be unnatural.

Making a circle is an easy gesture to do,

but it's not closely linked to anything you would do in the real world.

The same goes for actions that are based on the real world

but aren't that similar to the equivalent real-world interaction.

You might also have noticed that just now I said in Western cultures,

nodding your head means yes.

It doesn't mean yes everywhere in the world.

Just because a gesture is well-known where you are in the world doesn't

mean it will work if you are creating an experience for people globally.

Gestures can be quite hard to implement,

normally with custom scripts,

but there's been a lot of work in the last few years on

generic gesture recognition software

based on machine learning algorithms like neural networks,

and some are starting to be available for Unity.

It's a big area of development for us at Goldsmiths,

so watch this space.

Explorer notre catalogue

Rejoignez-nous gratuitement et obtenez des recommendations, des mises à jour et des offres personnalisées.

Coursera propose un accès universel à la meilleure formation au monde, en partenariat avec des universités et des organisations du plus haut niveau, pour proposer des cours en ligne.

© 2019 Coursera Inc. Tous droits réservés.

Télécharger dans l'App Store

Disponible sur Google Play