Augmented Reality
Virtual Reality
Virtual and Augmented Reality Introduction
ELIZABETH MARTÍNEZ VIVEROS
BYRON ALFONSO PÉREZ-GUTIÉRREZ
Mechatronics Engineering
Universidad Militar Nueva Granada
[email protected]
[email protected]
January 2023
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Outline I
1 Augmented Reality
2 Virtual Reality
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Augmented Reality
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Virtual Reality vs Augmented Reality
Augmented Reality (AR) and Virtual Reality (VR) are often part of
the same conversation, though there are significant differences
between the two technologies.
www.masteryield.com/inicio/avada-vr-man1/
www.newscientist.com/article/2130678-augmented-reality-goggles-give-surgeons-x-ray-vision/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Augmented Reality
¿What is Augmented Reality?
Is a general term applied to a variety of display technologies
capable of overlaying or combining alphanumeric, symbolic, or
graphical information with a user’s view of the real world.
https://www.youtube.com/watch?v=AYd7KC0yzKw
https://www.youtube.com/watch?v=vhEtAAtsOG4
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Display types
Optical see-through HMD - Video see-through HMD
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Display types
Desktop and mobile device displays
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Displays
Sir Howard Grubb. A New Collimating-telescope Gun-sight for
Large and Small Ordnance. R. Dublin Soc., 1901 - 9 pages. Patent
No.12108
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - HUD (Heads Up Display) in a aircraft
Transparent display mounted in front of the pilot that enables viewing
with the head positioned "up" (or heads-up) and looking forward, instead
of looking angled down, looking at instruments lower in the cockpit
http://www.esacademic.com/dic.nsf/eswiki/563390
Because the information projected onto the HUD is collimated (parallel light rays) and focused on
infinity, the pilot’s eyes do not need to refocus to view the scene beyond the display outside of the
aircraft.
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - HUD in a car
https://www.bmw.es/es/footer/footer-section/glosario-bmw/bmw-head-up-display.html
https://www.youtube.com/watch?v=i77ZW-4rLRE
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Microsoft Hololens 1/3
https://www.microsoft.com/en-us/hololens
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Ar - Microsoft Hololens 2/3
https://www.microsoft.com/en-us/hololens
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Microsoft Hololens 3/3
https://www.microsoft.com/en-us/hololens
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Magic Leap
https://www.brainlab.com/es/press-releases/
brainlab-releases-immersive-interactive-anatomy-viewer-based-on-magic-leap-one/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Mobile devices 1/2
Location of places of interest
https://cdn-images-1.medium.com/max/1600/1*K4v3T5GcJVDAxm3IOJ9mQw.jpeg
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Mobile devices 2/2
IKEA product catalog.
https://www.ikea.com/gb/en/customer-service/ikea-apps/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - CAD
Computer Aided Design (CAD) with AR
https://blog.metavision.com/meta-announces-new-augmented-reality-integration-with-solidworks
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
AR - Robotics
Industrial robot programming with AR.
Araque, D., Díaz, R., Pérez-Gutiérrez, B., Uribe, A. J. (2011, March). Augmented reality motion-based
robotics off-line programming. In Virtual Reality Conference (VR), 2011 IEEE (pp. 191-192). IEEE.
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Virtual Reality
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Virtual Reality (VR)
¿What is Virtual Reality?
“A high-end user-computer interface that involves real-time
simulation and interaction through multiple sensorial channels.”
(vision, sound, touch, smell, taste)” - Burdea 2003
http://conferences.computer.org/vr/2010/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Morton Heilig’s Sensorama - 1962
3D movie
Smell
Stereo sound
Seat vibrations
Wind
http://www.mortonheilig.com/
Video: https://www.youtube.com/watch?v=vSINEBZNCks
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Reality - Virtuality
From physical reality to virtual reality through imagination.
http://www.osmifw.com/arthroscopy/knee-surgeon-fort-worth/
https://openclipart.org/detail/279682/thinking-v1-animation
Rasool S., Sourin A. Image-driven virtual simulation of arthroscopy, The Visual Computer, Springer,
29(5): 333-355, 2013.
Video: https://www.youtube.com/watch?v=PZjC5P_gPRE
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Surgery simulator
S. Ullrich, T. Kuhlen. Haptic Palpation for Medical Simulation in
Virtual Environments. Best paper IEEE Virtual Reality 2012
Video application: https://www.youtube.com/watch?v=QmtHecrOVXo
Video full presentation: https://www.youtube.com/watch?v=M0YpjNUBOY4
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Blocks of a VR System
Virtual Input / Output
Reality
Engine Devices
Software
& User
Databases
Tasks
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Virtual Reality components
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
The 3 I’s of Virtual Reality
Burdea 2003. Virtual Reality Technology
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Human body senses and VR systems
Main senses:
Sight: 3D vision; VR helmets, 3D screens and glasses, CAVE
Touch: Haptic devices; force and touch feedback
Hearing: 3D sound; stereo, binaural and 5.1 systems
Smell: Olfactory displays
Taste: Gustatory displays
Other sense:
Proprioception: sense of movement and position of our limbs
and muscles
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Proprioception - Degrees of Freedom
Translations and rotations
Tx , Ty , Tz , Rx , Ry , Rz
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Proprioception - Complete body interaction
Tuukka M. Takala, Mikael Matveinen. (2014). Full Body Interaction in Virtual Reality with Affordable
Hardware.
Video: https://youtu.be/wMEaJWsowfQ
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of sight - Meta Quest
Head Mounted Display - HMD: Meta Quest Pro - Meta Quest 2
https://www.meta.com/quest/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of sight - HTC Vive Pro2 - XR Elite
https://www.vive.com
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of sight- VR Box
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of sight - Google Cardboard
https://vr.google.com/cardboard/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Touch - Haptic and power information flow
Srinivasan, M. A., & Basdogan, C. (1997). Haptics in virtual environments: Taxonomy, research status,
and challenges. Computers & Graphics, 21(4), 393-404.
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Touch and sight - CAVE with haptics
Pitstop Simulator was created by Clarté and Haption with 3DVIA
Virtools and showcased at Laval Virtual 2008
Video: https://www.youtube.com/watch?v=dCNw_e_zx-c
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of touch - Myo
Electromyography sensor
9-axis inertial measurement unit: 3-axis gyroscope 3-axis
accelerometer 3-axis magnetometer
Processor ARM Cortex M4 and bluetooth
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of touch - Leap motion
https://www.leapmotion.com/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of touch - Myocardium palpation
L. Vega-Medina. Prototipo de simulador de corazón basado en miocardio humano para educación
médica. Universidad Antonio Nariño. 2017
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of hearing - 3D Audio
Burdea 2003. Virtual Reality Technology
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of smell
Nakamoto, Otaguro. Cooking up an interactive olfactory game
display. Tokio Institute of Technology. 2008.
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of smell - Nosulus Rift
Ubisoft. Nosulus Rift. http://nosulusrift.ubisoft.com/
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Sense of taste
http://nimesha.info/
Nimesha Ranasinghe, Ryohei Nakatsu, Nii Hideaki, and Ponnampalam Gopalakrishnakone.Tongue
Mounted Interface for Digitally Actuating the Sense of Taste, in Proceedings of the 16th IEEE
International Symposium on Wearable Computers (ISWC), June 2012, pp. 80-87. DOI: 10.1109
ISWC.2012.16, ISSN: 1550-4816.
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Applications
Industry, Medicine, Architecture, Biology, Astronomy, Education,
Entertainment ....
https://www.youtube.com/watch?v=sv6T-tg6RL4
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
Augmented Reality
Virtual Reality
Questions?
B.A. Pérez-Gutiérrez - E. Martínez-Viveros Virtual and Augmented Reality Introduction
