Unit 3

Augmented Reality
 Introduction to Augmented Reality
(AR):-
• Augmented reality (AR) is the real-time use of
information in the form of text, graphics,
audio and other virtual enhancements
integrated with real-world objects.
• Augmented reality is an interactive experience
that combines the real world and
computer-generated content.
• Augmented reality (AR) is
an enhanced version of
the real physical world
that is achieved through
the use of digital visual
elements, sound, or other
sensory stimuli and
delivered via technology.
• It is a growing trend
among companies
involved in mobile
computing and business
applications in particular.
 Examples of Augmented Reality

• Product shopping :-
Some early adopters in the retail sector have developed AR technologies
designed to enhance the consumer shopping experience. Augmented
reality has been incorporated into store catalog apps, which allows
consumers to visualize what different products would look like in different
environments.
For example, when buying furniture, shoppers point the camera to the
appropriate room and the product will appear in the foreground.
• Medical sector:-
Augmented reality’s benefits can also extend to the healthcare sector,
where it can play a much bigger role. AR apps enable users to see highly
detailed, 3D images of different body systems when they fly their mobile
device over a mark image.
This use of AR has become a powerful learning tool for training medical
professionals.
What Is Augmented Reality Used for?

• Augmented reality is an interactive experience in

which a real world environment is enhanced with
computer-generated visual elements, sounds, and
other motivations.
• It can provide a user with a sensitive, more
immersive experience than they would practise
otherwise that adds to the user's enjoyment or
understanding.
• From a commercial perspective, augmented
reality can increase brand awareness and boost
sales.
What is the Difference Between VR
and AR?
Factors VR AR

Virtuality VR is completely virtual AR uses a real-world entity to enhance digital content

Control VR users are controlled by the system AR users can control their presence in real world

VR requires compatible devices like a

Compatibility AR needs no specific device
headset device

Environment VR only enhances a fictional reality AR enhances both virtual and real-world entities

VR is composed of cables and can be AR is free from cables and free to move without any
Freedom
inaccessible over a specified distance. hindrances like distance.
 Taxonomy of Augmented Reality
• Augmented Reality can be classified based on different criteria:
• Type of Augmentation:
– Marker-based AR: Uses visual markers like QR codes to trigger AR content.
– Markerless AR: Uses GPS, accelerometer, or gyroscope data to overlay content
(e.g., Pokémon Go).
– Projection-based AR: Projects digital information onto physical surfaces.
– Superimposition-based AR: Replaces a part of the view with augmented
content.
• Display Technology:
– Head-Mounted Displays (HMDs): AR glasses or headsets (e.g., Microsoft
HoloLens).
– Handheld Devices: Smartphones and tablets.
– Spatial AR: Uses projectors and sensors to augment the environment.
• User Interaction:
– Touch-based, gesture-based, voice commands, or eye-tracking.
 Technology and Features of
Augmented Reality
• Key Technologies:
– Sensors and Cameras: Capture real-world data.
– Processing Unit: Computes the augmented data.
– Projection: Displays virtual objects in the real
world.
– Reflection: Directs projected images to the user’s
eye (especially in optical see-through displays).
– Display Devices: Screens, glasses, or projectors.
• Features:
– Real-time Interaction: Seamless integration of
virtual objects.
– 3D Registration: Virtual objects correctly aligned
with real-world coordinates.
– Context Awareness: AR responds to
environmental data.
– Persistence: Virtual objects remain stable in the
environment.
 Challenges with AR
Technical Challenges:
• Accurate and fast 3D registration.
• Latency and synchronization.
• Limited field of view in AR devices.
• Power consumption and device ergonomics.
Content Challenges:
• Creating realistic and contextually relevant AR content.
• User interface design complexity.
Environmental Challenges:
• Handling occlusion (virtual objects being blocked by real objects).
• Variable lighting conditions affecting tracking.
Social and Privacy Challenges:
• Privacy concerns with continuous real-world data capture.
• User acceptance and safety issues.
 5. AR Systems and Functionality
• Components:
• Input: Sensors (camera, GPS, IMU).
• Processing: Computing hardware and algorithms for tracking and
rendering.
• Output: Display devices showing augmented content.
• Interaction: User interfaces (gestures, voice, touch).
• Functionality:
• Tracking: Identifying and following the user's position and
environment.
• Mapping: Understanding spatial layout.
• Rendering: Overlaying virtual objects aligned with the real world.
• User Interaction: Allowing manipulation of AR content.
 Augmented Reality Methods
• Tracking Methods:
– Marker-based tracking: Detects predefined visual markers.
– Markerless tracking: Uses natural feature tracking, GPS, or
inertial sensors.
– Simultaneous Localization and Mapping (SLAM): Builds a
map of the environment while tracking the user's location.
• Display Methods:
– Optical See-through: Transparent display overlays digital
info on real world.
– Video See-through: Camera captures real world and mixes
with virtual objects on screen.
– Projection-based: Projects images directly on surfaces.
 Visualization Techniques for
Augmented Reality
• 2D overlays: Simple text or icons on the real
world.
• 3D Models: Complex objects integrated in 3D
space.
• Animations: Dynamic and interactive virtual
content.
• Spatial Sound: Audio cues that correspond to
virtual object locations.
• Occlusion handling: Techniques to ensure virtual
objects appear behind real objects correctly.
 Enhancing Interactivity in AR
Environments
• Gesture Recognition: Use hand or body
gestures for control.
• Voice Commands: Natural language
interaction.
• Eye Tracking: Focus-based interaction.
• Haptic Feedback: Physical sensations to
simulate touch.
• Multi-user Collaboration: Shared AR
experiences across devices.
 Evaluating AR Systems
• Evaluation involves:
• Usability: Ease of use, user satisfaction.
• Accuracy: Precision of tracking and object placement.
• Latency: Delay between user action and system
response.
• Robustness: System performance in different
environments.
• User Experience: Immersion, engagement, and
comfort.
• Effectiveness: Impact on task performance.