Unit- 2 Computers in HCI
Input Technologies and Techniques, Sensor- and Recognition-Based Input for
Interaction, Visual Displays, Haptic Interface, Non-speech Auditory and
Cross modal Output, Network-Based Interaction, Wearable Computers,
Design of Fixed, Portable, and Mobile Information Devices
Unit- 2 Computers in HCI
Input Technologies and Techniques, Sensor- and Recognition-Based Input for
Interaction, Visual Displays, Haptic Interface, Non-speech Auditory and
Cross modal Output, Network-Based Interaction, Wearable Computers,
Design of Fixed, Portable, and Mobile Information Devices
Sensor- and Recognition-Based Input for Interaction
Sensors convert a physical signal into an electrical signal that may be manipulated symbolically on a
computer
A wide variety of sensors have been developed for aerospace, automotive, and robotics applications
Continual innovations in manufacturing and reductions in cost have allowed many sensing
technologies to find application in consumer products.
interesting example: Conventional computer mouse, used two metal wheels and a pair of potentio
meters to sense the wheels rolling over a desk surface
Later design: a ball and a pair of optical encoders to convert the movement of the hand into digital
signals indicating precise relative motion
Now, even the most inexpensive mice use a specialized camera and image-processing algorithms to
sense motions at the scale of one one-thousandth of an inch several thousand times per second
Sensor- and Recognition-Based Input for Interaction
Sensors and Sensing Modes
• Occupancy and Motion Range Sensing
• Position
• Movement and Orientation
• TouchGaze and Eyetracking
• Speech
• Gesture
• Identity
• Context
• Affect
• Brain Interfaces
Sensor- and Recognition-Based Input for Interaction
Sensors and Sensing Modes
Occupancy and Motion Range Sensing
• Air pressure sensors that detect changes in air pressure resulting from the opening of doors and
windows
• Capacitive sensors that detect capacitance changes induced by the body
• Acoustic sensors
• Photoelectric and laser-based sensors that detect disruption of light
• Optoelectric sensors that detect variations in illumination
• Pressure mat switches and strain gauges
• Contact and noncontact (magnetic) switches
• Vibration detectors
• Infrared motion detectors
• Active microwave and ultrasonic detectors
• Triboelectric detectors that detect the static electric charge of a moving object (Fraden 2003)
Sensor- and Recognition-Based Input for Interaction
Range Sensing
• Range sensors calculate the distance to a given object
• Many range and proximity sensors triangulate the position of the nearest object
• Such detectors can be used as occupancy detectors, and they are also useful in motion- and
gesture-driven interfaces.
Sensor- and Recognition-Based Input for Interaction
Sensors relevant to interactive applications and their typical modes of use.
1. Sensor/Sensor mode –Name (Occupancy and Motion Range Sensing,
Position, Movement and Orientation, Touch Gaze and Eye tracking,
Speech, Gesture, Identity, Context, Affect, Brain Interfaces)
2. Real time Application (Name any 5)
3. Application Image (5)
4. Working idea/ principle (in few lines)
5. Other sensors involved / technology involved (5)
Signal Processing
1. rare to find a sensor precisely suited to a given sensing task.
2. Often, sensor output must be manipulated or combined with other sensors to fit
the needs of the application.
3. This section surveys signal-processing techniques useful in applying sensors to
input and recognition tasks.
Signal Processing
• Preprocessing
• Feature selection
• Classification and modeling
Signal Processing
• Example system
Intelligent room
• Considerations in designing recognition-based systems
Computational cost, utility, and the cost of failure
Role of feedback
