Object Detecion in A Streaming Video: A Seminor Report ON
Object Detecion in A Streaming Video: A Seminor Report ON
SEMINOR REPORT
ON
OBJECT DETECION IN A STREAMING VIDEO
Submitted in partial fulfillment of the
Bachelor of
Technology In
Computer Science and Engineering
By
Professor
CERTIFICATE
I wish to thank Sri G Raghunath Reddy sir our beloved Managing Director & Smt.
V.K. Vani ,Director for providing us all facilities that are required for our seminar work.
I wish to thank our HOD Dr.AVLN Sujith, M. Tech.,Ph.D.for providing us all facilities that
are required for completing of my seminar work.
By:
(17F21A0569)
TABLE OF CONTENTS
ABSTRACT I
LIST OF FIGURES II
PAGE NO
TITLE
1.INTRODUCTION 1-5
2. BACKGROUND 6-9
2.1.Visual Image
2.2.Retinal Display
3. THE WORKING PRINCIPLE 10-11
INTRODUCTION
Technology is making a huge modification in existing machines or tools in order to
solve problem at higher level and make life comfortable. Screen less display is one of the
most interesting subjects in technologies and research on this is increasing by exponential
scale day by day. It is a system of transferring information/data though an electronic video
source without using screen at all. Few parts of this technology is being used at present but
they are not so advance yet.Screenless display is the present evolving technology in the
field of the computer-enhanced technologies. It is going to be the one of the greatest
technological development in the coming future years. Several patents are still working on
this new emerging technology which can change the whole spectacular view of the
screenless displays. Screen less display technology has the main aim of displaying (or)
transmitting the information without any help of the screen (or) the projector. Screen less
displays have become a new rage of development for the next GEN-X. Screenless videos
describe systems for transmitting visual information from a video source without the use of
the screen.
Well screenless display, AKA hologram, has such amazing potential that my hope is that
the internet can be a medium for collaboration of ideas and information about screenless
display that could help break down the barriers that prevent us from making it a reality.
Essentially screenless display is a projection that can be seen projected onto the air itself.
The only screenless display that has been achieved to my knowledge still uses fog as a
medium to reflect light. Other options have been to use mirrors and plastic film to imitate
the idea, but no one has been able to reflect light off of air itself. Can it be done? It’s quite
possible that it can. Light does reflect off of large amounts of air as we see in our
atmosphere but doing it in such a manner that we could pinpoint it to a single area is
immensely difficult. So why not take some time and look over some ideas I have collected
about the possibilities of screenless display and maybe even share some of your own.
Check some of the links below to get a better grasp on the development of the technology.
In the past similar systems have been made by projecting a defocused image directly in
front of the user's eye on a small "screen", normally in the form of large glasses. The user
focused their eyes on the background, where the screen appeared to be floating. The
disadvantage of these systems was the limited area covered by the "screen", the high weight
of the small televisions used to project the display, and the fact that the image would appear
focused only if the user was focusing at a particular "depth". Limited brightness made them
useful only in indoor settings as well.
Only recently a number of developments have made a true VRD system practical. In
particular the development of high-brightness LEDs have made the displays bright enough
to be used during the day, and adaptive opticshave allowed systems to dynamically correct
for irregularities in the eye (although this is not always needed). The result is a high-
resolution screenless display with excellent color gamut and brightness, far better than the
best television technologies.
In a conventional display a real image is produced. The real image is either viewed directly
or, as in the case with most head-mounted displays, projected through an optical system and
the resulting virtual image is viewed. The projection moves the virtual image to a distance
that allows the eye to focus comfortably. No real image is ever produced with the VRD.
Rather, an image is formed directly on the retina of the user's eye.
Reto Meier, an “Android Developer Advocate for Google” recently laid out a fairly
science-fiction account of where computer (or at least mobile) interfaces are headed.
In the spirit of the best futurism, all of his predictions - from Augmented Reality eye
glasses to advanced batteries - have parallels in the real world. What follows is a walk-
through of the future, expressed in terms of the not quite ready for prime time discoveries
coming out of labs today.
Working on the average laptop is like working on a desk that’s as big as a sheet of paper.
That’s why all our “files” are half an inch high. The key to productivity and immersion is
more, bigger screens - hence the proliferation of external monitors, secondary reading
devices and even mobile phones with improbably large screens.
So-called “Pico” projectors (named for their tiny size) already exist - there’s even an HD
version, the Forever Plus, that’s less than an inch on its longest dimension. And there are
mobile phones, such as the Samsung Show, which have built-in picoprojectors - so outside
of market demand (how many of us really need this?) there’s nothing to stop this prediction
from coming true.
The biggest impact in screenless technology has been seen in the use of optical technology.
Whether talking of VRD (virtual retinal display), RSD (retinal scanning display) or LOE
(light-guide optical element), optical technology is being used by consumer electronic
corporations like Apple to the military and even the health care industry. Optical
technology enables personal screenless displays by projecting images and data from
computers, DVD players, or VCRs into the viewer's eye, displaying them in the visual field
of the viewer. For instance, Microvision Inc. has created helmet mounted displays in which
an Army tank commander can view the surrounding area from topside while still viewing a
translucent map that floats a couple of feet away.
With the large influx of new displays into the market boasting '3D support', we thought we
would produce an article which outlines some of the key technologies being used, where
they differ and how they work. We will look at the two main techniques being used today,
those being active shutter and passive polarization technologies. We will also discuss the
trends in desktop displays from a 3D point of view as well as looking at the other aspects
being developed to support 3D, such as panel technology.
It is generally expected that most consumers have the desire to migrate to 3D systems from
2D. It is predicted that the 3D market will grow tremendously as soon as the problems in
the existing products are eliminated and the issues on basic infrastructure, such as price
competitiveness and 3D content, will be resolved. It is highly likely that the content
industry will also make a fast transition into 3D in all areas such as TV, film, and game and
have already begun to make this change.
Fig 4. 3D projection
The first screen-less display that needs mentioning is Google Glass. This device has been tested
for the past year, and some lucky individuals have even got their devices already. Google Glass sits on
the face like a pair of glasses, and on one eye it has a block of glass that allows you to see augmented
reality. Images can be displayed right in front of your eye, as well as text and information about
objects and places that are in front of you. This technology is only in its early stages, but definitely
shows that screen-less displays will become a natural form of media consumption in the future.
2.1.VISUAL
IMAGE
Visual Image screen less display includes any screen less image that the eye can perceive. The most
common example of Visual Image screen less display is a hologram.
Holographic messages, which we previously saw only in movies like Star Wars are about to become
reality through a new technology arrived directly from Japan. It’s True 3D, which is based on older
technology, developed by AIST and Keio University in 2006. This new projection system can be used
to present images without the need for a screen.
The system works by focusing a laser beam that generates a plasma environment from the oxygen and
nitrogen present in air, thus enabling it to display holographic images. According Ubergizmo.com, the
projected holographic images appear as 3D floating objects in mid-air.
At this point, the system creates approximately 50,000 points per second and features a frame rate of
10-15 FPS, but Japanese scientists are trying to increase it to 24-30 FPS. So far, the images are only
monochromatic (single color), green, but multi-colored images but can also be created using lasers
emitting at different wavelengths e.g. blue and red.
HOLOGRAM
Holographic technology has unfortunately not gone very far past trickery with mirrors. This
form of photography provides a three dimensional image, and some technologies are now
creating images using lenses, helium neon and holographic film. Scientists will not have a
fully working holographic table prepared for market any time soon, but it is definitely on
the cards for the future. The only downfall of this kind of system, however, is that the
orientation and viewing angle of a viewer will determine the quality of the image that can
be seen – meaning that so far, holographs are not ideal for media or information
consumption.
Holographs can work by using a laser beam that can interfere with an object beam. When
these two beams get in the way of one another, they can create what looks like a three
dimensional image. This image can then be recorded for processing by recording the
diffraction of the light and the way in which the beams interfere with one another.
2.2.RETINAL DISPLAY
Virtual retinal display systems are a class of screen less displays in which images are
projected directly onto the retina as shown in figure 3. They are distinguished from visual
image systems because light is not reflected from some intermediate object onto the retina;
it is instead projected directly onto the retina. Retinal Direct systems, once marketed, hold
out the promise of extreme privacy when computing work is done in public places because
most inquiring relies on viewing the same light as the person who is legitimately viewing
the screen, and retinal direct systems send light only into the pupils of their intended
viewer.
With a retinal display light is not reflected off an immediate object, like in a visual image,
but it is projected directly onto the retina. This can be handy in that one is not limited by
physical screen size because there is no immediate object to be viewed, retinal display can
be used to keep things such as financial information safe from snooping eyes. The image
can take up the entire field of vision. We’ve seen the potential of retinal displays in movies
like Terminator.
There are several new emerging ways for the technological development of the working
principle of the screen less displays. Several software’s are merging for the GEN-X wonder
view. Any computer system that can run the mudoc software can present text that has been
set in interactive movable type. Most of the mudocs that are consumed in the next few
years will be consumed with conventional personal computers, e-book readers, and other
kinds of display and projection devices that are now in use. Very soon it appears to be a
new kind of input/output system will facilitate communication and interaction between the
computer and the computer user. This new human/computer interface is the telereader
terminal. Visual Image is a bitmap manipulation and composition product. Bitmaps can be
manipulated independently, in the Image Mode or multiple bitmaps can be composited
Together in the Object Mode to create a "collage". Visual Image can create and Manipulate
images of any size: the only limitation is the amount of memory resources your system has.
A. Creating Visual Catalog Files with Visual Image Visual Image gives you the ability to
create files in the EYE file format for use in the Visual Catalog program. These EYE files
can be used to create catalogs of images in logical sub groupings: for example, you can
create a catalog file in the
EYE format that lists all images of building materials (brick, concrete, stone, etc.). The File,
Export Project command creates an EYE file that refers to all of the images that are
currently loaded into Visual Image. When you select this command, you are prompted to
enter a filename for the EYE file that is to be created. If you have created any image in
Visual Image that are not yet saved to disk you will be asked if you wish to include those
images in the EYE file and if so, you are prompted to store those images as bitmaps. The
File, Exports Editor Command in Visual Image allows you to pack and choose those image
files on disk that you wish to include in a catalog EYE file. When you select File in Export
Editor, a file browser appears from which you can choose the image files to include. Use
this browser to select images to add to a project file for use in Visual Catalog.
In Screenless display images projecting directly onto a person’s retina, not only avoiding
the need for weighty hardware, but also promising to safeguard privacy by allowing people
to interact with computers without others sharing the same view. By January 2014, one
start-up company had already raised a substantial sum via Kickstarter with the aim of
commercializing a personal gaming and cinema device using retinal display. In the longer
term, technology may allow synaptic interfaces that bypass the eye altogether, transmitting
“visual” information directly to the brain.
We can see things because of reflected light. Light bounces of an object and enters our eye.
This light then focuses on the retina to form an image.
which display images directly onto our retinas and brain wave sensing implants as shown in
figure 5. This will allow technology to integrate with our ‘reality vision’ much more
seamlessly. We are on the verge of a hardware revolution that will make this all possible, as
well as the cloud-based information streaming that will enable the user interface to become
a reality.
This invention relates to retinal display devices, and more particularly to a method and
apparatus for mapping and tracking a viewer's eye.
A retinal display device is an optical device for generating an image upon the retina of an
eye. Light is emitted from a light source, collimated through a lens, then passed through a
scanning device. The scanning device defines a scanning pattern for the light. The scanned
light converges to focus points on an intermediate image plane. As the scanning occurs the
focus point moves along the image plane (e.g., in a raster scanning pattern). The light then
diverges beyond the plane. An eyepiece is positioned along the light path beyond the
intermediate image plane at some desired focal length. An “exit pupil” occurs shortly
beyond the eyepiece in an area where a viewer's eye pupil is to be positioned.
A viewer looks into the eyepiece to view an image. The eyepiece receives light that is being
deflected along a raster pattern. Modulation of the light during the scanning cycle
determines the content of the image. For a see-
through virtual retinal display a user sees the real world environment around the user, plus
the added image of the display projected onto the retina.
A viewer wearing a head-mounted virtual retinal display typically moves their eye as they
look at images being displayed. According to the invention, the direction the viewer looks
is tracked with the display. Prior to tracking, a map of the viewer's eye is generated by the
display. The map includes ‘landmarks’ such as the viewer's optic nerve, fovea, and blood
vessels. Thereafter, the relative position of one or more landmarks is used to track the
viewing direction. The head-mounted display includes a light source and a scanner. The
scanner deflects light received from the light source to scan a virtual image onto a viewer's
retina in a periodic manner. During each scanning period, light is deflected along a
prescribed pattern. To generate a map, and thereafter to monitor viewing direction, light
reflected off the viewer's retina is monitored. Some of the reflected light travels back into
the display device. The content of the reflected light will vary depending upon the image
light projected and the features of the viewer's retina. During the initial mapping stage, the
content of the image light can be fixed at a constant intensity, so that the content of the
reflected light is related only to the feature's (i.e., landmarks) of the retina. The changing
content of the reflected light is sampled at a sampling rate and stored. The scanner position
at the time of each sample is used to correlate a position of the sample. The relative position
and the content represent a map of the viewer's retina.
Fig. 19.Optical schematic diagram of a virtual retinal display having an eye tracking
capability
According to one aspect of the invention, the light reflected from the viewer's eye travels
back into an eyepiece and along a light path within the retinal display device. In a specific
embodiment the reflected light is deflected by the scanner toward a beamsplitter. The
beamsplitter deflects the reflected light toward a photodetector which samples the reflected
light content. The beamsplitter is positioned between the light source and the scanner of the
retinal display device.
For generating a virtual image, light emitted from the light source passes through the
beamsplitter to the scanning subsystem and onward to the eyepiece and the viewer's eye.
Light reflected from the viewer's eye passes back along the same path but is deflected so as
not to return to the light source. Instead the light is deflected toward the photodetector.
Thus, the beamsplitter passes light which is incident in one direction (e.g., light from the
light source) and deflects light which is incident in the opposite direction (e.g., reflected
light from the viewer's eye).
According to another aspect of the invention, a specific feature of the retina (e.g., fovea
position) is monitored over time to track where the viewer is looking (i.e., the viewer's
center of vision). The landmarks in the retina which correspond to such feature will cause
the reflected light to exhibit an expected pattern. The relative position of such pattern in the
reflected light will vary according to the viewing direction. By identifying the pattern and
correlating the relative orientation of the pattern to the orientation of the corresponding
feature in the map, the change in viewing direction is determined. In various applications,
such position indication is used as a pointing device or is used to determine image content.
For example, as a pointing device the fovea position indicates pointer position. A blink of
the eye for example, corresponds to actuating a pointing device (e.g., “clicking” a computer
mouse.)
According to another aspect of the invention, the map of the viewer's retina is stored and
used for purposes of viewer identification. In a security application for example, a viewer is
denied access to information or denied operation of a computer or display when the
viewer's retina does not correlate to a previously stored map of an authorized user.
According to an advantage of the invention, the display can track where a viewer is
looking, use the viewer's eye as a pointer, and identify the person using the display. These
and other aspects and advantages of the invention will be better understood by reference to
the following detailed description taken in conjunction with the accompanying drawings.
It is really interesting to note why this family of imaging systems score better than the
conventional display systems.
A) Brightness
One problem with conventional helmet mounted display image sources is the low
luminance levels they produce. Most liquid crystal array image sources have insufficient
luminance levels for operation in a see- through display. The VRD, however, does not
contain individual Lambertian (or nearly Lambertian) pixel emitters (liquid crystal cells or
phosphors) as do most LCD arrays and CRT's. The only light losses in the VRD result from
the optics (including the scanners and fiber coupling optics). There is no inherent tradeoff,
however, between resolution and luminance as is true with individual pixel emitters.
In individual pixel emitters, a smaller physical size increases resolution but decreases
luminance. In the Virtual Retinal Display, intensity of the beam entering the eye and
resolution are independent of each other. Consequently, the VRD represents a major step
away from the traditional limitations on display brightness.
B) Resolution
C) Yield
One limiting aspect in the manufacture of liquid crystal array image generators is the yield
and reliability of the hundreds of thousands of individual liquid crystal cells present in these
displays. For a liquid crystal array display to function properly at all times, each picture
element must function properly. The Virtual Retinal Display requires only constant
functionality from the light sources and the scanners. As resolution increases in virtual
image displays, liquid crystal arrays will contain more and more individual liquid crystal
cells. The Virtual Retinal Display will gain an increasing advantage over liquid crystal
array image generators in terms of yield as resolution demands increase in the future.
D) Size
The theoretical size for horizontal and vertical scanners plus light sources for the VRD is
smaller than the size of conventional liquid crystal array and CRT image sources. A typical
size for a liquid crystal array image generator for helmet mounted display applications is
one inch by one inch. The Mechanical Resonant Scanner used in this project was
approximately 1 [cm] by 2m [cm]. Furthermore, the problem of scanner size has not been
directly addressed. Further size reduction is certainly possible. It should be noted that light
sources for a smaller, usable full color VRD must be much smaller than the sources used in
this project. The potential size of light emitting diodes and diode lasers indicate that these
sources show greatest promise for future systems in terms of size.
The main use of the screen less displays are used for the development of the mobile phones
which are mainly used by the old and blind people. This type of the invention of the screen
less displays was first done on the mobile phone named OWASYS 2CC. This model is very
useful for the old, blind, and even for the people with less vision power.
Screen less displays technology is also implemented for the development of the screen less
laptops. A laptop without an LCD can be a very useful portable solution when connected
toCRT or fixed LCD monitors. Laptops without screens would also be a green solution,
giving value to donated CRT monitors that would otherwise be heading for landfills.
Portability means that volunteers, who don’t always have the time to travel to people’s
homes, can more easily maintain this computer. Screenless displays are also widely
applicable in the field of the holograms projection. Hologram projection is a result of a
technological innovation that truly helps in touch less holographic interfaces. In fact,
hologram projection projects 3D images of so high quality that it feels as if one can touch
them. However, holographic projection is still to achieve mass acceptance as until now,
conventional holograms, which offer 3D images.
Latest laser technology are also implementing the special technique of the screen less
display through the presence of the several 3D scope animation or the screen provides the
advantage of being combined with the Laser Valve Video Projector that helps in projecting
video images by the use of the laser light instead of the Xenon Arc lamps as depicted in
figure 8. Laser technologies have given an edge over the other technologies as the LVP
gives the projector an excellent depth in the focus.
Screen less display’s major working principle can also be implemented in the emerging of the new
screen less TV’s. Imagine that watching the TV picture that seems to be magically appearing in the
thin air. The picture just floats on in front of the viewer; this would be a latest emerging technology
in the future as depicted in figure 22.
6.1 ADVANTAGES:
1. Low power requirements- Only six diodes are required and afew of a watts to deliver their images
to the user’s eyes [3].
2. Higher resolution images- The pixels in the images projected by the diodes can be made smaller
than is possible with any CRT or flat panel display, so higher resolution can be achieved. With retinal
projectors, the only limitation in the resolution of visual images will be the resolving power of the
users’ eyes.
3. Greater portability- The combination of diodes, lenses, and processing components in a retinal
projector system will weigh only a few ounces.
4. Wider angle of view- Retinal projectors will be able to provide a wider field of view than is
possible with display screens.
5. More accurate color- By modulating light sources to vary the intensity of red, green, and blue
light, retinal projectors canprovide a wider range of colors – and more fully saturated colors – than any
other display technology.
6. Greater brightness and better contrast- Retinal projectors can provide higher levels of contrast and
brightness than any other display system.
7. Ability to present 3D images- With their capability of presenting high definition image-pairs,
retinal projectors can deliver the most highly realistic stereoscopic movies and still pictorial images to
their users.
8. Ability to present far-point images- The human visual system is a far-point system. With today’s
desktop and laptop computers users must employ their near-point vision. The excessive use of our
near-point vision in using computers, reading, sewing, playing video games, etc., is making myopia a
very common impediment. The use of the far-point images that can be provided by retinal projector
systems could reduce the incidence of myopia and, hence, the growing need for and use of eyeglasses.
9. Lower costs- The present cost of retinal projector systems is high. Nevertheless, there are no hard-
to- overcome manufacturing problems in mass-producing and low-cost components, so inexpensive
systems will soon become available. Environmental and disposal costs of these tiny delivery devices
will also be minimal because toxic elements such as lead, phosphorus, arsenic, cadmium, and mercury
are not used in their manufacture.
SCREENLESS DISPLAY Page 22
GIT-CSE
6.2 DISADVANTAGES:
1. The principle disadvantage is that Virtual retinal display (VRD) is not yet available in the significant
number.
2. Prototypes and special experimental models are now being built, but their cost per unit is high.
3. The VRD technology is still under progress and Development.
FUTURE ENHANCEMENTS
For the future development of this emerging new technology, several researches are being conducted
and the several renowned IT sector companies and other best labs present in the world are handling
over the project of screenless displays.
Technology has become perhaps the greatest agent of change in the modern world. While never
without risk, positive technological breakthroughs promise innovative solutions to the most pressing
global challenges of our time, from resource scarcity to global environmental change. However, a lack
of appropriate investment, outdated regulatory frameworks and gaps in public understanding prevent
many promising technologies from achieving their potential.
This field saw rapid progress in 2013 and appears set for imminent breakthroughs of scalable
deployment of screenless display. Various companies have made significant breakthroughs in the field,
including virtual reality headsets, bionic contact lenses, the development of mobile phones for the
elderly and partially blind people, and hologram-like videos without the need for moving parts or
glasses.
Microsoft in 2001 began the work on an idea for an Interactive table that mixes both the physical
and the Virtual worlds.
Multi touch is a human computer interaction technique and the hardwire devices that implement it,
which allows users to compute without conventional input devices.
CUBIT is being developed for the future use of the multi Touch use of the program.
Development of the enhancement of the micro vision also gives the improved and the futuristic
view of the screen less displays. This technology of the micro vision is the very well useful in the
Artificial Retinal Display properties.
Japanese scientists have invented the pair of intelligent Glasses that remembers where people last
saw their keys, Handbags, iPod, and mobile phones.
Smart Google is developing the compact video camera which films everything the wearer looks at
the information what the viewer wants will be directly being seen in through the glasses where
there is no screen or projector present
o .
Several laboratories are working under progress on the electron beam lithography which
includes the advanced enhancement of the futuristic screen less display.
Adobe systems are also working out for the development and deployment cross platform of the
several applications which are to be viewed without the actual screen.
CONCLUSION
The paper has elaborately discussed screenless displays which is one of the most emerging computer
technologies and has become a new exciting rage for the upcoming generations as a field of the
futuristic technology. Due to the ability of having several advantages which are involved in the
making, designing, coding of the screenless, this needs plenty of knowledge and process for the
development is still under the improvement. May be in the future the world may be dominated with
the screen less display technologies and this enriches the world of technological empowerment in the
field of the computer technology. Screenless displays promises the cost effective aspect and also
brighter future in the computer technology.