(Click on underlined
link
to go to subject)
- Contents
Chapter
1.
Vision
System Design
Chapter
2. Biological Eye
Designs
Chapter
3. Eye
Design
Illustrations
Chapter
4. Eye
Reproduction
Chapter
5. Optical
Systems
Design
A.
Introduction
B.
Manufactured
optics
1.
Astronomy
and
surveillance
2.
Stable
platform for
optical systems
3.
Robotic
camera
applications
4.
Flying
robotics
5.
Microscope
and
endoscopic applications
6. New
technologies to see building blocks of cells
C.
Present
vision system technology approaches toward artificial eye
development
D. Integration
of mans technology with
biological eyes
Chapter
6. The Eye Designer
Related
Links
Appendix
A - Slide Show & Conference Speech by Curt Deckert
Appendix
B - Conference Speech by Curt Deckert
Appendix
C - Comments From Our Readers
Appendix
D - Panicked Evolutionists: The Stephen Meyer Controversy
|
EYE DESIGN BOOK
Chapter
5
Sections A and B
-
Prev Page
Go
to Chapter Links
-
Next Page
-
(Click on PICTURE
IN TEXT
to bring up LARGE PICTURE)
5. OPTICAL SYSTEM
DESIGNS
LEADING TO ARTIFICIAL
EYES
A.
Introduction
Present machine
vision systems are very limited in overall capability as compared to
most
biological eyes. Comparing eye-type optical systems in the 1990's with
nature's eyes is much like the Wright brothers' aeronautical science
being
compared to spacecraft of the late 1990's. As we learn more about
biological
eyes, we understand they have specific cell designs, not random chance
mixtures of elements.
In the following sections we will consider optical systems that may
be foundational in developing technology to design and build special
purpose
“eyes” that approach the capabilities of those
found in nature. Reproduction
and continuous repair of nature’s eyes are far ahead of the
complex optical
systems man has designed. Since the living cell structure is dynamic,
the
repair function that goes on in the eyes' retinas is more advanced than
any adaptive image sensor man has been able to design.
B. Manufactured optics
As recently as several
centuries ago, the
wide spread use of lowest commercial optics such as lenses and mirrors
was limited. The earliest commercial uses of optics were, of course,
eyeglasses,
magnifiers, mirrors, telescopes, and microscopes. After hundreds of
years
of optical component design and production, there are now a wide
variety
of commercially available optical building blocks with many choices of
materials, and technologies for the development of new optical systems.
As optical industries developed, manufacturing technology and
efficiency
enabled lower cost optical products, thereby increasing their use.
Optics
in television and motion picture industries gave entertainment to the
world's
population.
Early attempts to duplicate
the eye's function
of capturing images were limited to film cameras, which have been
around
for more than 150 years. As we all know, film cameras can only sense a
limited number of frames or pictures, which have to be processed or
developed.
But video cameras, which have only been around since the 1940's, can
sense
a large number of scenes for recording on tape, disk, hard disk or
other
computer memory. These scenes can be transferred directly to a computer
for image processing. Processing of electronic image information in a
computer
requires sensors, interface electronics, and software for recognition
for
what we may define as useful vision. During this century, scientists
and
engineers have made increasingly determined efforts to understand eyes.
The software and hardware for man's vision system did not just appear,
but required intelligence to develop.
Have we really
come very far in attempting to duplicate eyes?
We are just scratching the
surface of total
biological eye technology. There are many layers of information we have
not even penetrated. In trying to equal the size and function of the
eyes
of nature, the size of video cameras, computers, and electronic
components
has been greatly reduced. Image processing software and hardware has
come
closer to simulating eye functions, but these innovations are only
small
preliminary steps toward significant artificial eye design and
developments.
During the last 20 years, high-speed micro-circuitry, sensor arrays,
arrays
of micro lenses, gradient index materials, special glasses, and plastic
optics manufacturing techniques are starting to give us more suitable
building
blocks for artificial eyes. These components are still limited to
"non-living",
"non-reproducible" optical systems approaching the size of eyes we find
in nature.
The big challenge of optical
products is to
be affordably priced to reach large international markets. Most current
attempts at creating eyes are very simplified and less versatile when
compared
to biological eyes that are constantly reproduced from a variety of
cell
types from generation to generation. When living eyes are compared to
man's
ability to design optical systems that repair damaged building blocks,
we learn that living eyes are far advanced.
1. Astronomy and surveillance
Magnifiers were developed
around the 10th century while eyeglasses were developed
around the thirteenth century. Telescopes, using simple optics to
obtain magnification over a limited field of view, were still rare in
the seventeenth century while eyeglasses were becoming more common.
Telescopes were further developed during the next century for more
serious astronomy and military surveillance. Optical development then
accelerated duringthe
Nineteenth Century. Scientific and military optics developed during the
Twentieth Century have helped drive down costs. Before and during World
War II, there were very few significant optical surveillance
developments that were related to functional eye design. Now many
individuals can afford eyeglasses, telescopes, binoculars, or
microscopes. The following are some illustrative optical designs
developed over seven hundred years. The first picture is from
approximately 1252. (Fig. 5.1 from Pg. 20 and Fig 5.2 from Pg. 1, Looking
Back - An Illustrated History of the American Ophthalmic Industry,
by Joseph L. Bruneni, 1994 - Optical Laboratories Association)
Before the 1940's, large
telescopes were reserved for large schools, industry, and the military,
because of their high cost. The present cost of telescopic systems over
five inches in diameter is such that many people can now afford them.
The same can be said for early high-powered microscopes. As compared to
instruments available during the age of Darwin, now many people can
afford to study both the huge heavens as well as our tiny cellular
building blocks because of new cost-effective optical system
developments.
Infrared and ultra-violet
surveillance systems have been developed to work beyond normal human
visual capability. These systems were used for offensive and defensive
night fighting during the 1980's and 1990's. The were also used for
flame detection, finding losses of energy in power systems, finding
people in burning buildings, optical surveillance, astronomy, and
biological studies.
Night vision systems were used
effectively in the Gulf and other military operations during the
1990's. Modern infrared and ultra violet research optical systems can
see more than we do with natural human image systems. Man-made infrared
optical systems need special materials for optical transmission and
low-temperature cooling, for good sensor response. Low temperature
cooling used for current IR sensors is not needed by animals having IR
vision to see targets with very little heat radiation. Cooling
requirements make the overall vision system size differences even
greater, between small natural and larger man-made IR vision systems.
Some of man's evolutionary designs lead to commercial designs while
most are not produced. Now we can display this information directly on
the retina with a very small display.
Design studies of insect eyes
with UV capability, and snakes with IR capability, will undoubtedly
provide further insight into new technologies for the development of
more useful and compact optical systems. Ultra-violet systems also
require special materials to transmit short wave length light.
Different optical materials are required by insects to see
UV. |
Figure
5-1. Historic Optics
Figure
5-2. Historic Optics
Figure
5-3. Historic Optics -
Early Microscope
(from the Journal of The
Microscopical Society of
Southern California)
Figure
5-4. Modern Optics -
Typical Microscope
Design
(Nikon LaboPilot-2, Microscope Brochure, 2CEMXL2)
|
2.
Stable platforms for optical systems
Many of the large camera
systems built for advanced study of space and for strategic military
surveillance have very narrow fields of view. Man-made space camera
systems that record movement, scenes, or events, generally require
precision scanning and tracking ability. Vision systems are
specifically designed to function from ground, ships, aircraft, and
even satellites. Suitable platforms require different mountings and
interfacing to be useful. Biological tracking systems are often taken
for granted. Eye control design requires significant programming which
requires many parallel brain interactions. A simple stable platform for
optical equipment is shown on Fig.5-7. (Optical Equipment
2000 Catalog)
Figure
5-5. Modern Optics Confocal Laser Scan Microscope
(Zeiss
Instrument, about 1998)
|
Figure
5-6. Modern Optics- 1m Mirror telescope
(Pg. 47, Zeiss Instrument, No. 2, 1992-1993, Instrument No. 12)
|
Some satellite systems can track other satellites. Typical surveillance
satellite cameras use high-resolution electronic cameras to sense and
record details from the surface of the earth, and then electronically
relay these pictures to earth. It took considerable analysis and design
effort to conceptually evolve these intricate vision systems and their
supporting platforms from the early types that dropped film to
aircraft, to those that were able to transmit complex images. This
illustrates the requirement for intelligence in biological eyes.
Typical camera optical designs are shown in the following optical
diagrams. (By Curt Deckert)
Useful magnification
by a telescope for a given aperture is limited by light diffraction.
Information on diffraction limits can be found in many optical texts.
The larger the aperture of a high-quality diffraction limited
telescope, the more it can theoretically resolve. Space telescopes,
operating on platforms beyond the dense atmosphere, have optical
apertures large enough to enable us to see into space much farther than
man has ever been able to see from the surface of the earth. |
Figure
5-7. Stable Platform
for Optical
Systems
(Newport Research)
Figure
5-9. Typical Meniscus
Camera Lens Optical
Design
|
Figure
5-8. Typical 3 Element
Camera Lens Optical
Design
|
Figure
5-10. Typical Telephoto
Camera Lens Optical
Design
|
Thus, beyond the
light-absorbing atmosphere, we are witnessing the development of new
science to describe our universe. The Hubble telescope is a prime
example of a large telescope camera in space that is providing facts
for updating present scientific theories. See Figure 5-11 for an
optical diagram of the telescope. Many additional optics are used for
the instrumentation it supports. It works in visible, IR, and UV
spectral regions and is not limited by atmospheric interference.
necessary to form biological eye optical designs. (ZMAX Demo Program
Illustration)
Light comes from left side and
bounces off of the large curved mirror before it comes to a focus on
the right side. Scientific theories change with new optical
developments, as we gain more insight into the world of cell functions
including the eye vision platform. This broadens the scientific
foundations of artificial optical design. |
Figure
5-11 Hubble telescope
Optical Diagram
|
As we understand how to build
more advanced optical systems, we learn to appreciate the wide
variations in eye technologies related to biological optical systems.
Here we can start to comprehend the complexity and variations of the
cells
3. Robotic camera application
Early remote robotic camera
systems were developed to handle hazardous devices and substances. This
became necessary during the time nuclear energy sources were developed
in the 1940's. These remote handling systems were direct mechanical
devices using mirrors and/or windows to see from isolated viewing
areas. As motor drives and TV cameras with special optics were added to
mechanical systems, technicians were able to work farther away from
hazardous substances, while having as much control remotely as if they
were very close.
Machine vision system
containing small video cameras, or other sensors, and computer
controller systems has been used since the 1970's. Now machine vision
technology is using low-cost, high-resolution multicolor video cameras,
special lighting, high-speed computers, and special computer software,
for complex recognition purposes. As a result of these developments,
many workers who previously were exposed to chemical hazards have been
replaced or supplemented by robotic systems. These are examples of
conceptual evolution by intelligent selection.
Typical visual systems for
robotic application are much less versatile than the eyes of living
creatures. Man-made robotic systems often need specially structured
lighting, special optics, or color filtering in order to function for
even very limited applications. Biological systems make use of
variable, but optimized density pattern of sensors. For example see
Fig. 5-12 for an illustration of how resolution fall off from the
center of vision of a monkey, like many other eyes. This certainly
indicates an intelligent design approach to optimizing the visual
usefulness of the final output of the retina. It also takes into
account the useful information coming from the optical system. (Pg.
188, Neuro-Vision Systems,
Ed. by Madan M. Gupta, George K. Knopf, IEEE Press, 1994) |
Figure
5-12 Diagram showing
concentration of
information
near the center of
the eye
|
Advanced remote robotic
systems are now being used for surgical procedures using 3-D virtual
reality and the proper robotic instrument interfaces. The intelligence
required for design of these optical systems and to program a computer
to recognize specific subjects in a variety of remote environments is
similar to that required for natural vision systems which have been
scaled down in size. Here is a diagram of an advanced robotic neural
vision system developed at the University of Houston. (Pg. 338 SPIE
Selected papers on Model Based Vision - Vol. MS72, by R. T. Chin
& C. R. Dyer) |
Figure
5-13. Neural Robotic
Vision System
Diagram.
|
Animal eyes and brains are
small and compact, compared to typical man-manufactured robotic camera
and image processing systems, but they have many of the same
characteristics. One can equate overall size to the level of
technology. Smaller components such as computer processor chips require
higher technology. The higher the technology, the greater the need for
intelligent design for engineering and integration with the
environment. Present intelligent robotic systems may approach the
optical capability of a honeybee's vision system, but not its small
size, due to the bees' bio-molecular design. For example, many small
bees can sense the direction of polarization of light and can sense UV
light, which typical robotic camera systems do not sense. Bees' eyes
also use much less volume, to process three-dimensional information,
than present man-made systems.
The thousands of
interconnections connecting nature's eyes to brains are more compact
than present interconnections of computer-based robotic systems. For
example, compare small two-dimensional color cameras and their sensor
interfaces with eyes and brains of birds that see in three dimensions.
Bio-molecular design in birds allows much smaller vision systems.
(Vision - High Resolution CMOS Sensors, VLSI Vision Limited, UK and San
Jose, May 1998)
One can say that higher
intelligence was involved in bird eyes since they have smaller pixels
than our present cameras and have vision systems that process in 3D. To
do this nature's eyes use many very small parallel connections, with
some processing occurring between the eye and the brain. |
Figure
5-14 Diagram of Small
Camera Electronic
Interface
for a Vision System.
|
This parallel processing
allows a large number of functions to take place simultaneously, as
compared to typical serial (or one operation following another)
computer processing of figure. Programming eye functions to work in
parallel, or at the same time, shortens the overall processing time,
allowing three-dimensional recognition to occur at the speed of
observation. Limited serial processing is one reason why most robotic
systems have a difficult time matching the typical short reaction times
of insects.
In comparing typical computer
communications and nature's "computer communications," just imagine
thousands upon thousands of very small connections coming out of a
video camera and going to a computer. Even though man has come up with
very small integrated circuits, where connections on a computer chip
can go down to as small as 0.15 micron, the interconnections between
the computer chips are dramatically larger than the insect's tiny
brain. Wires for attaching major computer subsystems are much larger in
diameter than many insect vision system cables. Now imagine the size
and cost of a cable made up of millions of wires going from a camera to
a computer to process visual data. If we take wires the size of a human
hair, or about 100 microns in diameter, then 1000 of these would be
approximately 100mm wide. Such a cable would be larger in diameter than
small cameras or computer plugs. This gives some perspective to the
image processing complexity of nature's eyes.
More importantly, we have to
remember an eye begins with a single cell and then grows by multiplying
cells, while coordinating millions of different cells for the vision
process. Imagine the intelligence to design, produce, integrate, and
power all the different kinds of cells that go into vision systems.
Just the powering of modern flying robots is still a very significant
problem. Reproduction is even more of a problem to explain without
intelligent design.
4. Flying robotics
Considerable new work is being
done in this area. There are a number of insect and bird size robots
being considered. Researchers are finding natural insect flight it is
not a simple task to duplicate. For example, the flight of insects and
birds is so complex that the smallest details provide significant
engineering challenge. We have already shown that vision is very
complex, but the sense of smell in insects like bees, or moths and
wasps is so sensitive it could be used to sense high explosives. So
people building small robots with infrared detection capabilities could
learn a lot from beetles, vipers, and other small creatures.
Naturally, utilizing existing
creatures would be easier than creating new robotic bugs. In any case,
there appears to be considerable design effort required to build
creatures that can fly and see. Their power conversion system design is
well beyond our present battery technology. An example of a robotic
insect is shown in Figure 5-15 and biological insects adapted for a
similar purpose are shown in Figure 5-16 and 5-17. |
Figure
5-17 Insect Robot
showing controls
attached to
insect (Researched
by
U. of Japan, reported by
Orange County Register, Friday,
June 10, 1997, News pg. 21)
|
Figure
5-15 Robotic Insects (NASA)
|
Figure
5-16 Insect Robot showing remote
controls attached
to insect (SPIE
Micromachining & Microfabrication 1999
Symposium Technical Program)
|
5. Microscope and endoscope applications
Microscopes have a long
history of specialized use for research. Now they are used more widely
in businesses, schools, and homes. Optical microscopes are able to
magnify cells over 1000 times to see them reproduce, to identify
abnormal cells, and to examine the design of molecular building blocks.
See the optical diagram of a typical microscope on figure 5-4.
Some new camera vision systems
are designed to have ultra violet (UV) imaging capability for high
technology areas, such as semiconductor fabrication. It takes very
high-resolution short-wave length UV image transfer capability and
analysis of quality for the production of today's integrated circuits
for computers. Considerable intelligent design and production effort
also went into developing the process for building very-
high-resolution UV systems for semi-conductor production.
Even fifty years ago, people
did not imagine the feasibility of producing these advanced
semi-conductor computers with sub-micron features. This technology
contributes to how we can produce small artificial vision systems using
human intelligence.
Some insects have UV
capabilities, which human eyes do not have. Insects are not able to see
shadows or forms with nearly as much resolution as humans, but they do
an effective job of rapidly sensing image motion as they travel. Much
of their rapid image processing seems to take place in the form of
motion sensing over part of a scene. This is quite different than
processing each complete scene in full color. One attempt to control a
cockroach is shown in figure 5-17. Here the man-made control mechanism
is quite crude compared to the basic insect.
In comparing IR eyes of nature
to typical video IR night sight vision systems, one can see great value
in the technology of nature's small compact IR eyes to provide remote
night-vision. This typically allows one to visualize distant
temperature sources or the temperature distribution of hot objects.
Improved compact IR vision systems may be developed as a result of new
viper eye research about IR vision capability.
During the last 200 years,
straight optical bore scopes were developed to see into body cavities.
These developments led to new flexible optical endoscopes containing
flexible cables of glass or plastic fiber optics to transmit images.
Fiber optic endoscopes are much more versatile than straight bore
scopes that use optics to relay an image within a small tube.
Flexible endoscopes are
typically used to detect and help correct abnormal conditions within
the body or to identify conditions within closed volumes not accessible
to cameras or to direct viewing. A wide variety of straight and
flexible specialized endoscopic devices are now used to enter all body
cavities and some blood passages to view and correct conditions inside
the body. Minimal size holes are also cut in the body to gain entrance
to organs a blood passage not accessed from body cavities. See the
following figures for illustrations of bore- scopes and
endoscopes.
|
Figure
5-18 Diagram of Borescope
(Olympus Marketing Literature)
Figure
5-19 Endoscope Diagram (Pg.
4,
Fiberoptic Endoscopy and the difficult airways,
Andranick Ovassapian Typrocott Room, 1996)
|
Although there are large UV
and IR optical devices available, there are few small microscopes,
borescopes, or endoscopes with high-resolution UV or IR capabilities.
Multi-spectral technology would be desirable for microscopes and
endoscopes used for cancer research and detection and other
applications. For example, detection of many types of cancer could be
made much easier if we had small intelligent vision systems that could
enter the body for direct analysis of tissue, instead of taking tissue
samples for evaluation using current instruments.
6.
New technologies to see the building
blocks of cells
We have been able to see major
components of cells for some time, but have not been able to see
details of very small cell components. New technologies are starting to
let us see more of the fine details of the building blocks of nature,
such as the construction of chromosomes. Special man-made optical,
confocal, electron-beam, and atomic-force microscope systems can now be
used to study DNA and other key building blocks of life. The small DNA
features are beyond optical system diffraction limits, but electron
beam and atomic force microscopes allow scientists to form images of
fine details that can approach enough resolving power to sense the
presence of individual atoms that make up materials. These and other
new techniques may be required to see genetic DNA code information.
Because of the way sample eyes have to be prepared for analysis, it is
very difficult to work with live cells using electron beam microscope
procedures that may require the process of coating surfaces within a
vacuum chamber.
Optical sensor resolution is
beginning to approach that required to see the interconnecting
biological structure that makes up the very intricate nerve cells of
our retinas. New multi-color fluorescence cell analysis is starting to
provide detailed information on the selective functioning of the large
numbers of interconnections between the nerve cells required for
vision. Vision cells interconnections may include 10,000's of
connections per cell. These new discoveries are giving us new insight
into the complexity of our eyes' image processing system.
The size of these connections
is small relative to integrated circuits with conductors approximately
0.3 microns wide. This compares to molecules as much smaller building
blocks than the lines. We need to remember that it takes 10,000
angstroms to equal one micron or about 3,000 angstroms to equal a thin
conductor width. As a comparison, features of DNA code in cells are on
the order of 10 angstroms
A new type of near-field
optical microscope, without conventional lenses, can be used to see
detail as small as about 50 nanometers (.05 microns), but 1nm
resolution may be required for comprehensive DNA research within cells.
Technologies are not yet adequate for direct viewing of the complete
DNA structure. This could be similar to viewing a large segment of a CD
ROM at one time. Atomic force microscopes have to be positioned so
close to samples, that they risk cell damage. These instruments are
somewhat cumbersome, difficult to use, and have limited fields of view,
compared to simple optical or electronic microscopes. Sensitive
high-resolution microscopes and related systems require stabilization
to function, as compared to typical lower resolution microscopes,
working without stabilization. For illustration of their small field of
view a typical image is shown, in Figures 5-20 (Photonics Design and
Applications Handbook, 1996) and 5-21 (Pg. 19 Laser
Focus World, Jan. 2000. This is
one reason why research in this area will take so much time, and does
not give wide-field visibility needed for detailed cell
studies.
|
Figure
5-20 Image From
Near-field or
Atomic
Force Microscope
of
an optical
coating
Figure
5-21 Image of a Wasp
Parasite from an
Electron-
beam Microscope
image --
Image of a parasite
that
lives inside a wasp.
|
Rapid parallel
processing by groups of cells, with thousands of connections per cell,
is one of the most amazing features of the vision process. Since it is
so difficult to view these parallel inter- connections, it is very
difficult to design a means to reproduce the thousands of
interconnections between cells. Just imagine the processing taking
place in the insect parasite shown on figure 5-21 and the
interconnections between cells. The programming and connections
necessary for time-efficient parallel processing by the brain has to be
designed and in place to allow vision.
Considerable design effort was
necessary to form stable images for moving man-made vision systems, in
order to provide feedback to control where the eye looks. This is no
less true of eye stability design in nature. We are still learning how
to build better, stable, moving optical systems leading to better
vision system platforms. As we learn more about nature's eyes, it can
help designers provide more stable structural mountings for optical
systems.
Many different scanning eyes
are used in various small animals where the space and potential
resolution is limited. This requires some special processing of the
visual information, especially when used with additional Eyes that do
not scan. The following table illustrates several applications of
scanning eyes. (Reference: table 9.2, p. 197, Animal
Eyes, Michael F. Land, Dan-Eric
Nilsson, Oxford Animal Biology series, Oxford University Press, 2002-
Please see their book for more details )
Figure
5.21a Table Showing Examples Of Scanning Eyes
|
|
|