Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/106—Processing image signals
  • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B82—NANOTECHNOLOGY
  • B82Y—SPECIFIC USES OR APPLICATIONS OF NANOSTRUCTURES; MEASUREMENT OR ANALYSIS OF NANOSTRUCTURES; MANUFACTURE OR TREATMENT OF NANOSTRUCTURES
  • B82Y30/00—Nanotechnology for materials or surface science, e.g. nanocomposites
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
  • G02B27/10—Beam splitting or combining systems
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B3/00—Simple or compound lenses
  • G02B3/12—Fluid-filled or evacuated lenses
  • G02B3/14—Fluid-filled or evacuated lenses of variable focal length
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
  • G02B30/10—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images using integral imaging methods
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
  • H04N13/229—Image signal generators using stereoscopic image cameras using a single 2D image sensor using lenticular lenses, e.g. arrangements of cylindrical lenses
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
  • H04N13/236—Image signal generators using stereoscopic image cameras using a single 2D image sensor using varifocal lenses or mirrors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/246—Calibration of cameras
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/296—Synchronisation thereof; Control thereof
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
  • H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
  • H04N13/322—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using varifocal lenses or mirrors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
  • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/398—Synchronisation thereof; Control thereof
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/106—Processing image signals
  • H04N13/167—Synchronising or controlling image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/189—Recording image signals; Reproducing recorded image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
  • H04N13/194—Transmission of image signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
  • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/25—Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/257—Colour aspects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
  • H04N13/289—Switching between monoscopic and stereoscopic modes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/293—Generating mixed stereoscopic images; Generating mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
  • H04N13/307—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using fly-eye lenses, e.g. arrangements of circular lenses
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/324—Colour aspects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/327—Calibration thereof
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/366—Image reproducers using viewer tracking
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
  • H04N13/395—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N2013/0074—Stereoscopic image analysis
  • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Definitions

• the present invention relates generally to optical systems, and more specifically to three dimensional imaging systems incorporating diffractive, refractive, or diffractive/refractive compound lenses.
• Micro-stamping techniques using self assembling monolayers have allowed low cost production of features on sub-micron ( ⁇ 10 m) scales. Certain compounds, when placed in an appropriate environment, are capable of spontaneously forming an ordered two dimensional crystalline array. For example, solutions of alkane thiols exhibit this property on gold.
• Micro-stamping or micro contact printing uses a 'rubber' (silicone elastomer) stamp to selectively deposit alkane thiols in small domains on gold surfaces.
• a 'master' mold with the desired feature shapes and sizes is fabricated using optical lithographic techniques well known in the electronic arts.
• transparent polymers have been used to make stable micro-lenses.
• a solution of unpolymerized monomers which are hydrophilic
• polymerization may be initiated (e.g., by heating).
• Variable focus lens 50 includes a liquid lens 52 and two SAM surfaces 54. SAM surfaces 54 adhere to liquid lens 52. As can be seen in the progression from Figures 3(a) through 3(c), by varying the distance between the SAM surfaces 54, the shape, and therefore optical characteristics, of liquid lens 52 can be altered. There are also several other ways to vary the shape and optical characteristics of liquid lens 52. For example, the electrical potential between lens 52 and surface 54 can be varied, causing changes in the shape of lens 52, as is discussed further below with respect to Figure 4. The index of refraction of lens 52 can be varied by using different liquid materials.
• the cohesive and adhesive properties of liquid lens 52 can be adjusted by varying the chemistry of the liquid material, and by varying the chemistry of surface 54.
• the three dimensional characteristics of surface 54 can be varied. For example, when viewed from the top or bottom surface 54 can be circular, rectangular, hexagonal, or any other shape, and may be moved up and down. These techniques may be used individually or in combination to create a variety of lens shapes and optical effects.
• FIG 4 a schematic diagram of an electrically variable focus lens as disclosed in the above cited Abbott et al. article is shown.
• a drop of liquid 52 is placed on SAM surface 54, which is in turn formed on metallic surface 56, preferably gold.
• SAM surface 54 By varying the electric potential between microelectrode 58 and SAM surface 54, the curvature (and thus optical characteristics) of liquid lens 52 can be varied.
• the progression from Figure 4(a) to 4(c) shows schematically how the shape of liquid lens 52 can be changed. Similar effects can be achieved using the techniques described in the above Gorman et al. article, although microelectrodes 58 need not be used.
• micro-lenses may be focused through mechanical means.
• flexible polymeric or elastomeric lenses may be compressed or relaxed so as to vary focus through piezoelectric means.
• liquid lenses encapsulated in flexible casings may be mechanically compressed or relaxed.
• Figure 1 is a schematic diagram showing a 3D imaging system incorporating a micro-lens array according to a preferred embodiment.
• Figures 2(a) - 2(c) are schematic diagrams showing the path of light directed to an observer under various conditions.
• Figures 4(a) - 4(c) are schematic diagrams showing another technique for varying the focal length of a liquid micro-lens through the use of SAMs.
• variable focus micro-lens arrays such as those fabricated using the techniques discussed above, along with still or motion images having relatively great depth of field, are used to create 3D effects.
• images viewed by the human eye comprise a plurality of extremely fine points which are perceived in continuous detail.
• the light is scattered and the point diffusely reflects a cone of light 30 (i.e., light which subtends some solid angle) outward.
• a cone of light 30 i.e., light which subtends some solid angle
• the rays of light that are collected are nearly parallel (see Figure 2(a): far focus).
• the rays collected by the eyes of observer 20 are less parallel and are received at greater diverging angles (see Figure 2(a); medium focus and close focus).
• a two dimensional photograph or image which is in focus at all points of the image is overlaid with an array of micro- lenses.
• an array of micro- lenses With proper illumination, such a system can generate light cones of varying divergence and simulate 3D space.
• a preferred embodiment of the present invention will work with images generated using an optical system having a large depth of field.
• proper placement of the plane of focus and use of depth of field is adequate to attain perceived sharpness throughout the entire image.
• more advanced techniques are required to attain perceived exact focus for all points within an image.
• Modified cameras and/or digital imaging techniques may be used. For example, some out of focus areas within an image may be focused using digital software 'sharpening' filters.
• Camera 60 includes conventional motorized optics 62 having an input lens 64 and an output lens 66. While lenses 64 and 66 have been depicted as convex lenses, those skilled in the art will understand that lenses 64 and 66 may be of any desired configuration.
• Motorized optics 62 focuses an image on image recorder 72. An image can also be focused on image recorder 72 by varying the distance between image recorder 72 and output lens 66 either independently, or in combination with adjustments in motorized optics 62.
• Image recorder 72 may be a charge coupled device (CCD), photomultiplier tube (PMT), photodiode, avalanche photodiode, photographic film, plates, or other light sensitive materials. In addition, image recorder 72 may be a combination of any of the above light recording or collecting devices.
• controller 68 The focus of motorized optics 62 is controlled by controller 68, which is coupled to motorized optics 62 via control line 70. Controller 68 may be a microprocessor, micro-controller, or any other device which generates a digital or analog signal that can be used to control the focus of motorized optics 70.
• Memory 74 may be semiconductor memory, magnetic memory, optical memory, or any other type of memory used to store digital information.
• Image recorder 72 is coupled to memory 74 via data line 76.
• Controller 68 may also control memory 74 and Image recorder 72 via control lines 78 and 80.
• Camera 60 may be a still camera or a video camera. Controller 68 can be used to sequence motorized optics 64 through any range of focuses, as the desired range of focuses may change with the type of scene and lighting conditions. If camera 60 is used as a video camera, motorized optics 64 must be made to operate very quickly, as several frames (each including several images taken at different focuses) per second must be captured. To save time, controller 68 could be programmed to cycle motorized optics 64 from the closest desired focus to the furthest desired focus to capture the images required to generate one frame, and then cycle motorized optics 64 from the furthest desired focus to the closest desired focus to capture the images required to generate the next frame. This process could then be repeated for all subsequent frames.
• each 5x5 high contrast segment may then be assembled into a single image which will be substantially in focus over the entire scene. This may be done with more advanced software algorithms which will recognize "continuous shapes" or objects to simplify the process and make it more rapid.
• the manipulation is most easily carried out in digital form (either from digitized analog originals or from digital originals) but may also be done in an analog format (cut and paste).
• Objects 15A-15C represent the position of several objects in space as perceived by a viewer 20.
• Objects 15A-15C are distances 22A-22C, respectively, away from viewer 20.
• Objects 15A-15C also reflect light cones 16A-16C towards viewer 20.
• the degree to which a light cone 16 is diverging when it reaches viewer 20 varies with the distance of an object 15 from viewer 20.
• an image 10 (which is preferably perceived as sharp over its entire area) is placed in registered alignment with an array 12 of micro- lenses 14.
• the preferred embodiment can also operate on an image 10 that is not sharp at each point.
• Array 12 can be a substantially flat two dimensional array, or it can be an array having a desired degree of curvature or shape, which depends on the curvature or shape of image 10.
• the characteristics of each micro-lens 14 corresponding to each point or pixel on image 10 are chosen based on the focus distance of the camera lens which made that point or pixel of the image sharp.
• the focal lengths of the micro-lenses 14 may be chosen so that light cones 18A-18C duplicate light cones 16A-16C (based on the expected or known viewing distance from the micro-lenses, or based on a relative scale or an arbitrary scale to vary the perceived image). In this respect, viewer 20A will see the same 3D image seen by viewer 20.
• image 10 can be viewed as a coherent 2D image when viewed by itself, the appearance of image 10 can be made to vary or alternate between 2D and 3D. If 2D viewing is desired, lenses 14 in array 12 can either be removed, or can be adjusted to be optically neutral. If 3D viewing is desired, lenses 14 in array 12 can be adjusted as described above.
• a similar procedure may be utilized to produce 3D motion pictures/video. As is known to those skilled in the art, motion video is achieved by rapidly displaying images in sequential fashion. Therefore, sequential images in focus over the entire image (or to the degree desired) must be created. To achieve this, a video camera which is made to rapidly and continuously cycle between near and far focus is used.
• Each overall sharp image is produced by the techniques discussed above (utilizing depth of field, knowledge of the scene, collage techniques, etc.). Further, intelligent software can be used in combination with still or video cameras to optimize depth of field, number of focus steps on a focus cycle, etc., based on ambient conditions, previously inputted preferences, and/or the past (immediately prior or overall past history) appropriate settings. Additional software/hardware manipulation can be used to make sharp images over the entire scene or to the degree desired. For example, the periphery of a scene may be selectively out of focus.
• the brain focuses on a central portion and the periphery is often substantially out of focus.
• the image behind the micro-lens array is sharp over the entire scene so that as the viewer examines different portions of the scene each will come into focus as the viewer focuses properly.
• sharpness over the entire image is not needed, such as in video sequences when the viewer only follows a particular field within a scene.
• 3D display is achieved by placing the images behind an array 12 of variable focus lenses 14, as discussed above with respect to Figure 1.
• each frame in the video sequence for each point or pixel of the frame there is a corresponding focus setting for the lens 14 which is in register with that pixel.
• each pixel varies its focus to the appropriate predetermined setting for the pixel of that frame.
• each point or pixel has with it an associated lens or compound lens, the rays from each pixel can be controlled to reach the eye at a predetermined angle corresponding to the 3D depth desired for that pixel.
• the above described techniques may be used for display screens such as television, video, video cameras, computer displays, advertising displays such as counter top and window displays, billboards, clothes, interior decorating, fashion watches, personal accessories, exteriors, camouflage, joke items, amusement park rides, games, virtual reality, books, magazines, postcards and other printed material, art, sculptures, lighting effects which cause light to become more intense or diffuse, as may be desired in photographic or home use applications, and any other applications where three dimensional or variable optical effects are desired.
• advertising displays such as counter top and window displays, billboards, clothes, interior decorating, fashion watches, personal accessories, exteriors, camouflage, joke items, amusement park rides, games, virtual reality, books, magazines, postcards and other printed material, art, sculptures, lighting effects which cause light to become more intense or diffuse, as may be desired in photographic or home use applications, and any other applications where three dimensional or variable optical effects are desired.
• Computer displays are typically placed close to a user, and the user's eyes are constantly set at a single distance which puts strain on the eye muscles. To prevent eyestrain and long-term deleterious effects, it is recommended that one periodically look at distant objects.
• a lens array can be adjusted so that the viewer can focus near or far to view the display.
• Such variation in apparent viewing distance may be manually user controlled, or may follow a predetermined algorithm (such as slowly and imperceptibly cycling but moving through a range to prevent strain).
• Such algorithms may also be used for therapeutic purposes.
• the viewing distance may be modulated to therapeutically benefit certain muscle groups.
• the technique may be used for books as well as other close-field intensive work.
• Still images may be paired with fixed focal length lens arrays as well as variable focus arrays.
• Unique effects can be achieved by modulating the focal length of the lenses in conjunction with a still image.
• Eccentric art as well as eye-catching displays or advertisements could be achieved by undulating the focus of a still image.
• this technique can be used to guide the viewer's attention to particular portions of an image by selectively modulating the apparent viewing area of interest and leaving the rest of the image static ⁇ or vice versa, or alter the focus of a region and its apparent size.
• Wrap-around, or all encompassing views are advantageous because they eliminate distracting non-relevant peripheral information and images.
• the second technique is the use of individual viewing goggles or glasses. In this technique relatively small screens are placed close to the eyes.
• micro-lenses An advantage to using the micro-lenses is that even at very close distances, it is difficult for the average person to discern features of less than 100 microns - so if the micro-lenses in the array are made small enough (but are large enough so that unwanted diffraction effects do not predominate) the screen can remain virtually continuous without pixel effects. Because the screens are small, reductions in cost to achieve the wrap-around all encompassing views are achieved. Additionally, it is possible to use blackened areas around the screen if the screen does not fill the entire viewing angle so as to remove distractions. Alternatively, some applications would advantageously incorporate external visual images. For example, a partially transparent display could overlap images from the environment with displayed images (this can be used in other embodiments such as heads up displays). Such displays could have military as well as civilian use. In particular, information can be displayed to operators of moving vehicles. When using goggles, such displays could be visible to one eye or both.
• goggles may have one screen for each eye. Such goggles would require appropriate parallax correction so that the two images coincide and are perceived as a single image by the viewer.
• An advantage of using two screens is that the individual screens may be placed very close to their respective eyes.
• the two images of different parallax may be obtained from a variety of modified camera systems (see Ray, Figure 65.10, Section 65.5 (cited above)).
• software algorithms may be used to generate second images from single views with altered parallax.
• Two screen goggles may also be used without parallax corrected images—that is, with the same perspective displayed to both eyes. This would likely result in some loss of natural 3D effect. However, many factors contribute to 3D effects, of which parallax is only one.
• the display 10 behind the lens array 12 may be analog or digital, and it may be printed, drawn, typed, etc. It may be a photograph or transparency, in color or black and white, a positive or negative, inverted or offset by any angle or properly oriented in its original fashion-it may emit or reflect light of many different wavelengths visible or non-visible. It may be lithograph, sequential cinematic images and may be an XY plane in two or three dimensions. It may be a CRT, LCD, plasma display, electrochromic display, electrochemiluminescent display or other displays well known in the art.
• Lenses 14 in array 12 may vary in terms of:
• Size preferably ranging from 1 cm to 1 micron.
• Shape preferably circular, cylindrical, convex, concave, spherical, aspherical, ellipsoid, rectilinear, complex (e.g. Fresnel), or any other optical configuration known in the art.
• the lenses may be primarily refractive, primarily diffractive, or a hybrid diffractive-refractive design, such as the design disclosed in Missig et al., 1995, "Diffractive Optics Applied to Eyepiece Design,” Applied Optics ___ 14):2452-2461, which is incorporated herein by reference.
• Number of lenses in the array; the arrays may range from 2x2 to a virtually unlimited array, as the lens array 12 could be in the form of a very large sheet.
• lens elements used for each 'pixel' may be useful for correcting optical aberrations and/or useful for different optical effects.
• spherical or chromatic aberrations may be corrected and zoom lens optics may be incorporated into an array.
• zoom lens optics may be incorporated into an array.
• different optical element designs could be incorporated into the same array.
• the lenses may be colored or colorless and may be transparent to a variety of visible and non-visible wave lengths. For example, stacked arrays of red, green, and blue lenses may be used. Alternatively, colored display pixels could be used with non-colored lenses.
• the lenses may be composed of a variety of materials in a variety of states.
• the lenses may be liquid solutions, colloids, elastomers, polymers, solids, crystalline, suspensions etc.
• Lens compression, relaxation, and deformation the lenses may be deformed by electrical and/or mechanical (e.g. piezoelectric) means. Deformation may be employed to control effective focal length and/or to vary other optical properties of the lens or lens system (e.g. aberrations or alignment-alignment may be between lenses and/or alignment with the display)
• arrays may be combined or stacked to vary or increase different optical properties.
• the arrays can be curved or flat.
• filters may be used in the arrays, between the array and the display, and in front of the array. Such filters may be global, covering all or most pixels, or may be in register with only one pixel or a select group of pixels.
• neutral density filters e.g. an LCD array.
• Other filters include color filters, gradient filters, polarizers (circular and linear) and others know to those skilled in the art.
• the surfaces of the different components of the invention may be coated with a variety of coatings, such as, antiglare coatings (often multilayer).
• coatings such as, antiglare coatings (often multilayer).
• Other coatings provide scratch resistance or mechanical stability and protection from environmental factors.
• Light baffling structures or materials may be used to prevent unwanted stray light or reflections. For example, it may be desirable to isolate each pixel optically from neighboring pixels.
• SAMs may be used to form micro light baffles.
• micro-lenses which occupy hydrophilic regions may be circumscribed by hydrophobic regions whose surfaces are selectively occupied by light absorbing material.
• micro-machined light baffle structures may be used.
• the components of the invention may advantageously have varying optical properties.
• substantially transparent components and support materials would be used-e.g. for use in a heads up display.
• mirrored surfaces may be desirable-e.g. as a backing to maximally utilize reflected light and also for the use of mirrored optical elements.
• Other materials include semitransparent mirrors/beam splitters, optical gratings, Fresnel lenses, and other materials known to those skilled in the art.
• Shutters and/or apertures may be placed in various locations the system and may be global or specific (as the filters above). Shutters may be useful, for example, if a film based cinematic video scene were used as the display. Apertures could be used to vary light intensity and depth of field.
• the lighting may be from the front (reflected) or from the rear (backlit) and/or from a variety of intermediate angles.
• both reflected and luminous backlighting are desirable to more accurately represent a scene. For example, when indoors looking out a window, one may perceive strong backlighting through the window and reflected softer light with directional shadows within the room. Combining backlight, reflected light and the intensity/neutral density filtering will give a more realistic image.
• Directional reflected light may be focused on a single pixel or specific area or may be global (as with backlighting). The light may be filtered, polarized, coherent or non-coherent.
• the color temperature of sunlight varies through the day.
• a sunlight corrected source light could then be filtered to represent the reddish tones of a sunset image etc.
• the light may be placed in a variety of positions (as with the filters above) and may be from a variety of known light sources to one skilled in the art including incandescent, halogen, fluorescent, mercury lamps, strobes, lasers, natural sunlight, luminescing materials, phosphorescing materials, chemiluminescent materials, electrochemiluminescent etc.
• luminescing lenses Liquid lenses or lenses which may be suitably doped with luminescent materials may be useful, especially in disposable systems. For example, consider a liquid phase lens resting on an electrode. Such a lens (if it contained an ECL tag) could be caused to luminesce.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Optics & Photonics (AREA)
• Chemical & Material Sciences (AREA)
• Nanotechnology (AREA)
• Condensed Matter Physics & Semiconductors (AREA)
• Materials Engineering (AREA)
• Crystallography & Structural Chemistry (AREA)
• Composite Materials (AREA)
• Stereoscopic And Panoramic Photography (AREA)
• Instruments For Viewing The Inside Of Hollow Bodies (AREA)
• Endoscopes (AREA)
• Length Measuring Devices By Optical Means (AREA)
• Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Priority Applications (3)

Applications Claiming Priority (6)

Publications (1)

Family

ID=27413393

Family Applications (1)

Country Status (8)

Cited By (26)

Families Citing this family (17)

Citations (6)

• 1996
  • 1996-06-06 EP EP96921565A patent/EP0871917A4/en not_active Ceased
  • 1996-06-06 AU AU62764/96A patent/AU6276496A/en not_active Abandoned
  • 1996-06-06 WO PCT/US1996/010181 patent/WO1996041227A1/en not_active Application Discontinuation
  • 1996-06-06 CN CNB961961503A patent/CN1188727C/zh not_active Expired - Lifetime
  • 1996-06-06 CA CA002223126A patent/CA2223126A1/en not_active Abandoned
  • 1996-06-06 JP JP9502230A patent/JPH11513129A/ja not_active Ceased
  • 1996-06-06 CN CNA2004101011584A patent/CN1645187A/zh active Pending
  • 1996-06-06 KR KR1019970709168A patent/KR100436538B1/ko not_active IP Right Cessation
  • 1996-06-06 KR KR10-2003-7012438A patent/KR100417567B1/ko not_active IP Right Cessation
  • 1996-06-17 TW TW085107281A patent/TW355756B/zh not_active IP Right Cessation

Patent Citations (6)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events