JPH11513129A - 3D image forming system - Google Patents

Abstract

(57) [Summary] Recent advances in surface technology have led to the development of tiny (submicron) scale features. These techniques allow for the formation of polymer microlenses (14) as well as variable focus liquid lenses (52). The present invention relates primarily to the use of small lenses in the fabrication of new displays that exhibit three-dimensional (3D) effects. Both still images and video images (or other moving images) can be created.

Description

DETAILED DESCRIPTION OF THE INVENTION                          3D image forming system                                Field of the invention   The present invention relates generally to optical systems, and more particularly to diffraction, refraction, or Or a three-dimensional imaging system incorporating a diffractive / refractive compound lens.                                   background                                Human vision   Normal human vision perceives space in a colored three-dimensional (3D) view. Observation Photographic systems that present 3D stereoscopic images or stereo models that are acceptable to the The optical requirements that can be realized are better by understanding stereoscopic vision, or visual perception of space. Can be well recognized.   The stimulus conditions for spatial recognition are called cues and there are two groups. Monocular Groups can view stereoscopically with one eye, the relative size of the objects, their intervening, linear and Includes visual and aerial perspectives, light and dark distribution, moving parallax of objects and backgrounds, and visual adjustment. Both The eye group consists of two coordination activities of the eyes: first, the optical axis for looking far away. Visual convergence with muscles from parallel to a convergence angle of 23 ° for a near point of 150 mm; And secondly, by two different viewpoints, the imaging system has two different retinas in the left and right eyes Use stereovision to give an image. This difference is a disparity, i.e., the corresponding Or a homologous image point is shifted away from the optical axis due to the location of the point of interest in the binocular field of view. This is due to the fact that it is offset.   Retinal images are transmitted along the optic nerve as frequency-modulated voltage impulses. , Encoded by signal processing performed in the medial lateral geniculate body and then in the visual cortex of the brain. result The visual perception that is possible is specific to the observer. Further discussion of human 3D perception See, for example, Sydney Fray, “Photographic, Film and Video Applications. Photo Optical Imaging System ", Focal Press, pp. 469-484, (1 988), which is incorporated herein by reference.                                 3D technology   Many prior art 3D imaging systems use parallax to produce a 3D effect. To use. Section 65.5 of Ray, cited above and incorporated herein by reference, is a 3D movie 3D viewing of two parallel offset images, 3D picture postcards, etc. A well-described technique based on differences. Systems based solely on these disparities are not Produces some 3D effect, but is visibly non-photorealistic.   Another well-known but much more complex technique for generating 3D effects The art is holography. Holography creates extremely realistic 3D images. But a coherent light source (such as a laser) and Its use is very limited because it requires a darkroom or near-darkroom condition.   One prior art technique known as one-piece photography for creating 3D images is 3D images. An array of lenslets (fly-eye lens or A microlens array is used. The technology of this one piece photograph is Ives ・ Herbert E, “Optical Properties of Lippman Lenticular Sheet”,US Optical Magazine 21 (3) : 171 to 176 (1931).   Other techniques for incorporating microlens arrays to create 3D images include 1988, "Discussion on New 3-D Image Forming System",Applied Optical Box 27 (21) : 4529-4534; Davis et al., 1988, "Three-dimensional images. Forming system: New development ”,Applied Optics 27 (21): 4520- 4528; Davis et al., 1994, "Image transmission systems using microlens arrays. System design and analysis ”,Optical engineering 33 (11): 362 4-3633; Benton Stefan A, 1972, "Direct image stereo. Panoramic Camera ", U.S. Pat. No. 3,657,981; Nims et al., 19 74, "Three-dimensional images and methods for constructing them", U.S. Pat. No. 3,852,787. And Davis et al., 1991, "Imaging Systems", U.S. Pat. No. 5,040, 871, each of which is incorporated herein by reference. My above A disadvantage of 3D optical systems based on chlorens arrays is that all lenses in the array That is, it has a fixed focal length. This can be caused by such an array. Significantly limit the types of 3D effects that can be used.                        Fabrication of micro lens array   The generation of microscale surface morphology has advanced significantly recently. Self-assembled monolayer (SAM) Micro stamping technology using submicron (<10^-6m) in the form of scale This enables low-cost production.   Some compounds naturally form a regular two-dimensional crystal array when placed in a suitable environment. Can be made. For example, solutions of alkanethiols exhibit this property on gold. You. Micro-stamping or micro-contact printing Use rubber (silicone elastomer) stamps to cover small areas on the gold surface. Selectively deposits lucanthiol. 'Master' model of desired shape and size The semiconductor device is fabricated using optical lithography techniques, which are well known in electronic technology. The silicone elastomer poly (dimethylsiloxane) (PDMS) Pour over the master to cure, then gently remove. Next suitable for PDMS surface Brush the alkanethiol solution into the resulting stamp. Attach. Next, place this PDMS stamp on a gold surface and use alkanethiol Is selectively deposited as a monolayer on this surface. These simple The molecular layer is made up of various head groups to tailor this surface property. (Exposed to an environment away from the metal surface).   In this way, it is possible to easily fabricate alternating hydrophilic and hydrophobic areas on the surface on a microscopic scale. Wear. Under appropriate conditions, such a surface can be cooled in the presence of water vapor, Selectively precipitates in areas of the hydrophobic surface. Such water droplets are convergent micro lens Alternatively, it can act as a divergent microlens. What shape lens element Can also be made. The SAM may be selectively deposited on a flat or curved surface, These surfaces may or may not be optically transparent. SAM surface misunderstanding, next to Contact, stacking, and other forms are all used to create complex lens shapes Can be.   Using a polymer similar to the SAM technology discussed above, using a transparent polymer and stable Make a micro lens. For example, the dissolution of non-polymerizable monomers (which are hydrophilic) The liquid selectively adsorbs to the hydrophilic area on the surface of the derivatized SAM. In that respect, polymerization May begin (eg, by heating). Shape and area of the derivatized surface area By changing the amount of solution on the area, and the composition of the solution, the optical properties differ , Many different lenses can be made.   Examples of optical techniques using liquid optics and SAMs include Kumar et al., 1994. , “Aggregated figures patterned as optical diffraction gratings”,Science 263: 60-6 2; Kumar et al., 1993, "Evaluating gold forms on the order of microns to centimeters. Chemistry after stamping with Stomastamp and alkanethiol 'ink' It can be made by combining etching. "Applied Fiji Books Letter 63 (14) : 2002-2004; Kumar et al., 1994, " Patterning of self-assembled monolayers: applications in materials science ”,Langmuir 10 (5 ) : 1498-1511; Schaudhary et al., 1992, "Water flowing uphill. Law ",Science 256: 1395-1541; Abbott et al., 1994, "Gold Self-assembled made from 15- (Ferocenylcarbonyl) pentadecanethiol on top Potential-dependent wetting of aqueous solution on a standing monolayer ",Langmuir 10 (5): 1 493-1497; and Gorman et al., "During self-assembled monolayers during printing. Controlling the Shape of a Liquid Lens on a Modified Gold Surface Using an Electrical Potential ", Harbor University of California, Department of Chemistry, each of which is incorporated herein by reference.   Microlens arrays can also be fabricated using several other well-known techniques. You. Some examples for making microlens or micromirror arrays Techniques are disclosed in the following articles, each of which is incorporated herein by reference: : Liu et al., 1994, "Large opening by one-step etching and mass transfer smoothing." Manufacture of Speech Micro Lens ”,Applied Physics Letter 64 (12) J. et al., 1994, "Making refractive microlenses. Pre-formed photoresist forOptical engineering 33 (11) : 3552-3555; McFarlane et al., 1994, "Microlens Leh's microjet production ",IEEE Photonics Technology Letter 6 (9) Stern et al., 1994, "Coherent refraction. Dry etching for micro lens array ”,Optical Engineering 3 3 (11) : 3547-3551; and Kendall et al., 1994, "Lenten. Silicon KOH: H for plates, geodesic lenses, and other applications_Two Micro mirror array using O micro machining ”Optical engineering 3 3 (11) : 3578-3588.                           Focal length variation and control   Small lens with variable focal length using the micro-stamping technology discussed above Can be manufactured. Variable focus can be achieved by several common means, such as (i) (Ii) by mechanical deformation; (iii) gas phase Deposition of liquid droplets from water (Kumar et al., Cited above, (Science, 1994)) By selective deposition, as described)); and (iv) heating or Melting (e.g., molding as is, then melting to fine optics, The structure may be melted to change its optical properties, such as a microlens array ).   The extent to which the solution wets or spreads over the surface depends on the electronic properties of the system. Can be controlled by changing For example, placing a microelectrode in a liquid lens By changing the potential to the surface, the curvature of the lens can be changed . See Abbott et al., Cited above. In other configurations, a hydrophilic liquid micro A lens is made, covered with an aqueous solution, and the surface potential for the aqueous solution is changed. Like that System has an extremely small volume that can be reversibly and quickly refocused (1 nL) (see Gorman et al., Cited above).   Referring now to FIG. 3, a schematic diagram of the varifocal lens 50 is shown. variable Focus lens 50 includes a liquid lens 52 and two SAM surfaces 54. SAM Surface 54 adheres to liquid lens 52. 3 (a) to 3 (c) By changing the distance between the SAM surfaces 54 as described above, The shape and thus the optical properties can be changed. Shape and optics of liquid lens 52 There are also some other ways to change the target properties. For example, a lens 52 and a surface 54 As will be discussed in more detail below with respect to FIG. In addition, the shape of the lens 52 can be changed. If the refractive index of the lens 52 is different Can be changed by using a liquid material. The cohesiveness of the liquid lens 52 And adhesion by altering the chemistry of the liquid material, and the surface 5 4 can be adjusted by changing the chemistry. 3D of surface 54 Characteristics can be changed. For example, when viewed from above or below, the surface 54 is a circle Shape, rectangle, hexagon, or any other shape, can be moved up and down No. Using these techniques individually or in combination, a wide variety of lens shapes and An optical effect may be created.   Referring now to FIG. 4, it is disclosed in the Abbott et al. Article cited above. A schematic diagram of such an electrically variable focus lens is shown. The droplet 52 is on the SAM surface 5 4 and its surface is made on a metal surface 56, preferably gold. Fine By changing the electrical potential between the small electrode 58 and the SAM surface 54, the liquid The curvature (and thus the optical properties) of the body lens 52 can be changed. FIG. 4) to FIG. 4 (c) outline how the shape of the liquid lens 52 changes. Shown schematically. A similar effect was achieved using the technique described in the above-mentioned article by Gorman et al. This can be achieved without having to use microelectrodes 58.   Instead, focus such microlenses by mechanical means. You may. For example, changing the focus of a flexible polymer or elastomer lens As such, it may be compressed or relaxed by piezoelectric means. Instead, a flexible case The liquid lens enclosed in the container may be mechanically compressed or relaxed.                                Summary of the Invention   The present invention differs from the prior art in that it has a variable focus microlens and relatively high coverage. An image that appears to have been taken with an optical system having a depth of field; that is, a variable distance within this image Includes an image in which the remote object is substantially in focus over a predetermined range. In an alternative embodiment Uses a variable focus microlens in combination with a still or moving image to view the image. You can change the distance. Another embodiment is a variable focal length element. A 3D or other optical effect is created using a fixed array.                                Description of the drawings   FIG. 1 shows a 3D imaging system incorporating a microlens array according to a preferred embodiment. It is the schematic which shows a system.   FIGS. 2 (a) to 2 (c) show light paths toward an observer under various conditions. It is a schematic diagram.   FIGS. 3A to 3C show the focal length of a liquid microlens using a SAM. FIG. 3 is a schematic diagram illustrating one technique for changing the separation.   FIGS. 4A to 4C show the focal length of the liquid microlens using the SAM. FIG. 5 is a schematic diagram illustrating another technique for changing the separation.   FIG. 5 shows a camera block used to create a two-dimensional image of the type used in the preferred embodiment. It is a lock diagram.                                Detailed description   The structure and function of the preferred embodiment can be best understood by referring to the drawings. Wear. The reader will notice that the same reference number appears in more than one figure. in this case Refers to structures with the same or corresponding numbers. In the preferred embodiment, the relative Manufactured using the techniques discussed above, with deep or static images A 3D effect is produced using a variable focus microlens array, such as   Referring to FIG. 2A, the image seen by the human eye is a plurality of images perceived in continuous detail. Contains extremely fine points. When light hits each object point, the light is scattered and the point is the light cone 30 (that is, light indicating the boundary of a certain solid angle) is reflected outward. If observer 20 When looking at an object at a considerable distance, it collects a very small portion of the cone 30; The collected rays are almost parallel (see FIG. 2 (a); far focus). But observe When the distance is reduced, the light rays collected by the eyes of the observer 20 are less than parallel and larger. It is received at a divergent angle (see FIG. 2 (a); middle focus and near focus). Thing whose distance fluctuates The corneal and lens complex changes shape so that the body is in focus. Discuss on For a more complete discussion of the types of diffuse reflection discussed, see, for example, Le A, Physics for Scientists and Engineers, Third Edition, Extended Edition, Word Publisher Pp. 982-984, which is incorporated herein by reference.   According to a preferred embodiment, a two-dimensional photograph or image that is in focus at all points of the image Place an array of microlenses on the image. With proper lighting, such a system Can create light cones with varying degrees of opening and simulate 3D space.   A photographic lens has only one focal point, so a photograph must have a strictly focused surface. There is only one; the image gradually gets out of focus before and after this plane. This effect is This can be reduced by increasing the depth of field, but can only be corrected to some extent.   In general, preferred embodiments of the present invention have been made using optics with a large depth of field. Works with images. For some images, properly position the focal plane and use depth of field. If used, sharpness can be sufficiently perceived throughout the entire image. In other cases, all To perceive strict focus on all points, more advanced techniques Surgery is required. Using improved cameras and / or digital imaging techniques I can do it. For example, digital software can be used to defocus certain areas of the image. Can be focused using the 'sharpening' filter.   Referring now to FIG. 5, it is used to create a two-dimensional image of the type used in the preferred embodiment. A block diagram of the camera 60 is shown. The camera 60 has an input lens 64 It includes a conventional motorized optical system 62 having an output lens 66. Lenses 64 and 6 Although 6 is depicted as a convex lens, those skilled in the art will appreciate that lenses 64 and 66 can be any desired lens. You will understand that any configuration is acceptable. The optical system with motor 62 is an image recording device. The image is focused on the device 72. The image is between the image recording device 72 and the output lens 66. Can be varied independently or in combination with the adjustment of motorized optics 62. Thus, the image can be focused on the image recording device 72. The image recording device 72 , Charge-coupled device (CCD), photomultiplier tube (PMT), photodiode, Lanche photodiode, photographic film, dry plate, or other photosensitive material Good. In addition, the image recording device 72 can be any of the above optical recording devices or light collecting devices. It may be a combination.   The focusing of the motorized optics 62 is controlled by a controller 68, which It is connected to an optical system with motor 62 via a control line 70. The control device 68 Control the focusing of the processor, microcontroller or motorized optics 70 Other digital or analog signals that can be used to control It may be a device.   If the image recording device 72 is a digital device, the image recording device 72 The obtained image is stored in the memory 74. If the image recording device 72 is a photograph or photosensitive material If it is a fee, the memory 74 is unnecessary.   The memory 74 is a semiconductor memory, a magnetic memory, an optical memory, or a digital information. Other types of memory used to store the data. The image recording device 72 , And a memory 74 via a data line 76. Control device 68 includes control line 78 and The memory 74 and the image recording device 72 can also be controlled via 80.   Operate the camera 60 to create a collage of sharp areas, You can make an image. For example, the same focusing on different distances A series of images of the scene can be captured by the image recording device 72. That is, the control device 6 Reference numeral 8 denotes a focus over a range (for example, from 5 m to infinity) in the motorized optical system 64. The image recording device 72 captures images of scenes taken at different focal lengths by repeating the point matching. And the memory 74 stores the captured image. Focal length of optical system 64 with motor The separation can be changed continuously or stepwise, depending on the conditions and the required image. Wear.   Furthermore, capturing one to several hundred images, depending on conditions and required images Can be. For example, if the images are all distant horizon, only the No need. Thus, the overall shutter speed will be very short.   The camera 60 may be a still camera or a video camera. Desired focal length range May vary with scene type and lighting conditions, so use controller 68. The motored optical system 64 is arranged in a fixed order over an arbitrary focal length range. be able to. If the camera 60 is used as a video camera, a few frames per second (Including several images taken at different focal lengths) The optical system 64 must be made to operate very quickly. Save time To reduce the cost, the controller 68 has to capture the images needed to make one frame, The motorized optical system 64 repeats from the desired recent focal length to the desired furthest focal length. And then motorized light to capture the image needed to make the next frame The system 64 is designed to repeat from the desired longest focal length to the desired recent focal length. G can be. Therefore, this process is repeated for all subsequent frames.   Each of the digital images stored in memory 74 (eg, an array of 5 × 5 pixels) You may sample the same part of the scene in contrast with contrast (best control The last corresponds to the sharpest focus). Next, each 5 × 5 high When the trust portion is collected into a single image, the image is almost in focus over the entire scene. I guess. This simplifies this process and to make it even faster, Go with advanced software algorithms that recognize continuous shapes or objects Is also good. This operation is performed in digital form (digital conversion of the analog original). Or with digital originals), but analog It may be done in a format (cut and paste).   Referring now to FIG. 1, a preferred embodiment of the present invention is illustrated. Object 15A 15 to 15C represent the positions of some objects in the space perceived by the observer 20. Stuff The bodies 15A to 15C are located at a distance 22A to 2 away from the observer 20, respectively. 2C. Objects 15A through 15C are directed toward observer 20 by light cones 16A through 16C. 16C also reflects. As discussed above, when light cone 16 reaches observer 20 Varies with the distance of the object 15 from the observer 20. Object 15A In order for the 3D of the chair 15C to reproduce the image, the image 10 (clear over the entire area thereof) (Preferably recognized) is placed in alignment with the array 12 of microlenses 14. However, the preferred embodiment can also work with images 10 that are not sharp at each point.   The array 12 may be a substantially flat two-dimensional array, or the curvature of the image 10 Alternatively, the array may have a desired degree of curvature or shape depending on the shape. The characteristics of each microlens 14 corresponding to each point or pixel in the image 12 Choose based on the focal length of the camera to sharpen the points or pixels. Micro lens The focal length of 14 is such that light cones 18A-18C duplicate light cones 16A-16C. (Based on the intended or known viewing distance from this microlens Or on a relative or arbitrary scale to alter the perceived image) You may choose. In this regard, observer 20A is the same as observer 20 has seen. You will see 3D images.   Image 10 can be viewed as a coherent 2D image when viewed alone. So, the appearance of the image 10 changes between 2D and 3D or is made to alternate be able to. If you want 2D observation, remove the lens 14 of the array 12 or Or it can be adjusted to be optically neutral. If you want 3D viewing , The lens 14 of the array 12 can be adjusted as described above.   A similar procedure can be used to create a 3D movie / video. Known to those skilled in the art As shown, moving video is achieved by displaying images in rapid succession. I do. Thus, a continuous image in focus (or to the extent desired) over the entire image I have to make it. To achieve this, a quick and continuous transition between near and far focus Use a video camera made to repeat. A clear image over each, (Depth of field, scene knowledge, collage technology, etc.) Use). Furthermore, intelligent software can be used in combination with a still camera or video camera. Hardware, ambient conditions, pre-entered preferences, and / or past Is based on the appropriate settings of the entire past history), the depth of field, The number of focusing steps can be optimized. Additional software / hardware operations The crop can be used to create an image that is as sharp as the entire scene or as desired. For example, the periphery of the scene may be selectively out of focus.   Although the human eye has a large overall depth of field, the brain focuses on the central Is often almost out of focus. Ideally, behind a microlens array Image is sharp over the entire scene, and when the observer examines different parts of the scene When the observer properly focuses, each comes into focus. But, Like a video sequence where the observer tracks only a certain area of a scene, Sharpness over the entire image may not be needed.   Once the desired video image has been captured, as discussed above with respect to FIG. Image is placed behind the array 12 of the varifocal lens 14 to provide a 3D display. Realize. For each point or pixel in the video sequence up to this point, There is a corresponding focus setting for lens 14 aligned with that pixel. Each frame sequentially When displayed, each pixel sets its focal length to the appropriate predetermined setting for that pixel. Change to   Since each point or pixel has an associated lens or compound lens, To reach the eye at a predetermined angle corresponding to the 3D depth desired for that pixel. Can be controlled. Numerous suitable for the desired effect in any given case There will be lens design.   Referring again to FIG. 2, an important consideration in the operation of the present invention is the distance between the eye and the pixel. You. For a near screen like goggles (see FIG. 2 (b)), it is farther A different lens design for the screen (see FIG. 2 (c)) is needed. Figure 2 (b) (medium focus and far focus), the combination of elements (positive lens and negative Can be moved relative to each other to produce the desired optical effect. It may be possible. Thus, in one embodiment, multiple arrays are moved relative to each other. To produce the proper light output. Further properties of the combination of optical elements A complete description can be found, for example, in Ray (cited above), pp. 139-143. 43 to 49, These are hereby incorporated by reference.   Consider the analog behavior of diffuse reflection and focus from the lens; if focus and reflection If both points are the same distance from the eye, the angles of the rays when they reach the eye will be the same U. The pupil of the eye is relatively small, about 5 mm, so the diffusely reflected light cone Since the eye only sees a small part, it is necessary to "reproduce" the light that the eye does not see Absent.   The above technologies are used in TVs, videos, camcorders and computer displays. Advertising screens such as display screens, countertops and window displays Spray, bulletin board, clothing, interior decoration, fashion watch, accessories, d Custeria, camouflage, fun, amusement park rides, games, virtual reality, For books, magazines, postcards and other printed matter, art, sculpture, photography or home use Lighting effects that make light more intense or diffused in the way, as well as three-dimensional or It can be used for other applications requiring a varioptic effect.   The computer display is typically located close to the user and is Is always set to a single distance, which overworkes the eye muscles. Eye strain and long-term It is recommended that you regularly look at distant objects to prevent harmful effects. Using the present invention Adjusts the lens array to focus the viewer closer or farther away. You can also see the display. Such a change in visual distance (de The display itself may be kept at the same distance), but manually controlled by the user. Or may follow a predetermined algorithm (e.g., Return, but move as far as possible to prevent tension). Such algorithms are It may be used for medical purposes. Observation distance to therapeutically benefit a muscle group May be adjusted. This technique may be used for books and other near-field focused tasks. No.   One use of the static 3D image according to the present invention would be in the field of art and collections . Still images can be paired with a fixed focal length lens array, as well as a variable focus array. I You may. By adjusting the focal length of the lens relative to the still image, The effect of can be achieved. By swelling the focus of a still image, Unusual art could be realized, as well as eye-catching displays or advertisements. Special In addition, this technique selectively adjusts the area of bright vision of interest, and Change the focus of a certain area and its apparent size-or vice versa Can be used to direct the observer's attention to specific areas of the image. Wear. For example, if the objects are the same size (in terms of their proportion in the observer's field of view) And the observer's eye switches from near focus to far focus, the size of the object The observer's perception of this is a change of will (ie, the observer is Will be larger). Similarly, if the size of the object (in the observer's field of view) If the observer's eye switches from far focus to near focus while the The observer will then perceive that the object is smaller). This effect is Quasi-images-further aided by including images of objects of known size. Therefore Such screens, for example, have a large apparent size to draw the viewer's attention. Can be selectively changed.   Wrap-around or full siege observations can be distracting, Advantageously, the images are eliminated. In order for the observer to observe the entire scene In general, there are two technologies. The first is group observation (for example, Sony's Aima The most useful extra large (for a theater or planetarium) and (also A) using a curved viewing screen. The second technique is personal observation goggles Or use glasses. With this technology, a relatively small screen is placed near the eye. Place The advantage of using microlenses is that even at very close distances, the average It is difficult for humans to identify features smaller than 100 microns, so the array If you make the icro lens small enough (but the unwanted diffraction effects do not Large enough to keep the screen virtually continuous without pixel effects Is Rukoto. Because the screen is small, perform a full wraparound observation A reduction in the cost for achieving this is achieved. Besides, if the screen does not fill the entire viewing angle If not, you can use a blackened area around the screen to avoid distractions You. Instead, some applications may advantageously incorporate an external visual image. For example, Semi-transparent Bright display can be superimposed on the surrounding image that displays the image (This can be used in other embodiments, such as head-up displays). That Such displays can be used for military purposes as well as for consumer use. In particular, for moving vehicles Information can be displayed to the driver. When using goggles, such displays are It could be made visible to one or both eyes.   If you make a computer display in wraparound goggles, The effective screen size will be the largest. Computer monitor size As all information / number of computer applications is increasing, they are expanding at the same time There is a tendency. Wrap-around goggles computer display Will make the entire field of view available as a desktop. This is the above It could be combined with a 3D effect as well as a tension reduction function.   Additionally, goggles may have one screen for each eye. Such a go The Google optics should be properly viewed so that the two images coincide and the viewer perceives it as a single image. Correction is needed. The advantage of using two screens is that each screen It should be very close to each eye. Various corrections for two images with different parallax (Ray, see FIGS. 65.10, 65.5 ( See above)). Instead, use software algorithms to create a single field of view. A second image with a different parallax may be created. Two screen goggles, parallax correction It is also possible to display and use the same perspective view in both eyes without a normal image. this is This will result in some loss of the natural 3D effect. However, there are many 3D effects Factors contribute, parallax is just one of them.   Referring again to FIG. 1, the display 10 behind the lens array 12 is an analog Or digital, and may be printed, drawn, or typed. It Is a photo or slide, color or black and white, positive or negative, upside down or appropriate Angle offset or the proper orientation in its original form--it is It may emit or reflect light of many different wavelengths, or invisible. It's ritog It may be a rough, a series of cinematic images, or a two-dimensional or three-dimensional XY plane. So These are CRT, liquid crystal display, plasma display, electrochromic display Electrochemiluminescence display or its well-known in the art. Other displays may be used.   The lenses 14 of the array 12 may vary in the following ranges:   Size; preferably ranges from 1 cm to 1 micron.   Shape; preferably circular, cylindrical, convex, concave, spherical, aspheric, oval, straight Shape, composite (eg, Fresnel), or other optical as known in the art shape.   Configuration; these lenses are predominantly refractive, predominantly diffractive, An alternate hybrid design may be used. 95, "Diffractive optical element applied to eyepiece design"Applied Optics 34 (14) : 2452-2461, incorporated herein by reference. I do.   Number of lenses in the array; lens array 12 is in the form of a very large sheet The array may range from 22 to a virtually unlimited array .   Number of lens elements used for each 'pixel'; complex as known in the art Lenses may be useful for correcting optical aberrations and / or different May be useful for obtaining optical effects. For example, spherical aberration or chromatic aberration This may be corrected, or a zoom lens optical system may be incorporated into the array. Besides, di Use a fixed focus array before spraying, then zoom on top of this first array. May be used. Or combine different optics designs in the same array for different applications Can be included.   Lens colors; these lenses may be colored or colorless and have various visible and It may be transparent to non-visible wavelengths. For example, stacking arrays of red, green, and blue lenses You may use it. Instead, use colored display pixels with colorless lenses. You can also.   Lens composition; as discussed above, these lenses are made of a variety of materials and a variety of You may make it in a state. These lenses include liquid solutions, colloids, elastomers, It may be a polymer, solid, crystal, suspension or the like.   Compression, relaxation and deformation of the lenses; these lenses are electrically and / or It may be deformed by mechanical (eg, piezoelectric) means. Deformation is effective focal length And / or other optical properties of the lens or lens system May be used to change (eg, aberration or alignment--alignment is (Or may be aligned with the display).   Finally, combine or overlay arrays to change the optical properties or add different properties. May be increased. The array may be curved or flat.   Many other various elements can be included in the preferred embodiment. For example, the filter May be used in the array, between the arrays, and before the array. That's it Such filters may be comprehensive, cover all or most of the pixels, or It may be aligned with only one pixel or a selected group of pixels. Special attention And a neutral filter (for example, a liquid crystal display array). To other filters Are known to color filters, gradation filters, polarizers (circles and straight lines) and those skilled in the art. There are other things that can be done.   Furthermore, the surfaces of the different parts of the invention can be painted with various paints, for example with anti-glare paint. (Often multi-layer). Other coatings provide scratch or mechanical stability and Protect from factors.   Light blocking structures or materials may be used to prevent unwanted stray light or reflection . For example, it may be desirable to optically isolate each pixel from neighboring pixels . In one embodiment, a small light blocking plate using SAM may be used. For example, hydrophilic The microlens occupying the hydrophobic area is replaced by the hydrophobic area whose surface is occupied by the light absorbing material You may surround it. Alternatively, a micro-machined light blocking plate structure may be used.   The components of the present invention advantageously have various optical properties. In some applications, Use qualitatively transparent components and support materials--for example, for head-up displays To use. In other cases, mirror-finished surfaces--for example, make the best use of reflected light It may also be desirable to perform and to use specular optics. Other materials Include translucent mirrors / beamsplitters, optical gratings, Fresnel lenses, and There are other materials known to the trader.   Shutters and / or apertures may be located at various positions in the system, It can be comprehensive or specific (as in the filter above). The shutter, for example, If you use film-based cinematic video scenes as displays , Will be useful. Apertures could be used to change light intensity and depth of field.   The entire system varies in size between 2.3 microns and more than a few hundred meters will do. The system may be curved or flat. It's a kit Is also good. It can be permanent or portable. Screen facilitates transportation It may be folded or rolled up for use. The screen should not be It may be incorporated in a combined unit (eg a laptop computer). This cis The system may be used for simulators and virtual reality systems. This system measures the distance by associating the effective focal point of the array with the surrounding focal plane. Can be used as a distance meter. This system is an advanced autofocus system. You may use it as a system. For example, a micro lens is a large mechanical camera lens Can focus much faster, and then put this lens in the correct focus position Can be used to quickly find the optimal focus position. I can do it. This system can, for example,-use a long effective focal length. It can be used to observe the directivity of the display. This system , May be disposable.   An important consideration in the present invention is the type and direction of illumination. Lighting from before ( From reflection) or from behind (backlight) and / or from various intermediate angles May be. The number of light sources may be one or more. In some cases, reflected light and bright batteries Both lights are desirable to more accurately represent the scene. For example, a window in the room Strong backlight from windows with directional shadows in the room when looking outside You will feel the soft light reflected. Backlight, reflected light and intensity / medium A combination of gender filters will give a more realistic image. Directional reflected light May be focused on a single pixel or a specific area or may be comprehensive (backlight Like). Light can be filtered, polarized, coherent, It may be coherent. For example, the color temperature of sunlight changes throughout the day. So, Filters the light from the light source corrected for sunlight to a reddish color sunset image Page, etc. This light may be placed in various locations (as in the above filter). Like), incandescent, halogen, fluorescent, mercury lamp, strobe, laser, natural sunlight, luminous substance Skilled in the art, including, but not limited to, phosphorescent, chemiluminescent, electrochemiluminescent, etc. To Light from various known light sources may be used. Another embodiment is an embodiment of a light emitting lens It is. Liquid lenses appropriately doped with luminescent materials are especially useful in disposable systems. Would be. For example, consider a liquid phase lens placed on an electrode. Such a lens (If it contains an ECL tag) will emit light.   The invention has been described with reference to a preferred embodiment. However, the present invention does not It is not limited to the embodiment. Rather, the scope of the present invention is defined by the appended claims. .

────────────────────────────────────────────────── ─── Continuation of front page    (31) Priority claim number 08 / 476,854 (32) Priority date June 7, 1995 (33) Priority country United States (US) (81) Designated countries EP (AT, BE, CH, DE, DK, ES, FI, FR, GB, GR, IE, IT, L U, MC, NL, PT, SE), OA (BF, BJ, CF) , CG, CI, CM, GA, GN, ML, MR, NE, SN, TD, TG), AP (KE, LS, MW, SD, S Z, UG), UA (AM, AZ, BY, KG, KZ, MD , RU, TJ, TM), AL, AM, AT, AU, AZ , BB, BG, BR, BY, CA, CH, CN, CZ, DE, DK, EE, ES, FI, GB, GE, HU, I L, IS, JP, KE, KG, KP, KR, KZ, LK , LR, LS, LT, LU, LV, MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, RO, R U, SD, SE, SG, SI, SK, TJ, TM, TR , TT, UA, UG, UZ, VN

Claims (1)

[Claims]   1. A three-dimensional image forming system,   A two-dimensional array of microlenses, at least some of which have a variable focal length, and And   2D image with multiple image points or pixels Including   At least one microlens in this array is associated with one or more image points or pixels. Image forming system aligned.   2. A three-dimensional image forming system,   A two-dimensional array of variable focal length microlenses, and   2D image with multiple image points or pixels Including   At least one microlens in this array is associated with one or more image points or pixels. Image forming system aligned.   3. A three-dimensional image forming system,   An array of microlenses, at least some of which have a variable focal length; and   2D image with multiple image points or pixels Including   An image in which each image point or pixel is aligned with one or more microlenses in this array. Imaging system.   4. In the invention of claim 3, the image forming system is sold as a kit. System.   5. 3. The image forming system according to claim 2, wherein the image forming system comprises a pair of goggles. The embedded system.   6. In the invention according to claim 3, the image forming system is a head-up display. A system built into play.   7. In the invention of claim 3, the image is taken at any one of the focal lengths. An image forming system having a greater depth of field than would be possible.   8. 4. The image forming system according to claim 3, wherein the image forming system includes a 3D image and a 2D image Image forming system that can be changed between.   9. In the invention according to claim 8, the microlens can be made optically neutral. Image forming system.   10. An image according to claim 8, wherein the microlens is removable. Imaging system.   11. In the invention according to claim 3, the image forming system is incorporated in a work of art. Image forming system.   12. The image according to claim 3, wherein the image forming system is incorporated in an advertisement. Imaging system.   13. In the invention according to claim 3, the image forming system is a virtual real Image forming system incorporated in a security device.   14． A three-dimensional image forming system,   A first array of microlenses, at least some of which have a variable focal length;   A second array of microlenses, at least some of which have a variable focal length; and   Image with multiple image points or pixels Including   Each image point or pixel is aligned with one or more microlenses of the first array;   At least one microlens in the second array is one or more microlenses in the first array. An imaging system aligned with the microlens above.   15. A three-dimensional image forming system,   An array of variable focal length microlenses, and   Image with multiple image points or pixels Including   An image in which each image point or pixel is aligned with one or more microlenses in this array. Imaging system.   16. A three-dimensional image forming system,   Each microlens is fixed, but individually has a predetermined focal length. Array of lenses with multiple focal lengths , and   Image with multiple image points or pixels Including   An image in which each image point or pixel is aligned with one or more microlenses in this array. Imaging system.   17． A three-dimensional image forming system,   An array of microlenses, each microlens having a fixed focal length, and   Image with multiple image points or pixels Including   An image in which each image point or pixel is aligned with one or more microlenses in this array. Imaging system.   18. A three-dimensional optical system,   Each microlens is fixed, but individually has a predetermined focal length. Array of   Image with multiple image points or pixels Including   Light in which each image point or pixel is aligned with one or more microlenses in this array Science system.   19. A three-dimensional optical system,   Each microlens is fixed, but individually has a predetermined focal length. Array of   Image with many image points or pixels Including   At least one microlens is aligned with one or more image points or pixels Optical system.   20. Optical system for changing the apparent distance of a computer screen And   An array of variable focal length microlenses, and   Computer screen with multiple pixels Including   An optical system in which each pixel is aligned with one or more microlenses in this array .   21. Array of variable focal length microlenses, and one or more of this array Including a computer screen having a plurality of pixels aligned with a microlens A method for reducing eye tension in an optical system, comprising:   Periodically change the focal length of all microlenses in this array, Include the step of making this computer screen visible near or far away Way.   22. Array of variable focal length microlenses, and one or more of this array Including a computer screen having a plurality of pixels aligned with a microlens A method for reducing eye tension in an optical system, comprising:   Periodically change the focal length of a subset of the array's microlenses, So that part of this computer screen can be seen near or far away A method comprising the steps of:   23. Optical system for changing the distance apparently on a computer screen And   An array of variable focal length microlenses, and   Computer screen with multiple pixels Including   An optical system in which at least one microlens is aligned with one or more pixels M   24. An optical system for changing the apparent distance of a two-dimensional object,   An array of variable focal length microlenses, and   2D object with multiple points or pixels Including   Optics where each point or pixel is aligned with one or more microlenses in this array system.   25. An optical system for changing the apparent distance of a two-dimensional object,   An array of variable focal length microlenses, and   2D object with multiple points or pixels Including   Light in which at least one microlens is aligned with one or more points or pixels Science system.   26. An optical system for changing the apparent distance of a two-dimensional object,   An array of fixed focal length microlenses, and   2D object with multiple points or pixels Including   Optics where each point or pixel is aligned with one or more microlenses in this array system.   27. An optical system for changing the apparent distance of a two-dimensional object,   An array of fixed focal length microlenses, and   2D object with multiple points or pixels Including   Light in which at least one microlens is aligned with one or more points or pixels Science system.   28. A method for creating a three-dimensional image,   A two-dimensional image having a high depth of field and a large number of image points or pixels. And   Each of these image points or pixels reflects or projects the light it emits Create a cone of light with a given solid angle, the solid angle of which is the view of the image point or pixel. The process of changing with the perceived distance from the observer, A method that includes   29. A method for creating a three-dimensional image,   A two-dimensional image having a high depth of field and a large number of image points or pixels. And   Reflect, transmit, or emit light from each of these image points or pixels to a predetermined Creates a cone of light with a solid angle of which the solid angle is the viewer of the image point or pixel. The process of changing with the perceived distance from A method that includes   30. A method for creating a three-dimensional image,   Create a two-dimensional image with many image points or pixels, and make sure that the image Making it substantially in focus over   Each of these image points or pixels reflects or projects the light it emits Create a cone of light with a given solid angle, the solid angle of which is the view of the image point or pixel. The process of changing with the perceived distance from the observer A method that includes   31. A method for creating a three-dimensional image,   Create a two-dimensional image with many image points or pixels, and make sure that the image Making it substantially in focus over   Reflect, transmit, or emit light from each of these image points or pixels to a predetermined Creates a cone of light with a solid angle of which the solid angle is the viewer of the image point or pixel. The process of changing with the perceived distance from A method that includes   32. A method for producing an optical effect,   Creating a two-dimensional image having a large number of image points or pixels; and   Each of these image points or pixels reflects or projects the light it emits Making a cone of light having a predetermined variable solid angle A method that includes   33. A method for producing an optical effect,   Creating a two-dimensional image having a large number of image points or pixels; and   Reflect, transmit, or emit light from each of these image points or pixels to a predetermined Making a cone of light with variable solid angle A method that includes   34. A method for creating a three-dimensional image,   A two-dimensional image having a high depth of field and a large number of image points or pixels. And   Each of these image points or pixels reflects or projects the light it emits Making a cone of light having a predetermined variable solid angle A method that includes   35. A method for creating a three-dimensional image,   A two-dimensional image having a high depth of field and a large number of image points or pixels. And   Reflect, transmit, or emit light from each of these image points or pixels to a predetermined Making a cone of light with variable solid angle A method that includes   36. A method for creating a three-dimensional image,   Create a two-dimensional image with many image points or pixels, and make sure that the image Making it substantially in focus over   Each of these image points or pixels reflects or projects the light it emits Making a cone of light having a predetermined variable solid angle A method that includes   37. A method for creating a three-dimensional image,   Create a two-dimensional image with many image points or pixels, and make sure that the image Making it substantially in focus over   Reflect, transmit, or emit light from each of these image points or pixels to a predetermined Making a cone of light with variable solid angle A method that includes   38. A method for creating a three-dimensional image,   Have a large number of image points or pixels using an optical system with a large depth of field Making a two-dimensional image, and   Each of these image points or pixels reflects or projects the light it emits Making a cone of light having a predetermined variable solid angle A method that includes   39. Create a changing three-dimensional image using a variable focus microlens array A method for   Have a large number of image points or pixels that are substantially in focus over a given area The process of creating a series of two-dimensional images,   Each of these image points or pixels reflects or emits light that Projecting through the microlens of the ray to create a cone of light with a given solid angle, The solid angle changes with the perceived distance of the image point or pixel from the viewer. Process, and   A process for appropriately changing the focal length of each microlens of the array together with each series of images. About A method that includes   40. A three-dimensional image forming system,   An array of variable focal length liquid microlenses built on the SAM, and   Image with multiple image points or pixels Including   An image in which each image point or pixel is aligned with one or more microlenses in this array. Imaging system.   41. A three-dimensional image forming system,   An array of variable focal length liquid microlenses built on the SAM, and   Image with multiple image points or pixels Including   At least one microlens in this array is associated with one or more image points or pixels. Image forming system aligned.   42. 42. The image forming system according to claim 41, wherein the number of the microlenses is one. The above system is a liquid lens attached to the SAM.   43. 43. The image forming system according to claim 42, wherein the focal length of the liquid lens is Is a system that adjusts by applying an electric field.   44. 42. The image forming system according to claim 41, wherein the micro lens is flexible. System that is a perfect lens.   45. 45. The image forming system according to claim 44, wherein a focal length of the flexible lens. A system that adjusts separation by elastic deformation.   46. The image forming system according to claim 45, wherein the elastic deformation is applied to a piezoelectric element. Thus the system created by the working pressure.   47. A three-dimensional image forming system,   First array of microlenses, at least some of which are colored with a variable focal length ,   A second array of microlenses, at least some of which are colored with a variable focal length ,   Third array of microlenses, at least some of which are colored with a variable focal length ,and   An image having a plurality of image points or pixels, Including   Each image point or pixel is aligned with one or more microlenses of the first array;   At least one microlens in the second array is one or more microlenses in the first array. Align with the micro lens above,   At least one microlens in the third array is one or more microlenses in the second array. An imaging system aligned with the microlens above.   48. 49. The three-dimensional image forming system according to claim 47, wherein Lenses are colored red, the lenses of the second array are colored green, and the third A system in which the lenses of the array are colored blue.   49. A method for making an image of a scene having a plurality of objects, comprising:   a) focusing on one or more of those objects;   b) capturing an image of such a focused scene;   c) focusing on different objects;   d) capturing another image of the scene so focused;   e) Steps (c) and (d) are performed until an image focused on a desired number of objects is captured. Repeating steps, and   f) combining these captured images to create a single image with a large depth of field About A method that includes   50. 50. The method of claim 49, wherein the captured image is a digital image. .   51. 50. The method of claim 49, wherein the combining step is performed digitally.   52. A method for creating an image of a scene,   a) focusing on a specific distance;   b) capturing an image of such a focused scene;   c) focusing on different distances;   d) capturing another image of the scene so focused;   e) Steps (c) and (d) are performed until an image focused at a desired number of distances is captured. Repeating steps, and   f) combining these captured images to create a single image; A method that includes   53. 53. The method of claim 52, wherein the captured image is a digital image. .   54. 53. The method of claim 52, wherein the combining step is performed digitally.   55. A method of making a digital image using a variable focus camera,   a) A series of digital images while changing the focus of this camera between near focus and far focus Sequentially capturing images, and   b) combining these captured images to create a single image with a large depth of field About A method that includes   56. 56. The method of claim 55, wherein the capturing step is performed with a CCD.   57. This is a method of creating digital video using a variable focus video camera. hand,   a) While changing the focus of this camera from near focus to far focus, a first series of digital A process of sequentially capturing the tall images,   b) digitally combining this first series of captured images into a first video sequence; The process of making the top,   c) changing the focus of this camera from near focus to far focus while a second series of digital A process of sequentially capturing the tall images,   d) digitally combining this second series of captured images to form the second The process of making the top,   e) repeating steps (a) to (d) until the desired number of video frames has been produced; A method that includes   58. 58. The method of claim 57, wherein the capturing step is performed with a CCD.   59. 58. The method of claim 57, wherein the camera focus changes in a continuous manner. Method.   60. 58. The method of claim 57, wherein the camera focus changes in a stepped manner. Method.   61. This is a method of creating digital video using a variable focus video camera. hand,   a) While changing the focus of this camera from near focus to far focus, a first series of digital A process of sequentially capturing the tall images,   b) digitally combining this first series of captured images to a predetermined range Creating a first frame of video substantially in-focus over   c) changing the focus of this camera from near focus to far focus while a second series of digital A process of sequentially capturing the tall images,   d) digitally combining this second series of captured images to a predetermined range Creating a second frame of video substantially in-focus over   e) repeating steps (a) to (d) until the desired number of video frames has been created A method that includes   62. A camera for producing an image that is substantially focused over a given area So,   A series of images that are variable focus from near focus to far focus in response to the variable focus signal Optical system with motor for making   A control device connected to the motor-equipped optical system for outputting the variable focus signal,   Receives a series of images or a subset of a series of images created by this motorized optics. Image recording device for catching and capturing; and   Connected to this image recording device to store images captured by this image recording device Memory Including camera.   63. 63. The camera according to claim 62, wherein said image recording device is a CCD. La.   64. A camera for producing an image that is substantially focused over a given area So,   A series of focuses that respond to the variable focus signal and are variable focus from near focus to far focus Optical system with motor for making images,   A control device connected to the motor-equipped optical system for outputting the variable focus signal, and   Receives a series of images or a subset of a series of images created by this motorized optics. Image recording device for catching and capturing Including camera.   65. A camera for producing an image that is substantially focused over a given area So,   A series of focuses that respond to the variable focus signal and are variable focus from near focus to far focus Motorized optical means for making images,   Connected to the optical means with a motor to output the variable focus signal and Control means for controlling the focus of the attached optical means,   A series of images or a subset of a series of images created by this motorized optical means Means for receiving and capturing; and   Memory means for storing an image captured by the means for receiving and capturing Including camera.   66. A camera for producing an image that is substantially focused over a given area So,   Optical system with motor that automatically scans from near focus to far focus,   CCD, and   Memory connected to this CCD, And this motorized optical system creates a changing image and projects it on a CCD. , The CCD functions to capture this changing image at several successive points in time A camera that stores the images captured by the CCD in this memory.   67. A video camera for producing an image that is substantially focused over a predetermined area. Mela,   Motor that automatically scans from near focus to far focus and from far focus to near focus With optical system,   CCD, and   Memory connected to this CCD, And this motorized optical system creates a changing image and projects it on a CCD. , The CCD functions to capture this changing image at several successive points in time A camera that stores the images captured by the CCD in this memory.   68. A video camera for producing an image that is substantially focused over a predetermined area. Mela,   Motor that automatically scans from near focus to far focus and from far focus to near focus With optical means,   Means for capturing images, and   A memory connected to the means for capturing this image, This motorized optical means creates a changing image and captures it The means for projecting and capturing this image on the Function to capture at successive points in time, and the means to capture this image captured A camera that stores images in this memory.