JP2017511496A - Imaging curved mirrors and partially transparent plates - Google Patents

Abstract

A system (100), method (900) and apparatus (110) for displaying an image (650) are provided. The system (100) can project the image directly to the eyes (92) of the user (96) using the partially transparent plate (430) in conjunction with the curved mirror (420). The combination of the curved mirror (420) and the plate (430) is capable of operating in a tracking mode (123) that tracks the eye (92) of the viewer (96) and the viewer (96) in the physical environment (650). It can also be used for additional functions of the VRD visor device (116), such as the ability to operate in an extended mode where the displayed image (880) overlaid on the view can be viewed. [Selection] Figure 1d

Description

[Related applications]
This general patent application is filed on January 6, 2014, entitled “NEAR-EYE DISPLAY APPARATUS AND METHOD” (US Patent Application No. 61 / 924,209). We claim priority to the provisional patent application, which is hereby incorporated by reference in its entirety.

  The present invention is an image display system, method and apparatus (collectively “system”). Specifically, this system is a virtual retinal display system that projects an image onto the viewer's eye using a curved mirror and a partially transparent plate.

  A virtual retina display (VRD) is such that the viewer's eyes are directly exposed to 80-inch television images. In an era where large-screen TVs continue to grow and mobile media consumption continues to grow through the use of smartphones and tablet computers, VRD combines the experience of large-screen TVs with the mobility of headphone sets. Take advantage of the advantages.

US patent application Ser. No. 13 / 367,261

  VRD has the potential to open highly desirable functions in a wide range of fields to users. However, reconciling these different functions is not an easy task. Light is a resource that is always difficult to control. In head mounted displays such as VRD, there is not much space in the device when a sufficiently small device is desired for convenient mobile applications.

  There is a need for a “traffic cop” that manages different light paths that can be useful in managing different light paths in VRD displays or other forms of head mounted displays.

  The present invention is an image display system, method and apparatus (collectively “system”). Specifically, this system is a virtual retinal display system that projects an image onto the viewer's eye using a curved mirror and a partially transparent plate.

  The combination of a curved mirror and a partially reflective plate is an effective way to direct the desired image directly to the viewer's retina. If necessary, such a configuration can be used to (1) direct light to the tracking assembly for the purpose of monitoring viewer eye movements, and (2) a media experience that enables augmented reality (ie, visible to the user). It is also possible to create a media display that overlays views of the physical environment.

  Various features and inventive aspects of the system are shown in the various figures briefly described below. All components associated with element numbers shown in the following drawings are specified and described in Table 1 in the Detailed Description section.

It is a block diagram which shows the example of the side view of the curved mirror fixed to the partially reflective and partially transparent plate. Example of light transmission from the illumination assembly to the imaging assembly in the example of the light life cycle (ie, illumination path) in the system from the generation of light by the illumination assembly until the image is projected to the viewer's eye FIG. Shows an example of image transfer from the imaging assembly to the plate in the example of the light life cycle (ie, illumination path) in the system from the generation of light by the illumination assembly to the projection of the image onto the viewer's eye It is a block diagram. In the example of the light life cycle (ie, illumination path) in the system from the generation of light by the lighting assembly until the image is projected to the viewer's eye, some light is reflected towards the curved mirror FIG. 6 is a block diagram showing the partial transparency and reflectivity of the plate, with other light passing up the plate. The light previously reflected by the plate towards the mirror in the example of the light life cycle (ie, illumination path) in the system from the generation of light by the lighting assembly until the image is projected to the viewer's eye It is a block diagram which shows the example in which is reflected toward a plate. In the example of the light life cycle (ie, illumination path) in the system, starting from the generation of light by the lighting assembly until the image is projected to the viewer's eye, some light passes through the plate and others FIG. 6 is a block diagram illustrating an example in which light is reflected toward an imaging assembly. It is a block diagram which shows a mode that the infrared light from an eye reaches | attains a plate in the infrared-light path which a tracking assembly utilizes. FIG. 6 is a block diagram illustrating how infrared light is reflected from a plate to a tracking assembly in an infrared light path utilized by the tracking assembly. It is a block diagram which shows the example in which the external environment image reaches | attains a curved-surface mirror in the illumination path where external light reaches | attains a viewer's eyes while looking at the image produced by the imaging assembly. FIG. 6 is a block diagram illustrating an example where an external environment image reaches a partially transparent plate in an illumination path where external light reaches the viewer's eyes while viewing an image created by the imaging assembly. FIG. 6 is a block diagram illustrating an example in which external light reaches the viewer's eye in an illumination path where the external light reaches the viewer's eye while viewing an image created by the imaging assembly. It is a front view which shows the example of a plate-curved mirror structure in the form which faced the viewer's eyes. FIG. 6 is a block diagram illustrating examples of types of roles that a plate-curved mirror configuration can perform in relation to image display, eye tracking, and bringing an external environment image to the viewer's eye. It is a processing flow figure showing an example in which a user uses a system. FIG. 6 is a block diagram illustrating examples of different assemblies that can exist in the operation of the system, such as an illumination assembly, an imaging assembly, and a projection assembly. FIG. 6 is a block diagram illustrating an example configuration that includes an optional tracking assembly. FIG. 6 is a block diagram illustrating an example configuration that includes an optional expansion assembly. FIG. 6 is a block diagram illustrating an example configuration that includes both an optional tracking assembly and an optional expansion assembly. FIG. 6 is a hierarchical diagram illustrating examples of different components that can be included in a lighting assembly. FIG. 6 is a hierarchical diagram illustrating examples of different components that can be included in an imaging assembly. FIG. 6 is a hierarchical diagram illustrating examples of different components that can be included in a projection assembly. FIG. 6 is a hierarchical diagram illustrating examples of different components that can be included in a tracking assembly. FIG. 6 is a hierarchical diagram illustrating examples of different components that can be included in an expansion assembly. FIG. 2 is a hierarchical diagram illustrating examples of different types of support components that can be included in the structure and function of the system. FIG. 6 is a block diagram illustrating an example of light flow used to support the function of the tracking assembly. It is a flowchart figure which shows the example of an image projection. It is a block diagram which shows the example of the DLP system using a plate-curved surface mirror structure. It is a block diagram which shows the further detailed example of the DLP system using a plate-curved mirror structure. It is a block diagram which shows the example of the LCOS system using a some optical diffuser. 1 is a perspective view of an embodiment of a VRD device of the system. FIG. It is an environment figure showing an example of a side view of a user who wears a VRD device which materializes a system. It is a structural diagram showing an example of components that can be used in the VRD device. FIG. 6 is a hierarchical diagram illustrating examples of different categories of display systems that can potentially implement innovative systems, ranging from giant systems such as stadium scoreboards to VRD visor systems that project visual images directly to the retina of individual users. FIG. 5b is a hierarchical diagram illustrating examples of different categories of display devices that closely reflect the system of FIG. 5a. It is a perspective view showing an example of a user who wears an integrated VRD visor device. FIG. 2 is a hierarchical diagram illustrating examples of different display / projection techniques that can be incorporated into the system. It is a hierarchy figure which shows the example of the different operation mode of the system regarding immersion and expansion. FIG. 6 is a hierarchical diagram illustrating examples of different operating modes of a system relating to user attribute detection using sensors and / or use of the system by a user. FIG. 4 is a hierarchical diagram illustrating examples of different categories of system implementations based on whether device (s) are integrated with a media player component. FIG. 3 is a hierarchical diagram illustrating examples of two roles or types of image viewers and users who are operators of the system. FIG. 6 is a hierarchical diagram illustrating examples of different attributes that can be associated with media content. It is a hierarchy figure which shows the example of a different image context.

  The present invention is an image display system, method and apparatus (collectively “system”). Specifically, this system is a virtual retinal display system that projects an image onto the viewer's eye using a curved mirror and a partially transparent plate.

I. Overview FIG. 1 a is a block diagram illustrating a partial example of system 100. This figure discloses two components of the projection assembly 400 that can be a very useful tool for directing light. The two components are an at least partially transparent plate 430 (which is of course also an at least partially reflective plate) and a curved mirror 420. In many cases, the curved mirror 420 is a semi-transparent mirror that is at least partially transparent. These two components can constitute a highly desirable projection assembly 400 that serves to project an image onto the viewer's eye. This component configuration can also be used to enable eye tracking by the tracking assembly and / or augmented reality by the augmentation assembly. Plate 430 and curved mirror 420 can serve as very effective “traffic” inducers for the movement of light in the system.

A. Display of Images to the Viewer Eye FIGS. 1b-1f illustrate the light life cycle (ie, illumination path) of the system 100 from the generation of light by the lighting assembly to the projection of the image onto the viewer's eye. It is a block diagram which shows an example.

  FIG. 1 b is a block diagram illustrating an example of the transmission of light 800 from the illumination assembly 200 to the imaging assembly 300.

  FIG. 1 c is a block diagram illustrating an example of the transmission of an image 880 (embodied in light) from the imaging assembly 300 to the plate 430.

  FIG. 1d is a block diagram illustrating the partial transparency and reflectivity of the plate 430, with some light reflected toward the curved mirror 420 and other light passing upward through the plate 430. FIG.

  FIG. 1 e is a block diagram illustrating an example in which light 880 previously reflected by the plate 430 toward the mirror 420 is reflected toward the plate 430.

  FIG. 1 f is a block diagram illustrating an example where some light 880 passes through the plate 430 and other light is reflected toward the imaging assembly 300.

B. Some embodiments of the eye movement tracking system 100 may include a tracking assembly. The tracking assembly allows the system 100 to track the movement of the eye 92 of the viewer 96 while the viewer 96 is viewing the image 880. FIGS. 1g-1h are block diagrams illustrating the infrared light path utilized by tracking assembly 500. FIG.

  FIG. 1 g is a block diagram showing how the infrared light 830 from the eye 92 reaches the plate 430.

  FIG. 1 h is a block diagram illustrating how infrared light 830 is reflected from the plate 430 to the tracking assembly 500. Infrared light 832 or other types of light may be generated by a light source or lamp within tracking assembly 500.

C. The augmented reality system 100 can be used in either an augmented reality mode (where a viewer views an external world image and a display image simultaneously) or an immersive mode that blocks external images. 1i-1k are block diagrams illustrating illumination paths through which external light reaches the viewer's eyes while viewing an image created by the imaging assembly.

  FIG. 1 i is a block diagram illustrating an example in which the external environment image 650 reaches a curved mirror.

  FIG. 1 j is a block diagram illustrating an example in which the external environment image 650 reaches a partially transparent plate.

  FIG. 1 k is a block diagram illustrating an example in which the external light 830 that embodies the external environment image 650 reaches the eye 92 of the viewer 96.

  FIG. 11 is a front view showing an example of a plate-curved mirror configuration facing the viewer's eyes.

D. Aggregation Function FIG. 1m is an input / output diagram illustrating examples of types of light 800 that can be implemented by a plate-curved mirror configuration for image display, eye tracking, and bringing an image of the external environment to the viewer's eye. . Although some embodiments of the system 100 do not include either a tracking mode or an augmented reality mode, the plate 430 and the curved mirror 420 can be a useful way to implement all three functions. This configuration can act as an effective “traffic cop” for various light streams in the system 100.

  FIG. 1 n is a flowchart showing an example using all three functions. At 950, an image 880 is projected onto the eye 92 of the viewer 96. At 960, the system 100 tracks the movement of the eye 92 of the viewer 96 when viewing the image 880 (or more likely being multiple images 880). At 954, the system 100 can cause the external environment image 650 to reach the viewer's eye 92 and display it for viewing simultaneously with the display image 880.

II. Assembly and Component System 100 can be described in terms of an assembly of components that perform various functions that support the operation of system 100. FIG. 2 a is a block diagram illustrating examples of different assemblies that may exist in the operation of system 100, such as illumination assembly 200, imaging assembly 300 and projection assembly 400. The illumination assembly 200 includes a light source 210 that provides light 800 for the image 880. A modulator 320 in the imaging assembly 300 modulates the incident light 800 to form an image 880. At this stage, image 880 can also be referred to as provisional image 850 because in some methods, image 880 is further modified, focused, or otherwise affected by the processing of system 100. Nevertheless, the modulator 320 is responsible for converting the source material of the light 800 into something visible to the viewer 96. Projection assembly 300 including at least partially transparent plate 430 and curved mirror 420 receives image 880 from imaging assembly 300 and projects this image onto viewer 96. In the case of the VRD visor device 116, the image 880 is projected onto the eye 92 of the viewer 96.

  As shown in FIGS. 2b, 2c, and 2d, the system 100 may also include a tracking assembly 500 that tracks the eye movements of the viewer. This tracking can be done while the image 880 is displayed, or it can be done when the image 880 is not displayed. The system 100 may also include an expansion assembly that makes both the image 880 from the media content and the external environment image 650 visible to the viewer 96. This can be called augmented reality.

A. Illumination Assembly Illumination assembly 200 performs the function of providing light 800 to system 100 so that image 880 can be displayed. FIG. 2 e is a hierarchical diagram illustrating examples of different components that can be included in the lighting assembly 200. These components can include, but are not limited to, a wide range of light sources 210, a color wheel or other type of coloring filter, a diffuser, and various support components 150. Examples of the light source 210 include, but are not limited to, a multi-bulb light source 211, an LED lamp 212, a three-color LED lamp 213, a laser 214, an OLED 215, a CFL 216, an incandescent lamp 218, and an angle-independent lamp 219. Can be mentioned. The light source 210 is where the light 800 is generated and travels throughout the rest of the system 100. Thus, each light source is a location 230 where light 800 is produced.

B. Imaging Assembly The imaging assembly 300 performs the function of creating an image 880 from the light 800 provided by the illumination assembly 200. The modulator 320 can convert the light 800 provided by the lighting assembly 200 into an image 880 that the system 100 displays. The image 880 generated by the imaging assembly 300 is referred to as a provisional image 850 because it can be focused before being directed to a location where one or more users 90 can experience or otherwise modified to some extent. You can also.

  The imaging assembly 300 can vary greatly based on the type of technique used to create the image. Substantially different components within the imaging assembly 300 involve display technologies such as DLP (Digital Light Processing), LCD (Liquid Crystal Display), LCOS (Liquid Crystal on Silicon), and other methods. Can do.

  FIG. 2 f is a hierarchical diagram illustrating examples of different components that can be utilized in the imaging assembly 300 of the system 100. The prism 310 can be a very useful component in guiding light to and / or from the modulator 320. Typically, DLP applications direct light to and from DMD 324 using an array of TIR prisms 311 or RTIR prisms 312.

  The light modulator 320 is a device that modifies or changes the light 800 and generates an image 880 to be displayed. Modulator 320 can operate with a variety of different characteristics of modulator 320. The reflective modulator 322 uses the reflection characteristics of the modulator 320 to form an image 880 from the supplied light 800. Examples of the reflective modulator 322 include, but are not limited to, a DLP display DMD 324 and several LCOS (reflective liquid crystal) panels 340. The transmissive modulator 321 forms an image 880 from the supplied light 800 using the transmission characteristics of the modulator 320. Examples of transmissive modulator 321 include, but are not limited to, an LCD (Liquid Crystal Display) LCD display and several LCOS panels 340. Typically, the imaging assembly 300 of the LCOS or LCD system 100 has a combiner cube 350 or some similar device for incorporating different monochromatic images into a single image 880.

  The imaging assembly 300 can also include various support components 150.

C. Projection Assembly Projection assembly 400 can perform the task of directing image 880 to a final destination in system 100 where user 900 can access image 880. In many cases, the image 880 created by the imaging assembly 300 is at least slightly modified between the generation of the image 880 by the modulator 320 and the display of the image 880 to the user 90. Accordingly, the image 880 created by the modulator 320 of the imaging assembly 300 is only a provisional image 850 and not the final image 880 that is actually displayed to the user 90.

  FIG. 2 g is a hierarchical diagram illustrating examples of different components that can be part of the projection assembly 400. The curved mirror 420 and the partially transparent plate 430 (usually a semi-transparent mirror 422 where expansion is the desired capability) can be accompanied by various support components 150 that can be characterized as mostly conventional optics.

D. Tracking / Sensing Assembly As shown in FIG. 2h, tracking assembly 500 typically includes a lamp, such as infrared lamp 520, a camera, such as infrared camera 520, and various support components. The assembly 500 may include a quad photodiode array or CCD that tracks the eye. FIG. 2k is an input / output diagram illustrating an example of light flow that the tracking assembly 830 can implement. The lamp 520 generates light 830 so that the camera 510 can “see” the eye 92 of the viewer 96. The generated light 830 serves as a kind of flash and is not used for image projection, so the infrared lamp 520 can be located in a variety of different locations. One reason for using the infrared light 830 is that the infrared light 830 is not visible to the viewer 96 and therefore does not interfere with the image 880 of the external environment image 650.

F. Extension Assembly The extension assembly 600 provides the ability to view an external environment image 650 simultaneously with a display image 880 generated from a media source or streaming source. As shown in FIG. 2i, the expansion assembly 2i includes a window component 620 that allows the external light 650 to reach the viewer's eye, and a shutter component 610 that allows the window component 620 to be closed or blocked, in certain situations Support component 150 may also be included where necessary or useful.

G. Supporting components Light 800 can be a difficult resource to manage. The light 800 is fast moving and cannot be constrained in the same way that most input or source materials can be constrained. FIG. 2j is a hierarchical diagram illustrating examples of several support components 150, many of which are conventional optical components. Conventional optical components such as mirror 141 (including dichroic mirror 152), lens 160, collimator 170 and doublet 180 involve any display technology application. Similarly, any electrically powered device requires a power source 191 and any device capable of displaying an image 880 is likely to have a processor 190.

H. Process Flow Diagram The system 100 can be described as interconnecting the functions of the illumination assembly 200, the imaging assembly 300, and the projection assembly 400. On the other hand, the system 100 can also be described in terms of a method 900 that includes an illumination process 910, an imaging process 920, and a projection process 930. Similarly, the functions of tracking assembly 500 and expansion assembly 600 can also be described and characterized from a processing perspective.

III. Different Display Technologies System 100 can be implemented for a variety of different display technologies including, but not limited to, DLP and LCOS.

A. DLP Embodiment FIG. 3a shows an example of a DLP system 141, ie, an embodiment of a system 100 that utilizes DLP optics. The DLP system 141 uses a DMD 314 (digital micromirror device) composed of millions of extremely small mirrors as the modulator 320. Each micromirror in DMD 314 can be associated with a particular pixel in image 880.

  As described above, the illumination assembly 200 includes a light source 210 that provides light 800. The light 800 then proceeds to the imaging assembly 300. Two TIR prisms 311 direct the light 800 to the DMD 314, which uses the light 800 to create an image 880, after which the TIR prism 311 transmits the light 800 that embodies the image 880 and the image 880 to the viewer 96. Orienting the plate 430 and the curved mirror 420 to cooperate for delivery on the eye 92.

  FIG. 3 b is a more detailed example of the DLP system 141. In this figure, the DLP system 141 includes an additional lens 160 that can help direct light flow. Similarly, components such as a color wheel or other similar components can be added to color the image 880. The lens 160 is positioned in front of the display 410 so as to correct / focus the image 880 before the image 880 is provided to the viewer 96.

B. LCD Embodiment FIG. 3 d is a diagram illustrating an example of an LCOS system 143. LCOS is a mixture of DLP and LCD. LCOS means a reflective liquid crystal display. LCD means liquid crystal display. The modulator 320 in the LCD system 142 is one or more LCD panels 330 composed of liquid crystals that are electronically manipulated to form an image 880. The LCOS panel 340 is an LCD panel that includes a computer chip similar to the chip used in DMD 314 for DLP applications.

  Typically, the lighting assembly 200 in the LCOS system 143 separates the light 800 into three component colors, typically red, green and blue, which are the same colors as on many color wheels 240 found in DLP applications. Various dichroic mirrors 152 are included.

  The LCD 330 forms a single color image that is combined with the multicolor image 880 by the dichroic combiner cube 320 or some similar device.

IV. VRD Visor Embodiments The system 100 can be implemented in a variety of different configurations and operational scales. However, the original idea of the concept of multiple diffuser concepts arises in the context of the VRD visor system 106 embodied as a VRD visor device 116. The VRD visor device 116 projects the image 880 directly onto the user's 90 eye. The VRD visor device 116 is a device that can be worn on the head of the user 90. The VRD visor device 116 may include acoustic and visual capabilities in many embodiments. Such embodiments can include multiple modes of operation, such as a visual only mode, an audio only mode, and an audio-visual mode. The VRD visor device 116 can be configured like normal headphones when used in non-visual mode.

  FIG. 4 a is a perspective view showing an example of the VRD visor device 116. The two VRD eyepieces 418 allow the image 880 to be projected directly onto the user 90 eye. The “eyepiece” 418 is basically a path of light that travels between the plate 430 and the viewer's eye 92. As shown in FIGS. 1 b-1 f, the plate 430 is the last object that the image 880 encounters before reaching the eye 92 of the viewer 96. Image 880 strikes plate 430 twice (FIGS. 1c and 1e). The image 880 hits the curved mirror 420 only once (FIG. 1d). As shown in the front view, ie, the view seen from the eye of FIG. 11, the configuration of the plate 430 and the curved mirror 420 can form a virtual eyepiece in the VRD display.

  FIG. 4 b is a side view showing an example in which the VRD visor device 116 is worn on the head 94 of the user 90. When device 116 is in a position to project image 880 onto user's 90 eye 92, user's 90 eye 92 is occluded by device 116 itself.

  FIG. 4 c is a component diagram illustrating an example of a VRD visor device 116 for the left eye 92. Associated with the right eye 92 is the mirror image of FIG.

  The three-color LED light source 213 generates partially coherent light 803, the light 803 passes through the condenser lens 160, the condenser lens 160 directs the light 800 to the mirror 151, and the mirror 151 forms the light 800. Reflected towards 160, then the light 800 is incident on an imaging assembly 300 composed of two TIR prisms 311 and DMD 314. The provisional image 850 from the imaging assembly 300 passes through two doublets 180 and another lens 160 so that they focus the provisional image 880 to the final image 850 and are visible to the user 90 through the plate 430 / mirror 420 configuration. Become.

V. Alternative Embodiments There are no patent applications that can explicitly disclose all potential embodiments of the invention in words or drawings. Variations of known equivalents are also implicitly included. In accordance with the provisions of patent law, the principles, functions and modes of operation of system 100, method 900 and apparatus 110 (collectively “system” 100) are described and illustrated in the form of some preferred embodiments. However, it should be understood that the system 100 of the present invention can be implemented in other ways than those specifically described and illustrated without departing from the spirit or scope of the present invention.

  It is to be understood that the description of system 100 above and below includes all novel and non-obvious combinations of the elements described herein, and the claims may be presented in this application, Alternatively, it can be presented in a subsequent application for any novel non-obvious combination of these elements. Further, the above-described embodiments are exemplary, and no single feature or element is essential to all possible combinations that can be claimed in this or a subsequent application.

  System 100 represents a substantial improvement over prior art display technologies. As with conventional display technology, the system 100 can be implemented in a wide variety of different ways. The new method of utilizing the partially transparent plates 430 in series and the curved mirror 420 is immersive and expansive, as well as one-way embodiments (without sensor feedback from the user 90) and bi-directional ( In both embodiments (sensor feedback from user 90), a variety of different display technologies can be utilized and implemented at a variety of different scales.

A. Various scales Display devices can be implemented in various different scales. The EverBanks Field giant scoreboard (home of Jacksonville Jaguars) is a display system consisting of 35.5 million LED bulbs, 60 feet high and 362 feet long. This scoreboard is intended to be viewed simultaneously by tens of thousands of people. The ALYGANT GLYPH ™ visor at the opposite end is a device that is worn on the user's head and projects a visual image directly on the eyes of one viewer. There are a variety of different display systems between the ends of these continuums. The specification purpose of the system 100 is deeply based on the visor system 105, in particular the VRD visor system 106, but it does not mean that this concept has no utility outside these contexts.

  The system 100 can be implemented such that these structures are used on a variety of different scales or for different purposes.

  FIG. 5a is a hierarchical diagram illustrating various categories and subcategories that are generally associated with a display system, specifically the scale of implementation of the system 100. FIG. As shown in FIG. 5 a, the system 100 can be implemented as a large scale system 101 or as a personal system 103.

1. Large Scale System Large scale system 101 is intended for use by multiple concurrent users 90. Examples of large scale systems 101 include movie theater projectors, bars, large screen TVs in restaurants or homes, and other similar displays. Large system 101 includes a sub-category of giant system 102, such as a stadium scoreboard 102a, Times Square display 102b, or other or large outdoor displays such as billboards off the highway.

2. Personal System Personal system 103 is an embodiment of system 100 designed for viewing by a single user 90. Examples of the personal system 103 include a desktop monitor 103a, a portable TV 103b, a laptop monitor 103c, and other similar devices. The category of the personal system 103 includes a sub-category of the near eye system 104.

a. Near Eye System The near eye system 104 is a subcategory of the personal system 103 where the user's 90 eye is within approximately 12 inches of the display. The near eye system 104 includes a tablet computer 104a, a smartphone 104b, and an eyepiece application 104c such as a camera and a microscope, and other similar devices. The sub-category of the near eye system 104 includes a subcategory of visor system 105.

b. Visor System The visor system 105 is a subcategory of the near eye system 104 in which a portion of the system 100 that displays the visual image 200 is actually worn on the head 94 of the user 90. Examples of such a system 105 include a virtual reality visor, Google Glass, and other conventional head mounted displays 105a. The category of the visor system 105 includes a subcategory VRD visor system 106.

c. VRD Visor System The VRD visor system 106 is an implementation of a visor system 105 in which the visual image 200 is projected directly onto the user's eyes. A technique for directly projecting an image onto the viewer's eye is disclosed in “Image GENERATION SYSTEM AND IMAGE GENERATION METHODS” filed on Feb. 6, 2012 (US Patent Application No. 13 / 367,261). No.), the contents of which are incorporated herein by reference. The VRD visor system 106 is expected to be particularly suitable for implementing a multiple diffuser 140 approach that reduces the coherence of the light 210.

3. Integrated devices Media components tend to become segmented and shared over time. A display device concept is possible in which the illumination assembly 120 is only temporarily connected to a particular imaging assembly 160. However, the illumination assembly 120 and imaging assembly 160 of the system 100 are permanently incorporated into a single integrated device 110 (at least from a practical point of view of the user 90) in most embodiments. FIG. 5 b is a hierarchical diagram illustrating examples of different categories and subcategories of the device 110. FIG. 5b closely reflects FIG. 5a. Potential device 110 areas include the categories of large devices 111 and personal devices 113. Large device 111 includes a subcategory of giant device 112. The category of the personal device 113 includes a sub-category of the near eye device 114 including a sub-category of the visor device 115. The VRD visor device 116 constitutes a category of the visor device 115 that implements the virtual retina display, that is, the VRD visor device 116 projects the visual image 200 directly on the eyes of the user 90.

  FIG. 5 c shows an example of a perspective view of the VRD visor system 106 embodied in the form of an integrated VRD visor device 106 worn on the head 94 of the user 90. For the element 92, the dotted line is used in the figure because the user's 90 eye 92 is occluded by the device 116 itself.

B. Different Categories of Display Technology The prior art includes a variety of different display technologies including, but not limited to, DLP (Digital Light Processing), LCD (Liquid Crystal Display) and LCOS (Reflective Liquid Crystal). FIG. 5d is a hierarchical diagram illustrating different categories of the system 100 based on basic display technology that can implement two (or more) diffusers 282 separated by a gap 290. FIG. As shown in FIG. 5d, the system 100 can be implemented as a DLP system 141, an LCOS system 143, and an LCD system 142. The system 100 can also be implemented in other categories and subcategories of display technology.

C. Immersion vs. Extension FIG. 5e is a hierarchy diagram showing the hierarchy of the system 100 organized into categories based on the difference between immersive and extended. Some embodiments of the system 100 can have a variety of different modes of operation 120. The immersion mode 121 has a function of blocking the outside world so that the user 90 is focused only on what the system 100 displays to the user 90. In contrast, the enhanced mode 122 is intended to display a visual image 200 superimposed on the physical environment of the user 90. The difference between immersive mode and extended mode of system 100 is particularly relevant in the context of near eye system 104 and visor system 105.

  Some embodiments of the system 100 may be configured to operate in either immersive mode or extended mode at the user's own discretion. On the other hand, other embodiments of the system 100 may have only a single mode of operation 120.

D. Some embodiments of the display-only versus display / detect / track / monitor system 100 are configured for only one-way transmission of optical information. Other embodiments can capture information from the user 90 as a visual image 880, potentially allowing the user 90 to access other aspects of the media experience. FIG. 5f is a hierarchical diagram reflecting the categories of the one-way system 124 (non-detection operation mode 124) and the bidirectional system 123 (detection operation mode 123). The interactive system 123 can include functions such as retinal scanning and monitoring. The user 90 can be identified, the focus of the user's 90 eye 92 can be tracked, or other similar functions can be provided. There is no sensor or sensor array in the one-way system 124 that captures information about or from the user 90.

E. Media Player—Integrated vs. Separate Display Device may be integrated with a media player. In another example, the media player is completely separated from the display device. As an example, a laptop computer can be a single integrated device with a screen that displays a movie, speakers that carry audio accompanying a video image, a DVD or BLU-RAY® player that plays the source media away from the disc. Can be included. Such devices can also stream.

  FIG. 5g is a hierarchical diagram illustrating various different categories of the system 100 based on whether the system 100 is integrated with a media player. The integrated media player system 107 includes the ability to actually play media content and the ability to display images 880. The non-integrated media player system 108 must communicate with the media player to play the media content.

F. User-Viewer vs. Operator FIG. 5h is a hierarchy diagram showing examples of different roles that the user 90 can play. The viewer 96 can access the image 880 but cannot otherwise control the functions of the system 100. Operator 98 can control the operation of system 100, but cannot access image 880. Speaking of a movie theater, the viewer 96 is a spectator and the operator 98 is a movie theater employee.

G. Media Content Attributes As shown in FIG. 5i, media content 840 can include a variety of different types of attributes. A system 100 that displays an image 880 is a system 100 that plays media content 840 that includes a visual attribute 841. However, many examples of media content 840 include acoustic attributes 842 and even tactile attributes. There are also some new technologies for communicating olfactory attributes 844, and in some situations, the ability to convey taste attributes 845 becomes only part of the media experience.

  As shown in FIG. 5j, some images 880 are part of a much larger video 890 context. In other contexts, the image 880 may be a stand-alone still frame 882.

6). Glossary / Definition Table 1 below lists element numbers, names and descriptions / definitions.

92 Eye 200 Illumination assembly 300 Imaging assembly 420 Curved mirror 430 Plate 880 Image (light)

Claims (20)

A system (100) for displaying an image (880) to an eye (92) of a viewer (96),
A light source (210) that provides a plurality of light (800) to a modulator (320), wherein the modulator (320) creates the image (880) from the light (800), the system comprising:
A curved mirror (420) and a partially transparent plate (430) for projecting the image (880) on the eye (92) of the viewer (96);
The system (100) characterized by the above. The system (100) is a VRD visor device (116).
The system (100) of claim 1. The partially transparent plate (430) is the last component of the system (100) that contacts the image (880) before reaching the eye (92) of the viewer (96).
The system (100) of claim 1. The curved mirror (420) is the penultimate component of the system (100) that contacts the image (880) before reaching the eye (92) of the viewer (96).
The system (100) of claim 3. The image (880) projected onto the eye (92) of the viewer (96) is at least twice on the partially transparent plate (430) before reaching the eye (92) of the viewer (96). Contact,
The system (100) of claim 1. The image (880) projected onto the eye (92) of the viewer (96) contacts the curved mirror (420) at least twice before reaching the eye (92) of the viewer (96). ,
The system (100) of claim 1. The curved mirror (420) is an at least partially transparent semi-transparent mirror (422).
The system (100) of claim 1. The semi-transparent mirror (422) causes a plurality of external lights (832) to reach the eye (92) of the viewer (96), and the image (880) generated by the modulator (320) and an external environment image (650) is visible to the viewer (96) simultaneously,
The system (100) of claim 7. The system (100) further comprises a shutter component (610) that blocks the external light (832).
The system (100) of claim 8. The shutter component (610) is opened and closed by the viewer (96).
The system (100) of claim 9. The partially transparent plate (430) is at least partially transparent to infrared light;
The system (100) of claim 1. The system (100) further comprises an infrared lamp (520) that generates a plurality of infrared lights (830) and an infrared camera (510) that tracks the eye (92) of the viewer (96).
The system (100) of claim 11. The partially transparent plate (430) directs infrared light (830) impinging on the eye (92) of the viewer (96) to the infrared camera (510).
The system (100) of claim 12. At least a portion of the infrared light (830) transmitted from between the eyes (92) of the viewer (96) to the infrared camera (510) does not contact the curved mirror (420);
The system (100) of claim 13. The infrared camera (510) communicates with at least one of (a) a quad photodiode array and (b) a CCD;
The system (100) of claim 12. An apparatus (110) worn by a head (94) of a viewer (96) and projecting an image (880) onto an eye (92) of the viewer (96),
An illumination assembly (200) including a light source (210) that provides a plurality of lights (800) to the modulator (320);
An imaging assembly (300) including the modulator (320) that uses the light (800) from the light source (210) to form the image (880);
A projection assembly (400) that includes a partially transparent plate (430) and a curved mirror (420) and projects the image (880) formed by the modulator (320) onto the eye (92) of the viewer (96). )When,
A device (110), comprising: The device (110) includes an extended mode (122) that allows a plurality of external lights (832) from an external environment (650) of the viewer (96) to be visible, and the eyes (92) of the viewer (96). A tracking mode (123) for tracking the movement of
The apparatus (110) of claim 16. The device (110) allows the external light (832) to reach the eyes (92) of the user (96) and directs the external light (832) to the eyes (96) of the user (96). And 92) further comprising a shutter component (610) that makes it impossible to reach
The apparatus (110) of claim 17. The apparatus (110) further comprises an infrared lamp (520) and an infrared camera (510) that tracks the movement of the eye (92) of the viewer (96).
The apparatus (110) of claim 17. A method (900) of displaying an image (880) for an eye (92) of a viewer (96) comprising:
By directing the image (880) to the user's eye (920) using a curved mirror (420) and a partially transparent plate (430), the image (880) is moved to the eye of the viewer (96) ( 92) projecting to (950);
Receiving (952) the image (880) and tracking the movement of the eye (92);
While the image (880) is projected onto the eye (92) of the viewer (96), external light (832) including an external environment image (650) of the viewer (96) is transmitted to the viewer (96). Reaching (954) the eyes (92) of
A method (900) comprising: