TWI691739B - Near-eye display method with multiple depth of field imaging - Google Patents

Abstract

A near-eye display method with multiple depth-of-field imaging is capable of illuminating a collimating element with a light source through one or more single pixels or a group of pixels containing several pixels on a self-luminous display, so as to wear The incident light passing through the collimating element can achieve a collimating effect, and then at least one collimating light direction changing element is arranged on the light direction path of the beam of the collimating element, so two beams passing through the collimating element can The collimated light direction changing element changes its collimated light direction so as to be able to overlap at different positions to generate focus and change the depth of field, so as to achieve the purpose of multiple depth of field imaging.

Description

Near-eye display method with multiple depth of field imaging

The invention relates to a near-eye display method with multiple depth-of-field imaging, in particular to a method capable of overlapping light beams emitted by any two pixels to produce focusing at different positions, so that the output image can present multiple depth-of-field near-eye display method.

In response to the increasing demand for real-time information in modern society, the transmission of on-demand information has received much attention. The near-eye display is portable, and combined with electronic devices can update and transfer images, colors or text at any time, so it is a good choice for portable personal information devices. Early near-eye displays were mostly used for military or government purposes. Recently, manufacturers have seen business opportunities and introduced near-eye displays to their homes. In addition, entertainment-related players are also optimistic about the potential of this market. For example, manufacturers of home musical instruments and musical instrument software have invested in research and development.

Currently, near-eye displays (NEDs) include head-mounted displays (HMDs) that can project images directly into the eyes of viewers. Such displays can overcome other mobile display form factors by synthesizing virtual large-format display surfaces The limited screen size provided may be used for virtual or augmented reality applications.

The near-eye display can be subdivided into two categories: immersive displays and see-through displays. Among them, an immersive display can be used in a virtual reality (VR) environment to use synthetically rendered images to completely cover the user's field of vision. For augmented reality (AR) applications, a see-through display can be used, in which text, other synthetic annotations, or images can be superimposed in the field of view of the user in the physical environment. In terms of display technology, AR applications require translucent displays (for example, by optical or electro-optical methods), so that the real world can be viewed simultaneously with a near-eye display.

However, due to the fact that the human eye cannot focus (focus) on objects placed at close distances (for example, when the user is wearing glasses, reading the distance between the lens of the magnifying glass and the user's eyes) Difficult to construct. Therefore, the near-eye display must be adjusted so that the viewer can use it comfortably, otherwise it will cause out-of-focus and other conditions that affect the use. However, traditionally, complex and bulky optical components are used for adjustment, but due to the near-eye display Most of them must be worn directly on the viewer's head, so too bulky near-eye displays are often unacceptable to consumers.

Therefore, in order to overcome the above-mentioned problems, if the light beams emitted by any two or more pixels can be overlapped to produce focus, so that the output image can be clearly presented, then no bulky optical components are required, and It can also save the extra cost of using bulky optical components, so it should be an optimal solution.

The above-mentioned near-eye display method with multiple depth-of-field imaging can be achieved. The methods are as follows: (1) The light source of a collimating element can be illuminated by one or more pixels on a self-luminous display to pass through the collimating The incident light of the collimating element can achieve a collimating effect; and (2) and at least one collimating light direction changing element can be arranged on the ray direction path of the beam of the collimating element to change at least two pixels Collimate the light direction so that it can overlap at different positions to produce focus and change the depth of field.

More specifically, the display technology used in the self-luminous display is organic light emitting diode (OLED), micro light emitting diode (micro LED), quantum dot (Quantum dot), laser or any other Form of active light source.

More specifically, the self-luminous display is a transparent display or a non-transparent display.

More specifically, the collimating element is a mircrolens, flat meta-lens or liquid crystal light spatial modulator (LCSLM).

More specifically, the planar super-lens can achieve the effect of a diopter, so that the light direction can achieve a collimating effect.

More specifically, the liquid crystal light spatial modulator has liquid crystal, and the liquid crystal arrangement can be adjusted by changing the voltage, so that the light direction of the incident light of each pixel can achieve a collimating effect.

More specifically, the collimated light direction changing element is a mircrolens, flat meta-lens or liquid crystal light spatial modulator (LCSLM).

More specifically, the microlens is used to enable at least two collimated beam systems to overlap to produce focusing.

More specifically, the planar meta-lens system includes a plurality of regions with convex particles, which are used to adjust and change the direction of the collimated light so that at least two collimated beam systems can overlap to produce focusing.

More specifically, the at least two collimated beams are overlapped at different positions through two other areas with different convex particles, so as to achieve overlapping multiple positions to generate focused multiple depth-of-field imaging.

More specifically, the two collimated beams are overlapped at different positions through one of the same areas and another different areas with convex particles, so as to achieve overlapping of different positions to produce focused multiple depth of field display Like.

More specifically, the liquid crystal light spatial modulator has a liquid crystal, and the liquid crystal arrangement can be adjusted by changing the voltage to change the direction of the collimated beam, so that at least two beam systems that achieve the collimation effect can intersect Stacked to produce focus.

More specifically, the driving voltage on at least two liquid crystals can be changed so that the two collimated beams overlap at different positions to achieve overlapping multiple positions to produce focused multiple depth-of-field imaging.

More specifically, the driving voltage on at least one different liquid crystal can be changed so that the two collimated light beams overlap at different positions to achieve overlapping multiple positions to generate focused multiple depth-of-field imaging.

More specifically, the pixel refers to a single pixel or a group of pixels including several pixels.

Regarding other technical contents, features and effects of the present invention, it will be clearly presented in the following detailed description of the preferred embodiments with reference to the drawings.

Please refer to FIG. 1, which is a schematic flowchart of a near-eye display method with multiple depth-of-field imaging of the present invention. As can be seen from the figure, the steps are: (1) It can pass one or more pixel pairs on a self-luminous display A collimating element emits a light source to illuminate the incident light passing through the collimating element to achieve collimating effect 101; and (2) and at least one collimating light direction changing element can be arranged on the light beam of the collimating element On the directional path, it is used to change the direction of the collimated light emitted by at least two pixels so as to be able to overlap at different positions to generate focus and change the depth of field 102.

In the above process, the display technology used by the self-luminous display 1 is a display that can emit light autonomously, and the self-luminous display 1 can be a transparent display or a non-transparent display, and the type of the self-emitting display can be organic Light emitting diode (OLED), micro light emitting diode (micro LED), quantum dot (Quantum dot), laser or any other form of active light source.

The collimating elements are mircrolens, Liquid Crystal Spatial Light Modulator (LCSLM) or flat meta-lens. The different types of collimating elements are described as follows : (1) Micro lens (mircrolens): As shown in FIG. 2A, the micro lens 2 is located on the path of the light direction of the light beam emitted from the self-luminous display 1, and when in operation, as shown in FIG. 2B , To enable the light direction of the light beam incident on at least one pixel 11 on the self-luminous display 1 to achieve a collimating effect. (2) Liquid crystal light spatial modulator (LCSLM): As shown in FIG. 3A, the liquid crystal light spatial modulator 3 has several liquid crystals 31, and when at least one pixel 11 on the self-luminous display 1 emits In the case of an incident light beam, as shown in FIG. 3B, the driving voltage on the liquid crystal 31 that contacts the light beam incident on at least one pixel 11 can be further changed, so that the light direction of the light beam incident on the pixel 11 can achieve a collimating effect (The control device used to change the driving voltage on the liquid crystal 31 to change the phase of the liquid crystal is a conventional technology, so no additional explanation is required). (3) Flat meta-lens: As shown in Figure 4A, the flat meta-lens 4 includes a plurality of regions 41 with convex particles, and when in operation, as shown in Figure 4B , The light beam incident on at least one pixel 11 can pass through one of the areas 41 so that the direction of the light can be collimated (and the planar super-lens 4 allows the light to travel in different directions is a conventional technique, so it is not explained). Flat meta-lens (flat meta-lens) refers to the metasurface formed by nano convex particles, which has the functions of refraction and changing the direction of collimated light.

The collimated light direction changing element is a micro lens (mircrolens), a liquid crystal light spatial modulator (LCSLM) or a flat meta-lens (flat meta-lens), where different types of collimating light direction changing elements are described as follows : (1) Micro lens (mircrolens): (a) The structure of the micro lens 2 is the same as that in Figure 2A, which is used to enable at least two collimated beams to overlap to produce the focus of the virtual image; (b ) Two different microlenses 2 are used to overlap the two collimated light beams, and another microlens 2 is used to overlap at different positions to produce focused multiple depth-of-field imaging. (2) Liquid crystal light spatial modulator (LCSLM): (a) The structure of the liquid crystal light spatial modulator 3 is the same as that in FIG. 3A, which has several liquid crystals 31, which are used to adjust the direction of collimated light The principle is to change the driving voltage on the liquid crystal 31 that is in contact with the light beams incident on two of the pixels, so that at least two light beams that achieve the collimation effect change their direction to overlap and produce the focus of the virtual image; (b) Among them, the driving voltage on at least two different liquid crystals 31 can be changed, so that the two collimated light beams overlap at different positions to achieve overlapping multiple positions to produce focused multiple depth of field imaging; (c ) Among them, the driving voltage on one liquid crystal 31 can not be changed, but changing the driving voltage on at least another different liquid crystal 31 can cause the two beams that achieve the collimation effect to overlap at different positions to achieve different Overlapping positions produce focused multiple depth-of-field imaging. (3) Flat meta-lens: (a) The structure of the flat meta-lens 4 is the same as that in Figure 4A, which is used to make at least two beam systems that achieve collimation effect overlap The focus of the virtual image; (b) where two different areas 41 with convex grains are used to cause the two collimated light beams to overlap at different positions, so as to achieve overlapping at different positions to produce multiple focal depths of focus Imaging; (c) One of the same and another different areas 41 with convex particles is used to cause the two collimated light beams to overlap at different positions to achieve overlapping at different positions to produce focus Multiple depth of field imaging.

When multiple depth-of-field imaging is actually to be produced, different collimating elements and different collimating light direction changing elements can be used. The configuration is as follows: (1) The collimating element uses microlenses, and the collimation The light direction changing element can use a micro lens (mircrolens), a liquid crystal light spatial modulator (LCSLM) or a flat meta-lens. (2) The collimating element uses a liquid crystal light spatial modulator (LCSLM), and the collimating light direction changing element can use the same liquid crystal light spatial modulator (LCSLM). (3) The collimating element uses a flat meta-lens, and the collimating light direction changing element can use the same flat meta-lens. (4) The collimating element uses a flat meta-lens, and the collimating light direction changing element can use a micro lens (mircrolens), a liquid crystal light spatial modulator (LCSLM) or a flat meta lens ( flat meta-lens).

As shown in FIG. 5A, the collimating element used is a microlens 2, and the collimating light direction changing element is a liquid crystal light spatial modulator 3, wherein when the microlens 2 is capable of connecting the two on the self-luminous display 1 After the light direction of the light beam incident on each pixel 11 can achieve the collimation effect, the liquid crystal 31 of the liquid crystal light spatial modulator 3 is adjusted to adjust the collimated light direction of the light beam of one or more pixel 11 The image of each pixel 11 can be extended, overlapped and merged into a virtual image 51, and then as shown in FIG. 5B, the phase of the liquid crystal 31 can be adjusted to change the direction of collimated light, which will enable the image of the two pixels 11 to overlap and merge At another location, another virtual image 52 is formed to lengthen the depth of field, so through the above method, the phase of the liquid crystal 31 can be adjusted continuously, so that the human eye 6 can see multiple continuous virtual images to achieve multiple depth of field display Like the purpose.

In addition, a single element can also be used to collimate and adjust the collimated light direction, as described below: (1) The microlens 2 can be directly collimated and the collimated light direction can be directly adjusted, but different microlenses can be preset through the manufacturing process The direction of the collimated light is adjusted differently, so as shown in Figure 6A, after the two different microlenses 2 are collimated, the two collimated beams overlap to produce the focus of the virtual image, but if another one is to be formed The focal point of the virtual image, as shown in FIG. 6B, passes through another microlens 2 and the light beam originally collimated by the microlens 2 overlaps to generate another focal point of the virtual image. (2) It is also possible to use only the liquid crystal light spatial modulator 3 or the planar super lens 4 to collimate and adjust the direction of collimated light at the same time, and the liquid crystal 31 of the liquid crystal light spatial modulator 3 can directly change the liquid crystal 31 The driving voltage is used to adjust the direction of the collimated light to form the focal point of the virtual image at different positions. However, the planar super-lens 4 must pass through a plurality of regions 41 with convex particles to form the focal point of the virtual image at different positions.

The near-eye display method with multiple depth-of-field imaging provided by the present invention has the following advantages when compared with other conventional technologies: 1. The present invention is capable of overlapping beams emitted by two or more pixels Focus is generated at different positions, so that the output image exhibits the effect of multiple depth-of-field visualization, and the above-mentioned pixels refer to a single pixel or a pixel group including several pixels. 2. The liquid crystal light spatial modulator of the present invention can directly adjust the direction of collimated light. Therefore, without moving the pixel position, the beams emitted by the two pixels can be overlapped to produce focusing at different positions. It can save the extra cost of using other optical components.

The present invention has been disclosed as above through the embodiments described above, but it is not intended to limit the present invention. Anyone who is familiar with this technical field and has general knowledge should understand the foregoing technical features and embodiments of the present invention without departing from this. Within the spirit and scope of the invention, some changes and modifications can be made. Therefore, the scope of patent protection of the present invention shall be subject to the definition as defined in the claims attached to this specification.

1‧‧‧Self-luminous display 11‧‧‧Pixel 2‧‧‧ Microlens 3‧‧‧Liquid crystal light space modulator 31‧‧‧Liquid crystal 4‧‧‧ Planar super lens 41‧‧‧ Nanometer lens 51‧‧‧ virtual image 52‧‧‧ virtual image 6‧‧‧ human eyes

[Figure 1] It is a schematic flow chart of the near-eye display method with multiple depth-of-field imaging of the present invention. [Fig. 2A] It is a schematic diagram of a first implementation architecture of a near-eye display method with multiple depth-of-field imaging of the present invention. [Fig. 2B] It is a schematic diagram of the first implementation application of the near-eye display method with multiple depth-of-field imaging of the present invention. [Fig. 3A] It is a schematic diagram of a second implementation architecture of the near-eye display method with multiple depth-of-field imaging of the present invention. [Fig. 3B] It is a schematic diagram of a second implementation application of the near-eye display method with multiple depth-of-field imaging of the present invention. [Figure 4A] It is a schematic diagram of a third implementation architecture of the near-eye display method with multiple depth-of-field imaging of the present invention. [Fig. 4B] It is a schematic diagram of a third implementation application of the near-eye display method with multiple depth-of-field imaging of the present invention. [Fig. 5A] It is a schematic diagram of multiple depth of field of the near-eye display method with multiple depth of field imaging of the present invention. [Fig. 5B] This is a schematic diagram of multiple depth of field of the near-eye display method with multiple depth of field imaging of the present invention. [Fig. 6A] It is another schematic diagram of multiple depth of field implementation of the near-eye display method with multiple depth of field imaging of the present invention. [Fig. 6B] It is another schematic diagram of multiple depth of field implementation of the near-eye display method with multiple depth of field imaging of the present invention.

Claims (20)

A near-eye display method with multiple depth-of-field imaging, the method of which is to emit light from a collimating element through one or more pixels on a self-luminous display to make incident light passing through the collimating element The light can achieve the collimating effect to form collimated light; and at least one collimating light direction changing element can be arranged on the light direction path of the beam of the collimating element to change the collimated light emitted by at least two pixels Direction, so that it can overlap at different positions to produce focus and change the depth of field; where the collimating element is a liquid crystal light spatial modulator (LCSLM), which has liquid crystal and can be adjusted by changing the voltage The liquid crystal is arranged so that the light direction of the incident light of each pixel can be collimated. The near-eye display method with multiple depth-of-field imaging as described in claim 1, wherein the display technology used in the self-luminous display is organic light emitting diode (OLED), micro light emitting diode (micro LED), quantum dot (Quantum dot), laser or any other form of active light source. The near-eye display method with multiple depth-of-field imaging as described in claim 1, wherein the self-luminous display is a transparent display or a non-transparent display. The near-eye display method with multiple depth-of-field imaging as described in claim 1, wherein the collimated light direction changing element is a micro lens (mircrolens), a flat meta-lens (flat meta-lens) or a liquid crystal light spatial modulation (LCSLM). The near-eye display method with multiple depth-of-field imaging as described in claim 4, the microlens is used to enable at least two collimated beam systems to overlap to produce focusing. The near-eye display method with multiple depth-of-field imaging as described in claim 4, wherein the planar super-lens includes a plurality of regions with convex particles to enable at least two collimated beam systems to overlap to produce Focus. The near-eye display method with multiple depth-of-field imaging as described in claim 6, wherein at least two collimated beams are overlapped at different positions through two other areas with different convex grains to achieve different positions Overlapping to produce focused multiple depth-of-field imaging. The near-eye display method with multiple depth-of-field imaging as described in claim 6, wherein at least two collimated beams are overlapped at different positions through one of the same areas and the other with convex areas Achieving overlapping multiple depth-of-field imaging at different positions. The near-eye display method with multiple depth-of-field imaging as described in claim 4, wherein the liquid crystal light spatial modulator has liquid crystal, and the liquid crystal arrangement can be adjusted by changing the voltage to change the direction of the collimated beam to make at least The two collimated beam systems can overlap to produce focus. The near-eye display method with multiple depth-of-field imaging as described in claim 9, wherein the driving voltage on at least two liquid crystals can be changed so that the two collimated beams overlap at different positions to reach different positions Overlapping to produce focused multiple depth-of-field imaging. The near-eye display method with multiple depth-of-field imaging as described in claim 9, wherein the driving voltage on at least one different liquid crystal can be changed so that the two collimated beams overlap at different positions to achieve different Overlapping positions produce focused multiple depth-of-field imaging. The near-eye display method with multiple depth-of-field imaging as described in claim 1, wherein the pixel refers to a single pixel or a pixel group including several pixels. A near-eye display method with multiple depth-of-field imaging, the method of which is to emit light from a collimating element through one or more pixels on a self-luminous display to make incident light passing through the collimating element The light can achieve the collimating effect to form collimated light; and at least one collimating light direction changing element can be arranged on the light direction path of the beam of the collimating element to change the collimated light emitted by at least two pixels Direction, to be able to overlap in different positions Focus and change the depth of field; where the collimating element is a mircrolens, and the collimating light direction changing element is a flat meta-lens or liquid crystal light spatial modulator (LCSLM), Wherein the planar meta-lens includes a plurality of regions with convex particles to enable at least two collimated beam systems to overlap to produce focusing, and the liquid crystal light spatial modulator has liquid crystals, which can be The voltage is adjusted to adjust the arrangement of the liquid crystal to change the direction of the collimated beam, so that at least two beams that achieve the collimating effect can overlap to produce focusing. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the display technology used in the self-luminous display is organic light emitting diode (OLED), micro light emitting diode (micro LED), quantum dot (Quantum dot)), laser or any other form of active light source. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the self-luminous display is a transparent display or a non-transparent display. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the planar super-lens passes through two other areas with different convex particles to overlap at least two collimated beams at different positions , In order to achieve the overlapping of different positions to produce focused multiple depth of field imaging. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the planar meta-lens transmits at least two collimated beams at different positions through one of the same and another areas with convex particles Produce overlap to achieve overlapping of different positions to produce focused multiple depth-of-field imaging. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the liquid crystal light spatial modulator can change the driving voltage on at least two liquid crystals so that the two collimated beams are generated at different positions Overlap to achieve overlapping multiple depth-of-field imaging at different positions. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the liquid crystal light spatial modulator can change the driving voltage on at least one different liquid crystal so that the two collimated beams are in different positions Overlaps are generated to achieve overlapping of different positions to produce focused multiple depth-of-field imaging. The near-eye display method with multiple depth-of-field imaging as described in claim 13, wherein the pixel refers to a single pixel or a pixel group including several pixels.

Images