TWM547127U - Image projection device with pupil-tracking function and pupil position-tracking device thereof - Google Patents

Description

Image projection device with pupil tracking function and pupil position tracking device thereof

The present invention relates to an image projection device and a position tracking device thereof, and more particularly to an image projection device having a pupil tracking function and a pupil position tracking device thereof.

The application of virtual reality and/or augmented virtual reality to a user's head-mounted or wearable image projection system is currently the trend. When a user uses a head-mounted or wearable image projection system (usually glasses), the virtual reality image or video is projected through the projection device to the user's eyes for imagery. At the same time, in order to achieve a better virtual reality experience, a tracking device is added to the projection system to track the position and movement of the user's head and eyes.

In the virtual reality device of the prior art, the user's focus area is analyzed and combined with the image to the next position by detecting the current eye position and predicting the next position of the head and the eye to achieve the effect of gaze tracking. However, the real image perceived by each eye of the user (imaging of the retina) is actually a real or virtual image plane that is focused at a fixed distance (focal length) from the eye. In general, the optic nerve of the human brain will autonomously adjust the eye to focus on the perceived component/object according to the perceived real image, but in the virtual reality device, the focal length adjustment of the eye will be compared with the real image with a fixed distance. The focal length is in conflict. As a result, the brain can not successfully coordinate the visual perception system and the proprioception, which is prone to fatigue and dizziness.

Therefore, the gaze tracking system and the virtual image projection in the prior art virtual reality device still have room for improvement.

The technical problem to be solved by the present invention is to provide an image projection device capable of having a pupil tracking function and a pupil position tracking device capable of promptly feeding back pupil position information, in view of the deficiencies of the prior art.

In order to solve the above technical problem, one of the technical solutions adopted by the present invention is to provide an image projection device with a pupil tracking function, comprising: a light source module, a micro mirror module, an optical module, and a sense a test module and a control module, the control module is electrically connected to the micromirror module and the sensing module, and the light source module, the micromirror module, and the optical module The set and the sensing module are arranged along a predetermined optical path. The first point light source provided by the light source module is reflected by the micro mirror module to form a first surface light source, and the first surface light source is reflected by the optical module to form a heading. A detection light source on the surface of the eye, and the surface of the eyeball has a pupil surface and a non-pupil surface surrounding the pupil surface. The detecting light source is reflected by the surface of the pupil to form a first reflective light source that is directed to the sensing module, and the sensing module transmits a pupil position signal according to the first reflective light source. To the control module. The control module adjusts the micromirror module according to the pupil position signal, and a second point light source provided by the light source module passes through the adjusted reflection of the micromirror module to form a a second surface light source, and the second surface light source is reflected by the optical module to form an image light source that is accurately projected onto the pupil surface.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a pupil position tracking device, which includes: a light source module, a micro mirror module, an optical module, a sensing module, and a control module, the control module is electrically connected to the micro mirror module and the sensing module, and the light source module, the micro mirror module, the optical module, and the The sensing modules are arranged along a predetermined optical path. The point source provided by the light source module passes through the reflection of the micromirror module to form a light source, and the surface light source reflects through the optical module to form a detection light source that is directed to an eye surface. And the surface of the eyeball has a pupil surface and a non-porous surface surrounding the pupil surface. Wherein the detection A light source is reflected by the surface of the pupil to form a first reflective light source that is directed to the sensing module, and the sensing module transmits a pupil position signal to the control module according to the first reflective light source. .

The invention has the beneficial effects that the image projection device with the pupil tracking function and the pupil position tracking device provided by the creative technical solution can pass the micro-mirror through the first point light source provided by the light source module. Reflecting the module to form a first surface light source, the first surface light source is reflected by the optical module to form a detection light source that is directed toward an eye surface, and "the detection light source reflects through the pupil surface The technical feature of forming the first reflective light source directed to the sensing module is such that the sensing module transmits the pupil position signal to the control module according to the first reflective light source, and the control module adjusts according to the pupil position signal. The micromirror module is such that the second point source forms an image source that is accurately directed toward the pupil surface.

In order to further understand the features and technical contents of the present invention, please refer to the following detailed description of the present invention and the accompanying drawings. However, the drawings are provided for reference and description only, and are not intended to limit the creation.

D‧‧‧Image projection device

1‧‧‧Light source module

2‧‧‧Micromirror module

3‧‧‧Optical module

4‧‧‧ eye surface

41‧‧‧ pupil surface

42‧‧‧ Non-porous surface

5‧‧‧Sensing module

6‧‧‧Control module

L‧‧‧Predetermined optical path

L1‧‧‧ first point light source

L11‧‧‧ first surface light source

L12‧‧‧Detecting light source

L2‧‧‧second point light source

L21‧‧‧second surface light source

L22‧‧‧ image source

R1‧‧‧first reflected light source

R2‧‧‧second reflected light source

FIG. 1 is a schematic diagram of an image projection apparatus having a pupil tracking function disposed along a predetermined optical path according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of an image projection optical path of the image projection apparatus with the pupil tracking function according to the embodiment of the present invention.

FIG. 3 is a schematic diagram of a pupil position tracking optical path of an image projection apparatus having a pupil tracking function according to an embodiment of the present invention.

4 is a schematic diagram of another image projection optical path of the image projection device with the pupil tracking function according to the embodiment of the present invention.

The following is a specific embodiment to explain an embodiment of the "image projection device having a pupil tracking function and its pupil position tracking device" disclosed in the present disclosure. Those skilled in the art can understand the creation of the present disclosure from the contents disclosed in the present specification. Advantages and effects. The present invention may be implemented or applied in various other specific embodiments, and various details in the present specification may be made based on different viewpoints and applications, and various modifications and changes may be made without departing from the spirit of the present invention. In addition, the drawings of the present creation are only for the purpose of simple illustration, and are not stated in advance according to the actual size. The following embodiments will further explain the related technical content of the present invention, but the disclosure is not intended to limit the scope of protection of the present invention.

Please refer to FIG. 1 , which is a schematic diagram of the arrangement of an image projection apparatus with a pupil tracking function according to an embodiment of the present invention. The present invention provides an image projection device D having a pupil tracking function, which includes a light source module 1, a micro mirror module 2, an optical module 3, a sensing module 5, and a control module 6. The control module 6 is electrically connected to the micromirror module 2 and the sensing module 5. At the same time, the light source module 1, the micromirror module 2, the optical module 3 and the sensing module 5 are arranged along a predetermined optical path L.

The predetermined optical path L of the present creation is a predictable path that travels by the principle of light incidence and reflection, and thus the arrangement of the predetermined optical paths can be configured in accordance with basic optical principles.

Furthermore, as shown in FIG. 1 , the image projection device D having the pupil tracking function of the present invention has a light source module 1 that can provide at least one light source. At least one light source can be reflected by the micromirror module 2 to form at least one light source. At least one light source is then reflected by the optical module 3 to form a detection light source and/or an image light source.

For example, in the embodiment of the present invention, the light source module 1 of the image projection device D having the pupil tracking function can simultaneously provide the first point source and the second point source, and the first point source and the second point source The wavelength of the light wave is different. In addition, the first point source is used to form the detection source; and the second point source is used to form the image source. Further, the first point source may be a non-visible beam; and the second point source is an image beam capable of forming an image.

The light source module 1 may have two light source projection units respectively providing a first point light source and a second point light source with different wavelengths of light waves. For example, the light source module 1 may include a visible light projection unit and a non-visible light projection unit, which respectively provide non-visible light The first point source of the beam and the second point source of the image beam.

As described above, in the present embodiment, the first point light source provided by the light source module 1 can be reflected by the micro mirror module 2 to form a first surface light source, and the first surface light source can pass through the optical module 3. Reflect to form a detection source. The detection source is directed onto the surface of the eye, and the surface of the eye has a pupil surface and a non-pupil surface surrounding the pupil surface. Because the light source enters the eyeball through the pupil, the intensity of the reflected source reflected through the pupil surface will be less than the intensity of the light source reflected through the non-porous surface.

Then, in the image projection device with the pupil tracking function of the present invention, the sensing module 5 detected by the light source of only a specific wavelength is further included. In the present invention, the sensing module 5 only receives the light of the non-visible wavelength, so the sensing module 5 senses the detecting light source formed by the first surface light source, and is not affected by the image light source formed by the reflection of the second surface light source. . The detection light source is reflected by the surface of the pupil to form a first reflective light source that is directed to the sensing module 5, and the light source is reflected by the non-boring surface to form a second reflective light source that is directed to the sensing module 5. The intensity of the first reflective light source is less than the intensity of the second reflective light source. In this manner, the sensing module 5 can transmit the pupil position signal to the control module 6 according to the first reflective light source.

Furthermore, the control module 6 adjusts the micromirror module 2 according to the pupil position signal, and the second point light source provided by the light source module 1 passes through the reflection of the adjusted micromirror module 2 to form a second surface light source. And the second surface light source is also reflected by the optical module 3 to form an image light source that is accurately projected to the pupil surface.

Hereinafter, the operation of each component of the image projecting device D having the pupil tracking function of the present creation will be sequentially described in detail according to the actual operation mode to achieve the function of pupil tracking.

Please refer to FIG. 1 and FIG. 2 , which are schematic diagrams showing an optical projection optical path of an image projection device D having a pupil tracking function. As shown in FIG. 2 , the present embodiment provides an image projection device D having a pupil tracking function, which includes a light source module 1 , a micro mirror module 2 , an optical module 3 , a sensing module 5 , and a control module 6 . . The control module 6 is electrically connected to the micromirror module 2 and the sensing module 5 . Also, as mentioned before, light The source module 1, the micromirror module 2, the optical module 3, and the sensing module 5 are arranged along a predetermined optical path L. In the mode of image projection (Fig. 2), the light source module 1 provides a second point source L2 according to a predetermined optical path. The light source module 1 can provide the second point light source L2 through the visible light projection unit.

First, the light source module 1 provides the second point light source L2 to the micro mirror module 2, and is reflected by the micro mirror module 2 to form a second surface light source L21. The second surface light source L21 is reflected by the optical module 3 to form an image light source L22.

In detail, the second point light source L2 is a visible light beam that can transmit an image. In other words, the second point source L2 is an image beam that can form an image. In the present embodiment, the second point light source L2 may be an RGB laser light emitting module including a red laser light source, a blue laser light source, and a green laser light source (indicated here by RGB). The light source module 1 instantaneously projects the RGB laser light source on each micromirror unit (which may be a microlens) of the micromirror module 2 in a short time. Then, the RGB laser light source is reflected by the micromirror module 2 to form a frame of the second surface light source L21, which is projected to the optical module 3. The second surface light source L21 is further reflected by the optical module 3 to form an image light source L22.

It is worth mentioning that, in addition to the aforementioned single RGB laser light source, the second point light source L2 of the present invention may also be an RGGB laser light source. That is, the second point source L2 may be a red laser source, two green laser sources, and a blue laser source. Similarly, the second point source L2 can also be an RRGGB laser source having two red laser sources, two green laser sources, and a blue laser source.

It should be noted that the optical module 3 can be, for example but not limited to, a concave mirror, a plane mirror, and a convex lens. In the present embodiment, the optical module 3 is a concave mirror, but the present creation is not limited thereto. In addition, the optical module 3 can be fixed or adjustable. In the present embodiment, the optical module 3 is of a fixed type.

As described above, as shown in FIG. 2, the image light source L22 is reflected by the optical module 3 and accurately projected to the pupil surface 41 of the user's eyeball surface 4. According to this embodiment, the second surface light source L21 reflected by the micromirror module 2 passes through an optical mode which is a concave mirror. After the reflection of the group 3, an image light source L22 is formed. After the image light source L22 passes through the pupil surface 41, it is focused on the eyeball of the user, and finally images are imaged on the retina. Therefore, the second point light source L2 emitted from the light source module 1 can finally form the image light source L22 imaged in the user's eyeball.

Next, please refer to FIG. 1 and FIG. 3 , which are schematic diagrams of the pupil position tracking optical path of the image projection device D having the pupil tracking function. As shown in FIG. 3, the image projection device D having the pupil tracking function of the present embodiment includes a light source module 1, a micromirror module 2, an optical module 3, and a sensing module 5 arranged along a predetermined optical path L. And a control module 6. According to FIG. 3, the light source module 1 provides a first point light source L1 according to a predetermined optical path, and at this time, the image projecting device D having a pupil tracking function has a mode in which the pupil position is tracked by the optical path.

Similar to the image projection mode, first, the light source module 1 provides the first point light source L1 to the micro mirror module 2 through the non-visible light projection unit, and is reflected by the micro mirror module 2 to form the first surface light source L11, the first surface The light source L11 is reflected by the optical module 3 to form a detecting light source L12 that is directed toward the pupil surface.

In detail, the first point light source L1 is a non-visible light beam. For example, the first point light source L1 of the present embodiment may be infrared light having a wavelength of light between 760 nm and 1000 nm.

As described above, the first point source L1 can be emitted as a single beam, or a plurality of beams can be formed to form a range of emission. In the present embodiment, the first point source L1 is emitted as a single beam. The light source module 1 provides infrared light to be instantaneously projected on each micromirror unit (which may be a microlens) of the micromirror module 2 in a short time. Then, the infrared light is reflected by the micromirror module 2 to form a frame of the first surface light source L11, which is projected to the optical module 3. The first surface light source L11 is further reflected by the optical module 3 to form a detection light source L12 having a projection range.

Again, in the present embodiment, the optical module 3 is a fixed concave mirror, but the present creation is not limited thereto.

As described above, as shown in FIG. 3, the first surface light source L11 is reflected by the optical module 3. And it is directed to the user's eye surface 4. It is worth mentioning that, according to the presently-created embodiment, the eyeball surface 4 has a pupil surface 41 and a non-porate surface 42 surrounding the pupil surface 41. The coverage area of the detection light source L12 that is directed to the surface 4 of the eye includes the range of the pupil surface 41 and the non-pupil surface 42. Specifically, the area of the detection light source L12 that is directed to the surface 4 of the eyeball may be greater than or equal to the area of the surface 4 of the eyeball. In the present embodiment, the area of the detection light source L12 is equal to the area of the eyeball surface 4.

As described above, the detection light source L12 forms the first reflection light source R1 through the reflection of the pupil surface 41; the detection light source L12 forms the second reflection light source R2 through the reflection of the non-pupil surface 42. The first reflective light source R1 can be detected by the sensing module 5, and the sensing module 5 can transmit the pupil position signal to the control module 6 according to the first reflective light source R1. The light transmission of the pupil surface 41 is greater than the light transmission of the non-pupil surface 42. The detecting light source L12 that is directed toward the pupil surface 41 partially enters the eyeball through the pupil, so that the intensity of the first reflected light source R1 is smaller than the intensity of the totally reflected second reflected light source R2. In this way, the sensing module 5 can determine the position of the pupil and obtain a pupil position signal, and transmit the pupil position signal to the control module 6.

As can be seen from Fig. 3, the rotation of the eyeball causes the pupil position to shift from the vertical center to the right side, and the pupil surface 41 is still within the area of the detection light source L12. Therefore, part of the infrared light beam in the detecting light source L12 reflects the first reflecting light source R1 of less intensity through the offset pupil surface 41, while the intensity of the second reflecting light source R2 reflected from the non-boring surface 42 remains unchanged. . Further, the sensing module 5 can determine the pupil position by the intensity of the first reflective light source R1 and the second reflective light source R2 reflected to the sensing module. In this way, when the user's eyeball rotates, the sensing module 5 can instantly track the position of the eyeball pupil of the user, and immediately output the pupil position signal of the pupil.

Next, please refer to FIG. 4 , which is a schematic diagram of another image projection optical path of the image projection device D having the pupil tracking function. In detail, as described above, the sensing module 5 outputs the pupil position signal of the pupil to the control module 6, and the control module 6 adjusts the micromirror module 2 according to the pupil position signal. According to FIG. 4, the control module 6 adjusts the micromirror module 2 according to the pupil position signal, so that the second point light source L2 provided by the light source module 1 is The adjusted micromirror module 2 reflects the second surface light source L21 after the adjustment, and the adjusted second surface light source L21 forms the adjusted image light source L22 by the reflection of the optical module 3. The adjusted image light source L22 is accurately projected onto the (offset) pupil surface to re-image in the user's eyeball. Specifically, the micromirror module 2 can include a plurality of microlenses, and the control module 6 can adjust the reflection angle of each microlens through the pupil position signal. In this way, the predetermined optical path can be changed, so that the image light source L22 formed by the second point light source L2 sequentially passing through the reflection of the micromirror module 2 and the optical module 3 can be accurately and immediately projected to the pupil surface.

It should be noted that the detecting light source L12 reflects the first reflecting light source R1 and the second reflecting light source R2 of different intensities through the surface of the eyeball to cause the sensing module 5 to determine the operation of the pupil position, and the control module 6 adjusts the micro mirror mode. The operation of the group 2 to accurately project the image light source L22 toward the pupil surface occurs almost simultaneously. In this way, the image projection device D having the pupil tracking function simultaneously provides the first point light source L1 and the second point light source L2. The first point source L1 forms the detecting light source L12 and reflects the reflected light source of different intensity through the eyeball surface 4, and senses The module 5 determines the pupil position by the reflected light source and transmits the pupil position signal to the control module 6. At the same time, the control module 6 instantly adjusts the micromirror module 2 to change the optical path of the second point source L2 to accurately image in the user's eye. In this way, the creation of the image projection device with the pupil tracking function can be finally achieved.

[Advantageous Effects of Embodiments]

The beneficial effect of the present invention is that the image projection device with the pupil tracking function provided by the creative technical solution and the pupil position tracking device thereof can pass the micro-mirror module through the first point light source L1 provided by the light source module 1. The reflection of 2 forms a first surface light source L11, the first surface light source L11 is reflected by the optical module 3 to form a detection light source L12" that is directed toward the eyeball surface 4, and "detects the reflection of the light source L12 through the pupil surface 41 to form a projection. The technical characteristics of the first reflective light source R1" of the sensing module 5 are such that the sensing module 5 transmits the pupil position signal according to the first reflective light source R1 to The control module 6 is controlled, and the control module 6 adjusts the micromirror module 2 according to the pupil position signal, so that the second point light source L2 forms an image light source L22 that is accurately projected to the pupil surface 41.

The above disclosure is only a preferred and feasible embodiment of the present invention, and is not intended to limit the scope of the patent application of the present invention. Therefore, any equivalent technical changes made by using the present specification and the contents of the drawings are included in the application for this creation. Within the scope of the patent.

D‧‧‧Image projection device

1‧‧‧Light source module

2‧‧‧Micromirror module

3‧‧‧Optical module

4‧‧‧ eye surface

41‧‧‧ pupil surface

42‧‧‧ Non-porous surface

5‧‧‧Sensing module

6‧‧‧Control module

L1‧‧‧ first point light source

L11‧‧‧ first surface light source

L12‧‧‧Detecting light source

R1‧‧‧first reflected light source

R2‧‧‧second reflected light source

Claims (10)

An image projection device with a pupil tracking function, comprising: a light source module, a micro mirror module, an optical module, a sensing module and a control module, wherein the control module is electrically connected to the a micromirror module and the sensing module, wherein the light source module, the micromirror module, the optical module, and the sensing module are arranged along a predetermined optical path; a first point light source provided by the light source module is reflected by the micro mirror module to form a first surface light source, and the first surface light source is reflected by the optical module to form a surface of an eyeball Detecting a light source, and the surface of the eyeball has a pupil surface and a non-porous surface surrounding the pupil surface; wherein the detecting light source reflects through the pupil surface to form a projection toward the sensing module a first reflective light source, and the sensing module transmits a pupil position signal to the control module according to the first reflective light source; wherein the control module adjusts the sound according to the pupil position signal Micromirror module, the light a second point light source provided by the module passes through the adjusted reflection of the micro mirror module to form a second surface light source, and the second surface light source is reflected by the optical module to form an accurate An image source that is directed toward the surface of the pupil. The image projection device with the pupil tracking function of claim 1, wherein the first point source is an invisible light beam, and the second point source is an image beam. The image projection device with a pupil tracking function according to claim 1, wherein an area of the detection light source that is directed to the surface of the eyeball is greater than or equal to an area of the surface of the eyeball. The image projection device with a pupil tracking function according to claim 1, wherein the micromirror module comprises a plurality of microlenses, and the control module passes through the pupil a position signal to adjust a reflection angle of each of the microlenses. The image projection device with the pupil tracking function of claim 1, wherein the detecting light source reflects through the non-boring surface to form a second reflective light source that is directed to the sensing module, and The light transmittance of the pupil surface is greater than the light transmittance of the non-porous surface such that the intensity of the first reflective light source is less than the intensity of the second reflective light source. A pupil position tracking device includes: a light source module, a micro mirror module, an optical module, a sensing module, and a control module, wherein the control module is electrically connected to the micro mirror module And the sensing module, wherein the light source module, the micromirror module, the optical module, and the sensing module are arranged along a predetermined optical path; wherein the light source module Providing a point of light source through the reflection of the micromirror module to form a light source, the surface light source is reflected by the optical module to form a detection light source that is directed to an eye surface, and the surface of the eyeball has a a pupil surface and a non-porous surface surrounding the pupil surface; wherein the detecting light source reflects through the pupil surface to form a first reflective light source directed to the sensing module, and the sensing mode The group transmits a pupil position signal to the control module according to the first reflective light source. The pupil position tracking device of claim 6, wherein the point source is an invisible light beam. The pupil position tracking device of claim 6, wherein an area of the detection light source directed to the surface of the eyeball is greater than or equal to an area of the surface of the eyeball. The pupil position tracking device of claim 6, wherein the micromirror module comprises a plurality of microlenses, and the control module passes the pupil position signal to adjust a reflection of each of the microlenses angle. The pupil position tracking device of claim 6, wherein the detecting light source reflects through the non-boring surface to form a second reflective light source directed to the sensing module, and the surface of the pupil is transparent Light is greater than the surface of the non-porous surface The light is such that the intensity of the first reflective light source is less than the intensity of the second reflective light source.