CN110933390A - Display method and device based on image projection - Google Patents
Display method and device based on image projection Download PDFInfo
- Publication number
- CN110933390A CN110933390A CN201911295394.7A CN201911295394A CN110933390A CN 110933390 A CN110933390 A CN 110933390A CN 201911295394 A CN201911295394 A CN 201911295394A CN 110933390 A CN110933390 A CN 110933390A
- Authority
- CN
- China
- Prior art keywords
- pupil
- image
- display
- area
- opening area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
Abstract
The application provides a display method and device based on image projection. The method comprises the following steps: detecting the opening area of the pupil: detecting the opening area of the pupil; and (3) display work control: and the processor controls the size of a working area of the display module according to the detected pupil area so as to display an application image, and projects the application image into the pupil, so that the area of the application image is matched with the pupil opening area. Through the aperture area of the pupil in the detection eyeball, the processor controls the size of the working area of the display module according to the aperture area of the pupil to display the application image corresponding to the aperture area, the AR display experience is improved, and when the application image is displayed in a reduced mode, the display module can only work in partial areas or work in partial light sources in the display module, so that the energy consumption is reduced, and the cruising time is prolonged.
Description
Technical Field
The present application belongs to the field of augmented reality technologies, and in particular, to a display method and device based on image projection.
Background
AR (English: Augmented Reality), Augmented Reality technology is a technology that ingeniously fuses virtual information and the real world, and virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer is applied to the real world after being simulated, and the two kinds of information complement each other, so that the real world is enhanced. After current AR equipment starts, the display module is generally with each application image direct projection to eyes to wait for manual operation to select to show different content, because AR equipment generally is battery powered, and volume weight is limited, and the time of endurance is short, influences user experience.
Disclosure of Invention
An object of the embodiments of the present application is to provide a display method based on image projection, so as to solve the problems of high power consumption and short endurance time of an AR device in the related art.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions: a display method based on image projection is provided, which comprises the following steps:
detecting the opening area of the pupil: detecting the opening area of the pupil;
and (3) display work control: and the processor controls the size of a working area of the display module according to the detected pupil area so as to display an application image, and projects the application image into the pupil, so that the area of the application image is matched with the pupil opening area.
In one embodiment, the display operation controlling step further comprises, before the step of displaying the operation image, the steps of:
presetting an image pupil relation: and setting the proportional relation between the application image area displayed by the display module and the pupil opening area, and increasing the application image area along with the increase of the pupil opening area.
In one embodiment, the step of presetting the image pupil relation further comprises the steps of:
detecting the pupil area: and detecting the opening area of the pupil, and acquiring the maximum opening area and the minimum opening area of the pupil.
In one embodiment, the preset image pupil relation step further comprises: and corresponding the maximum area of the application image to the maximum opening area of the pupil, and corresponding the minimum area of the application image to the minimum opening area of the pupil.
In one embodiment, the display module includes a plurality of display screens, and the processor controls one or more of the plurality of display screens to cooperate in displaying the application image.
Another object of an embodiment of the present application is to provide an image projection-based display device, including:
a head-mounted body;
the display module is used for displaying an application image and projecting the application image to the pupils of human eyes;
the eyeball identification module is used for detecting the opening area of the pupil; and the number of the first and second groups,
the processor is used for controlling the size of the working area of the display module according to the detected pupil area so as to control the area of the displayed application image;
the display module, the eyeball identification module and the processor are arranged on the head-mounted body; the display module and the eyeball identification module are respectively electrically connected with the processor.
In one embodiment, the eye recognition module comprises at least one light sensor for acquiring an eye image.
In one embodiment, the eyeball identification module further comprises at least one directional light source for emitting detection light to the eyeball.
In one embodiment, the detection light is infrared light.
In one embodiment, the eye image is a gray scale image.
In one embodiment, the display module includes at least one display screen for displaying the application image.
In one embodiment, the display module further includes a light guide structure for guiding the light emitted from each of the display screens to the pupil of the human eye.
In one embodiment, the headgear includes a lens and a frame, the display module, the eye recognition module, and the processor being mounted on the frame.
One or more technical solutions in the embodiments of the present application have at least one of the following technical effects:
according to the display method based on image projection, provided by the embodiment of the application, the processor controls the size of the working area of the display module according to the opening area of the pupil by detecting the opening area of the pupil in the eyeball so as to display the application image with the corresponding area, AR display experience is improved, and when the application image is displayed in a reduced mode, the display module can only work in partial area or work in partial light source in the display module so as to reduce energy consumption and improve endurance time.
The display device based on image projection that this application embodiment provided sets up eyeball identification module and treater, surveys pupil opening area through eyeball identification module, and then the treater controls display module workspace size according to pupil opening area to control and show the application image size, promote AR and show and experience, and need not the whole work always of display module, reduce the energy consumption, improve the time of endurance, promote user experience.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or exemplary technical descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of a display method based on image projection according to an embodiment of the present disclosure;
fig. 2 is a block diagram of a display device based on image projection according to an embodiment of the present application.
Fig. 3 is a schematic flowchart of a display method based on image projection according to a second embodiment of the present application.
Fig. 4 is a schematic flowchart of a display method based on image projection according to a third embodiment of the present application.
FIG. 5 is a schematic diagram of a small pupil opening area in an eye;
FIG. 6 is a schematic view of an application image displayed by the display module during the pupil opening area in FIG. 5;
FIG. 7 is a diagram illustrating a pupil with a large opening area in an eye;
fig. 8 is a schematic view of an application image displayed by the display module when the pupil opening area is large in fig. 7.
Fig. 9 is a schematic structural diagram of a display device based on image projection according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a display device based on image projection according to a second embodiment of the present application.
Fig. 11 is a schematic structural diagram of a display device based on image projection according to a third embodiment of the present application.
Fig. 12 is a schematic structural diagram of a display device based on image projection according to a fourth embodiment of the present application.
Fig. 13 is a schematic structural diagram of a display device based on image projection according to a fifth embodiment of the present application.
Wherein, in the drawings, the reference numerals are mainly as follows:
100-a display device based on image projection; 11-a processor; 12-an eyeball identification module; 121-a light sensor; 122-a directional light source; 13-a display module; 131-a display screen; 132-a light guiding structure;
20-a headgear; 21-a lens; 22-a frame; 221-a mirror frame;
30-visual range; 31-application of images;
50-eye; 51-eyeball; 52-pupil.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the present application clearer, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It should be noted that the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
In the description of the present application, it is to be understood that the terms "center", "front", "left", "right", etc., indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present application.
In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted" and "connected" are to be interpreted broadly, e.g., as being either fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Referring to fig. 1, fig. 2 and fig. 6, a description will now be given of a display method based on image projection provided in the present application. The display method based on image projection comprises the following steps:
pupil opening area detection S2: detecting the opening area of pupil 52;
display operation control S3: the processor 11 controls the size of the working area of the display module 13 according to the detected opening area of the pupil 52 to display the application image 31, and projects the application image 31 into the pupil 52 to match the area of the application image 31 with the opening area of the pupil 52.
In the step of detecting the pupil opening area S2, the change in the pupil opening area 52 can be determined from the detected pupil opening area 52. Since the eye 50 looks at something, the pupil 52 naturally enlarges to look through it if the thing is of interest. Therefore, whether the user needs to check the corresponding application image 31 can be determined by detecting the opening area of the pupil 52, so that the processor 11 can control the display module 13 to display the application image 31 with the corresponding size according to the determination, and the user AR experience is improved.
In the step of S3, the opening area of the pupil 52 is detected, and it can be determined whether the eye 50 is watching the corresponding application image 31, if the eye 50 is watching the corresponding application image 31, the opening area of the pupil 52 is increased, and the processor 11 controls the display module 13 to display the larger application image 31, so that the application image 31 occupies a larger area of the visual range 30 of the eye 50, so as to facilitate watching. When the eye 50 does not watch the corresponding application image 31, the opening area of the pupil 52 is reduced, so that the application image 31 occupies a smaller area of the visual range 30 of the eye 50, and the influence on the user in watching other scenes or environments is avoided, and the corresponding display module 13 can only work in a partial area or work in a partial light source of the display module 13, so as to reduce energy consumption and improve endurance time.
Referring to fig. 7 and 8, when the user views a certain application image 31a, the opening area of the pupil 52 is increased, and accordingly, the eyeball identification module 12 detects that the opening area of the pupil 52 is larger, and the processor 11 controls the working area of the display module 13 to be larger, so as to display the larger application image 31a, so that the application image 31a occupies a larger area of the visual range 30 of the eye 50, so as to facilitate viewing. Referring to fig. 5 and fig. 6, when the user does not view a certain application image 31 any more, the opening area of the pupil 52 becomes smaller, and accordingly, it is detected that the opening area of the pupil 52 is smaller, and the processor 11 controls the working area of the display module 13 to become smaller to display the smaller application image 31, so that the application image 31 occupies a smaller area of the visual range 30 of the eye 50, and the use of the user's eye is not affected.
According to the display method based on image projection, the opening area of the pupil 52 in the eyeball 51 is detected, the processor 11 controls the size of the working area of the display module 13 according to the opening area of the pupil 52 to display the application image 31 with the corresponding area, AR display experience is improved, and when the application image 31 is displayed in a reduced mode, the display module 13 can only work in partial area or part of light sources in the display module 13 to reduce energy consumption and improve endurance time.
In one embodiment, the application image 31 displayed by the display module 13 is projected to a partial area of the visual range 30 of the eyeball 51, that is, the display module 13 only occupies the partial area in the visual range when viewed by human eyes, and does not cover the whole visual range 30, so that when the display module 13 works, the human eyes can see the external environment to realize augmented reality.
In one embodiment, referring to fig. 9, the display module 13 includes a display screen 131, and different areas of the display screen 131 work to display application images 31 with different sizes.
In one embodiment, referring to fig. 11, the display module 13 includes a plurality of display screens 131, and the processor 11 can control the plurality of display screens 131 to cooperatively display the larger application image 31. The processor 11 may also control one or more of the display screens 131 to operate to change the size of the application image 31.
In one embodiment, the display screen 131 may be a micro-OLED screen, an OLED (Organic Light-Emitting Diode), also called an Organic electroluminescent display, an Organic Light-Emitting semiconductor. Thereby, different LED lighting devices in the micro-OLED screen can be controlled to operate to display different images and to project images to different areas of the eye 50.
In one embodiment, the display screen 131 may be a micro-LED screen, an LED (Light-Emitting Diode). Thereby, different LED lighting devices in the micro-LED screen can be controlled to operate to display different images and to project images to different areas of the eye 50.
In one embodiment, the display 131 may be a liquid crystal display, such as a transmissive liquid crystal display or a reflective liquid crystal display. In one embodiment, the display screen 131 may be a Digital Light Processing (DLP) or Laser Beam Scanner (LBS) based on micro-electromechanical systems (MEMS) technology, or the like.
In one embodiment, the display screen 131 may be supported directly in front of the eye 50, such that the light emitted from the display screen 131 is projected directly into the pupil 52 of the human eye to realize the display.
In one embodiment, referring to fig. 2, the display module 13 further includes a light guiding structure 132, and the light guiding structure 132 is used for guiding the light emitted from each display screen 131 to the pupil 52 of the human eye, so that the display screens 131 do not need to be supported in front of the eyes 50, and the display screens 131 can be more conveniently arranged.
In one embodiment, the light guiding structure 132 may be a "Birdbath," curved mirror (also known as "moth-eye"), light guide, prism, or the like.
In one embodiment, referring to fig. 3, the step of displaying operation control S3 further includes a step of presetting an image pupil relationship S1, the presetting an image pupil relationship S1: the proportional relation between the area of the application image 31 displayed by the display module 13 and the opening area of the pupil 52 is set, and the area of the application image 31 is increased along with the increase of the opening area of the pupil 52. Through the step of presetting the image pupil relation S1, when the opening area of the pupil 52 changes, the display area of the application image 31 can be more conveniently controlled, and the response speed is improved.
In one embodiment, the proportional relationship between the area of the application image 31 and the opening area of the pupil 52 may be a linear relationship, a nonlinear relationship, or a relationship set according to the needs of the user.
In an embodiment, referring to fig. 4, the step of presetting the image pupil relation S1 further includes a step of detecting pupil area S0, the step of detecting pupil area S0: the opening area of the pupil 52 is detected, and the maximum opening area and the minimum opening area of the pupil 52 are obtained. By detecting the opening area of the pupil 52, the maximum opening area and the minimum opening area of the pupil 52 of each user can be determined according to different users, so that the application image 31 with the corresponding area is displayed according to different users, and the user AR experience is improved.
In one embodiment, referring to fig. 4, the step of S1 further includes: and corresponding the maximum area of the application image 31 to the maximum opening area setting of the pupil 52, and corresponding the minimum area of the application image 31 to the minimum opening area setting of the pupil 52. Through this step, the application image 31 can be better matched with the sizes of the eyeballs 51 and the pupils 52 of the user according to different users, so that the processor 11 can conveniently control the display module 13 to display the application image 31 with the corresponding area.
In one embodiment, referring to fig. 10, the eye recognition module 12 may be used to detect the opening area of the pupil 52. The eyeball identification module 12 includes a light sensor 121, and the light sensor 121 is used for acquiring an eyeball image, so that the opening area of the pupil 52 can be determined according to the eyeball image. In some embodiments, a camera module or an image sensor may also be used as the eyeball identification module 12, for example, an eyeball image is obtained through the camera module or the image sensor, and the pupil 52 image is obtained according to the difference between the color of the pupil 52 and other areas of the eyeball, so as to determine the size of the pupil 52.
In one embodiment, when the image projection-based display method is used on a contact lens attachable to the eye 50, the eyeball identification module 12 may be a plurality of light sensors 121 fabricated on the contact lens, and the opening area of the pupil 52 in the eyeball 51 is sensed by the plurality of light sensors 121 to determine the opening area of the pupil 52.
In an embodiment, referring to fig. 10, the eyeball identification module 12 further includes a directional light source 122, the directional light source 122 emits a detection light to the eyeball 51, and the light sensor 121 receives the detection light reflected by the eyeball 51 to obtain an eyeball image. The directional light source 122 is arranged, so that the eyeball 51 can reflect more light rays, the light ray sensor 121 can receive more light rays, the obtained eyeball image is clearer, and the pupil opening area can be measured more accurately.
In one embodiment, referring to fig. 9, the eye recognition module 12 may only include one directional light source 122, so as to facilitate the manufacture of the display device based on image projection and reduce the cost.
In one embodiment, referring to fig. 10, the eye recognition module 12 may include a plurality of directional light sources 122 to provide more light, so that the light sensor 121 receives more light, and the obtained eye image is clearer, so as to more accurately measure the pupil opening area.
In an embodiment, referring to fig. 10, the plurality of directional light sources 122 are disposed around the eyeball 51, so that the distance between the light reflected by the eyeball 51 to each direction is similar, and the light emitted from the plurality of directional light sources 122 to the eyeball 51 can be more uniform, so that the light sensor 121 can obtain a more accurate eyeball image, thereby improving the detection effect.
In an embodiment, referring to fig. 9, the eyeball image is a gray scale image, so that when analyzing the opening area of the pupil 52, the gray scale information of the eyeball image can be analyzed, the pupil 52 is darker in color, the black pixels are concentrated in one region, and the brightness of the edge portion of the pupil 52 is higher than that of the pupil 52, so as to determine the opening area of the pupil 52. The opening area of the pupil 52 of the eyeball 51 is identified by using the gray scale map, so that the judgment is more convenient, and the efficiency and the accuracy are high. Of course, in some embodiments, the eyeball image is a color image, and the opening area of the pupil 52 is determined by identifying the color of each part of the image.
In one embodiment, referring to fig. 9, the light emitted from the directional light source 122 is infrared light, so as to avoid affecting the image viewing of the human eye, and the light sensor 121 receives the detection light reflected by the eyeball 51.
In an embodiment, referring to fig. 9, when the eye recognition module 12 detects the opening area of the pupil 52, it may fit the edge of the pupil 52 by using an elliptical equation according to the eye image to obtain the shape of the pupil 52, and calculate the opening area of the pupil 52. By fitting with an elliptic equation, the shape of the pupil 52 can be accurately obtained, and the opening area of the pupil 52 can be further calculated.
The display method based on image projection can be applied to head-mounted display devices such as helmets, glasses and the like; but also to contact lenses and the like.
Referring to fig. 9, an embodiment of the present application further discloses a display device 100 based on image projection. Referring to fig. 2, the image projection-based display device 100 includes a head-mounted body 20, a display module 13, an eyeball identification module 12, and a processor 11. The display module 13, the eyeball identification module 12 and the processor 11 are mounted on the head-wearing body 20, the display module 13, the eyeball identification module 12 and the processor 11 are supported by the head-wearing body 20, and the display module 13 and the eyeball identification module 12 are electrically connected with the processor 11. In this embodiment, the head-wearing body 20 is glasses, and in other embodiments, the head-wearing body 20 may be a helmet with a lens, or the like. The display module 13 is used for displaying, the display module 13 may display the application image 31, and the display module 13 may project the displayed light into the pupil 52 of the human eye so that the human eye can see the corresponding image. The eyeball identification module 12 is configured to detect an opening area of the pupil 52, and further determine that the eye 50 views a certain application image 31 according to the opening area of the pupil 52. The processor 11 controls the size of the working area of the display module 13 according to the detected opening area of the pupil 52, so as to display the application image 31 with the corresponding area size.
Referring to fig. 7 and 8, when the user views a certain application image 31a, the opening area of the pupil 52 is increased, and accordingly, the eyeball identification module 12 detects that the opening area of the pupil 52 is larger, and the processor 11 controls the larger area of the display module 13 to work to display the larger application image 31a, so that the application image 31a occupies the larger area of the visual range 30 of the eye 50 for viewing conveniently. Referring to fig. 5 and fig. 6, when the user does not view a certain application image 31 any more, the opening area of the pupil 52 becomes smaller, and accordingly, the eyeball identification module 12 detects that the opening area of the pupil 52 is smaller, and the processor 11 controls the working area of the display module 13 to become smaller to display the smaller application image 31, so that the application image 31 occupies a smaller area of the visual range 30 of the eye 50, and the use of the user's eye is not affected.
The image projection-based display device 100 provided by the embodiment of the application comprises an eyeball identification module 12 and a processor 11, the opening area of a pupil 52 is detected through the eyeball identification module 12, the processor 11 controls the size of the working area of a display module 13 according to the opening area of the pupil 52 to control and display the size of an application image 31, AR display experience is improved, the display module 13 does not need to work all the time, energy consumption is reduced, endurance time is prolonged, and user experience is improved.
In one embodiment, the application image 31 displayed by the display module 13 is projected to a partial area of the visual range 30 of the eyeball 51, that is, the display module 13 only occupies the partial area in the visual range when viewed by human eyes, and does not cover the whole visual range 30, so that when the display module 13 works, the human eyes can see the external environment to realize augmented reality.
In one embodiment, referring to fig. 9, the display module 13 includes a display screen 131, and different areas of the display screen 131 work to display application images 31 with different sizes.
In one embodiment, referring to fig. 11, the display module 13 includes a plurality of display screens 131, and the processor 11 can control the plurality of display screens 131 to cooperatively display the larger application image 31. The processor 11 may also control one or more of the display screens 131 to operate to change the size of the application image 31.
In one embodiment, the display screen 131 may be a micro-OLED screen, an OLED (Organic Light-Emitting Diode), also called an Organic electroluminescent display, an Organic Light-Emitting semiconductor. Thereby, different LED lighting devices in the micro-OLED screen can be controlled to operate to display different images and to project images to different areas of the eye 50. In some embodiments, the display screen 131 may be a micro-LED screen, an LED (Light-Emitting Diode). Thereby, different LED lighting devices in the micro-LED screen can be controlled to operate to display different images and to project images to different areas of the eye 50. In some embodiments, the display 131 may be a liquid crystal display, such as a transmissive liquid crystal display or a reflective liquid crystal display. In one embodiment, the display screen 131 may be a Digital Light Processing (DLP) or Laser Beam Scanner (LBS) based on micro-electromechanical systems (MEMS) technology, or the like.
In one embodiment, the display screen 131 may be supported directly in front of the eye 50, such that the light emitted from the display screen 131 is projected directly into the pupil 52 of the human eye to realize the display.
In one embodiment, referring to fig. 2, the display module 13 further includes a light guiding structure 132, and the light guiding structure 132 is used for guiding the light emitted from each display screen 131 to the pupil 52 of the human eye, so that the display screen 131 does not need to be supported in front of the eye 50, and the display screen 131 can be more conveniently arranged.
In one embodiment, the light guiding structure 132 may be a "Birdbath," curved mirror (also known as "moth-eye"), light guide, prism, or the like.
In one embodiment, referring to fig. 10, the eye recognition module 12 includes a light sensor 121, and the light sensor 121 is used for acquiring an eye image, so as to determine the opening area of the pupil 52 according to the eye image. In some embodiments, a camera module or an image sensor may also be used as the eyeball identification module 12, for example, an eyeball image is obtained through the camera module or the image sensor, and the pupil 52 image is obtained according to the difference between the color of the pupil 52 and other areas of the eyeball, so as to determine the size of the pupil 52.
In an embodiment, referring to fig. 10, the eyeball identification module 12 further includes a directional light source 122, the directional light source 122 emits a detection light to the eyeball 51, and the light sensor 121 receives the detection light reflected by the eyeball 51 to obtain an eyeball image. The directional light source 122 is arranged, so that the eyeball 51 can reflect more light rays, the light ray sensor 121 can receive more light rays, the obtained eyeball image is clearer, and the pupil opening area can be measured more accurately.
In one embodiment, referring to fig. 9, the eye recognition module 12 may only include one directional light source 122, so as to facilitate the manufacture of the display device 100 based on image projection and reduce the cost.
In one embodiment, referring to fig. 10, the eye recognition module 12 may include a plurality of directional light sources 122 to provide more light, so that the light sensor 121 receives more light, and the obtained eye image is clearer, so as to more accurately measure the pupil opening area.
In an embodiment, referring to fig. 10, the plurality of directional light sources 122 are disposed around the eyeball 51, so that the distance between the light reflected by the eyeball 51 to each direction is similar, and the light emitted from the plurality of directional light sources 122 to the eyeball 51 can be more uniform, so that the light sensor 121 can obtain a more accurate eyeball image, thereby improving the detection effect.
In one embodiment, referring to fig. 9, the light emitted from the directional light source 122 is infrared light, so as to avoid affecting the image viewing of the human eye, and the light sensor 121 receives the detection light reflected by the eyeball 51.
In one embodiment, referring to fig. 12, the display module 13 includes a plurality of display screens 131 and a plurality of directional light sources 122.
In one embodiment, referring to fig. 9, the head-mounted body 20 includes a lens 21 and a frame 22, the display module 13, the eyeball identification module 12 and the processor 11 are mounted on the frame 22, and the head-mounted body 20 can be made into a glasses structure for convenient use.
In one embodiment, referring to fig. 9, the eyeball identification module 12 is mounted on a frame 221 of the frame 22 to simplify the structure and reduce the cost.
In one embodiment, referring to fig. 10, when there are a plurality of directional light sources 122, a plurality of directional light sources 122 may be mounted on the frame 221 at intervals.
In one embodiment, referring to fig. 11, when there are a plurality of display screens 131, a plurality of display screens 131 may be mounted on the frame 221.
In an embodiment, referring to fig. 13, the two lens frames 221 of the lens frame 22 are respectively provided with the eyeball identification modules 12, so that the opening area of the pupils 52 of the two eyes can be detected, and the augmented reality display of the two eyes can be matched.
The display device 100 based on image projection according to any of the above embodiments of the present application may use the display method based on image projection according to any of the above embodiments of the present application. Similarly, the display method based on image projection according to any of the above embodiments of the present application can be applied to the display device 100 based on image projection according to any of the above embodiments of the present application.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (13)
1. The display method based on image projection is characterized by comprising the following steps:
detecting the opening area of the pupil: detecting the opening area of the pupil;
and (3) display work control: and the processor controls the size of a working area of the display module according to the detected pupil area so as to display an application image, and projects the application image into the pupil, so that the area of the application image is matched with the pupil opening area.
2. The image projection-based display method of claim 1, wherein said display operation control step further comprises, before said display operation control step, the steps of:
presetting an image pupil relation: and setting the proportional relation between the application image area displayed by the display module and the pupil opening area, and increasing the application image area along with the increase of the pupil opening area.
3. The image projection-based display method of claim 2, wherein the step of presetting an image pupil relationship further comprises the steps of:
detecting the pupil area: and detecting the opening area of the pupil, and acquiring the maximum opening area and the minimum opening area of the pupil.
4. The image projection-based display method of claim 3, wherein the step of presetting the image pupil relationship further comprises: and corresponding the maximum area of the application image to the maximum opening area of the pupil, and corresponding the minimum area of the application image to the minimum opening area of the pupil.
5. The image projection-based display method of any one of claims 1-4, wherein the display module includes a plurality of display screens, and the processor controls one or more of the plurality of display screens to cooperate in displaying the application image.
6. A display device based on image projection, comprising:
a head-mounted body;
the display module is used for displaying an application image and projecting the application image to the pupils of human eyes;
the eyeball identification module is used for detecting the opening area of the pupil; and the number of the first and second groups,
the processor is used for controlling the size of the working area of the display module according to the detected pupil area so as to control the area of the displayed application image;
the display module, the eyeball identification module and the processor are arranged on the head-mounted body; the display module and the eyeball identification module are respectively electrically connected with the processor.
7. The image projection-based display device of claim 6, wherein the eye recognition module comprises at least one light sensor for acquiring an eye image.
8. The image projection-based display device of claim 7, wherein the eye recognition module further comprises at least one directional light source for emitting probe light to the eye.
9. The image projection-based display device of claim 8, wherein the detection light is infrared light.
10. The image projection-based display device of claim 7, wherein the eye image is a gray scale image.
11. The image projection based display device of any of claims 6-10, wherein the display module comprises at least one display screen for displaying the application image.
12. The image projection-based display device of claim 11, wherein the display module further comprises a light guiding structure for guiding light emitted from each of the display screens to a pupil of a human eye.
13. The image projection based display device of any of claims 6-10, wherein the head mount comprises a lens and a frame, the display module, the eye recognition module, and the processor being mounted on the frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295394.7A CN110933390B (en) | 2019-12-16 | 2019-12-16 | Display method and device based on image projection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295394.7A CN110933390B (en) | 2019-12-16 | 2019-12-16 | Display method and device based on image projection |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110933390A true CN110933390A (en) | 2020-03-27 |
| CN110933390B CN110933390B (en) | 2022-01-07 |
Family
ID=69863830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911295394.7A Active CN110933390B (en) | 2019-12-16 | 2019-12-16 | Display method and device based on image projection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110933390B (en) |
Citations (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7744216B1 (en) * | 2006-01-06 | 2010-06-29 | Lockheed Martin Corporation | Display system intensity adjustment based on pupil dilation |
| JP2010220942A (en) * | 2009-03-25 | 2010-10-07 | Yaskawa Information Systems Co Ltd | Pupil measuring device, pupil measuring method, and pupil measuring program |
| US20110080421A1 (en) * | 2009-10-06 | 2011-04-07 | Palm, Inc. | Techniques for adaptive brightness control of a display |
| CN102841725A (en) * | 2011-06-21 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Electronic device and screen information adjusting method thereof |
| US20130088574A1 (en) * | 2011-10-11 | 2013-04-11 | Chao Hung Lu | Detective Adjusting Apparatus for Stereoscopic Image and Related Method |
| CN103091843A (en) * | 2011-11-04 | 2013-05-08 | 微软公司 | See-through display brightness control |
| US20140192092A1 (en) * | 2013-01-07 | 2014-07-10 | Seiko Epson Corporation | Display device and control method thereof |
| CN104470128A (en) * | 2014-12-01 | 2015-03-25 | 联想(北京)有限公司 | Luminance adjusting method and electronic equipment |
| CN104581127A (en) * | 2014-12-24 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Method, terminal and head-worn display equipment for automatically adjusting screen brightness |
| CN105319718A (en) * | 2014-07-31 | 2016-02-10 | 三星电子株式会社 | Wearable glasses and method of displaying image via wearable glasses |
| WO2016050119A1 (en) * | 2014-09-29 | 2016-04-07 | 北京蚁视科技有限公司 | Microlens-array-type near-eye display with diopter detection device |
| US20170004749A1 (en) * | 2008-01-23 | 2017-01-05 | Spy Eye, Llc | Eye mounted displays and systems, with scaler using pseudo cone pixels |
| CN107092873A (en) * | 2017-04-08 | 2017-08-25 | 闲客智能（深圳）科技有限公司 | A kind of eye moves direction recognizing method and device |
| JP2017161759A (en) * | 2016-03-10 | 2017-09-14 | 富士通株式会社 | Retina projection type display device, image display method and program |
| TW201830217A (en) * | 2017-02-02 | 2018-08-16 | 宏碁股份有限公司 | Display adjustment method and electronic device |
| CN110007759A (en) * | 2019-03-26 | 2019-07-12 | 上海临奇智能科技有限公司 | Interpupillary distance adjusting method and equipment |
| US20190222830A1 (en) * | 2018-01-17 | 2019-07-18 | Magic Leap, Inc. | Display systems and methods for determining registration between a display and a user's eyes |
| US10394322B1 (en) * | 2018-10-22 | 2019-08-27 | Evolution Optiks Limited | Light field display, adjusted pixel rendering method therefor, and vision correction system and method using same |
| US20190265785A1 (en) * | 2018-12-17 | 2019-08-29 | Intel Corporation | Virtual reality adaptive display control |
| CN110251074A (en) * | 2019-06-19 | 2019-09-20 | 重庆市中医院 | Multifunctional medical detection system |
| CN110275613A (en) * | 2019-05-29 | 2019-09-24 | Oppo广东移动通信有限公司 | Screen display processing method, device, electronic equipment and storage medium |
| US20190295507A1 (en) * | 2018-03-21 | 2019-09-26 | International Business Machines Corporation | Adaptive Rendering of Virtual and Augmented Displays to Improve Display Quality for Users Having Different Visual Abilities |
-
2019
- 2019-12-16 CN CN201911295394.7A patent/CN110933390B/en active Active
Patent Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7744216B1 (en) * | 2006-01-06 | 2010-06-29 | Lockheed Martin Corporation | Display system intensity adjustment based on pupil dilation |
| US20170004749A1 (en) * | 2008-01-23 | 2017-01-05 | Spy Eye, Llc | Eye mounted displays and systems, with scaler using pseudo cone pixels |
| JP2010220942A (en) * | 2009-03-25 | 2010-10-07 | Yaskawa Information Systems Co Ltd | Pupil measuring device, pupil measuring method, and pupil measuring program |
| US20110080421A1 (en) * | 2009-10-06 | 2011-04-07 | Palm, Inc. | Techniques for adaptive brightness control of a display |
| CN102841725A (en) * | 2011-06-21 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Electronic device and screen information adjusting method thereof |
| US20130088574A1 (en) * | 2011-10-11 | 2013-04-11 | Chao Hung Lu | Detective Adjusting Apparatus for Stereoscopic Image and Related Method |
| CN103091843A (en) * | 2011-11-04 | 2013-05-08 | 微软公司 | See-through display brightness control |
| US20130114043A1 (en) * | 2011-11-04 | 2013-05-09 | Alexandru O. Balan | See-through display brightness control |
| US20140192092A1 (en) * | 2013-01-07 | 2014-07-10 | Seiko Epson Corporation | Display device and control method thereof |
| CN105319718A (en) * | 2014-07-31 | 2016-02-10 | 三星电子株式会社 | Wearable glasses and method of displaying image via wearable glasses |
| WO2016050119A1 (en) * | 2014-09-29 | 2016-04-07 | 北京蚁视科技有限公司 | Microlens-array-type near-eye display with diopter detection device |
| CN104470128A (en) * | 2014-12-01 | 2015-03-25 | 联想(北京)有限公司 | Luminance adjusting method and electronic equipment |
| CN104581127A (en) * | 2014-12-24 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Method, terminal and head-worn display equipment for automatically adjusting screen brightness |
| JP2017161759A (en) * | 2016-03-10 | 2017-09-14 | 富士通株式会社 | Retina projection type display device, image display method and program |
| TW201830217A (en) * | 2017-02-02 | 2018-08-16 | 宏碁股份有限公司 | Display adjustment method and electronic device |
| CN107092873A (en) * | 2017-04-08 | 2017-08-25 | 闲客智能（深圳）科技有限公司 | A kind of eye moves direction recognizing method and device |
| US20190222830A1 (en) * | 2018-01-17 | 2019-07-18 | Magic Leap, Inc. | Display systems and methods for determining registration between a display and a user's eyes |
| US20190295507A1 (en) * | 2018-03-21 | 2019-09-26 | International Business Machines Corporation | Adaptive Rendering of Virtual and Augmented Displays to Improve Display Quality for Users Having Different Visual Abilities |
| US10394322B1 (en) * | 2018-10-22 | 2019-08-27 | Evolution Optiks Limited | Light field display, adjusted pixel rendering method therefor, and vision correction system and method using same |
| US20190265785A1 (en) * | 2018-12-17 | 2019-08-29 | Intel Corporation | Virtual reality adaptive display control |
| CN110007759A (en) * | 2019-03-26 | 2019-07-12 | 上海临奇智能科技有限公司 | Interpupillary distance adjusting method and equipment |
| CN110275613A (en) * | 2019-05-29 | 2019-09-24 | Oppo广东移动通信有限公司 | Screen display processing method, device, electronic equipment and storage medium |
| CN110251074A (en) * | 2019-06-19 | 2019-09-20 | 重庆市中医院 | Multifunctional medical detection system |
Non-Patent Citations (2)
| Title |
|---|
| 呼新荣: "基于出曈扩展的头戴显示器关键光学技术研究", 《中国博士学位论文全文数据库（电子期刊）信息科技辑》 * |
| 高颖，郭淑霞编著: "《虚拟现实视景仿真技术》", 31 March 2014, 西安：西北工业大学出版社 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110933390B (en) | 2022-01-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10031579B2 (en) | Automatic calibration for reflective lens | |
| US10565446B2 (en) | Eye-tracking enabled wearable devices | |
| EP3449337B1 (en) | Eye-tracking enabled wearable devices | |
| KR20230076815A (en) | How to drive a light source in a near eye display | |
| US10852817B1 (en) | Eye tracking combiner having multiple perspectives | |
| EP3191921B1 (en) | Stabilizing motion of an interaction ray | |
| US9348144B2 (en) | Display device and control method thereof | |
| US20140192092A1 (en) | Display device and control method thereof | |
| US11269406B1 (en) | Systems and methods for calibrating eye tracking | |
| JP5420793B1 (en) | Head-mounted display with adjustable image viewing distance | |
| US10725302B1 (en) | Stereo imaging with Fresnel facets and Fresnel reflections | |
| KR20220091160A (en) | Augmented reality device and method for operating the same | |
| WO2019196694A1 (en) | Virtual reality display apparatus, display device, and viewing angle computing method | |
| US11307654B1 (en) | Ambient light eye illumination for eye-tracking in near-eye display | |
| CN110927973A (en) | Display device | |
| US20210373336A1 (en) | Systems and methods for providing mixed-reality experiences under low light conditions | |
| CN110933390B (en) | Display method and device based on image projection | |
| US20220365354A1 (en) | Segmented illumination display | |
| CN214954339U (en) | Optical module and head-mounted display device with same | |
| KR20230162090A (en) | Eyewear Projector Brightness Control | |
| US20190347833A1 (en) | Head-mounted electronic device and method of utilizing the same | |
| US11860371B1 (en) | Eyewear with eye-tracking reflective element | |
| US11924536B2 (en) | Augmented reality device including variable focus lenses and operating method thereof | |
| US11792371B2 (en) | Projector with field lens | |
| US11852500B1 (en) | Navigation assistance for the visually impaired |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |