US11630300B2 - Near-eye display device, augmented reality apparatus and virtual reality apparatus - Google Patents

Near-eye display device, augmented reality apparatus and virtual reality apparatus Download PDF

Info

Publication number
US11630300B2
US11630300B2 US16/919,693 US202016919693A US11630300B2 US 11630300 B2 US11630300 B2 US 11630300B2 US 202016919693 A US202016919693 A US 202016919693A US 11630300 B2 US11630300 B2 US 11630300B2
Authority
US
United States
Prior art keywords
pixel
array
light
display device
optical element
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/919,693
Other languages
English (en)
Other versions
US20210063737A1 (en
Inventor
Qiuyu Ling
Wei Wang
Xiandong MENG
Pengxia LIANG
Xianqin MENG
Gaolei XUE
Fangzhou Wang
Meng YAN
Peilin Liu
Yujiao GUO
Yishan TIAN
Xiaochuan Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Assigned to BOE TECHNOLOGY GROUP CO., LTD. reassignment BOE TECHNOLOGY GROUP CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHEN, XIAOCHUAN, GUO, YUJIAO, LIANG, Pengxia, LING, QIUYU, LIU, PEILIN, MENG, Xiandong, MENG, Xianqin, TIAN, Yishan, WANG, FANGZHOU, WANG, WEI, XUE, Gaolei, YAN, Meng
Publication of US20210063737A1 publication Critical patent/US20210063737A1/en
Application granted granted Critical
Publication of US11630300B2 publication Critical patent/US11630300B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10—Beam splitting or combining systems
    • G02B27/12—Beam splitting or combining systems operating by refraction only
    • G02B27/123—The splitting element being a lens or a system of lenses, including arrays and surfaces with refractive power
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G02B3/0037—Arrays characterized by the distribution or form of lenses
    • G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses

Definitions

  • the present disclosure relates to the field of display technologies, and in particular, to a near-eye display device, an augmented reality apparatus, and a virtual reality apparatus.
  • the Virtual Reality (VR) technology and the Augmented Reality (AR) technology dominate, and provide excellent audio-visual experience to people.
  • Embodiments of the present disclosure provide a near-eye display device, an augmented reality apparatus, and a virtual reality apparatus.
  • a first aspect of the present disclosure provides a near-eye display device, including a base substrate, a pixel island array, an optical element array, and a sensor array; wherein
  • the base substrate includes a first surface and a second surface opposite to each other, the optical element array is on the first surface, the pixel island array and the sensor array are on the second surface, and the sensor array and the pixel island array are coupled to each other;
  • the pixel island array is configured to emit first pixel light to the optical element array, such that the first pixel light passes through the optical element array and then reaches a human eye;
  • the sensor array is configured to receive reflected light of the first pixel light reflected by the human eye, determine a position of a pupil center of the human eye according to an intensity distribution of the reflected light, determine pixels corresponding to the position of the pupil center in the pixel island array, and control the pixels to emit second pixel light.
  • the pixel island array includes a plurality of pixel islands
  • the optical element array includes a plurality of optical elements
  • the sensor array includes a plurality of light sensors
  • the plurality of pixel islands of the pixel island array are in one-to-one correspondence with the plurality of optical elements of the optical element array
  • the plurality of pixel islands of the pixel island array are in one-to-one correspondence with the plurality of light sensors of the sensor array
  • each of the plurality of light sensors is coupled to a corresponding pixel island.
  • each of the plurality of light sensors is in contact with the corresponding pixel island.
  • a center of each of the plurality of optical elements, a center of the pixel island corresponding to the optical element, and a center of the human eye are on a same straight line.
  • each of the plurality of pixel islands is within one focal length of a corresponding optical element.
  • each of the plurality of optical elements is a microlens.
  • a material of each of the plurality of optical elements includes polymethyl methacrylate.
  • each of the plurality of pixel islands includes a plurality of pixels
  • each of the plurality of light sensors is configured to determine a plurality of target pixels corresponding to the position of the pupil center from the plurality of pixels of a corresponding pixel island, and to control the plurality of target pixels to emit the second pixel light.
  • the optical element array is configured to form an enlarged virtual image at a same virtual image plane by using the first pixel light, and the virtual image plane is in a space close to the second surface.
  • a material of the base substrate includes at least one of polymethyl methacrylate and silicon nitride.
  • each of the plurality of optical elements has a viewing angle ⁇ and a focal length f
  • a distance between the human eye and the base substrate is L
  • a distance d2 is provided between any adjacent two of the plurality of pixel islands
  • d2 (L+f) ⁇ tan ⁇ .
  • a plurality of pixels of each of the plurality of pixel islands emit light of a same color, and different ones of the plurality of pixel islands emit light of different colors.
  • a second aspect of the present disclosure provides a wearable augmented reality apparatus, including the near-eye display device according to any one of the embodiments of the first aspect of the present disclosure.
  • the pixel island array includes a plurality of pixel islands, a first gap is provided between any adjacent two of the plurality of pixel islands, and is configured to transmit ambient light; and the optical element array includes a plurality of optical elements, a second gap is provided between any adjacent two of the plurality of optical elements, and is configured to transmit the ambient light.
  • each of the plurality of optical elements is a microlens having a diameter greater than or equal to 0.5 millimeters and less than or equal to 1.2 millimeters.
  • a third aspect of the present disclosure provides a wearable virtual reality apparatus, including the near-eye display device according to any one of the embodiments of the first aspect of the present disclosure.
  • the optical element array of the near-eye display device includes a plurality of optical elements, and each of the plurality of optical elements is a microlens, which has a diameter greater than or equal to 0.5 millimeters and less than or equal to 2 millimeters.
  • FIG. 1 is a schematic diagram showing a structure of a near-eye display device according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram showing that a human eye is wearing a near-eye display device according to an embodiment of the present disclosure to view a picture;
  • FIG. 3 is a schematic diagram showing the details that a near-eye display device according to an embodiment of the present disclosure is worn by a human eye for viewing a picture;
  • FIG. 4 is a schematic diagram showing a structure of a pixel island, and showing that a light sensor determines a plurality of target pixels corresponding to a pupil center at a first time from a plurality of pixels of a corresponding pixel island, according to an embodiment of the present disclosure
  • FIG. 5 is a schematic diagram showing a structure of a pixel island, and showing that a light sensor determines a plurality of target pixels corresponding to a pupil center at a second time from a plurality of pixels of a corresponding pixel island, according to an embodiment of the present disclosure.
  • the inventors of the present inventive concept have found that, the best viewing position and the best viewing angle of an existing near-eye display device with a VR display function, an AR display function, and/or the like are fixed. That is, human eyes must view (observe) a picture at the fixed best viewing position and at the fixed best viewing angle to achieve a better viewing effect.
  • the near-eye display device displays a picture
  • the viewing effect for the picture is greatly influenced by a viewing angle for each of the human eyes.
  • a pupil of each of the human eyes rotates, some light rays from the picture may not enter the human eye, such that the user cannot observe a complete (or full) picture.
  • embodiments of the present disclosure provide a near-eye display device, an augmented reality apparatus and a virtual reality apparatus, which may at least track a position of a pupil center of a human eye in real time, control different pixels to display a picture to make the picture adapt to the human eye after the position of the pupil center changes, such that the human eye may observe a complete and clear picture in real time.
  • FIG. 1 illustrates a structure of a near-eye display device according to an embodiment of the present disclosure.
  • the near-eye display device includes a base substrate 10 , a pixel island array 20 , an optical element array 30 , and a sensor array 40 .
  • the base substrate 10 includes a first surface 01 and a second surface 02 that are opposite to each other, the optical element array 30 is disposed on the first surface 01 , the pixel island array 20 and the sensor array 40 are disposed on the second surface 02 , and the sensor array 40 and the pixel island array 20 are coupled to each other.
  • the pixel island array 20 is configured to emit first pixel light toward the optical element array 30 such that the first pixel light passes through the optical element array 30 and then reaches a human eye.
  • the sensor array 40 is configured to receive light of the first pixel light reflected from the human eye, determine a position of a pupil center of the human eye according to an intensity distribution of the reflected light, determine pixels corresponding to the position of the pupil center in the pixel island array 20 , and control the pixels to emit second pixel light.
  • the first surface 01 is a surface of the base substrate 10 proximal to the human eye
  • the second surface 02 is a surface of the base substrate 10 distal to the human eye.
  • the pixel island array 20 disposed on the second surface 02 may emit the first pixel light.
  • the first pixel light may reach the human eye after passing through the optical element array 30 disposed on the first surface 01 , and is reflected by the human eye.
  • the sensor array 40 disposed on the second surface 02 may receive light reflected by the human eye, and determine the current position of the pupil center of the human eye according to an intensity distribution of the reflected light, so as to determine pixels corresponding to the current position of the pupil center in the pixel island array 20 , and control the pixels emit the second pixel light.
  • the first light may be emitted from a first portion of the pixels of the pixel island array 20
  • the second light may be emitted from a second portion of the pixels of the pixel island array 20
  • the second portion of the pixels may be different from the first portion of the pixels.
  • the near-eye display device may track the position of the pupil center of the human eye in real time, and then control different pixels to display a picture in real time, so as to adjust the picture so that the picture adapts to the human eye after the position of the pupil center thereof changes. Therefore, the human eye may observe a complete and clear picture in real time.
  • the base substrate 10 may be made of a transparent material for transmitting light.
  • the material of the base substrate 10 may include at least one of polymethyl methacrylate (PMMA) and silicon nitride (Si 3 N 4 ).
  • PMMA polymethyl methacrylate
  • Si 3 N 4 silicon nitride
  • polymethyl methacrylate has a relatively small weight per unit volume, and thus, it may reduce a weight of the near-eye display device such that the near-eye display device is easy to be worn by a user.
  • the base substrate 10 may be made of a transparent material (e.g., silicon nitride) commonly used in a base substrate of a liquid crystal display (LCD), such that the near-eye display device may be more compact.
  • an embodiment of the present disclosure is not limited thereto.
  • FIG. 2 shows that a human eye is wearing a near-eye display device according to an embodiment of the present disclosure to view a picture.
  • the pixel island array 20 includes a plurality of pixel islands 21 , and the plurality of pixel islands 21 may be arranged on the second surface 02 of the base substrate 10 according to the viewing requirements of a human eye 03 .
  • Each of the pixel islands 21 may include a plurality of pixels 211 (see FIGS. 4 and 5 ), i.e. one of the pixel islands 21 is actually one cluster of pixels.
  • the plurality of pixels 211 may also be arranged (e.g., arranged in an array) according to the viewing requirement of the human eye 03 .
  • One of the pixel islands 21 may include a plurality of pixels of a same color (i.e., the plurality of pixels of one of the pixel islands 21 may emit light of a same color), and the colors of light emitted from the pixels in different pixel islands 21 may be different, such that the uniformity of the display effect may be ensured while the real-time tracking of the position of the pupil center of human eyes is achieved.
  • the pixels of each of the pixel islands 21 may emit light of three colors of R, G, and B, respectively.
  • Each of the pixel islands 21 corresponds to a small display panel, and for a full picture to be viewed, each of the pixel islands 21 may only display a part of the full picture to be viewed.
  • Image planes of the pixel islands 21 amplified by the optical element array 30 may be spliced (or superposed) together to form the full picture to be viewed (i.e. an amplified virtual image 04 ), as shown in FIG. 2 , such that the virtual image 04 may be viewed (or observed) by the human eye 03 .
  • each pixel island 21 may have a shape of rectangle (or even square), as shown in FIGS. 4 and 5 .
  • the present disclosure is not limited thereto, and for example, each pixel island 21 may alternatively have a shape of regular hexagon.
  • the near-eye display device since the achievement of the display effect of augmented reality needs a certain amount of ambient light, if the near-eye display device is employed to realize augmented reality display, a certain gap needs to be provided between any adjacent two of the pixel islands 21 , and the gap is configured to transmit the ambient light. Since the achievement of the display effect of the virtual reality does not require any ambient light, if the near-eye display device is employed to realize virtual reality display, no gap may be provided between any adjacent two of the pixel islands 21 , or a light shielding sheet may be provided on a portion of the second surface of the base substrate 10 between any adjacent two of the pixel islands 21 .
  • the optical element array 30 may include a plurality of optical elements 31 , and the plurality of optical elements 31 may be arranged on the first surface 01 of the base substrate 10 according to the viewing requirement of the human eye.
  • each of the optical elements 31 may be a microlens (e.g., a convex lens). If the near-eye display device is employed to realize augmented reality display, a diameter of the microlens may be greater than or equal to 0.5 mm and less than or equal to 1.2 mm, and the diameter of the microlens may be selected within this range according to a specific augmented reality display scene, such that a gap is provided between any adjacent two microlenses.
  • an aperture of a single microlens cannot be too large, in a case where the number of microlenses meeting display requirements is fixed, a large diameter of each of microlenses may result in a small gap or even no gap between any adjacent two of the microlenses, and in this case, ambient light may not enter the human eye, and thus the display effect of augmented reality may not achieved. Therefore, the diameter of each microlens needs to be small, such that a certain gap is provided between any adjacent two of the optical elements (e.g., microlenses), and this gap may be configured to transmit the ambient light.
  • the diameter of each of the microlenses may be larger.
  • the diameter of each of the microlens may be greater than or equal to 0.5 mm and less than or equal to 2 mm, and the diameter of each of the microlenses may be selected within this range according to the specific virtual reality display scene.
  • a center of the optical element 31 , a center of the pixel island 21 corresponding to the optical element 31 , and a center of the human eye are located on a same straight line, such that the light emitted from each pixel island 21 may pass through the corresponding optical element 31 for optical processing, and the light optically processed by each optical element 31 may be received by the human eye.
  • the optical element array 30 is configured to form an enlarged virtual image on a same virtual image surface (e.g., virtual image plane) 05 by using the first pixel light, the virtual image plane 05 is located in a space close to the second surface 02 and has a predetermined depth of field with respect to the optical element array 30 .
  • each pixel island 21 may be located within a range of one focal length of the optical element 31 corresponding to the pixel island 21 , such that the light emitted from the pixel island 21 may pass through the corresponding optical element 31 , and then form an enlarged virtual image at the virtual image plane 05 in the space close to the second surface 02 .
  • the enlarged virtual images formed at the same virtual image plane by the first pixel light emitted by the pixel islands 21 should be complementary to form a complete picture, which may be realized by designing parameters such as a distance between the human eye and the optical elements 31 (i.e., the optical element array 30 ), a thickness of the base substrate 10 , and the like in a practical application.
  • the thickness of the base substrate 10 may be less than or equal to a focal length f of each of the optical elements 31 , such that each pixel island 21 may be located within a range of one focal length f of the corresponding optical element 31 .
  • a material of each of the optical elements 31 may include polymethyl methacrylate.
  • Polymethyl methacrylate is light and transparent, and thus selecting polymethyl methacrylate as the material of each of the optical elements 31 may reduce the weight of the near-eye display device, thereby ensuring that a user may wear the near-eye display device comfortably.
  • the material of each of the optical elements 31 may include another material, such as a transparent glass material, a resin material, an optical film material, or the like, which is not limited in an embodiment of the present disclosure.
  • the sensor array 40 includes a plurality of light sensors 41 .
  • the plurality of pixel islands 21 of the pixel island array 20 are in one-to-one correspondence with the plurality of optical elements 31 of the optical element array 30
  • the plurality of pixel islands 21 of the pixel island array 20 are in one-to-one correspondence with the plurality of light sensors 41 of the sensor array 40 .
  • Each of the light sensors 41 is coupled to the corresponding pixel island 21 .
  • each of the light sensors 41 may be disposed adjacent to the corresponding pixel island 21 , for example, each of the light sensors 41 may be in contact with the corresponding pixel island 21 .
  • each light sensor 41 may be configured to determine a plurality of target pixels corresponding to the position of the pupil center of the human eye 03 from the plurality of pixels of the corresponding pixel island 21 , and control the plurality of target pixels to emit the second pixel light.
  • the plurality of pixel islands 21 of the pixel island array 20 may be arranged in a plurality of rows and a plurality of columns
  • the plurality of optical elements 31 of the optical element array 30 may be arranged in a plurality of rows and a plurality of columns
  • the plurality of light sensors 41 of the sensor array 40 may be arranged in a plurality of rows and a plurality of columns.
  • each light sensor 41 may be a charge coupled device (CCD) camera, a complementary metal oxide semiconductor (CMOS) sensor, or the like.
  • CCD charge coupled device
  • CMOS complementary metal oxide semiconductor
  • the pupil of the human eye may change its position with the movement of a sight line.
  • the movement range of the pupil of the human eye may be 2 mm, i.e., the position of the pupil center of the human eye may change within the range of 4 mm in any direction.
  • the pixel island 21 may emit the first pixel light, the first pixel light may reach the human eye 03 after passing through the optical element 31 corresponding to the pixel island 21 , and is reflected by the human eye 03 , such that the corresponding light sensor 41 may receive the light reflected by the human eye 03 .
  • FIG. 3 is a schematic diagram showing the details that a near-eye display device according to an embodiment of the present disclosure is worn by a human eye for viewing a picture.
  • the light rays reflected by the pupil may be shown by the solid lines in FIG. 3 .
  • the light rays reflected by the pupil may be shown by the dashed lines in FIG. 3 .
  • a spot of the reflected light received by each of the light sensors 41 moves upward accordingly.
  • the spot of light is a part of the reflected light with a relatively concentrated intensity.
  • each of the light sensors 41 may determine the current position of the pupil center of the human eye according to a position of the spot of the reflected light with a relatively concentrated intensity.
  • each of the light sensors 41 may pre-store a correspondence (or correspondence relationship) between positions of the light spot and positions of the pupil center, and a correspondence between each of the positions of the pupil center and pixels in each pixel island 21 . These correspondences may be acquired in advance through machine training, actual measurements, and/or the like, which is not specifically limited in the embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram showing a structure of each of the pixel islands 21 , and showing that the light sensor 41 corresponding to the pixel island 21 determines a plurality of target pixels 2110 corresponding to the pupil center of the human eye 03 at a first time from the plurality of pixels 211 of the pixel island 21 , according to an embodiment of the present disclosure. As shown in FIG. 4 , since each light sensor 41 may detect a distance by which the position of the light spot has moved upward (see FIG.
  • the light sensor 41 may determine a plurality of target pixels 2110 (e.g., an upper portion of pixels among the plurality of pixels 211 of the corresponding pixel island 21 ) corresponding to the position of the pupil center at this time, from the plurality of pixels 211 of the corresponding pixel island 21 by querying the pre-stored correspondences, and control the plurality of target pixels 2110 to emit the second pixel light.
  • the second pixel light emitted from the plurality of target pixels 2110 of each pixel island 21 passes through the corresponding optical element 31 , and then reaches the human eye (e.g., reaches the position of the pupil center of the human eye).
  • each light sensor 41 may determine the position of the pupil center of the human eye at this time, may determine a plurality of target pixels 2110 (e.g., a lower-right portion of pixels among the plurality of pixels 211 of the corresponding pixel island 21 ) corresponding to the position of the pupil center at this time from the plurality of pixels 211 of the corresponding pixel island 21 , as shown in FIG. 5 , and then may control the plurality of target pixels 2110 to emit the second pixel light.
  • a plurality of target pixels 2110 e.g., a lower-right portion of pixels among the plurality of pixels 211 of the corresponding pixel island 21
  • FIG. 5 the plurality of target pixels 2110 to emit the second pixel light.
  • the near-eye display device includes the base substrate, the pixel island array, the optical element array, and the sensor array.
  • the optical element array is disposed on the first surface of the base substrate, the pixel island array and the sensor array are disposed on the second surface of the base substrate, and the sensor array and the pixel island array are coupled to each other.
  • the pixel island array may emit the first pixel light, and the first pixel light may pass through the optical element array and then reach the human eye, and are reflected by the human eye.
  • the sensor array may receive the light reflected by the human eye, and determine the current position of the pupil center of the human eye according to the intensity distribution of the reflected light, so as to determine pixels corresponding to the position of the pupil center in the pixel island array, and control the determined pixels to emit the second pixel light.
  • the near-eye display device may track the position of the pupil center of the human eye in real time, and control different pixels to display a picture in real time to adjust the picture such that the picture adapts to the human eye after the position of the pupil center changes. Therefore, the human eye may observe a complete and clear picture in real time.
  • An embodiment of the present disclosure provides a wearable augmented reality apparatus including the near-eye display device as described above.
  • the pixel island array includes a plurality of pixel islands, and a first gap (or first interval/distance) is provided between any adjacent two of the pixel islands and is configured to transmit ambient light.
  • the optical element array includes a plurality of optical elements, and a second gap (or second interval/distance) is provided between any adjacent two of the optical elements and is configured to transmit the ambient light.
  • each of the optical elements is a microlens (e.g., convex lenses), which may have a diameter greater than or equal to 0.5 millimeters and less than or equal to 1.2 millimeters.
  • the near-eye display device of the augmented reality apparatus includes the base substrate, the pixel island array, the optical element array, and the sensor array.
  • the optical element array is disposed on the first surface of the base substrate, the pixel island array and the sensor array are disposed on the second surface of the base substrate, and the sensor array and the pixel island array are coupled to each other.
  • the pixel island array may emit the first pixel light, and the first pixel light may pass through the optical element array and then reach the human eye, and are reflected by the human eye.
  • the sensor array may receive the light reflected by the human eye, and determine the current position of the pupil center of the human eye according to the intensity distribution of the reflected light, so as to determine pixels corresponding to the position of the pupil center in the pixel island array, and control the determined pixels to emit the second pixel light.
  • the near-eye display device may track the position of the pupil center of the human eye in real time, and control different pixels to display a picture in real time to adjust the picture such that the picture adapts to the human eye after the position of the pupil center changes. Therefore, the human eye may observe a complete and clear picture in real time.
  • An embodiment of the present disclosure provides a wearable virtual reality apparatus including the near-eye display device as described above.
  • each of the optical elements 31 of the optical element array 30 of the near-eye display device is a microlens, which may have a diameter greater than or equal to 0.5 millimeters and less than or equal to 2 millimeters.
  • the near-eye display device of the virtual reality apparatus includes the base substrate, the pixel island array, the optical element array, and the sensor array.
  • the optical element array is disposed on the first surface of the base substrate, the pixel island array and the sensor array are disposed on the second surface of the base substrate, and the sensor array and the pixel island array are coupled to each other.
  • the pixel island array may emit the first pixel light, and the first pixel light may pass through the optical element array and then reach the human eye, and are reflected by the human eye.
  • the sensor array may receive the light reflected by the human eye, and determine the current position of the pupil center of the human eye according to the intensity distribution of the reflected light, so as to determine pixels corresponding to the position of the pupil center in the pixel island array, and control the determined pixels to emit the second pixel light.
  • the near-eye display device may track the position of the pupil center of the human eye in real time, and control different pixels to display a picture in real time to adjust the picture such that the picture adapts to the human eye after the position of the pupil center changes. Therefore, the human eye may observe a complete and clear picture in real time.
  • relational terms such as first and second, and the like used herein are solely for distinguishing one entity or operation from another entity or operation, but are not intended to require or imply any actual such relationship or order between such entities or operations.
  • the terms “include”, “comprise” or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, product, or apparatus that has a list of elements contains not only those elements but also may include other elements not expressly listed or inherent to such a process, method, product, or apparatus.
  • an element defined by the phrase “comprising a/an . . . ” does not exclude the presence of other identical elements from the process, method, product, or apparatus that comprises the element.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
US16/919,693 2019-08-30 2020-07-02 Near-eye display device, augmented reality apparatus and virtual reality apparatus Active 2041-07-02 US11630300B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910817529.5 2019-08-30
CN201910817529.5A CN110488494B (zh) 2019-08-30 2019-08-30 一种近眼显示装置、增强现实设备以及虚拟现实设备

Publications (2)

Publication Number Publication Date
US20210063737A1 US20210063737A1 (en) 2021-03-04
US11630300B2 true US11630300B2 (en) 2023-04-18

Family

ID=68555825

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/919,693 Active 2041-07-02 US11630300B2 (en) 2019-08-30 2020-07-02 Near-eye display device, augmented reality apparatus and virtual reality apparatus

Country Status (2)

Country Link
US (1) US11630300B2 (zh)
CN (1) CN110488494B (zh)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112987295B (zh) * 2019-12-17 2023-02-28 京东方科技集团股份有限公司 近眼显示装置和虚拟/增强现实设备
CN111175982B (zh) * 2020-02-24 2023-01-17 京东方科技集团股份有限公司 近眼显示装置和可穿戴设备
EP4123358A4 (en) * 2020-03-19 2023-04-26 BOE Technology Group Co., Ltd. DISPLAY DEVICE AND ASSOCIATED DISPLAY METHOD
CN113495362A (zh) * 2020-04-03 2021-10-12 深圳光峰科技股份有限公司 增强现实显示光学器件、光学系统、眼镜及hud显示系统
CN111580270A (zh) * 2020-06-08 2020-08-25 昆山梦显电子科技有限公司 基于眼球追踪技术的显示面板及其制备方法、显示装置
CN111562668A (zh) * 2020-06-08 2020-08-21 昆山梦显电子科技有限公司 一种微显示装置及其制备方法
CN111624784B (zh) * 2020-06-23 2022-10-18 京东方科技集团股份有限公司 一种光场显示装置
CN114449319B (zh) * 2020-11-04 2024-06-04 深圳Tcl新技术有限公司 视频画面动态调整方法、装置、智能终端及存储介质
CN115715379A (zh) * 2021-06-18 2023-02-24 京东方科技集团股份有限公司 近眼显示装置及其显示方法
CN113703169B (zh) * 2021-09-09 2022-07-08 中山大学 具有屈光矫正功能的集成成像光场显示方法及显示系统
TWI807535B (zh) * 2021-12-15 2023-07-01 財團法人工業技術研究院 眼鏡上的頭戴式擴增實境立體視覺光學膜
CN116745683A (zh) * 2022-01-10 2023-09-12 京东方科技集团股份有限公司 眼动追踪装置和眼动追踪方法
CN114842810A (zh) * 2022-03-29 2022-08-02 河南经贸职业学院 一种嵌入式低分辨率显示器处理高画质图形的图像处理技术
CN117642679A (zh) * 2022-06-23 2024-03-01 京东方科技集团股份有限公司 显示装置及其驱动方法

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130285885A1 (en) * 2012-04-25 2013-10-31 Andreas G. Nowatzyk Head-mounted light-field display
US20140168782A1 (en) * 2012-12-13 2014-06-19 Beijing Boe Display Technology Co., Ltd. Brighness enhancement film, backlight assembly, and display apparatus
CN205539744U (zh) 2016-03-11 2016-08-31 深圳市漫游互联科技有限公司 一种基于头部跟踪的裸眼增强现实显示系统
US20170039960A1 (en) * 2015-08-03 2017-02-09 Oculus Vr, Llc Ocular Projection Based on Pupil Position
CN106873161A (zh) 2017-03-02 2017-06-20 上海天马微电子有限公司 一种显示装置及近眼可穿戴设备
CN108428716A (zh) 2018-02-12 2018-08-21 谢学军 增强现实显示系统
CN108700934A (zh) 2015-09-24 2018-10-23 托比股份公司 能够进行眼睛追踪的可穿戴设备
CN108921951A (zh) 2018-07-02 2018-11-30 京东方科技集团股份有限公司 虚拟现实图像显示方法及其装置、虚拟现实设备
US10168531B1 (en) 2017-01-04 2019-01-01 Facebook Technologies, Llc Lightfield waveguide integrated eye tracking
CN109256042A (zh) 2018-11-22 2019-01-22 京东方科技集团股份有限公司 显示面板、电子设备及人眼追踪方法
US10319266B1 (en) 2017-04-24 2019-06-11 Facebook Technologies, Llc Display panel with non-visible light detection
US20190179154A1 (en) 2008-09-04 2019-06-13 Innovega Inc. System and apparatus for see-through display panels

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108572450B (zh) * 2017-03-09 2021-01-29 宏碁股份有限公司 头戴式显示器、其视野校正方法以及混合现实显示系统

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190179154A1 (en) 2008-09-04 2019-06-13 Innovega Inc. System and apparatus for see-through display panels
US20130285885A1 (en) * 2012-04-25 2013-10-31 Andreas G. Nowatzyk Head-mounted light-field display
US20140168782A1 (en) * 2012-12-13 2014-06-19 Beijing Boe Display Technology Co., Ltd. Brighness enhancement film, backlight assembly, and display apparatus
US20170039960A1 (en) * 2015-08-03 2017-02-09 Oculus Vr, Llc Ocular Projection Based on Pupil Position
CN108700934A (zh) 2015-09-24 2018-10-23 托比股份公司 能够进行眼睛追踪的可穿戴设备
CN205539744U (zh) 2016-03-11 2016-08-31 深圳市漫游互联科技有限公司 一种基于头部跟踪的裸眼增强现实显示系统
US10168531B1 (en) 2017-01-04 2019-01-01 Facebook Technologies, Llc Lightfield waveguide integrated eye tracking
CN106873161A (zh) 2017-03-02 2017-06-20 上海天马微电子有限公司 一种显示装置及近眼可穿戴设备
US10319266B1 (en) 2017-04-24 2019-06-11 Facebook Technologies, Llc Display panel with non-visible light detection
CN108428716A (zh) 2018-02-12 2018-08-21 谢学军 增强现实显示系统
CN108921951A (zh) 2018-07-02 2018-11-30 京东方科技集团股份有限公司 虚拟现实图像显示方法及其装置、虚拟现实设备
CN109256042A (zh) 2018-11-22 2019-01-22 京东方科技集团股份有限公司 显示面板、电子设备及人眼追踪方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
First Office Action with Search Report dated Jan. 29, 2021 corresponding to Chinese application No. 201910817529.5.

Also Published As

Publication number Publication date
CN110488494A (zh) 2019-11-22
US20210063737A1 (en) 2021-03-04
CN110488494B (zh) 2023-08-15

Similar Documents

Publication Publication Date Title
US11630300B2 (en) Near-eye display device, augmented reality apparatus and virtual reality apparatus
US11582440B2 (en) Display apparatus, head-mounted display apparatus, image display method, and image display system
CN106873161B (zh) 一种显示装置及近眼可穿戴设备
US10338451B2 (en) Devices and methods for removing zeroth order leakage in beam steering devices
CN108375840B (zh) 基于小型阵列图像源的光场显示单元及使用其的三维近眼显示装置
JP6658529B2 (ja) 表示装置、表示装置の駆動方法、及び、電子機器
CN108139591B (zh) 三维显示面板、包括其的三维显示设备、及其制造方法
US11073701B2 (en) Head-mounted display device
WO2011043188A1 (ja) 表示方法、表示装置、光学ユニット、表示装置の製造方法、及び電子機器
US20190035364A1 (en) Display apparatus, method of driving display apparatus, and electronic apparatus
US10534192B2 (en) Stereo display panel and display device having the stereo display panel
US11272168B2 (en) Three-dimensional display apparatus, three-dimensional imaging apparatus, and method of displaying three-dimensional image
CN103149696A (zh) 显示系统
US8525957B2 (en) Display apparatus, electronic equipment, mobile electronic equipment, mobile telephone, and image pickup apparatus
US10859850B2 (en) Reflective 3D display device and display method
US10511832B1 (en) Calibration of virtual image system with extended nasal field of view
KR20200061043A (ko) 헤드 마운트 디스플레이장치
CN210038329U (zh) 显示装置以及虚拟现实显示系统
US20200166752A1 (en) Display for use in display apparatus
US10718949B1 (en) Display apparatus and method of displaying
JP2002365586A (ja) 画像表示装置
TWI734640B (zh) 集成式立體影像顯示裝置
US20230221614A1 (en) Display apparatus
US11300808B2 (en) Stereoscopic image display apparatus
CN110928034B (zh) 一种彩膜基板、显示面板以及显示装置

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: BOE TECHNOLOGY GROUP CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LING, QIUYU;WANG, WEI;MENG, XIANDONG;AND OTHERS;REEL/FRAME:053237/0509

Effective date: 20180202

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STCF Information on status: patent grant

Free format text: PATENTED CASE