CN112130321A - Waveguide module and near-to-eye display module and equipment based on waveguide - Google Patents

Waveguide module and near-to-eye display module and equipment based on waveguide Download PDF

Info

Publication number
CN112130321A
CN112130321A CN201910550146.6A CN201910550146A CN112130321A CN 112130321 A CN112130321 A CN 112130321A CN 201910550146 A CN201910550146 A CN 201910550146A CN 112130321 A CN112130321 A CN 112130321A
Authority
CN
China
Prior art keywords
unit
light
image
coupling
feedback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910550146.6A
Other languages
Chinese (zh)
Other versions
CN112130321B (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Idealsee Technology Co Ltd
Original Assignee
Chengdu Idealsee Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Idealsee Technology Co Ltd filed Critical Chengdu Idealsee Technology Co Ltd
Priority to CN201910550146.6A priority Critical patent/CN112130321B/en
Publication of CN112130321A publication Critical patent/CN112130321A/en
Application granted granted Critical
Publication of CN112130321B publication Critical patent/CN112130321B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10Scanning systems
    • G02B26/103Scanning systems having movable or deformable optical fibres, light guides or waveguides as scanning elements

Abstract

The invention provides a waveguide module, a near-eye display module based on a waveguide and a device, which are used for improving the feedback capacity of a display device in the projection display process. The waveguide module comprises a waveguide, and a coupling-in unit, a relay unit, a coupling-out unit and a feedback light-emitting unit which are arranged in the waveguide in a one-to-one correspondence manner; the coupling-in unit is used for coupling the full-field image light generated by the image source into the waveguide, the relay unit is used for expanding the pupil and transmitting the full-field image light, and the full-field image light transmitted to the coupling-out unit is coupled out by the coupling-out unit to form a display image; the light feedback unit is arranged on the coupling-out unit or is arranged adjacent to the relay unit in the pupil expanding direction of the relay unit, and the light feedback unit is used for coupling out part of energy of the full-field image light to form a feedback image.

Description

Waveguide module and near-to-eye display module and equipment based on waveguide
Technical Field
The invention relates to the technical field of display, in particular to a waveguide module, a near-to-eye display module based on the waveguide and equipment.
Background
Existing waveguide-based AR display devices typically include an image source, a waveguide, an incoupling component, a relay component, and an outcoupling component. If a collimating lens is arranged in the image source, the image light emitted by the image source is collimated light. The image light is coupled into the waveguide by the coupling-in part at a certain diffraction angle for total reflection propagation, and then interacts with the relay part to expand the pupil in the first direction. And finally, the image light after the pupil expansion of the relay part propagates along the waveguide until the image light interacts with the coupling-out part, the coupling-out part expands the pupil of the image light interacting with the coupling-out part in the second direction and couples the image light out of the waveguide, and the coupled-out image light enters human eyes so as to display an image.
At present, an image source adopts a laser scanner such as an optical fiber scanner or a MEMS scanner as a device for emitting image light, in the display technology of combining the laser scanner with a waveguide, the precision requirement of the optical fiber scanner or the MEMS scanner as the image source is high, the problems of unstable scanned image, drifting and the like easily occur, particularly in a structure of splicing a plurality of image sources, the problem of splicing dislocation of sub-images easily occurs, and a better solution is not provided at present.
Disclosure of Invention
The embodiment of the invention aims to provide a waveguide module, a near-eye display module based on a waveguide and a device, which are used for improving the feedback effect of a display device in the projection display process.
The specific technical scheme provided in the embodiment of the invention is as follows:
in a first aspect, an embodiment of the present invention provides a waveguide module, including a waveguide, and an incoupling unit, a relay unit, an outcoupling unit, and a feedback light-emitting unit, which are disposed in the waveguide and are in one-to-one correspondence; the coupling-in unit is used for coupling the full-field image light generated by the image source into the waveguide, the relay unit is used for expanding the pupil and transmitting the full-field image light, and the full-field image light transmitted to the coupling-out unit is coupled out by the coupling-out unit to form a display image; the light feedback unit is arranged on the coupling-out unit or is arranged adjacent to the relay unit in the pupil expanding direction of the relay unit, and the light feedback unit is used for coupling out part of energy of the full-field image light to form a feedback image.
Optionally, the light feedback unit is disposed at a transmission end of the relay unit, which is far away from the coupling-in unit in the pupil expanding direction, or the light feedback unit is located at an edge area of the coupling-out unit.
Optionally, the coupling-in unit, the relay unit, the feedback light-emitting unit, and the coupling-out unit are all of a grating structure.
Optionally, the grating structure of the light feedback and output unit is perpendicular to the grating direction of the grating structure of the coupling-in unit; or the grating structure of the light feedback and output unit is the same as that of the coupling-out unit.
Optionally, the coupling-out direction of the feedback light-emitting unit is the same as or opposite to the coupling-out direction of the coupling-out unit.
Optionally, when the coupling-out direction of the light feedback unit is the same as the coupling-out direction of the coupling-out unit, if the grating structure of the light feedback unit is the same as the grating structure of the coupling-out unit, and the light feedback unit is disposed on the coupling-out unit, the light feedback unit is a part of the grating structure in the coupling-out unit.
Optionally, when the coupling-out direction of the light feedback unit is opposite to the coupling-out direction of the coupling-out unit, the light feedback unit is disposed on a surface of the relay unit or the coupling-out unit opposite to the coupling-out surface of the coupling-out unit.
In a second aspect, an embodiment of the present invention provides a waveguide-based near-eye display module, including:
the image display device comprises at least one image source, a display unit and a control unit, wherein the image source is used for emitting light for forming an image to be displayed, each image source comprises an input light source and a corresponding laser scanner, the input light source is used for emitting image light for the image to be displayed, and the laser scanner is used for scanning and emitting the image light; the images emitted by the image sources form different parts of a complete image with a corresponding large field angle, and the image formed by the light emitted by each image source has a corresponding sub-field angle;
the waveguide module according to the first aspect is disposed on the light-emitting path of the at least one image source, and after the full-field image light of the image to be displayed generated by the at least one image source is coupled into the waveguide module, the full-field image light is coupled out and spliced into the image to be displayed through an out-coupling unit in the waveguide module, and a part of energy of the full-field image light is coupled out through the feedback light-emitting unit to form a feedback image;
and the detection part is arranged on the coupling light path of the feedback light-emitting unit and used for receiving the feedback image and generating a corresponding electric signal as a feedback signal according to the feedback image.
Optionally, the near-to-eye display module further includes:
and the processor is connected with the detection component and the at least one image source and used for receiving the electric signals output by the detection component, judging whether the feedback image of the feedback light-emitting unit is the same as the image to be displayed or not according to the electric signals and correcting the image corresponding to the emergent light of the at least one image source when the situation that the image is different is determined.
Optionally, the image source includes a laser scanner and at least one path of input light source, the one path of input light source is used for generating at least one light beam of the sub-field of view of the image to be displayed, the one path of input light source includes at least one group of light sources, each group of light sources includes at least R, G, B three light-emitting units, and the light-emitting units of the same color channel in the at least one group of light sources are configured to emit light with different wavelengths; the laser scanner is an optical fiber scanner or an MEMS scanner and is used for scanning and emitting the light beams generated by the at least one path of input light source.
Optionally, the waveguide is provided with a plurality of layers of one-to-one corresponding coupling-in units, relay units, coupling-out units and feedback light-emitting units, and each layer corresponds to light with one wavelength.
Optionally, the near-to-eye display module further includes:
the beam splitter is arranged on the light-emitting path of the at least one image source and used for separating light beams with different wavelengths in the image mixed light beam to be displayed, and the light beams with different wavelengths are respectively coupled into the waveguide module through corresponding coupling-in units; when a plurality of image sources are adopted to simultaneously modulate and emit different image parts of the image to be displayed, light beams of the plurality of image sources are spliced with each other before being incident to the beam splitter.
In a third aspect, an embodiment of the present invention provides a near-eye display device, including the near-eye display module according to the second aspect.
In the embodiment of the invention, a waveguide module in a near-eye display module is internally provided with a coupling-in unit, a relay unit, a coupling-out unit and a feedback light-emitting unit which are in one-to-one correspondence, and the feedback light-emitting unit is arranged on the coupling-out unit or is arranged adjacent to the relay unit in the pupil expanding direction of the relay unit; the relay unit is used for expanding pupil and transmitting full-field image light after the full-field image light generated by the image source is coupled into the waveguide by the coupling-in unit, and the full-field image light transmitted to the coupling-out unit is coupled out by the coupling-out unit to form a display image; meanwhile, the feedback light emitting unit is used for coupling out part of energy of the full-field image light to form a feedback image, so that the near-eye display module obtains an electric signal of the feedback image through detection of the detection component as a feedback signal, a feedback effect is realized, and the projection effect of the display device in the projection display process is improved.
Drawings
FIG. 1 is a schematic structural diagram of a near-eye display module according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram illustrating an image source of a near-eye display module according to an embodiment of the present disclosure;
FIGS. 3A-3B are schematic structural diagrams of a waveguide module according to an embodiment of the invention;
fig. 4A and 4B are schematic diagrams illustrating the light exiting direction of the feedback light-emitting unit according to the embodiment of the invention;
fig. 5 is a schematic diagram of a near-eye display device in an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention is described in detail below with reference to the accompanying drawings.
Referring to fig. 1, which is a schematic structural diagram of a waveguide-based near-eye display module according to an embodiment of the present invention, the near-eye display module according to the embodiment of the present invention includes an image source 10, a waveguide module 20 and a detection component 30, where the waveguide module 20 in fig. 1 is a top view; the image source 10 includes an input light source 101 and a laser scanner 102, where the input light source 101 is a laser light source, the laser scanner 102 is preferably an optical fiber scanner or a MEMS scanner, and the laser scanner 102 is an optical fiber scanner as an example in the figure; the waveguide module 20 includes a waveguide 201, and an incoupling unit 202, a relay unit 203, an outcoupling unit 24 and a feedback light-emitting unit 205 that are arranged in the waveguide in a one-to-one correspondence manner, the image source 10 is configured to generate full-view image light of an image to be displayed, the full-view image light is coupled into the waveguide by the incoupling unit 202, and is coupled out and spliced into an image to be displayed by the outcoupling unit 204 in the waveguide module 20, meanwhile, a part of energy of the full-view image light is coupled out by the feedback light-emitting unit 205 to form a feedback image, and the detection component 30 arranged on the exit light path of the feedback light-emitting unit 205 can detect an electrical signal corresponding to the feedback image as a feedback signal, thereby realizing feedback of a projected image in the projection display process.
In the embodiment of the invention, the image to be displayed can be a complete image or a partial image in the complete image, that is, the near-eye display module based on the waveguide in the embodiment of the invention can be used as an independent module to independently process a complete view field picture, and can also be used as a part of a splicing module to only process a partial view field picture, so that the complete view field picture is realized after being spliced with a plurality of similar modules.
The following describes each part of the near-eye display module in the embodiment of the present invention.
An image source 10 for scanning image light exiting an image to be displayed. Unless otherwise specified, the image light referred to herein refers to the full field of view image light of the image to be displayed. The input light source 101 in the image source 10 may be a laser light source, a light emitting diode LED, an ambient light source, and the like. One path of input light source may include at least one group of light sources, each group of light sources includes at least R, G, B three kinds of light emitting units, one kind of light emitting unit may include one or more light emitters, for example, an R light emitting unit may be formed by mixing two light emitters R' and R ″, and when each kind of light emitting unit includes multiple kinds of light emitters, light energy may be improved.
When the image to be displayed corresponds to a plurality of sub-field-of-view images (i.e., the plurality of sub-field-of-view images are stitched to form the image to be displayed for the full field of view), each sub-field-of-view image may be modulated by a set of light sources. As shown in fig. 2, one path of input light source includes n groups of laser light sources, n is greater than or equal to 2, each group of laser light source includes R, G, B three monochromatic lasers (R, G, B three monochromatic lasers refer to red laser, green laser and blue laser, respectively), and the n monochromatic lasers of the same color channel in the 2 groups of laser light sources are configured to emit light with different wavelengths; the light generated by N groups of laser light sources is input into one scanning optical fiber 111 in the optical fiber scanner 100, and N is an integer greater than or equal to 2. The light generated by the n groups of laser light sources is preferably input into one scanning optical fiber in the optical fiber scanner after being combined. The combined beam may be a combined beam of red light, green light and blue light generated by R, G, B monochromatic lasers in a single group of laser light sources, or a combined beam of all lights of n groups of laser light sources, or both of the two combined beams, which is not limited herein.
The n monochromatic lasers of the same color channel in the n groups of laser light sources are configured to emit light of different wavelengths, and taking a red monochromatic laser as an example, an R1 monochromatic laser, an R2 monochromatic laser … … Rn monochromatic laser shown in fig. 2 generate red light, but generate red light of different wavelengths. Similarly, the G1 monochromatic laser and the G2 monochromatic laser … … Gn monochromatic laser generate green light, but generate green light with different wavelengths; the B1 and B2 … … Bn monochromatic lasers, although both producing blue light, produce blue light of different wavelengths; in fig. 2, the laser scanner 102 is taken as an example of an optical fiber scanner, and reference numeral 1021 denotes a scanning optical fiber.
The image source 10 may be a functional module based on an optical fiber scanner or an MEMS scanner, and as long as the light-emitting source can use a wavelength division multiplexing method, the pixel light information including one or more images in the same pixel light spot emitted can be used as the image source 10 in the embodiment of the present invention.
Specifically, when the laser scanner 102 is a fiber scanner, the fiber scanner includes at least one scanning fiber and at least one actuator (e.g., a piezoelectric actuator), and the actuator drives the scanning fiber to perform two-dimensional scanning in the space under the action of the driving signal. For example, an XY type two-dimensional scanner whose scanning directions include an x direction and a y direction perpendicular to each other scans an image with a fast axis in the x direction and a slow axis in the y direction perpendicular to the x direction. Each brake can drive one or more scanning optical fibers, and one scanning optical fiber of the optical fiber scanner corresponds to one path of input light source 101; if the fiber scanner includes more than two fibers, the wavelength configuration of the input light source 101 corresponding to each fiber is the same. The optical fiber scanner provided by the embodiment of the invention is suitable for optical fiber scanners with various scanning modes, such as deleting format scanning, spiral scanning and the like.
When the laser scanner 102 is an MEMS scanner, the beams generated by the groups of light sources of the input light source 101 are combined and then reflected by the scanning mirror of the MEMS scanner to scan out, which is consistent with the implementation process of the existing method and will not be described here.
Optionally, an eyepiece optical device may be further disposed in the near-eye display device, where the eyepiece optical device is disposed in one-to-one correspondence with at least one image source 10, as shown in fig. 1 (no reference numeral in the figure), and the eyepiece optical device may be configured to collimate all light beams emitted by the corresponding image source 10 to form parallel light, and emit the parallel light into the waveguide module 20 according to a corresponding angle.
The waveguide module 20 is disposed on an outgoing light path of at least one image source 10, a waveguide 201 of the waveguide module 20 is provided with a coupling-in unit 202, a relay unit 203, a coupling-out unit 204 and a feedback light-emitting unit 205, which are in one-to-one correspondence, and the feedback light-emitting unit 205 is disposed on the coupling-out unit 204 or is disposed adjacent to the relay unit 203 in a pupil expanding direction of the relay unit 203. The coupling-in unit 202 is configured to couple image light generated by the image source 10 into the waveguide 201, and then the relay unit 203 performs pupil expansion and transmission on the full-view image light, the full-view image light transmitted to the coupling-out unit 204 is coupled out to human eyes by the coupling-out unit 204 to form a display image, and the feedback light-emitting unit 205 couples out a part of energy of the full-view image light to form a feedback image, where light energy corresponding to the feedback image is greater than minimum image light energy required for image detection by the detection component 30.
In the embodiment of the present invention, the coupling-in unit 202, the relay unit 203, the coupling-out unit 204, and the feedback light-emitting unit 205 disposed in the waveguide module 20 may all adopt a grating structure. In order to ensure that the energy transmitted to the light feedback unit 205 by the full-view image is greater than the minimum light energy for image detection by the detection component 30, the grating region of the relay unit 203 or the coupling-out unit 204 adjacent to the light feedback unit 205 is optimized in advance, so that the light intensity of the image light transmitted to the light feedback unit 205 is not reduced to zero, that is, the light feedback unit 205 is ensured to always receive and couple out a part of the full-view image light with energy. Specifically, the grating structure of the feedback light-emitting unit 205 may be designed to be perpendicular to the grating direction of the grating structure of the coupling-in unit 202, or the grating structure of the feedback light-emitting unit 205 may be designed to be the same as the grating structure of the coupling-out unit 204.
In practical applications, the feedback light-emitting unit 205 may be disposed at the transmission end of the relay unit 203 far away from the coupling-in unit 202 in the pupil expanding direction, or the feedback light-emitting unit 205 may also be located at the edge region of the coupling-out unit 204 to avoid blocking the light of the display image and affecting the viewing effect of the user. Fig. 3A and 3B are schematic front views of the structure of the waveguide module 20 according to the embodiment of the invention, wherein the relay unit 203 is in a wedge shape gradually increasing in the pupil expanding direction (e.g. x-axis direction) to enhance the pupil expanding and transmission effect of the coupled-in light beam.
In fig. 3A, the feedback light-emitting unit 205 in the waveguide module 20 is disposed adjacent to the relay unit 203, and the feedback light-emitting unit 205 is located at the transmission end of the relay unit 203. In this structure, after the full-field image light emitted from the input light source is coupled into the waveguide 201 by the coupling-in unit 202, the full-field image light in the waveguide 201 is transmitted and expanded by the relay unit 203, and then the full-field image light transmitted to the coupling-out unit 204 is coupled out by the coupling-out unit 204 to be spliced to form a display image, and simultaneously, the image light (the part also includes all fields of view) transmitted to the light splitting part of the feedback light-emitting unit 205 by the relay unit 203 is coupled out of the waveguide 201 by the feedback light-emitting unit 205 to be spliced to form a feedback image and enter the detection component 30.
In fig. 3B, the waveguide module 20 is located at a side region of the feedback light-emitting unit 205. Of course, in practical applications, a part of the grating structure of the coupling-out unit 204 may be directly processed as the feedback light-emitting unit 205, or the feedback light-emitting unit 205 may also be located at the bottom edge region of the coupling-out unit 204. The feedback light-emitting unit 205 couples a portion of the energy of the image light of the full field of view out of the waveguide 201. In this structure, image light of all fields of view is coupled into the waveguide 201 through the coupling-in unit 202, the relay unit 203 transmits and expands a pupil of the light in the waveguide 201 according to a first direction (e.g., X direction), the grating of the relay unit 203 diffracts the image light acting on the grating toward the coupling-out unit 204 again according to a second direction (e.g., Y direction), the coupling-out unit 204 receives the image light and then couples the image light acting on the grating out of the waveguide 201 to enter human eyes, and meanwhile, a part of energy (including all fields of view) of the image light is transmitted to the feedback light-emitting unit 205 to be coupled out to form a feedback image.
In the embodiment of the present invention, the coupling-out direction of the feedback light-emitting unit 205 and the coupling-out direction of the coupling-out unit 204 may be the same or opposite. On the basis of satisfying the grating structure, if the coupling-out direction (i.e., the light direction) of the light feedback and output unit 205 needs to be changed, only the corresponding placement surface of the grating structure of the light feedback and output unit 205 in the waveguide 201 needs to be changed.
In a possible embodiment, when the coupling-out direction of the feedback light-emitting unit 205 is the same as the coupling-out direction of the coupling-out unit 204, for example, both facing the eye direction of the wearer, the feedback light-emitting unit 205 may be disposed on the same surface of the relay unit 203 or the coupling-out unit 204 as the coupling-out surface of the coupling-out unit 204, so that the direction of the coupled-out light is the same as the direction of the coupled-out light of the coupling-out unit 204. Further, if the grating structure of the feedback light-emitting unit 205 is the same as the grating structure of the coupling-out unit 204, and the feedback light-emitting unit 205 is disposed on the coupling-out unit 204, the feedback light-emitting unit 205 may also be located in an edge region of the coupling-out unit 204, such as a side edge or a bottom edge of the coupling-out unit 204 in fig. 3B, so as to avoid blocking light of the display image. Preferably, the light feedback unit 205 may be a partial grating structure in the light coupling-out unit 204, that is, the light coupling-out unit 204 and the light feedback unit 205 are integrated, as shown in fig. 4A, a letter a represents a coupling-out surface of the light coupling-out unit 204, and an arrow represents a coupling-out direction of the full-field image light in the corresponding grating structure.
In another possible embodiment, if the coupling-out direction of the feedback light-emitting unit 205 is opposite to the coupling-out direction of the coupling-out unit 204, the feedback light-emitting unit 205 is disposed on a surface of the relay unit 203 or the coupling-out unit 204 opposite to the coupling-out surface of the coupling-out unit 204, as shown in fig. 4B, where a letter a represents the coupling-out surface of the coupling-out unit 204, and the feedback light-emitting unit 205 is disposed on the coupling-out surface B of the coupling-out unit 204 opposite to the coupling-out surface a, for example, adhered to the coupling-out surface B, and the coupling-out direction of the feedback light-emitting unit 205 is opposite to the coupling-out direction of the coupling-out unit 204.
In practical applications, the waveguide module 20 may be designed into different forms according to practical applications, for example, the waveguide module 20 may include a plurality of stacked waveguides, or may include one or more waveguides in which a plurality of layers of the coupling-in unit 202, the relay unit 203, the coupling-out unit 204, and the feedback light-emitting unit 205 are disposed. The waveguide module 20 is used to separate (e.g., separate according to sub-images) and transmit light beams of each wavelength/waveband in the full-field image light beams generated by the image source 10, and a part of the full-field image light transmitted in the waveguide 201 is coupled out by the coupling-out unit 204 and spliced into an image to be displayed, and another part of the full-field image light transmitted to the feedback light-emitting unit 205 is coupled out by the coupling-out unit 204 and spliced into a feedback image. For example, if a group of light sources in the input light source 101 includes three light emitting units of RGB, and the image to be displayed corresponds to n sub-images, when each sub-image is modulated by R, G, B three light emitting units, 3 × n layers of the coupling-in unit 202, the relay unit 203, the coupling-out unit 204, and the feedback light-emitting unit 205 may be disposed in the waveguide 201 of the waveguide module 20. For example, the waveguide module 20 includes 3 × n stacked waveguides 201, each waveguide 201 has a one-to-one corresponding coupling-in unit 202, relay unit 203, coupling-out unit 204, and feedback-out unit 205, and each waveguide 201 corresponds to light of one wavelength.
It should be noted that, in practical applications, when the feedback light-emitting unit 205 is designed on the coupling-out unit 204, the relay unit 203 in the waveguide module 20 can be reserved or eliminated according to practical requirements, without affecting the light beam transmission and feedback effects of the waveguide module of the present invention.
The detecting component 30 is disposed on the light coupling-out path of the light feedback unit 205, and is configured to receive the image coupled out by the light feedback unit 205 and convert an electrical signal according to the feedback image to determine whether the feedback image is the same as the image to be displayed. The detecting member 30 may be a Charge Coupled Device (CCD), and the CCD camera is a semiconductor Device capable of converting an optical image into an electrical signal. Then, a part of the full-field light of the image to be displayed in the waveguide module 20 is coupled out to the CCD through the feedback light-emitting unit 205, and the CCD receives the feedback image, and then converts the received image (light signal) into an electrical signal, and outputs and feeds back the electrical signal to the processor. The electrical signal may represent information such as content, pixel distribution, brightness, and color of the feedback image.
In practical implementation, the coupling-out direction of the feedback light-out unit 205 is the same as or opposite to the coupling-out direction of the coupling-out unit 204. Accordingly, the position where the detecting member 30 is disposed differs according to the coupling-out direction of the feedback light-emitting unit 205. Specifically, if the coupling-out direction of the feedback light-emitting unit 205 is the same as the coupling-out direction of the coupling-out unit 204, for example, both are on the light-in side (i.e., the human eye side) of the waveguide 201, the detecting member 30 is also located on the light-in side of the waveguide module 20, and is on the same side as the human eye, the position of the detecting member 30 does not interfere with the projected image, and the position selectivity is large, for example, the detecting member can be located on a lens barrel, a lens frame, or other positions; alternatively, if the coupling-out direction of the feedback light-out unit 205 is opposite to the coupling-out direction of the coupling-out unit 204, the detection member 30 may be located on the opposite side of the light-in side, i.e., the back side of the waveguide 201.
The processor, which has data processing and control functions, may be a separate physical component or a logical component, and may be integrated in the near-eye display module, the image source 10, or the waveguide module 20, without limitation. After receiving the electrical signal fed back by the detection component 30, the processor can determine whether the feedback image is consistent with the calibration image according to the electrical signal; if the two images are determined to be inconsistent, it is indicated that the projected image of the laser scanner 102 has deformation, and the processor can correct the emergent image of the image source 10 to make the emergent image identical to the calibrated image to be displayed. The calibration image may be a predetermined standard projection image corresponding to the image to be displayed, and may have a standard swing, squareness, and a correct horizontal/vertical position, and the calibration image may change in real time along with the image to be displayed in the projection process.
If the processor determines that a deviation occurs between the image coupled out by the feedback light-emitting unit 205 and the calibration image, such as amplitude, contour squareness, verticality, posture, etc., the processor may adjust to the calibration image; or if the spliced image is cracked, adjusting the splicing gap to be gapless. The image emitted from the laser scanner 102 may have an ellipse or a swing variation, an image tilt, and the like, and when the detection component 30 detects the problem, the feedback image may be corrected to the calibration image through real-time feedback.
For example, if the laser scanner 102 is an XY two-dimensional fiber scanner, the processor may determine whether the feedback image is a parallelogram with obtuse angles, and if so, may make a perpendicular line to the opposite side with two obtuse vertices as the starting points, to obtain a new rectangular region; the new rectangular area can be used as an effective display area for laser modulation; comparing the feedback image with a standard projection image of an image to be displayed to obtain an inclination angle between the feedback image and the standard projection image in the horizontal direction; then, the driving signal corresponding to the effective display area can be calculated and corrected according to the inclination angle, so that the effective display area becomes a horizontal rectangle; or calculating and correcting the deflection angle of the optical path turner corresponding to the effective display area according to the inclination angle so that the effective display area becomes a horizontal rectangle after the optical path turner deflects according to the deflection angle.
Therefore, in the near-eye display module in the embodiment of the present invention, the detection component 30 performs visual detection feedback on the image light projected by the feedback light-emitting unit 205, so as to realize stability detection and splicing fusion detection of an image, and further realize adaptive adjustment of the image through the processor.
In another embodiment, the input light source 101 may include an external environment light source, and the coupling-in unit 202 may further couple the current environment image light into the waveguide 201, and the partial full-view environment image light is coupled out after reaching the feedback light-emitting unit 205 through the transmission and the pupil of the relay unit 203 or the coupling-out unit 204. At this time, the processor may also adjust the display brightness of the image source 10 according to the brightness of the image formed by the ambient image light emitted from the feedback light-emitting unit 205, and/or make a corresponding reaction according to the content of the ambient image, for example, determine the overlapping position of AR information according to the captured scene image, and so on.
Optionally, a beam splitter, not shown in the figure, may be disposed on an outgoing light path of at least one image source 10, and configured to split light beams with different wavelengths/wave bands in a mixed light beam of an image to be displayed, for example, to split R, G, B light beams, and further, light beams with different wavelength ranges may be coupled into the waveguide module 20 through corresponding coupling-in units 202, so that the light beam splitting operation and part of the field angle adjustment operation may be performed, and the design difficulty and the processing difficulty of the waveguide module 20 may be reduced.
In practical applications, when a plurality of image sources 10 are used to simultaneously modulate different image portions of an image to be displayed, the light beams of the plurality of image sources 10 are spliced together before being incident on the beam splitter. The beam splitter may include a plurality of dichroic filters, which may be one or more of a band pass filter, a short pass filter, and a long pass filter, and is configured to split light beams having different wavelengths, and the exit angle of each split light beam may be adjusted by designing the reflection angle of the dichroic filter. When the beam splitter adopts a plurality of long-wave pass filters, the cut-off wavelength of the long-wave pass filters is gradually increased; when the beam splitter adopts a short-wave-pass filter, the cut-off wavelength of the short-wave-pass filter is gradually reduced; each layer of incoupling units 202 only incouples light beams of one wavelength of the mixed light beam of the image to be displayed. In practice, three waves of the same image portion are reflectedFilter for long light beam with same reflection angle and reflecting different sub-image light beamsLight (es)The reflection angles are different between the devices.
In the near-eye display module in the embodiment of the present invention, a part of light for projecting a display image is projected to the detection component 30 through the feedback light-emitting unit 205 in the waveguide module 20 to form a feedback electrical signal, so that the projection effect of the coupled-out image can be fed back, if distortion, sub-image splicing dislocation, or the like occurs; meanwhile, the adopted optical fiber scanning display is separated from the limitation of material pixels, the pixel grid of the optical fiber scanning display is a space area which is divided artificially, and the uniform and preset image display can be realized by modulating laser according to the preset modulation time, so that under the condition of obtaining a feedback signal, if the image is determined to generate deformation, such as image deformation similar to optical distortion, fish-eye effect and the like, non-uniform pixel size, irregular display area and various deformation forms, the near-eye display module adjusts the projection image by changing the laser modulation parameter and/or the control signal of the scanner (such as controlling the amplitude, frequency and the like of the optical fiber in the brake) to enable the projection image to be consistent with or close to a calibration image, feeds back and corrects the projection image in real time, and effectively improves the projection effect.
Based on the same inventive concept, the embodiment of the invention also provides near-eye display equipment, which can comprise two sets of near-eye display modules, wherein light rays emitted by the two sets of near-eye display modules respectively enter two eyes of a user, so that virtual reality display or augmented reality display is realized.
In one possible implementation, the near-eye display device may be a head-mounted display device, as shown in fig. 5. The near-eye display device may be configured with the near-eye (e.g., AR/VR) display module in the above embodiments and a head-mounted component (e.g., a temple or other wearing device) for wearing on the head of the user, and the near-eye display module may be mounted on the head-mounted component (e.g., the temple or other location) and positioned to direct the light beam to the eye of the wearer. Various changes and specific examples of the near-eye display module in the foregoing embodiments are also applicable to the near-eye display device in this embodiment, and through the foregoing detailed description of the near-eye display module, those skilled in the art can clearly know the implementation of the near-eye display device in this embodiment, so that for the sake of brevity of the description, detailed description is not repeated here.
All of the features disclosed in this specification, or all of the steps in any method or process so disclosed, may be combined in any combination, except combinations of features and/or steps that are mutually exclusive.
Any feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving equivalent or similar purposes, unless expressly stated otherwise. That is, unless expressly stated otherwise, each feature is only an example of a generic series of equivalent or similar features.
The invention is not limited to the foregoing embodiments. The invention extends to any novel feature or any novel combination of features disclosed in this specification and any novel method or process steps or any novel combination of features disclosed.

Claims (10)

1. A waveguide module is characterized by comprising a waveguide, and a coupling-in unit, a relay unit, a coupling-out unit and a feedback light-emitting unit which are arranged in the waveguide in a one-to-one correspondence manner; the coupling-in unit is used for coupling the full-field image light generated by the image source into the waveguide, the relay unit is used for expanding the pupil and transmitting the full-field image light, and the full-field image light transmitted to the coupling-out unit is coupled out by the coupling-out unit to form a display image; the light feedback unit is arranged on the coupling-out unit or is arranged adjacent to the relay unit in the pupil expanding direction of the relay unit, and the light feedback unit is used for coupling out part of energy of the full-field image light to form a feedback image.
2. The waveguide module of claim 1, wherein the light feedback unit is disposed at a transmission end of the relay unit away from the coupling-in unit in a pupil expanding direction, or is located at an edge region of the coupling-out unit.
3. The waveguide module of claim 2, wherein the coupling-in unit, the relay unit, the feedback light-emitting unit and the coupling-out unit are all grating structures.
4. The waveguide module of claim 3, wherein the grating structure of the feedback light unit is perpendicular to the grating direction of the grating structure of the coupling-in unit; or the grating structure of the light feedback and output unit is the same as that of the coupling-out unit.
5. The waveguide module of claim 4, wherein the coupling-out direction of the feedback light unit is the same as or opposite to the coupling-out direction of the coupling-out unit.
6. The waveguide module of claim 5, wherein when the coupling-out direction of the light feedback unit is the same as the coupling-out direction of the coupling-out unit, if the grating structure of the light feedback unit is the same as the grating structure of the coupling-out unit and the light feedback unit is disposed on the coupling-out unit, the light feedback unit is a partial grating structure in the coupling-out unit.
7. The waveguide module of claim 5, wherein the light feedback unit is disposed on a surface of the relay unit or the coupling-out unit opposite to the coupling-out surface of the coupling-out unit when the coupling-out direction of the light feedback unit is opposite to the coupling-out direction of the coupling-out unit.
8. A near-to-eye display module based on a waveguide, comprising:
the image display device comprises at least one image source, a display unit and a control unit, wherein the image source is used for emitting light for forming an image to be displayed, each image source comprises an input light source and a corresponding laser scanner, the input light source is used for emitting image light for the image to be displayed, and the laser scanner is used for scanning and emitting the image light; the images emitted by the image sources form different parts of a complete image with a corresponding large field angle, and the image formed by the light emitted by each image source has a corresponding sub-field angle;
the waveguide module of any one of claims 1 to 7, disposed on an outgoing light path of the at least one image source, wherein a full-field image of an image to be displayed generated by the at least one image source is coupled into the waveguide module, and then coupled out by an out-coupling unit in the waveguide module to be spliced into the image to be displayed, and a part of energy of the full-field image light is coupled out by the feedback out-light unit to form a feedback image;
and the detection part is arranged on the coupling light path of the feedback light-emitting unit and used for receiving the feedback image and generating a corresponding electric signal as a feedback signal according to the feedback image.
9. The near-eye display module of claim 8, wherein the near-eye display module further comprises:
and the processor is connected with the detection component and the at least one image source and used for receiving the electric signals output by the detection component, judging whether the feedback image of the feedback light-emitting unit is the same as the image to be displayed or not according to the electric signals and correcting the image corresponding to the emergent light of the at least one image source when the situation that the image is different is determined.
10. A near-eye display device comprising the near-eye display module of claim 8 or 9.
CN201910550146.6A 2019-06-24 2019-06-24 Waveguide module, near-to-eye display module based on waveguide and near-to-eye display equipment Active CN112130321B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910550146.6A CN112130321B (en) 2019-06-24 2019-06-24 Waveguide module, near-to-eye display module based on waveguide and near-to-eye display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910550146.6A CN112130321B (en) 2019-06-24 2019-06-24 Waveguide module, near-to-eye display module based on waveguide and near-to-eye display equipment

Publications (2)

Publication Number Publication Date
CN112130321A true CN112130321A (en) 2020-12-25
CN112130321B CN112130321B (en) 2023-06-27

Family

ID=73849049

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910550146.6A Active CN112130321B (en) 2019-06-24 2019-06-24 Waveguide module, near-to-eye display module based on waveguide and near-to-eye display equipment

Country Status (1)

Country Link
CN (1) CN112130321B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023071474A1 (en) * 2021-10-27 2023-05-04 上海鲲游科技有限公司 Optical waveguide device and manufacturing method therefor

Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2604843A1 (en) * 1976-02-07 1977-08-11 Exnii Metallorezh Stankov Spark erosion machine with automatic control - has optical reading head to control cutting tool through electronic circuit
US5416876A (en) * 1994-01-28 1995-05-16 Hughes Training, Inc. Fiber optic ribbon subminiature display for head/helmet mounted display
JPH0961682A (en) * 1995-08-22 1997-03-07 Hamamatsu Photonics Kk Light source position adjusting device
US20060215244A1 (en) * 2003-12-02 2006-09-28 Jacob Yosha Vehicle display system
US20090316116A1 (en) * 2008-05-19 2009-12-24 University Of Washington Uw Techtransfer - Invention Licensing Scanning laser projection display for small handheld devices
US20110063194A1 (en) * 2009-09-16 2011-03-17 Brother Kogyo Kabushiki Kaisha Head mounted display device
CN102427758A (en) * 2009-05-15 2012-04-25 皇家飞利浦电子股份有限公司 An optical probe with feedback correction
CN103649816A (en) * 2011-07-12 2014-03-19 谷歌公司 Whole image scanning mirror display system
US20150036105A1 (en) * 2012-12-26 2015-02-05 Citizen Holdings Co., Ltd. Projection apparatus
WO2015192117A1 (en) * 2014-06-14 2015-12-17 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
JP2016009103A (en) * 2014-06-25 2016-01-18 船井電機株式会社 Optical instrument
CN105911700A (en) * 2016-07-01 2016-08-31 成都理想境界科技有限公司 Near-to-eye display system, virtual reality equipment and augmented reality equipment
WO2017129029A1 (en) * 2016-01-29 2017-08-03 北京灵犀微光科技有限公司 Waveguide-based display system
US20180003805A1 (en) * 2015-01-20 2018-01-04 Digilens, Inc. Holographic waveguide lidar
WO2018057528A1 (en) * 2016-09-21 2018-03-29 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
CN107924103A (en) * 2015-06-15 2018-04-17 奇跃公司 Display system with the optical element for interior coupling multiplexing light stream
WO2018081636A1 (en) * 2016-10-28 2018-05-03 Magic Leap, Inc. Method and system for large field of view display with scanning reflector
CN207689753U (en) * 2017-10-31 2018-08-03 成都理想境界科技有限公司 A kind of optical fiber scanning projection arrangement and projection device
CN108431583A (en) * 2015-12-22 2018-08-21 微视公司 System and method for the feedback control in scanning projector
WO2018175548A1 (en) * 2017-03-21 2018-09-27 Magic Leap, Inc. Method and system for tracking eye movement in conjunction with a light scanning projector
US20180286320A1 (en) * 2017-04-03 2018-10-04 Microsoft Technology Licensing, Llc Wide field of view scanning display
JPWO2017130352A1 (en) * 2016-01-28 2018-10-04 オリンパス株式会社 Optical fiber scanning system and endoscope system
WO2018200140A1 (en) * 2017-04-28 2018-11-01 Microsoft Technology Licensing, Llc Compact display engine with mems scanners
CN108803023A (en) * 2018-02-13 2018-11-13 成都理想境界科技有限公司 The nearly eye display module of simple eye big visual field, display methods and head-mounted display apparatus
CN108803021A (en) * 2018-02-12 2018-11-13 成都理想境界科技有限公司 A kind of near-eye display system wears display equipment and light field display methods
CN108873332A (en) * 2018-05-24 2018-11-23 成都理想境界科技有限公司 The nearly eye display module of simple eye big visual field, display methods and head-mounted display apparatus
CN109416432A (en) * 2016-05-12 2019-03-01 奇跃公司 Distributed light manipulation on imaging guides
CN109613696A (en) * 2018-12-12 2019-04-12 深圳创维新世界科技有限公司 Optical fiber scanning projection arrangement and electronic equipment
CN109856796A (en) * 2018-11-20 2019-06-07 成都理想境界科技有限公司 Image source mould group, waveguide, near-eye display system and its control method
CN208998751U (en) * 2018-12-12 2019-06-18 深圳创维新世界科技有限公司 Optical Fiber Projection scanning means and electronic equipment with track detection

Patent Citations (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2604843A1 (en) * 1976-02-07 1977-08-11 Exnii Metallorezh Stankov Spark erosion machine with automatic control - has optical reading head to control cutting tool through electronic circuit
US5416876A (en) * 1994-01-28 1995-05-16 Hughes Training, Inc. Fiber optic ribbon subminiature display for head/helmet mounted display
JPH0961682A (en) * 1995-08-22 1997-03-07 Hamamatsu Photonics Kk Light source position adjusting device
US20060215244A1 (en) * 2003-12-02 2006-09-28 Jacob Yosha Vehicle display system
US20090316116A1 (en) * 2008-05-19 2009-12-24 University Of Washington Uw Techtransfer - Invention Licensing Scanning laser projection display for small handheld devices
CN102427758A (en) * 2009-05-15 2012-04-25 皇家飞利浦电子股份有限公司 An optical probe with feedback correction
US20110063194A1 (en) * 2009-09-16 2011-03-17 Brother Kogyo Kabushiki Kaisha Head mounted display device
CN103649816A (en) * 2011-07-12 2014-03-19 谷歌公司 Whole image scanning mirror display system
US20150036105A1 (en) * 2012-12-26 2015-02-05 Citizen Holdings Co., Ltd. Projection apparatus
WO2015192117A1 (en) * 2014-06-14 2015-12-17 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
JP2016009103A (en) * 2014-06-25 2016-01-18 船井電機株式会社 Optical instrument
US20180003805A1 (en) * 2015-01-20 2018-01-04 Digilens, Inc. Holographic waveguide lidar
CN107924103A (en) * 2015-06-15 2018-04-17 奇跃公司 Display system with the optical element for interior coupling multiplexing light stream
CN108431583A (en) * 2015-12-22 2018-08-21 微视公司 System and method for the feedback control in scanning projector
JPWO2017130352A1 (en) * 2016-01-28 2018-10-04 オリンパス株式会社 Optical fiber scanning system and endoscope system
US20180353056A1 (en) * 2016-01-28 2018-12-13 Olympus Corporation Optical fiber scanning system and endoscope system
WO2017129029A1 (en) * 2016-01-29 2017-08-03 北京灵犀微光科技有限公司 Waveguide-based display system
CN109416432A (en) * 2016-05-12 2019-03-01 奇跃公司 Distributed light manipulation on imaging guides
CN105911700A (en) * 2016-07-01 2016-08-31 成都理想境界科技有限公司 Near-to-eye display system, virtual reality equipment and augmented reality equipment
WO2018057528A1 (en) * 2016-09-21 2018-03-29 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
CN109863435A (en) * 2016-09-21 2019-06-07 奇跃公司 System and method for the optical system with emergent pupil expander
WO2018081636A1 (en) * 2016-10-28 2018-05-03 Magic Leap, Inc. Method and system for large field of view display with scanning reflector
WO2018175548A1 (en) * 2017-03-21 2018-09-27 Magic Leap, Inc. Method and system for tracking eye movement in conjunction with a light scanning projector
US20180286320A1 (en) * 2017-04-03 2018-10-04 Microsoft Technology Licensing, Llc Wide field of view scanning display
WO2018200140A1 (en) * 2017-04-28 2018-11-01 Microsoft Technology Licensing, Llc Compact display engine with mems scanners
CN207689753U (en) * 2017-10-31 2018-08-03 成都理想境界科技有限公司 A kind of optical fiber scanning projection arrangement and projection device
CN108803021A (en) * 2018-02-12 2018-11-13 成都理想境界科技有限公司 A kind of near-eye display system wears display equipment and light field display methods
CN108803023A (en) * 2018-02-13 2018-11-13 成都理想境界科技有限公司 The nearly eye display module of simple eye big visual field, display methods and head-mounted display apparatus
CN108873332A (en) * 2018-05-24 2018-11-23 成都理想境界科技有限公司 The nearly eye display module of simple eye big visual field, display methods and head-mounted display apparatus
CN109856796A (en) * 2018-11-20 2019-06-07 成都理想境界科技有限公司 Image source mould group, waveguide, near-eye display system and its control method
CN109613696A (en) * 2018-12-12 2019-04-12 深圳创维新世界科技有限公司 Optical fiber scanning projection arrangement and electronic equipment
CN208998751U (en) * 2018-12-12 2019-06-18 深圳创维新世界科技有限公司 Optical Fiber Projection scanning means and electronic equipment with track detection

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
何宇婧等: ""基于反馈环全光纤干涉的一种新型光声检测方法"", 《复旦学报:自然科学版》 *
何宇婧等: ""基于反馈环全光纤干涉的一种新型光声检测方法"", 《复旦学报:自然科学版》, no. 1, 31 January 2016 (2016-01-31) *
宗磊;: "专利视角下的AR显示技术及产品分析", 中国发明与专利, no. 07 *
王文晓;张谦;徐国祥;: "头戴式增强现实显示设备技术综述", 河南科技, no. 17 *
王蕴琦: ""沉浸式头戴显示光学系统关键技术研究"", 《中国博士学位论文全文数据库信息科技辑》, no. 10 *
相广鑫;郭岩;李文强;闫占军;谢意;周家武;: "L型全息波导构型设计", 电光与控制, no. 03 *
齐丽杰: ""基于数字微镜扫描的大视场全息图像拼接技术研究"", 《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》 *
齐丽杰: ""基于数字微镜扫描的大视场全息图像拼接技术研究"", 《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》, 15 June 2019 (2019-06-15) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023071474A1 (en) * 2021-10-27 2023-05-04 上海鲲游科技有限公司 Optical waveguide device and manufacturing method therefor

Also Published As

Publication number Publication date
CN112130321B (en) 2023-06-27

Similar Documents

Publication Publication Date Title
JP6308630B2 (en) Directional illumination waveguide arrangement
EP1952189B1 (en) Display with image-guiding substrate
KR0181726B1 (en) A color helmet mountable display
WO2019152538A1 (en) Method and system for large field of view display with scanning mirror having optical power
JP2007219562A (en) Virtual retinal display with fiber optic point source
JP2021517269A (en) Single-chip ultra-bright light emitting diode array for waveguide displays
US11782276B2 (en) Systems and methods to reduce bounce spacing and double-bounce in waveguides
US9236028B2 (en) Image display apparatus
CN112130321B (en) Waveguide module, near-to-eye display module based on waveguide and near-to-eye display equipment
US20230060689A1 (en) Video projection device
CN114624807A (en) Waveguide module, display module based on waveguide and near-to-eye display equipment
CN112015035B (en) Polarized light source, scanning projection device and equipment
US10690919B1 (en) Superluminous LED array for waveguide display
CN116057446A (en) Beam scanner with PIC input and display device based on beam scanner
JP2002372677A (en) Projection type image display and multiplexing optical system for the same
CN214540354U (en) Optical fiber coupling light source module and optical fiber scanning imaging system
US20240126089A1 (en) Reflective facet waveguide with dual reflective facet configuration
US20220269084A1 (en) Multiple laser light source sets for scanning display systems
US20230066767A1 (en) Systems and methods to minimize double-bounce in waveguides
JP6776748B2 (en) Light source device, image display device
CN115542542A (en) Cascaded eye-box extension in augmented reality image projection devices
JP2004177477A (en) Luminous flux irradiation apparatus and image display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant