CN117608024A - Photoelectric separation type miniature projection optical structure based on image transmission optical fiber - Google Patents

Photoelectric separation type miniature projection optical structure based on image transmission optical fiber Download PDF

Info

Publication number
CN117608024A
CN117608024A CN202311708161.1A CN202311708161A CN117608024A CN 117608024 A CN117608024 A CN 117608024A CN 202311708161 A CN202311708161 A CN 202311708161A CN 117608024 A CN117608024 A CN 117608024A
Authority
CN
China
Prior art keywords
micro
optical fiber
optical
image transmission
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311708161.1A
Other languages
Chinese (zh)
Inventor
陈恩果
金华健
林子健
郝伟杰
陈慷慷
叶芸
徐胜
郭太良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN202311708161.1A priority Critical patent/CN117608024A/en
Publication of CN117608024A publication Critical patent/CN117608024A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/04Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings formed by bundles of fibres
    • G02B6/06Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings formed by bundles of fibres the relative position of the fibres being the same at both ends, e.g. for transporting images
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/22Telecentric objectives or lens systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/18Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical projection, e.g. combination of mirror and condenser and objective
    • G02B27/20Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical projection, e.g. combination of mirror and condenser and objective for imaging minute objects, e.g. light-pointer
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0013Means for improving the coupling-in of light from the light source into the light guide
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0033Means for improving the coupling-out of light from the light guide
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/142Adjusting of projection optics

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

The invention provides a photoelectric separation type miniature projection optical structure based on an image transmission optical fiber, which mainly comprises a display module, an optical module and an image transmission module; the display module is composed of one or more micro display chips and driving and power supply parts thereof; the optical module is an image space telecentric micro projection lens formed by at least one spherical or aspherical lens; the image transmission module is composed of a plurality of image transmission optical fibers which are clustered and arranged according to an array, and micro-collimation element arrays which are added when necessary. The invention realizes a micro projection structure with effectively separated optical module and electrical module by combining the micro display chip, the image transmission optical fiber and the micro projection lens, can be applied to near-eye display equipment such as intelligent helmets, intelligent glasses and the like, greatly enhances the structural flexibility, and is more suitable for being used in special environments with great influence on electronic devices such as underwater, strong magnetic fields and the like.

Description

Photoelectric separation type miniature projection optical structure based on image transmission optical fiber
Technical Field
The invention relates to the technical field of miniature projection and near-eye display, in particular to a photoelectric separation type miniature projection optical structure based on an image transmission optical fiber.
Background
Mini projection (PicoProjection): a miniaturized projection technique projects an image or video onto a screen or other surface by using a high brightness LED or laser light source. The miniature projection equipment is small in size, portable and flexible, is suitable for various environments and application scenes, and can be connected to various equipment, such as a smart phone, a tablet computer or a notebook computer, and the like, so that convenient projection experience is realized.
Near-eye display (Near-eye display), a display technology that projects images or information in front of the eyes of a user through a head-mounted display, smart glasses, or other portable device, may create an immersive Virtual Reality (VR) or Augmented Reality (AR) experience. The technology enables the user to see the virtual object in front of the eyes or to be overlapped with the real world information, and greatly expands the perception interface of the user.
The traditional miniature projection mainly depends on an LED or laser as a light source, and utilizes DLP, LCoS, LBS and other technologies to realize projection display, and the light source and the image source are generated by different devices, so that the structure has larger limitation, the traditional miniature projection cannot realize real miniature, and the self-luminous display chip such as MicroLED, microOLED is utilized to replace the light source and the image source, so that the structure is greatly simplified, and a better thought is provided for the miniature of projection. When the traditional miniature projection is applied to near-eye display equipment, the limitations of large volume, inflexible structure and the like exist, and meanwhile, the miniature projection is applied to some special use environments such as: the environment with large influence on electronic elements, such as underwater, strong magnetic field and the like, needs special waterproof, antimagnetic and other treatments on the near-to-eye display equipment, has high cost and high difficulty, and can further lead to the increase of the structural volume, thereby greatly reducing the use convenience and comfort.
Disclosure of Invention
In view of the above, the present invention aims to provide a photoelectric separation type micro projection optical structure based on an image transmission optical fiber, which can be applied to near-eye display devices such as intelligent helmets, intelligent glasses, etc., greatly enhances the structural flexibility, and is more suitable for being used in special environments with great influence on electronic devices such as underwater, strong magnetic fields, etc.
In order to achieve the above purpose, the invention adopts the following technical scheme: the device comprises a display module, an image transmission module and an optical module; the source image or video of the display module passes through the image transmission module and the optical module, and finally the screen is used as an image plane for observation;
the display module is composed of one or more micro display chips and driving and power supply parts thereof; when the optical structure can only display a monochromatic image, the display module is composed of a single monochromatic micro-display chip and a driving and power supply part thereof; when the optical structure can display full-color images, the display module consists of a full-color micro-display chip and a driving and power supply part thereof, or consists of three single-color micro-display chips and driving and power supply parts thereof;
the optical module is at least one micro projection lens which comprises a spherical surface, an aspherical surface, a geometrical optical element such as a Fresnel lens or a micro-nano optical element with imaging capability such as a super surface, and the micro projection lens projects an image to a physical screen;
the image transmission module is composed of a plurality of image transmission optical fibers which are bundled and arranged according to an array; an array of microcollimator elements is added in front of the display pixels, one microcollimator element corresponding to each optical fiber, or a plurality of optical fibers covered by one microcollimator element, each optical fiber being responsible for transmitting information of one pixel or information of a plurality of pixel sets. Here, the micro-collimating element array may be replaced by other elements, such as a super surface, a grating, a liquid crystal lens, etc., as the coupling light element.
In a preferred embodiment, the micro-display chip in the display module is configured to generate a source of micro-display images, and when the structure is capable of displaying only monochromatic images, the images are generated by a single piece of monochromatic micro-display chip, wherein each pixel or pixels is/are transmitted to the optical module through a set of micro-collimating elements and an optical fiber; when the structure can display full-color images, the images are generated by a single full-color micro-display chip or by three single-color micro-display chips; when the system image is generated by a single full-color micro-display chip, every three adjacent color light-emitting sub-pixels form a complete pixel, and the three sub-pixels are respectively transmitted to the optical module through a group of micro-collimation elements and an optical fiber, or the complete pixel is transmitted to the optical module through the same group of micro-collimation elements and the same optical fiber; when the system image is generated by three single-color micro-display chips, each pixel is generated by the luminous pixels corresponding to the three single-color micro-display chips, the pixels are respectively clustered by the corresponding micro-collimation elements through the color combination elements and then transmitted to the optical module through the same optical fiber, or the corresponding pixels of the three-color chips are respectively transmitted to the optical module through the corresponding micro-collimation elements and the optical fiber, and the color combination and the image combination are carried out at the coupling-out end of the image transmission optical fiber.
In a preferred embodiment, the pixel shape, pitch, and resolution on the microdisplay are redefined by image-transmitting fibers. When the system image is generated by a single full-color micro-display chip, the adjacent three color luminous pixels form a complete pixel, the shape of the sub-pixels comprises but is not limited to a circle, a triangle or a rectangle, and the arrangement structure comprises but is not limited to a stripe arrangement, a triangle form arrangement, a mosaic arrangement or a PenTileG arrangement; when the diagonal length of the pixel is smaller than the diameter of the fiber core, the pixel is transmitted to the coupling-out end through one fiber after being subjected to beam shaping by the corresponding micro-collimation elements, or is transmitted to the coupling-out end through one fiber after being subjected to beam shaping by the same group of micro-collimation elements, and at the moment, the resolution of the image at the coupling-out end is equal to that of the image generated by the micro-display chip; when the diagonal length of the pixel is larger than the diameter of the fiber core, the light emitted by one luminous pixel is correspondingly coupled into a plurality of adjacent optical fibers after passing through the micro-collimation element, and the resolution of the image at the coupling-out end is larger than the resolution of the image generated by the micro-display chip, so that super-resolution projection display is realized.
In a preferred embodiment, the micro-projection lens of the optical module is used for directly projecting the image transmitted by the image transmission optical fiber to a screen for display or projecting the image to the near-eye display device for entering the eye, and the lens of the micro-projection lens comprises materials such as glass, plastic or crystal, and the lens group structure comprises fresnel optical surface, super surface, folded optical path, pancake, double gluing and movable optical zoom structure; the miniature projection lens is preferably an image space telecentric light path structure, and the coupling efficiency with an image transmission optical fiber and the uniformity of a projection image are optimal at the moment; when the miniature projection lens is not in an image space telecentric light path structure, the system images normally, but the coupling efficiency from the image transmission optical fiber to the miniature projection lens is lower than that of the miniature projection lens, and the uniformity of the projected image is also reduced.
In a preferred embodiment, the image transmission module is used for collecting and transmitting the image light emitted by the display chip to the optical module, wherein the micro-collimating element adopts an array structure formed by at least one of a geometric optical element, a super surface and a photonic crystal diffraction optical element, and each micro-collimating element corresponds to the light emitting pixels one by one and is used for collimating the light beams emitted by the light emitting pixels, or one micro-collimating element covers a plurality of light emitting pixels; the image transmission optical fiber is an integrated optical device formed by arranging a plurality of optical fibers according to a certain rule; the numerical aperture of the image transmission optical fiber is smaller than or equal to the image space numerical aperture of the miniature projection lens in the corresponding optical module, and the coupling efficiency from the image transmission optical fiber to the miniature projection lens is highest at the moment; when the numerical aperture of the image transmission optical fiber is larger than that of the image side of the miniature projection lens in the corresponding optical module, the system can normally image, but the coupling efficiency from the image transmission optical fiber to the miniature projection lens is lower than that of the image transmission optical fiber, and the uniformity of the projected image is also reduced.
In a preferred embodiment, when the structure realizes full color through three single-color RGB micro-display chips, the structure is respectively coupled into optical fibers, and then the optical fiber bundles are coupled out to be combined with colors; or the color is combined by the X prism and then coupled into the optical fiber;
when the system is that the light emitted by the luminous pixels is respectively coupled into optical fibers after being collimated, and when the coupling-out ends of the optical fiber bundles are combined, the coupling-in ends of the image transmission optical fibers are divided into a first coupling-in end, a second coupling-in end and a third coupling-in end, which are respectively connected with a first micro display chip, a second micro display chip and a third micro display chip of RGB three colors, the corresponding coupling-out ends are single-ended outputs, wherein the three optical fibers respectively transmit corresponding sub-pixel points on three chips;
when the system is that the light emitted by the luminous pixels is collimated and then coupled into the optical fiber through the X-prism, three groups of single-color micro-display chips and the corresponding micro-collimation element arrays are respectively positioned on three incidence surfaces of the X-prism, the coupling-in ends of the image transmission optical fibers are positioned on the emergent surface of the X-prism, and the single-color light beams generated by the three groups of micro-display chips are transmitted to the optical module through the image transmission optical fibers after being collimated by the corresponding micro-collimation elements and the color combination of the X-prism and finally projected onto a screen or a near-eye display device.
In a preferred embodiment, when the diagonal length of the light emitting pixels is smaller than the diameter of the fiber core, the interval between two adjacent light emitting pixels or two groups of light emitting pixels is approximately equal to the diameter of the fiber cladding, the image transmission fiber array arrangement corresponds to the light emitting pixel array arrangement, the light emitting pixels are coupled with the optical fibers in pixel level, and one light emitting pixel light-emitting diode is coupled into one optical fiber or a full-color light beam formed by a group of three adjacent color light emitting sub-pixels is coupled into one optical fiber; when the optical fiber arrangement structure in the image transmission optical fiber is inconsistent with the luminous pixel arrangement structure, or the diameter of the fiber core of the optical fiber is unequal to the interval between two adjacent luminous pixels or the diagonal length of the luminous pixels is larger than the diameter of the fiber core of the optical fiber, the luminous pixels and the optical fiber are not coupled in pixel level, and the adjacent pixels may have crosstalk or the projection display pixels may be incomplete, but still can normally transmit images.
In a preferred embodiment, the light emitted by the luminous pixels of the micro-display chip can be directly coupled with the image transmission optical fiber, so that a micro-collimation element is not needed, or the light can be coupled into the image transmission optical fiber through the micro-collimation element to form indirect coupling; when the two are directly coupled, the distance h between the micro display chip and the optical fiber is smaller thanThe coupling efficiency reaches the optimum, wherein D is the diameter of a fiber core, D is the width of a pixel point, and theta is the included angle between incident light and an optical axis; when the light beam and the light beam are indirectly coupled, the coupling efficiency is related to the micro-collimation element, and the higher the proportion of the light beam which is incident on the fiber core and has an included angle smaller than the maximum incident angle of the optical fiber and the optical axis is, the higher the coupling efficiency is.
In a preferred embodiment, the optical structures are in a group number for outputting image beams corresponding to left or right eyes when applied to a direct-entry projection system or a head-mounted near-eye display device; or the number of the optical structures is two, and the optical structures are divided into a left near-eye display module and a right near-eye display module, which are respectively used for outputting image light beams corresponding to two eyes, wherein the near-eye display structures comprise, but are not limited to, a waveguide, a free-form surface and a 4f system; the display module is arranged on portable or fixed equipment and used for generating images and providing power, and the display module and the image transmission module are connected through the image transmission module, so that the effective separation of the optical module and the electric module is realized, and the display module is more suitable for special environments with large influence on electronic devices, such as underwater, strong magnetic fields and the like.
In a preferred embodiment, when used in an underwater, high magnetic field environment, the image transmission optical fiber and the miniature projection lens are positioned and fixed in a special way to prevent the imaging effect from being reduced due to the influence of factors such as water flow, pressure or vibration in the underwater environment, wherein the special way comprises but is not limited to: a waterproof and pressure-resistant protective sleeve is used around the image transmission optical fiber and the miniature projection lens, a waterproof adhesive or a magnetic element is used at the bottom or around the image transmission optical fiber and the miniature projection lens to fix the image transmission optical fiber and the miniature projection lens on a supporting structure, and a vibration absorbing material such as a spring is used around the image transmission optical fiber and the miniature projection lens to reduce the influence of external vibration on the image transmission optical fiber and the miniature projection lens; secondly, the optical module is made of a water pressure resistant and corrosion resistant material, and has reliability and stability after being invaded by water in an underwater environment; meanwhile, the optical module and the part connected with the image transmission optical fiber are required to be in a detachable structure, so that the optical module can be easily detached after being used or when needed, and dirt, sediment or other pollutants can be removed.
In a preferred embodiment, the optical structure may be combined with a conventional fiber optic scanning device to effect imaging on a screen or near-eye display device via the persistence of vision effect of the human eye. An optical fiber scanning structure is added at the coupling-out end of the image transmission optical fiber to serve as a vibration source, electrodes of the vibration source are divided into four parts according to a cross direction, and electric potential is applied to each electrode to enable the electrodes to be driven independently in the X-axis direction and the Y-axis direction. Vibration of resonance frequency different from 90 DEG phase is added in the X-axis direction and the Y-axis direction, and a spiral track is drawn with the amplitude gradually increasing. Compared with the single-pixel scanning imaging of the traditional single optical fiber, the structure realizes the surface pixel scanning imaging by utilizing the optical fiber bundle, and greatly improves the image transmission rate, the imaging size and the resolution.
Compared with the prior art, the invention has the following beneficial effects: through the combination of self-luminous micro-display chip, pass like optic fibre and miniature projection lens, realized the miniature projection structure of an optical module and the effective separation of electricity module, when being applied to near-to-eye display device such as intelligent helmet, intelligent glasses, optical module installs on near-to-eye display device for output image beam gets into the people's eye, display module can install on portable or fixed equipment, be used for generating the image, provide power etc. both pass through the image module and connect, greatly strengthen its flexibility simultaneously also more be fit for using in the special environment that influences great to electronic device such as under water, strong magnetic field.
Drawings
FIG. 1 is a schematic view of a structure of an embodiment of the present invention
FIG. 2 is a schematic diagram of a second embodiment of the present invention
FIG. 3 is a schematic view of a third embodiment of the present invention
FIG. 4 is a schematic diagram of a pixel structure with three fiber-coupled ends according to an embodiment of the present invention
FIG. 5 is a schematic diagram of a near-to-eye display according to an embodiment of the present invention
FIG. 6 is a schematic diagram showing a near-to-eye display according to an embodiment of the present invention
FIG. 7 is a schematic diagram of a third embodiment of the present invention applied to a near-eye display
FIG. 8 is a flow chart of an embodiment of the present invention
The reference numerals therein describe:
fig. 1:101: micro display chip, 102: an array of microcollimator elements, 103: image transmission optical fiber, 104: image fiber coupling in end, 105: image-transmitting fiber-optic coupling-out end, 106: image fiber coupling-out end section, 107: micro-projection lens, 108: projecting light;
fig. 2:1011: first micro display chip, 1012: a second micro display chip, 1013: third microdisplay chip, 1021: first array of microcollimator elements 1022: second array of microcollimator elements, 1023: third array of microcollimator elements, 103: image transmission optical fiber, 104: image fiber coupling in end, 105: image-transmitting fiber-optic coupling-out end, 106: image fiber coupling-out end section, 107: micro-projection lens, 108: projection light, 109: an X color combining prism;
fig. 3:1011: first micro display chip, 1012: a second micro display chip, 1013: third microdisplay chip, 1021: first array of microcollimator elements 1022: second array of microcollimator elements, 1023: third array of microcollimator elements, 103: image-transmitting optical fiber, 1041: image transmission optical fiber first coupling-in end, 1042: image transmission fiber second coupling-in end, 1043: image transmission optical fiber third coupling-in end, 105: image-transmitting fiber-optic coupling-out end, 106: image fiber coupling-out end section, 107: micro-projection lens, 108: projecting light;
fig. 4:1061: stripe (strip) arrangements; 1062: triangle form (Delta) arrangement; 1063: mosaic (mosaics) arrangement; 1064: pentilelrgb arrangement;
fig. 5:201: left micro-projection system, 202: right micro-projection system, 203: left near eye display module, 204: a right near-eye display module;
fig. 6:201: left miniature projection system, 202: right miniature projection system, 205: left near eye display module, 206: a right near-eye display module;
fig. 7:201: left miniature projection system, 202: right miniature projection system, 207: left near eye display module, 208: right near-eye display module, 2071: lens group, 2072: total reflection sheet, 2073: lens group, 2074: flat beam splitter, 2081: lens group, 2082: total reflection sheet, 2083: lens group, 2084: a flat beam splitter.
Detailed Description
The invention will be further described with reference to the accompanying drawings and examples.
It should be noted that the following detailed description is illustrative and is intended to provide further explanation of the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments in accordance with the present application; as used herein, the singular is also intended to include the plural unless the context clearly indicates otherwise, and furthermore, it is to be understood that the terms "comprises" and/or "comprising" when used in this specification are taken to specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof.
Example 1
As shown in fig. 1, the photoelectric separation type self-luminous micro projection optical structure based on image transmission optical fiber provided by the invention comprises three parts from a display image source to a screen or human eyes, namely a display module, an image transmission module and an optical module: wherein the display module is composed of a micro display chip 101 capable of generating micro display images and a driving and power supply part thereof; the image transmission module is positioned between the display module and the optical module and mainly comprises a plurality of image transmission optical fibers 103 which are clustered and arranged according to an array, and in order to improve the optical fiber clustering capacity, a micro-collimation element array 102 is added between the micro-display chip 101 and the coupling-in end of the image transmission optical fibers, wherein one group of micro-collimation elements corresponds to one optical fiber and is responsible for transmitting one pixel; the optical module is an image space telecentric micro-projection lens 107 composed of at least three spherical or aspheric lenses. The optical module is arranged on near-eye display equipment and used for outputting image light beams to enter eyes of people or directly projecting images onto a screen, the display module can be arranged on portable or fixed equipment and used for generating images, providing power and the like, and the two are connected through the image transmission module, so that the effective separation of the optical module and the electric module is realized, and the device is more suitable for special environments with great influence on electronic devices, such as underwater, strong magnetic fields and the like.
The Micro display chip 101 of the present embodiment is used for generating Micro display images, including but not limited to self-luminous display chips such as Micro-LEDs and Micro-OLEDs, and may be replaced by other passive light emitting structures capable of generating Micro display images, such as LCOS, LCD, DMD. And the micro display chip 101 may be a single-color or full-color self-luminous display chip, when the embodiment only can display a single-color pattern, each light emitting unit on the micro display chip 101 is responsible for one pixel, each pixel corresponds to one micro-collimating element in the micro-collimating element array 102, and the emitted light beam is transmitted to the optical module through one optical fiber in the image transmission optical fiber 103 after being collimated. Similarly, when the embodiment can display full-color patterns, every three adjacent color light emitting pixels on the micro display chip 101 form a complete pixel, and the complete pixel can correspond to one micro-collimating element in the micro-collimating element array 102, and the emitted light beam is transmitted to the optical module through one optical fiber in the image transmission optical fiber 103 after being collimated; or three adjacent color pixels respectively correspond to three adjacent micro-collimation elements in the collimation element array 102, and the emitted light beams are transmitted to the optical module through three adjacent optical fibers in the image transmission optical fiber 103 after being collimated.
The image transmission module of this embodiment is used for collecting and transmitting the image light emitted by the display chip to the optical module, and is composed of a micro-collimation element array 102 and an image transmission optical fiber 103. The micro-collimation element array 102 is used for collimating light beams emitted by the light-emitting pixels, and adopts an array structure formed by at least one of geometrical optical elements such as micro lenses, TIR lenses, reflecting cups and the like or diffraction optical elements such as super surfaces and photonic crystals, and each micro-collimation element corresponds to the light-emitting pixels one by one. The image transmission fiber 103 realizes image transmission through spatial transmission and change of light energy, the material of the image transmission fiber 103 can be quartz, glass or plastic, the end face structure of each fiber in the image transmission fiber coupling-in end 105 and the image transmission fiber coupling-out end 106 is mainly circular, or can be elliptical or polygonal, and the end face contour thereof reshapes the contour of a projection screen or an eye-entering pixel.
The micro-projection lens 107 of the present embodiment is used for projecting an image transmitted by an image-transmitting optical fiber onto a screen or a near-eye display device, and the lens may be made of glass, plastic, or crystalline material, and the lens group structure includes, but is not limited to, fresnel optical surface, super-surface, folded optical path, pancake, double-glue, active optical zoom structure, etc.
The projection lens constructed in this embodiment can directly project an image onto a physical screen; when the system is directly matched with human eyes, a near-eye display structure which is directly penetrated into the eyes can be formed by further combining with a subsequent optical system. Fig. 5-7 show three classical near-eye display structures combined with the present embodiment, wherein the left micro-projection system 201 and the right micro-projection system 202 are projection optical structures designed in the present embodiment, fig. 5 shows a structure for realizing near-eye display combined with a waveguide, fig. 6 shows a structure for realizing near-eye display combined with a freeform prism structure, and fig. 7 shows a structure for realizing retinal projection combined with a 4f system.
The working flow of the optical structure is shown in fig. 8, and the specific working states are as follows:
the optical device is started, the micro display chip 101 generates a micro display image, the micro display image enters the image transmission optical fiber coupling-in end 104 after being collimated by the micro collimating element array, the micro display image enters the micro projection lens 107 after being transmitted out of the image transmission optical fiber coupling-out end 105 after being spatially transmitted by the image transmission optical fiber 103, and finally is directly projected on a physical screen or enters human eyes through a near-eye display structure.
Example two
As shown in fig. 2, the photoelectric separation type self-luminous micro projection optical structure based on image transmission optical fiber provided by the invention comprises three parts from a display image source to a screen or human eyes, namely a display module, an image transmission module and an optical module: wherein the display module is composed of a first micro display chip 1011, a second micro display chip 1012, a third micro display chip 1013, and driving and power supply parts thereof, which can generate micro display images; the image transmission module is positioned between the display module and the optical module and mainly comprises a large number of image transmission optical fibers 103 which are clustered and arranged according to an array, and in order to realize full color and improve the optical fiber bundling capacity through three single-color micro display chips, a first micro display chip 1011, a second micro display chip 1012, a third micro display chip 1013 and an image transmission optical fiber coupling-in end are added with a first micro collimation element array 1021, a second micro collimation element array 1022, a third micro collimation element array 1023 and an X color combining prism 109; the optical module is an image space telecentric micro-projection lens 107 composed of at least three spherical or aspheric lenses. The optical module is arranged on near-eye display equipment and used for outputting image light beams to enter eyes of people or directly projecting images onto a screen, the display module can be arranged on portable or fixed equipment and used for generating images, providing power and the like, and the two are connected through the image transmission module, so that the effective separation of the optical module and the electric module is realized, and the device is more suitable for special environments with great influence on electronic devices, such as underwater, strong magnetic fields and the like.
The first Micro display chip 1011, the second Micro display chip 1012 and the third Micro display chip 1013 of the present embodiment are used to generate Micro display images, including but not limited to self-luminous display chips such as Micro-LEDs and Micro-OLEDs, and can be replaced by other passive light emitting structures capable of generating Micro display images, such as LCOS, LCD, DMD. The first micro display chip 1011, the second micro display chip 1012 and the third micro display chip 1013 are respectively single-color micro display chips with three colors of RGB, each light emitting unit is responsible for one pixel, each pixel corresponds to one micro collimating element in the first micro collimating element array 1021, the second micro collimating element array 1022 and the third micro collimating element array 1023 respectively, and the emitted light beams are transmitted to the optical module through one optical fiber in the image transmission optical fiber 103 after being collimated by the micro collimating element array and combined with the color of the X-color combining prism.
The image transmission module of the present embodiment is configured to collect and transmit the image light emitted by the display chip to the optical module, and is composed of five parts, namely, a first micro-collimating element array 1021, a second micro-collimating element array 1022, a third micro-collimating element array 1023, a color combining prism 109 and an image transmission optical fiber 103. The three micro-collimation element arrays are used for collimating light beams emitted by the luminous pixels, and adopt an array structure formed by at least one of geometrical optical elements such as micro lenses, TIR lenses, reflecting cups and the like or diffraction optical elements such as super surfaces and photonic crystals, and each micro-collimation element corresponds to the luminous pixels one by one. The color combining prism 109 combines the collimated three-color microdisplay images to form a full-color microdisplay image. The image transmission fiber 103 realizes image transmission through spatial transmission and change of light energy, the material of the image transmission fiber 103 can be quartz, glass or plastic, the end face structure of each fiber in the image transmission fiber coupling-in end 105 and the image transmission fiber coupling-out end 106 is mainly circular, or can be elliptical or polygonal, and the end face contour thereof reshapes the contour of a projection screen or an eye-entering pixel.
The micro projection lens 107 of the present embodiment is similar to that of embodiment 1 and will not be repeated here.
The projection lens constructed in this embodiment can directly project an image onto a physical screen or be directly used with the human eye, and its structure is similar to that of embodiment 1 and will not be repeated here.
The working flow of the optical structure is shown in fig. 8, and the specific working states are as follows:
the optical device is started, the first micro display chip 1011, the second micro display chip 1012 and the third micro display chip 1013 generate three single-color micro display images of RGB, the three micro display images are collimated by the micro collimating element array and combined by the color combining prism 109 to form a full-color micro display image, then the full-color micro display image enters the image transmitting optical fiber coupling end 104, the full-color micro display image is transmitted in space by the image transmitting optical fiber 103, then the full-color micro display image is transmitted out of the image transmitting optical fiber coupling end 105 and enters the micro projection lens 107, and finally the full-color micro display image is directly projected on a physical screen or enters human eyes through a near-eye display structure.
Example III
As shown in fig. 3, the photoelectric separation type self-luminous micro projection optical structure based on the image transmission optical fiber provided by the invention comprises three parts from a display image source to a screen or human eyes, namely a display module, an image transmission module and an optical module: wherein the display module is composed of a first micro display chip 1011, a second micro display chip 1012, a third micro display chip 1013, and driving and power supply parts thereof, which can generate micro display images; the image transmission module is positioned between the display module and the optical module and mainly comprises a large number of image transmission optical fibers 103 which are clustered and arranged according to an array, in order to realize full color and improve the optical fiber bundling capacity through three single-color micro display chips, the image transmission optical fibers are changed from single-end coupling into three-end coupling, and a first micro-collimation element array 1021, a second micro-collimation element array 1022 and a third micro-collimation element array 1023 are added between the first micro-display chip 1011, the second micro-display chip 1012, the third micro-display chip 1013 and the image transmission optical fiber coupling-in ends; the optical module is an image space telecentric micro-projection lens 107 composed of at least three spherical or aspheric lenses. The optical module is arranged on near-eye display equipment and used for outputting image light beams to enter eyes of people or directly projecting images onto a screen, the display module can be arranged on portable or fixed equipment and used for generating images, providing power and the like, and the two are connected through the image transmission module, so that the effective separation of the optical module and the electric module is realized, and the device is more suitable for special environments with great influence on electronic devices, such as underwater, strong magnetic fields and the like.
The first Micro display chip 1011, the second Micro display chip 1012 and the third Micro display chip 1013 of the present embodiment are used to generate Micro display images, including but not limited to self-luminous display chips such as Micro-LEDs and Micro-OLEDs, and can be replaced by other passive light emitting structures capable of generating Micro display images, such as LCOS, LCD, DMD. The first micro display chip 1011, the second micro display chip 1012, and the third micro display chip 1013 are single color micro display chips of three colors of RGB, each light emitting unit is responsible for one pixel, each pixel corresponds to one micro collimating element in the first micro collimating element array 1021, the second micro collimating element array 1022, and the third micro collimating element array 1023, and the emitted light beams are coupled into the first coupling end 1041, the second coupling end 1042, and the third coupling end 1043 of the image transmission fiber after being collimated by the micro collimating element array, and the color combination is performed at the coupling end 105 of the image transmission fiber, and the cross-sectional structure is shown as 106, that is, each complete pixel is transmitted to the optical module through three optical fibers in the image transmission fiber 103.
The image transmission module of the present embodiment is configured to collect and transmit the image light emitted by the display chip to the optical module, and is composed of four parts, namely, a first micro-collimating element array 1021, a second micro-collimating element array 1022, a third micro-collimating element array 1023 and an image transmission optical fiber 103. The three micro-collimation element arrays are used for collimating light beams emitted by the luminous pixels, and adopt an array structure formed by at least one of geometrical optical elements such as micro lenses, TIR lenses, reflecting cups and the like or diffraction optical elements such as super surfaces and photonic crystals, and each micro-collimation element corresponds to the luminous pixels one by one. The image transmission fiber 103 realizes image transmission through spatial transmission and change of light energy, the material of the image transmission fiber 103 can be quartz, glass or plastic, the end face structure of each fiber in the image transmission fiber coupling-in end 105 and the image transmission fiber coupling-out end 106 is mainly circular, or can be elliptical or polygonal, and the end face contour thereof reshapes the contour of a projection screen or an eye-entering pixel.
The micro projection lens 107 of the present embodiment is similar to that of embodiment 1 and will not be repeated here.
The projection lens constructed in this embodiment can directly project an image onto a physical screen or be directly used with the human eye, and its structure is similar to that of embodiment 1 and will not be repeated here.
The working flow of the optical structure is shown in fig. 8, and the specific working states are as follows:
the optical device is started, the first micro display chip 1011, the second micro display chip 1012, and the third micro display chip 1013 generate three single color micro display images of RGB, and the three single color micro display images are collimated by the micro collimating element array and then respectively coupled into the first coupling-in end 1041 of the image transmission fiber, the second coupling-in end 1042 of the image transmission fiber, and the third coupling-in end 1043 of the image transmission fiber, and after spatial transmission by the image transmission fiber 103, color combination is performed at the coupling-out end 105 of the image transmission fiber, and finally enter the micro projection lens 107, and are directly projected on a physical screen or enter human eyes through a near-eye display structure.

Claims (10)

1. An optical structure of photoelectric separation type miniature projection based on image transmission optical fiber is characterized in that: the device comprises a display module, an image transmission module and an optical module; the source image or video of the display module passes through the image transmission module and the optical module, and finally the screen is used as an image plane for observation;
the display module is composed of one or more micro display chips and driving and power supply parts thereof; when the optical structure can only display a monochromatic image, the display module is composed of a single monochromatic micro-display chip and a driving and power supply part thereof; when the optical structure can display full-color images, the display module consists of a full-color micro-display chip and a driving and power supply part thereof, or consists of three single-color micro-display chips and driving and power supply parts thereof;
the optical module is at least one micro projection lens which comprises a spherical surface, an aspherical surface, a Fresnel lens geometric optical element or a micro-nano optical element with imaging capability such as a super surface and the like, and the micro projection lens projects an image to a physical screen;
the image transmission module is composed of a plurality of image transmission optical fibers which are bundled and arranged according to an array; adding a micro-collimation element array in front of the display pixels, wherein one micro-collimation element corresponds to one optical fiber or a plurality of optical fibers are covered by one micro-collimation element, and each optical fiber is responsible for transmitting information of one pixel or information of a plurality of pixel sets; here, the micro-collimating element array is used as a coupling light element, or other elements are used instead, such as a super surface, a grating, a liquid crystal lens.
2. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the micro display chip in the display module is used for generating a micro display image source, when the structure can only display a single-color image, the image is generated by a single-color micro display chip, and each luminous pixel or a plurality of luminous pixels are transmitted to the optical module through a group of micro collimation elements and an optical fiber; when the structure can display full-color images, the images are generated by a single full-color micro-display chip or by three single-color micro-display chips; when the system image is generated by a single full-color micro-display chip, every three adjacent color light-emitting sub-pixels form a complete pixel, and the three sub-pixels are respectively transmitted to the optical module through a group of micro-collimation elements and an optical fiber, or the complete pixel is transmitted to the optical module through the same group of micro-collimation elements and the same optical fiber; when the system image is generated by three single-color micro-display chips, each pixel is generated by the luminous pixels corresponding to the three single-color micro-display chips, the pixels are respectively clustered by the corresponding micro-collimation elements through the color combination elements and then transmitted to the optical module through the same optical fiber, or the corresponding pixels of the three-color chips are respectively transmitted to the optical module through the corresponding micro-collimation elements and the optical fiber, and the color combination and the image combination are carried out at the coupling-out end of the image transmission optical fiber.
3. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the shape, the spacing and the resolution of the pixels on the micro display screen are redefined by image transmission optical fibers; when the system image is generated by a single full-color micro-display chip, the adjacent three color luminous pixels form a complete pixel, the shape of each sub-pixel comprises a circle, a triangle or a rectangle, and the arrangement structure comprises a stripe arrangement, a triangle arrangement, a mosaic arrangement or a PenTile RGBG arrangement; when the diagonal length of the pixel is smaller than the diameter of the fiber core, the pixel is transmitted to the coupling-out end through one fiber after being subjected to beam shaping by the corresponding micro-collimation elements, or is transmitted to the coupling-out end through one fiber after being subjected to beam shaping by the same group of micro-collimation elements, and at the moment, the resolution of the image at the coupling-out end is equal to that of the image generated by the micro-display chip; when the diagonal length of the pixel is larger than the diameter of the fiber core, the light emitted by one luminous pixel is correspondingly coupled into a plurality of adjacent optical fibers after passing through the micro-collimation element, and the resolution of the image at the coupling-out end is larger than the resolution of the image generated by the micro-display chip, so that super-resolution projection display is realized.
4. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the miniature projection lens of the optical module is used for directly projecting an image transmitted by the image transmission optical fiber to a screen for display or projecting the image to the near-eye display device for entering the eye, the lens comprises glass, plastic or crystal materials, and the lens group structure comprises a Fresnel optical surface, a super surface, a folding optical path, a Pancake, a double-gluing and a movable optical zoom structure; the miniature projection lens is preferably an image space telecentric light path structure, and the coupling efficiency with an image transmission optical fiber and the uniformity of a projection image are optimal at the moment; when the miniature projection lens is not in an image space telecentric light path structure, the system images normally, but the coupling efficiency from the image transmission optical fiber to the miniature projection lens is lower than that of the miniature projection lens, and the uniformity of the projected image is also reduced.
5. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the image transmission module is used for collecting and transmitting image light emitted by the display chip to the optical module, wherein the micro-collimation element adopts an array structure formed by at least one of a geometric optical element, a super surface and a photonic crystal diffraction optical element, and each micro-collimation element corresponds to the luminous pixels one by one and is used for collimating light beams emitted by the luminous pixels or one micro-collimation element covers a plurality of luminous pixels; the image transmission optical fiber is an integrated optical device formed by arranging a plurality of optical fibers according to a certain rule; the numerical aperture of the image transmission optical fiber is smaller than or equal to the image space numerical aperture of the miniature projection lens in the corresponding optical module, and the coupling efficiency from the image transmission optical fiber to the miniature projection lens is highest at the moment; when the numerical aperture of the image transmission optical fiber is larger than that of the image side of the miniature projection lens in the corresponding optical module, the system can normally image, but the coupling efficiency from the image transmission optical fiber to the miniature projection lens is lower than that of the image transmission optical fiber, and the uniformity of the projected image is also reduced.
6. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1 or 2, wherein: when the structure realizes full color through three single-color RGB micro display chips, the three micro display chips are respectively coupled into optical fibers, and then the coupled ends of the optical fiber bundles are combined; or the color is combined by the X prism and then coupled into the optical fiber;
when the system is that the light emitted by the luminous pixels is respectively coupled into optical fibers after being collimated, and when the coupling-out ends of the optical fiber bundles are combined, the coupling-in ends of the image transmission optical fibers are divided into a first coupling-in end, a second coupling-in end and a third coupling-in end, which are respectively connected with a first micro display chip, a second micro display chip and a third micro display chip of RGB three colors, the corresponding coupling-out ends are single-ended outputs, wherein the three optical fibers respectively transmit corresponding sub-pixel points on three chips;
when the system is that the light emitted by the luminous pixels is collimated and then coupled into the optical fiber through the X-prism, three groups of single-color micro-display chips and corresponding micro-collimation element arrays thereof are respectively positioned on three incidence surfaces of the X-prism, the coupling-in ends of the image transmission optical fibers are positioned on the emergent surface of the X-prism, and the single-color light beams generated by the three groups of micro-display chips are transmitted to the optical module through the image transmission optical fibers after being collimated by the corresponding micro-collimation elements and the color combination of the X-prism and finally projected onto a screen or a near-eye display device;
when the diagonal length of the luminous pixels is smaller than the diameter of the fiber cores, the interval between two adjacent or two groups of luminous pixels is approximately equal to the diameter of the fiber cladding, the image transmission fiber array arrangement corresponds to the luminous pixel array arrangement, the luminous pixels are coupled with the optical fibers in a pixel level, and one luminous pixel light-out coupling is coupled into one optical fiber or a full-color light beam formed by a group of adjacent three color luminous sub-pixels is coupled into one optical fiber; when the optical fiber arrangement structure in the image transmission optical fiber is inconsistent with the luminous pixel arrangement structure, or the diameter of the fiber core of the optical fiber is unequal to the interval between two adjacent luminous pixels or the diagonal length of the luminous pixels is larger than the diameter of the fiber core of the optical fiber, the luminous pixels and the optical fiber are not coupled in pixel level, and the adjacent pixels may have crosstalk or the projection display pixels may be incomplete, but still can normally transmit images.
7. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the light emitted by the luminous pixels of the micro-display chip is directly coupled with the image transmission optical fiber, and a micro-collimation element is not needed at the moment, or the light is coupled into the image transmission optical fiber through the micro-collimation element again to form indirect coupling; when the two are directly coupled, the distance h between the micro display chip and the optical fiber is smaller thanThe coupling efficiency reaches the optimum, wherein D is the diameter of a fiber core, D is the width of a pixel point, and theta is the included angle between incident light and an optical axis; when the light beam and the light beam are indirectly coupled, the coupling efficiency is related to the micro-collimation element, and the higher the proportion of the light beam which is incident on the fiber core and has an included angle smaller than the maximum incident angle of the optical fiber and the optical axis is, the higher the coupling efficiency is.
8. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the number of optical structures is a set for outputting image beams corresponding to the left or right eye when applied to a direct-entry projection system or a head-mounted near-eye display device; or the number of the optical structures is two, and the optical structures are divided into a left near-eye display module and a right near-eye display module which are respectively used for outputting image light beams corresponding to two eyes, wherein the near-eye display structure comprises a waveguide, a free-form surface and a 4f system; the display module is arranged on portable or fixed equipment and used for generating images and providing power, and the display module and the image transmission module are connected through the image transmission module, so that the effective separation of the optical module and the electric module is realized, and the display module is more suitable for special environments with large influence on electronic devices, such as underwater, strong magnetic fields and the like.
9. The optical structure of claim 8, wherein the optical fiber is positioned and fixed with the micro-projection lens in a special way to prevent the imaging effect from being reduced due to factors such as water flow, pressure or vibration in the underwater environment, when the optical structure is used in the underwater, strong magnetic field environment, the special way comprises: a waterproof and pressure-resistant protective sleeve is used around the image transmission optical fiber and the miniature projection lens, a waterproof adhesive or a magnetic element is used at the bottom or around the image transmission optical fiber and the miniature projection lens to fix the image transmission optical fiber and the miniature projection lens on a supporting structure, and a vibration absorbing material such as a spring is used around the image transmission optical fiber and the miniature projection lens to reduce the influence of external vibration on the image transmission optical fiber and the miniature projection lens; secondly, the optical module is made of a water pressure resistant and corrosion resistant material, and has reliability and stability after being invaded by water in an underwater environment; meanwhile, the optical module and the part connected with the image transmission optical fiber are required to be in a detachable structure, so that the optical module can be easily detached after being used or when needed, and dirt, sediment or other pollutants can be removed.
10. The photoelectric separation type micro projection optical structure based on image transmission optical fiber according to claim 1, wherein: the optical structure is combined with a traditional optical fiber scanning device, and imaging is realized on a screen or a near-eye display device through the visual persistence effect of human eyes; an optical fiber scanning structure is added at the coupling-out end of an image transmission optical fiber to serve as a vibration source, electrodes of the vibration source are divided into four parts according to a cross direction, and electric potential is applied to each electrode to independently drive the electrodes in the X axis direction and the Y axis direction; vibration of resonance frequency different from 90 DEG phase is added in the X-axis direction and the Y-axis direction, and a spiral track is drawn with the amplitude gradually increasing.
CN202311708161.1A 2023-12-13 2023-12-13 Photoelectric separation type miniature projection optical structure based on image transmission optical fiber Pending CN117608024A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311708161.1A CN117608024A (en) 2023-12-13 2023-12-13 Photoelectric separation type miniature projection optical structure based on image transmission optical fiber

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311708161.1A CN117608024A (en) 2023-12-13 2023-12-13 Photoelectric separation type miniature projection optical structure based on image transmission optical fiber

Publications (1)

Publication Number Publication Date
CN117608024A true CN117608024A (en) 2024-02-27

Family

ID=89953485

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311708161.1A Pending CN117608024A (en) 2023-12-13 2023-12-13 Photoelectric separation type miniature projection optical structure based on image transmission optical fiber

Country Status (1)

Country Link
CN (1) CN117608024A (en)

Similar Documents

Publication Publication Date Title
US11119322B2 (en) Imaging display system
US20200225487A1 (en) Near-eye optical imaging system, near-eye display device and head-mounted display device
US8873148B1 (en) Eyepiece having total internal reflection based light folding
US7542209B2 (en) Compact head mounted display devices with tilted/decentered lens element
US7884985B2 (en) High brightness optical device
US7450310B2 (en) Head mounted display devices
US11275246B2 (en) Head-mounted display
US8666212B1 (en) Head mounted display using a fused fiber bundle
US7391573B2 (en) Substrate-guided optical devices
US20070177275A1 (en) Personal Display Using an Off-Axis Illuminator
US20050013005A1 (en) Optical combiner designs and head mounted displays
US20050018309A1 (en) Apparatus and methods for illuminating optical systems
US20070252954A1 (en) Beamsplitting structures and methods in optical systems
CN1637459A (en) Wearable color display system
CN112068314A (en) Near-to-eye display device
KR19990077317A (en) Color separation backlight
EP1538477A1 (en) Image display system and method for head-mounted viewing system
CN113009698A (en) Color display system and method and AR glasses
CN117608024A (en) Photoelectric separation type miniature projection optical structure based on image transmission optical fiber
CN114624807A (en) Waveguide module, display module based on waveguide and near-to-eye display equipment
CN114326123A (en) Near-to-eye display device
CN110687678B (en) Display module based on waveguide, image generation module and application thereof
CN217718277U (en) Head-up display device and vehicle based on augmented reality
CN217521440U (en) Waveguide structure
CN219891488U (en) Near-to-eye display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination