CN114007056A - Method and device for generating three-dimensional panoramic image - Google Patents
Method and device for generating three-dimensional panoramic image Download PDFInfo
- Publication number
- CN114007056A CN114007056A CN202111261549.2A CN202111261549A CN114007056A CN 114007056 A CN114007056 A CN 114007056A CN 202111261549 A CN202111261549 A CN 202111261549A CN 114007056 A CN114007056 A CN 114007056A
- Authority
- CN
- China
- Prior art keywords
- image
- orientation
- shooting
- scene
- orientation information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Abstract
The embodiment of the invention provides a method and a device for generating a three-dimensional panoramic image. The method comprises the following steps: the method comprises the steps of collecting scene images, obtaining shooting orientation information, adopting the shooting orientation information to label the scene images to obtain orientation label images, adjusting the shooting orientation of a camera, repeating the steps for multiple times to obtain multiple groups of orientation label images, adopting the multiple groups of orientation label images to carry out image splicing, and generating the three-dimensional panoramic image.
Description
Technical Field
The invention relates to the technical field of generation of a three-dimensional panoramic image, in particular to a method and a device for generating a three-dimensional panoramic image.
Background
In the existing mobile phone panoramic shooting mode, a plurality of pictures continuously shot by a mobile phone are generally synthesized into one picture, the shooting mode can only generate the effect of one wide-width plane picture, the stereoscopic space sense is lacked, and a user cannot obtain immersive experience.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a generation method of a stereoscopic panorama image and a corresponding generation apparatus of a stereoscopic panorama image that overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a method for generating a stereoscopic panoramic image, where the method includes:
acquiring a scene image;
acquiring shooting orientation information;
marking the scene image by adopting the shooting orientation information to obtain an orientation marking image;
adjusting the shooting direction of the camera;
repeating the steps for multiple times to obtain multiple groups of orientation labeling images;
and performing image splicing by adopting the plurality of groups of orientation labeling images to generate a three-dimensional panoramic image.
Optionally, the step of adjusting the shooting orientation of the camera includes:
acquiring shooting parameters of a camera;
acquiring historical shooting orientation information;
determining a first scene view angle which is not shot according to the shooting parameters and the historical shooting orientation information;
and adjusting the shooting orientation of the camera based on the first scene visual angle.
Optionally, the step of performing image stitching by using the plurality of sets of orientation labeling images to generate a stereoscopic panoramic image includes:
analyzing the orientation marking image to obtain a scene image and shooting orientation information;
establishing a virtual three-dimensional space;
determining a virtual space azimuth in the virtual three-dimensional space according to the shooting orientation information;
displaying the scene image in the virtual spatial orientation;
repeating the steps for multiple times to obtain an original three-dimensional panoramic image;
and cutting and splicing the overlapped parts of the adjacent images in the original three-dimensional panoramic image to obtain the three-dimensional panoramic image.
Optionally, the shooting parameters include a shooting angle of view.
The embodiment of the invention also discloses a device for generating the three-dimensional panoramic image, which comprises:
the scene image acquisition module is used for acquiring a scene image;
the shooting orientation information acquisition module is used for acquiring shooting orientation information;
the information marking module is used for marking the scene image by adopting the shooting orientation information to obtain an orientation marking image;
the shooting orientation adjusting module is used for adjusting the shooting orientation of the camera;
the orientation annotation image generation module is used for repeating the steps for multiple times to obtain multiple groups of orientation annotation images;
and the stereoscopic panoramic image construction module is used for splicing the images by adopting the plurality of groups of orientation labeling images to generate a stereoscopic panoramic image.
Optionally, the shooting orientation adjusting module includes:
the shooting parameter acquisition module is used for acquiring shooting parameters of the camera;
the historical shooting orientation information acquisition module is used for acquiring historical shooting orientation information;
determining a first scene view angle which is not shot according to the shooting parameters and the historical shooting orientation information;
and adjusting the shooting orientation of the camera based on the first scene visual angle.
Optionally, the stereoscopic panorama image constructing module includes:
the orientation annotation image analysis submodule is used for analyzing the orientation annotation image to obtain a scene image and shooting orientation information;
the virtual three-dimensional space establishing submodule is used for establishing a virtual three-dimensional space;
the virtual space azimuth determining submodule is used for determining a virtual space azimuth in the virtual three-dimensional space according to the shooting orientation information;
a scene image display sub-module for displaying the scene image in the virtual spatial orientation;
the original three-dimensional panoramic image generation submodule is used for repeating the steps for multiple times to obtain an original three-dimensional panoramic image;
and the image cutting and splicing submodule is used for cutting and splicing the overlapped parts of the adjacent images in the original three-dimensional panoramic image to obtain the three-dimensional panoramic image.
Optionally, the shooting parameters include a shooting angle of view.
The embodiment of the invention has the following advantages: the method comprises the steps of collecting scene images, obtaining shooting orientation information, adopting the shooting orientation information to label the scene images to obtain orientation label images, adjusting the shooting orientation of a camera, repeating the steps for multiple times to obtain multiple groups of orientation label images, adopting the multiple groups of orientation label images to carry out image splicing, and generating the three-dimensional panoramic image.
Drawings
Fig. 1 is a flowchart illustrating a first step of a method for generating a stereoscopic panorama according to a first embodiment of the present invention.
Fig. 2 is a block diagram showing a configuration of a second embodiment of a stereoscopic panorama image generating apparatus according to the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart illustrating a first step of a first method for generating a stereoscopic panoramic image according to the present invention is shown, and specifically, the method may include the following steps:
in the embodiment of the present invention, first, an image of a scene of an environment is collected in any shooting direction, specifically, the image can be collected by a camera of the mobile terminal, for example, a rear camera of a mobile phone is used to collect an image in the front direction.
102, acquiring shooting orientation information;
after a scene image of an environment is acquired in any shooting orientation, the shooting orientation is determined, namely shooting orientation information is acquired, wherein the shooting orientation information is a spatial orientation. Specifically, the acquisition of the orientation information may be performed by a direction sensor in the mobile terminal, and the orientation information may be represented in a space vector manner.
103, marking the scene image by using the shooting orientation information to obtain an orientation marking image;
after the scene image and the shooting orientation information are collected, the shooting orientation information is adopted to label the scene image, and an orientation labeling image is obtained. The orientation-labeled image after the orientation information labeling carries the shooting orientation information at the time of shooting the image.
after a scene image is collected towards a certain direction, the shooting orientation of the camera is adjusted, and the rest angles in the environment are shot. In order to avoid unnecessary data processing due to the fact that scene images at the same angle are shot, the angle of view at which shooting is not performed needs to be determined before the shooting orientation of the camera is adjusted. In practical application, the smaller the adjustment range of the shooting direction of each time is, the finer the three-dimensional panoramic image is finally generated, and the larger the adjustment range of the shooting direction of each time is, the coarser the three-dimensional panoramic image is finally generated.
Specifically, the step of adjusting the shooting orientation of the camera includes:
acquiring shooting parameters of a camera;
the shooting parameters comprise a shooting angle of view.
Acquiring historical shooting orientation information; the historical shooting orientation information is information of an orientation in which the scene image has been shot, for example, if the scene image has been shot in the front and above, the historical shooting orientation information is in the front and above.
Determining a first scene view angle which is not shot according to the shooting parameters and the historical shooting orientation information;
in practical applications, as is well known, a stereoscopic panoramic view angle is spherical, a shooting view angle of a camera is generally a circular view angle, a scene view angle which is shot can be obtained according to the shooting view angle and historical shooting orientation information, and then a first scene view angle which is not shot is finally obtained by combining the spherical panoramic view angle.
And adjusting the shooting orientation of the camera based on the first scene visual angle.
105, repeating the steps for multiple times to obtain multiple groups of orientation annotation images;
and after the steps are repeated for multiple times, acquiring the stereo full-angle scene images to obtain multiple groups of orientation annotation images.
And 106, performing image splicing by adopting the plurality of groups of orientation labeling images to generate a three-dimensional panoramic image.
And adopting the plurality of groups of orientation labeling images to carry out image splicing, wherein the step of generating the three-dimensional panoramic image comprises the following steps:
analyzing the orientation marking image to obtain a scene image and shooting orientation information;
establishing a virtual three-dimensional space;
determining a virtual space azimuth in the virtual three-dimensional space according to the shooting orientation information;
displaying the scene image in the virtual spatial orientation;
repeating the steps for multiple times to obtain an original three-dimensional panoramic image;
and cutting and splicing the overlapped parts of the adjacent images in the original three-dimensional panoramic image to obtain the three-dimensional panoramic image.
In the embodiment of the invention, the scene image is collected, the shooting orientation information is obtained, the scene image is marked by adopting the shooting orientation information to obtain the orientation marking image, the shooting orientation of the camera is adjusted, the steps are repeated for a plurality of times to obtain a plurality of groups of orientation marking images, and the plurality of groups of orientation marking images are adopted to carry out image splicing to generate the three-dimensional panoramic image.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 2, a block diagram of a first embodiment of an apparatus for generating a stereoscopic panorama image according to the present invention is shown, and may specifically include the following modules:
a scene image acquisition module 201, configured to acquire a scene image;
a shooting orientation information obtaining module 202, configured to obtain shooting orientation information;
the information labeling module 203 is configured to label the scene image with the shooting orientation information to obtain an orientation labeled image;
a shooting orientation adjusting module 204, configured to adjust a shooting orientation of the camera;
an orientation annotation image generation module 205, configured to repeat the above steps for multiple times to obtain multiple sets of orientation annotation images;
and the stereoscopic panoramic image construction module 206 is configured to perform image stitching by using the multiple sets of orientation labeling images to generate a stereoscopic panoramic image.
In an embodiment of the present invention, the photographing orientation adjusting module includes:
the shooting parameter acquisition module is used for acquiring shooting parameters of the camera;
the historical shooting orientation information acquisition module is used for acquiring historical shooting orientation information;
determining a first scene view angle which is not shot according to the shooting parameters and the historical shooting orientation information;
and adjusting the shooting orientation of the camera based on the first scene visual angle.
In the embodiment of the present invention, the stereoscopic panorama image constructing module includes:
the orientation annotation image analysis submodule is used for analyzing the orientation annotation image to obtain a scene image and shooting orientation information;
the virtual three-dimensional space establishing submodule is used for establishing a virtual three-dimensional space;
the virtual space azimuth determining submodule is used for determining a virtual space azimuth in the virtual three-dimensional space according to the shooting orientation information;
a scene image display sub-module for displaying the scene image in the virtual spatial orientation;
the original three-dimensional panoramic image generation submodule is used for repeating the steps for multiple times to obtain an original three-dimensional panoramic image;
and the image cutting and splicing submodule is used for cutting and splicing the overlapped parts of the adjacent images in the original three-dimensional panoramic image to obtain the three-dimensional panoramic image.
In an embodiment of the present invention, the shooting parameters include a shooting angle of view.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
An embodiment of the present invention further provides an apparatus, including:
the method comprises a processor, a memory and a computer program which is stored in the memory and can run on the processor, wherein when the computer program is executed by the processor, each process of the embodiment of the method for generating the stereoscopic panoramic image is realized, the same technical effect can be achieved, and the method is not repeated herein for avoiding repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the above-mentioned method for generating a stereoscopic panoramic image, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method for generating a stereoscopic panoramic image and the device for generating a stereoscopic panoramic image provided by the present invention are described in detail above, and a specific example is applied in the text to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be some modifications in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (9)
1. A method for generating a stereoscopic panoramic image, the method comprising:
acquiring a scene image;
acquiring shooting orientation information;
marking the scene image by adopting the shooting orientation information to obtain an orientation marking image;
adjusting the shooting direction of the camera;
repeating the steps for multiple times to obtain multiple groups of orientation labeling images;
and performing image splicing by adopting the plurality of groups of orientation labeling images to generate a three-dimensional panoramic image.
2. The method of claim 1, wherein the step of adjusting the shooting orientation of the camera comprises:
acquiring shooting parameters of a camera;
acquiring historical shooting orientation information;
determining a first scene view angle which is not shot according to the shooting parameters and the historical shooting orientation information;
and adjusting the shooting orientation of the camera based on the first scene visual angle.
3. The method of claim 1, wherein the step of generating the stereoscopic panoramic image by image stitching using the plurality of sets of orientation labeled images comprises:
analyzing the orientation marking image to obtain a scene image and shooting orientation information;
establishing a virtual three-dimensional space;
determining a virtual space azimuth in the virtual three-dimensional space according to the shooting orientation information;
displaying the scene image in the virtual spatial orientation;
repeating the steps for multiple times to obtain an original three-dimensional panoramic image;
and cutting and splicing the overlapped parts of the adjacent images in the original three-dimensional panoramic image to obtain the three-dimensional panoramic image.
4. The method of claim 2, wherein the camera parameters comprise camera view angle.
5. An apparatus for generating a stereoscopic panorama image, the method comprising:
the scene image acquisition module is used for acquiring a scene image;
the shooting orientation information acquisition module is used for acquiring shooting orientation information;
the information marking module is used for marking the scene image by adopting the shooting orientation information to obtain an orientation marking image;
the shooting orientation adjusting module is used for adjusting the shooting orientation of the camera;
the orientation annotation image generation module is used for repeating the steps for multiple times to obtain multiple groups of orientation annotation images;
and the stereoscopic panoramic image construction module is used for splicing the images by adopting the plurality of groups of orientation labeling images to generate a stereoscopic panoramic image.
6. The apparatus of claim 1, wherein the photographing orientation adjusting module comprises:
the shooting parameter acquisition module is used for acquiring shooting parameters of the camera;
the historical shooting orientation information acquisition module is used for acquiring historical shooting orientation information;
determining a first scene view angle which is not shot according to the shooting parameters and the historical shooting orientation information;
and adjusting the shooting orientation of the camera based on the first scene visual angle.
7. The apparatus of claim 1, wherein the stereoscopic panorama image constructing module comprises:
the orientation annotation image analysis submodule is used for analyzing the orientation annotation image to obtain a scene image and shooting orientation information;
the virtual three-dimensional space establishing submodule is used for establishing a virtual three-dimensional space;
the virtual space azimuth determining submodule is used for determining a virtual space azimuth in the virtual three-dimensional space according to the shooting orientation information;
a scene image display sub-module for displaying the scene image in the virtual spatial orientation;
the original three-dimensional panoramic image generation submodule is used for repeating the steps for multiple times to obtain an original three-dimensional panoramic image;
and the image cutting and splicing submodule is used for cutting and splicing the overlapped parts of the adjacent images in the original three-dimensional panoramic image to obtain the three-dimensional panoramic image.
8. The apparatus of claim 6, wherein the camera parameters comprise camera view angle.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of a method of generating a stereoscopic panorama image as claimed in any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111261549.2A CN114007056A (en) | 2021-10-28 | 2021-10-28 | Method and device for generating three-dimensional panoramic image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111261549.2A CN114007056A (en) | 2021-10-28 | 2021-10-28 | Method and device for generating three-dimensional panoramic image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114007056A true CN114007056A (en) | 2022-02-01 |
Family
ID=79924497
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111261549.2A Pending CN114007056A (en) | 2021-10-28 | 2021-10-28 | Method and device for generating three-dimensional panoramic image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114007056A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086629A (en) * | 2022-06-10 | 2022-09-20 | 谭健 | Sphere multi-lens real-time panoramic three-dimensional imaging system |
-
2021
- 2021-10-28 CN CN202111261549.2A patent/CN114007056A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086629A (en) * | 2022-06-10 | 2022-09-20 | 谭健 | Sphere multi-lens real-time panoramic three-dimensional imaging system |
| CN115086629B (en) * | 2022-06-10 | 2024-02-27 | 谭健 | Real-time panoramic three-dimensional imaging system with multiple spherical lenses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3101624B1 (en) | Image processing method and image processing device | |
| US10410397B2 (en) | Picture presentation method and apparatus | |
| US9591237B2 (en) | Automated generation of panning shots | |
| US9756260B1 (en) | Synthetic camera lenses | |
| KR20140004592A (en) | Image blur based on 3d depth information | |
| JP2015208001A (en) | Method and electronic device for implementing refocusing | |
| CN105744138B (en) | Quick focusing method and electronic equipment | |
| CN107084740B (en) | Navigation method and device | |
| CN102474636A (en) | Adjusting perspective and disparity in stereoscopic image pairs | |
| CN107690673A (en) | Image processing method and device and server | |
| KR20150097987A (en) | Electronic device and method for processing image | |
| CN105701762B (en) | Picture processing method and electronic equipment | |
| US20100171815A1 (en) | Image data obtaining method and apparatus therefor | |
| CN105516579A (en) | Image processing method and device and electronic equipment | |
| JP2022500792A (en) | Image processing methods and devices, electronic devices and storage media | |
| CN105635568A (en) | Image processing method in mobile terminal and mobile terminal | |
| KR20150091064A (en) | Method and system for capturing a 3d image using single camera | |
| JP6552256B2 (en) | Image processing apparatus and image processing apparatus control method | |
| CN114007056A (en) | Method and device for generating three-dimensional panoramic image | |
| CN114742703A (en) | Method, device and equipment for generating binocular stereoscopic panoramic image and storage medium | |
| CN110012236A (en) | A kind of information processing method, device, equipment and computer storage medium | |
| WO2015115946A1 (en) | Methods for encoding and decoding three-dimensional video content | |
| CN105467741A (en) | Panoramic shooting method and terminal | |
| CN109300191A (en) | AR model treatment method, apparatus, electronic equipment and readable storage medium storing program for executing | |
| JP6405539B2 (en) | Label information processing apparatus for multi-viewpoint image and label information processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |