CN113240809A - Three-dimensional building model construction method - Google Patents
Three-dimensional building model construction method Download PDFInfo
- Publication number
- CN113240809A CN113240809A CN202110455680.6A CN202110455680A CN113240809A CN 113240809 A CN113240809 A CN 113240809A CN 202110455680 A CN202110455680 A CN 202110455680A CN 113240809 A CN113240809 A CN 113240809A
- Authority
- CN
- China
- Prior art keywords
- grid
- area
- image data
- grids
- base station
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/13—Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
- G06F30/23—Design optimisation, verification or simulation using finite element methods [FEM] or finite difference methods [FDM]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Geometry (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Structural Engineering (AREA)
- Computational Mathematics (AREA)
- Civil Engineering (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The application relates to a three-dimensional building model construction method, which comprises the following steps: dividing a current area into a grid area consisting of a plurality of grids, and determining an outward expansion area of the grid area; dividing the meshes of the mesh area into a first mesh and a second mesh according to whether the meshes are adjacent to the outward expansion area; sequentially carrying out flying photography along each grid to obtain image data, and after the flying of each first grid is finished, continuing to carry out flying photography along the extended area adjacent to the current first grid; and processing the image data. The beneficial effects are that: this application flies to shoot through carrying out outer expanding aviation to the grid region, has reduced the outer area that expands of flight, improves collection efficiency.
Description
Technical Field
The application relates to the technical field of aerial survey, in particular to a three-dimensional building model construction method.
Background
In the prior art, in a central area of a city, when a flight route is established according to a flight grid range, flight acquisition needs to be carried out on each grid extension to ensure the integrity of a three-dimensional data model. Influenced by factors such as data precision requirement and batteries, the unmanned aerial vehicle three-dimensional data acquisition flight speed is low, the acquisition efficiency is low, and the acquisition effective area is 1 square kilometer per day.
Disclosure of Invention
The application aims to solve the problems of low flight speed and low acquisition efficiency of unmanned aerial vehicle three-dimensional data acquisition in the prior art, provides a three-dimensional building model construction method,
a method of building a three-dimensional architectural model, the method comprising:
dividing a current area into a grid area consisting of a plurality of grids, and determining an outward expansion area of the grid area;
dividing the meshes of the mesh area into a first mesh and a second mesh according to whether the meshes are adjacent to the outward expansion area;
sequentially carrying out flying photography along each grid to obtain image data, and after the flying of each first grid is finished, continuing to carry out flying photography along the extended area adjacent to the current first grid;
and processing the image data.
Optionally, before dividing the current region into a mesh region composed of a plurality of meshes, the method further includes:
judging whether the current area has signals or not;
if yes, no treatment is carried out; otherwise, communication is carried out through a carrier phase differential technology;
wherein the communicating via carrier phase difference techniques comprises: the base station is arranged in a signal area, the power of the radio station is adjusted according to the distance from the current area, the mobile station is arranged on the acquisition equipment, the power of the mobile station is set to be the same as that of the base station, and the coordinate of the mobile station is calculated by receiving the coordinate signal of the base station.
Optionally, the adjusting the station power according to the distance from the current area includes:
if the linear distance between the current area and the set point of the base station exceeds 3km, the base station needs to use an external radio station to enhance the signal frequency, and if the linear distance between the current area and the set point of the base station is within 3km, the base station is used for carrying out signal transmission by using the built-in radio station of the base station.
Optionally, the dividing the current area into grid areas composed of a plurality of grids, and performing aviation flight photography along grid lines of each grid in sequence includes:
and dividing the current area into a plurality of grid areas according to the flight height and distance of the acquisition equipment, the image photographing range and the endurance time.
Optionally, the determining an outward expansion area of the grid area includes:
determining an outward propagation line at a periphery of the grid area,
wherein the area enclosed by the outer diffusion flight lines is larger than the area of the grid area.
Optionally, the processing the image data includes:
splicing a plurality of image data logically through a block merging technology;
carrying out independent grid filtering in each grid to enable data between adjacent grids to be mutually used;
the image data are photo sets collected by a plurality of collecting devices.
Optionally, the logically splicing the plurality of image data by the block merging technology includes:
recording the serial numbers of all the photos in the grid, the POS data and the camera parameters in an XML file;
and merging the XML files in the grids.
Optionally, the performing separate mesh filtering in each mesh to enable data interoperability between adjacent meshes includes:
and according to the XML file after the blocks are combined, when a photo is extracted from one grid, automatically extracting data of other grids around the grid.
Optionally, the method further includes modeling three-dimensional data according to the image data, including:
according to the image data, carrying out spatial triangulation processing on each grid to generate a space-three result;
and sequentially importing all the empty three results into a modeling system, pointing the engines of the task sequences of the empty three results to the same path, and sequentially submitting the modeling.
Optionally, the performing spatial triangulation processing on each mesh to generate a null-triplet result includes:
the space triangulation is realized by any one of a simulation method, an analytic method, a navigation method, an independent model method and a light beam method, and three control results are generated according to the pictures, POS values, camera parameters, picture control points and connection points of the grids.
Compared with the prior art, the beneficial effects of this application are: according to the method, the outward-expansion flight shooting is carried out on the grid area, so that the outward-expansion area of the flight is reduced, and the acquisition efficiency is improved; the problem that image control points cannot be distributed in a signal-free area is solved; meanwhile, automatic sequencing production of three-dimensional data modeling tasks is realized, the production efficiency and precision of the three-dimensional building model are improved, and the production cost and the production difficulty are reduced.
Drawings
Fig. 1 is a flow chart of a method of an embodiment of the present application.
Fig. 2 is a schematic diagram of a grid area and an extension area of a method according to an embodiment of the present application.
Detailed Description
The present application will be further described with reference to the following detailed description.
The same or similar reference numerals in the drawings of the embodiments of the present application correspond to the same or similar components; in the description of the present application, it is to be understood that the terms "upper", "lower", "left", "right", "top", "bottom", "inner", "outer", and the like, if any, are used in the orientations and positional relationships indicated in the drawings only for the convenience of describing the present application and for simplicity of description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and therefore the terms describing the positional relationships in the drawings are for illustrative purposes only and are not to be construed as limiting the present patent.
Furthermore, if the terms "first," "second," and the like are used for descriptive purposes only, they are used for mainly distinguishing different devices, elements or components (the specific types and configurations may be the same or different), and they are not used for indicating or implying relative importance or quantity among the devices, elements or components, but are not to be construed as indicating or implying relative importance.
In an embodiment as shown in fig. 1-2, the present application provides a method of building a three-dimensional architectural model, the method comprising:
100, dividing a current area into a grid area consisting of a plurality of grids, and determining an outward expansion area of the grid area; (ii) a In step 100, the current area is divided into a plurality of grid areas according to the flight height and distance of the acquisition device, the image shooting range and the endurance time.
200, dividing the grid of the grid area into a first grid and a second grid according to whether the grid is adjacent to the outward expansion area or not; (ii) a In step 200, the present application determines a first grid and a second grid according to whether the grids in the grid area are adjacent to or connected to the expanded area, where the first grid is a grid connected to the expanded area at the periphery of the grid area, and the second grid is an area inside the grid area and not connected to the expanded area.
300, sequentially carrying out flying photography along each grid to obtain image data, and after the flying of each first grid is finished, continuing to carry out flying photography along the extended area adjacent to the current first grid; in step 300, the acquisition device performs a flight acquisition along each grid in turn in this step. When the first grid flies, after the first grid flies, the first grid flies continuously along the adjacent flaring areas. When the flight is performed on the second grid, the flight is performed only along the grid lines of the second grid. The image data is processed 400. In step 400, image data is processed, including: splicing a plurality of image data logically through a block merging technology; carrying out independent grid filtering in each grid to enable data between adjacent grids to be mutually used; the image data are photo sets collected by a plurality of collecting devices.
According to the method, the outward-expansion flight shooting is carried out on the grid area, so that the outward-expansion area of the flight is reduced, and the acquisition efficiency is improved; the problem that image control points cannot be distributed in a signal-free area is solved; meanwhile, automatic sequencing production of three-dimensional data modeling tasks is realized, the production efficiency and precision of the three-dimensional building model are improved, and the production cost and the production difficulty are reduced.
In some embodiments, before dividing the current region into a grid region composed of a plurality of grids, further comprising: judging whether a signal exists in the current area; if yes, no treatment is carried out; otherwise, communication is carried out through a carrier phase differential technology; wherein, the communication by the carrier phase differential technique comprises: the base station is arranged in a signal area, the power of the radio station is adjusted according to the distance from the current area, the mobile station is arranged on the acquisition equipment, the power of the mobile station is set to be the same as that of the base station, and the coordinate of the mobile station is calculated by receiving the coordinate signal of the base station. In this embodiment, two sets of RTK devices, that is, carrier phase differential devices, are used for communication in a signal-free area, where one set of RTK devices is used as a base station, and one set of RTK devices is used as a mobile station, and the base station receiver receives accurate geographic position information, and the mobile station receiver receives signals in a radio station signal sending mode, and a three-dimensional coordinate and precision of the mobile station are resolved in real time by a carrier phase observation real-time differential technique.
In one implementation of the foregoing embodiment, adjusting the station power according to the distance from the current area includes: if the linear distance between the current area and the set point of the base station exceeds 3km, the base station needs to use an external radio station to enhance the signal frequency, and if the linear distance between the current area and the set point of the base station is within 3km, the base station is used for carrying out signal transmission by using the built-in radio station of the base station. By externally hanging the radio station, the signal frequency is enhanced. Communication between the base station and the mobile station is ensured.
In some embodiments, dividing the current region into a grid region comprised of a plurality of grids comprises: and dividing the current area into a plurality of grid areas according to the flight height and distance of the acquisition equipment, the image photographing range and the endurance time. After each grid of the grid area is divided, the acquisition equipment takes the grid lines as a path to carry out aerial photography and sequentially flies the grid lines of all the grids. Referring to fig. 2, 1 is a grid line and 2 is an outward-extending flight line. The current area is divided into a grid area comprising a plurality of grids, and the acquisition device is caused to fly along grid lines. The grid region is before the flight of collection equipment, presets the gridlines of dividing in advance at collection equipment, makes collection equipment fly according to the gridlines, and wherein, collection equipment can be unmanned aerial vehicle makes a video recording.
In some embodiments, determining the flaring region of the grid region comprises: and determining an outward expansion flight line at the periphery of the grid region, so that after each first grid is flown, the adjacent outward expansion region is flown immediately. And when all the first grids are flown, the outward expansion area can be flown completely. Wherein, the area enclosed by the outward-expanding flight lines is larger than the area of the grid area. In this embodiment, when a flight path is planned according to a flight grid range, in order to ensure the integrity of a three-dimensional data model, flight acquisition needs to be performed on each grid extension. In the embodiment, the outward expansion is only needed to be performed on the grids in the edge area, so that the outward expansion range can be reduced, and the production efficiency is improved. The generating effect is consistent with the flying effect of each grid. And the flying outward-expanding area is reduced, and the acquisition efficiency is improved. Specifically, the distance between the external expansion flight line and the external grid line of the grid area is 150-200 meters; the flare can be performed along the voyage with the distance of 180 meters in the grid area.
In some embodiments, processing the image data comprises: splicing a plurality of image data logically through a block merging technology; carrying out independent grid filtering in each grid to enable data between adjacent grids to be mutually used; the image data are photo sets collected by a plurality of collecting devices. In this embodiment, logically splicing a plurality of image data by a block merging technique includes: recording the serial numbers of all photos in the grid, POS data and camera parameters in an XML file; and merging the XML files in the grids. The numbers of all the photos and the POS data of the independent grids are recorded in an XML file, the XML file and the corresponding photos are blocks of the grids, and the block combination is to combine the XML files of the grids. Carry out independent grid in every net and filter, make the data intercommunion between the adjacent net, in this application, according to computer performance, carry out independent blocking to independent net and handle, promote treatment effeciency, specifically include: and according to the XML file after the blocks are combined, when a photo is extracted from one grid, automatically extracting data of other grids around the grid. After all grids are flown, data are integrally imported into the data processing system, all photos are logically connected into a whole by using the block merging function of the data processing system, and independent grid filtering is carried out, so that data interoperability between adjacent grids is realized, and cyclic outward expansion flight is reduced. Further realizing the reduction of the circular outward-expanding flight. The data processing system may be any of contextcapture, aerial view smart3d, and middle wisdom plot M3D.
In some embodiments, further comprising modeling three-dimensional data from the image data, including: according to the image data, carrying out spatial triangulation processing on each grid to generate a space-three result; and (4) sequentially importing all the empty three results into a modeling system, pointing the engines of the task sequences of the empty three results to the same path, and sequentially submitting the empty three results for modeling.
In an implementation manner of the foregoing embodiment, the performing spatial triangulation processing on each mesh to generate a null-triplet result includes: the space triangulation is realized by any one of a simulation method, an analytic method, a navigation method, an independent model method and a light beam method, and three control results are generated according to the pictures, POS values, camera parameters, picture control points and connection points of the grids. The method comprises the steps of inputting pictures, POS values, camera parameters, picture control points and connection points of grids into a modeling system, and enabling the modeling system to produce space-time-three achievements through a space triangulation algorithm. The triangulation algorithm is used for calculating the accurate POS values of all the photos in a grid and matching a certain number of photo connection points.
In an implementation manner of the above embodiment, the three-dimensional modeling is based on a computer cluster, the connection between the computer and the item for processing the empty three results is based on one JOB file, and the automatic sorting can be realized only by directing JOB paths of all the empty three results to be processed to one file. Thereby completing the modeling. The modeling system may be any of contextcapture, aerial view smart3d, and middle wisdom plot M3D.
According to the method, the outward-expansion flight shooting is carried out on the grid area, so that the outward-expansion area of the flight is reduced, and the acquisition efficiency is improved; the problem that image control points cannot be distributed in a signal-free area is solved; meanwhile, automatic sequencing production of three-dimensional data modeling tasks is realized, the production efficiency and precision of the three-dimensional building model are improved, and the production cost and the production difficulty are reduced.
It should be understood that the above examples of the present application are only examples for clearly illustrating the present application, and are not intended to limit the embodiments of the present application. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the claims of the present application.
Claims (10)
1. A method of constructing a three-dimensional architectural model, the method comprising:
dividing a current area into a grid area consisting of a plurality of grids, and determining an outward expansion area of the grid area;
dividing the meshes of the mesh area into a first mesh and a second mesh according to whether the meshes are adjacent to the outward expansion area;
sequentially carrying out flying photography along each grid to obtain image data, and after the flying of each first grid is finished, continuing to carry out flying photography along the extended area adjacent to the current first grid;
and processing the image data.
2. The method of claim 1, further comprising, before dividing the current area into a grid area comprising a plurality of grids:
judging whether the current area has signals or not;
if yes, no treatment is carried out; otherwise, communication is carried out through a carrier phase differential technology;
wherein the communicating via carrier phase difference techniques comprises: the base station is arranged in a signal area, the power of the radio station is adjusted according to the distance from the current area, the mobile station is arranged on the acquisition equipment, the power of the mobile station is set to be the same as that of the base station, and the coordinate of the mobile station is calculated by receiving the coordinate signal of the base station.
3. The method as claimed in claim 2, wherein said adjusting the power of the radio station according to the distance from the current area comprises:
if the linear distance between the current area and the set point of the base station exceeds 3km, the base station needs to use an external radio station to enhance the signal frequency, and if the linear distance between the current area and the set point of the base station is within 3km, the base station is used for carrying out signal transmission by using the built-in radio station of the base station.
4. The method of claim 1, wherein the dividing the current area into grid areas consisting of a plurality of grids comprises:
and dividing the current area into a plurality of grid areas according to the flight height and distance of the acquisition equipment, the image photographing range and the endurance time.
5. The method of claim 1, wherein the determining the extent of the grid region comprises:
and determining an outward-extending flight line along the periphery of the grid region, wherein the area enclosed by the outward-extending flight line is larger than the area of the grid region.
6. The method of claim 1, wherein the processing the image data comprises:
splicing a plurality of image data logically through a block merging technology;
carrying out independent grid filtering in each grid to enable data between adjacent grids to be mutually used;
wherein the image data is a photo set captured by a plurality of capture devices.
7. The method of claim 6, wherein the logically stitching the image data by the block merging technique comprises:
recording the serial numbers of all the photos in the grid, the POS data and the camera parameters in an XML file;
and merging the XML files in the grids.
8. The method of claim 7, wherein the performing of the individual mesh filtering in each mesh to make data between adjacent meshes mutually usable comprises:
and according to the XML file after the blocks are combined, when a photo is extracted from one grid, automatically extracting data of other grids around the grid.
9. The method of claim 1, further comprising modeling three-dimensional data from the image data, including:
according to the image data, carrying out spatial triangulation processing on each grid to generate a space-three result;
and sequentially importing all the empty three results into a modeling system, pointing the engines of the task sequences of the empty three results to the same path, and sequentially submitting the modeling.
10. The method of claim 9, wherein the spatially triangulating each of the meshes to generate the null-triplet result comprises:
the space triangulation is realized by any one of a simulation method, an analytic method, a navigation method, an independent model method and a light beam method, and three control results are generated according to the pictures, POS values, camera parameters, picture control points and connection points of the grids.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110455680.6A CN113240809A (en) | 2021-04-26 | 2021-04-26 | Three-dimensional building model construction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110455680.6A CN113240809A (en) | 2021-04-26 | 2021-04-26 | Three-dimensional building model construction method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113240809A true CN113240809A (en) | 2021-08-10 |
Family
ID=77129313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110455680.6A Pending CN113240809A (en) | 2021-04-26 | 2021-04-26 | Three-dimensional building model construction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113240809A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043381A (en) * | 2007-04-20 | 2007-09-26 | 北京航空航天大学 | System and method for collecting service grid traceback information |
| CN109238239A (en) * | 2018-09-12 | 2019-01-18 | 成都坤舆空间科技有限公司 | Digital measurement three-dimensional modeling method based on aeroplane photography |
| CN109460053A (en) * | 2017-09-06 | 2019-03-12 | 广东泰高新技术发展有限公司 | Aerial survey of unmanned aerial vehicle turning flight course planning method |
| CN111540048A (en) * | 2020-04-22 | 2020-08-14 | 深圳市中正测绘科技有限公司 | Refined real scene three-dimensional modeling method based on air-ground fusion |
| CN112418188A (en) * | 2020-12-17 | 2021-02-26 | 成都亚讯星科科技股份有限公司 | Crop growth whole-course digital assessment method based on unmanned aerial vehicle vision |
-
2021
- 2021-04-26 CN CN202110455680.6A patent/CN113240809A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043381A (en) * | 2007-04-20 | 2007-09-26 | 北京航空航天大学 | System and method for collecting service grid traceback information |
| CN109460053A (en) * | 2017-09-06 | 2019-03-12 | 广东泰高新技术发展有限公司 | Aerial survey of unmanned aerial vehicle turning flight course planning method |
| CN109238239A (en) * | 2018-09-12 | 2019-01-18 | 成都坤舆空间科技有限公司 | Digital measurement three-dimensional modeling method based on aeroplane photography |
| CN111540048A (en) * | 2020-04-22 | 2020-08-14 | 深圳市中正测绘科技有限公司 | Refined real scene three-dimensional modeling method based on air-ground fusion |
| CN112418188A (en) * | 2020-12-17 | 2021-02-26 | 成都亚讯星科科技股份有限公司 | Crop growth whole-course digital assessment method based on unmanned aerial vehicle vision |
Non-Patent Citations (1)
| Title |
|---|
| 刘仁钊 等: "《高等职业教育测绘地理信息类十三五规划教材 无人机倾斜摄影测绘技术》", 武汉大学出版社, pages: 115 - 118 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7168733B2 (en) | Information processing system, information processing device, and information processing method | |
| CN112470092B (en) | Surveying and mapping system, surveying and mapping method, device, equipment and medium | |
| KR101797006B1 (en) | Land research system using drones and method thereof | |
| CN107504957A (en) | The method that three-dimensional terrain model structure is quickly carried out using unmanned plane multi-visual angle filming | |
| CN104462281B (en) | A kind of distributed parallel survey system for fingerprint location | |
| KR101839599B1 (en) | Road facility surveying system using drone | |
| CN107613248A (en) | Monitoring unmanned system and method based on BIM | |
| CN106371452B (en) | Method, device and system for acquiring and sharing flight-limiting area information of aircraft | |
| US20220292992A1 (en) | Autonomous mission action alteration | |
| CN108344397A (en) | Automation modeling method, system and its auxiliary device based on oblique photograph technology | |
| CN104118561B (en) | Method for monitoring large endangered wild animals based on unmanned aerial vehicle technology | |
| CN111178148A (en) | Ground target geographic coordinate positioning method based on unmanned aerial vehicle vision system | |
| CN108955645A (en) | Three-dimensional modeling method and device applied to communication iron tower intelligent patrol detection | |
| CN111536946A (en) | Town layout planning terrain surveying and mapping method | |
| CN106406343A (en) | Control method, device and system of unmanned aerial vehicle | |
| CN109547769A (en) | A kind of highway communication dynamic 3 D number scene acquisition building system and its working method | |
| US20200098189A1 (en) | System and Methods for Data Transmission and Rendering of Virtual Objects for Display | |
| CN109076173A (en) | Image output generation method, equipment and unmanned plane | |
| CN108572379A (en) | Communication base station siting investigation system and method based on unmanned plane | |
| CN107036609A (en) | Virtual reality air navigation aid, server, terminal and system based on BIM | |
| CN107240040A (en) | A kind of geography of tourism data acquisition management system | |
| CN107622525A (en) | Threedimensional model preparation method, apparatus and system | |
| CN107272037A (en) | A kind of road equipment position, image information collecting device and the method for gathering information | |
| CN112288818A (en) | Unmanned quick shooting modeling method below ten thousand square meters | |
| CN113240809A (en) | Three-dimensional building model construction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |