CN114577180A - Geographic information mapping device, system and method based on unmanned aerial vehicle - Google Patents
Geographic information mapping device, system and method based on unmanned aerial vehicle Download PDFInfo
- Publication number
- CN114577180A CN114577180A CN202210487408.0A CN202210487408A CN114577180A CN 114577180 A CN114577180 A CN 114577180A CN 202210487408 A CN202210487408 A CN 202210487408A CN 114577180 A CN114577180 A CN 114577180A
- Authority
- CN
- China
- Prior art keywords
- mapping
- unmanned aerial
- camera
- aerial vehicle
- surveying
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013507 mapping Methods 0.000 title claims abstract description 149
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000001514 detection method Methods 0.000 claims abstract description 57
- 238000012806 monitoring device Methods 0.000 claims abstract description 20
- 239000000725 suspension Substances 0.000 claims description 10
- 238000003384 imaging method Methods 0.000 claims description 6
- 230000000295 complement effect Effects 0.000 claims description 4
- 230000002452 interceptive effect Effects 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 4
- 230000003993 interaction Effects 0.000 claims description 3
- 238000005259 measurement Methods 0.000 claims description 3
- 230000000153 supplemental effect Effects 0.000 claims 1
- 230000008859 change Effects 0.000 abstract description 10
- 230000008569 process Effects 0.000 abstract description 10
- 230000007547 defect Effects 0.000 abstract description 3
- 230000009471 action Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Aviation & Aerospace Engineering (AREA)
- Automation & Control Theory (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to a geographic information mapping device, a geographic information mapping system and a geographic information mapping method based on an unmanned aerial vehicle, which belong to the technical field of intelligent control of mapping unmanned aerial vehicles, even if the mapping unmanned aerial vehicle is interfered by meteorological changes, such as windy weather, rainy weather, snowy weather and the like, due to the characteristics of high-altitude operation environments of the mapping unmanned aerial vehicle in the mapping operation process; the surveying and mapping unmanned aerial vehicle can overcome the defect that the surveying and mapping precision of the surveying and mapping unmanned aerial vehicle is reduced due to severe meteorological factors by orderly matching and starting the devices of the geographical position detection device, the meteorological monitoring device, the stress information judgment device, the hovering auxiliary device, the camera shooting direction detection device and the camera shooting direction adjusting device; the error that geographic information can not exist is gathered to the survey and drawing operation in-process for, survey and drawing unmanned aerial vehicle survey and drawing precision still can obtain the guarantee under meteorological change interference environment.
Description
Technical Field
The invention belongs to the technical field of intelligent control of surveying and mapping unmanned aerial vehicles, and particularly relates to a geographic information surveying and mapping device, system and method based on an unmanned aerial vehicle.
Background
With the vigorous development of the geographic information industry, the unmanned aerial vehicle mapping technology has been widely applied in a plurality of fields as an important means for acquiring emerging spatial data. Unmanned aerial vehicle survey and drawing has characteristics such as maneuverability is good, emergency response is quick, is an important development direction in present geographic survey technical field.
However, in the surveying and mapping process of the unmanned aerial vehicle, due to the characteristics of the aerial work environment, the unmanned aerial vehicle is easily interfered by meteorological changes, such as windy weather, rainy weather, snowy weather and the like; if survey and drawing unmanned aerial vehicle only carries out the survey and drawing operation according to the default flight parameter of setting for, then survey and drawing operation in-process and gather geographic information and probably have very big error, and the research to the survey and drawing unmanned aerial vehicle intelligent control technique of considering meteorological change interference is less at present stage, leads to the meteorological change to disturb surveying and drawing unmanned aerial vehicle surveying accuracy under the environment generally lower.
Therefore, at present, a geographic information mapping device, a geographic information mapping system and a geographic information mapping method based on the unmanned aerial vehicle are required to be designed to solve the problems.
Disclosure of Invention
The invention aims to provide a geographic information mapping device, a geographic information mapping system and a geographic information mapping method based on an unmanned aerial vehicle, which are used for solving the technical problems in the prior art, and the mapping unmanned aerial vehicle is easily interfered by meteorological changes, such as windy weather, rainy weather, snowy weather and the like, due to the characteristics of the aerial work environment of the mapping unmanned aerial vehicle in the mapping operation process; if survey and drawing unmanned aerial vehicle only carries out the survey and drawing operation according to the default flight parameter of setting for, then survey and drawing operation in-process and gather geographic information and probably have very big error, and the research to the survey and drawing unmanned aerial vehicle intelligent control technique of considering meteorological change interference is less at present stage, leads to the meteorological change to disturb surveying and drawing unmanned aerial vehicle surveying accuracy under the environment generally lower.
In order to achieve the purpose, the technical scheme of the invention is as follows:
the geographic information mapping device based on the unmanned aerial vehicle comprises a geographic position detection device, a meteorological monitoring device, a stress information judgment device, a hovering auxiliary device, a camera shooting direction detection device and a camera shooting direction adjusting device;
the geographic position detection device is used for detecting whether the surveying and mapping unmanned aerial vehicle reaches a target position of geographic information surveying and mapping;
the meteorological monitoring device is used for monitoring meteorological data of the position where the surveying and mapping unmanned aerial vehicle is located after the target position is reached, and judging whether the current meteorological data reach the degree of interfering the balance of the surveying and mapping unmanned aerial vehicle;
the stress information judging device is used for detecting stress information when the surveying and mapping unmanned aerial vehicle is interfered by meteorological data;
the hovering auxiliary device is used for assisting in mapping the balanced hovering of the unmanned aerial vehicle according to the stress information;
the camera shooting direction detection device is used for detecting the camera shooting direction of the surveying and mapping unmanned aerial vehicle during balanced suspension and judging the deviation angle between the current camera shooting direction and the preset camera shooting direction;
the camera shooting direction adjusting device is used for adjusting the camera shooting direction of the surveying and mapping unmanned aerial vehicle to be consistent with the preset camera shooting direction according to the deviation angle.
Further, the geographic position detection device is started, and the meteorological monitoring device, the stress information judgment device, the hovering auxiliary device, the camera shooting direction detection device and the camera shooting direction adjustment device are closed;
when the unmanned aerial vehicle for mapping is detected to reach the target position for mapping the geographic information, the meteorological monitoring device is started;
when the current meteorological data is judged to reach the degree of interference on the balance of the surveying and mapping unmanned aerial vehicle, the stress information judging device and the hovering auxiliary device are started;
when the unmanned aerial vehicle is subjected to auxiliary surveying and mapping according to the stress information and is in balanced suspension, the camera shooting direction detection device and the camera shooting direction adjusting device are started;
judging the deviation angle between the current camera shooting direction and the preset camera shooting direction, and adjusting the camera shooting direction of the surveying and mapping unmanned aerial vehicle to be consistent with the preset camera shooting direction according to the deviation angle.
Further, the camera shooting direction adjusting device comprises a controller, a camera rotating device and a camera moving device;
the controller is used as a control core of the camera shooting direction adjusting device;
the camera rotating device is used for controlling the camera of the surveying and mapping unmanned aerial vehicle to rotate within a rotating angle range;
the camera moving device is used for controlling the camera of the surveying and mapping unmanned aerial vehicle to move within a moving distance range;
the camera rotating device and the camera moving device are normally closed;
the camera shooting direction detection device judges a deviation angle between the current camera shooting direction and a preset camera shooting direction and then sends the deviation angle to the controller;
when the controller judges that the deviation angle does not exceed the rotation angle range, the controller controls the camera rotating device to be started;
and when the controller judges that the deviation angle exceeds the rotation angle range, the controller controls the camera rotating device and the camera moving device to be started simultaneously.
Further, the camera shooting direction adjusting device further comprises a supplementary camera, a camera shooting area of the supplementary camera is marked as a second camera shooting area, and the supplementary camera is normally closed;
a shooting area of the camera under the adjustment of the camera rotating device and the camera moving device is marked as a first shooting area;
the first imaging region is complementary to the second imaging region and does not overlap;
when the controller judges that the deviation angle exceeds the rotation angle range and controls the camera rotating device and the camera moving device to be started simultaneously, if the camera shooting direction of the camera still cannot reach the preset camera shooting direction, the controller controls the supplementary camera to be started.
Further, the image pickup direction detection device comprises a control unit, a illuminance detection unit, an illuminance adjustment unit and an image pickup direction detection unit;
the control unit is used as a control core of the image pickup direction detection device;
the camera shooting direction detection unit is used for detecting the camera shooting direction of the surveying and mapping unmanned aerial vehicle during balanced suspension;
the control unit judges the deviation angle between the current shooting direction and the preset shooting direction;
the illuminance detection unit is used for detecting the real-time illuminance of the current environment where the unmanned aerial vehicle is located;
the illuminance adjusting unit is used for adjusting the real-time illuminance of the current environment of the surveying and mapping unmanned aerial vehicle;
when the real-time illuminance is not matched with the preset illuminance during normal operation of the surveying and mapping unmanned aerial vehicle, the illuminance adjusting unit adjusts the real-time illuminance of the current environment where the surveying and mapping unmanned aerial vehicle is located to the preset illuminance.
Furthermore, the camera shooting direction detection device further comprises a distance measurement unit, and the distance measurement unit is used for detecting the real-time height between the mapping unmanned aerial vehicle and the target position mapped by the geographic information;
the illuminance adjusting unit also adjusts the real-time illuminance according to the real-time high adaptability.
Further, the geographic position detection device is a GPS positioning system;
the weather monitoring device comprises a first controller, a rain and snow sensor and a wind direction and wind speed instrument, wherein the first controller is respectively connected with the rain and snow sensor, the wind direction and wind speed instrument and a GPS (global positioning system) positioning system;
the stress information judging device comprises a second controller and a nine-axis sensor, and the second controller is connected with the nine-axis sensor and the first controller;
the hovering auxiliary device comprises a third controller and an independent unmanned aerial vehicle power system, and the third controller is connected with the independent unmanned aerial vehicle power system and the second controller;
the control unit is respectively connected with the third controller and the controller.
Geographic information mapping system based on unmanned aerial vehicle includes as above-mentioned geographic information mapping device based on unmanned aerial vehicle, still includes high in the clouds data center, high in the clouds data center be used for with geographic information mapping device based on unmanned aerial vehicle carries out the remote data interaction.
The geographic information mapping method based on the unmanned aerial vehicle adopts the geographic information mapping device based on the unmanned aerial vehicle to carry out geographic information mapping based on the unmanned aerial vehicle.
Compared with the prior art, the invention has the beneficial effects that:
one of the beneficial effects of the scheme is that even if the surveying and mapping unmanned aerial vehicle is interfered by meteorological changes due to the characteristics of the high-altitude operation environment in the surveying and mapping operation process, the unmanned aerial vehicle is interfered by wind, rain, snow and the like; the surveying and mapping unmanned aerial vehicle can overcome the defect that the surveying and mapping precision of the surveying and mapping unmanned aerial vehicle is reduced due to severe meteorological factors by orderly matching and starting the devices of the geographical position detection device, the meteorological monitoring device, the stress information judgment device, the hovering auxiliary device, the camera shooting direction detection device and the camera shooting direction adjustment device; the error that geographic information can not exist is gathered to the survey and drawing operation in-process, and survey and drawing unmanned aerial vehicle survey and drawing precision still can be ensured under meteorological change interference environment.
Drawings
Fig. 1 is a schematic structural diagram of an embodiment of the present application.
Fig. 2 is a schematic flow chart illustrating principle steps according to an embodiment of the present application.
Fig. 3 is a schematic diagram of the slope of surveying and mapping unmanned aerial vehicle disturbed by weather in the embodiment of the application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention. It is noted that relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The features and properties of the present invention are described in further detail below with reference to examples.
During the surveying and mapping operation process of the surveying and mapping unmanned aerial vehicle, due to the characteristics of the aerial operation environment, the surveying and mapping unmanned aerial vehicle is easily interfered by meteorological changes, such as windy weather, rainy weather, snowy weather and the like; if survey and drawing unmanned aerial vehicle only carries out the survey and drawing operation according to the default flight parameter of setting for, then survey and drawing operation in-process and gather geographic information and probably have very big error, and the research to the survey and drawing unmanned aerial vehicle intelligent control technique of considering meteorological change interference is less at present stage, leads to the meteorological change to disturb surveying and drawing unmanned aerial vehicle surveying accuracy under the environment generally lower.
As shown in fig. 1, a geographic information mapping device based on an unmanned aerial vehicle is provided, which includes a geographic position detection device, a weather monitoring device, a stress information judgment device, a hovering auxiliary device, a camera shooting direction detection device, and a camera shooting direction adjustment device;
the geographic position detection device is used for detecting whether the surveying and mapping unmanned aerial vehicle reaches a target position of geographic information surveying and mapping; the surveying and mapping unmanned aerial vehicle arrives at a target position which needs to be surveyed and mapped by geographic information according to the remote control instruction, and whether the target position arrives at the geographic position detection device or not is confirmed to be detected and judged. It is specific, can adopt GPS orientation module, the cooperation between data storage module and the data processing module (GPS positioning system, this single device is not the innovation point of this scheme, belongs to prior art, so here just no longer gives unnecessary details) realizes above-mentioned function, GPS orientation module acquires the current positional information of survey and drawing unmanned aerial vehicle in real time, data storage module stores the target location information of geographic information survey and drawing, data processing module carries out contrastive analysis with real-time positional information and target location information, can detect and judge whether reach.
The meteorological monitoring device is used for monitoring meteorological data of the position where the surveying and mapping unmanned aerial vehicle is located after the target position is reached, and judging whether the current meteorological data reach the degree of interfering the balance of the surveying and mapping unmanned aerial vehicle; the meteorological monitoring device is used for monitoring real-time meteorological data; extracting reference meteorological data which can affect the operation balance of the surveying and mapping unmanned aerial vehicle by combining the operation parameters of the surveying and mapping unmanned aerial vehicle and the historical meteorological data encountered by the surveying and mapping unmanned aerial vehicle; and comparing and analyzing the real-time meteorological data and the reference meteorological data to judge whether the current meteorological data reach the interference degree. Wherein, meteorological data are as follows: wind, rain, snow and other relevant parameters. A single meteorological monitoring device is not the innovation point of this scheme either, so can monitor meteorological data's device, subassembly etc. (like sleet sensor, wind direction anemoscope etc.) all be applicable to this scheme.
The stress information judgment device (such as a nine-axis sensor) is used for detecting stress information when the surveying and mapping unmanned aerial vehicle is interfered by meteorological data; when encountering meteorological factors which can interfere the balance of the surveying and mapping unmanned aerial vehicle, the surveying and mapping unmanned aerial vehicle quickly detects and identifies stress information (such as wind power of wind blowing relative to the surveying and mapping unmanned aerial vehicle, hitting power of rain and snow on the surveying and mapping unmanned aerial vehicle and the like) borne by the current surveying and mapping unmanned aerial vehicle.
The hovering auxiliary device is used for assisting in mapping the balanced hovering of the unmanned aerial vehicle according to the stress information; the hovering auxiliary device is special equipment (for example, independent of a power system except a self-provided power system of the unmanned aerial vehicle, the functions of the power system and the power system are the same, but the power system and the power system are mutually independent) which is configured besides normal operation equipment of the surveying and mapping unmanned aerial vehicle, and is applied to hovering auxiliary of the surveying and mapping unmanned aerial vehicle when the surveying and mapping unmanned aerial vehicle encounters the stress information, so that extra hovering auxiliary power is provided.
The shooting direction detection device (a plurality of components capable of realizing shooting direction detection, such as an angle sensor, an infrared scanner and the like) is used for detecting the shooting direction when the surveying and mapping unmanned aerial vehicle is in balanced suspension, and judging the deviation angle between the current shooting direction and the preset shooting direction; due to the effect of meteorological factors, the unmanned aerial vehicle is interfered by the hovering auxiliary device, and the unmanned aerial vehicle is mapped and drawn when hovering balance is processed, and the unmanned aerial vehicle possibly enters or exits from the attitude during normal operation and hovering, such as inclining at a certain angle (as shown in fig. 3); the preset shooting direction is the shooting direction of the unmanned aerial vehicle during normal operation suspension by default surveying and mapping, so that a deviation angle exists between the preset shooting direction and the actual shooting direction at the moment; and the deviation angle can affect the accuracy of the geographic information mapping.
The camera shooting direction adjusting device is used for adjusting the camera shooting direction of the surveying and mapping unmanned aerial vehicle to be consistent with the preset camera shooting direction according to the deviation angle. In order to ensure the surveying and mapping precision of geographic information surveying and mapping under the condition of severe meteorological factors, the actual shooting direction of the surveying and mapping unmanned aerial vehicle is adjusted by the shooting direction adjusting device, so that no deviation angle exists between the actual shooting direction and the preset shooting direction, and finally the surveying and mapping precision is ensured.
In the scheme, even if the surveying and mapping unmanned aerial vehicle is interfered by meteorological changes due to the characteristics of the aerial work environment of the surveying and mapping unmanned aerial vehicle in the surveying and mapping process, such as windy weather, rainy weather, snowy weather and the like; the surveying and mapping unmanned aerial vehicle can overcome the defect that the surveying and mapping precision of the surveying and mapping unmanned aerial vehicle is reduced due to severe meteorological factors by orderly matching and starting the devices of the geographical position detection device, the meteorological monitoring device, the stress information judgment device, the hovering auxiliary device, the camera shooting direction detection device and the camera shooting direction adjustment device; the error that geographic information can not exist is gathered to the survey and drawing operation in-process for, survey and drawing unmanned aerial vehicle survey and drawing precision still can obtain the guarantee under meteorological change interference environment.
As shown in fig. 2, further, the geographic position detecting device is turned on, and the weather monitoring device, the stress information judging device, the hovering auxiliary device, the image pickup direction detecting device and the image pickup direction adjusting device are turned off;
when the unmanned aerial vehicle for mapping is detected to reach the target position for mapping the geographic information, the meteorological monitoring device is started;
when the current meteorological data are judged to reach the degree of interfering the balance of the surveying and mapping unmanned aerial vehicle, the stress information judging device and the hovering auxiliary device are started;
when the unmanned aerial vehicle is subjected to auxiliary surveying and mapping according to the stress information and is in balanced suspension, the camera shooting direction detection device and the camera shooting direction adjusting device are started;
judging the deviation angle between the current camera shooting direction and the preset camera shooting direction, and adjusting the camera shooting direction of the surveying and mapping unmanned aerial vehicle to be consistent with the preset camera shooting direction according to the deviation angle.
In the scheme, the geographic position detection device is used as a trigger unit, and the subsequent equipment is triggered after the detection and judgment of the previous part of equipment are completed, so that the phenomenon that too many equipment run for a long time and a large amount of invalid data is collected can be effectively avoided; moreover, the equipment is gradually triggered to effectively improve the pertinence of the scheme, so that the problem that the meteorological change interferes with the surveying and mapping unmanned aerial vehicle is solved pertinently.
Further, the camera shooting direction adjusting device comprises a controller, a camera rotating device and a camera moving device;
the controller is used as a control core of the camera shooting direction adjusting device;
the camera rotating device is used for controlling the camera of the surveying and mapping unmanned aerial vehicle to rotate within a rotating angle range (such as cooperation among a rotating motor, a rotary table, a camera fixing structure and the like);
the camera moving device is used for controlling the camera of the surveying and mapping unmanned aerial vehicle to move within a moving distance range (such as the matching among a sliding driving motor, a sliding rail, a camera fixing structure and the like);
the camera rotating device and the camera moving device are normally closed;
the camera shooting direction detection device judges the deviation angle between the current camera shooting direction and the preset camera shooting direction and then sends the deviation angle to the controller;
when the controller judges that the deviation angle does not exceed the rotation angle range, the controller controls the camera rotating device to be started;
and when the controller judges that the deviation angle exceeds the rotation angle range, the controller controls the camera rotating device and the camera moving device to be started simultaneously.
In the above-mentioned scheme, through camera rotary device, camera mobile device's cooperation, can increase the regional scope of making a video recording of survey and drawing unmanned aerial vehicle camera to a very big degree, avoid geographic information survey and drawing work because the regional limited and survey and drawing unmanned aerial vehicle of making a video recording receive the weather to disturb and the slope leads to unable developing.
Further, the camera shooting direction adjusting device further comprises a supplementary camera, a camera shooting area of the supplementary camera is marked as a second camera shooting area, and the supplementary camera is normally closed;
a shooting area of the camera under the adjustment of the camera rotating device and the camera moving device is marked as a first shooting area;
the first imaging region is complementary to the second imaging region and does not overlap;
when the controller judges that the deviation angle exceeds the rotation angle range and controls the camera rotating device and the camera moving device to be started simultaneously, if the shooting direction of the camera still cannot reach the preset shooting direction, the controller controls the supplementary camera to be started.
In the scheme, when the camera rotating device and the camera moving device are moved to the maximum range and still cannot meet the camera shooting direction, the camera shooting region complementation is carried out by opening the normally closed complementary camera, so that the problem that the camera shooting direction and the camera shooting region are limited is solved.
Further, the image pickup direction detection device comprises a control unit, a illuminance detection unit, an illuminance adjustment unit and an image pickup direction detection unit;
the control unit is used as a control core of the image pickup direction detection device;
the camera shooting direction detection unit is used for detecting the camera shooting direction when the surveying and mapping unmanned aerial vehicle is in balanced suspension;
the control unit judges the deviation angle between the current shooting direction and the preset shooting direction;
the illuminance detection unit is used for detecting the real-time illuminance of the current environment where the unmanned aerial vehicle is located;
the illuminance adjusting unit is used for adjusting the real-time illuminance of the current environment where the unmanned aerial vehicle is located;
when the real-time illuminance is not matched with the preset illuminance during normal operation of the surveying and mapping unmanned aerial vehicle, the illuminance adjusting unit adjusts the real-time illuminance of the current environment where the surveying and mapping unmanned aerial vehicle is located to the preset illuminance.
In the above-mentioned scheme, consider the illuminance to survey and drawing unmanned aerial vehicle mapping process's influence, through the cooperation between illuminance detecting element, the illuminance regulation unit, can ensure the illuminance of survey and drawing unmanned aerial vehicle's normal operating.
Further, the camera shooting direction detecting device further comprises a distance measuring unit, and the distance measuring unit is used for detecting the real-time height between the surveying and mapping unmanned aerial vehicle and the target position of geographic information surveying and mapping;
the illuminance adjusting unit also adjusts the real-time illuminance according to the real-time high adaptability.
In the above scheme, the adaptive adjustment of the illuminance is performed according to the real-time height, the higher the height is, the stronger the illuminance is, and the lower the height is, the lower the illuminance is.
Further, the geographic position detection device is a GPS positioning system;
the weather monitoring device comprises a first controller, a rain and snow sensor and a wind direction and wind speed instrument, wherein the first controller is respectively connected with the rain and snow sensor, the wind direction and wind speed instrument and a GPS (global positioning system) positioning system;
the stress information judging device comprises a second controller and a nine-axis sensor, and the second controller is connected with the nine-axis sensor and the first controller;
the hovering auxiliary device comprises a third controller and an independent unmanned aerial vehicle power system, and the third controller is connected with the independent unmanned aerial vehicle power system and the second controller;
the control unit is respectively connected with the third controller and the controller.
Geographic information mapping system based on unmanned aerial vehicle includes as above-mentioned geographic information mapping device based on unmanned aerial vehicle, still includes high in the clouds data center, high in the clouds data center be used for with geographic information mapping device based on unmanned aerial vehicle carries out the remote data interaction.
The geographic information mapping method based on the unmanned aerial vehicle adopts the geographic information mapping device based on the unmanned aerial vehicle to carry out geographic information mapping based on the unmanned aerial vehicle.
The above are preferred embodiments of the present invention, and all changes made according to the technical scheme of the present invention that produce functional effects do not exceed the scope of the technical scheme of the present invention belong to the protection scope of the present invention.
Claims (9)
1. The geographic information mapping device based on the unmanned aerial vehicle is characterized by comprising a geographic position detection device, a meteorological monitoring device, a stress information judgment device, a hovering auxiliary device, a camera shooting direction detection device and a camera shooting direction adjusting device;
the geographic position detection device is used for detecting whether the surveying and mapping unmanned aerial vehicle reaches a target position of geographic information surveying and mapping;
the meteorological monitoring device is used for monitoring meteorological data of the position where the surveying and mapping unmanned aerial vehicle is located after the target position is reached, and judging whether the current meteorological data reach the degree of interfering the balance of the surveying and mapping unmanned aerial vehicle;
the stress information judging device is used for detecting stress information when the surveying and mapping unmanned aerial vehicle is interfered by meteorological data;
the hovering auxiliary device is used for assisting in mapping the balanced hovering of the unmanned aerial vehicle according to the stress information;
the camera shooting direction detection device is used for detecting the camera shooting direction of the surveying and mapping unmanned aerial vehicle during balanced suspension and judging the deviation angle between the current camera shooting direction and the preset camera shooting direction;
the camera shooting direction adjusting device is used for adjusting the camera shooting direction of the surveying and mapping unmanned aerial vehicle to be consistent with the preset camera shooting direction according to the deviation angle.
2. The unmanned aerial vehicle-based geographic information mapping device of claim 1, wherein the geographic position detection device is turned on, and the weather monitoring device, the stress information determination device, the hover assistance device, the camera direction detection device, and the camera direction adjustment device are turned off;
when the unmanned aerial vehicle for mapping is detected to reach the target position for mapping the geographic information, the meteorological monitoring device is started;
when the current meteorological data is judged to reach the degree of interference on the balance of the surveying and mapping unmanned aerial vehicle, the stress information judging device and the hovering auxiliary device are started;
when the unmanned aerial vehicle is subjected to auxiliary surveying and mapping according to the stress information and is in balanced suspension, the camera shooting direction detection device and the camera shooting direction adjusting device are started;
judging the deviation angle between the current camera shooting direction and the preset camera shooting direction, and adjusting the camera shooting direction of the surveying and mapping unmanned aerial vehicle to be consistent with the preset camera shooting direction according to the deviation angle.
3. The drone-based geographic information mapping device of claim 2, wherein the camera direction adjustment device includes a controller, a camera rotation device, a camera movement device; the controller is respectively connected with the camera rotating device and the camera moving device;
the controller is used as a control core of the camera shooting direction adjusting device;
the camera rotating device is used for controlling the camera of the surveying and mapping unmanned aerial vehicle to rotate within a rotating angle range;
the camera moving device is used for controlling the camera of the surveying and mapping unmanned aerial vehicle to move within a moving distance range;
the camera rotating device and the camera moving device are normally closed;
the camera shooting direction detection device judges a deviation angle between the current camera shooting direction and a preset camera shooting direction and then sends the deviation angle to the controller;
when the controller judges that the deviation angle does not exceed the rotation angle range, the controller controls the camera rotating device to be started;
and when the controller judges that the deviation angle exceeds the rotation angle range, the controller controls the camera rotating device and the camera moving device to be started simultaneously.
4. The drone-based geographic information mapping device of claim 3, wherein the camera direction adjustment device further comprises a supplemental camera connected with the controller; the camera shooting area of the supplementary camera is marked as a second camera shooting area, and the supplementary camera is normally closed;
the camera shooting area of the camera under the adjustment of the camera rotating device and the camera moving device is recorded as a first camera shooting area;
the first imaging region is complementary to the second imaging region and does not overlap;
when the controller judges that the deviation angle exceeds the rotation angle range and controls the camera rotating device and the camera moving device to be started simultaneously, if the shooting direction of the camera still cannot reach the preset shooting direction, the controller controls the supplementary camera to be started.
5. The unmanned-aerial-vehicle-based geographic information mapping device of claim 4, wherein the camera direction detection device comprises a control unit, a illuminance detection unit, an illuminance adjustment unit, a camera direction detection unit; the control unit is respectively connected with the illuminance detection unit, the illuminance adjusting unit and the shooting direction detection unit;
the control unit is used as a control core of the image pickup direction detection device;
the camera shooting direction detection unit is used for detecting the camera shooting direction of the surveying and mapping unmanned aerial vehicle during balanced suspension;
the control unit judges the deviation angle between the current shooting direction and the preset shooting direction;
the illuminance detection unit is used for detecting the real-time illuminance of the current environment where the surveying and mapping unmanned aerial vehicle is located;
the illuminance adjusting unit is used for adjusting the real-time illuminance of the current environment of the surveying and mapping unmanned aerial vehicle;
when the real-time illuminance is not matched with the preset illuminance during normal operation of the surveying and mapping unmanned aerial vehicle, the illuminance adjusting unit adjusts the real-time illuminance of the current environment where the surveying and mapping unmanned aerial vehicle is located to the preset illuminance.
6. The drone-based geographic information mapping device of claim 5, wherein the camera direction detection device further comprises a ranging unit connected with the control unit; the distance measurement unit is used for detecting the real-time height between the surveying and mapping unmanned aerial vehicle and the target position of geographic information surveying and mapping;
the illuminance adjusting unit also adjusts the real-time illuminance according to the real-time high adaptability.
7. The drone-based geographic information mapping device of claim 6, wherein the geographic location detection device is a GPS positioning system;
the weather monitoring device comprises a first controller, a rain and snow sensor and a wind direction and wind speed instrument, wherein the first controller is respectively connected with the rain and snow sensor, the wind direction and wind speed instrument and a GPS (global positioning system) positioning system;
the stress information judging device comprises a second controller and a nine-axis sensor, and the second controller is connected with the nine-axis sensor and the first controller;
the hovering auxiliary device comprises a third controller and an independent unmanned aerial vehicle power system, and the third controller is connected with the independent unmanned aerial vehicle power system and the second controller;
the control unit is respectively connected with the third controller and the controller.
8. Unmanned aerial vehicle-based geographic information mapping system, comprising the unmanned aerial vehicle-based geographic information mapping device of any one of claims 1-7, and further comprising a cloud data center for remote data interaction with the unmanned aerial vehicle-based geographic information mapping device.
9. Method for drone-based geographic information mapping, characterized in that drone-based geographic information mapping is performed using a drone-based geographic information mapping device according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210487408.0A CN114577180B (en) | 2022-05-06 | 2022-05-06 | Geographic information mapping device, system and method based on unmanned aerial vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210487408.0A CN114577180B (en) | 2022-05-06 | 2022-05-06 | Geographic information mapping device, system and method based on unmanned aerial vehicle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114577180A true CN114577180A (en) | 2022-06-03 |
| CN114577180B CN114577180B (en) | 2022-07-15 |
Family
ID=81769119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210487408.0A Active CN114577180B (en) | 2022-05-06 | 2022-05-06 | Geographic information mapping device, system and method based on unmanned aerial vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114577180B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115931008A (en) * | 2023-02-27 | 2023-04-07 | 昆明人为峰科技有限公司 | System and method for monitoring running state of terrain mapping equipment |
Citations (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103595836A (en) * | 2013-11-25 | 2014-02-19 | 广东欧珀移动通信有限公司 | Mobile terminal with rotary camera and camera rotation control device |
| US20140100037A1 (en) * | 2012-10-05 | 2014-04-10 | Qfo Labs, Inc. | Wireless communication system for game play with multiple remote-control flying craft |
| CN104076869A (en) * | 2013-03-29 | 2014-10-01 | 鸿富锦精密工业（深圳）有限公司 | Camera rotating structure |
| CN104290907A (en) * | 2014-10-15 | 2015-01-21 | 西南科技大学 | Novel hybrid vertical/short take-off and landing (V/STOL) unmanned aerial vehicle |
| CN104822024A (en) * | 2015-04-23 | 2015-08-05 | 广东欧珀移动通信有限公司 | Method and apparatus for controlling rotation of camera |
| CN105138699A (en) * | 2015-09-25 | 2015-12-09 | 广东欧珀移动通信有限公司 | Photograph classification method and device based on shooting angle and mobile terminal |
| CN105741477A (en) * | 2015-11-03 | 2016-07-06 | 天津艾思科尔科技有限公司 | Aircraft with intelligent fire control voice assistant |
| CN105775118A (en) * | 2016-05-03 | 2016-07-20 | 北方民族大学 | Unmanned aerial vehicle resistant to interference in hovering and control method |
| FR3031958A1 (en) * | 2015-01-23 | 2016-07-29 | Franck Andre-Marie Guigan | VARIABLE GEOMETRY PROPELLER |
| CN105957070A (en) * | 2016-04-26 | 2016-09-21 | 胡碧滢 | Small-sized unmanned plane camera orientation calibrating device and calibrating method |
| CN106099748A (en) * | 2016-06-27 | 2016-11-09 | 国网山东省电力公司济南供电公司 | A kind of power transmission line unmanned machine mapping system |
| US20170067734A1 (en) * | 2015-09-09 | 2017-03-09 | Faro Technologies, Inc. | Aerial device that cooperates with an external projector to measure three-dimensional coordinates |
| US20170150053A1 (en) * | 2015-11-23 | 2017-05-25 | Parrot Drones | Drone equipped with a video camera sending sequences of images corrected for the wobble effect |
| CN206363125U (en) * | 2017-01-05 | 2017-07-28 | 江西视航科技有限公司 | It is a kind of to be taken photo by plane unmanned plane for mapping |
| CN107727061A (en) * | 2017-09-27 | 2018-02-23 | 武汉霸云创新科技有限公司 | A kind of electro-optical distance measurement system and method for autonomous atmospheric correction |
| CN108146608A (en) * | 2017-12-19 | 2018-06-12 | 北京航空航天大学 | A kind of rotor with vectored thrust and air bag combined type lighter-than-air flight device |
| CN207670655U (en) * | 2017-11-23 | 2018-07-31 | 深圳市九天创新科技有限责任公司 | A kind of auto-folder three-axis stability augmentation camera shooting quadrotor drone |
| JP2018136315A (en) * | 2017-02-22 | 2018-08-30 | 株式会社日本環境調査研究所 | Multicopter and atmospheric environment measuring method using multicopter |
| KR101918287B1 (en) * | 2017-07-24 | 2018-11-13 | 김경수 | Wired dron with gas balloon |
| CN109062405A (en) * | 2018-07-23 | 2018-12-21 | 努比亚技术有限公司 | Mobile terminal display methods, mobile terminal and computer readable storage medium |
| JP2019128448A (en) * | 2018-01-24 | 2019-08-01 | 日本電産サンキョー株式会社 | Optical unit with tremor correction function |
| CN110525673A (en) * | 2019-09-16 | 2019-12-03 | 华南理工大学 | A kind of unmanned aerial vehicle onboard two degrees of freedom increases steady cradle head mechanism and unmanned plane |
| CN110726669A (en) * | 2019-08-31 | 2020-01-24 | 苏州国科测试科技有限公司 | Flying probe is camera subassembly and flying probe test equipment for test equipment |
| CN111142548A (en) * | 2019-12-24 | 2020-05-12 | 河南省有色测绘有限公司 | Surveying and mapping unmanned aerial vehicle and surveying and mapping method based on unmanned aerial vehicle |
| CN112141363A (en) * | 2020-11-05 | 2020-12-29 | 云南电力试验研究院(集团)有限公司 | Unmanned aerial vehicle hovering precision testing system and method |
| CN112484704A (en) * | 2020-11-19 | 2021-03-12 | 苏州极目机器人科技有限公司 | Rapid mapping method and device |
| CN213384718U (en) * | 2020-10-30 | 2021-06-08 | 东华理工大学长江学院 | Unmanned aerial vehicle survey and drawing is with multiple type of data acquisition device |
| CN113759951A (en) * | 2021-10-18 | 2021-12-07 | 深圳市中正测绘科技有限公司 | Unmanned aerial vehicle tilt shooting measurement method and system |
-
2022
- 2022-05-06 CN CN202210487408.0A patent/CN114577180B/en active Active
Patent Citations (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140100037A1 (en) * | 2012-10-05 | 2014-04-10 | Qfo Labs, Inc. | Wireless communication system for game play with multiple remote-control flying craft |
| CN104076869A (en) * | 2013-03-29 | 2014-10-01 | 鸿富锦精密工业（深圳）有限公司 | Camera rotating structure |
| CN103595836A (en) * | 2013-11-25 | 2014-02-19 | 广东欧珀移动通信有限公司 | Mobile terminal with rotary camera and camera rotation control device |
| CN104290907A (en) * | 2014-10-15 | 2015-01-21 | 西南科技大学 | Novel hybrid vertical/short take-off and landing (V/STOL) unmanned aerial vehicle |
| FR3031958A1 (en) * | 2015-01-23 | 2016-07-29 | Franck Andre-Marie Guigan | VARIABLE GEOMETRY PROPELLER |
| CN104822024A (en) * | 2015-04-23 | 2015-08-05 | 广东欧珀移动通信有限公司 | Method and apparatus for controlling rotation of camera |
| US20170067734A1 (en) * | 2015-09-09 | 2017-03-09 | Faro Technologies, Inc. | Aerial device that cooperates with an external projector to measure three-dimensional coordinates |
| CN105138699A (en) * | 2015-09-25 | 2015-12-09 | 广东欧珀移动通信有限公司 | Photograph classification method and device based on shooting angle and mobile terminal |
| CN105741477A (en) * | 2015-11-03 | 2016-07-06 | 天津艾思科尔科技有限公司 | Aircraft with intelligent fire control voice assistant |
| US20170150053A1 (en) * | 2015-11-23 | 2017-05-25 | Parrot Drones | Drone equipped with a video camera sending sequences of images corrected for the wobble effect |
| CN105957070A (en) * | 2016-04-26 | 2016-09-21 | 胡碧滢 | Small-sized unmanned plane camera orientation calibrating device and calibrating method |
| CN105775118A (en) * | 2016-05-03 | 2016-07-20 | 北方民族大学 | Unmanned aerial vehicle resistant to interference in hovering and control method |
| CN106099748A (en) * | 2016-06-27 | 2016-11-09 | 国网山东省电力公司济南供电公司 | A kind of power transmission line unmanned machine mapping system |
| CN206363125U (en) * | 2017-01-05 | 2017-07-28 | 江西视航科技有限公司 | It is a kind of to be taken photo by plane unmanned plane for mapping |
| JP2018136315A (en) * | 2017-02-22 | 2018-08-30 | 株式会社日本環境調査研究所 | Multicopter and atmospheric environment measuring method using multicopter |
| KR101918287B1 (en) * | 2017-07-24 | 2018-11-13 | 김경수 | Wired dron with gas balloon |
| CN107727061A (en) * | 2017-09-27 | 2018-02-23 | 武汉霸云创新科技有限公司 | A kind of electro-optical distance measurement system and method for autonomous atmospheric correction |
| CN207670655U (en) * | 2017-11-23 | 2018-07-31 | 深圳市九天创新科技有限责任公司 | A kind of auto-folder three-axis stability augmentation camera shooting quadrotor drone |
| CN108146608A (en) * | 2017-12-19 | 2018-06-12 | 北京航空航天大学 | A kind of rotor with vectored thrust and air bag combined type lighter-than-air flight device |
| JP2019128448A (en) * | 2018-01-24 | 2019-08-01 | 日本電産サンキョー株式会社 | Optical unit with tremor correction function |
| CN109062405A (en) * | 2018-07-23 | 2018-12-21 | 努比亚技术有限公司 | Mobile terminal display methods, mobile terminal and computer readable storage medium |
| CN110726669A (en) * | 2019-08-31 | 2020-01-24 | 苏州国科测试科技有限公司 | Flying probe is camera subassembly and flying probe test equipment for test equipment |
| CN110525673A (en) * | 2019-09-16 | 2019-12-03 | 华南理工大学 | A kind of unmanned aerial vehicle onboard two degrees of freedom increases steady cradle head mechanism and unmanned plane |
| CN111142548A (en) * | 2019-12-24 | 2020-05-12 | 河南省有色测绘有限公司 | Surveying and mapping unmanned aerial vehicle and surveying and mapping method based on unmanned aerial vehicle |
| CN213384718U (en) * | 2020-10-30 | 2021-06-08 | 东华理工大学长江学院 | Unmanned aerial vehicle survey and drawing is with multiple type of data acquisition device |
| CN112141363A (en) * | 2020-11-05 | 2020-12-29 | 云南电力试验研究院(集团)有限公司 | Unmanned aerial vehicle hovering precision testing system and method |
| CN112484704A (en) * | 2020-11-19 | 2021-03-12 | 苏州极目机器人科技有限公司 | Rapid mapping method and device |
| CN113759951A (en) * | 2021-10-18 | 2021-12-07 | 深圳市中正测绘科技有限公司 | Unmanned aerial vehicle tilt shooting measurement method and system |
Non-Patent Citations (3)
| Title |
|---|
| XIANGKAI XU等: "The design of inspection drone based on three-stage PID control algorithm", 《2021 INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND SMART AGRICULTURE (ICEITSA)》 * |
| 肖会涛 等: "单旋翼植保无人机喷杆悬架机构设计与分析", 《中国农机化学报》 * |
| 陈钊 等: "四旋翼无人机自主飞行系统优化设计与实现", 《控制与信息技术》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115931008A (en) * | 2023-02-27 | 2023-04-07 | 昆明人为峰科技有限公司 | System and method for monitoring running state of terrain mapping equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114577180B (en) | 2022-07-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106886225B (en) | Multifunctional unmanned aerial vehicle intelligent landing station system | |
| CN110262568B (en) | Unmanned aerial vehicle obstacle avoidance method and device based on target tracking and unmanned aerial vehicle | |
| Mirallès et al. | LineDrone Technology: Landing an unmanned aerial vehicle on a power line | |
| CN110603379B (en) | Inspection tool control device for wind power equipment inspection tool | |
| CN107272740B (en) | Novel four-rotor unmanned aerial vehicle control system | |
| CN109765930A (en) | A kind of unmanned plane vision navigation system | |
| CN114296483B (en) | Intelligent inspection method and electronic equipment for wind driven generator in non-stop state | |
| CN111801717A (en) | Automatic exploration control for robotic vehicles | |
| JP2018005914A (en) | Autonomous movement control system, traveling unit, unmanned aircraft, and autonomous movement control method | |
| CN114577180B (en) | Geographic information mapping device, system and method based on unmanned aerial vehicle | |
| CN113325880B (en) | Sun and moon tracking device and method suitable for motion state | |
| CN108820215B (en) | Automatic air-drop unmanned aerial vehicle capable of automatically searching target | |
| JP6957304B2 (en) | Overhead line photography system and overhead line photography method | |
| CN108780322A (en) | Method and apparatus and UAV system for controlling unmanned plane | |
| CN108207377A (en) | Trimming machine cuts people and trimming machine cuts people control method and device | |
| CN113900436B (en) | Inspection control method, inspection control device, inspection control equipment and storage medium | |
| CN115202376A (en) | Unmanned aerial vehicle patrols and examines electric power grid management and control platform based on individual soldier removes | |
| EP3300842A1 (en) | System and method for coordinating terrestrial mobile automated devices | |
| CN116679011A (en) | Unmanned aerial vehicle equipment for monitoring carbon emission source and monitoring method | |
| CN104536460A (en) | Method for patrolling concave mountain slope electric transmission line by unmanned aerial vehicle | |
| CN107272729B (en) | Unmanned aerial vehicle system of cruising based on router | |
| CN113568430A (en) | Correction control method for unmanned aerial vehicle wing execution data | |
| CN113759944A (en) | Automatic inspection method, system and equipment based on designated altitude flight | |
| CN117369494A (en) | Unmanned aerial vehicle autonomous return method and device and unmanned aerial vehicle | |
| CN113467519B (en) | Automatic cruising method and system for unmanned aerial vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |