KR20220037027A - System and method for monitoring the ground using hybrid unmanned airship - Google Patents

Abstract

The present invention relates to a system for monitoring the ground using a convergence blockchain-based hybrid unmanned airship, which includes: at least one hybrid unmanned airship flying using sunlight as a power source and searching for a region where a preset event has occurred; and an integrated control server performing state monitoring with respect to at least one of ground, road traffic, forest, marine algae, and crime prevention and public order based on search information of the at least one hybrid unmanned airship and sharing the monitoring information with a server of a response agency. The integrated control server performs distributed storage of real-time weather data or location data on the hybrid unmanned airship in a public blockchain, stores drone authentication data of at least one user terminal in at least one full node constituting a private blockchain, transmits an initial generation key to the at least one user terminal, stores and shares the initial generation key in at least one full node constituting a consortium blockchain, and performs restoration or reset of the initial generation key using the drone authentication data in the consortium blockchain in a case where the initial generation key is lost at the at least one user terminal.

Description

Ground monitoring system and method using hybrid unmanned airship based on convergence block chain {System and method for monitoring the ground using hybrid unmanned airship}

The present invention relates to a ground monitoring system and method using a hybrid unmanned aerial vehicle based on a convergence block chain.

An unmanned airship is an unmanned aerial vehicle that can fly and steer by induction of wireless electromagnetic waves.

Unmanned airships were initially used for military purposes for reconnaissance, but are gradually being used as offensive weapons to destroy enemies by equipping them with various weapons. Recently, these unmanned airships are being used for commercial purposes as air vehicles with various types and performance depending on the purpose of use. As we enter the era of the 4th industrial revolution, the unmanned airship industry is emerging as one of the core industries of the future. , atmospheric measurement, public transportation, daily life, leisure, etc.

In addition to filming for broadcast movies, disaster safety, infrastructure inspections such as bridges, pylons, and construction sites, cadastral surveys, shoreline surveys, 3D mapping, and spatial information acquisition, as well as agricultural fields, from pesticide spraying to growth status check, etc. The range of use of unmanned aerial vehicles is expanding.

Japanese Laid-Open Patent JP2004253471

An object of the present invention is to provide a ground monitoring system and method using a hybrid unmanned airship based on a convergence block chain that can solve the problems of the present invention.

However, the technical task to be achieved by the present embodiment is not limited to the technical task as described above, and other technical tasks may exist.

The ground monitoring system using a hybrid unmanned airship based on a convergence block chain according to an embodiment of the present invention for solving the above problems flies using sunlight as a power source, and searches for an area where a preset event occurs. Based on the at least one or more hybrid unmanned aerial vehicles and the search information found in the at least one or more hybrid unmanned aerial vehicles, the state of at least one or more of the ground, road traffic, forest, marine green algae, and crime prevention is monitored, and the monitoring information is provided to a corresponding agency An integrated control server shared with a server of At least one pool constituting the consortium blockchain by storing the initial generated key (Key) to the at least one user terminal and transmitting the initially generated key to the at least one full node constituting the It is stored and shared in a node, and when the initially generated key is lost in the at least one user terminal, the initially generated key is restored or reset using the drone authentication data in the consortium block chain. do.

The ground monitoring method using a hybrid unmanned airship based on a convergence block chain according to an embodiment of the present invention for solving the above problems receives the target point coordinates transmitted from the integrated control server, and then receives the meteorological condition information from the satellite in real time. After receiving, generating a shortest flight path according to the weather conditions; A hybrid unmanned aerial vehicle flying to a target location, and searching for a point of occurrence of a set event while photographing a ground image; when an event is detected during flight movement of the hybrid unmanned aerial vehicle, descending to the detected area, performing a hovering operation, and precisely searching the detected area; And after transmitting the precisely searched detection image to the integrated control server, when the integrated control server receives a moving message and new target coordinates, the shortest flight path to the new target location after receiving the weather condition information from the satellite in real time After calculating, moving to the shortest flight path, wherein the integrated control server distributes and stores real-time weather data or location data of the hybrid unmanned airship in a public block chain, and at least one user terminal drone authentication Data is stored in at least one Full Blockchain Node constituting a private block chain, an initial generated key is transmitted to the at least one user terminal, and the initially generated key is transferred to a Consortium Blockchain. It is stored and shared in at least one full node, and when the initially generated key is lost in the at least one user terminal, the initially generated key is restored or reset using the drone authentication data in the consortium blockchain. characterized by performing.

When using the ground monitoring system and method using a hybrid unmanned aerial vehicle based on a convergence block chain according to an embodiment of the present invention, there is an advantage that it is possible to easily search an area where CCTV installation is impossible with a small amount of data transmission and reception.

In addition, public data or shared data is distributed and stored in the public blockchain, and user authentication data including personal authentication data and personal information data is stored in the Full Blockchain Node in the private blockchain, and then the initial generated key is saved to the user. It is transmitted to the terminal, and if the initial generated key is lost in the user terminal, it can be restored or reset through the consortium block chain managed by public institutions, and preset light information is stored in the Lightweight Node in addition to the full node. This provides the advantage of not having to have all the nodes for information other than important information, increasing speed and eliminating delays.

In addition, by implementing network docking between the unmanned aerial vehicle and the control terminal (control terminal) based on the user authentication of the unmanned aerial vehicle to which the convergence block chain is applied, even if the unmanned aerial vehicle or the control terminal is stolen, the use of the stolen unmanned aerial vehicle or control terminal can be blocked.

1 is a block diagram illustrating a ground monitoring system using a hybrid unmanned aerial vehicle based on a convergence block chain according to an embodiment of the present invention.
2 is a configuration diagram showing the detailed configuration of the hybrid unmanned aerial vehicle based on the convergence block chain shown in FIG. 1 .
3 and 4 are enlarged views of the inert gas tube of the hybrid unmanned aerial vehicle based on the convergence block chain shown in FIG. 1 .
FIG. 5 is a detailed configuration diagram of the event detection unit shown in FIG. 2 .
6 is a detailed configuration diagram of the integrated control server shown in FIG.
7 is a detailed configuration diagram of the user terminal shown in FIG.
8 to 10 are exemplary views showing an example in which the relaxation and contraction distances of the iris and the pupil used in the authentication processing unit are displayed, and the characteristic points of the fingerprint.
11 to 13 are exemplary views of a convergence block chain applied to the present invention.
14 is a flowchart illustrating a ground monitoring method using a hybrid unmanned airship according to an embodiment of the present invention.
15 illustrates an example computing environment in which one or more embodiments disclosed herein may be implemented.

Specific structural or functional descriptions of the embodiments of the present invention disclosed in the present specification or application are only exemplified for the purpose of describing the embodiments according to the present invention, and the embodiments according to the present invention may be implemented in various forms. and should not be construed as being limited to the embodiments described in the present specification or application.

Since the embodiment according to the present invention can have various changes and can have various forms, specific embodiments are illustrated in the drawings and described in detail in the present specification or application. However, this is not intended to limit the embodiment according to the concept of the present invention with respect to a specific disclosed form, and should be understood to include all changes, equivalents or substitutes included in the spirit and scope of the present invention.

Terms such as first and/or second may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one element from another element, for example, without departing from the scope of the present invention, a first element may be called a second element, and similarly The second component may also be referred to as the first component.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle. Other expressions describing the relationship between elements, such as "between" and "immediately between" or "neighboring to" and "directly adjacent to", etc., should be interpreted similarly.

The terminology used herein is used only to describe specific embodiments, and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. As used herein, terms such as “comprise” or “have” are intended to designate that the specified feature, number, step, operation, component, part, or combination thereof is present, and includes one or more other features or numbers, It should be understood that the existence or addition of steps, operations, components, parts or combinations thereof is not precluded in advance.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present specification. does not

Hereinafter, a ground monitoring system and method using a hybrid unmanned aerial vehicle based on a convergence block chain according to an embodiment of the present invention will be described in more detail based on the accompanying drawings.

1 is a block diagram illustrating a ground monitoring system using a hybrid unmanned aerial vehicle based on a convergence block chain according to an embodiment of the present invention. FIG. 2 is a configuration diagram showing the detailed configuration of the hybrid unmanned aerial vehicle based on the convergence block chain shown in FIG. 1 . 3 and 4 are enlarged views of the inert gas tube of the hybrid unmanned aerial vehicle based on the convergence block chain shown in FIG. 1 . FIG. 5 is a detailed configuration diagram of the event detection unit shown in FIG. 2 . 6 is a detailed configuration diagram of the integrated control server shown in FIG. 7 is a detailed configuration diagram of the user terminal shown in FIG. 8 to 10 are exemplary diagrams showing an example in which the relaxation and contraction distances of the iris and the pupil used in the authentication processing unit are displayed, and the characteristic points of the fingerprint. 11 to 13 are exemplary views of a convergence block chain applied to the present invention.

First, as shown in FIG. 1 , the ground monitoring system 100 using a hybrid unmanned airship based on a convergence block chain according to an embodiment of the present invention includes a hybrid unmanned airship 200 and an integrated control server 300 . include

In addition, the ground monitoring system 100 using the hybrid unmanned aerial vehicle based on the convergence block chain according to an embodiment of the present invention further includes a user terminal 400 for controlling the hybrid unmanned aerial vehicle.

The user terminal 400 is interlocked with the unmanned aerial vehicle using a web page, an app page, a program or an application related to the unmanned aerial vehicle control service, and may be a terminal that receives and outputs weather data and location data necessary to control the unmanned aerial vehicle.

In addition, the user terminal 400 may be a terminal for setting user authentication data for accessing the unmanned aerial vehicle in order to control the unmanned aerial vehicle.

And, the user terminal 400 may be any one node constituting a public block chain and a private block chain, and receives the initial generated key generated after setting the user unmanned aerial vehicle authentication data from the integrated control server 300 and It may be a terminal that stores.

If the user terminal 500 forgot the password or lost the initially generated key, access to the consortium block chain for recovery and resetting and then input a password hint to recover or reset the initially generated key may be a terminal . In this case, the user terminal 400 may be a terminal that stores the initially generated key in an electronic wallet format.

Here, the at least one user terminal 100 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100 is, for example, as a wireless communication device that guarantees portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

A more detailed description of the user terminal 400 will be provided later.

First, the hybrid unmanned airship 200 receives a location through a Global Navigation Satellite System (GNSS), and satellite communication such as Iridium satellite or 4G, 5G, LTE, LTE-A, WiBro (Wireless Broadband Internet), etc. communicates with the integrated control server 300 using

The hybrid unmanned aerial vehicle 200 uses sunlight as a power source to fly and communicate, and searches for an area in which a preset event occurs.

More specifically, the hybrid unmanned aerial vehicle 200 includes an aircraft 201, an inert gas tube 210, a power supply 220, a plurality of flyer propellants 230, an event detection unit 240, and a driving control unit 250. includes

In addition, the hybrid unmanned aerial vehicle 200 may include a plurality of solar cell panels 270 , a satellite navigation unit 280 , and a communication unit 290 .

The body 201 is known including the above-described power supply unit 220, a plurality of flyer propellants 230, an event detection unit 240, a driving control unit 250, a plurality of solar panels, a satellite navigation unit and a communication unit, etc. As a component in which various parts necessary for the unmanned aerial vehicle of the UAV are installed, it may be composed of synthetic resin or metal material.

Although the drawings exemplify the cylindrical structure, it is not limited thereto, and the shape and form may be variously modified and implemented according to the implementation conditions. For example, it is also possible to configure the base 210 in a polygonal cylindrical structure, such as a rectangular cylindrical body, an octagonal cylindrical body, rather than a cylindrical structure.

Next, the inert gas tube 210 is a tube filled with an inert gas, for example, helium gas. can be

It is a graph showing the relationship between the weight reduction according to the volume increase of the flying energy reduction solar power unmanned aerial vehicle according to the embodiment of the present invention, and when helium, which is a buoyancy gas, is filled in the inert gas tube 210, helium according to the volume increase It shows the relationship in which the total weight of the unmanned aerial vehicle is reduced while buoyancy is generated by the If the buoyancy and weight reduction effects are calculated through comparison of air and helium densities, the air density is 1.293 kg/m3 and the helium density is 0.1786 kg/m3. The difference between the density of air and the density of helium is 1.293-0.1786=1.119. Therefore, a load reduction effect of about 1 kg can be obtained by using 1 m 3 of helium.

The embodiment of the present invention can minimize the gravitational resistance according to the weight of the unmanned aerial vehicle due to the inert gas tube 210, thereby reducing the energy consumed for the take-off and movement of the unmanned aerial vehicle. For reference, the flight energy of a flying vehicle is calculated by multiplying the flight speed by the value obtained by subtracting buoyancy from its own weight and dividing it by the lift ratio (flight energy = (self weight - buoyancy) * flight speed / lift ratio). Therefore, the increase in buoyancy through the weight reduction of the aircraft 100 is a factor to increase the flight energy.

Accordingly, due to the inert gas tube 210, the flight weight of the unmanned airship is reduced.

That is, the total volume of the inert gas tube 210 can be calculated through the necessary buoyancy calculated based on the flight weight, and the inert gas tube having a shape having the calculated total volume can be manufactured.

On the other hand, the upper surface and the curved surface of the inert gas tube 210 are provided with a plurality of flexible solar panels (dye-sensitized solar cells) and silicon solar cells 270 that collect sunlight and convert it into electricity.

The inert gas tube 210 may include a wire frame 10 for fixing the plurality of flexible solar cell panels 270 .

Electricity generated by the plurality of flexible solar cell panels 270 is supplied to and stored in a power supply unit 220 to be described later.

The power supply unit 220 may be configured to convert and store electrical energy supplied from a plurality of flexible solar panels, and convert the stored energy into electrical energy having a size corresponding to the load of each component and provide the converted energy.

The power supply unit 220 includes a PCS (Power Conversion System), and the PCS performs power conversion to an input/output terminal and power conversion from an input/output terminal, wherein the power conversion is DC/AC conversion and conversion between the first voltage and the second voltage.

The plurality of flyer propelling body 230 is a part fixed to the airframe, and generates a driving force by generating lift when the impeller rotates by a motor is rotated.

Next, the event detection unit 240 may be configured to detect a preset event in the captured flight image.

The event detection unit 240 includes a function of, after precisely photographing a point where the event occurs in a hovering (stop flight) state, when an event occurs in the image captured during flight movement, and then transmitting the image.

Here, the event may include a forest fire, traffic jam, mineral exploration, water level measurement, object search, geological search, and the like.

The event detection unit 240 is manufactured in a modular form and can be detached from the aircraft, so that the user can use the event detection unit by replacing it according to the type of event.

The event detection unit 240 may include a camera unit 241 and an event determination unit 242 .

Various types of the camera unit 241, such as a thermal imaging camera, an infrared camera, an ultraviolet camera, and a magnetic field camera, may be used, and may be changed according to the type of event to be detected.

The camera unit 241 includes a camera gimbal (camera gimbal) 243 to photograph the surroundings of the flight, and to maintain the same shooting direction without shaking of the shooting.

To elaborate on this, the camera gimbal 243 is rotated in three axis directions in the Roll, Pitch, or Yaw directions so that the shooting direction of the camera is maintained to correct the position of the camera. . A camera gimbal may be composed of a fixed base on which the camera is mounted, a correction control module equipped with an acceleration sensor, three motors and a frame responsible for rotation of three axes (Roll, Pitch, Yaw), and correction control By measuring the inclination of each axis with an accelerometer provided in the module and rotating each corresponding motor in the opposite direction, the position of the camera can be corrected so that the angle of the camera is maintained by finally operating so that the inclination of the holder does not change.

The event determination unit 242 is configured to determine whether an event occurs in the image captured by the camera 241 and may use a deep learning algorithm.

The deep learning is a technology used to cluster or classify objects or data. It is a technology that inputs a large amount of data into a computer and classifies similar ones.

At this time, many machine learning algorithms have already appeared on how to classify data. Deep learning is an artificial intelligence learning method proposed to overcome the limitations of artificial neural networks.

For reference, the deep learning algorithm disclosed in the present invention is employed, and the deep learning algorithm may include a Deep Belief Network, an Autoencoder, a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), a Deep Q-Network, etc., The deep learning algorithm listed in the present invention is only an example, and is not limited thereto.

In the present invention, an example of applying CNN (Convolutional Neural Network), which is one of the deep learning algorithms listed above, is applied to the system, but the present invention is not limited thereto, and various types of deep learning algorithms may be used according to the user's selection. may be

More specifically, the event determination unit 242 includes a sampling unit 242-1, a capability enhancement unit 242-2, a transfer learning unit 242-3, and an algorithm application unit 242-4.

The sampling unit 242-1 samples using the terrestrial image obtained from the camera 241.

The capability enhancement unit 242-2 performs data pre-processing and capability enhancement (Augmentation) of the sample image of the sampled terrestrial image. At this time, the detection neural network model training, data generation model training, data generation, etc. are implemented.

In addition, the transfer learning unit 242 - 3 transfers learning the neural network model by learning the image with the capacity augmented in the capacity enhancing unit 242 - 2 .

At this time, the transfer learning unit 242-3 may generate a lot of event image data by training the data generation model neural network using the detection neural network, and store it in the memory. That is, there is an effect that the performance of the learned detection neural network model can be continuously increased by newly generating and storing the similar event image in the transfer learning unit 242-3.

In an embodiment, the transfer learning unit 242-3 extracts an object region using a Region Proposal Network (RPN) in order to specify a region corresponding to an event included in the pre-processed image.

Then, in order to recognize an object in the extracted object area as a single object, it learns using R-CNN algorithm, a deep learning algorithm, and compares it with several objects in memory. The learning result is upgraded by storing the name result of the object back in memory. The stored results are saved as new learning to upgrade the R-CNN algorithm.

Here, the memory stores the data photographed by the camera unit and various data processed through the event determination unit, and is a storage medium such as a flash memory type, a hard disk type, and multimedia. It may include a storage medium of at least one type of a multimedia card micro type, card type memory (eg, SD or XD memory, etc.), RAM, and ROM.

The algorithm application unit 242-4 selects and applies a transfer-learned detection algorithm using the acquired image.

In one embodiment, the algorithm application unit 242-4 performs object recognition faster through convolutional coupling of RPN for specifying an object area and Fast R-CNN, which is an algorithm for recognizing a specified object, into one network. can do. That is, by comparing the object in the image with the various information stored in the memory for object recognition, the time required for many calculations can be reduced, and the existence and location of the event can be recognized much faster than the existing method.

On the other hand, hovering (hovering, stop flight) is controlled through the drive control unit 250 to be described later, the drive control unit 250, when the event detection unit 240 receives the event detection signal, a plurality of flyers so that the aircraft hovers Controls the motion of the propellant.

An IMU sensor-based method, a radar-based method, an image-based method, etc. may be applied to the hovering technology of an unmanned airship, and the present invention operates in an image-based method.

For example, the image-based hovering method using a downward camera module mounted on the fuselage of an unmanned airship, unlike other active sensor-based methods such as radar, consumes less power and has less weight and supports excellent performance. Easy to apply to airships.

In the image-based hovering method, hovering is performed by tracking the movement of the unmanned airship through a downward image obtained from the unmanned airship and then compensating for the tracked movement.

Therefore, accurately tracking the movement of the unmanned aerial vehicle using downward image information is an essential element in supporting the hovering function.

A block matching algorithm, a feature descriptor matching algorithm, and a Kanade Lucas Tomasi (KLT) feature tracking algorithm exist as algorithms typically used in the image-based hovering method.

Accordingly, the event detector 240 detects whether the primary event has occurred in the image, and when the event is detected, precisely detects the occurrence of the secondary event through a hovering operation at the point where the event occurred, and the secondary event is detected. If so, it may be configured to transmit an image of the detected point.

Next, the driving control unit 250 may be configured to control the number of rotations of the respective impellers of the plurality of flyer propellants so as to be flown with flight path information provided by the satellite navigation unit 280 to be described later. In addition, the driving control unit 250 may be a component that controls the operation of each component. The driving control unit 250 enables the vehicle to automatically implement a plurality of flight patterns in the air through the multi-command mode of the flight algorithm, wherein the flight patterns are, for example, acro flight, stabilize flight , circle flight, follow me flight, geo fence and auto flight, etc. are adjusted to be performed, and it also receives location information from GPS satellites and stays within the preset guard area. It can also be adjusted so that the flight can take place.

The satellite navigation unit 280 receives the weather condition information from the satellite in real time, calculates the shortest flight path to the target location transmitted from the integrated control server 300, and corrects the shortest flight path according to the weather condition. It provides the shortest flight path.

The communication unit 290 may use artificial satellite communication, 4G, 5G, LTE, LTE-A, Wi-Fi, etc., and NFC (Near Field Communication) as a short-distance communication module, Bluetooth (Bluetooth) ), Zigbee, UWB (Ultra-wideband) communication module, etc. can be used, but is not limited thereto.

The communication unit 290 configures software (S/W) functions that support standard protocols (TCP/IP, UDP, VPN, etc.) so that the integrated control server 300 and the network can be efficiently built and used. In addition to making it compatible with communication programs and applications, it can provide hardware (H/W) for image compression and transmission processing, flight control computer (FCC), mission device control and additional module expansion.

Next, the integrated control server 300 monitors the status of at least one of the ground, road traffic, forest, marine green algae, and crime prevention security based on the search information found in the at least one or more hybrid unmanned aerial vehicles, and monitoring information may be configured to share with the server of the corresponding organization.

In addition, the integrated control server 300 may be a server that provides an unmanned aerial vehicle control service web page, an app page, a program or an application. And, the integrated control server 300 converges public block chain, private block chain and consortium block chain, so that public data is in the public block chain, and the personal unmanned airship authentication data of the user terminal 400 is in the private block chain, The reset or recovery of the initially generated key of the user terminal 400 may be a server that stores and manages the consortium block chain by dividing each role. In addition, the integrated control server 300 stores information classified into a preset important category in a full node of the private blockchain, and other information is at least one light node of the public blockchain. ), it can be a server that increases the processing speed of information and also enhances security by dualizing it to be distributed and stored. In addition, the integrated control server 300 may be a server that stores the initial generated key in the user terminal 400 in an electronic wallet format when personal unmanned aerial vehicle authentication data is input in the user terminal 400, and the user terminal 400 ), if the initial generated key is lost or the password is forgotten, it may be a server that links with the consortium blockchain so that the initial generated key can be restored or reset using user authentication data.

More specifically, the integrated control server 300 includes an operator management unit 310, an unmanned airship information management unit 320, a communication unit 330, a database unit 340, a flight information management unit 350, a risk analysis unit 360, It includes a remote control unit 370 , a display unit 380 , and an integrated control unit 390 .

The operator management unit 310 manages an ID (ID), password, etc. of the unmanned airship control operator. On the other hand, it is preferable to further include authentication and encryption/decryption procedures to prevent unauthorized access by unauthorized persons or to prevent hacking of data transmitted and received with the server 300 . In this case, authentication procedures can be implemented using digital signatures and hash functions (such as SHA-224, SHA-256, SHA-384, SHA-512, etc.), and ARIA (Academy Research Institute Agency), ECC ( The encryption/decryption procedure can be implemented using a lightweight encryption/decryption algorithm such as Elliptic Curve Cryptosystem).

The unmanned airship information management unit 320 manages the unmanned airship identification information for the unmanned airships to be controlled, wherein the unmanned airship identification information includes a manufacturer, an importer, a seller, a serial number, and an unmanned airship specification (weight, size, flight speed, etc.), and a unique registration number registered with a predetermined association.

The communication unit 330 communicates with an unmanned airship and an external server, 3G, 4G, 5G, LTE, LTE-A, WiBro (Wireless Broadband Internet), Wi-Fi, etc. and NFC (Near Field Communication) as a short-distance communication module, Wireless communication using Bluetooth, Zigbee, Ultra-wideband (UWB), etc., or the Internet, Social Network Service (SNS), etc. may be used.

The database unit 340 forms a database (DB) of information for monitoring and control of unmanned airships and information on processed results, and stores the information in a storage medium. For example, the database unit 340 may include identification information of unmanned airships, information of legal regulations related to unmanned airships, information on flight restriction/prohibited areas, risk information according to the behavior of unmanned airships, and control/control policy information according to risk, etc. is distributed and stored on the public blockchain.

In addition, the database unit 340 may distribute and store real-time weather data or unmanned aerial vehicle location data in a public block chain.

At this time, when distributing and storing real-time weather data or unmanned aerial vehicle location data in a public blockchain, preset public data or shared data including real-time weather data or unmanned aerial vehicle location data is at least one light node constituting the public blockchain. Node) can be distributed and stored.

As described above, in one embodiment of the present invention, data that needs to be fast and short in access time or speed is stored in the light node, and other data that needs to be kept confidential even if the speed is slow, such as personal information or authentication information, is stored in the full node ( Full Blockchain Node).

In this case, the light node is a node that participates in the blockchain and performs transactions, and performs the function of verifying individual transactions by requesting transaction data from the full node. Like a full node, it does not have the original source of all block information, but only a kind of summary, that is, important data in the block header. In the case of smartphones, Android mobile Bitcoin wallets are used as light nodes, as there are not many phones with 100GB of storage yet. For reference, the Bitcoin wallet on the desktop computer is used as a full node. Since the light node does not have all block information, when it receives any new transaction information, it cannot verify whether this transaction is normal. Conversely, in the case of a full node, since it has all data, it can be verified by inquiring the block information in the local area. Therefore, the light node uses Simple Payment Verify (SPV) to verify the transaction for each individual transaction. SPV is a method of verifying whether this transaction is a verified transaction through the Merkle Tree by requesting block information from the full node to verify the transaction in the light node.

Blockchain maintains and manages the network by gathering individual servers participating in transactions without storing and managing transaction records in a centralized server. This individual server, that is, a participant is called a node. Since there is no central manager, the role of the node distributing blocks is important, and a new block is created only when more than half of the participating nodes agree. The nodes store the block chain in the computer, and even if some nodes are hacked and the existing contents are changed, the data remains in a large number of nodes, so data can be continuously preserved. If it has all the transaction information of the blockchain network, it is called a Full Blockchain Node, and if it has only Merkle Tree, it is called a Lightweight Node.

Therefore, all nodes in the blockchain are divided into full nodes and light nodes. The full node stores all transaction information on the network and manages users' wallets. Light nodes store user wallets, but rely on full nodes for network access. A node is a component of a network, a full node is to maintain the blockchain, and a light node is to grant access rights for participants. Taking the analogy of the safe and the watchman as an example, the full node can be viewed as a military-grade reinforced watchman, and the light node can be viewed as a channel that attempts to deposit and withdraw money using the safe. Among full nodes and light nodes, the ones that contribute the most to the blockchain network are also full nodes. After all, light nodes and individual nodes read the blockchain stored in the node and participate in the network.

The advantage of a full node is that no one knows where the transmission originated because, for example, the transmission data is sent from its own node. The light node is not completely secure because the transmitted data goes through the central server. However, the lack of complete security does not mean that the risk of hacking increases. The information that can be exposed means that information about which address is sent from which IP can be left on the server. On the other hand, a full node does not know which address was sent from which IP. This is because, when data transmitted from an arbitrary node is forwarded to another node, the node receiving the arbitrary broadcast does not know whether this transmission was sent by me or something else. In addition, the full node enables easy input and output of private keys.

Conversely, the advantage of the light node is that it is easy to use. Instead of using its own block, it is a method of checking how much data the central server has. Therefore, it takes little time from installation to use of the program, and it is easy to use. In the case of a full node, since block data reaches 140 GB, it may take 2 to 7 days to receive all these blocks. In addition, light nodes are easy to restore. Since the address is managed using the seed method, wallet recovery is easy. If you write down 12/18/24 English words well, you can use these words to recover your wallet even if your wallet is lost.

Hereinafter, the simple concepts of private, public, and consortium blockchains used herein will be described first.

A public blockchain is a blockchain that allows nodes to participate in the network according to the free will of the nodes without approval from an authoritative organization. In order for an organization to conduct a business using blockchain, it is necessary to consider whether the business satisfies the seven business requirements of effectiveness, efficiency, confidentiality, integrity, availability, conformity, and reliability. However, when an organization conducts business using public blockchains, it cannot satisfy business requirements due to four chronic limitations of public blockchains. The four limitations of public blockchains are:

First, low transaction throughput and high latency reduce the effectiveness, efficiency and availability of the business. In Ethereum, a public blockchain, 20 transactions are processed per second, and each transaction has a latency of 10 to 20 seconds. Compared to 2000 transactions per second with credit card payments, public blockchains have great limitations in conducting businesses that require quick payments. Second, the lack of privacy and confidentiality protection reduces the confidentiality and compliance of the business. In a public blockchain, each node stores and processes blocks containing personal identification information and organizational transaction information for block integrity and transparency. This not only violates the requirements for handling personal information specified in the Personal Information Protection Act, but also exposes confidential organization transaction details to network participants, greatly hindering business performance.

Third, the lack of blockchain governance reduces the effectiveness, efficiency and compliance of the business. A public blockchain that is hard forkable and difficult to control nodes makes it impossible for organizations to conduct business with strong and consistent strategies and policies. Such an environment not only makes it difficult for organizations to conduct business effectively and efficiently, but also makes it difficult to satisfy the requirements of stakeholders. Fourth, business efficiency is lowered due to inefficient energy consumption. A public blockchain consumes energy such as computing power and power for proof-of-work. Considering that the Bitcoin network consumes 14.96 Twh of electricity and $747 million per year for proof-of-work, excessive energy consumption and unfriendly factors result in inefficient business. Due to the limitations of these public blockchains, organizations must select a blockchain that can satisfy all business requirements to conduct business.

The biggest significance of blockchain technology is that transactions between individuals are possible without an intermediary who guarantees trust in a network environment where they cannot trust each other. In this environment, in order to guarantee trust that transactions between individuals have not been forged, public blockchains have fatal limitations in terms of efficiency, confidentiality and availability, which are essential for business execution. However, the actual environment in which organizations conduct business and transact is not as extreme as the trustless network premised on public blockchains. This is because organizations typically conduct business in partnership with and transact with those they consider to be trusted. In other words, the root cause of the limitations in using the public blockchain for business comes from the extreme premise of trustlessness.

Next, the basic premise of the consortium blockchain is a trusted environment among network members. In a consortium blockchain, members who trust each other make decisions through consensus and cooperate to operate the network in a decentralized way. In addition, the consortium consists only of organizations that can be trusted and held accountable while meeting the network goals. Because it is a trusted environment made up of approved and well-subjected members, the consortium block chain allows businesses to run effectively and efficiently without being bound by the fundamental limitations inherent in public block chains. Consortium blockchain can comply with the reliability, efficiency, availability, integrity and confidentiality of business requirements due to its trusted environment. Organizations can use an efficient consensus algorithm to maximize transaction processing speed and conduct business that requires immediate approval. In addition, since it is not necessary to use a consensus algorithm that requires excessive energy consumption, blocks can be efficiently verified while maintaining integrity. Because transaction details are disclosed only to authorized stakeholders, the issue of privacy or confidentiality is compromised.

In addition to the five business requirements described above, the consortium blockchain can achieve organizational goals with effectiveness and compliance. In the consortium blockchain, members can perform governance by decentralizing and cooperating so that the organization's blockchain utilization strategy and policies are aligned with the organizational goals and values are delivered to stakeholders. Governance that complies with external requirements, evaluates strategies and policies, and directs and oversees effective network operation may be most appropriate in a consortium blockchain operated through consensus and voting among members in a trusted environment.

IT governance refers to the leadership, organizational structure, and processes that enable IT to maintain and expand an organization's strategies and objectives as part of corporate governance conducted under the responsibilities of the board and management. The international standard ISO/IEC 38500:2015 defines IT governance as activities in which the present and future use of IT is directed and controlled by top management. Top management evaluates current and future use of IT, directs IT use through strategies and policies to achieve business goals, and monitors performance against policy and strategy. Accordingly, the drone control service according to an embodiment of the present invention, in the case of public data or data that can be shared by anyone, is distributed and stored in a public block chain and shared, but not a full node, so that the speed is not slowed down. It is stored in the node, and personal and biometric information such as personal drone authentication data is stored in the full node of the private chain, and data that should not be hijacked is stored in the full node of the private chain. However, if it is lost or forgotten, it is restored and reset in the consortium blockchain, which is a trusted institution, so that each information is dualized into full-node-light nodes. A reliable drone control service can be provided.

The consortium blockchain is operated by two entities: the Governor and the Members. The governor performs the six functions of consortium blockchain governance as a key decision-making entity through the decentralized governance of the consortium blockchain. As the actual operation and management entity of the consortium blockchain, the member performs seven functions: development, operation, security, protection of personally identifiable information and confidentiality, node management, ledger management and transaction management of the blockchain system. In addition, the members cooperate and operate the consortium through consensus and report to the governor the suitability of the proposals and plans for the use of blockchain and performance. Accordingly, the governor dictates strategies and policies to the members and controls the consortium's use of the blockchain. Each member owns a private key (initially generated key) and a public key, and is identified as an operating entity of the blockchain network through the keys, and has the right to create and verify blocks. A general user who is not a subject of the consortium blockchain cannot directly transmit a transaction to the network, but can conduct business or use the service through the member's service system.

When a general user sends a transaction to a specific member's service system, the service system sends the transaction to the consortium network using the member's private key. As such, general users cannot directly act as subjects of the consortium blockchain, but can trade and conduct business through members. A consortium block chain according to an embodiment of the present invention is a block chain managed by a military or public institution, and it is defined as a block chain that manages to store and restore each individual's personal information and authentication information.

Referring back to FIG. 6 , the flight information management unit 350 tracks and manages flight information of unmanned airships in real time, where the flight information may include current location information, posture information, altitude information, and the like.

When it is determined that an emergency has occurred in the currently flying unmanned airships based on the risk level analyzed by the risk analysis unit 260, the remote control unit 360 remotely transmits an emergency control command to the corresponding unmanned airships in real time. This allows you to respond to emergencies. The remote control unit 360 may provide an automatic take-off and landing signal when an abnormality occurs in the airframe of the unmanned aerial vehicle.

The event information processing unit 370 analyzes the precise image of the event occurrence point transmitted from the unmanned airship, and then provides the encrypted image information of the event to the agency server associated with the event.

That is, the integrated control server 300 can store and register the data of each listed configuration in the public block chain, and manage it.

Meanwhile, the integrated control server 300 further includes a user authentication data management unit 291 .

The user authentication data management unit 291 stores personal information such as user authentication data and data that should not be hijacked, such as biometric information, in the full node of the private blockchain, and the initial generated key generated from the personal authentication data is It is kept by the user, but if it is lost or forgotten, it is restored and reset in the consortium blockchain, a trusted institution, so that each information is dualized into a full node and a light node. By doing so, it performs the function of providing it quickly and reliably.

More specifically, when the user authentication information management unit 380 loses the initially generated key in the user terminal 400, using the personal unmanned aerial vehicle authentication data in the consortium block chain to restore or reset the initially generated key. there is.

In this case, the user authentication data may include biometric data including any one or a combination of at least one of iris, face, fingerprint, vein, and voice. In addition, the initially generated key may be a hash function-based hash value, and the public key-private key structure and hash function are the same as in the known technology, and thus will not be described in detail.

In addition, when the initially generated key is lost in the user terminal 400 , when the initially generated key is restored or reset using personal unmanned aerial vehicle authentication data in the consortium block chain, the initially generated key in the user terminal 400 is performed In the case of loss, a preset hint capable of inferring personal authentication data and personal information data included in the user authentication data is transmitted to at least one user terminal 400 , and the hint is mapped with the hint in the user terminal 100 . This can cause a recovery or reset process to proceed when stored answers are collected. In this case, the AI algorithm and macro bot can be used as described above.

Here, after creating the [question-answer] pair, when presenting the content corresponding to the “answer” to the user, only the “answer” should not be presented, but the fingerprints corresponding to the remaining incorrect answers should be mixed.

For example, assuming that there are a total of 12 views on a 3X4 screen, and 4 photos taken by the user as the answer, the remaining 8 views should contain the incorrect view. At this time, it is necessary to mix incorrect answers that only the user knows, but look similar to others, and in this case, the work of extracting the pictures of the landscape and background similar to the pictures extracted from the user's photo album (gallery) from within the big data must be performed. For example, if a user takes a photo of Seoul Land, an incorrect view must be extracted from big data by inserting a photo of Lotte World. To this end, the process of extracting photos labeled with amusement park tags such as #AMUSEMENTPARK #THEMEPARK from big data and generating an incorrect example may be performed. In big data, it is possible to assume that each photo is tagged with a tag through pre-processing and image classification, so that classification and data mining are all in progress.

At this time, if the user terminal 400 accurately selects the picture taken by the user, the user who restores and resets it is the true person without asking for the user's personal information or when using it as a double security device after asking for personal information It can be verified with higher reliability.

In addition to this, when generating the initially generated key, it may be based on a hash value, or a pseudo-random number generator may be used. The ideal random number required for information security is a number that is unpredictable, independent, and non-reoccurring, such as a number obtained through tossing a coin. Since the encryption algorithm or protocol of the encryption system is designed after assuming that the random number is an ideal random number, it is essential to use a random number generator that can generate a safe random number. The random number generator mainly generates a random number from an initial seed value through a deterministic algorithm (Pseudo Random Number Generator; PRNG, Deterministic Random Bit Generator; DRBG), and a random number from an unpredictable physical phenomenon. It is classified as a True Random Number Generator (TRNG).

Since the output random number of a PRNG is determined by the input seed, it is common to use the output random number of a TRNG as a seed. On the other hand, in TRNG, a digitization process is performed to convert a noise source, which is analog data, into digital data to use as an input, and a post-processing process is selectively performed to reduce the bias of the digitized data, and then a random number is output. Since the output of an ideal random number depends on the unpredictable noise source, which is the input of the random number generator, it is important to understand the characteristics of the noise source used as the entropy source. Therefore, the safety analysis of the post-processing process to reduce the bias of the noise source of the physical characteristics must be considered in order to output an ideal random number.

In this case, the quantum random number generator of the quantum random number algorithm is a TRNG that generates random numbers by using the unpredictability of quantum information. This guarantees unpredictability, non-uniformity, and irrelevance between numbers, and unlike PRNG, the seed value cannot be tracked with an encryption pattern. In this case, the quantum random number generator is a method of generating a random number by measuring the polarization of a photon, the path of the photon, the arrival time of the photon, and the shot noise in a vacuum state. , and 0 and 1 are assigned according to the observed position of the measuring instrument. In the case of a quantum random number generator that measures the arrival time of photons, the observation period is divided into several sections, and a bit logarithmic of the ratio of the period to the period is generated for each observation. Since the shot noise in the vacuum state is an arbitrary state having a Gaussian distribution, a random number may be generated as a section.

In addition to this, ARIA, AES block ciphers, Whirlpool hash functions, etc. may be used. At this time, ARIA (Academy, Research Institute, Agency) is a symmetric key block cipher that encrypts/decrypts 128-bit plaintext/ciphertext to create 128-bit ciphertext/decrypted text. It supports three key lengths of 128/192/256 bits, and 12/14/16 rounds of conversion are performed according to the key length. Round transformation consists of round key addition, substitution layer, and diffusion layer operation.

Different permutation layers are used for the odd round transform function and the even round transform function, and the spreading layer is replaced with round key addition in the final round transform function. Since ARIA has an Involution Substitution-Permutation Network (ISPN) structure, encryption and decryption processes are the same, only the round key is different. The key scheduler consists of a key initialization process and a round key generation process. In the key initialization process, four 128-bit initialization key values are generated from the master key using the three-round Feistel structure, and these initialization key values are used in the round key generation process. Depending on the key length, round conversion is performed 12/14/16 times, and key addition is performed twice in the final round, so a total of 13/15/17 round keys are generated.

AES (Advanced Encryption Standard) algorithm is a symmetric key block cipher that encrypts/decrypts 128-bit plaintext/ciphertext to create 128-bit ciphertext/decryption text. It supports three key lengths of 28/192/256 bits, and 10/12/14 rounds of conversion are performed according to the key length. Encryption round transformation consists of SubByte, ShiftRow, MixColumn, AddRoundKey operations after initial round key addition (AddRoundKey), and MixColumn operation is omitted in the last round. For decryption, InvSubByte, InvShiftRow, and InvMixColumn, which are inverse transformations of the functions used for encryption, are used.

Whirlpool is a lightweight hash function adopted as the ISO/IEC 10118-3 standard, and converts a message of any length into a 512-bit message digest. A block cipher with a non-Feistel SPN structure similar to AES is used as a compression function, and message padding preprocessing is required to make the input message an odd multiple of 256 bits. After initial key addition, round transformation consisting of SubBytes, ShiftColumn, MixRows, and KeyAdd operations is repeated 9 times, and the final round transformation consists of SubBytes, ShiftColumn and KeyAdd operations. The round conversion result of each data block, the input data of the corresponding block, and the encryption key of the previous block are XORed and used as the encryption key of the next data block. This operation is repeated for all data blocks to generate a message digest. can Of course, it will be obvious that various methods other than the above-described encryption method are available.

Next, the user terminal 400 may be a terminal including a control means for controlling the unmanned aerial vehicle.

In addition, the user terminal 400 may include means for authenticating (identifying) the user.

In addition, the user terminal 400 may be a terminal including an electronic wallet for storing the initially generated key.

More specifically, the user terminal 400 includes an operation unit 410 , an authentication unit 420 , a network docking unit 430 , a communication unit 440 , a display unit 450 , a multi-connection control unit 460 , and a block chain encryption unit. (470).

The operation unit 410 may be provided with a pair of control sticks for controlling the operation of a plurality of rotating actuators of the unmanned aerial vehicle, and provides a flight control signal of the unmanned aerial vehicle according to the angle and displacement according to the operation of the pair of control sticks. do.

As an example, among the pair of control sticks, one control stick generates a flight control signal necessary for rotation of the aircraft of the unmanned aerial vehicle based on the Z-axis or movement in the Z-axis direction for ascending and descending of the aircraft, but The displacement value according to the operation is reflected in the flight control signal in direct proportion to the Z-axis reference rotation speed of the aircraft or the movement speed in the Z-axis direction for ascending and descending.

In addition, the other control stick generates flight control signals necessary for movement in the forward/backward (Y-axis) left/right (X-axis) direction based on the Z-axis, but the displacement value according to the operation of the other control stick is in direct proportion to the forward, left, right, and left movement speed of the aircraft. This is reflected in the flight control signal.

Next, the authenticator 420 may include a plurality of authentication means for identifying at least one of biometric information, motion information, and voice information provided from the user.

Also, the authentication unit 420 may receive and set the authentication order of the plurality of authentication modules from the user. For example, the authentication procedure may be performed in the order of ① biometric information recognition → ② motion information recognition → ③ voice recognition, authentication in a sequence other than the above, or by applying an additional authentication method.

More specifically, the authenticator 420 may include a plurality of biometric information recognition units.

The first biometric recognition unit uses light with variable brightness for a preset exposure time or light containing specific patterns, letters, or numbers to position and shape the user's face contour, eyeball (iris), eyebrows, nose, mouth, and ears. It may be a configuration for recognizing information in a non-contact manner (refer to FIGS. 8 to 9 ).

The second biometric recognition unit may be configured to recognize the entire shape of the user's hand, the color and shape of the back of the hand, finger prints, the distance between the knuckles, the shape of the nail, the position of the blood vessels, and the wrinkles on the back of the hand through a contact method (see FIG. 10 ). ).

일 수 있다.The second biometric recognition unit may include a configuration (transparent panel) that is in contact with the fingers and palms of the hands and provides an optical path for acquiring images of fingerprints and palms of the fingers. Here, the transparent panel may be manufactured to be in close contact with specific joints of the palm and fingers. For example, the shape of the first vertical cross-section of the transparent panel may be manufactured in a ○ shape, a U shape, a L shape, or a C shape. In addition, the transparent panel may be a panel of a flexible material having a bending characteristic. In addition, the shape of the second vertical cross-section is

can be

The second biometric recognition unit may include a configuration for irradiating light with a short wavelength of 320 nm to 450 nm below the transparent panel.

In addition, the second biometric recognition unit may include a plurality of sensors, any one of the plurality of sensors may be a sensor that detects a palm shape using light, any one of the plurality of sensors using light or ultrasound It may be a sensor that detects wrinkles on the back of the hand and wrinkles on the fingers, any one of which may be a sensor that detects the shape of blood vessels on the back of the hand using ultrasonic waves, and any one uses light or ultrasonic waves to detect the shape of nails and knuckles may be a sensor for detecting the shape of , and any one may be a sensor for detecting the color of the back of the hand using light.

The third biometric recognition unit may be configured to recognize a user's voice, and more specifically, may be configured to recognize characteristic information (eg, a groove) according to the pronunciation of a specific word. Here, the characteristic information may be Mel-Frequency Cepstral Coefficients, Short Time Energy, Zero Crossing Rate, Spectral Rolloff, Spectral Flux, or Spectral Centroid of the user's voice.

The fourth biometric recognition unit may be configured to recognize the user's motion information, and may be configured to recognize the user's motion based on an image or to recognize the motion of the unmanned aerial vehicle according to the user's motion. Here, the fourth biometric recognition unit may include a gyro sensor for detecting the user's movement.

The fifth recognition module (not shown) may be configured to recognize a gene from a user's saliva.

Next, the confirmation unit may be configured to determine whether the biometric information provided by the user and the previously registered biometric information are identical.

As an example, the confirmation unit extracts the image of the eye, nose, mouth, ear, etc. and/or the image of the iris and the pupil region within the eyeball image from the face shape image acquired by the first biometric information recognition unit) and converts it into a two-dimensional code. can be processed.

As another example, the confirmation unit extracts feature points of image information such as palm palms, fingerprints, backs of fingers, backs of the entire hand, joint intervals, nail shapes, blood veins, etc. from the image information detected by the second biometric information recognition unit. to process it into a two-dimensional code.

The feature point refers to a point generated at a point where the curve is greatest for each ridge in an image related to a fingerprint, a palm print, a wrinkle, etc. among a plurality of sensors, and each feature point includes coordinate information corresponding to a location.

The characteristic point of the present application may be a point given by searching for the curvature of the ridges displayed on the back of the hand and partial images of a specific finger (nails, dorsal folds of the fingers, and internode spacing).

The present application uses the FAST (Features from Accelerated Segment Test) algorithm as a feature point setting algorithm, and when a feature point is extracted from each image, it is stored as the feature point x and y coordinates on the image. The feature point setting algorithm provides a descriptor to each set feature point, and the descriptor defines the feature of the feature point with pixels surrounding the feature point. For example, characteristic information such as flow direction and size change of the ridge is defined.

Next, the block chain encryption unit 470 converts the unmanned aerial vehicle authentication information into a hash function-based hash value according to the user, and then applies the unmanned aerial vehicle authentication information to the block chain encryption electronic wallet to block the leakage of the unmanned aerial vehicle authentication information from external hacking. It may be configured to register and store airship authentication information.

Here, the block chain encryption unit 470 registers and manages a hash function-based hash value of the unmanned aerial vehicle authentication information registered by the enterprise, organization or group in the consortium block chain when the user of the user terminal is a company or institution. And, when the user of the unmanned aerial vehicle is an individual or a group of companies, it registers and manages a hash value based on a hash combination of the registration information registered by the user in a private block chain or public block chain.

Here, a detailed description of the private, public, and consortium blockchains will be described later.

Meanwhile, the user terminal 400 may be designed to receive user authentication information from a user terminal that is an external terminal.

That is, a bidirectional network between the user terminal and the user terminal may be formed. In addition, user authentication information and control information transmitted to the unmanned aerial vehicle 200 may be provided by being grafted with block chain and hard setting technology for security.

Next, when the identity authentication processing of the biometric information authentication unit 420 is completed, the network docking unit 430 uses a unique network IP between the unmanned aerial vehicle and the communication unit assigned (set) to the user terminal 300. communication connection, and tracks the unique network IP within the preset communication area.

In addition, when the network docking unit 430 is assigned to a virtual network IP group from the network unit to be described later when selecting the multi-way flight mode through the multi-access control unit 460 to be described later, the network docking unit 430 blocks the existing network docking, and virtual Retry network docking with drone with network group IP.

The communication unit 440 may be configured to communicate with the unmanned aerial vehicle and the integrated control server 300 through a network network.

Here, the network includes satellite communication, local area network (LAN), metropolitan area network (MAN), global system for mobile network (GSM), enhanced data GSM environment (EDGE), high speed downlink packet access (HSDPA), W-CDMA (Wideband Code Division Multiple Access), CDMA (Code Division Multiple Access), TDMA (Time Division Multiple Access), Bluetooth, Zigbee, VoIP (Voice over Internet Protocol), LTE Advanced, IEEE802.16m, WirelessMAN -Advanced, HSPA+, 3GPP Long Term Evolution (LTE), Mobile WiMAX (IEEE 802.16e), UMB (formerly EV-DO Rev. C), Flash-OFDM, iBurst and MBWA (IEEE 802.20) systems, HIPERMAN, Beam-Division Any communication method selected from the group consisting of Multiple Access (BDMA), World Interoperability for Microwave Access (Wi-MAX), and ultrasound-based communication may be performed.

On the other hand, the network may provide an environment for enabling communication between each configuration, for example, TCP/IP protocol and various services existing in its upper layer, namely HTTP (Hyper Text Transfer Protocol), Telnet, FTP ( File Transfer Protocol), Domain Name System (DNS), Simple Mail Transfer Protocol (SMTP), Simple Network Management Protocol (SNMP), Network File Service (NFS), Network Information Service (NIS), etc. can

The display unit 450 may display a photographed image captured by the unmanned aerial vehicle, flight state information, and geographic information of an area in which the unmanned aerial vehicle flies.

In addition, the display unit 450 may display a network docking state between the user terminal and the unmanned aerial vehicle, and a flight mode (personally controlled flight mode or multilaterally controlled flight mode).

In addition, the display unit 450 may include a function of displaying the screen to flicker when the unmanned aerial vehicle enters the flight restricted area.

Liquid Crystal Display (LCD), Thin Film Transistor-Liquid Crystal Display (TFT LCD), Organic Light-Emitting Diode (OLED), Flexible Display (Flexible Display), 3D Display (3D Display), an e-ink display (e-ink display), may include at least one of LED (Light Emitting Diode).

The multi-connection control unit 460 may be configured to select a mode for flight control of one unmanned aerial vehicle in a relay manner with a plurality of control terminals.

The multi-access control unit 460 may include an input unit for inputting an ID of a sub-control terminal for multi-party flight coordination. Here, the input means may include a function to call the ID of the previously registered sub control terminal stored in the memory.

In addition, the multi-access control unit 460 is interlocked with the network docking unit 330, and after receiving the virtual network group IP from the unmanned aerial vehicle security management server 400 to be described later, after releasing the network docking connected to the unmanned aerial vehicle , performs a function of providing re-docking indication information to the received network group IP.

That is, the network docking unit 430 may attempt and release network docking, for example, wired/wireless network docking or Bluetooth pairing (connection, interworking), under the control of the multi-access controller 360 .

14 is a flowchart illustrating a ground monitoring method using a hybrid unmanned aerial vehicle according to an embodiment of the present invention.

14, in the ground monitoring method (S700) using the hybrid unmanned aerial vehicle according to an embodiment of the present invention, the integrated control server 300 transmits the target point coordinates to the hybrid unmanned aerial vehicle 200. The hybrid unmanned airship 200 receives the weather condition information from the satellite in real time, calculates the shortest flight path to the target location transmitted from the integrated control server 300, and then corrects the shortest flight path according to the weather condition. Create a flight path.

Thereafter, the hybrid unmanned aerial vehicle 200 flies to the target location and searches for the occurrence point of the set event while simultaneously photographing the ground image.

Here, when an event is detected during flight movement, it descends to the detected area and performs a hovering operation to precisely search the detected area.

The event detection is performed by the event determination unit 242 , and a deep learning algorithm may be used as a configuration for determining whether an event occurs in an image captured by the camera 241 .

The deep learning is a technology used to cluster or classify objects or data. It is a technology that inputs a large amount of data into a computer and classifies similar ones. At this time, many machine learning algorithms have already appeared on how to classify data. Deep learning is an artificial intelligence learning method proposed to overcome the limitations of artificial neural networks. For reference, the deep learning algorithm disclosed in the present invention is employed, and the deep learning algorithm may include a Deep Belief Network, an Autoencoder, a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), a Deep Q-Network, etc., The deep learning algorithm listed in the present invention is only an example, and is not limited thereto. In the present invention, an example of applying CNN (Convolutional Neural Network), which is one of the deep learning algorithms listed above, is applied to the system, but the present invention is not limited thereto, and various types of deep learning algorithms may be used according to the user's selection. may be

More specifically, in the event detection process, the sampling unit 242-1 samples using the terrestrial image obtained from the camera 241, and then uses the sample image of the terrestrial image sampled by the capability enhancement unit 242-2 as data. Pre-process and enhance capability (Augmentation). At this time, we implement detection neural network model training, data generation model training, and data generation.

Thereafter, the transfer learning unit 242-3 transfers the neural network model by learning the image with the capacity augmentation unit 242-2 in the transfer learning unit 242-3, and the transfer learning unit 242-3 uses the detection neural network to transfer data. By training a generative model neural network, a lot of event image data can be newly generated and stored in memory.

Here, the transfer learning unit 242-3 extracts an object region using a Region Proposal Network (RPN) to specify a region corresponding to an event included in the pre-processed image.

Then, in order to recognize an object in the extracted object area as a single object, it learns using R-CNN algorithm, a deep learning algorithm, and compares it with several objects in memory. The learning result is upgraded by storing the name result of the object back in memory. The stored results are saved as new learning to upgrade the R-CNN algorithm.

Next, the transfer-learned detection algorithm is selected and applied using the image acquired by the algorithm application unit 242-4. The algorithm application unit 242-4 may perform object recognition faster by convolutionally combining RPN for specifying an object area and Fast R-CNN, which is an algorithm for recognizing a specified object, into one network. That is, by comparing the object in the image with the various information stored in the memory for object recognition, the time required for many calculations can be reduced, and the existence and location of the event can be recognized much faster than the existing method.

Thereafter, the event detection unit 240 searches for the occurrence of the primary event in the image, and when the event is detected, precisely detects the occurrence of the secondary event through a hovering operation at the point where the event occurs.

Since the secondary event detection is performed in the same manner as the primary event detection, a more detailed description will be omitted.

After that, the precisely searched detection image is transmitted to the integrated control server, a movement message and new target coordinates are received from the integrated control server, and then weather condition information is received from the satellite in real time, and transmitted from the integrated control server 300 . After calculating the shortest flight path to a new target location, the shortest flight path is created by correcting the shortest flight path according to the weather conditions, and then moves to the shortest flight path.

15 illustrates an example computing environment in which one or more embodiments disclosed herein may be implemented, and is an illustration of a system 1000 including a computing device 1100 configured to implement one or more embodiments described above. shows For example, computing device 1100 may be a personal computer, server computer, handheld or laptop device, mobile device (mobile phone, PDA, media player, etc.), multiprocessor system, consumer electronics, minicomputer, mainframe computer, distributed computing environments including any of the aforementioned systems or devices, and the like.

The computing device 1100 may include at least one processing unit 1110 and a memory 1120 . Here, the processing unit 1110 may include, for example, a central processing unit (CPU), a graphic processing unit (GPU), a microprocessor, an Application Specific Integrated Circuit (ASIC), Field Programmable Gate Arrays (FPGA), etc. and may have a plurality of cores. The memory 1120 may be a volatile memory (eg, RAM, etc.), a non-volatile memory (eg, ROM, flash memory, etc.), or a combination thereof. Additionally, computing device 1100 may include additional storage 1130 . Storage 1130 includes, but is not limited to, magnetic storage, optical storage, and the like. The storage 1130 may store computer readable instructions for implementing one or more embodiments disclosed herein, and other computer readable instructions for implementing an operating system, an application program, and the like. Computer readable instructions stored in storage 1130 may be loaded into memory 1120 for execution by processing unit 1110 . Computing device 1100 may also include input device(s) 1140 and output device(s) 1150 .

Here, the input device(s) 1140 may include, for example, a keyboard, mouse, pen, voice input device, touch input device, infrared camera, video input device, or any other input device, or the like. Further, the output device(s) 1150 may include, for example, one or more displays, speakers, printers, or any other output device, or the like. Also, the computing device 1100 may use an input device or an output device included in another computing device as the input device(s) 1140 or the output device(s) 1150 . Computing device 1100 may also include communication connection(s) 1160 that enable computing device 1100 to communicate with another device (eg, computing device 1300 ).

Here, communication connection(s) 1160 may be a modem, network interface card (NIC), integrated network interface, radio frequency transmitter/receiver, infrared port, USB connection, or other for connecting computing device 1100 to another computing device. It may include interfaces. Further, the communication connection(s) 1160 may include a wired connection or a wireless connection. Each component of the above-described computing device 1100 may be connected by various interconnections such as a bus (eg, peripheral component interconnection (PCI), USB, firmware (IEEE 1394), optical bus structure, etc.) and may be interconnected by the network 1200 . As used herein, terms such as "component," "system," and the like, generally refer to a computer-related entity that is hardware, a combination of hardware and software, software, or software in execution.

For example, a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. For example, both an application running on a controller and a controller may be a component. One or more components may reside within a process and/or thread of execution, and components may be localized on one computer or distributed between two or more computers.

The present invention is not limited by the above embodiments and the accompanying drawings. For those of ordinary skill in the art to which the present invention pertains, it will be apparent that the components according to the present invention can be substituted, modified and changed without departing from the technical spirit of the present invention.

100: Ground monitoring system using hybrid unmanned airship based on convergence block chain
200: hybrid drone
210: inert gas tube
220: power supply
230: flyer prominence
240: event detection unit
241: camera unit
243: Camera Gimbal
244: memory
242: event judgment unit
242-1: sampling unit
242-2: Capacity Building Department
242-3: Transfer Learning Unit
242-4: Algorithm application unit
250: drive control unit
270: solar panel
280: satellite legal department
290: communication department
300: integrated control server
310: operation management department
320: Unmanned Aircraft Management Department
330: communication unit
340: database
350: flight information management unit
360: remote control unit
370: event processing unit
380: user authentication information management unit
400: user terminal
410: control panel
420: biometric information authentication unit
430: network docking unit
440: communication department
450: display
460: multi-access control unit
470: block chain encryption unit

Claims (5)

At least one hybrid unmanned aerial vehicle that flies using sunlight as a power source and searches for an area where a preset event has occurred, and
Integrated control that monitors the status of at least one of the ground, road traffic, forest, marine algae, and crime prevention security based on the search information found in the at least one or more hybrid unmanned aerial vehicles, and shares the monitoring information with a server of a corresponding agency including the server;
The integrated control server is
Distributed storage of real-time weather data or location data of the hybrid unmanned aerial vehicle in a public blockchain, and at least one user terminal's drone authentication data are stored in at least one Full Blockchain Node constituting a private blockchain and initially created A key is transmitted to the at least one user terminal, the initially generated key is stored and shared in at least one full node constituting a consortium blockchain, and the initial generated key is stored in the at least one user terminal. When the key is lost, the ground monitoring system using a hybrid unmanned airship based on a convergence block chain, characterized in that the recovery or reset of the initially generated key is performed using the drone authentication data in the consortium block chain. According to claim 1,
The unmanned aerial vehicle
gas;
a power supply that is installed on the base and converts sunlight into electric energy and supplies it;
a plurality of flyer propellants operating with power supplied from the power supply;
an event detection unit provided at the bottom of the aircraft and providing photographing information of a point where an event designated by the integrated control server occurred;
a driving control unit for controlling the flying operation of each of the plurality of flyer propellants;
a satellite navigation unit that receives weather condition information from the satellite in real time, calculates the shortest flight path to the target location transmitted from the integrated control server, and corrects the shortest flight path according to the weather condition;
a communication unit for transmitting and receiving data to and from the integrated control server using satellite communication; and
A ground monitoring system using a hybrid unmanned airship based on a convergence block chain including a driving control unit for controlling each operation of the plurality of flyer propellants to fly on the shortest flight path. 3. The method of claim 2,
The unmanned aerial vehicle
Ground monitoring system using a hybrid unmanned airship based on a convergence block chain, characterized in that it further comprises an inert gas tube filled with an inert (helium) gas connected to the upper part of the gas. 3. The method of claim 2,
The front surface of the inert gas tube is
A plurality of flexible solar panels are attached,
The event detection unit
When an event set by the integrated control server occurs in the captured image, the ground monitoring system using a hybrid unmanned airship based on a convergence block chain that transmits the location information and the shooting information of the spot including the event. After receiving the coordinates of the target point transmitted from the integrated control server, receiving weather condition information in real time from the satellite, and then generating the shortest flight path according to the weather condition;
A hybrid unmanned aerial vehicle flying to a target location, and searching for a point of occurrence of a set event while photographing a ground image;
when an event is detected during flight movement of the hybrid unmanned aerial vehicle, descending to the detected area, performing a hovering operation, and precisely searching the detected area; and
After transmitting the precisely searched detection image to the integrated control server, when a moving message and new target coordinates are received from the integrated control server, the shortest flight path to the new target location is calculated after receiving the weather condition information from the satellite in real time. After calculating, including the step of moving to the shortest flight path,
The integrated control server distributes and stores real-time weather data or location data of the hybrid unmanned airship in a public block chain, and at least one full node (Full Blockchain Node) that forms a private block chain with the drone authentication data of at least one user terminal. stores and transmits the initially generated key (Key) to the at least one user terminal, stores and shares the initially generated key in at least one full node constituting a consortium blockchain, and the at least one user When the terminal loses the initially generated key, a ground monitoring method using a hybrid unmanned airship based on a convergence block chain that restores or resets the initially generated key using the drone authentication data in the consortium block chain.

Images