KR102263892B1 - Navigation positioning system for multicopter adjacent power rail, in geomagnetic disturbance situation, and control method - Google Patents

Abstract

The present invention relates to a system for correcting navigation information based on a terrestrial magnetism disturbance when a multi-copter is adjacent to an electric railway line and a control method thereof. According to one aspect of the present invention, a navigation information correction method for a multi-copter includes: a first step in which at least one multi-copter photographs at least one rail laid on the ground by using a camera; a second step in which the at least one multi-copter calculates heading information by using an installation direction of the at least one rail; a third step in which the at least one multi-copter photographs the at least one rail while moving based on the calculated heading information; a fourth step in which the at least one multi-copter transmits the heading information and the photographed image information to a server; a fifth step in which the server matches the image information with pre-stored map information related with the at least one rail, based on the heading information; and a sixth step in which the server detects damage related with the at least one rail based on the matched map information and the matched image information.

Description

Navigation positioning system for multicopter adjacent power rail, in geomagnetic disturbance situation, and control method

The present invention relates to a system for correcting navigation information by geomagnetic disturbance when a multicopter approaches a catenary and a method for controlling the same.

Unmanned Aerial Vehicles (UAVs) fly by remote control or autonomous flight control without a pilot on board, so that it is difficult for humans to perform them directly, such as reconnaissance, bombing, cargo transportation, forest fire monitoring, and radiation monitoring. It means an airplane performing a dangerous mission.

It is important for an unmanned aerial vehicle to land safely at a desired point after completing its mission, but it is necessary to precisely control the landing so that it does not fall down during landing on the ground or on the landing pad because the pilot is not on board and controls it.

Landing-related navigation systems of unmanned aerial vehicles are being implemented in various ways for each type of unmanned aerial vehicle. In general, GPS and inertial guidance devices are mainly used for navigation or landing guidance of unmanned aerial vehicles. Among them, GPS tends to be preferred because of its low chipset price and small size. For example, in the case of an unmanned aerial vehicle such as a Predator, which is a kind of unmanned aerial vehicle, it is implemented to enable manually controlled landing using a precision approach radar and a video camera.

A typical example of an unmanned aerial vehicle is a multicopter.

A multicopter or multirotor refers to a vehicle that obtains buoyancy by using two or more rotors as opposed to a fixed-wing vehicle, and the movement of the vehicle is made by adjusting the relative rotational speed of each rotor.

Recently, a multicopter is receiving new attention in various fields as an unmanned aerial vehicle that has been mainly used only as a military weapon.

For example, it is emerging as a next-generation logistics delivery method, and its infinite potential is recognized as it is used in various fields such as agriculture, disaster relief, broadcasting, and leisure.

These multicopters are also called 4-, 6-, 8-rotor helicopters, drones, etc. depending on the number of rotors.

On the other hand, drones can also be used to inspect railway facilities. At this time, in a railway environment, large voltages of AC 25KV and DC 3000V are applied to the catenary, and a large current flows up to 300A at the moment the train passes.

Therefore, a large magnetic field is formed around the catenary, which greatly affects the geomagnetic sensor, which is one of the drone's navigation sensors.

On the other hand, since relatively little current flows when the train is not running, the magnetic field around the catenary is smaller than when the train passes, but it affects the navigation sensor.

As such, there is a problem in that it is difficult to cope with the change in the magnetic field in the railway environment for the drone to fly in the railway environment because the change in the magnetic field is severe in the railway environment and it causes a disturbance in the navigation sensor.

In other words, the multicopter uses all of the GPS, accelerometer, geomagnetic sensor, and altimeter to position a location and perform navigation. In order to perform navigation, location information, heading information, and acceleration information are required, of which heading information is geomagnetic. obtained from the sensor.

At this time, the geomagnetic sensor is a sensor that senses the magnetic force of the earth like a compass and detects where the multicopter is heading, and when the multicopter approaches the catenary, it is affected by the magnetic field generated by the current flowing in the catenary.

At this time, the induced magnetic field causes a large error in the heading angle of the geomagnetic sensor mounted on the multicopter, and there is a problem that the multicopter that does not recognize the heading may fall.

Registered Patent KR 10-1586188

In order to solve the above-mentioned problems, the present invention is to provide a navigation information correction system and a control method therefor by geomagnetic disturbance when a multicopter's catenary approaches.

Specifically, the present invention is to provide a system comprising a gimbal mounted on a multicopter, a camera mounted on the gimbal, a distance measuring sensor, and a navigation computer that receives and processes camera information and distance measuring sensor information.

In addition, an object of the present invention is to provide a user with a method for automatically adjusting the direction of a camera by following a rail.

Another object of the present invention is to provide a user with a system and method for calculating heading information of a multicopter by using the angle at which the longitudinal rail is misaligned in the image, the angle at which the gimbal is misaligned in the multicopter, and distance information from the rail.

In addition, the present invention is to provide a user with a multicopter navigation system using the developed system, GPS, accelerometer, and altimeter, and a method for controlling the same.

On the other hand, the technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned are clearly to those of ordinary skill in the art to which the present invention belongs from the description below. can be understood

A method of correcting navigation information of a multicopter according to an aspect of the present invention for achieving the above technical problem, the at least one multicopter, a first step of photographing at least one rail installed on the ground using a camera; a second step of calculating, by the at least one multicopter, heading information using an installation direction of the at least one rail; a third step of photographing, by the at least one multicopter, the at least one rail while moving based on the calculated heading information; a fourth step of transmitting, by the at least one multicopter, the heading information and the captured image information to a server; a fifth step of matching, by the server, the image information with map information related to the at least one rail stored in advance based on the heading information; and a sixth step of detecting, by the server, damage related to the at least one rail based on the matched map information and the matched image information.

In addition, the second step, the at least one multicopter, a step 2-1 of automatically adjusting the direction of the camera by following the installation direction of the at least one rail; First angle information at which the at least one rail is twisted based on a predetermined point in the image taken by the at least one multicopter, and a gimbal connecting the camera and the at least one multicopter is based on the multicopter a step 2-2 of obtaining separation distance information between the at least one rail and the at least one multicopter through the second angle information and the distance sensor that are distorted; and step 2-3 of calculating the heading information based on the first angle information, the second angle information, and the separation distance information. may include.

In addition, the second step may be performed according to a predetermined period, and the heading information may be changeable.

In addition, the fifth step may include: a 5-1 step in which the server calculates the posture coordinates of the at least one multicopter based on the heading information; a 5-2 step of synchronizing the position of the at least one multicopter at the time of capturing the image information and the calculated posture coordinates on the trajectory of the at least one multicopter in the image information; and a 5-3 step of matching where the position of the image information is located in the trajectory in the map information based on the synchronization operation; may include.

Also, the map information may be information through a Geographic Information System (GIS).

On the other hand, in the navigation information correction system of a multicopter including at least one multicopter and a server, which is another aspect of the present invention for achieving the above technical problem, the at least one multicopter is on the ground using a camera. Photographing the at least one installed rail, calculating heading information using the installation direction of the at least one rail, moving based on the calculated heading information, photographing the at least one rail, and the heading information and transmits the photographed image information to a server, wherein the server matches the image information with the map information related to the at least one rail stored in advance based on the heading information, and the matched map information and the matching Based on the obtained image information, it is possible to detect damage related to the at least one rail.

In addition, the at least one multicopter automatically adjusts the direction of the camera by following the installation direction of the at least one rail, and the at least one rail is twisted first based on a certain point in the captured image. Angle information, second angle information in which a gimbal connecting the camera and the at least one multicopter is twisted with respect to the multicopter, and separation distance information between the at least one rail and the at least one multicopter through a distance sensor , and the heading information may be calculated based on the first angle information, the second angle information, and the separation distance information.

In addition, the server calculates the posture coordinates of the at least one multicopter based on the heading information, and on the trajectory of the at least one multicopter in the image information, the at least one It is possible to synchronize the position of the multicopter and the calculated posture coordinates, and match where the position of the image information is located in the trajectory in the map information based on the synchronization operation.

The present invention can provide a navigation information correction system and a control method therefor by geomagnetic disturbance when a multicopter approaches a catenary in order to solve the above problems.

Specifically, the present invention can provide a system comprising a gimbal mounted on a multicopter, a camera mounted on the gimbal, a distance measurement sensor, and a navigation computer that receives and processes camera information and distance measurement sensor information.

In addition, the present invention can provide a user with a method of automatically adjusting the direction of the camera by following the rail.

In addition, the present invention can provide the user with a system and method for calculating the heading information of the multicopter by using the angle at which the longitudinal rail is misaligned in the image, the angle at which the gimbal is misaligned in the multicopter, and distance information from the rail.

In addition, the present invention can provide a user with a multicopter navigation system using the developed system, GPS, an accelerometer, and an altimeter, and a method for controlling the same.

On the other hand, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

1 shows an example of a general plan configuration of a quadcopter, which is a kind of unmanned aerial vehicle.
2 is a view showing an example of the operating principle of a general quadcopter related to the present invention.
3 shows an example of a block configuration diagram of a navigation information correction system by geomagnetic disturbance when the multicopter of the present invention approaches a catenary.
4 shows an example of a block diagram of a drone applied to the system proposed by the present invention.
5 is a flowchart illustrating a method of correcting navigation information by geomagnetic disturbance when a multicopter approaches a catenary in relation to the present invention.
6 is a flowchart illustrating a method of correcting heading information of a multicopter by recognizing the direction of a rail in relation to the present invention.
7 is a flowchart illustrating a method of matching an orbit image with an image of a GIS diagram using corrected heading information in relation to the present invention.

Multicopter (Drone)

An unmanned aerial vehicle (UAV), or simply a drone, is an air vehicle designed to perform a designated mission without a pilot.

Another name for unmanned aerial vehicles is the buzzing of bees, which is why they are also called drones.

It is sometimes referred to as an abbreviation of Uninhabited Aerial (Air) Vehicle, emphasizing the fact that there is a remote-controlled pilot on the ground as there are no people on the aircraft.

Unmanned aerial vehicles operate as independent systems or in conjunction with space and ground systems.

Various equipment (optical, infrared, radar sensor, etc.) is loaded depending on the field of application to carry out missions such as monitoring, reconnaissance, induction of precision attack weapons, communication/information relay, EA/EP, and Decoy, and loading explosives to provide precision As a weapon itself has been developed and put to practical use, it is attracting attention as a major means of military power in the future.

A typical example of an unmanned aerial vehicle is a multicopter.

A multicopter or multirotor refers to a vehicle that obtains buoyancy by using two or more rotors as opposed to a fixed-wing vehicle, and the movement of the vehicle is made by adjusting the relative rotational speed of each rotor.

Hereinafter, for convenience of description, it is assumed that the type of the unmanned aerial vehicle to which the present invention is applied is a quadcopter.

However, the content of the present invention is not limited to the quadcopter, it is obvious that it can be applied to other types of unmanned aerial vehicles.

1 shows an example of a general plan configuration of a quadcopter, which is a kind of unmanned aerial vehicle.

Referring to FIG. 1 , the quadcopter 100 includes a body 10 , four arms 20 radially fixed to the body 10 , and a motor 40 provided on each arm 20 . It is composed of four propellers 30 that are rotationally driven.

The quadcopter 100 configured in this way controls the rotation speed of each propeller 30 to perform thrust and attitude control necessary for flight.

In addition, FIG. 2 is a view showing the operation principle of a general quadcopter related to the present invention.

In FIG. 2, arrows of each propeller indicate the rotation direction and the magnitude of the speed.

Referring to FIG. 2 , the first propeller 31 and the third propeller 33 and the second propeller 32 and the fourth propeller 34 disposed to face each other rotate in opposite directions at the same rotational speed. In this case, the height of the quadcopter is adjusted in a parallel posture or hovering is made according to the size of the rotation speed (a).

In addition, yawing, rolling, and pitching can be performed by changing the rotational speed of a specific propeller among the four propellers.

For example, by controlling the rotational speeds of the first propeller 31 and the third propeller 33 and the second propeller 32 and the fourth propeller 34 differently from each other, the yaw control of the aircraft can be achieved ( b), by controlling the rotation speed of only a specific propeller out of the four propellers differently, the pitching control of the aircraft can be made.

When the quadcopter that operates in this way wants to move in a specific direction, it is done through pitching control, which corresponds to a basic operating principle in a multicopter regardless of the number of propellers.

Problems of the prior art

Drones can also be used to inspect railway facilities. At this time, in a railway environment, large voltages of AC 25KV and DC 3000V are applied to the catenary, and a large current flows up to 300A at the moment the train passes.

Therefore, a large magnetic field is formed around the catenary, which greatly affects the geomagnetic sensor, which is one of the drone's navigation sensors.

On the other hand, since relatively little current flows when the train is not running, the magnetic field around the catenary is smaller than when the train passes, but it affects the navigation sensor.

As such, there is a problem in that it is difficult to cope with the change in the magnetic field in the railway environment for the drone to fly in the railway environment because the change in the magnetic field is severe in the railway environment and it causes a disturbance in the navigation sensor.

In other words, the multicopter uses all of the GPS, accelerometer, geomagnetic sensor, and altimeter to position a location and perform navigation. In order to perform navigation, location information, heading information, and acceleration information are required, of which heading information is geomagnetic. obtained from the sensor.

At this time, the geomagnetic sensor is a sensor that senses the magnetic force of the earth like a compass and detects where the multicopter is heading, and when the multicopter approaches the catenary, it is affected by the magnetic field generated by the current flowing in the catenary.

At this time, the induced magnetic field causes a large error in the heading angle of the geomagnetic sensor mounted on the multicopter, and there is a problem that the multicopter that does not recognize the heading may fall.

Accordingly, in order to solve the above-described problems, the present invention is to provide a navigation information correction system and a control method therefor by geomagnetic disturbance when a multicopter approaches a catenary.

Specifically, the present invention is to provide a system comprising a gimbal mounted on a multicopter, a camera mounted on the gimbal, a distance measuring sensor, and a navigation computer that receives and processes camera information and distance measuring sensor information.

In addition, an object of the present invention is to provide a user with a method for automatically adjusting the direction of a camera by following a rail.

Another object of the present invention is to provide a user with a system and method for calculating heading information of a multicopter by using the angle at which the longitudinal rail is misaligned in the image, the angle at which the gimbal is misaligned in the multicopter, and distance information from the rail.

In addition, the present invention is to provide a user with a multicopter navigation system using the developed system, GPS, accelerometer, and altimeter, and a method for controlling the same.

Navigation information correction system by geomagnetic disturbance when multicopter's catenary approaches

3 shows an example of a block configuration diagram of a navigation information correction system by geomagnetic disturbance when the multicopter of the present invention approaches a catenary.

Referring to FIG. 3 , the system for correcting navigation information by geomagnetic disturbance when the multicopter of the multicopter approaches the catenary according to the present invention may include the plurality of drones 1000, the navigation management unit 10 and the catenary 100 described above. .

Here, the navigation management unit 10 may communicate with the plurality of drones 1000 and perform an operation of collecting information related to the catenary 100 .

Here, a short-distance communication method or a long-distance communication method may be applied between the plurality of drones 1000 and the navigation management unit 10 .

Here, the short-range communication may include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra-Wideband (UWB), ZigBee, and Wireless Fidelity (Wi-Fi) technologies.

In addition, long-distance communication is CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), SC-FDMA (single carrier frequency division multiple access) technology may include.

Multicopter applied to the present invention

4 shows an example of a block diagram of a drone applied to the system proposed by the present invention.

4, the drone 1000 according to the present invention includes a wireless communication unit 1110, an A/V (Audio/Video) input unit 1120, a user input unit 1130, a sensing unit 1140, and an output unit ( 1150 ), a memory 1160 , an interface unit 1170 , a controller 1180 , a power supply unit 1190 , and the like.

Since the components shown in FIG. 4 are not essential, a device having more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 1110 may include one or more modules that enable wireless communication between the drone 1000 and a wireless communication system or between the drone 1000 and a network in which the drone 1000 is located. For example, the wireless communication unit 1110 may include a broadcast reception module 111 , a mobile communication module 1112 , a wireless Internet module 1113 , a short-range communication module 1114 , and a location information module 1115 , etc. .

The broadcast reception module 1111 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server that generates and transmits a broadcast signal and/or broadcast-related information or a server that receives a previously generated broadcast signal and/or broadcast-related information and transmits the received broadcast signal and/or broadcast-related information to the drone 1000 . The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may be provided through a mobile communication network. In this case, it may be received by the mobile communication module 1112 .

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast reception module 1111 is, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), Digital Video Broadcast (DVB-H). -Handheld), DVB-CBMS, OMA-BCAST, ISDB-T (Integrated Services Digital Broadcast-Terrestrial), etc. digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast reception module 1111 may be configured to be suitable not only for the above-described digital broadcast system but also for other broadcast systems.

A broadcast signal and/or broadcast related information received through the broadcast reception module 1111 may be stored in the memory 1160 .

The mobile communication module 1112 transmits/receives wireless signals to and from at least one of a base station, an external drone 1000, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission/reception of an audio signal, an image signal, or a text/multimedia message.

The wireless Internet module 1113 refers to a module for wireless Internet access, and may be built-in or external to the drone 1000 .

As the wireless Internet technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. may be used.

The short-range communication module 1114 refers to a module for short-range communication. As the short-range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 1115 is a module for obtaining the location of the drone 1000 , and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 1115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information, thereby generating a three-dimensional current according to latitude, longitude, and altitude. Location information can be accurately calculated. Currently, a method of calculating position and time information using three satellites and correcting errors in the calculated position and time information using another one satellite is widely used. Also, the GPS module 1115 may calculate speed information by continuously calculating the current location in real time.

Referring to FIG. 4 , the A/V (Audio/Video) input unit 1120 is for inputting an audio signal or a video signal, and may include a camera 1121 , a microphone 1122 , and the like. The camera 1121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 1151 .

The image frame processed by the camera 1121 may be stored in the memory 1160 or transmitted to the outside through the wireless communication unit 1110 .

In this case, two or more cameras 1121 may be provided according to the use environment.

For example, the camera 1121 may be provided with first and second cameras 1121a and 1121b for capturing a 3D image on the opposite surface of the device 100 on which the display unit 1151 is provided, and the drone ( A third camera 1121c for a user's self-photography may be provided in a portion of the surface on which the display unit 1151 of 1000 is provided.

In this case, the first camera 1121a may be for capturing a left eye image, which is a source image of a 3D image, and the second camera 1121b may be for capturing a right eye image.

In addition, the connection unit 1123 is a structure for connecting the camera 1121 and the drone 1000. Typically, a gimbal, a structure made to rotate an object about one axis, is a structure of the connection unit 1123 . This is a typical example.

In addition, the microphone 1122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 in the call mode and output. Various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 1122 .

The user input unit 1130 generates input data for the user to control the operation of the drone 1000 .

The user input unit 1130 may receive, from the user, a signal for designating two or more contents among contents displayed according to the present invention. In addition, a signal for designating two or more contents may be received through a touch input or may be received through a hard key and a soft key input.

The user input unit 1130 may receive an input for selecting the one or more contents from the user. Also, an input for generating an icon related to a function that the drone 1000 can perform may be received from a user.

As described above, the user input unit 1130 may include a direction key, a key pad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects the current state of the drone 1000, such as the opening/closing state of the drone 1000, the location of the drone 1000, the presence or absence of user contact, the orientation of the device, and acceleration/deceleration of the device. A sensing signal is generated to control the operation of the In addition, it is also possible to sense whether power is supplied to the battery 1190 , whether the interface unit 1170 is coupled to an external device, and the like. Meanwhile, the sensing unit 1140 may include a proximity sensor 1141 .

In particular, the sensing unit 1140 may include an acceleration sensor 1142 .

Here, the acceleration sensor 1142 refers to a sensor that measures the acceleration of a moving object or the strength of an impact.

Also, the sensing unit 1140 may include a geomagnetic sensor 1143 .

Here, the geomagnetic sensor 1143 refers to a sensor used to detect geomagnetism.

Also, the sensing unit 1140 may include an altitude sensor 1144 .

Here, the altitude sensor 1144 is a type of pressure sensor, and is a sensor used to detect a change in atmospheric pressure according to a difference in altitude and correct a difference in air-fuel ratio according to a change in air density sucked into the engine.

Also, the sensing unit 1140 may include a distance measuring sensor 1145 .

Here, when measuring the distance between two points, the distance measuring sensor 1145 is a sensor using a triangulation method (using infrared rays, natural light use), an ultrasonic method, or the like.

In addition, the output unit 1150 is for generating an output related to visual, auditory or tactile sense, and includes a display unit 1151 , a sound output module 1152 , an alarm unit 1153 , a haptic module 154 , and a projector. A module 1155 and the like may be included.

The display unit 1151 displays (outputs) information processed by the device 100 . For example, when the device is in a call mode, a user interface (UI) or graphic user interface (GUI) related to a call is displayed. When the device 100 is in a video call mode or a shooting mode, a captured and/or received image, UI, or GUI is displayed.

Also, the display unit 1151 according to the present invention supports 2D and 3D display modes.

That is, the display unit 1151 according to the present invention may have a configuration in which a switch liquid crystal 1151b is combined with a general display device 1151a as shown in FIG. 4 below. In addition, the optical parallax barrier 50 is operated using the switch liquid crystal 1151b to control the propagation direction of the light, so that different lights can be separated to reach the left and right eyes. For this reason, when the image in which the image for the right eye and the image for the left eye are combined is displayed on the display device 1151a, from the user's point of view, images corresponding to each eye are shown and feel as if displayed in three dimensions.

That is, under the control of the controller 1180, the display unit 1151 drives only the display device 1151a without driving the switch liquid crystal 1151b and the optical parallax barrier 50 in the 2D display mode. Perform normal 2D display operations.

In addition, under the control of the controller 1180, the display unit 1151 drives the switch liquid crystal 1151b, the optical parallax barrier 50, and the display device 1151a in the 3D display mode to drive the display device ( 1151a) is driven to perform a 3D display operation.

Meanwhile, the display unit 151 as described above includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), and an organic light-emitting diode (OLED). , a flexible display, and a three-dimensional display (3D display) may include at least one.

Some of these displays may be of a transparent type or a light-transmitting type so that the outside can be viewed through them. This may be referred to as a transparent display, and a typical example of the transparent display is a TOLED (Transparant OLED). The rear structure of the display unit 1151 may also be configured as a light-transmitting structure. With this structure, the user can see an object located at the rear of the body of the drone 1000 through the area occupied by the display unit 1151 of the body of the drone 1000 .

Two or more display units 1151 may exist depending on the implementation form of the drone 1000 . For example, in the device 100 , a plurality of display units may be spaced apart from each other on one surface or may be integrally disposed, or may be respectively disposed on different surfaces.

When the display unit 1151 and the sensor for sensing a touch operation (hereinafter, referred to as a 'touch sensor') form a layered structure (hereinafter referred to as a 'touch screen'), the display unit 1151 may be used in addition to the output device. It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 1151 or a change in capacitance generated at a specific portion of the display unit 1151 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of the touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to a touch controller (not shown). The touch controller processes the signal(s) and then transmits corresponding data to the controller 1180 . Accordingly, the controller 1180 can know which area of the display unit 1151 has been touched, and the like.

The proximity sensor 1141 may be disposed in an inner region of the device covered by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. Proximity sensors have a longer lifespan than contact sensors and their utility is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is of a capacitive type, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of bringing the pointer closer to the touch screen without making contact so that the pointer is recognized as being positioned on the touch screen is referred to as “proximity touch”, and the touch The act of actually touching the pointer on the screen is called "contact touch". The position at which a proximity touch is performed by the pointer on the touch screen means a position at which the pointer vertically corresponds to the touch screen when the pointer is touched in proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 1152 may output audio data received from the wireless communication unit 1110 or stored in the memory 1160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 1152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the drone 1000 . The sound output module 1152 may include a receiver, a speaker, a buzzer, and the like.

The memory 1160 may store a program for processing and control of the controller 1180 , and may perform a function for temporarily storing input/output data. The memory 1160 may also store the frequency of use of each of the data. In addition, the memory unit 1160 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

The memory 1160 as described above may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory, etc.). ), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic It may include at least one type of storage medium among a memory, a magnetic disk, and an optical disk.

The interface unit 1170 serves as a passage with all external devices connected to the drone 1000 . The interface unit 1170 receives data from an external device, receives power and transmits it to each component inside the drone 1000 , or allows data inside the drone 1000 to be transmitted to an external device. For example, wired/wireless headset ports, external charger ports, wired/wireless data ports, memory card ports, ports for connecting devices equipped with identification modules, audio input/output (I/O) ports, A video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 170 .

The identification module is a chip storing various information for authenticating the use right of the drone 1000, and is a user identification module (UIM), a subscriber identification module (SIM), a universal user identification module (Universal). Subscriber Identity Module (USIM), and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the drone 1000 through the port.

When the drone 1000 is connected to an external cradle, the interface unit becomes a passage through which power from the cradle is supplied to the drone 1000, or various command signals input from the cradle by a user are transmitted to the device. can be a pathway to Various command signals or the power input from the cradle may be operated as signals for recognizing that the device is correctly mounted on the cradle.

The controller 1180 generally controls the overall operation of the device. For example, it performs related control and processing for voice calls, data communications, video calls, and the like. The controller 1180 may include a multimedia module 1181 for playing multimedia. The multimedia module 1181 may be implemented within the controller 1180 or may be implemented separately from the controller 1180 .

The controller 1180 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch screen as characters and images, respectively.

On the other hand, when the display unit 1151 is provided with an organic light-emitting diode (OLED) or a transparent OLED (TOLED), the controller 1180 controls the input through the camera 121 according to the present invention. When the size of the preview image is adjusted according to a user's manipulation while the preview image is pull-up displayed on the screen of the organic light-emitting diode (OLED) or the transparent OLED (TOLED), the size of the preview image is displayed on the screen By turning off driving of pixels in the remaining second area except for the first area in which the preview image is displayed, the consumption of power supplied from the power supply unit 1190 to the display unit 151 may be reduced.

The power supply unit 1190 receives external power and internal power under the control of the control unit 1180 to supply power required for operation of each component.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to the hardware implementation, the embodiments described herein are ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays, It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions. The described embodiments may be implemented by the controller 1180 itself.

According to the software implementation, embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code may be implemented as a software application written in a suitable programming language. The software code may be stored in the memory 1160 and executed by the controller 1180 .

How to correct navigation information by geomagnetic disturbance when multicopter approaches catenary

Based on the above-described components of the present system, a method for correcting navigation information by geomagnetic disturbance when a multicopter's catenary approaches are described according to the present invention.

5 is a flowchart illustrating a method of correcting navigation information by geomagnetic disturbance when a multicopter approaches a catenary in relation to the present invention.

Referring to FIG. 5 , first, using the camera 1121 and the distance measuring sensor 1145 mounted on the multicopter 1000 , the step S10 of photographing the rail 100 installed on the ground in real time is performed. can be

Next, the multicopter 1000 recognizes the direction of the rail 100 and corrects the heading information of the multicopter 1000 ( S20 ) is performed.

Thereafter, the navigation management unit (server, 10) performs a step (S30) of matching the orbit image with the image of the GIS drawing using the corrected heading information received from the multicopter 1000.

Finally, the navigation management unit (server, 10) proceeds to the step (S40) of detecting damage to the track based on the matched information.

That is, the multicopter 1000 according to the present invention uses all of the GPS 1115 , the accelerometer 1142 , the geomagnetic sensor 1143 , the altimeter 1144 , and the like to position a location and perform navigation.

At this time, in order for the multicopter 1000 to perform navigation, location information, heading information, and acceleration information are required. Among them, the heading information is acquired from the geomagnetic sensor 1143 .

As described above, when the multicopter 1000 approaches the catenary 100 , it is affected by a magnetic field generated by a current flowing in the catenary 100 , and the induced magnetic field is a geomagnetic field mounted on the multicopter 1000 . A large error is generated in the heading angle of the sensor 1143 .

Therefore, since the multicopter 1000 not recognizing the heading may fall, the present invention proposes a method for acquiring heading information auxiliary.

That is, in the present invention, the rail 100 installed on the ground is photographed in real time using the camera 1121 and the distance measuring sensor 1145 mounted on the multicopter 1000, and the direction of the rail 100 is recognized. It relates to a method of correcting heading information of the multicopter (1000).

In addition, since the orbit image taken by the multicopter is used for detecting damage to the orbit (S40), it is necessary to automatically match where the captured image is located on the orbit diagram constructed based on GIS.

Therefore, in the present invention, by synchronizing the position and posture coordinates of the multicopter 1000 at the time of taking the photographed orbital image to the photographed orbital image, the image is positioned in the GIS space and a method of clearly knowing where it is on the orbital drawing is utilized.

However, since the track is under the catenary 100, the multicopter has no choice but to approach the catenary, and in this case, the correct posture coordinates of the multicopter 1000 cannot be obtained due to an error in the heading information of the geomagnetic sensor.

Therefore, in the present invention, by calculating the posture coordinates with the corrected heading information described above, the exact position and posture information of the captured trajectory image can be obtained, and the correct position on the GIS-based trajectory drawing can be automatically matched.

In the following, the multicopter 1000 recognizes the direction of the rail 100 and corrects the heading information of the multicopter 1000 ( S20 ) and the navigation management unit (server, 10 ) received from the multicopter 1000 . The step (S30) of matching the trajectory image and the image of the GIS drawing using the corrected heading information will be described in detail with reference to the drawings.

How to correct the heading information of the multicopter by recognizing the direction of the rail

Hereinafter, the step (S20) of the multicopter 1000 recognizing the direction of the rail 100 and correcting the heading information of the multicopter 1000 will be described in detail.

6 is a flowchart illustrating a method of correcting heading information of a multicopter by recognizing the direction of a rail in relation to the present invention.

Referring to FIG. 6 , first, the multicopter 1000 follows the rail 100 to automatically adjust the direction of the camera 1121 ( S21 ).

After that, the multicopter 1000 obtains information about the angle at which the rail 100 in the longitudinal direction is misaligned in the image, the angle at which the gimbal 1123 is misaligned in the multicopter 1000, and distance information from the rail 100 (S22). carry out

After step S22, a step (S23) of calculating heading information of the multicopter 1000 based on the obtained information is performed, and a step (S24) of moving and photographing the multicopter 1000 according to the calculated heading information (S24) proceeds

A method of matching the trajectory image and the image of the GIS drawing using the corrected heading information

Hereinafter, the step (S30) of matching the trajectory image with the image of the GIS drawing by the navigation management unit (server, 10) using the corrected heading information received from the multicopter 1000 will be described in detail.

7 is a flowchart illustrating a method of matching an orbit image with an image of a GIS diagram using corrected heading information in relation to the present invention.

Referring to FIG. 7 , the server 10 calculates the posture coordinates of the multicopter 1000 based on the corrected heading information ( S31 ).

Thereafter, the server 10 performs a step (S32) of synchronizing the position of the multicopter 1000 and the calculated posture coordinates at the time of photographing the captured trajectory image (S32).

After step S32, the server 10 matches where the image taken by the multicopter 1000 is located on the orbit diagram constructed based on the geographic information system (GIS) based on the synchronization operation ( S33) is performed.

Finally, the navigation management unit (server, 10) can proceed with the step (S40) of detecting damage to the track based on the matched information.

Effects according to the present invention

The present invention can provide a navigation information correction system and a control method therefor by geomagnetic disturbance when a multicopter approaches a catenary in order to solve the above problems.

Specifically, the present invention can provide a system comprising a gimbal mounted on a multicopter, a camera mounted on the gimbal, a distance measurement sensor, and a navigation computer that receives and processes camera information and distance measurement sensor information.

In addition, the present invention can provide a user with a method of automatically adjusting the direction of the camera by following the rail.

In addition, the present invention can provide the user with a system and method for calculating the heading information of the multicopter by using the angle at which the longitudinal rail is misaligned in the image, the angle at which the gimbal is misaligned in the multicopter, and distance information from the rail.

In addition, the present invention can provide a user with a multicopter navigation system using the developed system, GPS, an accelerometer, and an altimeter, and a method for controlling the same.

On the other hand, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

The above-described embodiments of the present invention may be implemented through various means. For example, embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof. In case of implementation by hardware, the method according to embodiments of the present invention may include one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), and Programmable Logic Devices (PLDs). , FPGAs (Field Programmable Gate Arrays), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of implementation by firmware or software, the method according to the embodiments of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code may be stored in the memory unit and driven by the processor. The memory unit may be located inside or outside the processor, and may transmit and receive data to and from the processor by various known means.

The detailed description of the preferred embodiments of the present invention disclosed as described above is provided to enable any person skilled in the art to make and practice the present invention. Although the above has been described with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art that various modifications and changes can be made to the present invention without departing from the scope of the present invention. For example, those skilled in the art may use each configuration described in the above-described embodiments in a way in combination with each other. Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention. The present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. In addition, claims that are not explicitly cited in the claims may be combined to form an embodiment, or may be included as new claims by amendment after filing.

Claims (8)

At least one multicopter, a first step of photographing at least one rail installed on the ground using a camera;
a second step of calculating, by the at least one multicopter, heading information using an installation direction of the at least one rail;
a third step of photographing, by the at least one multicopter, the at least one rail while moving based on the calculated heading information;
a fourth step of transmitting, by the at least one multicopter, the heading information and the captured image information to a server;
a fifth step of matching, by the server, the image information with map information related to the at least one rail stored in advance based on the heading information; and
A sixth step of detecting, by the server, damage related to the at least one rail based on the matched map information and the matched image information;

The second step is
a 2-1 step in which the at least one multicopter automatically adjusts the direction of the camera by following the installation direction of the at least one rail;
First angle information at which the at least one rail is twisted based on a predetermined point in the image taken by the at least one multicopter, and a gimbal connecting the camera and the at least one multicopter is based on the multicopter a step 2-2 of obtaining separation distance information between the at least one rail and the at least one multicopter through the second angle information and the distance sensor that are distorted; and
a 2-3 step of calculating the heading information based on the first angle information, the second angle information, and the separation distance information; Multicopter navigation information correction method comprising a.
delete The method of claim 1,
The second step is performed according to a predetermined period, and the heading information is changeable.
The method of claim 1,
The fifth step is
a 5-1 step of calculating, by the server, the posture coordinates of the at least one multicopter based on the heading information;
a 5-2 step of synchronizing the position of the at least one multicopter at the time of capturing the image information and the calculated posture coordinates on the trajectory of the at least one multicopter in the image information; and
a 5-3 step of matching the position of the image information on the orbit in the map information based on the synchronization operation; A method of correcting navigation information of a multicopter, comprising a.
The method of claim 1,
The map information is a navigation information correction method of a multicopter, characterized in that the information through a geographic information system (Geographic Information System, GIS).
In the multicopter navigation information correction system comprising at least one multicopter and a server,
The at least one multicopter,
using a camera to photograph at least one rail laid on the ground,
Calculating heading information using the installation direction of the at least one rail,
While moving based on the calculated heading information, the at least one rail is photographed,
Transmitting the heading information and the captured image information to a server,
The server is
Match the image information with map information related to the at least one rail stored in advance based on the heading information,
Detect damage related to the at least one rail based on the matched map information and the matched image information,

The at least one multicopter,
automatically adjusts the direction of the camera by following the installation direction of the at least one rail,
First angle information at which the at least one rail is misaligned based on a certain point in the captured image, second angle information and distance in which a gimbal connecting the camera and the at least one multicopter is misaligned with respect to the multicopter Obtaining separation distance information between the at least one rail and the at least one multicopter through a sensor,
The multicopter navigation information correction system, characterized in that calculating the heading information based on the first angle information, the second angle information, and the separation distance information.
delete 7. The method of claim 6,
The server is
calculating the posture coordinates of the at least one multicopter based on the heading information,
Synchronizing the position of the at least one multicopter at the time of capturing the image information and the calculated posture coordinates on the trajectory of the at least one multicopter in the image information,
Based on the synchronization operation, the multicopter navigation information correction system, characterized in that the position of the image information is matched with where it is located in the trajectory in the map information.

Images