KR101827249B1 - Intelligent system for object detection drone based on smart device using VPN, and Intelligent object detection method for the same - Google Patents
Intelligent system for object detection drone based on smart device using VPN, and Intelligent object detection method for the same Download PDFInfo
- Publication number
- KR101827249B1 KR101827249B1 KR1020160011674A KR20160011674A KR101827249B1 KR 101827249 B1 KR101827249 B1 KR 101827249B1 KR 1020160011674 A KR1020160011674 A KR 1020160011674A KR 20160011674 A KR20160011674 A KR 20160011674A KR 101827249 B1 KR101827249 B1 KR 101827249B1
- Authority
- KR
- South Korea
- Prior art keywords
- drones
- smart device
- control server
- drone
- user
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title abstract description 11
- 238000000034 method Methods 0.000 claims abstract description 31
- 230000008569 process Effects 0.000 claims abstract description 15
- 238000004891 communication Methods 0.000 claims abstract description 9
- 230000008901 benefit Effects 0.000 abstract description 2
- 230000000694 effects Effects 0.000 abstract description 2
- 238000003909 pattern recognition Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C27/00—Rotorcraft; Rotors peculiar thereto
- B64C27/04—Helicopters
- B64C27/08—Helicopters with two or more rotors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
- B64C39/024—Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/12—Messaging; Mailboxes; Announcements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/60—Subscription-based services using application servers or record carriers, e.g. SIM application toolkits
-
- B64C2201/127—
-
- B64C2201/146—
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Health & Medical Sciences (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
- User Interface Of Digital Computer (AREA)
- Selective Calling Equipment (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention relates to a smart device-based intelligent object recognition drones system and an intelligent object tracking method using a VPN network. In the present invention, when an open source computer vision mode (OpenCV) is requested by a user in a flight start mode for a dron according to a user's selection on a touch screen, a drones A smart device having an Android application that receives and displays an object recognition notification push message through a control server on a touch screen; And 3G / 4G data communication of the smart device that acts as a router in configuring the VPN network to track the object by matching the learned image and the captured image in advance, A drone that provides an object tracking process through the drones control server without being limited by distance, where possible; .
As a result, images received by a small aircraft type drones can be analyzed by pattern recognition and object detection by automatically analyzing images rather than simply recognized by Android smart devices. By providing intelligent CCTVs that replace conventional CCTVs, Detection, and so on.
In addition, the present invention is applicable to a general mode for general control of a drone as a flight start mode of a drone, a streaming mode for providing a real time image taken from a drone, an open source computer By providing vision mode (OpenCV), the user has the advantage of utilizing the drones for various purposes.
In addition, the present invention provides convenience for terrestrial exploration and job execution without being limited by the distance where a 3G / 4G data communication of a smart device acting as a router on the same network is possible using a VPN network It provides an effect that can be done.
Description
The present invention relates to a smart device-based intelligent object recognition drones system and an intelligent object tracking method using a VPN network. More particularly, the present invention relates to a smart device- Intelligent Object Recognition Drones System and Intelligent Object Based on Smart Device Using VPN Network to Trace Registered Dictionary Information by Matching and Tracking the Recorded Image by Using Intelligent Object Recognition Drone Tracking method.
FIG. 1 is a diagram illustrating a conventional unmanned aerial vehicle and image recognition technology. First, as shown in FIG. 1A, unmanned aerial vehicles (UAVs), which have been developed for military purposes, have been exploiting the explosive growth of the Internet of Things (IOT) Etc.), and it is possible to overcome the problems of various environments where human access is restricted like population density due to various terrain problems.
In addition, as shown in FIG. 1B, computer vision and image processing, which are progressing in research and development around the world as a core technology of future robotics along with development of science and technology, It is a field of intelligence that computers are used in various fields such as shooting, security task, CCTV control system, etc., by recognizing, judging, classifying, and tracking objects.
SUMMARY OF THE INVENTION The present invention has been made to solve the above problems and it is an object of the present invention to provide a smart device-based intelligent object using a VPN network to enable drones movement and camera control through a smart device in cooperation with a smart device such as a smart phone, A recognition drone system and an intelligent object tracking method.
However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.
According to an embodiment of the present invention, there is provided a smart device-based intelligent object recognition drones system using a VPN network, the intelligent object recognition drones system comprising: A smart device having an Android application for receiving an object recognition notification push message via a drones control server connected to a wireless AP and displaying it on a touch screen when a source computer vision mode (OpenCV) is requested; And 3G / 4G data communication of the smart device that acts as a router in configuring the VPN network to track the object by matching the learned image and the captured image in advance, A drone that provides an object tracking process through the drones control server without being limited by distance, where possible; .
According to an embodiment of the present invention, there is provided a smart device-based intelligent object recognition drones method using a VPN network, wherein an Android application of a smart device displays a fly start mode for a dron according to a user's selection on a touch screen A first step of performing the first step; And when the Android application receives an open source computer vision mode (OpenCV) from the user, the object recognition notification push message is received through the drones control server connected to the wireless AP and displayed on the touch screen during the object recognition by the drones A second step; .
A third step of receiving and displaying an object search push message through the drones control server in the object estimation process by the drones of the object recognized by the Android application after the second step; .
Also, in the third step, when the Android application is able to perform 3G / 4G data communication of the smart device serving as a router in configuring the VPN network, it is possible to transmit the object through the drones control server It is desirable to perform a tracking process.
The smart device-based intelligent object recognition drones system and intelligent object tracking method using a VPN network according to an embodiment of the present invention is an intelligent object recognition dron system and an intelligent object tracking method using a VPN network, And detecting and analyzing the object to provide an effect that can be used in various forms such as a missing person and a criminal detection using the intelligent CCTV that replaces the conventional CCTV.
In addition, the smart device-based intelligent object recognition drones system and the intelligent object tracking method using the VPN network according to another embodiment of the present invention include a general mode for general control of a drone as a flight start mode of a drone, (OpenCV), which performs tracing on the learned object. The user can utilize the drone for various purposes.
In addition, according to another embodiment of the present invention, a smart device-based intelligent object recognition drones system and an intelligent object tracking method using a VPN network can be applied to a smart device that acts as a ROUTER on the same network using a VPN network, 4G data communication, it is possible to provide convenience for terrain surveillance and work without restriction of distance.
FIG. 1 is a view showing an unmanned aerial vehicle and image recognition technology according to the prior art. FIG.
2 is a diagram illustrating a smart device-based intelligent object recognition drones system using a VPN network according to an embodiment of the present invention.
3 is a block diagram illustrating a class that constitutes an application of a smart device in a smart device-based intelligent object recognition drones system using a VPN network according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating a class of a drones control server in a smart device-based intelligent object recognition drones system using a VPN network according to an embodiment of the present invention;
5 is a diagram illustrating a program class of a smart device based intelligent object recognition drones system using a VPN network according to an exemplary embodiment of the present invention.
6 to 9 are views showing a UI screen implemented in a smart device among smart device-based intelligent object recognition drones systems using a VPN network according to an embodiment of the present invention.
FIG. 10 is a flowchart illustrating an intelligent object tracking method based on a smart device-based intelligent object recognition drones system using a VPN network according to an embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.
In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.
2 is a diagram illustrating a smart device-based intelligent object recognition drones system using a VPN network according to an embodiment of the present invention. Referring to FIG. 2, a
3 is a view showing a class constituting an application on the
3, the
The CreatedID 10a accesses the
The LoginActivity 10b performs login to the
The SeachIdpass 10d can perform the search through access to the
The MainActivity 10e controls the
The NDK (Native Development Kit: 10f) provides a work environment utilizing the Java Native Interface (JNI) based on the Android application. The NDK (10f) can act as a tool for inserting the library created according to the native code building process into the Android application package in the Android OS.
The Phtosaver 10g corresponds to a class for capturing an image screen provided from a camera of the
The DroneManager 10h corresponds to the class for the
The HttpCommunication 10i receives from the
The IMG
The OpenCVLibrary (10k) controls the object tracking that is recognized through the control of the detection (101) through real-time image processing from an open source computer vision library corresponding to OpenCV (Open Computer Vision).
Detection (10l) corresponds to a class for tracking by object recognition and object search using the drones (40).
The
FIG. 4 is a diagram illustrating a program class of a
The
MySQL (30c) is an open source relational database management class that uses SQL (Structured Query Language), a standard database query language. The MySQL 30c performs database management for providing a push message to be transmitted to the authenticated user through the user information stored in the
The JDK 30c is a Java program execution set class on a
The JSP 30d extracts tracking information on an image matched with the dictionary information learned by the
FIG. 5 is a diagram illustrating a program class of a
The
The
The
The VPN 40d establishes a private network on the public network, and performs 3G / 4G data communication of the
In another embodiment of the present invention, the VPN 40d includes a plurality of
6 to 9 are views showing a UI screen implemented in the
On the other hand, upon selection for flight start, the
On the main UI screen, the flight start mode provided by the flight start menu is made up of three modes: a general mode, a streaming mode, and an open source computer vision mode (OpenCV).
The normal mode corresponds to a mode for control using the
7 illustrates a streaming mode in which the Android application of the
In this case, four button buttons a1, a2, a3, and a4 are displayed on the touch screen by the Android application.
On the other hand, the real-time screen provided on the touch screen of the
In the OpenCV UI screen as shown in FIG. 8, object recognition is performed through objection detection through a texture displayed on a touch screen, and the
Accordingly, since the
8, when the Android application of the
FIG. 9 shows a case where an object recognized during the flight process of the
According to another embodiment of the present invention, when searching for a recognized object during the flight of the
10 is a flowchart illustrating an intelligent object tracking method based on a smart device-based intelligent object recognition drones system using a VPN network according to an embodiment of the present invention. Referring to FIG. 10, in order to provide the UI screen of FIGS. 6 to 9, the Android application of the
After step S110, the Android application of the
If it is determined in step S120 that the streaming mode is requested, the Android application of the
If the open source computer vision mode (OpenCV) is requested instead of the stream mode as a result of the determination in step S120, the Android application of the
To this end, the
According to another embodiment of the present invention, in step S140, by using the image recognition technology with the
After step S140, the Android application of the
The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.
Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) .
The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.
As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.
10:
10b:
10d:
10f:
10h:
10j:
10l:
20: Wireless AP 30: Drones control server
30a:
30c:
31: Database 40: Drones
40a:
40c: WiFi-
Claims (4)
A wireless AP that receives a user request from the smart device and transmits the user request to the drones control server, and provides the smart device with the image data and the drones' flight record data transmitted from the drones control server;
A drones control server for storing image data photographed by a drone in a database, extracting trace information on the stored images, and providing the extracted trace data to a smart device of a user through a wireless AP; And
It provides the drone control server through the wireless AP to notify the photographed video and object recognition, learns the video image of the object in advance, tracks the object by matching the learned video image with the photographed video, A dron that provides an object tracking process through the drones control server without being restricted by distances where the 3G / 4G data communication of the smart device serving as a router in the network can be performed; A smart device based intelligent object recognition drones system using a VPN network.
When the Android application receives an open source computer vision mode (OpenCV) from a user, the mobile terminal receives an object recognition notification push message through a drones control server connected to a wireless AP in the object recognition process by the dragon, Step 2; And
And a third step of receiving and displaying an object search push message through the drones control server in the object estimation process by the drones of the object recognized by the Android application,
In the third step,
The object tracking process is performed from the drones through the drones control server without being limited by the distance where the Android application can perform 3G / 4G data communication of the smart device serving as a router in configuring the VPN network A Smart Device Based Intelligent Object Tracking Method Using a VPN Network.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160011674A KR101827249B1 (en) | 2016-01-29 | 2016-01-29 | Intelligent system for object detection drone based on smart device using VPN, and Intelligent object detection method for the same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160011674A KR101827249B1 (en) | 2016-01-29 | 2016-01-29 | Intelligent system for object detection drone based on smart device using VPN, and Intelligent object detection method for the same |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170090826A KR20170090826A (en) | 2017-08-08 |
KR101827249B1 true KR101827249B1 (en) | 2018-02-08 |
Family
ID=59653142
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160011674A KR101827249B1 (en) | 2016-01-29 | 2016-01-29 | Intelligent system for object detection drone based on smart device using VPN, and Intelligent object detection method for the same |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101827249B1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10574945B1 (en) | 2017-02-03 | 2020-02-25 | Alarm.com Incorported | Asset management monitoring |
US10810890B2 (en) | 2017-01-17 | 2020-10-20 | Alarm.Com Incorporated | Dynamic drone navigation |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102028622B1 (en) * | 2018-01-31 | 2019-10-04 | 주식회사 에디테크놀로지 | Method and system for automatically tracking object using drone |
KR102075552B1 (en) | 2018-08-07 | 2020-02-11 | 주식회사 우보테크 | Headrest Moving Device |
KR102219954B1 (en) * | 2019-09-30 | 2021-02-23 | (주)대우건설 | Drone integrated control server and integrated control system including the same |
-
2016
- 2016-01-29 KR KR1020160011674A patent/KR101827249B1/en active IP Right Grant
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10810890B2 (en) | 2017-01-17 | 2020-10-20 | Alarm.Com Incorporated | Dynamic drone navigation |
US11914400B2 (en) | 2017-01-17 | 2024-02-27 | Alarm.Com Incorporated | Dynamic drone navigation |
US10574945B1 (en) | 2017-02-03 | 2020-02-25 | Alarm.com Incorported | Asset management monitoring |
US10798344B1 (en) | 2017-02-03 | 2020-10-06 | Alarm.Com Incorporated | Asset management monitoring |
US11412188B2 (en) | 2017-02-03 | 2022-08-09 | Alarm.Com Incorporated | Asset management monitoring |
Also Published As
Publication number | Publication date |
---|---|
KR20170090826A (en) | 2017-08-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101827249B1 (en) | Intelligent system for object detection drone based on smart device using VPN, and Intelligent object detection method for the same | |
CN109074750B (en) | Flight management and control for unmanned aerial vehicles | |
US11216954B2 (en) | Systems and methods for real-time adjustment of neural networks for autonomous tracking and localization of moving subject | |
Alwateer et al. | Drone services: issues in drones for location-based services from human-drone interaction to information processing | |
CN107168352B (en) | Target tracking system and method | |
US11041737B2 (en) | Method, device and system for processing a flight task | |
US20200034620A1 (en) | Self-reliant autonomous mobile platform | |
US12018947B2 (en) | Method for providing navigation service using mobile terminal, and mobile terminal | |
Ruiz et al. | Idrone: Robust drone identification through motion actuation feedback | |
KR20210128074A (en) | Audio zoom based on speaker detection using lip learding | |
CN110580053A (en) | Target tracking method, aircraft and flight system | |
KR101959366B1 (en) | Mutual recognition method between UAV and wireless device | |
JP6949974B2 (en) | Imaging control method, device and control device, imaging device | |
KR102370873B1 (en) | Remote control method and system for robot | |
KR102462636B1 (en) | A building where robots that are remotely controlled by a cloud server and robot remote control system move | |
JP6849272B2 (en) | Methods for controlling unmanned aerial vehicles, unmanned aerial vehicles, and systems for controlling unmanned aerial vehicles | |
CN112528699B (en) | Method and system for obtaining identification information of devices or users thereof in a scene | |
CN110622086B (en) | Movable object application framework | |
KR20200100944A (en) | UAV landing system | |
Nyein et al. | Implementation of vision-based landing target detection for VTOL UAV using raspberry Pi | |
KR20200054933A (en) | UAV landing induction method | |
WO2018237204A1 (en) | System and method for broadcasting the location of low altitude objects | |
KR102505426B1 (en) | Providing Location Information Service Remotely | |
Ahlawat et al. | Smart surveillance using on cloud machine learning and internet controlled UAVs | |
EP4250251A1 (en) | System and method for detecting and recognizing small objects in images using a machine learning algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |