TWI810761B - Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security - Google Patents

Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security Download PDF

Info

Publication number
TWI810761B
TWI810761B TW110148523A TW110148523A TWI810761B TW I810761 B TWI810761 B TW I810761B TW 110148523 A TW110148523 A TW 110148523A TW 110148523 A TW110148523 A TW 110148523A TW I810761 B TWI810761 B TW I810761B
Authority
TW
Taiwan
Prior art keywords
module
flight
uav
wireless communication
real
Prior art date
Application number
TW110148523A
Other languages
Chinese (zh)
Other versions
TW202326331A (en
Inventor
鄭婉淑
Original Assignee
國立高雄科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 國立高雄科技大學 filed Critical 國立高雄科技大學
Priority to TW110148523A priority Critical patent/TWI810761B/en
Publication of TW202326331A publication Critical patent/TW202326331A/en
Application granted granted Critical
Publication of TWI810761B publication Critical patent/TWI810761B/en

Links

Images

Abstract

一種架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,係包括至少一無人機、一邊緣運算設備、一裝設有一無人機監控應用模組之電子通訊設備、以及一網路設備所構成。藉此,本發明開發出一套深具教育意義之iOS系統之無人機監控應用模組,並輔以邊緣運算設備,對於練習場地之環境進行即時深度智慧運算,即時訊息提醒初學者危險動作或危險死角之即時修正,助初學者安心練習之同時,並在任一飛行命令未完成送達任一無人機或是未完整執行時,可提供使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止;本發明之無人機監控應用模組不僅可讓新手學員藉安裝在電子通訊設備(如:智慧型手機)上提升基本練習之便利性外,在安全性、監控性與防干擾安全迫降上亦為本發明之開發重點,藉以提升學員練飛時之安全性。 A real-time monitoring and anti-jamming safe emergency landing device for intelligent UAV group flight based on information security, which includes at least one UAV, an edge computing device, an electronic communication device equipped with a UAV monitoring application module, and a network composed of road equipment. In this way, the present invention has developed a set of UAV monitoring application modules with deep educational significance for the iOS system, supplemented by edge computing equipment, to perform real-time in-depth intelligent computing on the environment of the practice field, and instant messages to remind beginners of dangerous actions or The real-time correction of dangerous blind spots helps beginners practice with peace of mind, and when any flight command has not been delivered to any drone or is not fully executed, it can provide users with a quick judgment on whether to start a single drone to stop or start all drones machine stops; the UAV monitoring application module of the present invention can not only allow novice students to install it on electronic communication equipment (such as: smart phones) to improve the convenience of basic exercises, but also improve safety, monitoring and anti-interference safety. The above is also the focus of the development of the present invention, so as to improve the safety of trainees when they practice flying.

Description

架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置 Smart drone group flight real-time monitoring and anti-jamming safety forced landing device based on information security

本發明係有關於一種架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,尤指涉及一種簡單易用,兼顧安全性、即時監控與防干擾安全迫降,並能跨越各種年齡使用之iOS系統之無人機監控應用模組。 The present invention relates to a real-time monitoring and anti-interference safe forced landing device for intelligent UAV group flight based on information security, especially relates to a simple and easy-to-use device that takes into account safety, real-time monitoring and anti-interference safe forced landing, and can span various ages UAV monitoring application module for iOS system.

無人機之應用已越來越廣泛,從攝影、勘災、救難、軍事、農業乃至娛樂,無所不致,使得無人機於各領域之應用潛力無窮。而在民用領域中,無人機已成為不可或缺之工具,因其成本低,機動性高,可超視線距離的無人機操作,使用方便且高效,目前已成功應用於各大領域。近來,無形中在各大晚會,無人機已然成為點綴各活動亮點之不可或缺之要角,如在2019年2月,屏東燈會由英特爾三百台之無人機演出獲得了滿堂彩。自此,臺灣希望創新股份有限公司Taiwan Drone 100團隊也於後續有很多大放異彩之表現,可見無人機應用之潛力。由此可知,無人機人力資源供不應求,具實際操作能力之無人機操控及維護人員將成為不可或缺之人才。 The application of drones has become more and more extensive, ranging from photography, disaster survey, rescue, military, agriculture and even entertainment, which makes the application potential of drones in various fields unlimited. In the civilian field, drones have become an indispensable tool. Because of their low cost, high mobility, and the ability to operate drones beyond the line of sight, they are easy to use and efficient, and have been successfully used in various fields. Recently, unmanned aerial vehicles (UAVs) have become an indispensable part of embellishing the highlights of various events. For example, in February 2019, the Pingtung Lantern Festival was performed by 300 UAVs from Intel, which won a full house. Since then, the Taiwan Drone 100 team of Taiwan Hope Innovation Co., Ltd. has also made many outstanding performances in the follow-up, which shows the potential of drone applications. It can be seen that the human resources of UAVs are in short supply, and UAV operation and maintenance personnel with practical operation ability will become indispensable talents.

因此,有訓練更多飛手以進入各產業之需求性。訓練過程中,安全最為重要,不僅是機體本身之安全性,訓練地之環境安全性亦是,足見無人機相關應用程式之撰寫能力、相關客製化應用程式(APP)開發,以至於飛手練訓之重要性。不僅配合各產業需求之相關應用程式之開發是重要的,提供一即時監控安全機制讓學員安心藉APP練習飛行,訓練出更多專業飛手,更是重要。 Therefore, there is a need to train more pilots to enter various industries. During the training process, safety is the most important, not only the safety of the airframe itself, but also the safety of the environment of the training place, which shows that the writing ability of UAV-related applications and the development of related customized applications (APPs) make it easier for pilots to practice The importance of training. Not only is it important to develop relevant applications that meet the needs of various industries, it is even more important to provide a real-time monitoring and security mechanism so that students can use the APP to practice flying with peace of mind and train more professional pilots.

然而,目前市場上尚未有完成開發之民用、教育用之無人機的群體iOS APP操控程式。故,一般習用者係無法符合使用者於實際使用時之所需。 However, there is currently no group iOS APP control program for civil and educational drones that has been developed in the market. Therefore, general users cannot meet the needs of users in actual use.

本發明之主要目的係在於,克服習知技藝所遭遇之上述問題並提供一種簡單易用,兼顧安全性、即時監控與防干擾安全迫降,針對新手飛行訓練並能跨越各年齡使用之iOS系統之無人機監控應用模組。藉練習時安全機制提升,提供跨各階層年齡運用任務板進行群飛之定位,均可執行無人機群飛。在執行任務過程中,本發明之無人機監控應用模組將自動啟動即時安全性監控模式,除對周邊環境之保護機制、無人機是否失控,以及電量之控管均於本裝置實踐,並輔以採用Jetson nano套件之邊緣運算設備,無人機若遇險危動作或死角將即時傳訊至無人機監控應用模組,並且在任一飛行命令未完成送達任一無人機或是未完整執行時,亦可提供使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止,透過本發明iOS系統之無人機監控應用模組於操控顯示介面上與使用者之互動訊息,可讓新手飛行安心練習,也就是說飛機訊號傳給手機(指令執行狀況)及Jetson nano(加密後之地形資訊);由Jetson nano加密傳出之訊息:將判斷出有危險之地形或情境之訊號傳予手機,提示讓使用者是否執行單一或全面降落。 The main purpose of the present invention is to overcome the above-mentioned problems encountered by conventional techniques and provide an iOS system that is easy to use, takes into account safety, real-time monitoring and anti-interference safety forced landing, and is aimed at novice flight training and can be used across all ages. UAV monitoring application module. With the improvement of the safety mechanism during practice, it provides the positioning of group flight using task boards across all levels of age, and can perform group flight of drones. During the execution of the task, the UAV monitoring application module of the present invention will automatically start the real-time safety monitoring mode, except for the protection mechanism of the surrounding environment, whether the UAV is out of control, and the control and management of the power are all practiced in this device, and supplemented Using the edge computing device of the Jetson nano kit, if the drone is in danger or in a blind spot, it will be sent to the drone monitoring application module in real time, and when any flight command is not delivered to any drone or is not fully executed, it can also Provide users with a quick judgment on whether to start a single drone to stop or start all drones to stop. Through the interactive information between the drone monitoring application module of the iOS system of the present invention and the user on the control display interface, it allows novices to practice flying with peace of mind. That is to say, the aircraft signal is sent to the mobile phone (command execution status) and Jetson nano (encrypted terrain information); the encrypted message sent by Jetson nano: the signal that judges dangerous terrain or situation is sent to the mobile phone, prompting Whether the user performed a single or full landing.

為達以上之目的,本發明係一種架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,係包括:數個無人機,各該無人機上設置有一控制模組、一影像擷取模組、一第一無線通訊模組、一飛行模組、一記憶模組及一定位模組,該控制模組內建一模式通訊協定,該模式通訊協定至少包含位址模式、飛控模式,該控制模組利用該定位模組於一練習場地中選取定位至少一飛行位置點,由該影像擷取模組於該飛行位置點攝取至少一個或數個現 場環境資料,通過該第一無線通訊模組依據該飛行位置點選擇傳輸至少一現場衛星資訊,該控制模組將該現場衛星資訊結合於該現場環境資料,以便轉換產生一現場3D地形資訊,並將該現場3D地形資訊透過該第一無線通訊模組加密編碼後即時輸出該編碼後之現場3D地形資訊;一邊緣運算設備,係具有一圖像處理單元(Graphics Processing Unit,GPU)、一儲存模組、一第二無線通訊模組、及一智慧型安全迫降單元,該第二無線通訊模組與該第一無線通訊模組相互適配,用以接收各該無人機即時輸出該編碼後之現場3D地形資訊並進行解碼操作,每一解碼後之現場3D地形資訊係關於一無人機其周邊環境之狀況,該圖像處理單元執行深度學習模型以識別該解碼後之現場3D地形資訊,從該儲存模組提取與該解碼後之現場3D地形資訊相關的一個或數個地理環境資訊進行即時深度智慧運算,以識別各該無人機是否存在危險死角或危險動作行為,並對應產生一識別結果,該第二無線通訊模組將該識別結果加密編碼後即時輸出至電子通訊設備;而該智慧型安全迫降單元透過該第二無線通訊模組接收編碼後之錯誤訊息並解碼後,進行判斷是否需單台無人機或所有無人機行迫降處理,並對應產生一智慧安全迫降結果,該第二無線通訊模組將該智慧安全迫降結果加密編碼後即時輸出該編碼後之智慧安全迫降結果;一電子通訊設備,裝設有一無人機監控應用模組,該電子通訊設備具有與該無人機監控應用模組連接之一操控顯示介面模組、一通知模組、及一第三無線通訊模組,該第三無線通訊模組與該第一、二無線通訊模組相互適配,用以與該邊緣運算設備及各該無人機連結,該無人機監控應用模組通過該操控顯示介面模組接收一使用者輸入一飛行命令,該飛行命令內含模式通訊協定、位址及飛控資料,透過該第三無線通訊模組將該飛行命令加密編碼後輸出至各該無人機,各該無人機之控制模組透過該第一無線通訊模組接收該編碼後之飛行命令並解碼後,取得對應位址之飛控資料,獲取該飛控資料中的計時器時間,根據該飛控資料進行各該無人機的 群飛表演訓練,且於群飛啟動時,倘若有任一飛行命令未完成送達任一無人機或是未完整執行,該未完成送達或未完整執行的無人機之控制模組將自動產生一錯誤訊息,透過該第一無線通訊模組對該錯誤訊息加密編碼後回傳給該電子通訊設備,該無人機監控應用模組再透過該第三無線通訊模組接收該安全迫降單元分析當時情境所產生該編碼後之智慧安全迫降結果並進行解碼操作,以提供該使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止,該無人機監控應用模組亦透過該第三無線通訊模組接收該邊緣運算設備即時深度智慧運算所產生該編碼後之識別結果並進行解碼操作,當該解碼後之識別結果為該至少一無人機具有危險死角或危險動作行為的存在時,該無人機監控應用模組會藉由該通知模組對外即時發出一警告訊號,並將該解碼後之現場3D地形資訊即時顯示於該操控顯示介面模組上,供該使用者可即時評估調配平衡該至少一無人機飛行狀態,據以下達至少一飛行修正命令,並透過該第三無線通訊模組對該飛行修正命令加密編碼後傳送給該至少一無人機,該至少一無人機之控制模組透過該第一無線通訊模組接收該編碼後之飛行修正命令並解碼後,通過該解碼後之飛行修正命令以操控該至少一無人機之飛行模組對其飛行狀態即時進行對應修正;以及一網路設備,係提供一無線區網以無線連結該至少一無人機、該邊緣運算設備、及該電子通訊設備。 In order to achieve the above purpose, the present invention is a real-time monitoring and anti-interference safe forced landing device for smart UAV group flight based on information security. It includes: several UAVs, each of which is equipped with a control module and an image Capture module, a first wireless communication module, a flight module, a memory module and a positioning module, the control module has a built-in mode communication protocol, the mode communication protocol at least includes address mode, flight mode In the control mode, the control module uses the positioning module to select and locate at least one flight location point in a practice field, and the image capture module captures at least one or several on-site environmental data at the flight location point, through the first A wireless communication module selects and transmits at least one on-site satellite information according to the flight position point, and the control module combines the on-site satellite information with the on-site environmental data so as to convert and generate on-site 3D terrain information, and convert the on-site 3D terrain information Encrypted and encoded by the first wireless communication module, the encoded on-site 3D terrain information is output immediately; an edge computing device has an image processing unit (Graphics Processing Unit, GPU), a storage module, and a second A wireless communication module, and an intelligent safety emergency landing unit, the second wireless communication module and the first wireless communication module are adapted to each other to receive the on-site 3D topographical information outputted by the UAVs in real time and The decoding operation is carried out. Each decoded on-site 3D terrain information is related to the surrounding environment of a UAV. The image processing unit executes a deep learning model to identify the decoded on-site 3D terrain information. From the storage model The group extracts one or several pieces of geographical environment information related to the decoded 3D topographical information on the spot and performs real-time deep intelligent calculations to identify whether each drone has a dangerous dead angle or dangerous action behavior, and generates a recognition result correspondingly. The second wireless communication module encrypts and encodes the identification result and outputs it to the electronic communication device immediately; and the intelligent safety forced landing unit receives and decodes the encoded error message through the second wireless communication module, and then judges whether a single unit is needed UAVs or all UAVs perform forced landing processing, and correspondingly generate a smart safe forced landing result, the second wireless communication module encrypts and codes the smart safe forced landing result and immediately outputs the coded smart safe forced landing result; an electronic communication device , a UAV monitoring application module is installed, the electronic communication device has a control display interface module connected with the UAV monitoring application module, a notification module, and a third wireless communication module, the third The wireless communication module and the first and second wireless communication modules are adapted to each other to connect with the edge computing device and each of the drones, and the drone monitoring application module receives a user through the control display interface module Input a flight command, the flight command contains mode communication protocol, address and flight control data, the flight command is encrypted and encoded by the third wireless communication module, and then output to each of the drones, and the control modules of each of the drones After receiving and decoding the coded flight command through the first wireless communication module, the group obtains the flight control data of the corresponding address, obtains the timer time in the flight control data, and executes the operation of each UAV according to the flight control data. When the group flight is started, if any flight command has not been delivered to any drone or has not been fully executed, the control module of the undelivered or incompletely executed drone will be automatically generated An error message is encrypted and coded by the first wireless communication module and sent back to the electronic communication device, and the UAV monitoring application module receives the safety forced landing unit through the third wireless communication module to analyze the time The coded smart safety forced landing result generated by the situation is decoded to provide the user with a quick judgment on whether to start a single drone to stop or to start all drones to stop. The drone monitoring application module also uses the third wireless The communication module receives the encoded recognition result generated by the real-time deep intelligent operation of the edge computing device and performs a decoding operation. When the decoded recognition result is that the at least one drone has a dangerous dead angle or dangerous action behavior, the The UAV monitoring application module will send a warning signal to the outside in real time through the notification module, and display the decoded on-site 3D terrain information on the control display interface module in real time, so that the user can evaluate the deployment balance in real time The flight status of the at least one UAV is based on at least one flight correction order, and the flight correction order is encrypted and encoded by the third wireless communication module and sent to the at least one UAV. The control module of the at least one UAV After the group receives and decodes the encoded flight correction command through the first wireless communication module, the flight module that controls the at least one drone through the decoded flight correction command performs corresponding corrections to its flight state in real time; and A network device provides a wireless area network to wirelessly connect the at least one drone, the edge computing device, and the electronic communication device.

於本發明上述實施例中,該網路設備為無線路由器或手機熱點。 In the above embodiments of the present invention, the network device is a wireless router or a mobile phone hotspot.

於本發明上述實施例中,該第一無線通訊模組、該第二無線通訊模組及該第三無線通訊模組為具加密編碼/解碼功能者。 In the above-mentioned embodiments of the present invention, the first wireless communication module, the second wireless communication module and the third wireless communication module have encryption encoding/decoding functions.

於本發明上述實施例中,該飛行命令係依該使用者之群飛表演需求,依格式輸入各該無人機的網際網路協定(Internet Protocol,IP)、執行任務時間點及執行指令,編輯成為舞譜與舞序資料,並於選擇讀取音樂後即可觸發該無人機監控應用模組開啟群飛開關,開啟群飛。 In the above-mentioned embodiment of the present invention, the flight command is based on the user's group flight performance requirements, input the Internet Protocol (Internet Protocol, IP), execution time and execution instructions of each drone according to the format, edit Become the dance notation and dance order data, and after choosing to read the music, the drone monitoring application module can be triggered to turn on the group flight switch and start the group flight.

於本發明上述實施例中,該無人機監控應用模組通過該飛行命令觸發開啟群飛,進行自動偵測無人機數目,並伴隨音樂自動控制群飛。 In the above embodiments of the present invention, the UAV monitoring application module triggers the group flight through the flight command, automatically detects the number of UAVs, and automatically controls the group flight with music.

於本發明上述實施例中,該控制模組、該第一無線通訊模組、該飛行模組、該記憶模組及該定位模組係整合在一任務板上並將該任務板設置於各該無人機下方。 In the above embodiments of the present invention, the control module, the first wireless communication module, the flight module, the memory module and the positioning module are integrated on a task board and the task board is set on each Below the drone.

於本發明上述實施例中,各該無人機、該電子通訊設備及該邊緣運算設備其訊號發送與接收之過程係透過用戶資料包協定(User Datagram Protocol,UDP)來通訊該網路設備,經過該網路設備而與彼此聯繫。 In the above-mentioned embodiments of the present invention, the signal sending and receiving process of each of the UAV, the electronic communication device and the edge computing device is to communicate with the network device through the User Datagram Protocol (UDP). The network devices communicate with each other.

於本發明上述實施例中,該現場環境資料係該練習場地之影像或照片。 In the above-mentioned embodiments of the present invention, the on-site environment data is an image or photo of the practice field.

於本發明上述實施例中,該邊緣運算設備係經由一無線感測網路控制其感測收集地理環境資訊,並儲存至該儲存模組中。 In the above embodiments of the present invention, the edge computing device is controlled by a wireless sensor network to sense and collect geographical environment information, and store it in the storage module.

於本發明上述實施例中,該儲存模組係依該飛行位置點之現場衛星資訊選擇該一個或數個地理環境資訊。 In the above-mentioned embodiment of the present invention, the storage module selects the one or several geographical environment information according to the on-site satellite information of the flight location point.

於本發明上述實施例中,該警告訊號包含警示用之聲響、語音、光源或電子訊息。 In the above embodiments of the present invention, the warning signal includes sound, voice, light source or electronic message for warning.

於本發明上述實施例中,該無人機監控應用模組更包括監控各該無人機之一電池之電力,並於該操控顯示介面模組上顯示目前該電池之一電池剩餘電量。 In the above embodiment of the present invention, the UAV monitoring application module further includes monitoring the power of one battery of each UAV, and displaying the current remaining power of one of the batteries on the control display interface module.

1:無人機 1: UAV

11:控制模組 11: Control module

12:影像擷取模組 12: Image capture module

13:第一無線通訊模組 13: The first wireless communication module

14:飛行模組 14: Flight module

15:記憶模組 15: Memory module

16:定位模組 16: Positioning module

2:邊緣運算設備 2: Edge Computing Devices

21:圖像處理單元 21: Image processing unit

22:儲存模組 22: Storage module

23:第二無線通訊模組 23: Second wireless communication module

24:智慧型安全迫降單元 24:Intelligent safety forced landing unit

3:電子通訊設備 3: Electronic communication equipment

31:無人機監控應用模組 31: UAV monitoring application module

32:操控顯示介面模組 32: Control display interface module

33:第三無線通訊模組 33: The third wireless communication module

34:通知模組 34: Notification module

4:網路設備 4: Network equipment

第1圖,係本發明智慧無人機群飛即時監控與防干擾安全迫降裝置之架構示意圖。 Figure 1 is a schematic diagram of the structure of the smart drone group flight real-time monitoring and anti-interference safety forced landing device of the present invention.

第2圖,係本發明之安全防護機制示意圖。 Figure 2 is a schematic diagram of the safety protection mechanism of the present invention.

第3圖,係本發明無人機監控應用模組之操控顯示介面示意圖。 Figure 3 is a schematic diagram of the control and display interface of the UAV monitoring application module of the present invention.

第4圖,係本發明之舞序資料示意。 Fig. 4 is a schematic representation of the dance sequence data of the present invention.

請參閱『第1圖~第4圖』所示,係分別為本發明智慧無人機群飛即時監控與防干擾安全迫降裝置之架構示意圖、本發明之安全防護機制示意圖、本發明無人機監控應用模組之操控顯示介面示意圖、以及本發明之舞序資料示意圖。如圖所示:本發明係一種架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,係包括數個無人機1、一邊緣運算設備2、一電子通訊設備3以及一網路設備4所構成。 Please refer to "Fig. 1 ~ Fig. 4", which are the structure diagram of the real-time monitoring and anti-interference safety forced landing device of the smart drone group of the present invention, the schematic diagram of the safety protection mechanism of the present invention, and the monitoring application of the drone of the present invention. A schematic diagram of the control display interface of the module, and a schematic diagram of the dance sequence data of the present invention. As shown in the figure: the present invention is a real-time monitoring and anti-interference safety forced landing device for smart UAV group flight based on information security, which includes several UAVs 1, an edge computing device 2, an electronic communication device 3 and a network Road equipment 4 constitutes.

上述所提之各該無人機1上設置有一控制模組11、一影像擷取模組12、一第一無線通訊模組13、一飛行模組14、一記憶模組15及一定位模組16,且該控制模組11、該第一無線通訊模組13、該飛行模組14、該記憶模組15及該定位模組16係整合在一任務板(圖中未示)上並將該任務板設置於該無人機1下方。該控制模組11內建一模式通訊協定,該模式通訊協定至少包含位址模式、飛控模式,該控制模組11利用該定位模組16於一練習場地中選取定位至少一飛行位置點,由該影像擷取模組12於該飛行位置點攝取至少一個或數個現場環境資料,而該現場環境資料係該練習場地之影像或照片,通過該第一無線通訊模組13依據該飛行位置點選擇傳輸至少一現場衛星資訊,該控制模組11將該現場衛星資訊結合於該現場環境資料,以便轉換產生一現場3D地形資訊,並將該現場3D地形資訊透過該第一無線通訊模組13加密編碼後即時輸出該編碼後之現場3D地形資訊至該邊緣運算設備2,之後該數個無人機1中之至少一無人機1再從該電子通訊設備3接收一 飛行修正指令,並以該飛行模組14據以進行飛行狀態之修正。 Each of the above-mentioned drones 1 is provided with a control module 11, an image capture module 12, a first wireless communication module 13, a flight module 14, a memory module 15 and a positioning module 16, and the control module 11, the first wireless communication module 13, the flight module 14, the memory module 15 and the positioning module 16 are integrated on a task board (not shown) and The task board is arranged under the drone 1 . The control module 11 has a built-in mode communication protocol, which at least includes an address mode and a flight control mode. The control module 11 uses the positioning module 16 to select and locate at least one flight position point in a practice field, The image capture module 12 captures at least one or several on-site environmental data at the flight position, and the on-site environmental data is an image or photo of the practice field, and the first wireless communication module 13 according to the flight position Click to select to transmit at least one on-site satellite information, the control module 11 combines the on-site satellite information with the on-site environmental data, so as to convert and generate an on-site 3D terrain information, and pass the on-site 3D terrain information through the first wireless communication module 13 After encrypting and encoding, immediately output the encoded on-site 3D terrain information to the edge computing device 2, and then at least one of the several drones 1 receives a message from the electronic communication device 3 The flight correction command is used to correct the flight state with the flight module 14 .

該邊緣運算設備2係具有一圖像處理單元(Graphics Processing Unit,GPU)21、一儲存模組22、一第二無線通訊模組23、及一智慧型安全迫降單元24。該第二無線通訊模組23與該第一無線通訊模組13相互適配,用以接收各該無人機1即時輸出該編碼後之現場3D地形資訊並進行解碼操作,每一解碼後之現場3D地形資訊係關聯於一無人機1其周邊環境之狀況。該儲存模組22係依該飛行位置點之現場衛星資訊選擇一個或數個地理環境資訊。該圖像處理單元21執行深度學習模型以識別該解碼後之現場3D地形資訊,從該儲存模組22提取與該解碼後之現場3D地形資訊相關的一個或數個地理環境資訊進行即時深度智慧運算,以識別各該無人機1是否存在危險死角或危險動作行為,並對應產生一識別結果,該第二無線通訊模組23將該識別結果加密編碼後即時輸出該編碼後之識別結果至該電子通訊設備3,而該智慧型安全迫降單元24透過該第二無線通訊模組23接收編碼後之錯誤訊息並解碼後,進行判斷是否需單台無人機或所有無人機行迫降處理,並對應產生一智慧安全迫降結果,該第二無線通訊模組23將該智慧安全迫降結果加密編碼後即時輸出該編碼後之智慧安全迫降結果至該電子通訊設備3。其中,該邊緣運算設備2係經由一無線感測網路控制其感測收集地理環境資訊,並儲存至該儲存模組22中。 The edge computing device 2 has a Graphics Processing Unit (GPU) 21 , a storage module 22 , a second wireless communication module 23 , and a smart emergency landing unit 24 . The second wireless communication module 23 and the first wireless communication module 13 are adapted to each other, and are used to receive the encoded 3D terrain information output by each UAV 1 in real time and perform decoding operations. The 3D terrain information is related to the surrounding environment of a UAV 1 . The storage module 22 selects one or several pieces of geographical environment information according to the on-site satellite information of the flight position point. The image processing unit 21 executes a deep learning model to identify the decoded on-site 3D terrain information, and extracts one or more geographical environment information related to the decoded on-site 3D terrain information from the storage module 22 for real-time depth intelligence. operation to identify whether each UAV 1 has dangerous blind spots or dangerous actions, and correspondingly generate a recognition result, and the second wireless communication module 23 encrypts and codes the recognition result and immediately outputs the coded recognition result to the Electronic communication equipment 3, and the intelligent safety forced landing unit 24 receives and decodes the encoded error message through the second wireless communication module 23, and then judges whether a single unmanned aerial vehicle or all unmanned aerial vehicles are required to perform forced landing processing, and correspondingly Generate a smart safety forced landing result, the second wireless communication module 23 encrypts and codes the smart safe forced landing result and immediately outputs the coded smart safe forced landing result to the electronic communication device 3 . Wherein, the edge computing device 2 is controlled by a wireless sensor network to sense and collect geographical environment information, and store it in the storage module 22 .

該電子通訊設備3裝設有一無人機監控應用模組31,該電子通訊設備3具有與該無人機監控應用模組31連接之一操控顯示介面模組32、一第三無線通訊模組33、及一通知模組34。該第三無線通訊模組33與該第一、二無線通訊模組13、23相互適配,用以與該邊緣運算設備2及各該無人機1連結,且該第一無線通訊模組13、該第二無線通訊模組23及該第三無線通訊模組33為具加密編碼/解碼功能者。該無人機監控應用模組31通 過該操控顯示介面模組32接收一使用者輸入一飛行命令,該飛行命令內含模式通訊協定、位址及飛控資料,透過該第三無線通訊模組33將該飛行命令加密編碼後輸出至各該無人機1,各該無人機1之控制模組11透過該第一無線通訊模組13接收該編碼後之飛行命令並解碼後,取得對應位址之飛控資料,獲取該飛控資料中的計時器時間,根據該飛控資料進行各該無人機1的群飛表演訓練,且於群飛啟動時,倘若有任一飛行命令未完成送達任一無人機1或是未完整執行,該未完成送達或未完整執行的無人機1之控制模組11將自動產生一影像資訊,透過該第一無線通訊模組13對該影像資訊加密編碼後回傳給該邊緣運算設備2,該無人機監控應用模組31再透過該第三無線通訊模組33接收該安全迫降單元24分析當時情境所產生該編碼後之智慧安全迫降結果並進行解碼操作,以提供該使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止。該無人機監控應用模組31亦透過該第三無線通訊模組33接收該邊緣運算設備2即時深度智慧運算所產生該編碼後之識別結果並進行解碼操作,當該解碼後之識別結果為該至少一無人機1具有危險死角或危險動作行為的存在時,該無人機監控應用模組31會藉由該通知模組34對外即時發出一警告訊號,包含警示用之聲響、語音、光源或電子訊息,並將該解碼後之現場3D地形資訊即時顯示於該操控顯示介面模組32上,供該使用者可即時評估調配平衡該至少一無人機1飛行狀態,據以下達至少一飛行修正命令,並透過該第三無線通訊模組33對該飛行修正命令加密編碼後傳送給該至少一無人機1,該至少一無人機1之控制模組11透過該第一無線通訊模組13接收該編碼後之飛行修正命令並解碼後,通過該解碼後之飛行修正命令以操控該至少一無人機1之飛行模組14對其飛行狀態即時進行對應修正。此外,該無人機監控應用模組31更包括監控該無人機1之一電池之電力,並於該操控顯示介面模組32上顯示目前該電池之一電池剩餘電量。 The electronic communication device 3 is equipped with a UAV monitoring application module 31, and the electronic communication device 3 has a control display interface module 32 connected with the UAV monitoring application module 31, a third wireless communication module 33, And a notification module 34 . The third wireless communication module 33 is compatible with the first and second wireless communication modules 13 and 23, and is used to connect with the edge computing device 2 and each of the drones 1, and the first wireless communication module 13 . The second wireless communication module 23 and the third wireless communication module 33 are those with encryption encoding/decoding functions. The UAV monitoring application module has 31 channels The control display interface module 32 receives a flight command input by a user, the flight command contains mode communication protocol, address and flight control data, and the flight command is encrypted and encoded by the third wireless communication module 33 and then output To each of the drones 1, the control module 11 of each drone 1 receives and decodes the encoded flight command through the first wireless communication module 13, and obtains the flight control data of the corresponding address, and obtains the flight control According to the timer time in the data, the group flight performance training of each UAV 1 is carried out according to the flight control data, and when the group flight is started, if any flight command has not been delivered to any UAV 1 or has not been fully executed , the control module 11 of the unmanned aerial vehicle 1 that has not completed the delivery or has not been fully executed will automatically generate an image information, encrypt and encode the image information through the first wireless communication module 13 and send it back to the edge computing device 2, The UAV monitoring application module 31 receives the coded smart safety forced landing result generated by the safe forced landing unit 24 through the third wireless communication module 33 and analyzes the situation at that time, and performs decoding operation to provide the user with a quick judgment whether Start a single drone stop or start all drones stop. The UAV monitoring application module 31 also receives the encoded recognition result generated by the edge computing device 2 through the third wireless communication module 33 in real-time deep intelligent calculation and performs a decoding operation. When the decoded recognition result is the When at least one UAV 1 has a dangerous blind spot or dangerous behavior, the UAV monitoring application module 31 will immediately send a warning signal to the outside through the notification module 34, including sound, voice, light source or electronic warning signal. information, and display the decoded on-site 3D terrain information on the control display interface module 32 in real time, so that the user can immediately evaluate the deployment and balance of the flight status of the at least one UAV 1, and issue at least one flight correction order accordingly , and encrypt the flight correction command through the third wireless communication module 33 and send it to the at least one drone 1, and the control module 11 of the at least one drone 1 receives the flight correction command through the first wireless communication module 13 After the encoded flight correction command is decoded, the flight module 14 of the at least one UAV 1 is controlled by the decoded flight correction command to perform corresponding corrections to its flight state in real time. In addition, the UAV monitoring application module 31 further includes monitoring the power of a battery of the UAV 1 , and displaying the current remaining power of one of the batteries on the control display interface module 32 .

該網路設備4為無線路由器或手機熱點,係提供一無線區網以無線連結各該無人機1、該邊緣運算設備2、及該電子通訊設備3。其中,各該無人機1、該邊緣運算設備2及該電子通訊設備3其訊號發送與接收之過程係透過用戶資料包協定(User Datagram Protocol,UDP)來通訊該網路設備4,經過該網路設備4而與彼此聯繫。如是,藉由上述揭露之裝置構成一全新之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置。 The network device 4 is a wireless router or a mobile phone hotspot, which provides a wireless area network to wirelessly connect the drone 1 , the edge computing device 2 , and the electronic communication device 3 . Among them, the signal sending and receiving process of each of the UAV 1, the edge computing device 2 and the electronic communication device 3 is to communicate with the network device 4 through the User Datagram Protocol (UDP), and through the network road devices 4 to communicate with each other. If so, the device disclosed above constitutes a brand-new intelligent UAV group flight real-time monitoring and anti-interference safety forced landing device based on information security.

當運用時,為達控制群飛之目的,本發明係將無人機1之網路模式變更為工作站模式(Station Mode),藉由連線至網路設備4以形成區域網路,如第1圖所示。 When in use, in order to achieve the purpose of controlling the group flight, the present invention changes the network mode of the drone 1 to a workstation mode (Station Mode), and forms a local area network by connecting to the network device 4, as in the first As shown in the figure.

因練習可能於室內,難免與周邊物件發生碰撞,即相當容易造成漿掖或周邊物件之損害。該無人機監控應用模組31即可立即由使用者手動啟動防護機制,或由採用Jetson nano套件之邊緣運算設備2端即時深度智慧運算,並傳訊給使用者,進行緊急停止螺旋漿。因無人機1於室內練習飛行時,高度最高通常不超過3公尺,該無人機1本身具一定程度之撞擊緩衝能力,因此,亦不致於易導致機體損壞。 Because the practice may be indoors, it is inevitable to collide with surrounding objects, which is very easy to cause damage to the pads or surrounding objects. The UAV monitoring application module 31 can immediately start the protection mechanism manually by the user, or perform real-time deep intelligent computing on the edge computing device 2 using the Jetson nano kit, and send a message to the user to stop the propeller in an emergency. Because the UAV 1 is usually no more than 3 meters high when flying indoors, the UAV 1 itself has a certain degree of impact buffering ability, so it will not easily cause damage to the body.

本發明之無人機監控應用模組31之另一種安全機制係於群飛啟動時,即會自動啟動監控,偵測指令是否順利送達各無人機1,並完整執行,如第2圖所示。 Another safety mechanism of the UAV monitoring application module 31 of the present invention is that when the group flight starts, it will automatically start the monitoring, detect whether the command is successfully delivered to each UAV 1, and execute it completely, as shown in FIG. 2 .

在群飛表演當下,電力亦是相當重要之議題。倘若電力不足50%之情況下,是無法進行花式翻轉動作。此時,僅管再好的表演,也必定脫序或必需中斷。無人機機體即具低電量警示。本發明之無人機監控應用模組31亦備有電量顯示,可促電量顯示資訊與使用者之互動性提升。 Electricity is also a very important issue in group flying performances. If the power is less than 50%, it is impossible to perform fancy flips. At this time, no matter how good the performance is, it is bound to be out of order or must be interrupted. The drone body has a low battery warning. The UAV monitoring application module 31 of the present invention is also equipped with a power display, which can improve the interaction between the power display information and the user.

本發明完成iOS系統之無人機監控應用模組31,如第3圖所示,包含區塊A~區塊L,其中區塊A顯示檔案名稱,區塊B顯示檔案選擇, 區塊C顯示群飛啟動開關,區塊D顯示群飛時間軸,區塊E顯示訊息欄,區塊F顯示安全迫降設定,區塊G顯示設定網路與指令模式,區塊H顯示起飛、剩餘電量與降落,區塊I顯示翻轉與停止動作,區塊J顯示緊急按扭,區塊K顯示上升與旋轉,以及區塊L顯示前後左右。由第3圖可知,所提無人機監控應用模組31除基本功能可單獨控制起飛、降落,上、下、左、右;順/逆時針旋轉、上升、及下降,並可控制1~N台無人機1,搭配音樂所伴隨之舞序檔(CSV格式)及音樂設計進行群飛。本發明之無人機監控應用模組31將自動偵測無人機數目,伴隨音樂自動監控群飛。 The present invention completes the UAV monitoring application module 31 of the iOS system, as shown in Figure 3, including block A ~ block L, wherein block A displays the file name, block B displays the file selection, Block C shows the group flight start switch, block D shows the group flight time axis, block E shows the message bar, block F shows the safety forced landing setting, block G shows the setting network and command mode, and block H shows takeoff, Remaining power and landing, block I shows flip and stop actions, block J shows emergency buttons, block K shows rising and rotating, and block L shows front, back, left, and right. As can be seen from Figure 3, the proposed UAV monitoring application module 31 can independently control take-off, landing, up, down, left, right; clockwise/counterclockwise rotation, up and down, and can control 1~N in addition to the basic functions. One drone 1, with the dance sequence file (CSV format) and music design accompanied by music for group flight. The UAV monitoring application module 31 of the present invention will automatically detect the number of UAVs, and automatically monitor the group flying with music.

在該無人機監控應用模組31啟動前,飛行命令可依使用者之群飛表演需求,依格式輸入所需資訊,編輯成為舞譜與舞序資料。如第4圖所示,所需資訊包含無人機的網際網路協定(Internet Protocol,IP)、執行任務時間點及執行指令。於選擇讀取音樂後,即可觸發該無人機監控應用模組31開啟群飛開關,開啟群飛。本發明之無人機監控應用模組31將通過該飛行命令觸發開啟群飛,進行自動偵測無人機數目,並伴隨音樂自動控制群飛。 Before the UAV monitoring application module 31 is activated, the flight command can be edited into dance notation and dance order data by inputting required information in accordance with the format required by the user for group flight performance. As shown in Figure 4, the required information includes the drone's Internet Protocol (IP), mission execution time and execution instructions. After choosing to read the music, the UAV monitoring application module 31 can be triggered to turn on the group flight switch and start the group flight. The UAV monitoring application module 31 of the present invention will trigger the group flight through the flight command, automatically detect the number of UAVs, and automatically control the group flight with music.

無人機軟體開發套件(Software Development Kit,SDK)提供進行飛行指令執行飛行設計,本發明使用指令進行群飛舞序之編排,其指令與舞蹈舞步對應如下表一:

Figure 110148523-A0305-02-0012-1
The UAV software development kit (Software Development Kit, SDK) provides flight instructions to execute flight design. The present invention uses instructions to arrange group flight sequences. The instructions and dance steps correspond to the following table 1:
Figure 110148523-A0305-02-0012-1

本發明主要設計於合作教育,倘若學員或教練在飛訓時,不管是所在練習的環境安全維護、無人機突然失控甚至是電力之相關議題,均可運用本發明之無人機監控應用模組設計的自動監控功能,由使用者手動採取立即執行停止螺旋漿或進行安全迫降處理,將傷害降到最小。亦由採用Jetson nano套件之邊緣運算設備,進行即時深度智慧運算,即時通知使用者進行即時之警示功能。本發明之無人機監控應用模組於新訓使用者(飛手)時,運用安全監控機制將可提升於練習時之安全性及安全感。本發明提供下列三項安全功能: This invention is mainly designed for cooperative education. If students or coaches are in flight training, whether it is the safety maintenance of the practice environment, the sudden loss of control of the drone or even power-related issues, the drone monitoring application module design of the present invention can be used. The automatic monitoring function is adopted by the user to immediately stop the propeller or perform a safe emergency landing to minimize the damage. Also, the edge computing device using the Jetson nano kit performs real-time deep intelligent computing, and immediately notifies the user to perform real-time warning functions. The UAV monitoring application module of the present invention can improve the safety and sense of security during training by using the safety monitoring mechanism when new users (pilots) are trained. The present invention provides the following three safety functions:

1.安全防護一:練習可能於室內,難免與周邊物件發生碰撞,即相當容易造成漿掖或周邊物件之損害。本發明之無人機監控應用模組即可藉由邊緣運算設備即時深度智慧運算,並即時通知使用者或由使用者立即手動啟動防護機制,進行緊急停止。 1. Safety protection 1: Practice may be indoors, and it is inevitable to collide with surrounding objects, that is, it is quite easy to cause damage to the body or surrounding objects. The UAV monitoring application module of the present invention can use the edge computing device for real-time in-depth intelligent computing, and immediately notify the user or the user immediately manually activates the protection mechanism to perform an emergency stop.

2.安全防護二:群飛一旦啟動,自動監控即啟動執行安全防護機制,倘若有任一指令未完成送達無人機或是未完整執行。本發明之無人機控制模組將自動回傳錯誤訊息至邊緣運算設備進行智慧安全迫降判斷,提供使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止。 2. Safety protection 2: Once the group flight is started, the automatic monitoring will start to implement the safety protection mechanism. If any command is not delivered to the drone or not fully executed. The UAV control module of the present invention will automatically return an error message to the edge computing device for smart and safe emergency landing judgment, providing users with a quick judgment on whether to start a single UAV to stop or to start all UAVs to stop.

3.電力管制:在群飛表演當下,電力亦是相當重要之議題。倘若電力不足50%之情況下,是無法進行花式翻轉動作。此時,僅管再好的表演,也必定脫序或必需中斷。無人機機體即具低電量警示。本發明之無人機監控應用模組亦備有電量顯示,可促電量顯示資訊與使用者之互動性提升。 3. Electricity control: Electricity is also a very important issue in group flying performances. If the power is less than 50%, it is impossible to perform fancy flips. At this time, no matter how good the performance is, it is bound to be out of order or must be interrupted. The drone body has a low battery warning. The UAV monitoring application module of the present invention is also equipped with a power display, which can enhance the interaction between the power display information and the user.

藉此,當執行無人機群飛時,可運用任務板進行群飛之定位。而在執行任務過程中,本發明之無人機監控應用模組之即時安全性監控模式配合操控顯示介面上與使用者互動之訊息,無論在周邊環境之維護,以及無人機失控後之安全處置上,均可讓使用者彈性選擇所欲啟動之安全機制,使本裝置可在訓練新進飛手時,藉所設計之諸多安全機制,讓飛手在入門階段可較安心練 習。 In this way, when performing UAV group flight, the mission board can be used for group flight positioning. In the process of performing tasks, the real-time safety monitoring mode of the UAV monitoring application module of the present invention cooperates with the information interacted with the user on the control display interface, no matter in the maintenance of the surrounding environment or the safe disposal of the UAV after it is out of control. , can allow users to flexibly choose the safety mechanism they want to activate, so that when training new pilots, the device can use many safety mechanisms designed so that pilots can practice with more peace of mind at the entry stage. habit.

綜上所述,本發明係一種架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,可有效改善習用之種種缺點,係開發出一套深具教育意義之iOS系統之無人機監控應用模組,並輔以邊緣運算設備,對於練習場地之環境進行即時深度智慧運算,即時訊息提醒初學者危險動作或危險死角之即時修正,助初學者安心練習之同時,並在任一飛行命令未完成送達任一無人機或是未完整執行時,可提供使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止;本發明之無人機監控應用模組不僅可讓新手學員藉安裝在電子通訊設備(如:智慧型手機)上提升基本練習之便利性外,在安全性、監控性與防干擾安全迫降上亦為本發明之開發重點,藉以提升學員練飛時之安全性,進而使本發明之產生能更進步、更實用、更符合使用者之所須,確已符合新型專利申請之要件,爰依法提出專利申請。 To sum up, the present invention is a real-time monitoring and anti-jamming safe forced landing device for intelligent UAV group flight based on information security, which can effectively improve various shortcomings of conventional use. Aircraft monitoring application module, supplemented by edge computing equipment, conducts real-time deep intelligent calculations on the environment of the practice field, and instant messages remind beginners of dangerous actions or real-time corrections of dangerous dead angles, helping beginners practice with peace of mind while flying at any time When the command is not delivered to any drone or is not fully executed, it can provide users with a quick judgment whether to start a single drone to stop or start all drones to stop; the drone monitoring application module of the present invention not only allows novice students to borrow Installed on electronic communication equipment (such as: smart phones) to improve the convenience of basic exercises, it is also the focus of the development of this invention in terms of safety, monitoring and anti-interference safety forced landing, so as to improve the safety of students during flying training , so that the production of the present invention can be more advanced, more practical, and more in line with the needs of users, and it has indeed met the requirements of a new patent application, and a patent application is filed according to law.

惟以上所述者,僅為本發明之較佳實施例而已,當不能以此限定本發明實施之範圍;故,凡依本發明申請專利範圍及發明說明書內容所作之簡單的等效變化與修飾,皆應仍屬本發明專利涵蓋之範圍內。 But the above-mentioned ones are only preferred embodiments of the present invention, and should not limit the scope of the present invention; therefore, all simple equivalent changes and modifications made according to the patent scope of the present invention and the contents of the description of the invention , should still fall within the scope covered by the patent of the present invention.

1:無人機 1: UAV

11:控制模組 11: Control module

12:影像擷取模組 12: Image capture module

13:第一無線通訊模組 13: The first wireless communication module

14:飛行模組 14: Flight module

15:記憶模組 15: Memory module

16:定位模組 16: Positioning module

2:邊緣運算設備 2: Edge Computing Devices

21:圖像處理單元 21: Image processing unit

22:儲存模組 22: Storage module

23:第二無線通訊模組 23: Second wireless communication module

24:智慧型安全迫降單元 24:Intelligent safety forced landing unit

3:電子通訊設備 3: Electronic communication equipment

31:無人機監控應用模組 31: UAV monitoring application module

32:操控顯示介面模組 32: Control display interface module

33:第三無線通訊模組 33: The third wireless communication module

34:通知模組 34: Notification module

4:網路設備 4: Network equipment

Claims (10)

一種架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,係包括:數個無人機,各該無人機上設置有一控制模組、一影像擷取模組、一第一無線通訊模組、一飛行模組、一記憶模組及一定位模組,該控制模組內建一模式通訊協定,該模式通訊協定至少包含位址模式、飛控模式,該控制模組利用該定位模組於一練習場地中選取定位至少一飛行位置點,由該影像擷取模組於該飛行位置點攝取至少一個或數個現場環境資料,通過該第一無線通訊模組依據該飛行位置點選擇傳輸至少一現場衛星資訊,該控制模組將該現場衛星資訊結合於該現場環境資料,以便轉換產生一現場3D地形資訊,並將該現場3D地形資訊透過該第一無線通訊模組加密編碼後即時輸出該編碼後之現場3D地形資訊;一邊緣運算設備,係具有一圖像處理單元(Graphics Processing Unit,GPU)、一儲存模組、一第二無線通訊模組、及一智慧型安全迫降單元,該第二無線通訊模組與該第一無線通訊模組相互適配,用以接收各該無人機即時輸出該編碼後之現場3D地形資訊並進行解碼操作,每一解碼後之現場3D地形資訊係關聯於一無人機其周邊環境之狀況,該圖像處理單元執行深度學習模型以識別該解碼後之現場3D地形資訊,從該儲存模組提取與該解碼後之現場3D地形資訊相關的一個或數個地理環境資訊進行即時深度智慧運算,以識別各該無人機是否存在危險死角或危險動作行為,並對應產生一識別結果,該第二無線通訊模組將該識別結果加密編碼後即時輸出該編碼後之識別結果,傳至電子通訊模組,以提供使用者判斷是否啟動單台無人機停止或啟動所有無人機停止;一電子通訊設備,裝設有一無人機監控應用模組,該電子通訊設備具有與 該無人機監控應用模組連接之一操控顯示介面模組、一通知模組、及一第三無線通訊模組,該第三無線通訊模組與該第一、二無線通訊模組相互適配,用以與該邊緣運算設備及各該無人機連結,該無人機監控應用模組通過該操控顯示介面模組接收一使用者輸入一飛行命令,該飛行命令內含模式通訊協定、位址及飛控資料,透過該第三無線通訊模組將該飛行命令加密編碼後輸出至各該無人機,各該無人機之控制模組透過該第一無線通訊模組接收該編碼後之飛行命令並解碼後,取得對應位址之飛控資料,獲取該飛控資料中的計時器時間,根據該飛控資料進行各該無人機的群飛表演訓練,且於群飛啟動時,倘若有任一飛行命令未完成送達任一無人機或是未完整執行,該未完成送達或未完整執行的無人機之控制模組將自動產生一錯誤訊息,透過該第一無線通訊模組對該錯誤訊息加密編碼,該無人機監控應用模組再透過該第三無線通訊模組接收該安全迫降單元分析當時情境所產生該編碼後之智慧安全迫降結果並進行解碼操作,以提供該使用者快速判斷是否啟動單台無人機停止或啟動所有無人機停止,該無人機監控應用模組亦透過該第三無線通訊模組接收該邊緣運算設備即時深度智慧運算所產生該編碼後之識別結果並進行解碼操作,當該解碼後之識別結果為該至少一無人機具有危險死角或危險動作行為的存在時,該無人機監控應用模組會藉由該通知模組對外即時發出一警告訊號,並將該解碼後之現場3D地形資訊即時顯示於該操控顯示介面模組上,供該使用者可即時評估調配平衡該至少一無人機飛行狀態,據以下達至少一飛行修正命令,並透過該第三無線通訊模組對該飛行修正命令加密編碼後傳送給該至少一無人機,該至少一無人機之控制模組透過該第一無線通訊模組接收該編碼後之飛行修正命令並解碼後,通過該解碼後之飛行修正命令以操控該至少一無人機之飛行模組對其飛行狀態即時進行對應修正;以及一網路設備,係提供一無線區網以無線連結該至少一無人機、該邊緣運算 設備、及該電子通訊設備。 A real-time monitoring and anti-jamming safe forced landing device for smart UAV group flight based on information security, including: several UAVs, each of which is equipped with a control module, an image capture module, and a first wireless Communication module, a flight module, a memory module and a positioning module, the control module has a built-in mode communication protocol, the mode communication protocol includes at least address mode and flight control mode, and the control module uses the The positioning module selects and locates at least one flight location point in a practice field, and the image capture module captures at least one or several on-site environmental data at the flight location point, and uses the first wireless communication module according to the flight location Click to select and transmit at least one on-site satellite information, the control module combines the on-site satellite information with the on-site environmental data, so as to convert and generate an on-site 3D terrain information, and encrypt the on-site 3D terrain information through the first wireless communication module Immediately output the encoded on-site 3D terrain information after encoding; an edge computing device has an image processing unit (Graphics Processing Unit, GPU), a storage module, a second wireless communication module, and an intelligent The safe forced landing unit, the second wireless communication module and the first wireless communication module are adapted to each other, and are used to receive the encoded 3D topographical information output by each UAV in real time and perform decoding operations. On-site 3D terrain information is related to the surrounding environment of a UAV. The image processing unit executes a deep learning model to identify the decoded on-site 3D terrain information, and extracts the decoded on-site 3D terrain from the storage module. Real-time in-depth intelligent calculation is performed on one or several pieces of geographical environment information related to the information to identify whether each drone has a dangerous dead angle or dangerous action behavior, and a corresponding identification result is generated, and the second wireless communication module encrypts the identification result Immediately output the coded recognition result after encoding, and send it to the electronic communication module to provide the user with a judgment whether to start a single drone to stop or to start all drones to stop; an electronic communication device is equipped with a drone monitoring application module group, the electronic communication equipment has a The UAV monitoring application module is connected to a control display interface module, a notification module, and a third wireless communication module, and the third wireless communication module is compatible with the first and second wireless communication modules , for linking with the edge computing device and each of the drones, the drone monitoring application module receives a flight command input by a user through the control display interface module, and the flight command contains mode communication protocol, address and The flight control data is encrypted and encoded by the third wireless communication module to output the flight command to each unmanned aerial vehicle, and the control module of each unmanned aerial vehicle receives the encoded flight order through the first wireless communication module and After decoding, obtain the flight control data of the corresponding address, obtain the timer time in the flight control data, carry out the group flight performance training of each UAV according to the flight control data, and when the group flight starts, if there is any If the flight order has not been delivered to any drone or has not been fully executed, the control module of the drone that has not been delivered or has not been fully executed will automatically generate an error message, and the error message will be encrypted through the first wireless communication module coding, the UAV monitoring application module receives the safe forced landing unit through the third wireless communication module and analyzes the coded smart safe forced landing result generated by the current situation and performs decoding operation, so as to provide the user with a quick judgment on whether to activate When a single UAV is stopped or all UAVs are stopped, the UAV monitoring application module also receives the encoded recognition result generated by the real-time deep intelligent operation of the edge computing device through the third wireless communication module and performs decoding operation, When the decoded recognition result is that the at least one UAV has a dangerous blind spot or dangerous behavior, the UAV monitoring application module will immediately send a warning signal to the outside through the notification module, and the decoded The on-site 3D terrain information is displayed on the control display interface module in real time, so that the user can immediately evaluate the deployment and balance of the flight status of the at least one drone, and issue at least one flight correction order accordingly, and pass the third wireless communication module The group encrypts and encodes the flight correction command and sends it to the at least one drone. The control module of the at least one drone receives the encoded flight correction command through the first wireless communication module and decodes it. The flight correction command is used to control the flight module of the at least one unmanned aerial vehicle to make corresponding corrections to its flight status in real time; and a network device is to provide a wireless area network to wirelessly connect the at least one unmanned aerial vehicle, the edge computing equipment, and the electronic communication equipment. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該網路設備為無線路由器或手機熱點。 According to the information security-based real-time monitoring and anti-interference safety forced landing device for smart UAV group flight described in item 1 of the patent application scope, the network device is a wireless router or a mobile phone hotspot. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該飛行命令係依該使用者之群飛表演需求,依格式輸入各該無人機的網際網路協定(Internet Protocol,IP)、執行任務時間點及執行指令,編輯成為舞譜與舞序資料,並於選擇讀取音樂後即可觸發該無人機監控應用模組開啟群飛開關,開啟群飛。 According to the information security-based real-time monitoring and anti-interference safety forced landing device for intelligent UAV group flight described in item 1 of the scope of the application, the flight command is entered according to the format according to the user's group flight performance requirements. Edit the UAV's Internet Protocol (IP), mission execution time and execution instructions into dance score and dance order data, and after selecting to read the music, the UAV monitoring application module can be triggered to open the group Fly switch, open group fly. 依申請專利範圍第3項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該無人機監控應用模組通過該飛行命令觸發開啟群飛,進行自動偵測無人機數目,並伴隨音樂自動控制群飛。 According to the information security-based real-time monitoring and anti-jamming safety forced landing device of smart UAV group flight described in item 3 of the scope of the patent application, the UAV monitoring application module triggers the group flight through the flight command for automatic detection Measure the number of drones, and automatically control the group flight with music. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該控制模組、該第一無線通訊模組、該飛行模組、該記憶模組及該定位模組係整合在一任務板上並將該任務板設置於各該無人機下方。 According to the information security-based real-time monitoring and anti-interference safe forced landing device for smart UAV group flight described in item 1 of the patent application scope, the control module, the first wireless communication module, the flight module, the The memory module and the positioning module are integrated on a task board and the task board is arranged under each of the drones. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,各該無人機、該電子通訊設備及該邊緣運算設備其訊號發送與接收之過程係透過用戶資料包協定(User Datagram Protocol,UDP)來通訊該網路設備,經過該網路設備而與彼此聯繫。 According to the information security-based real-time monitoring and anti-jamming safety forced landing device of smart UAV group flight described in Item 1 of the scope of the application, the signal transmission and reception of each of the UAV, the electronic communication device and the edge computing device The process is to communicate with the network device through the User Datagram Protocol (UDP), and communicate with each other through the network device. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該現場環境資料係該練習場地之影像或照片。 According to the information security-based real-time monitoring and anti-interference safety forced landing device of smart UAV group flight described in item 1 of the patent application scope, the on-site environmental data is an image or photo of the practice site. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該邊緣運算設備係經由一無線感測網路控制其感測收集地理環境資訊,並儲存至該儲存模組中。 According to the information security-based real-time monitoring and anti-jamming safe forced landing device of smart UAV group flight described in item 1 of the scope of the patent application, the edge computing device is controlled by a wireless sensor network to sense and collect geographical environment information and store it in the storage module. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該警告訊號包含警示用之聲響、語音、光源或電子訊息。 According to the information security-based real-time monitoring and anti-jamming safe forced landing device for intelligent UAV group flight described in item 1 of the scope of the patent application, the warning signal includes sound, voice, light source or electronic message for warning. 依申請專利範圍第1項所述之架構於資訊安全之智慧無人機群飛即時監控與防干擾安全迫降裝置,其中,該無人機監控應用模組更包括監控各該無人機之一電池之電力,並於該操控顯示介面模組上顯示目前該電池之一電池剩餘電量。 According to the information security-based real-time monitoring and anti-jamming safety forced landing device of smart UAV group flight described in item 1 of the scope of the patent application, the UAV monitoring application module further includes monitoring the power of one battery of each UAV , and display the current remaining power of one of the batteries on the control display interface module.
TW110148523A 2021-12-23 2021-12-23 Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security TWI810761B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110148523A TWI810761B (en) 2021-12-23 2021-12-23 Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110148523A TWI810761B (en) 2021-12-23 2021-12-23 Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security

Publications (2)

Publication Number Publication Date
TW202326331A TW202326331A (en) 2023-07-01
TWI810761B true TWI810761B (en) 2023-08-01

Family

ID=88147684

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110148523A TWI810761B (en) 2021-12-23 2021-12-23 Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security

Country Status (1)

Country Link
TW (1) TWI810761B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107918402A (en) * 2017-12-02 2018-04-17 广东容祺智能科技有限公司 One kind is based on mobile network's unmanned plane cluster flight system
US20190391575A1 (en) * 2017-04-28 2019-12-26 Ars Electronica Linz Gmbh & Co Kg Unmanned aircraft with a modular swarm control unit
TWM593114U (en) * 2019-12-26 2020-04-01 實踐大學 Command system of flying swarm of unmanned aerial vehicle drones
CN113467275A (en) * 2021-08-16 2021-10-01 北京航空航天大学 Unmanned aerial vehicle cluster flight simulation system based on real object airborne equipment
TWM618419U (en) * 2021-03-16 2021-10-21 鄭婉淑 UAV swarm flying real-time deep intelligent monitoring safety protection device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190391575A1 (en) * 2017-04-28 2019-12-26 Ars Electronica Linz Gmbh & Co Kg Unmanned aircraft with a modular swarm control unit
CN107918402A (en) * 2017-12-02 2018-04-17 广东容祺智能科技有限公司 One kind is based on mobile network's unmanned plane cluster flight system
TWM593114U (en) * 2019-12-26 2020-04-01 實踐大學 Command system of flying swarm of unmanned aerial vehicle drones
TWM618419U (en) * 2021-03-16 2021-10-21 鄭婉淑 UAV swarm flying real-time deep intelligent monitoring safety protection device
CN113467275A (en) * 2021-08-16 2021-10-01 北京航空航天大学 Unmanned aerial vehicle cluster flight simulation system based on real object airborne equipment

Also Published As

Publication number Publication date
TW202326331A (en) 2023-07-01

Similar Documents

Publication Publication Date Title
CN110335359B (en) Distribution board fire accident emergency drilling simulation method based on virtual reality technology
US10525332B2 (en) System and method for conducting a drone race or game
CN104240547A (en) Fire-fighting and rescuing command computer simulation training system
CN206946745U (en) Fire Training system based on virtual reality technology
CN106796761A (en) System and method for supporting simulation mobile
WO2022193192A1 (en) Unmanned aerial vehicle scheduling method, server, base station, system, and readable storage medium
CN109686168A (en) A kind of air duty training system based on mixed reality
CN107065693A (en) A kind of remote control intelligent fire robot system based on ZigBee
CN109035929A (en) A kind of VR computer in education system
TWI810761B (en) Real-time monitoring and anti-jamming safety forced landing device for intelligent UAV group flight based on information security
CN105741645B (en) Big Dipper science popularization acousto-optic-electric demonstration equipment and establishment demenstration method
CN206523788U (en) A kind of live three-dimensional reconstruction system of the cases based on unmanned plane
TWM618419U (en) UAV swarm flying real-time deep intelligent monitoring safety protection device
Mangina et al. Drones for live streaming of visuals for people with limited mobility
CN109788265A (en) A kind of wireless interaction method and device of projector
CN105549618A (en) Real-scene interactive control system
KR102413130B1 (en) System and method for simulation of drone education based on real-time vr/mr of non-face-to-face multi-participation
Limosani et al. Low‐cost solution in international robotic challenge: Lessons learned by Tuscany Robotics Team at ERL Emergency Robots 2017
Peschel et al. Exploratory results for a mission specialist interface in micro unmanned aerial systems
CN107015815B (en) Device for simulating safety control display equipment of nuclear power station
Yousuf et al. Drone Labs to Promote Interest in Science, Technology, Engineering, and Mathematics (STEM)
TWI724423B (en) Interactive learning device for aircraft
Rouf et al. RF controlled solar based robotic drone
US11631339B2 (en) Training simulation system and method for detection of hazardous materials
CN207311858U (en) A kind of fire of high-rise building Interface based on unmanned plane