TWI819569B - A zero-time huge aerial photo shooting device based on drone swarm flight - Google Patents

A zero-time huge aerial photo shooting device based on drone swarm flight Download PDF

Info

Publication number
TWI819569B
TWI819569B TW111114224A TW111114224A TWI819569B TW I819569 B TWI819569 B TW I819569B TW 111114224 A TW111114224 A TW 111114224A TW 111114224 A TW111114224 A TW 111114224A TW I819569 B TWI819569 B TW I819569B
Authority
TW
Taiwan
Prior art keywords
module
flight
drone
mission
shooting
Prior art date
Application number
TW111114224A
Other languages
Chinese (zh)
Other versions
TW202340676A (en
Inventor
龔志銘
Original Assignee
實踐大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 實踐大學 filed Critical 實踐大學
Priority to TW111114224A priority Critical patent/TWI819569B/en
Publication of TW202340676A publication Critical patent/TW202340676A/en
Application granted granted Critical
Publication of TWI819569B publication Critical patent/TWI819569B/en

Links

Abstract

一種架構於無人機群飛之零時差巨幅空照圖拍攝裝置,將以一台無人機設定在一定高度所拍攝到的預期面積為主,設定要拍攝的場域面積範圍,由地面站先行運算出任務需要的無人機數量,並計算出任務位置與設計出機群中各台無人機的航路與任務規劃。待所有無人機飛行至指定的任務位置後,同步觸發拍攝任務與空照圖上傳,再透過後台影像拼接系統匯集空照圖後進行正射投影與拼接後處理,達到零時差的巨幅空照圖拍攝任務。藉此,本發明可大幅節省空照圖的拍攝成本,並可提供等同衛星空照圖之高正確度、高精密度的零時差巨幅空照圖。 A zero-time huge aerial photo shooting device based on a group of drones. It will focus on the expected area captured by a drone set at a certain height. The area of the field to be photographed is set, and the ground station takes the lead. Calculate the number of drones required for the mission, calculate the mission location, and design the route and mission planning for each drone in the fleet. After all the drones fly to the designated mission positions, the shooting tasks and aerial images are uploaded simultaneously. The aerial images are then collected through the background image splicing system for orthographic projection and splicing post-processing to achieve a zero-time difference in huge aerial images. Picture shooting task. Thereby, the present invention can significantly save the cost of photographing aerial images, and can provide a zero-time huge aerial image with high accuracy and precision equivalent to that of satellite aerial images.

Description

架構於無人機群飛之零時差巨幅空照圖拍攝裝置 A zero-time huge aerial photo shooting device based on drone swarm flight

本發明係有關於一種架構於無人機群飛之零時差巨幅空照圖拍攝裝置,尤指涉及一種可大幅節省空照圖的拍攝成本,並可提供等同衛星空照圖之高正確度、高精密度的零時差巨幅空照圖。 The present invention relates to a zero-time difference huge aerial photo shooting device based on a group of UAVs. In particular, it relates to a device that can significantly save the cost of shooting aerial photos and can provide high accuracy equivalent to satellite aerial photos. High-precision zero-day huge aerial images.

遙測影像資訊已被廣泛的融入至日常生活及各領域研究中,因其拍攝範圍廣泛、空間解析度高、反應時間快、及不受地形限制等優點,舉凡農業災害勘查、作物辨識、及農地利用調查等作業,亦可看到其應用蹤跡。以現今技術而言,遙測影像可分為空載及衛載系統,各應用範疇因應影像使用標的,選擇符合的拍攝類型,如航照資料蒐集面積雖大且影像解析度高,但與無人機(Unmanned Aerial Vehicle,UAV)相較,容易受限於天氣因素,且機動性低。 Telemetry image information has been widely integrated into daily life and research in various fields. Due to its wide shooting range, high spatial resolution, fast response time, and being not restricted by terrain, it has been widely used in agricultural disaster survey, crop identification, and farmland. Traces of its application can also be seen through surveys and other operations. In terms of current technology, telemetry images can be divided into airborne and satellite-borne systems. Each application field selects a suitable shooting type according to the image usage target. For example, although the aerial photo data collection area is large and the image resolution is high, it is different from UAVs. (Unmanned Aerial Vehicle, UAV) is easily limited by weather factors and has low maneuverability.

拍攝區域問題方面,無人機對於其自身相機系統拍攝範圍會依照高度(焦段)、光圈及鏡頭特性,拍攝出不同範圍的影像,飛越高範圍則越廣,但細節資訊也越少。因此為了細節資訊,一般航拍方式會以同高度的方式進行掃描拍攝來減少高度不同出現的差異,但缺點是非同步,導致影像的資料並非立即,當範圍越大,所花的拍攝時間越久。但是由於空照圖中各區域的航空照片取得時間不同,造成圖資中出現影像之鬼影,鬼影的產生是由於拍攝航空照片時間差所造成的現象,所以此類拼接後產生鬼影的照片在許多空照圖的運用場域並不適用,例如:交通運輸觀測、車輛偵測與追蹤等等。 As for the shooting area, the drone's camera system will shoot different ranges of images according to the height (focal length), aperture and lens characteristics. The higher you fly, the wider the range, but the less detailed information. Therefore, in order to obtain detailed information, the general aerial photography method will scan and shoot at the same height to reduce the difference caused by different heights. However, the disadvantage is that it is asynchronous, resulting in image data that is not immediate. The larger the range, the longer it takes to shoot. However, due to the different acquisition times of the aerial photos in each area of the aerial photo map, image ghosting appears in the map data. The ghosting is caused by the time difference in taking aerial photos. Therefore, such photos that produce ghosting after splicing It is not applicable in many application areas of aerial photos, such as transportation observation, vehicle detection and tracking, etc.

有鑑於過去要取得空照圖只能依靠衛星空照,但是所費不貲,後 來使用飛機藉由航路規劃進行航空攝影取得航空照片進行正射投影與相片拼接技術以獲得空照圖,但礙於空照圖中各區域的航空照片取得時間不同,造成圖資中出現影像之鬼影,因而無法使用在交通運輸觀測、車輛偵測與追蹤等多種空照圖的運用場域上。職是之故,發展一套可解決影像鬼影問題與前案技術缺點之發明實有必要。故,一般習用者係無法符合使用者於實際使用時達到零時差的巨幅空照圖拍攝之所需。 In view of the fact that in the past, the only way to obtain aerial photos was through satellite photos, which were expensive, later We use aircraft to carry out aerial photography through route planning to obtain aerial photos, and use orthographic projection and photo splicing technology to obtain aerial photos. However, due to the different acquisition times of aerial photos in each area of the aerial photos, resulting in the appearance of images in the map. Ghost images therefore cannot be used in various aerial image application fields such as transportation observation, vehicle detection and tracking, etc. For this reason, it is necessary to develop an invention that can solve the problem of image ghosting and the shortcomings of the previous technology. Therefore, ordinary users cannot meet the user's needs for shooting huge aerial photos with zero time difference in actual use.

本發明之主要目的係在於,克服習知技藝所遭遇之上述問題並提供一種可大幅節省空照圖的拍攝成本,並可提供等同衛星空照圖之高正確度、高精密度的零時差巨幅空照圖之架構於無人機群飛之零時差巨幅空照圖拍攝裝置。 The main purpose of the present invention is to overcome the above-mentioned problems encountered in the conventional art and provide a method that can greatly save the cost of shooting aerial images, and can provide a zero-day giant image with high accuracy and precision equivalent to that of satellite aerial images. The structure of the aerial photo is based on the zero-time difference huge aerial photo shooting device of drone swarm flight.

為達以上之目的,本發明係一種架構於無人機群飛之零時差巨幅空照圖拍攝裝置,係包括:數個無人機,每一無人機定位在一拍攝場域上方一高度位置處,每一無人機的焦段係設定恰對應於該拍攝場域所定義的數個預期面積,每一無人機包括有一第一無線通訊模組,用以接收該無人機對應的一飛行命令,該飛行命令包含一任務位置及一航路與任務規劃;一定位模組,用以產生該無人機的即時動態定位(Real-Time Kinematic,RTK)訊號;一記憶模組,用以儲存該飛行命令;一影像擷取模組,用來擷取該拍攝場域的數個影像;一飛行模組,用來讓該無人機飛行與起降;及一控制模組,連接該第一無線通訊模組、該定位模組、該記憶模組、該影像擷取模組、與該飛行模組,用以依據該航路與任務規劃控制該飛行模組的飛行方向與/或速度,以使該無人機飛抵並定位於該任務位置後,觸發該影像擷取模組進行空照圖同步拍攝;一地面站,具有一第二無線通訊模組、一資料庫模組、及一連接該第二無線通訊模組與該 資料庫模組之運算處理模組,該地面站與該數個無人機無線通訊,用以接收該拍攝場域的一設定參數,該設定參數包括該拍攝場域的高度、焦段、及該些預期面積,根據該設定參數計算出執行拍攝任務所需的該些無人機的數量、及執行拍攝任務的每一無人機對應的該任務位置,再根據接收的每一無人機之RTK訊號進行每一無人機的航路與任務規劃運算,並將包含該任務位置及該航路與任務規劃之該飛行命令傳輸至對應的該無人機,令每一無人機可依各自對應的該航路與任務規劃飛行至對應的該任務位置後,依據同步拍攝觸發訊號進行同步拍攝任務與空照圖上傳;以及一後台影像拼接系統,係通過該些第一無線通訊模組與該些無人機無線通訊,及通過該第二無線通訊模組與該地面站無線通訊,用以接收該些空照圖並進行建模,透過正射投影與拼接後處理,最終得到一零時差拼接空照圖,再將該零時差拼接空照圖傳回該地面站並儲存至該資料庫模組中。 In order to achieve the above purpose, the present invention is a zero-time huge aerial photo shooting device based on a group flight of drones. It includes: several drones, each drone is positioned at a height above a shooting field. , the focal length of each drone is set to correspond to several expected areas defined by the shooting field, and each drone includes a first wireless communication module for receiving a flight command corresponding to the drone. The flight command includes a mission position and a route and mission plan; a positioning module to generate the real-time dynamic positioning (Real-Time Kinematic, RTK) signal of the UAV; a memory module to store the flight command; An image capture module is used to capture several images of the shooting area; a flight module is used to allow the drone to fly, take off and land; and a control module is connected to the first wireless communication module , the positioning module, the memory module, the image capture module, and the flight module are used to control the flight direction and/or speed of the flight module according to the route and mission planning, so that the UAV After flying to and positioning at the mission location, the image capture module is triggered to perform synchronous shooting of aerial images; a ground station has a second wireless communication module, a database module, and a connection to the second wireless Communication module and the The computing processing module of the database module. The ground station communicates wirelessly with the several drones to receive a setting parameter of the shooting area. The setting parameters include the height, focal length, and the shooting area of the shooting area. The expected area is calculated according to the set parameters. The number of drones required to perform the shooting task and the task position corresponding to each drone performing the shooting task are calculated, and then each drone is calculated based on the received RTK signal of each drone. Route and mission planning calculations for a UAV, and transmit the flight command including the mission location and the route and mission plan to the corresponding UAV, so that each UAV can fly according to its corresponding route and mission plan After arriving at the corresponding task location, the synchronized shooting task and aerial photo upload are performed according to the synchronized shooting trigger signal; and a background image splicing system wirelessly communicates with the drones through the first wireless communication modules, and The second wireless communication module wirelessly communicates with the ground station to receive and model the aerial images. Through orthographic projection and splicing post-processing, a zero-time difference spliced aerial image is finally obtained, and then the zero-time difference spliced aerial images are obtained. The time difference spliced aerial image is sent back to the ground station and stored in the database module.

1:無人機 1: Drone

11:第一無線通訊模組 11:The first wireless communication module

12:定位模組 12: Positioning module

13:記憶模組 13:Memory module

14:影像擷取模組 14:Image capture module

15:飛行模組 15:Flight module

16:控制模組 16:Control module

2:地面站 2: Ground station

21:第二無線通訊模組 21:Second wireless communication module

22:資料庫模組 22:Database module

23:運算處理模組 23:Computational processing module

3:後台影像拼接系統 3:Backstage image stitching system

第1圖,係本發明架構於無人機群飛之零時差巨幅空照圖拍攝裝置之一實施例示意圖。 Figure 1 is a schematic diagram of an embodiment of the zero-time difference huge aerial photo shooting device based on the drone group flight according to the present invention.

第2圖,係本發明架構於無人機群飛之零時差巨幅空照圖拍攝裝置之操作流程示意圖。 Figure 2 is a schematic diagram of the operation flow of the zero-time difference huge aerial photo shooting device based on the drone group flight according to the present invention.

第3圖,係本發明之無人機Mesh網路系統架構示意圖。 Figure 3 is a schematic diagram of the UAV Mesh network system architecture of the present invention.

第4圖,係本發明之傳統架構與Mesh架構傳輸時間比較圖。 Figure 4 is a comparison chart of transmission time between the traditional architecture and the Mesh architecture of the present invention.

第5圖,係本發明之地面解析度、飛行高度、焦距與感測器圖元數之幾何關係示意圖。 Figure 5 is a schematic diagram of the geometric relationship between ground resolution, flight altitude, focal length and the number of sensor elements according to the present invention.

第6圖,係本發明之相片重疊度示意圖。 Figure 6 is a schematic diagram of the overlapping degree of photos according to the present invention.

第7圖,係本發明之預定拍攝場域使用無人機數量示意圖。 Figure 7 is a schematic diagram of the number of drones used in the intended shooting area of the present invention.

第8圖,係本發明之無人機任務位置示意圖。 Figure 8 is a schematic diagram of the mission position of the drone of the present invention.

請參閱『第1圖~第8圖』所示,係分別為本發明架構於無人機群飛之零時差巨幅空照圖拍攝裝置之一實施例示意圖、本發明架構於無人機群飛之零時差巨幅空照圖拍攝裝置之操作流程示意圖、本發明之無人機Mesh網路系統架構示意圖、本發明之傳統架構與Mesh架構傳輸時間比較圖、本發明之地面解析度、飛行高度、焦距與感測器圖元數之幾何關係示意圖、本發明之相片重疊度示意圖、本發明之預定拍攝場域使用無人機數量示意圖、及本發明之無人機任務位置示意圖。如圖所示:本發明係一種架構於無人機群飛之零時差巨幅空照圖拍攝裝置,係包括數個無人機1、一地面站2、以及一後台影像拼接系統3所構成。 Please refer to "Figures 1 to 8", which are respectively schematic diagrams of an embodiment of the zero-time difference huge aerial photo shooting device based on the structure of the present invention and the structure of the present invention based on the group flying of UAVs. Schematic diagram of the operation flow of the zero-time difference huge aerial photo shooting device, schematic diagram of the UAV Mesh network system architecture of the present invention, comparison diagram of the transmission time of the traditional architecture and Mesh architecture of the present invention, ground resolution, flight height, and focal length of the present invention. A schematic diagram of the geometric relationship with the number of sensor elements, a schematic diagram of the photo overlap of the present invention, a schematic diagram of the number of drones used in the predetermined shooting area of the present invention, and a schematic diagram of the drone mission location of the present invention. As shown in the figure: the present invention is a zero-time huge aerial photo shooting device based on a group of drones. It consists of several drones 1, a ground station 2, and a background image splicing system 3.

上述所提之數個無人機1,其每一無人機1定位在一拍攝場域上方一高度位置處,每一無人機1的焦段係設定恰對應於該拍攝場域所定義的數個預期面積,每一無人機1包括有一第一無線通訊模組11,用以接收該無人機1對應的一飛行命令該飛行命令包含一任務位置及一航路與任務規劃;一定位模組12,用以產生該無人機1的即時動態定位(Real-Time Kinematic,RTK)訊號;一記憶模組13,用以儲存該飛行命令;一影像擷取模組14,用來擷取該拍攝場域的數個影像;一飛行模組15,用來讓該無人機1飛行與起降;及一控制模組16,連接該第一無線通訊模組11、該定位模組12、該記憶模組13、該影像擷取模組14、與該飛行模組15,用以依據該航路與任務規劃控制該飛行模組15的飛行方向與/或速度,以使該無人機飛抵並定位於該任務位置後,觸發該影像擷取模組14進行空照圖同步拍攝。 Among the several drones 1 mentioned above, each drone 1 is positioned at a height above a shooting field, and the focal length of each drone 1 is set to correspond to several expected targets defined in the shooting field. area, each UAV 1 includes a first wireless communication module 11 for receiving a flight command corresponding to the UAV 1. The flight command includes a mission location and a route and mission plan; a positioning module 12 for To generate a real-time dynamic positioning (Real-Time Kinematic, RTK) signal of the UAV 1; a memory module 13 to store the flight command; an image capture module 14 to capture the shooting scene Several images; a flight module 15, used to allow the drone 1 to fly, take off and land; and a control module 16, connected to the first wireless communication module 11, the positioning module 12, and the memory module 13 The image capture module 14 and the flight module 15 are used to control the flight direction and/or speed of the flight module 15 according to the route and mission planning, so that the UAV arrives and is positioned at the mission. After the position is reached, the image capture module 14 is triggered to perform simultaneous shooting of aerial images.

該地面站2具有一第二無線通訊模組21、一資料庫模組22、及一連接該第二無線通訊模組21與該資料庫模組22之運算處理模組23。該地面站2與該數個無人機1無線通訊,用以接收該拍攝場域的一設定參數,該設定參數包括該拍攝場域的高度、焦段、及該些預期面積,根據該設定參數計算出執行拍攝任務所需的該些無人機1的數量、及執行拍攝任務的每一無人機1對應的該任務位置,再根據接收的每一無人機1之RTK訊號進行每一無人機1的航路與任務規劃運算,並將包含該任務位置及該航路與任務規劃之該飛行命令傳輸至對應的該無人機1,令每一無人機1可依各自對應的該航路與任務規劃飛行至對應的該任務位置後,依據同步拍攝觸發訊號進行同步拍攝任務與空照圖上傳。 The ground station 2 has a second wireless communication module 21, a database module 22, and a computing processing module 23 connecting the second wireless communication module 21 and the database module 22. The ground station 2 communicates wirelessly with the drones 1 to receive a setting parameter of the shooting area. The setting parameter includes the height, focal length, and expected areas of the shooting area, and is calculated based on the setting parameter. The number of UAVs 1 required to perform the shooting task and the task position corresponding to each UAV 1 performing the shooting task are determined, and then the RTK signal of each UAV 1 is received. Route and mission planning calculations, and transmit the flight command including the mission location and the route and mission plan to the corresponding UAV 1, so that each UAV 1 can fly to the corresponding location according to the corresponding route and mission plan. After the task location is determined, the synchronous shooting task and aerial photo upload are performed according to the synchronous shooting trigger signal.

該後台影像拼接系統3為雲端伺服器,其係通過該些第一無線通訊模組11與該些無人機1無線通訊,及通過該第二無線通訊模組21與該地面站2無線通訊,用以接收該些空照圖並進行建模,透過正射投影與拼接後處理,最終得到一零時差拼接空照圖,再將該零時差拼接空照圖傳回該地面站2並儲存至該資料庫模組22中。如是,藉由上述揭露之流程構成一全新之架構於無人機群飛之零時差巨幅空照圖拍攝裝置。 The background image stitching system 3 is a cloud server, which communicates wirelessly with the drones 1 through the first wireless communication modules 11, and communicates wirelessly with the ground station 2 through the second wireless communication module 21, It is used to receive these aerial images and perform modeling. Through orthographic projection and splicing post-processing, a zero-day spliced aerial image is finally obtained, and then the zero-day spliced aerial image is transmitted back to the ground station 2 and stored in This database is in module 22. In this way, through the process disclosed above, a brand new structure is formed for the zero-time difference huge aerial photo shooting device of drone swarm flight.

上述第一無線通訊模組11及該第二無線通訊模組21為一LoRa模組、一4G模組、一WiFi模組、一藍牙(Bluetooth)模組、或其組合。 The above-mentioned first wireless communication module 11 and the second wireless communication module 21 are a LoRa module, a 4G module, a WiFi module, a Bluetooth module, or a combination thereof.

上述第二無線通訊模組21與該第一無線通訊模組11相互適配,使該地面站2與各該無人機1溝通連結,透過星狀(mesh)無線通訊形式傳送該飛行命令給各該無人機1內之控制模組16,各該無人機1接收到該飛行命令後加以解碼,取得該無人機1對應任務位置之航路與任務規劃,並獲取該航路與任務規劃中的計時器時間,待以該計時器時間執行該無人機1對時動作完成後,即可根據該航路與任務規劃進行該無人機1的群飛拍攝任務,使得 該數個無人機1皆受到自我飛控機制,並可在通訊中斷時依然維持穩定飛行的自我拍攝完畢。 The above-mentioned second wireless communication module 21 and the first wireless communication module 11 are mutually adapted to enable the ground station 2 to communicate with each drone 1 and transmit the flight command to each drone 1 through a star-shaped (mesh) wireless communication form. The control module 16 in the UAV 1 decodes each UAV 1 after receiving the flight command, obtains the route and mission plan corresponding to the mission position of the UAV 1, and obtains the timer in the route and mission plan. time, after the time synchronization action of the UAV 1 is completed according to the timer time, the group flight shooting mission of the UAV 1 can be carried out according to the route and mission planning, so that The drones 1 are all subject to a self-flight control mechanism and can still maintain stable flight and complete self-photography when communication is interrupted.

上述地面站2內建有一應用程式(APP),能透過該第二無線通訊模組21獲取地面參考物體位置距離(焦段)與飛行高度資訊,即時分析規劃飛行航路與判別飛行狀態與記錄飛行航路。 The above-mentioned ground station 2 has a built-in application program (APP), which can obtain the position distance (focal length) and flight altitude information of the ground reference object through the second wireless communication module 21, and can analyze and plan the flight route, determine the flight status and record the flight route in real time. .

當運用時,本發明將以一台無人機1設定在一定高度所拍攝到的預期面積為主,設定要拍攝的場域範圍,由地面站2先行運算出任務需要的無人機1數量,並計算出任務位置與設計出機群中各台無人機1的航路與任務規劃。待所有無人機1飛行至指定的任務位置後,同步觸發拍攝任務與空照圖上傳。此時,後台影像拼接系統3立即開始進行建模,最終得到零時差拼接空照圖,其流程如第2圖所示。 When used, the present invention will focus on the expected area photographed by a drone 1 set at a certain height, set the field range to be photographed, and the ground station 2 will first calculate the number of drones 1 required for the task, and Calculate the mission location and design the route and mission planning of each UAV 1 in the fleet. After all UAVs 1 fly to the designated mission locations, the shooting mission and aerial photo upload will be triggered simultaneously. At this time, the background image stitching system 3 immediately starts modeling, and finally obtains a zero-day spliced aerial image. The process is shown in Figure 2.

以下實施例僅舉例以供了解本發明之細節與內涵,但不用於限制本發明之申請專利範圍。 The following examples are only examples for understanding the details and connotation of the present invention, but are not used to limit the patentable scope of the present invention.

[無人機群飛控制與通訊網路] [UAV group flight control and communication network]

本專利採用中華民國公告號M593114之無人機群飛指揮系統作為主要控制系統,可改善傳統通訊傳輸方式採線狀數據傳輸必須時時發送舞步飛行命令,不可中斷,一旦中斷,表演即被打斷之缺點。本發明使用之系統,係將群飛飛行命令先行上傳至無人機中,進入對時飛行後,不會因為通訊中斷而任務中斷。傳輸方式採Mesh傳輸方式,進行資料傳遞。 本發明使用構建無線mesh網絡來提供高速通訊的無人機系統,支援mesh網路的系統架構,如第3圖所示。當有n個無人機節點(Node)時,傳輸單位時間為t,傳輸頻寬為b時,使用二元Mesh架構時所需時間tmesh與頻寬bmesh,分別為:

Figure 111114224-A0305-02-0008-2
該地面站向一區域發送大量的無人機傳輸訊息,當該些無人機開啟時將自動搜尋附近的無人機,並自動建立無線mesh網路,為該區域的該些無人機提供高速的無線網路(如Wi-Fi)通訊,可將每一無人機的狀況即時傳輸到該地面站,使該地面站可對每個無人機節點的數據容量進行有效的網路檢查,以進行該些無人機的任務佈置。隨著群飛無人機數量增加Mesh架構之傳輸速率之速度提升將更加明顯,如第4圖所示之傳統架構傳輸時間(Ts)與Mesh架構傳輸時間(Tmesh)比較圖。 This patent uses the UAV group flight command system of the Republic of China Announcement No. M593114 as the main control system, which can improve the traditional communication transmission method. Linear data transmission must always send dance flight commands without interruption. Once interrupted, the performance will be interrupted. shortcomings. The system used in this invention uploads the group flight command to the drone in advance. After entering the time-matching flight, the mission will not be interrupted due to communication interruption. The transmission method adopts Mesh transmission method for data transmission. The present invention uses a UAV system to build a wireless mesh network to provide high-speed communication and supports the system architecture of the mesh network, as shown in Figure 3. When there are n drone nodes (Node), the transmission unit time is t, and the transmission bandwidth is b, when using the binary Mesh architecture, the required time t mesh and bandwidth b mesh are respectively:
Figure 111114224-A0305-02-0008-2
The ground station sends a large number of drone transmission messages to an area. When the drones are turned on, they will automatically search for nearby drones and automatically establish a wireless mesh network to provide high-speed wireless networks for the drones in the area. Through communication (such as Wi-Fi), the status of each drone can be transmitted to the ground station in real time, so that the ground station can conduct effective network checks on the data capacity of each drone node to carry out operations on these drones. Machine task arrangement. As the number of drones flying in the group increases, the transmission rate of the Mesh architecture will increase more obviously, as shown in Figure 4, which compares the transmission time of the traditional architecture (Ts) and the transmission time of the Mesh architecture (Tmesh).

[解析度(Resolution)] [Resolution]

圖像解析度係指圖像中存儲的資訊量,是每英寸圖像內有多少個圖元點(pixel),單位為PPI(Pixels Per Inch),決定圖像的清晰度,其和圖像的寬、高尺寸一起決定了影像檔的大小及圖像品質。也可以表達為圖像所包含的『水平圖元數×垂直圖元數』,如某照片的解析度為5472×3648。在地理資訊系統(Geographic Information System,GIS)中所提到的解析度表示一個圖元代表的地面實際距離,是衡量遙感影像能有差別區分開兩個相鄰地物的最小距離的能力。解析度有空間解析度(Spatial Resolution)與地面解析度(Ground Resolution),因此相關定義資訊,分別臚列如下: Image resolution refers to the amount of information stored in the image, which is the number of pixels per inch of the image. The unit is PPI (Pixels Per Inch), which determines the clarity of the image. The width and height dimensions together determine the size and image quality of the image file. It can also be expressed as "the number of horizontal pixels × the number of vertical pixels" contained in the image. For example, the resolution of a photo is 5472×3648. The resolution mentioned in Geographic Information System (GIS) represents the actual distance on the ground represented by a graphic element, and is a measure of the minimum distance at which remote sensing images can differentiate between two adjacent features. Resolution includes Spatial Resolution and Ground Resolution, so the relevant definition information is listed as follows:

1.空間解析度,也稱地面採樣間隔(Ground Sample Distance,GSD):指數字影像中用地面距離單位表示的圖元大小,即一個圖元所代表的地面長度。如,某影像的地面採樣間隔為5cm,即該影像一個圖元所代表的地面長度為5cm。 1. Spatial resolution, also called Ground Sample Distance (GSD): refers to the size of the graphic element expressed in ground distance units in digital images, that is, the length of the ground represented by one graphic element. For example, if the ground sampling interval of an image is 5cm, that is, the length of the ground represented by one pixel of the image is 5cm.

2.地面解析度,也稱幾何解析度:地面上所能分辨的最小地物的寬度,只有地物大於2個像元時才能從圖像上正確地分辨出來。也可以認為,地面解析度=2*地面採樣間隔。如,某影像的地面採樣間隔為5cm,即該影像一個圖元所代表的地面長度為5cm,然而,大於兩個像元大小(即10cm)的地物才能被分辨出來,因此該影像的地面解析度為10cm。 2. Ground resolution, also called geometric resolution: the width of the smallest feature that can be distinguished on the ground. Only when the feature is larger than 2 pixels can it be correctly distinguished from the image. It can also be considered that ground resolution = 2*ground sampling interval. For example, the ground sampling interval of an image is 5cm, that is, the length of the ground represented by one pixel of the image is 5cm. However, only ground objects larger than the size of two pixels (i.e. 10cm) can be distinguished, so the ground length of the image The resolution is 10cm.

因為無人機的機動性高,且產製之影像較傳統衛星影像與航空攝影有更高之地面解析度(Ground Sampling Distance,GSD)(如表一所示),以低空高重疊飛行方式,再透過影像前處理進行航拍影像拼接與校正處理,獲得高解析度的正射影像及光譜影像。 Because UAVs are highly maneuverable and produce images with higher Ground Sampling Distance (GSD) than traditional satellite images and aerial photography (as shown in Table 1), they fly at low altitudes with high overlap, and then Aerial image stitching and correction are performed through image pre-processing to obtain high-resolution orthophotos and spectral images.

Figure 111114224-A0305-02-0010-4
Figure 111114224-A0305-02-0010-4

[飛行高度計算] [Flight altitude calculation]

飛行高度計算需要知道GSD(地面解析度)、相機(即影像擷取模組)焦距、相機感測器寬度(mm)與照片寬度(圖元);該地面站之運算處理模組根據幾何光學物像關係,分辨尺寸、照相距離(飛行高度)、焦距與感測器圖元數這四個引數構成一個相似三角形的幾何關係,如第5圖所示。其幾何關係轉換公式為:

Figure 111114224-A0305-02-0010-30
The calculation of flight altitude requires knowing the GSD (ground resolution), camera (i.e. image capture module) focal length, camera sensor width (mm) and photo width (pixel); the calculation processing module of the ground station is based on geometric optics The object-image relationship, the four parameters of resolution size, photographic distance (flying height), focal length and number of sensor elements form a geometric relationship of a similar triangle, as shown in Figure 5. Its geometric relationship conversion formula is:
Figure 111114224-A0305-02-0010-30

Figure 111114224-A0305-02-0010-6
Figure 111114224-A0305-02-0010-6

Lx=Sx×GSD (4) L x =S x ×GSD (4)

Ly=Sy×GSD (5) 其中,該GSD為地面解析度(M/pixel),該r為感測器尺寸(mm),該S為感測器圖元數(pixel),該a為像元大小(μm/pixel),該f為真實焦距(mm),該H為飛行高度(M),該L為拍攝之實際尺寸(M)。 L y =S y ×GSD (5) Where, the GSD is the ground resolution (M/pixel), the r is the sensor size (mm), the S is the number of sensor elements (pixels), and the a is the pixel size (μm/pixel), f is the real focal length (mm), H is the flying height (M), and L is the actual size of the shot (M).

[相片重叠度] [Photo overlap]

對於無人機航測遙測系統,航向方向重疊度一般為60%~80%,最小不低於53%;橫向重疊度一般為15%~60%,最小不低於8%。地面起伏會引起重疊度的變化。以地形低的地方為準則重疊度大,以地形高的地方為準則重疊度小,因此,檢查重疊度是否滿足要求時,應以重疊部分最高地形為準,否則,有可能產生航攝漏洞。相片重疊的大小以重疊度表示。重疊部分長度與拍攝之實際尺寸之比的百分數稱為重疊度,如第6圖所示。 For UAV aerial survey and telemetry systems, the directional overlap is generally 60% to 80%, with a minimum of not less than 53%; the lateral overlap is generally 15% to 60%, with a minimum of not less than 8%. Ground undulations will cause changes in overlap. The overlap degree will be large based on the low terrain area, and the overlap degree will be small based on the high terrain area. Therefore, when checking whether the overlap degree meets the requirements, the highest terrain in the overlapping part should be used as the criterion. Otherwise, aerial photography loopholes may occur. The size of photo overlap is expressed in terms of overlap. The percentage of the ratio of the length of the overlapping part to the actual size of the shot is called the degree of overlap, as shown in Figure 6.

Figure 111114224-A0305-02-0011-7
Figure 111114224-A0305-02-0011-8
其中該L為拍攝之實際尺寸(M),該q為重疊部分長度(M),該p為重疊長度(M)。
Figure 111114224-A0305-02-0011-7
Figure 111114224-A0305-02-0011-8
Among them, L is the actual size of the photo (M), q is the length of the overlapping part (M), and p is the overlapping length (M).

[計算飛機數量] [Calculate the number of aircraft]

因此該運算處理模組計算所需無人機的數量,如第7圖所示,當一個大小為Wx×Wy的拍攝場域需要航拍時,假設橫向為n台無人機,縱向為m台無人機,則換算無人機數量為N,其轉換公式為:Wx=n×Lx-(n-1)×qx (8) Therefore, the computing processing module calculates the number of drones required. As shown in Figure 7, when a shooting area with a size of W x × W y requires aerial photography, it is assumed that there are n drones in the horizontal direction and m drones in the vertical direction. UAVs, then the number of UAVs is converted to N, and the conversion formula is: W x =n×L x -(n-1)×q x (8)

Wy=m×Ly-(m-1)×qy (9)推得無人機數量為:

Figure 111114224-A0305-02-0011-9
W y =m×L y -(m-1)×q y (9) The number of UAVs is calculated as:
Figure 111114224-A0305-02-0011-9

[計算飛機任務位置] [Calculate aircraft mission position]

該運算處理模組計算每一無人機對應的任務位置,如第8圖所示,由無人機數量N可推導出各無人機編號

Figure 111114224-A0305-02-0012-11
,與各無人機任務位置Di,j公式為:wx=Lx-qx (11) The computing processing module calculates the mission position corresponding to each drone. As shown in Figure 8, the number of each drone can be derived from the number N of drones.
Figure 111114224-A0305-02-0012-11
, and the formula for each UAV mission position D i,j is: w x =L x -q x (11)

wy=Ly-qy (12) w y =L y -q y (12)

Figure 111114224-A0305-02-0012-13
其中(
Figure 111114224-A0305-02-0012-22
,
Figure 111114224-A0305-02-0012-24
,0)為拍攝場域所定義的預期面積的左下角座標。
Figure 111114224-A0305-02-0012-13
in(
Figure 111114224-A0305-02-0012-22
,
Figure 111114224-A0305-02-0012-24
,0) is the coordinate of the lower left corner of the expected area defined by the shooting field.

[航路與任務規劃與同步觸發攝影] [Route and mission planning and synchronized trigger photography]

該運算處理模組由航路與任務規劃,建構演算出完整路徑與設定同步拍攝觸發時間。透過程式將式(13)所得之無人機任務位置批次匯出路徑檔進行路徑轉檔,將Di,j之路徑檔轉換為經緯度高度座標以及同步拍攝觸發訊號。無人機經緯度高度座標以及同步拍攝觸發訊號數值封包設計如表二:

Figure 111114224-A0305-02-0012-14
其中
Figure 111114224-A0305-02-0012-15
The computing module uses route and mission planning to calculate the complete path and set the trigger time for synchronized shooting. Through the formula, the path files of the UAV mission positions obtained by equation (13) are exported in batches for path conversion, and the path files of D i,j are converted into longitude, latitude and height coordinates and synchronous shooting trigger signals. The design of the UAV’s longitude, latitude and altitude coordinates and the numerical packet design of the synchronous shooting trigger signal is as shown in Table 2:
Figure 111114224-A0305-02-0012-14
in
Figure 111114224-A0305-02-0012-15

經由前述之程式轉換完成包含通訊封包之飛行路徑檔案在該運算處理模組中執行模擬預覽路徑並檢視路徑交錯狀況,並進行安全隔離檢查與飛行速度檢測,當模擬正確無誤後將透過第二無線通訊模組傳送包含通訊封包之飛行命令給各無人機進行同步拍攝任務。 The flight path file containing the communication packet is converted through the aforementioned program. The simulation is performed in the processing module to preview the path and check the path interleaving status. Safety isolation check and flight speed detection are also performed. When the simulation is correct, it will be sent through the second wireless The communication module transmits flight commands containing communication packets to each drone for simultaneous shooting tasks.

藉此,本發明可大幅節省空照圖的拍攝成本,並可提供等同衛星空照圖之高正確度、高精密度的零時差巨幅空照圖。 Thereby, the present invention can significantly save the cost of photographing aerial images, and can provide a zero-time huge aerial image with high accuracy and precision equivalent to that of satellite aerial images.

綜上所述,本發明係一種架構於無人機群飛之零時差巨幅空照圖拍攝裝置,可有效改善習用之種種缺點,將以一台無人機設定在一定高度所拍 攝到的預期面積為主,設定要拍攝的場域面積範圍,由地面站先行運算出任務需要的無人機數量,並計算出任務位置與設計出機群中各台無人機的航路與任務規劃。待所有無人機飛行至指定的任務位置後,同步觸發拍攝任務與空照圖上傳,再透過後台影像拼接系統匯集空照圖後進行正射投影與拼接後處理,達到零時差的巨幅空照圖拍攝任務,進而使本發明之產生能更進步、更實用、更符合使用者之所須,確已符合發明專利申請之要件,爰依法提出專利申請。 To sum up, the present invention is a zero-time difference huge aerial photo shooting device based on a group of drones. It can effectively improve the shortcomings of conventional methods. It can take a photo taken by a drone set at a certain height. Based on the expected area to be photographed, the area of the field to be photographed is set. The ground station first calculates the number of drones required for the mission, calculates the mission location, and designs the route and mission planning of each drone in the fleet. . After all the drones fly to the designated mission positions, the shooting tasks and aerial images are uploaded simultaneously. The aerial images are then collected through the background image splicing system for orthographic projection and splicing post-processing to achieve a zero-time difference in huge aerial images. Picture shooting task, thereby making the invention more advanced, more practical, and more in line with the needs of users. It has indeed met the requirements for an invention patent application, and the patent application must be filed in accordance with the law.

惟以上所述者,僅為本發明之較佳實施例而已,當不能以此限定本發明實施之範圍;故,凡依本發明申請專利範圍及發明說明書內容所作之簡單的等效變化與修飾,皆應仍屬本發明專利涵蓋之範圍內。 However, the above are only preferred embodiments of the present invention, and should not be used to limit the scope of the present invention; therefore, any simple equivalent changes and modifications made based on the patent scope of the present invention and the content of the invention description , should still fall within the scope covered by the patent of this invention.

1:無人機 1: Drone

11:第一無線通訊模組 11:The first wireless communication module

12:定位模組 12: Positioning module

13:記憶模組 13:Memory module

14:影像擷取模組 14:Image capture module

15:飛行模組 15:Flight module

16:控制模組 16:Control module

2:地面站 2: Ground station

21:第二無線通訊模組 21:Second wireless communication module

22:資料庫模組 22:Database module

23:運算處理模組 23:Computational processing module

3:後台影像拼接系統 3:Backstage image stitching system

Claims (7)

一種架構於無人機群飛之零時差巨幅空照圖拍攝裝置,係包括:數個無人機,每一無人機定位在一拍攝場域上方一高度位置處,每一無人機的焦段係設定恰對應於該拍攝場域所定義的數個預期面積,每一無人機包括有一第一無線通訊模組,用以接收該無人機對應的一飛行命令,該飛行命令包含一任務位置及一航路與任務規劃;一定位模組,用以產生該無人機的即時動態定位(Real-Time Kinematic,RTK)訊號;一記憶模組,用以儲存該飛行命令;一影像擷取模組,用來擷取該拍攝場域的數個影像;一飛行模組,用來讓該無人機飛行與起降;及一控制模組,連接該第一無線通訊模組、該定位模組、該記憶模組、該影像擷取模組、與該飛行模組,用以依據該航路與任務規劃控制該飛行模組的飛行方向與/或速度,以使該無人機飛抵並定位於該任務位置後,觸發該影像擷取模組進行空照圖同步拍攝;一地面站,具有一第二無線通訊模組、一資料庫模組、及一連接該第二無線通訊模組與該資料庫模組之運算處理模組,該地面站與該數個無人機無線通訊,用以接收該拍攝場域的一設定參數,該設定參數包括該拍攝場域的高度、焦段、及該些預期面積,根據該設定參數計算出執行拍攝任務所需的該些無人機的數量、及執行拍攝任務的每一無人機對應的該任務位置,再根據接收的每一無人機之RTK訊號進行每一無人機的航路與任務規劃運算,並將包含該任務位置及該航路與任務規劃之該飛行命令傳輸至對應的該無人機,令每一無人機可依各自對應的該航路與任務規劃飛行至對應的該任務位置後,依據同步拍攝觸發訊號進行同步拍攝任務與空照圖上傳,其中:運算處理模組計算所需無人機的數量,係當一個大小為Wx×Wy的該拍攝場 域需要航拍時,假設橫向為n台無人機,縱向為m台無人機,則換算無人機數量為N,其轉換公式為:W x =n×L x -(n-1)×q x W y =m×L y -(m-1)×q y ;其中該L為拍攝之實際尺寸(M),該q為重疊部分長度(M),推得所需無人機數量為:
Figure 111114224-A0305-02-0015-16
該運算處理模組計算每一無人機對應的任務位置,由該無人機數量N可推導出各該無人機編號
Figure 111114224-A0305-02-0015-18
,與各該無人機任務位置Di,j公式為:w x =L x -q x w y =L y -q y
Figure 111114224-A0305-02-0015-19
其中(
Figure 111114224-A0305-02-0015-27
,
Figure 111114224-A0305-02-0015-28
,0)為該拍攝場域所定義的預期面積的左下角座標;該運算處理模組由航路與任務規劃,建構演算出完整路徑與設定同步拍攝觸發時間,將該無人機任務位置批次匯出路徑檔進行路徑轉檔,將該Di,j之路徑檔轉換為經緯度高度座標以及同步拍攝觸發訊號,且執行模擬預覽路徑並檢視路徑交錯狀況,並進行安全隔離檢查與飛行速度檢測,當模擬正確無誤後將透過第二無線通訊模組傳送包含通訊封包之飛行命令給各該無人機進行同步拍攝任務;以及一後台影像拼接系統,係通過該些第一無線通訊模組與該些無人機無線通訊,及通過該第二無線通訊模組與該地面站無線通訊,用以接收該些空照圖並進行建模,透過正射投影與拼接後處理,最終得到一零時差拼接空照圖,再將 該零時差拼接空照圖傳回該地面站並儲存至該資料庫模組中。
A zero-time huge aerial photo shooting device based on a group of drones, including: several drones, each drone is positioned at a height above a shooting field, and the focal length of each drone is set Correctly corresponding to several expected areas defined by the shooting area, each drone includes a first wireless communication module for receiving a flight command corresponding to the drone. The flight command includes a mission location and a route. and mission planning; a positioning module to generate the real-time dynamic positioning (Real-Time Kinematic, RTK) signal of the UAV; a memory module to store the flight command; an image capture module to Capture several images of the shooting area; a flight module used to allow the drone to fly, take off and land; and a control module connected to the first wireless communication module, the positioning module, and the memory module. The set, the image capture module, and the flight module are used to control the flight direction and/or speed of the flight module according to the route and mission plan, so that the UAV flies and is positioned at the mission location. , triggering the image capture module to perform synchronous shooting of aerial images; a ground station having a second wireless communication module, a database module, and a connection between the second wireless communication module and the database module The computing processing module, the ground station wirelessly communicates with the several drones to receive a setting parameter of the shooting area, the setting parameters include the height, focal length, and the expected areas of the shooting area, according to This setting parameter calculates the number of drones required to perform the shooting task and the task position corresponding to each drone performing the shooting task, and then performs the measurement of each drone based on the received RTK signal of each drone. Route and mission planning calculations, and transmit the flight command including the mission location and the route and mission plan to the corresponding drone, so that each drone can fly to the corresponding drone according to the respective route and mission plan. After the mission is located, the synchronous shooting task and aerial photos are uploaded according to the synchronous shooting trigger signal. Among them: the computing processing module calculates the number of drones required. This is when a shooting area with a size of W x × W y requires aerial photography. When , assuming that there are n drones in the horizontal direction and m drones in the longitudinal direction, the converted number of drones is N, and the conversion formula is: W x = n × L x -( n -1)× q x ; W y = m × L y -( m -1)× q y ; where L is the actual size of the shot (M), and q is the length of the overlapping part (M). The number of drones required is:
Figure 111114224-A0305-02-0015-16
The computing processing module calculates the mission position corresponding to each drone, and the number of each drone can be derived from the number N of the drones.
Figure 111114224-A0305-02-0015-18
, and the formula of each UAV mission position D i,j is: w x = L x - q x ; w y = L y - q y ;
Figure 111114224-A0305-02-0015-19
in(
Figure 111114224-A0305-02-0015-27
,
Figure 111114224-A0305-02-0015-28
, 0) The coordinates of the lower left corner of the expected area defined by the shooting area; the computing module uses route and mission planning to calculate the complete path and set the synchronous shooting trigger time, and batches the UAV mission locations. Exit the path file for path conversion, convert the path file of D i, j into longitude, latitude and height coordinates and synchronized shooting trigger signals, and execute a simulation preview path and check the path interleaving status, and perform safety isolation inspection and flight speed detection. After the simulation is correct, flight commands containing communication packets will be sent to each drone through the second wireless communication module to perform synchronized shooting tasks; and a background image stitching system will communicate with the drones through the first wireless communication modules. wireless communication, and wireless communication with the ground station through the second wireless communication module to receive the aerial photos and perform modeling. Through orthographic projection and splicing post-processing, a zero-day spliced aerial photo is finally obtained. image, and then transmit the zero-time difference spliced aerial image back to the ground station and store it in the database module.
依申請專利範圍第1項所述之架構於無人機群飛之零時差巨幅空照圖拍攝裝置,其中,該地面站係向一區域發送大量的無人機傳輸訊息,當該些無人機開啟時將自動搜尋附近的無人機,並自動建立無線星狀(mesh)網路,為該區域的該些無人機提供高速的無線網路通訊,可將每一無人機的狀況即時傳輸到該地面站,使該地面站可對每個無人機節點的數據容量進行有效的網路檢查,以進行該些無人機的任務佈置。 According to the structure described in item 1 of the patent application scope, a zero-time difference huge aerial photo shooting device for UAV group flight, in which the ground station sends a large number of UAV transmission messages to an area. When these UAVs are turned on It will automatically search for nearby drones and automatically establish a wireless star (mesh) network to provide high-speed wireless network communications for the drones in the area and transmit the status of each drone to the ground in real time. station, so that the ground station can conduct effective network inspection of the data capacity of each UAV node to arrange the missions of these UAVs. 依申請專利範圍第1項所述之架構於無人機群飛之零時差巨幅空照圖拍攝裝置,其中,該第一無線通訊模組及該第二無線通訊模組為一LoRa模組、一4G模組、一WiFi模組、一藍牙(Bluetooth)模組、或其組合。 According to the structure described in item 1 of the patent application scope, a zero-time difference huge aerial photo shooting device for UAV group flight, wherein the first wireless communication module and the second wireless communication module are a LoRa module, A 4G module, a WiFi module, a Bluetooth module, or a combination thereof. 依申請專利範圍第1項所述之架構於無人機群飛之零時差巨幅空照圖拍攝裝置,其中,該第二無線通訊模組與該第一無線通訊模組相互適配,使該地面站與各該無人機溝通連結,透過mesh無線通訊形式傳送該飛行命令給各該無人機內之控制模組,各該無人機接收到該飛行命令後加以解碼,取得該無人機對應任務位置之航路與任務規劃,並獲取該航路與任務規劃中的計時器時間,待以該計時器時間執行該無人機對時動作完成後,即可根據該航路與任務規劃進行該無人機的群飛拍攝任務,使得該數個無人機皆受到自我飛控機制,並可在通訊中斷時依然維持穩定飛行的自我拍攝完畢。 According to the structure described in item 1 of the patent application scope, a zero-time difference huge aerial photo shooting device for UAV group flight, wherein the second wireless communication module and the first wireless communication module are adapted to each other, so that the The ground station communicates with each drone and transmits the flight command to the control module in each drone through mesh wireless communication. Each drone receives the flight command and decodes it to obtain the corresponding mission position of the drone. Route and mission planning, and obtain the timer time in the route and mission plan. After the UAV timing action is completed using the timer time, the UAV can be flown in groups according to the route and mission plan. The shooting task is such that the drones are all subject to a self-flight control mechanism and can still maintain stable flight when communication is interrupted. 依申請專利範圍第1項所述之架構於無人機群飛之零時差巨幅空照圖拍攝裝置,其中,該運算處理模組計算飛行高度係根據幾何光學物像關係,分辨尺寸、照相距離(飛行高度)、焦距與該影像擷取模組的感測器圖元數這四個引數構成一個相似三角形的幾何關係,其幾何關係轉換公式為:
Figure 111114224-A0305-02-0016-20
Figure 111114224-A0305-02-0017-21
L x =S x ×GSDL y =S y ×GSD;其中,該GSD為地面解析度(M/pixel),該r為感測器尺寸(mm),該S為感測器圖元數(pixel),該a為像元大小(μm/pixel),該f為真實焦距(mm),該H為飛行高度(M),該L為拍攝之實際尺寸(M)。
Based on the architecture described in item 1 of the patent application, a zero-time difference huge aerial photo shooting device for UAV group flight, in which the calculation processing module calculates the flight height based on the geometric optical object-image relationship, distinguishes the size, and the shooting distance The four arguments (flight height), focal length and the number of sensor elements of the image capture module form a geometric relationship similar to a triangle. The geometric relationship conversion formula is:
Figure 111114224-A0305-02-0016-20
Figure 111114224-A0305-02-0017-21
L x = S x × GSD ; L y = S y × GSD ; where GSD is the ground resolution (M/pixel), r is the sensor size (mm), and S is the number of sensor primitives (pixel), a is the pixel size (μm/pixel), f is the real focal length (mm), H is the flying height (M), and L is the actual size of the shot (M).
依申請專利範圍第1項所述之架構於無人機群飛之零時差巨幅空照圖拍攝裝置,其中,該後台影像拼接系統為雲端伺服器。 According to the architecture described in item 1 of the patent application, a zero-time difference giant aerial photo shooting device for drone group flights is provided, in which the background image stitching system is a cloud server. 依申請專利範圍第1項所述之架構於無人機群飛之零時差巨幅空照圖拍攝裝置,其中,該地面站內建有一應用程式(APP),能透過該第二無線通訊模組獲取地面參考物體位置距離(焦段)與飛行高度資訊,即時分析規劃飛行航路與判別飛行狀態與記錄飛行航路。 According to the structure described in item 1 of the patent application, a zero-time difference huge aerial photo shooting device for UAV group flight, wherein the ground station has an application program (APP) built in it, which can use the second wireless communication module Obtain ground reference object position distance (focal length) and flight altitude information, instantly analyze and plan flight routes, determine flight status and record flight routes.
TW111114224A 2022-04-14 2022-04-14 A zero-time huge aerial photo shooting device based on drone swarm flight TWI819569B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW111114224A TWI819569B (en) 2022-04-14 2022-04-14 A zero-time huge aerial photo shooting device based on drone swarm flight

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW111114224A TWI819569B (en) 2022-04-14 2022-04-14 A zero-time huge aerial photo shooting device based on drone swarm flight

Publications (2)

Publication Number Publication Date
TW202340676A TW202340676A (en) 2023-10-16
TWI819569B true TWI819569B (en) 2023-10-21

Family

ID=89856035

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111114224A TWI819569B (en) 2022-04-14 2022-04-14 A zero-time huge aerial photo shooting device based on drone swarm flight

Country Status (1)

Country Link
TW (1) TWI819569B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8902308B2 (en) * 2010-08-25 2014-12-02 Lakeside Labs Gmbh Apparatus and method for generating an overview image of a plurality of images using a reference plane
US9075415B2 (en) * 2013-03-11 2015-07-07 Airphrame, Inc. Unmanned aerial vehicle and methods for controlling same
US10694155B2 (en) * 2015-06-25 2020-06-23 Intel Corporation Personal sensory drones
CN112837378A (en) * 2021-02-03 2021-05-25 江南大学 Aerial camera attitude external dynamic calibration and mapping method based on multi-unmanned aerial vehicle formation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8902308B2 (en) * 2010-08-25 2014-12-02 Lakeside Labs Gmbh Apparatus and method for generating an overview image of a plurality of images using a reference plane
US9075415B2 (en) * 2013-03-11 2015-07-07 Airphrame, Inc. Unmanned aerial vehicle and methods for controlling same
US10694155B2 (en) * 2015-06-25 2020-06-23 Intel Corporation Personal sensory drones
CN112837378A (en) * 2021-02-03 2021-05-25 江南大学 Aerial camera attitude external dynamic calibration and mapping method based on multi-unmanned aerial vehicle formation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
期刊 Markus Quaritsch, Karin Kruggly, Daniel Wischounig-Strucl, Subhabrata Bhattacharyaz, Mubarak Shahz, Bernhard Rinner Networked UAVs as Aerial Sensor Network for Disaster Management Applications Elektrotechnik & Informationstechnik 127 Springer March 2010 56~63 *

Also Published As

Publication number Publication date
TW202340676A (en) 2023-10-16

Similar Documents

Publication Publication Date Title
CN107504957B (en) Method for rapidly constructing three-dimensional terrain model by using unmanned aerial vehicle multi-view camera shooting
CN110537365B (en) Information processing device, information processing method, information processing program, image processing device, and image processing system
CN106647804B (en) A kind of automatic detecting method and system
KR101793509B1 (en) Remote observation method and system by calculating automatic route of unmanned aerial vehicle for monitoring crops
US20170336203A1 (en) Methods and systems for remote sensing with drones and mounted sensor devices
JP2016522768A (en) Distortion correction sensor for collecting tilt images diagonally
CN110716586A (en) Photographing control method and device for unmanned aerial vehicle, unmanned aerial vehicle and storage medium
CN104118561B (en) Method for monitoring large endangered wild animals based on unmanned aerial vehicle technology
CN107894780A (en) A kind of highly geographical mapping system of multi-rotor unmanned aerial vehicle
CN108832986A (en) A kind of multi-source data control platform based on Incorporate
US10602064B2 (en) Photographing method and photographing device of unmanned aerial vehicle, unmanned aerial vehicle, and ground control device
CN203204299U (en) Air 360-DEG panorama-photograph shooting apparatus
CN102706331B (en) Correction method for aerial surveying and mapping images
US20230359204A1 (en) Flight control method, video editing method, device, uav and storage medium
TWI819569B (en) A zero-time huge aerial photo shooting device based on drone swarm flight
KR102517970B1 (en) Method and device for controling drones for aerial photography
Reich et al. Filling the Holes: potential of UAV-based photogrammetric façade modelling
WO2020225979A1 (en) Information processing device, information processing method, program, and information processing system
CN113063401A (en) Unmanned aerial vehicle aerial survey system
Whitley Unmanned aerial vehicles (UAVs) for documenting and interpreting historical archaeological Sites: Part II—return of the drones
KR102212452B1 (en) Aerial Image Processing Method and System Thereof
KR20150006752A (en) Air observations using the rotor structure construction method and system for terrain data.
CN114155290B (en) System and method for large-field-of-view high-speed motion measurement
CN208238786U (en) UAV Intelligent aerial survey system
Kung et al. A large-scale aerial photo shooting system with no time difference based on drone swarm flight