WO2017020856A1 - Photographing device and method using drone to automatically track and photograph moving object - Google Patents

Photographing device and method using drone to automatically track and photograph moving object Download PDF

Info

Publication number
WO2017020856A1
WO2017020856A1 PCT/CN2016/093490 CN2016093490W WO2017020856A1 WO 2017020856 A1 WO2017020856 A1 WO 2017020856A1 CN 2016093490 W CN2016093490 W CN 2016093490W WO 2017020856 A1 WO2017020856 A1 WO 2017020856A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving object
drone
load
platform
flight platform
Prior art date
Application number
PCT/CN2016/093490
Other languages
French (fr)
Chinese (zh)
Inventor
黄立
刘华斌
王效杰
顾兴
Original Assignee
普宙飞行器科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 普宙飞行器科技(深圳)有限公司 filed Critical 普宙飞行器科技(深圳)有限公司
Publication of WO2017020856A1 publication Critical patent/WO2017020856A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the invention relates to a moving object automatic locking photographing device and a photographing method.
  • the traditional sports aerial photography technology or the professional shooting based on the stability of the gimbal there are difficulties in the details of the long motion process, and it is necessary to set a plurality of viewing angles in a designated place, and to select the best details in the later stage, and the shooting equipment is constructed and Control debugging is difficult and costly;
  • the emerging follow-up shooting technology based on the UAV flight platform has lower cost and can lock moving objects, but only the rear shooting angle can be set, more exciting details can not be captured, and there is no tracking based.
  • the region of interest of the algorithm is adjusted, and the specific parameters of the locked moving object, such as the shooting angle and the shooting distance, cannot be arbitrarily adjusted.
  • the utility model relates to an automatic locking shooting device for a moving object by using a drone, comprising a drone flight platform, a load stabilization device, a motion camera and a mobile control terminal, wherein:
  • the bottom of the UAV flight platform is fixed with a load stabilizer.
  • the motion camera is fixed on the load stabilizer.
  • the mobile control terminal is carried by the moving target.
  • the mobile control terminal obtains the real-time image of the motion camera from the UAV flight platform through the data link. State information, and according to the instruction of the moving object to automatically lock the feedback of the shooting algorithm, control the flight platform of the drone with the moving object;
  • the UAV flight platform has an automatic hovering and GPS navigation flight function, and the route is planned by GPS;
  • the load stabilizing device is used for stabilizing the motion camera load and feeding back the load attitude in real time; the load stabilizing device ensures that the motion camera load can filter out motion disturbances from outside the load, maintaining a fixed viewing angle without jitter.
  • the motion camera as an image acquisition source device, provides high-definition scene data that is of most interest to the user.
  • the load stabilizing device will stabilize the motion camera load to ensure that the motion camera can capture high quality HD images for moving objects;
  • the mobile control terminal acquires the real-time image and related state information of the motion camera from the UAV flight platform through the data link, and automatically controls the unmanned aerial vehicle flight platform to shoot with the moving object according to the instruction of the moving object automatically locking the shooting algorithm feedback. ;
  • the mobile control terminal is equipped with an automatic locking imaging algorithm for moving objects, real-time intelligent calculation based on image and status information, combined with image tracking and GPS trend following or prediction, and finally realizes that the moving camera load locks the moving object and simultaneously captures the most moving objects. Good angle image.
  • the UAV flight platform can perform GPS navigation flight, set multiple waypoints to fly in sequence, and automatically hover when idle.
  • the UAV flight platform has a data link, and transmits a real-time image and status information of the loaded camera load to the mobile control terminal of the data link, and receives from the mobile control terminal connected to the data link. Intelligent control information to track moving shots.
  • the load stabilizing device can stabilize the three dimensions of pitch, roll and azimuth for the mounted moving camera load.
  • the motion camera is optimized for shooting moving objects, and has faster exposure time and motion compensation under the premise of ensuring image quality, ensuring that the motion details of the object can be photographed.
  • the mobile control terminal can establish a data link based on WIFI or digital transmission on the unmanned aerial vehicle flight platform, thereby performing image and status information transmission and control signal uploading.
  • the mobile control terminal has a GPS positioning function and is carried or fixed by a moving object.
  • a photographing method for automatically locking a moving object by using a drone characterized in that the method comprises the following steps:
  • the mobile control terminal analyzes the data preprocessing, performs screening or serialization modeling, estimates the motion state of the target to be tracked, and establishes a cumulative tracking pipeline for target tracking processing;
  • the mobile control terminal comprehensive decision data processing based on the target motion estimation and tracking processing data, generates comprehensive decision data, and transmits it to the drone flight platform through the data link to control the load and the next movement of the drone.
  • UAV flight plan prediction compare the motion curve of the target with the motion curve of the drone, calculate the difference between the two running trajectories, and set the standard according to the trajectory of the UAV's motion trajectory to the target trajectory. Flight plan for man and machine;
  • Target position search and positioning In order to ensure that the target of interest has a good shooting effect, the target needs to be located at the center of the motion camera, so the target search positioning is performed;
  • Flight and load stability decision The flight joint prediction scheme and the load stability control scheme are integrated, and the decision of the trade-off is made, and the final joint control scheme is obtained.
  • the moving target of the present invention carries a mobile control terminal, and the mobile control terminal is carried by the moving object, can perform real-time GPS positioning, and can run a moving object automatic locking shooting algorithm;
  • the UAV flight platform of the present invention can transmit telemetry data including the motion posture of the UAV and the load stabilizing device to the mobile control terminal through the data link in real time, and real-time images of the moving object target captured by the motion camera;
  • the mobile control terminal of the invention is based on the attitude of the unmanned aerial vehicle and the load stabilizing device, the real-time image of the moving target, the real-time GPS positioning information of the moving object, the automatic target locking tracking algorithm of the moving object, and the control of the drone and the load stabilizing device.
  • the solution is sent to the drone and load stabilizer via the data link.
  • the following or predictive algorithm combines the GPS trajectory calculation tracking and prediction algorithm with the image tracking and prediction algorithm, which has better robustness.
  • the invention needs to be combined with the unmanned aerial vehicle flight platform, equipped with a load stabilizing device, a motion camera, and a mobile control terminal to complete the wonderful detail shooting for the moving object.
  • Figure 1 is a block diagram showing the overall assembly of the system of the present invention
  • FIG. 3 is a flow chart of an automatic locking shooting algorithm for a moving object according to the present invention.
  • the present invention includes: a drone flight platform 10, a load stabilizing device 20, a motion camera 30, and a mobile control terminal 40.
  • the motion camera 30 is fixed to the load stabilizing device 20, and the load stabilizing device 20 and the motion camera 30 is again carried on the UAV flight platform 10; the digital transmission device of the UAV flight platform 10 establishes a data link with the mobile control terminal 40.
  • the bottom of the UAV flight platform 10 is fixed with a load stabilizing device 20, the motion camera 30 is fixed on the load stabilizing device 20, the mobile control terminal 40 is carried by the moving target, and the mobile control terminal 40 is obtained from the UAV flight platform 10 via the data link.
  • the real-time image of the motion camera 30 and related state information, and according to the instruction of the moving object automatically locking the feedback of the shooting algorithm, controlling the drone flight platform to shoot with the moving object
  • a data link is established with the mobile control terminal 40 by the data transmission device of the drone flight platform 10.
  • the UAV flight platform 10 is composed of intelligent flight control, ESC, motor, propeller, frame, power lithium battery, and digital transmission device components, and is used for carrying a moving camera and a load stabilizing device for moving objects accompanying flight;
  • a load stabilizing device 20 is fixed to the bottom of the drone flight platform for stabilizing the motion camera 30 at a specified viewing angle
  • the motion camera 30 is used as an image acquisition source device for capturing wonderful details of moving objects
  • the mobile control terminal 40 acquires the real-time image and load status of the moving object through the data link to the UAV flight platform, and transmits the load and the control signal of the flight platform, and has a GPS positioning function, and is carried by the moving object for motion. GPS positioning of objects;
  • the mobile control terminal 40 is provided with an automatic locking imaging algorithm for moving objects, which is an algorithm application running on the mobile control terminal, which inputs real-time images, load states, etc. as auxiliary parameters for motion state analysis of moving objects, and outputs the flight platform of the unmanned aerial vehicle.
  • the flight control command ensures that the front of the moving object or the image of the user's interest is in the central area of the shooting result.
  • the device provided by the invention can realize moving object following or pre-shooting to obtain the best motion detail shooting effect.
  • a shooting method for automatically locking a shooting device using a no-face surface includes the following steps:
  • the data source comes from the real-time image and attitude data generated by the flight control, load stabilizer and motion camera from the front end of the drone, and is transmitted to the mobile control terminal through the data link, wherein the data source mainly includes none.
  • Man-machine attitude data pitch angle, yaw angle and roll angle
  • the camera's attitude data is obtained by the load stabilizer, the real-time image data obtained by the camera, and the UAV position coordinates and target position coordinates obtained by the GPS positioning system;
  • the mobile control terminal After receiving the data source collected in real time, the mobile control terminal enters the processing flow of the automatic locking imaging algorithm of the moving object.
  • the first step is data analysis preprocessing, which refines, detects and analyzes all the original data.
  • the real-time image data is processed to output the relative position of the target center and the image center in the image, and the output camera motion is up, down, left, and right.
  • Deflection control parameters processing the GPS sequence position of the drone and the GPS sequence position of the target, and outputting the direction and speed of movement of the drone and the target;
  • the mobile control terminal is carried by the moving object target, so that the moving object target also has the GPS positioning function; the real-time image of the moving object target, the complete attitude angle of the load, and the real-time GPS position of the drone through the data link
  • the downlink control arrives at the mobile control terminal.
  • the moving object automatic locking shooting algorithm APP will perform the motion state analysis of the load and the moving object target from the image feature and the motion curve according to the information, combined with the GPS position of the moving object;
  • the dimension of the feature called the target location tracking sub-algorithm, is selected while the moving target object is selected, and the impact template of the moving target is saved as an important reference data for real-time tracking calculation; the real-time image is continuously updated, and the moving target is utilized.
  • Influencing the template to match in real time detecting the target, so that the target is continuously positioned. If it is about to deviate from the field of view, it will calculate according to the complete attitude parameter of the motion camera. After calculating the deviation angle, upload the control command of the load stabilization device to ensure Load stabilizers can be adjusted and reversed Deviation angle off target. From the dimension of the motion curve, called the flight platform trajectory correction sub-algorithm, according to the sequence position of the UAV flight platform obtained by the GPS positioning system and the sequence position of the moving object target, the motion curves of the two can be calculated.
  • the adjustment command is issued to the UAV flight platform in real time to ensure that the UAV flight curve can maintain a stable distance to the moving object target as much as possible, as well as the flight curve of the same shape.
  • the target positioning tracking sub-algorithm is first used to continuously locate the target, and the moving camera offset angle is continuously adjusted by the load stabilization device to ensure that the target is at the center of the image. Then use the flight platform trajectory correction sub-algorithm to adjust the motion direction of the drone, so that the trajectory of the drone is consistent with the trajectory of the target, ensuring that the target does not deviate from the camera field of view, and adjust the speed of the drone. , to ensure that the target has a suitable proportion in the image.
  • the tangential direction of the current time point on the motion trajectory curve is used as the predicted value of the moving direction of the target next time, and the moving speed of the current target is calculated according to the target position information of the first two moments.
  • UAV flight plan prediction compare the motion curve of the target and the motion curve of the drone, and the direction of motion of the target and the next moment of the drone, calculate the difference between the running track and the moving direction of the drone, according to the drone
  • Target position search and positioning In order to ensure that the target of interest has a good shooting effect, the target needs to be located at the center of the motion camera, so the target search positioning is performed.
  • Flight and load stability decision-making The flight joint prediction scheme and the load stability control scheme are integrated, and the decision of the trade-off is made, and the final joint control scheme can be obtained.
  • the angular velocity, acceleration, and magnetic field of the current load stabilizing device are obtained by a three-axis gyro, a three-axis accelerometer, and a three-axis magnetic compass.
  • Flight and load stability decision The integrated flight prediction scheme and the load stability control scheme, through the trade-off decision, the final joint control scheme is obtained.
  • the motor is controlled to ensure the camera is stable.
  • the displacement in the X direction is adjusted by the left and right rotation of the camera
  • the displacement in the Y direction is adjusted by the up and down rotation of the camera
  • the UAV flight platform has a GPS navigation flight mode, which can sequentially set a plurality of waypoints to be flighted; can be controlled to hover at a specified altitude at any time; there is wireless data transmission Function, can be connected to the mobile control terminal to become a data link, The image is transmitted down and the state control information is bidirectionally transmitted; the load stabilizing device can be fixed and the motion camera is carried for stable shooting of the moving object object.
  • the load stabilizing device comprises a three-axis gyroscope, a three-axis accelerometer, and a three-axis magnetic compass to form a closed-loop feedback control system, which can be used to stabilize the motion camera to a specified viewing angle, Disturbed by external high frequency or small motion, such as the vibration of the drone or the wind blowing.
  • the load stabilizing device consists of three parts:
  • Three-axis gyro The angular velocity of the output load stabilizing device x, y, z.
  • Three-axis accelerometer The acceleration of the output load stabilizing device x, y, z.
  • Three-axis magnetic compass The magnetic field of the output load stabilizing device x, y, z.
  • the attitude parameters and positioning parameters of the load stabilizing device can be obtained through calculation, and when there is external interference, it can be adjusted in real time to achieve the purpose of stabilizing the motion camera.
  • the motion camera has a high-definition photo shooting or high-definition video recording function, and has a large-capacity SD card storage; and is optimized for shooting of moving objects, and is suitable for the field of sports aerial photography.
  • the mobile control terminal may be a mobile phone or a tablet, and an Android or IOS operating system is installed, and the mobile APP configured with a moving object automatic locking shooting algorithm may be executed, and has a GPS positioning function, which can be the same
  • the UAV flight platform establishes a data link, and the image data and motion camera status information can be transmitted from the data link to the mobile control terminal and finally to the algorithm APP.
  • the algorithm APP transmits the precise control information to none.
  • Man-machine flight platform, load stabilizer and motion camera. Moving objects will be bundled or carry mobile control terminals, which also have GPS positioning capabilities.
  • the moving object automatically locks the shooting algorithm, combines the motion object trajectory calculation and prediction based on the moving object GPS positioning, and runs a real-time image tracking locking algorithm to pull the object of interest into the motion camera. Central area for better sports shooting.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

The invention relates to a device using a drone to automatically track and photograph a moving object, comprising: a drone flight platform, a load stabilization device, a photographing apparatus, and a mobile terminal, wherein the photographing apparatus is fixed to the drone flight platform via the load stabilization device and is configured to take an image of a moving object, and the mobile terminal is disposed on the moving object and can acquire location information of the moving object. According to location information of the drone flight platform and the moving object, a flightpath of the drone flight platform and a relative location of the photographing apparatus with respect to the drone flight platform are adjusted. Moreover, an orientation of the photographing apparatus is adjusted according to the image taken by the photographing apparatus, thereby enabling the photographing apparatus to track the moving object. The invention further relates to a method using a drone to automatically track and photograph a moving object, drone and control terminal.

Description

一种利用无人机进行运动物体自动锁定拍摄装置及拍摄方法Automatic locking shooting device for moving object by using drone and shooting method 技术领域Technical field
本发明涉及一种运动物体自动锁定拍摄装置及拍摄方法。The invention relates to a moving object automatic locking photographing device and a photographing method.
背景技术Background technique
目前传统的运动航拍技术或基于云台稳定的专业拍摄,存在长运动过程的细节拍摄困难,需要在指定的场所内,且预先设定多个视角,后期筛选最佳细节,其拍摄设备搭建及控制调试困难,成本高昂;新兴的基于无人机飞行平台的跟随拍摄技术,成本较低,能锁定运动物体,但只能设置后部的拍摄角度,更精彩的细节无法捕捉,同时没有基于跟踪算法的感兴趣区域调整,也无法任意调整锁定运动物体的具体参数,如拍摄角度、拍摄距离等。At present, the traditional sports aerial photography technology or the professional shooting based on the stability of the gimbal, there are difficulties in the details of the long motion process, and it is necessary to set a plurality of viewing angles in a designated place, and to select the best details in the later stage, and the shooting equipment is constructed and Control debugging is difficult and costly; the emerging follow-up shooting technology based on the UAV flight platform has lower cost and can lock moving objects, but only the rear shooting angle can be set, more exciting details can not be captured, and there is no tracking based. The region of interest of the algorithm is adjusted, and the specific parameters of the locked moving object, such as the shooting angle and the shooting distance, cannot be arbitrarily adjusted.
发明内容Summary of the invention
鉴于此,本发明有必要提供一种成本合适、性能突出的运动利用无人机进行运动物体自动锁定拍摄装置及拍摄方法,In view of the above, it is necessary for the present invention to provide an automatic locking device and a shooting method for a moving object using a drone with a suitable cost and outstanding performance.
一种利用无人机进行运动物体自动锁定拍摄装置,包括无人机飞行平台、载荷稳定装置、运动相机、移动控制终端,其特征在于:The utility model relates to an automatic locking shooting device for a moving object by using a drone, comprising a drone flight platform, a load stabilization device, a motion camera and a mobile control terminal, wherein:
无人机飞行平台的底部固定载荷稳定装置,运动相机固定在载荷稳定装置上,移动控制终端由运动目标携带,移动控制终端通过数据链路从无人机飞行平台获取运动相机的实时图像和相关状态信息,并根据运动物体自动锁定拍摄算法反馈的指令,控制无人机飞行平台随着运动物体进行飞行拍摄;The bottom of the UAV flight platform is fixed with a load stabilizer. The motion camera is fixed on the load stabilizer. The mobile control terminal is carried by the moving target. The mobile control terminal obtains the real-time image of the motion camera from the UAV flight platform through the data link. State information, and according to the instruction of the moving object to automatically lock the feedback of the shooting algorithm, control the flight platform of the drone with the moving object;
所述的无人机飞行平台具有自动悬停和GPS导航飞行功能,通过GPS规划其航线; The UAV flight platform has an automatic hovering and GPS navigation flight function, and the route is planned by GPS;
所述载荷稳定装置,用于稳定运动相机载荷,并实时反馈载荷姿态;载荷稳定装置确保运动相机载荷能滤除来自载荷外部的运动干扰,保持固定的可视角度而不发生抖动。The load stabilizing device is used for stabilizing the motion camera load and feeding back the load attitude in real time; the load stabilizing device ensures that the motion camera load can filter out motion disturbances from outside the load, maintaining a fixed viewing angle without jitter.
所述运动相机,作为图像采集源设备,提供用户最感兴趣的高清景物数据。载荷稳定装置将针对运动相机载荷进行稳定动作,确保运动相机能针对运动物体拍摄出高质量的高清图像;The motion camera, as an image acquisition source device, provides high-definition scene data that is of most interest to the user. The load stabilizing device will stabilize the motion camera load to ensure that the motion camera can capture high quality HD images for moving objects;
移动控制终端,通过数据链路从无人机飞行平台获取运动相机的实时图像和相关状态信息,并根据运动物体自动锁定拍摄算法反馈的指令,控制无人机飞行平台随着运动物体进行飞行拍摄;The mobile control terminal acquires the real-time image and related state information of the motion camera from the UAV flight platform through the data link, and automatically controls the unmanned aerial vehicle flight platform to shoot with the moving object according to the instruction of the moving object automatically locking the shooting algorithm feedback. ;
移动控制终端内安装运动物体自动锁定拍摄算法,根据图像和状态信息进行实时智能计算,结合图像跟踪和GPS趋势跟随或预测,最终实现运动相机载荷锁定运动物体飞行,并同步拍摄到运动物体的最佳角度图像。The mobile control terminal is equipped with an automatic locking imaging algorithm for moving objects, real-time intelligent calculation based on image and status information, combined with image tracking and GPS trend following or prediction, and finally realizes that the moving camera load locks the moving object and simultaneously captures the most moving objects. Good angle image.
所述的无人机飞行平台,能进行GPS导航飞行,设定多个航点顺序飞行,空闲时自动悬停。The UAV flight platform can perform GPS navigation flight, set multiple waypoints to fly in sequence, and automatically hover when idle.
所述的无人机飞行平台具备数据链路,将所载的运动相机载荷的实时图像及状态信息,传送连接到数据链路的移动控制终端,并从连接到数据链路的移动控制终端接收到运动物体跟踪拍摄的智能控制信息。The UAV flight platform has a data link, and transmits a real-time image and status information of the loaded camera load to the mobile control terminal of the data link, and receives from the mobile control terminal connected to the data link. Intelligent control information to track moving shots.
所述的载荷稳定装置能针对挂载的运动相机载荷,进行俯仰、横滚和方位三个维度的稳定。The load stabilizing device can stabilize the three dimensions of pitch, roll and azimuth for the mounted moving camera load.
所述的运动相机,针对拍摄运动物体有进行优化,在保证图像质量的前提下有更快的曝光时间和运动补偿,确保能拍摄清楚物体的运动细节。The motion camera is optimized for shooting moving objects, and has faster exposure time and motion compensation under the premise of ensuring image quality, ensuring that the motion details of the object can be photographed.
所述的移动控制终端,能够的无人机飞行平台建立基于WIFI或数传的数据链路,从而进行图像及状态信息下传,控制信号上传。 The mobile control terminal can establish a data link based on WIFI or digital transmission on the unmanned aerial vehicle flight platform, thereby performing image and status information transmission and control signal uploading.
所述的移动控制终端具有GPS定位功能,被运动物体携带或固定。The mobile control terminal has a GPS positioning function and is carried or fixed by a moving object.
利用无人机进行运动物体自动锁定拍摄装置的拍摄方法,其特征在于包括以下步骤:A photographing method for automatically locking a moving object by using a drone, characterized in that the method comprises the following steps:
(1)移动控制终端实时数据采集,获得运动相机的实时图像、载荷及稳定装置的姿态状态数据,识别待跟踪目标的具体区域,获取无人机遥测状态数据;(1) Real-time data acquisition of the mobile control terminal, obtaining the real-time image, load and attitude state data of the motion camera, identifying the specific area of the target to be tracked, and acquiring the telemetry state data of the drone;
(2)移动控制终端分析数据预处理,进行筛选或序列化建模,估计待跟踪目标的运动状态,建立累计跟踪管道进行目标跟踪处理;(2) The mobile control terminal analyzes the data preprocessing, performs screening or serialization modeling, estimates the motion state of the target to be tracked, and establishes a cumulative tracking pipeline for target tracking processing;
所述的筛选或序列化建模具体步骤为:The specific steps of the screening or serialization modeling are as follows:
(a)提取无人机和载荷稳定装置的当前姿态数据;(a) extracting current attitude data of the drone and the load stabilizing device;
(b)建立无人机和载荷稳定装置的历史姿态数据管道;(b) Establishing historical attitude data pipelines for drones and load stabilizers;
(c)计算无人机和载荷稳定装置的运动轨迹曲线;(c) calculating the trajectory curve of the drone and the load stabilizing device;
(d)提取移动控制终端获得运动目标的当前定位位置数据;(d) extracting current positioning position data of the moving target obtained by the mobile control terminal;
(e)建立运动目标的历史定位位置数据管道;(e) Establish a historical location data pipeline for the moving target;
(f)计算运动目标的运动轨迹曲线。(f) Calculate the trajectory curve of the moving target.
(3)移动控制终端综合决策数据处理,根据目标运动估计及跟踪处理数据,产生综合决策数据,通过数据链路传输到无人机飞行平台,控制载荷和无人机的下一步运动。(3) The mobile control terminal comprehensive decision data processing, based on the target motion estimation and tracking processing data, generates comprehensive decision data, and transmits it to the drone flight platform through the data link to control the load and the next movement of the drone.
运动物体自动锁定拍摄算法具体运行步骤如下:The specific operation steps of the moving object automatic locking shooting algorithm are as follows:
(1)目标运动曲线平滑:根据目标的GPS轨迹,平滑目标的运动轨迹历史曲线,分析目标的运动特征;(1) Smoothing of the target motion curve: smoothing the trajectory history curve of the target according to the GPS trajectory of the target, and analyzing the motion characteristics of the target;
(2)无人机运动曲线平滑:根据无人机的GPS轨迹,平滑无人机的运动轨迹历史曲线,分析无人机的运动特征;(2) Smooth motion curve of the drone: According to the GPS trajectory of the drone, smooth the historical curve of the trajectory of the drone and analyze the motion characteristics of the drone;
(3)无人机飞行方案预测:对比目标的运动曲线和无人机的运动曲线,计算两者运行轨迹的差异,根据无人机的运动轨迹向目标的运动轨迹调整的标准,设定无人机的飞行方案; (3) UAV flight plan prediction: compare the motion curve of the target with the motion curve of the drone, calculate the difference between the two running trajectories, and set the standard according to the trajectory of the UAV's motion trajectory to the target trajectory. Flight plan for man and machine;
(4)目标位置搜索定位:为了确保关注的目标有良好的拍摄效果,需要使目标位于运动相机拍摄的正中心,因此进行目标搜索定位;(4) Target position search and positioning: In order to ensure that the target of interest has a good shooting effect, the target needs to be located at the center of the motion camera, so the target search positioning is performed;
(5)载荷姿态稳定分析:在实时图像中搜索到运动的感兴趣目标后,需要设定载荷稳定装置的控制方案;(5) Load attitude stability analysis: After searching for the moving target of interest in the real-time image, it is necessary to set the control scheme of the load stabilizer;
(6)飞行及载荷稳定决策:飞行预测方案和载荷稳定控制方案综合,及取舍决策,就得到最终的联合控制方案。(6) Flight and load stability decision: The flight joint prediction scheme and the load stability control scheme are integrated, and the decision of the trade-off is made, and the final joint control scheme is obtained.
本发明的运动目标携带移动控制终端,移动控制终端被运动物体携带一起运动,能进行实时GPS定位,且能运行运动物体自动锁定拍摄算法;The moving target of the present invention carries a mobile control terminal, and the mobile control terminal is carried by the moving object, can perform real-time GPS positioning, and can run a moving object automatic locking shooting algorithm;
本发明的无人机飞行平台能够实时的通过数据链路向移动控制终端传递包含无人机和载荷稳定装置运动姿态的遥测数据,以及使用运动相机所拍摄的运动物体目标的实时图像;The UAV flight platform of the present invention can transmit telemetry data including the motion posture of the UAV and the load stabilizing device to the mobile control terminal through the data link in real time, and real-time images of the moving object target captured by the motion camera;
本发明的移动控制终端根据无人机和载荷稳定装置姿态,运动目标的实时图像,运动目标的实时GPS定位信息,运动物体自动锁定拍摄算法自动决策目标跟踪和无人机及载荷稳定装置的控制方案,并通过数据链路发送到无人机及载荷稳定装置。The mobile control terminal of the invention is based on the attitude of the unmanned aerial vehicle and the load stabilizing device, the real-time image of the moving target, the real-time GPS positioning information of the moving object, the automatic target locking tracking algorithm of the moving object, and the control of the drone and the load stabilizing device. The solution is sent to the drone and load stabilizer via the data link.
本发明具有如下优点:The invention has the following advantages:
(1)选定运动物体目标后,可以自动跟随目标进行拍摄;或者预测物体的运动趋势,进行前驱拍摄。(1) After selecting the target of the moving object, you can automatically follow the target to shoot; or predict the movement trend of the object and perform pre-shooting.
(2)可以选择运动物体的最佳拍摄角度,例如尾随、侧向或迎头,区别于市面常见的跟随拍摄。(2) You can choose the best shooting angle of the moving object, such as trailing, sideways or head-on, which is different from the common follow-up shooting in the market.
(3)整套系统成本配置低廉,远低于传统的航拍装置,但却能得到同等甚至更佳的运动细节效果。(3) The cost of the whole system is low, far lower than the traditional aerial equipment, but it can get equal or even better motion details.
(4)具备图像跟踪功能,能实时把最感兴趣的目标细节设置到拍摄屏幕的中央区域,保证拍摄效果。(4) With image tracking function, it can set the most interesting target details to the central area of the shooting screen in real time to ensure the shooting effect.
(5)跟随或预测的算法结合了GPS轨迹计算跟踪及预测算法和图像跟踪及预测算法,具有更好的鲁棒性。 (5) The following or predictive algorithm combines the GPS trajectory calculation tracking and prediction algorithm with the image tracking and prediction algorithm, which has better robustness.
本发明需结合无人机飞行平台,搭载载荷稳定装置、运动相机,配合移动控制终端,完成针对运动物体的精彩细节拍摄。The invention needs to be combined with the unmanned aerial vehicle flight platform, equipped with a load stabilizing device, a motion camera, and a mobile control terminal to complete the wonderful detail shooting for the moving object.
附图说明DRAWINGS
图1为本发明的系统总体组件组成图;Figure 1 is a block diagram showing the overall assembly of the system of the present invention;
图2为本发明的具体实施的内部数据运行流程图;2 is a flow chart of internal data operation of a specific implementation of the present invention;
图3为本发明的运动物体自动锁定拍摄算法流程图。3 is a flow chart of an automatic locking shooting algorithm for a moving object according to the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图内部数据运行流程图,对本发明实施例中的技术方案进行清楚完整的描述,显然,所面熟的实施例仅仅是本发明的一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the flowchart of the internal data in the embodiments of the present invention. It is obvious that the embodiments are only a part of the embodiments of the present invention, and not all of them. An embodiment. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
如图1所示,本发明包括:无人机飞行平台10、载荷稳定装置20、运动相机30、移动控制终端40,运动相机30固定在载荷稳定装置20上,而载荷稳定装置20和运动相机30又一起承载在无人机飞行平台10上;过无人机飞行平台10的数传装置,同移动控制终端40建立了数据链路。无人机飞行平台10的底部固定载荷稳定装置20,运动相机30固定在载荷稳定装置20上,移动控制终端40由运动目标携带,移动控制终端40通过数据链路从无人机飞行平台10获取运动相机30的实时图像和相关状态信息,并根据运动物体自动锁定拍摄算法反馈的指令,控制无人机飞行平台随着运动物体进行飞行拍摄As shown in FIG. 1, the present invention includes: a drone flight platform 10, a load stabilizing device 20, a motion camera 30, and a mobile control terminal 40. The motion camera 30 is fixed to the load stabilizing device 20, and the load stabilizing device 20 and the motion camera 30 is again carried on the UAV flight platform 10; the digital transmission device of the UAV flight platform 10 establishes a data link with the mobile control terminal 40. The bottom of the UAV flight platform 10 is fixed with a load stabilizing device 20, the motion camera 30 is fixed on the load stabilizing device 20, the mobile control terminal 40 is carried by the moving target, and the mobile control terminal 40 is obtained from the UAV flight platform 10 via the data link. The real-time image of the motion camera 30 and related state information, and according to the instruction of the moving object automatically locking the feedback of the shooting algorithm, controlling the drone flight platform to shoot with the moving object
通过无人机飞行平台10的数传装置,同移动控制终端40建立了数据链路。A data link is established with the mobile control terminal 40 by the data transmission device of the drone flight platform 10.
无人机飞行平台10由智能飞控、电调、电机、螺旋桨、机架、动力锂电池、数传装置部件组成,用于携带运动相机和载荷稳定装置进行运动物体伴随飞行; The UAV flight platform 10 is composed of intelligent flight control, ESC, motor, propeller, frame, power lithium battery, and digital transmission device components, and is used for carrying a moving camera and a load stabilizing device for moving objects accompanying flight;
载荷稳定装置20固定在无人机飞行平台底部,用于稳定运动相机30在指定的可视角度上;A load stabilizing device 20 is fixed to the bottom of the drone flight platform for stabilizing the motion camera 30 at a specified viewing angle;
运动相机30作为图像采集源设备,用来拍摄运动物体的精彩细节;The motion camera 30 is used as an image acquisition source device for capturing wonderful details of moving objects;
移动控制终端40通过到无人机飞行平台的数据链路,获取运动物体的实时图像和载荷状态,并传递出载荷及飞行平台的控制信号,同时其具有GPS定位功能,被运动物体承载进行运动物体GPS定位;The mobile control terminal 40 acquires the real-time image and load status of the moving object through the data link to the UAV flight platform, and transmits the load and the control signal of the flight platform, and has a GPS positioning function, and is carried by the moving object for motion. GPS positioning of objects;
移动控制终端40内安装运动物体自动锁定拍摄算法,是运行于移动控制终端上的算法应用程序,它输入实时图像、载荷状态等作为运动物体运动状态分析的辅助参数,输出无人机飞行平台的飞行控制指令,确保运动物体的正面或用户感兴趣影像在拍摄结果的中央区域。The mobile control terminal 40 is provided with an automatic locking imaging algorithm for moving objects, which is an algorithm application running on the mobile control terminal, which inputs real-time images, load states, etc. as auxiliary parameters for motion state analysis of moving objects, and outputs the flight platform of the unmanned aerial vehicle. The flight control command ensures that the front of the moving object or the image of the user's interest is in the central area of the shooting result.
本发明提供的装置能实现运动物体跟随或前驱拍摄,获得最佳运动细节拍摄效果。The device provided by the invention can realize moving object following or pre-shooting to obtain the best motion detail shooting effect.
如图2、图3所示,一种利用无人面进行运动物体自动锁定拍摄装置的拍摄方法,包括以下步骤:As shown in FIG. 2 and FIG. 3, a shooting method for automatically locking a shooting device using a no-face surface includes the following steps:
(1)数据源生成,数据源来自于无人机前端从飞控、载荷稳定装置和运动相机产生的实时图像和姿态数据,通过数据链路传输来到移动控制终端,其中数据源主要包括无人机的姿态数据:俯仰角,偏航角和滚转角,通过载荷稳定装置得到相机的姿态数据,通过相机得到的实时图像数据,以及GPS定位系统得到的无人机位置坐标和目标位置坐标;(1) Data source generation, the data source comes from the real-time image and attitude data generated by the flight control, load stabilizer and motion camera from the front end of the drone, and is transmitted to the mobile control terminal through the data link, wherein the data source mainly includes none. Man-machine attitude data: pitch angle, yaw angle and roll angle, the camera's attitude data is obtained by the load stabilizer, the real-time image data obtained by the camera, and the UAV position coordinates and target position coordinates obtained by the GPS positioning system;
(2)移动控制终端接收实时采集的数据源之后,就进入运动物体自动锁定拍摄算法的处理流程,第一步是数据分析预处理,该预处理将所有原始数据进行提炼、检测和分析,对实时图像数据进行处理,输出图像中目标中心与图像中心的相对位置,输出相机运动上下左右 偏转的控制参数;对无人机的GPS序列位置和目标的GPS序列位置进行处理,输出无人机和目标的运动方向和速度;(2) After receiving the data source collected in real time, the mobile control terminal enters the processing flow of the automatic locking imaging algorithm of the moving object. The first step is data analysis preprocessing, which refines, detects and analyzes all the original data. The real-time image data is processed to output the relative position of the target center and the image center in the image, and the output camera motion is up, down, left, and right. Deflection control parameters; processing the GPS sequence position of the drone and the GPS sequence position of the target, and outputting the direction and speed of movement of the drone and the target;
(3)运动物体自动锁定拍摄算法的第二步,将结合锁定的目标限制条件,根据(2)中得到的目标的运动速度和方向、相机上下左右偏转的控制参数,并且根据不同拍摄要求如前驱迎拍、跟随后拍、侧面并拍,进行姿态稳定分析和无人机飞行方案预测,实现上述功能;(3) The second step of the automatic locking imaging algorithm of the moving object, combined with the locked target limit condition, according to the moving speed and direction of the target obtained in (2), the control parameters of the camera up and down and left and right deflection, and according to different shooting requirements The predecessor pats the camera, follows the post, and shoots sideways to perform attitude stability analysis and UAV flight plan prediction to achieve the above functions;
(4)根据分析后的图像和状态信息进行实时智能计算,结合姿态分析结果和飞行方案预测结果,进行最终的飞行及载荷稳定决策,给出最终的无人机及载荷控制方案;(4) Perform real-time intelligent calculation based on the analyzed image and state information, combine the attitude analysis result and the flight plan prediction result, and make the final flight and load stability decision, and give the final drone and load control scheme;
(5)决策后的无人机及载荷控制方案通过数据链路传输到无人机飞行平台10和载荷稳定装置20,两者分别接受决策后的无人机姿态控制分案和载荷控制方案。运动物体自动锁定拍摄算法运行的详细过程描述如下:(5) The unmanned aerial vehicle and load control scheme after the decision is transmitted to the unmanned aerial vehicle flight platform 10 and the load stabilizing device 20 through the data link, and the two receive the decision-making sub-frame and the load control scheme of the drone. The detailed process of the moving object automatic locking shooting algorithm is described as follows:
本发明中,移动控制终端均由运动物体目标携带,这样使得运动物体目标同样具备了GPS定位功能;运动物体目标的实时图像,载荷的完整姿态角,无人机的实时GPS位置通过数据链路下传到达了移动控制终端,此时运动物体自动锁定拍摄算法APP将根据这些信息,结合自身的GPS位置,从图像特征和运动曲线两个维度进行载荷和运动物体目标的运动状态分析;从图像特征的维度,称为目标定位跟踪子算法,在运动目标物体被选定的同时,运动目标的影响模板就会被保存,作为实时跟踪计算的重要参考数据;实时图像不断更新,利用运动目标的影响模板进行实时匹配,检测出目标,这样目标就不断被定位,如果即将偏离视场,就会根据运动相机的完整姿态参数进行计算,计算出偏离角度后,上传载荷稳定装置的控制指令,确保载荷稳定装置能调整和反向补偿掉目标的偏离角度。从运动曲线的维度,称为飞行平台轨迹校正子算法,根据GPS定位系统得到的无人机飞行平台的序列位置和运动物体目标的序列位置,可以计算出两者的运动曲线, 实时向无人机飞行平台发出调整指令,确保无人机飞行的曲线尽量能向运动物体目标保持稳定的距离,还有同样形状的飞行曲线。这样,首先利用目标定位跟踪子算法,不断定位目标,并且通过载荷稳定装置不断调整运动相机偏移角度,保证目标处于图像中心。之后利用飞行平台轨迹校正子算法,调整无人机的运动方向,使得无人机的运动轨迹与目标的运动轨迹保持一致,保证目标不会偏离出相机视场,同时调整无人机的运动速度,保证目标在图像中有合适的比例。结合上述目标定位跟踪子算法和飞行平台轨迹校正子算法,就利用无人机实现了运动物体自动锁定拍摄的过程。运动物体自动锁定拍摄算法运行流程图详见附图3,具体运行步骤如下:In the present invention, the mobile control terminal is carried by the moving object target, so that the moving object target also has the GPS positioning function; the real-time image of the moving object target, the complete attitude angle of the load, and the real-time GPS position of the drone through the data link The downlink control arrives at the mobile control terminal. At this time, the moving object automatic locking shooting algorithm APP will perform the motion state analysis of the load and the moving object target from the image feature and the motion curve according to the information, combined with the GPS position of the moving object; The dimension of the feature, called the target location tracking sub-algorithm, is selected while the moving target object is selected, and the impact template of the moving target is saved as an important reference data for real-time tracking calculation; the real-time image is continuously updated, and the moving target is utilized. Influencing the template to match in real time, detecting the target, so that the target is continuously positioned. If it is about to deviate from the field of view, it will calculate according to the complete attitude parameter of the motion camera. After calculating the deviation angle, upload the control command of the load stabilization device to ensure Load stabilizers can be adjusted and reversed Deviation angle off target. From the dimension of the motion curve, called the flight platform trajectory correction sub-algorithm, according to the sequence position of the UAV flight platform obtained by the GPS positioning system and the sequence position of the moving object target, the motion curves of the two can be calculated. The adjustment command is issued to the UAV flight platform in real time to ensure that the UAV flight curve can maintain a stable distance to the moving object target as much as possible, as well as the flight curve of the same shape. In this way, the target positioning tracking sub-algorithm is first used to continuously locate the target, and the moving camera offset angle is continuously adjusted by the load stabilization device to ensure that the target is at the center of the image. Then use the flight platform trajectory correction sub-algorithm to adjust the motion direction of the drone, so that the trajectory of the drone is consistent with the trajectory of the target, ensuring that the target does not deviate from the camera field of view, and adjust the speed of the drone. , to ensure that the target has a suitable proportion in the image. Combined with the above-mentioned target positioning tracking sub-algorithm and flight platform trajectory correction sub-algorithm, the process of automatic locking shooting of moving objects is realized by using the drone. The flow chart of the moving object automatic locking shooting algorithm is shown in Figure 3, and the specific operation steps are as follows:
(1)目标运动曲线平滑:根据目标的GPS轨迹,平滑目标的运动轨迹历史曲线,分析目标的运动特征。(1) Smoothing of the target motion curve: According to the GPS trajectory of the target, the trajectory history curve of the target is smoothed, and the motion characteristics of the target are analyzed.
以运动轨迹曲线上当前时刻点的切线方向作为目标下一时刻运动方向的预测值,依据前两个时刻的目标位置信息计算当前目标的运动速度。The tangential direction of the current time point on the motion trajectory curve is used as the predicted value of the moving direction of the target next time, and the moving speed of the current target is calculated according to the target position information of the first two moments.
(2)无人机运动曲线平滑:根据无人机的GPS轨迹,平滑无人机的运动轨迹历史曲线,分析无人机的运动特征,同样以运动轨迹曲线上当前时刻点的切线方向作为无人机下一时刻运动方向的预测值,依据前两个时刻的无人机位置信息计算无人机的运动速度。(2) Smooth motion curve of the drone: According to the GPS trajectory of the drone, smooth the historical curve of the trajectory of the drone, analyze the motion characteristics of the drone, and also use the tangential direction of the current time point on the motion trajectory curve as The predicted value of the movement direction of the man-machine at the next moment is calculated according to the position information of the drone at the first two moments.
(3)无人机飞行方案预测:对比目标的运动曲线和无人机的运动曲线,以及目标和无人机下一刻的运动方向,计算两者运行轨迹和运动方向的差异,根据无人机的运动轨迹向目标的运动轨迹调整的标准,以及不同拍摄要求,设定无人机的飞行方案。如进行前驱迎拍时,得到目标的运动方向后以及运动速度后,调整无人机的运动方向以及运动速度,使无人机提前到达目标运动位置,实现前驱拍摄功能。(3) UAV flight plan prediction: compare the motion curve of the target and the motion curve of the drone, and the direction of motion of the target and the next moment of the drone, calculate the difference between the running track and the moving direction of the drone, according to the drone The trajectory of the trajectory to the target's trajectory adjustment criteria, as well as different shooting requirements, set the drone's flight plan. For example, when the front drive is taken, after the target moving direction and the moving speed are obtained, the moving direction and the moving speed of the drone are adjusted, so that the drone reaches the target moving position in advance, and the front shooting function is realized.
(4)目标位置搜索定位:为了确保关注的目标有良好的拍摄效果,需要使目标位于运动相机拍摄的正中心,因此进行目标搜索定位。 (4) Target position search and positioning: In order to ensure that the target of interest has a good shooting effect, the target needs to be located at the center of the motion camera, so the target search positioning is performed.
(5)载荷姿态稳定分析:在实时图像中搜索到运动的感兴趣目标后,需要设定载荷稳定装置的控制方案。(5) Load attitude stability analysis: After searching for the moving target of interest in the real-time image, it is necessary to set the control scheme of the load stabilizer.
(6)飞行及载荷稳定决策:飞行预测方案和载荷稳定控制方案综合,及取舍决策,就可以得到最终的联合控制方案。(6) Flight and load stability decision-making: The flight joint prediction scheme and the load stability control scheme are integrated, and the decision of the trade-off is made, and the final joint control scheme can be obtained.
(7)载荷姿态稳定分析:在实时图像中搜索到运动的感兴趣目标后,需要设定载荷稳定装置的控制方案。具体实施方案如下:(7) Load attitude stability analysis: After searching for the moving target of interest in the real-time image, it is necessary to set the control scheme of the load stabilizer. The specific implementation scheme is as follows:
(a)通过三轴陀螺、三轴加速度计、三轴磁罗盘得到当前载荷稳定装置的角速度、加速度,磁场。(a) The angular velocity, acceleration, and magnetic field of the current load stabilizing device are obtained by a three-axis gyro, a three-axis accelerometer, and a three-axis magnetic compass.
(b)通过变换公式计算得到载荷稳定装置在x,y,z方向的偏移。(b) The offset of the load stabilizing device in the x, y, z direction is calculated by the transformation formula.
(c)根据当前得到的感兴趣目标中心位置,计算该中心与图像中心的相对位移。(c) Calculate the relative displacement of the center from the center of the image based on the currently obtained target center position of interest.
(8)飞行及载荷稳定决策:综合飞行预测方案和载荷稳定控制方案,通过取舍决策,得到最终的联合控制方案。(8) Flight and load stability decision: The integrated flight prediction scheme and the load stability control scheme, through the trade-off decision, the final joint control scheme is obtained.
(a)根据无人机飞行预测方案调整无人机的运动方向,控制无人机的运动速度(a) Adjust the direction of motion of the drone according to the flight prediction plan of the drone, and control the speed of the drone
(b)根据载荷姿态稳定分析,得到载荷稳定装置的控制方案。(b) According to the load attitude stability analysis, the control scheme of the load stabilizer is obtained.
1.根据计算得到的载荷稳定装置在x,y,z方向上的偏移,控制电机进行校正,保证相机稳定。1. According to the calculated offset of the load stabilizer in the x, y, z direction, the motor is controlled to ensure the camera is stable.
2.根据计算得到的目标中心的相对位移,控制相机的运动,保证图像处于目标中心2. According to the calculated relative displacement of the target center, control the movement of the camera to ensure that the image is in the target center
X方向上的位移,通过相机的左右转动进行调节The displacement in the X direction is adjusted by the left and right rotation of the camera
Y方向上的位移,通过相机的上下转动进行调节The displacement in the Y direction is adjusted by the up and down rotation of the camera
在其中的一个实施例中,所述无人机飞行平台具有GPS导航飞行模式,可顺序设定即将要飞行的多个航点;可以随时受控稳定的悬停在指定高度;有无线数传功能,能与移动控制终端连接成为数据链路, 进行图像的下传和状态控制信息的双向传输;可以固定载荷稳定装置,并承载运动相机,用于稳定的拍摄运动物体目标。In one embodiment, the UAV flight platform has a GPS navigation flight mode, which can sequentially set a plurality of waypoints to be flighted; can be controlled to hover at a specified altitude at any time; there is wireless data transmission Function, can be connected to the mobile control terminal to become a data link, The image is transmitted down and the state control information is bidirectionally transmitted; the load stabilizing device can be fixed and the motion camera is carried for stable shooting of the moving object object.
在其中的一个实施例中,所述的载荷稳定装置,包括三轴陀螺、三轴加速度计、三轴磁罗盘,形成闭环反馈控制系统,可以用于稳定运动相机到指定的可视角度,不受外界的高频或小幅运动干扰,例如无人机的震动或风吹倾斜。In one of the embodiments, the load stabilizing device comprises a three-axis gyroscope, a three-axis accelerometer, and a three-axis magnetic compass to form a closed-loop feedback control system, which can be used to stabilize the motion camera to a specified viewing angle, Disturbed by external high frequency or small motion, such as the vibration of the drone or the wind blowing.
其中载荷稳定装置由三部分组成:The load stabilizing device consists of three parts:
(1)三轴陀螺:输出载荷稳定装置x,y,z三个方向的角速度。(1) Three-axis gyro: The angular velocity of the output load stabilizing device x, y, z.
(2)三轴加速度计:输出载荷稳定装置x,y,z三个方向的加速度。(2) Three-axis accelerometer: The acceleration of the output load stabilizing device x, y, z.
(3)三轴磁罗盘:输出载荷稳定装置x,y,z三个方向的磁场。(3) Three-axis magnetic compass: The magnetic field of the output load stabilizing device x, y, z.
根据三部分输出的数据,经过计算可以得到载荷稳定装置的姿态参数和定位参数,当有外界干扰时,可以实时调节,达到稳定运动相机的目的。According to the data of the three parts of the output, the attitude parameters and positioning parameters of the load stabilizing device can be obtained through calculation, and when there is external interference, it can be adjusted in real time to achieve the purpose of stabilizing the motion camera.
在其中的一个实施例中,所述的运动相机,具有高清照片拍摄或高清录像记录功能,具备大容量SD卡存储;有针对运动物体拍摄的进行优化处理,适用于运动航拍领域。In one of the embodiments, the motion camera has a high-definition photo shooting or high-definition video recording function, and has a large-capacity SD card storage; and is optimized for shooting of moving objects, and is suitable for the field of sports aerial photography.
在其中的一个实施例中,所述的移动控制终端,可以是手机或平板,安装了Android或IOS操作系统,可以运行配置了运动物体自动锁定拍摄算法的移动APP,具有GPS定位功能,可以同无人机飞行平台建立数据链路,图像数据和运动相机状态信息可以从数据链路下传到移动控制终端,并最终传递到该算法APP,算法APP经过智能计算之后将精确控制信息传递到无人机飞行平台、载荷稳定装置和运动相机。运动物体将捆绑或携带移动控制终端,从而也具备GPS定位功能。In one embodiment, the mobile control terminal may be a mobile phone or a tablet, and an Android or IOS operating system is installed, and the mobile APP configured with a moving object automatic locking shooting algorithm may be executed, and has a GPS positioning function, which can be the same The UAV flight platform establishes a data link, and the image data and motion camera status information can be transmitted from the data link to the mobile control terminal and finally to the algorithm APP. After the intelligent calculation, the algorithm APP transmits the precise control information to none. Man-machine flight platform, load stabilizer and motion camera. Moving objects will be bundled or carry mobile control terminals, which also have GPS positioning capabilities.
在其中的一个实施例中,所述的运动物体自动锁定拍摄算法,结合了基于运动物体GPS定位的运动物体轨迹计算和预测,并运行实时图像跟踪锁定算法,把感兴趣物体拉入到运动相机中央区域,以获得更理想的运动拍摄效果。 In one of the embodiments, the moving object automatically locks the shooting algorithm, combines the motion object trajectory calculation and prediction based on the moving object GPS positioning, and runs a real-time image tracking locking algorithm to pull the object of interest into the motion camera. Central area for better sports shooting.

Claims (15)

  1. 一种利用无人机进行运动物体自动锁定拍摄的装置,包括无人机飞行平台、载荷稳定装置、摄像设备、移动终端,其特征在于:The utility model relates to a device for automatically locking and shooting a moving object by using a drone, comprising a drone flight platform, a load stabilization device, an imaging device and a mobile terminal, wherein:
    所述摄像设备通过所述载荷稳定装置固定于所述无人机飞行平台,用于对所述运动物体进行拍摄,所述载荷稳定装置能够滤除来自所述载荷稳定装置外部的对摄像设备的运动干扰,并使所述摄像设备指向所述运动物体;The image capturing apparatus is fixed to the UAV flight platform by the load stabilizing device for photographing the moving object, and the load stabilizing device is capable of filtering out an image capturing device from outside the load stabilizing device Motion interference and directing the imaging device to the moving object;
    所述移动终端设置在所述运动物体上,并能够获取所述运动物体的位置信息;The mobile terminal is disposed on the moving object and is capable of acquiring position information of the moving object;
    自动锁定拍摄装置进行如下控制操作:The automatic lock camera performs the following control operations:
    根据所述无人机飞行平台和所述运动物体的位置信息调整所述无人机飞行平台的飞行路线以及所述摄像设备与所述无人机飞行平台的相对位置,并根据所述摄像设备拍摄的图像调整所述摄像设备的指向,使得所述摄像设备锁定拍摄所述运动物体。Adjusting a flight route of the UAV flight platform and a relative position of the camera device and the UAV flight platform according to the UAV flight platform and position information of the moving object, and according to the camera device The captured image adjusts the orientation of the imaging device such that the imaging device locks the shooting of the moving object.
  2. 根据权利要求1所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 1, wherein:
    所述载荷稳定装置包括三轴陀螺、三轴加速度计、三轴磁罗盘中的至少其中之一,形成闭环反馈控制系统。The load stabilizing device comprises at least one of a three-axis gyroscope, a three-axis accelerometer, and a three-axis magnetic compass to form a closed loop feedback control system.
  3. 根据权利要求2所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 2, wherein:
    所述移动终端通过数据链路连接所述无人机平台,所述自动锁定拍摄装置的控制操作在所述移动终端上进行。The mobile terminal connects to the drone platform through a data link, and the control operation of the automatic lock photographing device is performed on the mobile terminal.
  4. 根据权利要求3所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 3, wherein:
    所述移动终端通过数据链路从所述无人机平台获取无人机姿态信息、载荷稳定装置的姿态信息、无人机飞行平台和所述运动物体的位置信息、摄像设备所拍摄的图像信息。 The mobile terminal acquires the attitude information of the drone, the attitude information of the load stabilization device, the position information of the UAV flight platform and the moving object, and the image information captured by the imaging device from the UAV platform through a data link. .
  5. 根据权利要求4所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 4, wherein:
    所述移动终端使用自锁定拍摄方式控制所述无人机的飞行和载荷稳定装置的姿态,使得所述运动物体始终位于所述摄像设备所拍摄的图像的中央。The mobile terminal controls the attitude of the flight and load stabilizing device of the drone using a self-locking photographing mode such that the moving object is always located at the center of the image captured by the image capturing device.
  6. 根据权利要求5所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 5, wherein:
    所述移动终端在使用自锁定拍摄方式时,对所述运动物体和所述无人机飞行平台中的至少一个的运动轨迹进行平滑处理,以运动轨迹曲线上当前时刻的切线方向作为目标下一时刻运动方向的预测值,依据前两个时刻的位置计算当前的运动速度。When the mobile terminal uses the self-locking shooting mode, smoothing a motion trajectory of at least one of the moving object and the UAV flight platform, and using a tangential direction of the current time on the motion trajectory curve as a target next The predicted value of the moment of motion is calculated based on the position of the first two moments.
  7. 根据权利要求6所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 6, wherein:
    所述移动终端对比运动物体的运动曲线和无人机平台的运动曲线,以及运动曲线和无人机平台下一刻的运动方向,计算两者运行轨迹和运动方向的差异,根据无人机平台的运动轨迹向运动物体的运动轨迹调整的标准以及不同拍摄要求,设定无人机的飞行方案。The mobile terminal compares the motion curve of the moving object with the motion curve of the UAV platform, and the motion curve and the motion direction of the UAV platform in the next moment, and calculates the difference between the running track and the moving direction of the mobile device, according to the UAV platform. The standard for adjusting the trajectory of the moving trajectory to the moving object and the different shooting requirements, setting the flight plan of the drone.
  8. 根据权利要求7所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于,通过以下步骤进行载荷姿态稳定分析,设定载荷稳定装置的控制方案:The apparatus for automatically locking a moving object by using a drone according to claim 7, wherein the load posture stabilization analysis is performed by the following steps, and the control scheme of the load stabilization device is set:
    (a)通过三轴陀螺、三轴加速度计、三轴磁罗盘得到当前载荷稳定装置的角速度、加速度、磁场;(a) obtaining the angular velocity, acceleration, and magnetic field of the current load stabilizing device through a three-axis gyro, a three-axis accelerometer, and a three-axis magnetic compass;
    (b)通过变换公式计算得到载荷稳定装置在x,y,z方向的偏移;(b) calculating the offset of the load stabilizing device in the x, y, z direction by a transformation formula;
    (c)根据当前得到的运动物体中心位置,计算该中心与图像中心的相对位移。(c) Calculate the relative displacement of the center from the center of the image based on the currently obtained center position of the moving object.
  9. 根据权利要求8所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于: The apparatus for automatically locking a moving object by using a drone according to claim 8, wherein:
    综合所述无人机的飞行方案和载荷稳定装置的控制方案,通过取舍决策,得到最终的联合控制方案。Combining the flight plan of the drone and the control plan of the load stabilizing device, the final joint control plan is obtained through the trade-off decision.
  10. 根据权利要求9所述的利用无人机进行运动物体自动锁定拍摄的装置,其特征在于:The apparatus for automatically locking a moving object by using a drone according to claim 9, wherein:
    (a)根据无人机的飞行方案调整无人机的运动方向,控制无人机的运动速度;(a) adjusting the direction of movement of the drone according to the flight plan of the drone, and controlling the speed of movement of the drone;
    (b)通过以下步骤得到载荷稳定装置的控制方案:(b) Obtain a control scheme for the load stabilizer by the following steps:
    (b1)根据计算得到的载荷稳定装置在x,y,z方向上的偏移,控制电机进行校正,保证相机稳定;(b1) According to the calculated offset of the load stabilizing device in the x, y, z direction, the motor is controlled to ensure that the camera is stable;
    (b2)根据计算得到的运动物体中心的相对位移,控制相机的运动,保证图像处于目标中心,X方向上的位移,通过相机的左右转动进行调节,Y方向上的位移,通过相机的上下转动进行调节。(b2) According to the calculated relative displacement of the center of the moving object, control the movement of the camera to ensure that the image is at the center of the target, the displacement in the X direction is adjusted by the left and right rotation of the camera, and the displacement in the Y direction is rotated up and down by the camera. Make adjustments.
  11. 一种利用无人机进行运动物体自动锁定拍摄的方法,其特征在于:将摄像设备通过载荷稳定装置固定于无人机飞行平台,利用所述载荷稳定装置滤除来自所述载荷稳定装置外部的对摄像设备的运动干扰,并使所述摄像设备指向所述运动物体;A method for automatically locking a moving object by using a drone, characterized in that: the image capturing device is fixed to the unmanned aerial vehicle flight platform by a load stabilizing device, and the load stabilizing device is used to filter out the outside of the load stabilizing device Interfering with motion of the imaging device and directing the imaging device to the moving object;
    将能够获取所述运动物体的位置信息的移动终端设置在所述运动物体上;a mobile terminal capable of acquiring position information of the moving object is disposed on the moving object;
    根据所述无人机飞行平台和所述运动物体的位置信息调整所述无人机飞行平台的飞行路线以及所述摄像设备与所述无人机飞行平台的相对位置,并根据所述摄像设备拍摄的图像调整所述摄像设备的指向,使得所述摄像设备锁定拍摄所述运动物体。Adjusting a flight route of the UAV flight platform and a relative position of the camera device and the UAV flight platform according to the UAV flight platform and position information of the moving object, and according to the camera device The captured image adjusts the orientation of the imaging device such that the imaging device locks the shooting of the moving object.
  12. 一种利用无人机进行运动物体自动锁定拍摄的方法,其特征在于包括以下步骤:A method for automatically locking a moving object by using a drone, characterized in that the method comprises the following steps:
    (1)移动终端根据运动物体自动锁定拍摄算法反馈的指令,控制无人机飞行平台随着运动物体进行飞行拍摄,实时数据采集,获得运动相机的实时图像、载荷稳定装置的姿态状态数据,识别待跟踪目标的具 体区域,获取无人机遥测状态数据;(1) The mobile terminal automatically locks the feedback instruction of the shooting algorithm according to the moving object, controls the flying platform of the drone to perform flight shooting with the moving object, real-time data acquisition, obtains the real-time image of the moving camera, the posture state data of the load stabilization device, and recognizes The target to be tracked Body area, obtaining drone telemetry status data;
    (2)移动终端分析数据预处理,进行筛选或序列化建模,确定待跟踪目标的运动状态,建立累计跟踪管道进行目标跟踪处理;(2) The mobile terminal analyzes the data preprocessing, performs screening or serialization modeling, determines the motion state of the target to be tracked, and establishes a cumulative tracking pipeline for target tracking processing;
    (3)移动终端综合决策数据处理,根据目标运动估计及跟踪处理数据,产生综合决策数据,通过数据链路传输到的无人机飞行平台,控制载荷和无人机飞行平台的下一步运动。(3) The mobile terminal comprehensive decision data processing, based on the target motion estimation and tracking processing data, generates comprehensive decision data, and controls the load and the next movement of the drone flight platform through the UAV flight platform transmitted to the data link.
  13. 根据权利要求12所述的利用无人机进行运动物体自动锁定拍摄的方法,其特征在于:所述的筛选或序列化建模具体步骤为:The method for automatically locking a moving object by using a drone according to claim 12, wherein the specific steps of the screening or serialization modeling are:
    (a)提取无人机和载荷稳定装置的当前姿态数据;(a) extracting current attitude data of the drone and the load stabilizing device;
    (b)建立无人机和载荷稳定装置的历史姿态数据管道;(b) Establishing historical attitude data pipelines for drones and load stabilizers;
    (c)计算无人机和载荷稳定装置的运动轨迹曲线;(c) calculating the trajectory curve of the drone and the load stabilizing device;
    (d)提取移动控制终端获得运动目标的当前定位位置数据;(d) extracting current positioning position data of the moving target obtained by the mobile control terminal;
    (e)建立运动目标的历史定位位置数据管道;(e) Establish a historical location data pipeline for the moving target;
    (f)计算运动目标的运动轨迹曲线。(f) Calculate the trajectory curve of the moving target.
  14. 一种对运动物体进行自动锁定拍摄的无人机,包括无人机飞行平台、载荷稳定装置、摄像设备,其特征在于:An unmanned aerial vehicle for automatically locking and shooting a moving object, including a drone flight platform, a load stabilizing device, and an imaging device, wherein:
    所述摄像设备通过所述载荷稳定装置固定于所述无人机飞行平台,用于对所述运动物体进行拍摄,所述载荷稳定装置能够滤除来自所述载荷稳定装置外部的对摄像设备的运动干扰,并使所述摄像设备指向所述运动物体;The image capturing apparatus is fixed to the UAV flight platform by the load stabilizing device for photographing the moving object, and the load stabilizing device is capable of filtering out an image capturing device from outside the load stabilizing device Motion interference and directing the imaging device to the moving object;
    所述无人机能够与设置在所述运动物体上并获取所述运动物体的位置信息的移动终端进行通信,以及进行如下控制操作:The drone is capable of communicating with a mobile terminal disposed on the moving object and acquiring position information of the moving object, and performing the following control operations:
    根据所述无人机飞行平台和所述运动物体的位置信息调整所述无人机飞行平台的飞行路线以及所述摄像设备与所述无人机飞行平台的相对位置,并根据所述摄像设备拍摄的图像调整所述摄像设备的指向,使得所述摄像设备锁定拍摄所述运动物体。Adjusting a flight route of the UAV flight platform and a relative position of the camera device and the UAV flight platform according to the UAV flight platform and position information of the moving object, and according to the camera device The captured image adjusts the orientation of the imaging device such that the imaging device locks the shooting of the moving object.
  15. 一种控制无人机进行运动物体自动锁定拍摄的移动终端,其特征 在于:Mobile terminal for controlling drone to automatically lock and shoot moving objects, and its characteristics Lie in:
    所述移动终端设置在所述运动物体上,并能够获取所述运动物体的位置信息;The mobile terminal is disposed on the moving object and is capable of acquiring position information of the moving object;
    所述无人机包括无人机飞行平台、载荷稳定装置、摄像设备,所述摄像设备通过所述载荷稳定装置固定于所述无人机飞行平台,用于对所述运动物体进行拍摄,所述载荷稳定装置能够滤除来自所述载荷稳定装置外部的对摄像设备的运动干扰,并使所述摄像设备指向所述运动物体;The UAV includes a UAV flight platform, a load stabilizing device, and an imaging device, and the imaging device is fixed to the UAV flight platform by the load stabilizing device, and is used for photographing the moving object. The load stabilizing device is capable of filtering out motion interference with the imaging device from outside the load stabilizing device and directing the imaging device to the moving object;
    所述移动终端对所述无人机进行如下控制操作:The mobile terminal performs the following control operations on the drone:
    根据所述无人机飞行平台和所述运动物体的位置信息调整所述无人机飞行平台的飞行路线以及所述摄像设备与所述无人机飞行平台的相对位置,并根据所述摄像设备拍摄的图像调整所述摄像设备的指向,使得所述摄像设备锁定拍摄所述运动物体。 Adjusting a flight route of the UAV flight platform and a relative position of the camera device and the UAV flight platform according to the UAV flight platform and position information of the moving object, and according to the camera device The captured image adjusts the orientation of the imaging device such that the imaging device locks the shooting of the moving object.
PCT/CN2016/093490 2015-08-05 2016-08-05 Photographing device and method using drone to automatically track and photograph moving object WO2017020856A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510473852.7A CN105120146B (en) 2015-08-05 2015-08-05 It is a kind of to lock filming apparatus and image pickup method automatically using unmanned plane progress moving object
CN201510473852.7 2015-08-05

Publications (1)

Publication Number Publication Date
WO2017020856A1 true WO2017020856A1 (en) 2017-02-09

Family

ID=54668022

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/093490 WO2017020856A1 (en) 2015-08-05 2016-08-05 Photographing device and method using drone to automatically track and photograph moving object

Country Status (2)

Country Link
CN (1) CN105120146B (en)
WO (1) WO2017020856A1 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109668853A (en) * 2017-10-13 2019-04-23 中国石油化工股份有限公司 A kind of atmosphere pollution monitoring system
CN110678822A (en) * 2018-07-23 2020-01-10 深圳市大疆创新科技有限公司 Control method and device of mobile robot and mobile robot system
CN111343593A (en) * 2018-12-19 2020-06-26 广州海格通信集团股份有限公司 Control method, device, equipment and storage medium of unmanned running tool
WO2020176969A1 (en) * 2019-03-05 2020-09-10 Metaoptima Technology Inc. Unmanned mobile robot and software for clinical examination and treatment
US10880465B1 (en) 2017-09-21 2020-12-29 IkorongoTechnology, LLC Determining capture instructions for drone photography based on information received from a social network
CN112955712A (en) * 2020-04-28 2021-06-11 深圳市大疆创新科技有限公司 Target tracking method, device and storage medium
CN113093814A (en) * 2021-04-07 2021-07-09 浙江大华技术股份有限公司 Method and device for controlling movement of holder
CN113238568A (en) * 2021-04-26 2021-08-10 天津小鲨鱼智能科技有限公司 Following method, aircraft and first equipment
CN113467499A (en) * 2018-05-30 2021-10-01 深圳市大疆创新科技有限公司 Flight control method and aircraft
CN114136343A (en) * 2021-12-03 2022-03-04 中国人民解放军63660部队 Method for measuring dynamic pointing error of attitude stabilization tracking platform
CN114239392A (en) * 2021-12-09 2022-03-25 南通大学 Unmanned aerial vehicle decision model training method, using method, equipment and medium
CN114285996A (en) * 2021-12-23 2022-04-05 中国人民解放军海军航空大学 Ground target coverage shooting method and system
CN114489093A (en) * 2020-10-27 2022-05-13 北京远度互联科技有限公司 Attitude adjusting method and device, storage medium, image acquisition equipment and unmanned aerial vehicle
CN114814970A (en) * 2022-04-14 2022-07-29 中交遥感天域科技江苏有限公司 Unmanned aerial vehicle discovery device for airport and disposal method thereof
WO2023070441A1 (en) * 2021-10-28 2023-05-04 深圳市大疆创新科技有限公司 Movable platform positioning method and apparatus

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105120146B (en) * 2015-08-05 2018-06-26 普宙飞行器科技(深圳)有限公司 It is a kind of to lock filming apparatus and image pickup method automatically using unmanned plane progress moving object
US10824141B2 (en) * 2015-12-09 2020-11-03 SZ DJI Technology Co., Ltd. Systems and methods for UAV flight control
US10200659B2 (en) * 2016-02-29 2019-02-05 Microsoft Technology Licensing, Llc Collaborative camera viewpoint control for interactive telepresence
CN105847681A (en) * 2016-03-30 2016-08-10 乐视控股(北京)有限公司 Shooting control method, device and system
CN105872372A (en) * 2016-03-31 2016-08-17 纳恩博(北京)科技有限公司 Image acquisition method and electronic device
CN105857582A (en) * 2016-04-06 2016-08-17 北京博瑞爱飞科技发展有限公司 Method and device for adjusting shooting angle, and unmanned air vehicle
CN107305374A (en) * 2016-04-22 2017-10-31 优利科技有限公司 Unmanned plane system
KR20170130952A (en) * 2016-05-20 2017-11-29 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN105938372A (en) * 2016-06-03 2016-09-14 南京奇蛙智能科技有限公司 Combined type wearable unmanned aerial vehicle controller
CN105939463A (en) * 2016-06-16 2016-09-14 四川建筑职业技术学院 Aerial-shooting unmanned aerial vehicle image tracking system based on GPS positioning
CN106131482B (en) * 2016-06-27 2019-01-11 西安应用光学研究所 Unmanned carrier optoelectronic aims of systems capture systems and method
CN106254009B (en) * 2016-07-21 2018-08-03 北京航空航天大学 A kind of Unmanned Aerial Vehicle Data Link test electromagnetic interference signal recurrence system and reproducing method
WO2018027340A1 (en) * 2016-08-06 2018-02-15 SZ DJI Technology Co., Ltd. Systems and methods for mobile platform imaging
CN106295695B (en) * 2016-08-08 2019-08-16 中国民用航空总局第二研究所 A kind of takeoff and landing process automatic tracing image pickup method and device
CN109643116A (en) * 2016-08-22 2019-04-16 深圳市大疆创新科技有限公司 System and method for positioning mobile object
CN107783551A (en) * 2016-08-26 2018-03-09 北京臻迪机器人有限公司 The method and device that control unmanned plane follows
CN108885469B (en) * 2016-09-27 2022-04-26 深圳市大疆创新科技有限公司 System and method for initializing a target object in a tracking system
US10241520B2 (en) * 2016-12-22 2019-03-26 TCL Research America Inc. System and method for vision-based flight self-stabilization by deep gated recurrent Q-networks
CN106815335A (en) * 2016-12-30 2017-06-09 易瓦特科技股份公司 The construction method and system of standard database
CN106844542A (en) * 2016-12-30 2017-06-13 易瓦特科技股份公司 The method and device of destination object identification information is obtained based on unmanned plane
CN106874372A (en) * 2016-12-30 2017-06-20 易瓦特科技股份公司 The method and device of destination object identification information is obtained based on unmanned plane
CN106777307A (en) * 2016-12-30 2017-05-31 易瓦特科技股份公司 The data message acquisition methods and system of destination object
CN106844547A (en) * 2016-12-30 2017-06-13 易瓦特科技股份公司 Obtain the method and device of destination object identification information
CN106845369A (en) * 2016-12-30 2017-06-13 易瓦特科技股份公司 It is applied to the method and system that unmanned plane obtains data message
CN106844543A (en) * 2016-12-30 2017-06-13 易瓦特科技股份公司 It is applied to the method and system that unmanned plane is identified acquisition of information
CN107025262A (en) * 2016-12-30 2017-08-08 易瓦特科技股份公司 The method and device of destination object standard logo information is obtained applied to unmanned plane
CN106777305A (en) * 2016-12-30 2017-05-31 易瓦特科技股份公司 The method and apparatus of destination object standard database is built based on unmanned plane
CN106874369A (en) * 2016-12-30 2017-06-20 易瓦特科技股份公司 Normal data base construction method and system based on unmanned plane
CN106791684A (en) * 2016-12-31 2017-05-31 深圳市乐信兴业科技有限公司 Electronic equipment tracking and relevant apparatus and system and mobile terminal
JP6873716B2 (en) * 2017-01-31 2021-05-19 キヤノン株式会社 Image blur correction device and its control method, image pickup device, lens device
US10375289B2 (en) * 2017-03-31 2019-08-06 Hangzhou Zero Zero Technology Co., Ltd. System and method for providing autonomous photography and videography
CN107272732A (en) * 2017-06-12 2017-10-20 广东工业大学 Unmanned flight's device group system
CN109144106A (en) * 2017-06-28 2019-01-04 北京天龙智控科技有限公司 Unmanned plane follows flight system, follows flying method
CN107172360A (en) * 2017-07-06 2017-09-15 杨顺伟 Unmanned plane is with shooting method and device
CN107590450A (en) * 2017-09-01 2018-01-16 歌尔科技有限公司 A kind of labeling method of moving target, device and unmanned plane
CN108713179A (en) * 2017-09-18 2018-10-26 深圳市大疆创新科技有限公司 Mobile article body controlling means, equipment and system
CN108052114A (en) * 2017-12-06 2018-05-18 四川豪斯特电子技术有限责任公司 The Image Acquisition and tracking control system of a kind of unmanned plane
CN109995991A (en) * 2017-12-29 2019-07-09 深圳市优必选科技有限公司 A kind of image pickup method, robot and mobile terminal
JP6904263B2 (en) * 2018-01-10 2021-07-14 オムロン株式会社 Image processing system
CN108573498B (en) * 2018-03-08 2019-04-26 上海申雪供应链管理有限公司 The instant tracking system of driving vehicle based on unmanned plane
CN110622077B (en) 2018-03-23 2022-08-30 深圳市大疆创新科技有限公司 Control method, server, equipment and system
CN108566513A (en) * 2018-03-28 2018-09-21 深圳臻迪信息技术有限公司 A kind of image pickup method of unmanned plane to moving target
CN108683840A (en) * 2018-03-28 2018-10-19 深圳臻迪信息技术有限公司 Filming control method, image pickup method and unmanned machine end
WO2021128189A1 (en) * 2019-12-26 2021-07-01 深圳市大疆创新科技有限公司 Data processing method and apparatus, unmanned aerial vehicle and flight control system
JP7247904B2 (en) * 2020-01-15 2023-03-29 トヨタ自動車株式会社 Vehicle photography method by drone system and drone
WO2022141369A1 (en) * 2020-12-31 2022-07-07 SZ DJI Technology Co., Ltd. Systems and methods for supporting automatic video capture and video editing
CN114281100B (en) * 2021-12-03 2023-09-05 国网智能科技股份有限公司 Unmanned aerial vehicle inspection system and method without hovering
CN115657728B (en) * 2022-12-12 2023-03-21 辽宁电力能源发展集团有限公司 Unmanned aerial vehicle simulation control method and system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102143324A (en) * 2011-04-07 2011-08-03 天津市亚安科技电子有限公司 Method for automatically and smoothly tracking target by cradle head
CN103188431A (en) * 2011-12-27 2013-07-03 鸿富锦精密工业(深圳)有限公司 System and method for controlling unmanned aerial vehicle to conduct image acquisition
CN103744390A (en) * 2013-12-31 2014-04-23 中国测绘科学研究院 Cooperative control method for inspection of power line of unmanned aerial vehicle
US20140211987A1 (en) * 2013-01-30 2014-07-31 International Business Machines Corporation Summarizing salient events in unmanned aerial videos
US20150029332A1 (en) * 2013-07-24 2015-01-29 The Boeing Company Controlling movement of a camera to autonomously track a mobile object
CN104571135A (en) * 2013-10-20 2015-04-29 郁杰夫 Cloud deck tracking photography system and cloud deck tracking photography method
CN104796611A (en) * 2015-04-20 2015-07-22 零度智控(北京)智能科技有限公司 Method and system for remotely controlling unmanned aerial vehicle to implement intelligent flight shooting through mobile terminal
CN104853104A (en) * 2015-06-01 2015-08-19 深圳市微队信息技术有限公司 Method and system for automatically tracking and shooting moving object
CN105120146A (en) * 2015-08-05 2015-12-02 普宙飞行器科技(深圳)有限公司 Shooting device and shooting method using unmanned aerial vehicle to perform automatic locking of moving object

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103604427B (en) * 2013-12-10 2016-10-12 中国航天空气动力技术研究院 UAS and method to ground moving target dynamic location
CN104133484B (en) * 2014-07-10 2017-09-22 浙江飞神车业有限公司 Multi-rotor aerocraft electronic-controlled installation, taking photo by plane for multi-rotor aerocraft and follow formula multi-rotor aerocraft of taking photo by plane at electronic-controlled installation
CN104808674A (en) * 2015-03-03 2015-07-29 广州亿航智能技术有限公司 Multi-rotor aircraft control system, terminal and airborne flight control system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102143324A (en) * 2011-04-07 2011-08-03 天津市亚安科技电子有限公司 Method for automatically and smoothly tracking target by cradle head
CN103188431A (en) * 2011-12-27 2013-07-03 鸿富锦精密工业(深圳)有限公司 System and method for controlling unmanned aerial vehicle to conduct image acquisition
US20140211987A1 (en) * 2013-01-30 2014-07-31 International Business Machines Corporation Summarizing salient events in unmanned aerial videos
US20150029332A1 (en) * 2013-07-24 2015-01-29 The Boeing Company Controlling movement of a camera to autonomously track a mobile object
CN104571135A (en) * 2013-10-20 2015-04-29 郁杰夫 Cloud deck tracking photography system and cloud deck tracking photography method
CN103744390A (en) * 2013-12-31 2014-04-23 中国测绘科学研究院 Cooperative control method for inspection of power line of unmanned aerial vehicle
CN104796611A (en) * 2015-04-20 2015-07-22 零度智控(北京)智能科技有限公司 Method and system for remotely controlling unmanned aerial vehicle to implement intelligent flight shooting through mobile terminal
CN104853104A (en) * 2015-06-01 2015-08-19 深圳市微队信息技术有限公司 Method and system for automatically tracking and shooting moving object
CN105120146A (en) * 2015-08-05 2015-12-02 普宙飞行器科技(深圳)有限公司 Shooting device and shooting method using unmanned aerial vehicle to perform automatic locking of moving object

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11363185B1 (en) 2017-09-21 2022-06-14 Ikorongo Technology, LLC Determining capture instructions for drone photography based on images on a user device
US10880465B1 (en) 2017-09-21 2020-12-29 IkorongoTechnology, LLC Determining capture instructions for drone photography based on information received from a social network
US11889183B1 (en) 2017-09-21 2024-01-30 Ikorongo Technology, LLC Determining capture instructions for drone photography for event photography
CN109668853A (en) * 2017-10-13 2019-04-23 中国石油化工股份有限公司 A kind of atmosphere pollution monitoring system
CN113467499A (en) * 2018-05-30 2021-10-01 深圳市大疆创新科技有限公司 Flight control method and aircraft
CN110678822A (en) * 2018-07-23 2020-01-10 深圳市大疆创新科技有限公司 Control method and device of mobile robot and mobile robot system
CN111343593B (en) * 2018-12-19 2021-09-07 广州海格通信集团股份有限公司 Control method, device, equipment and storage medium of unmanned running tool
CN111343593A (en) * 2018-12-19 2020-06-26 广州海格通信集团股份有限公司 Control method, device, equipment and storage medium of unmanned running tool
WO2020176969A1 (en) * 2019-03-05 2020-09-10 Metaoptima Technology Inc. Unmanned mobile robot and software for clinical examination and treatment
CN112955712A (en) * 2020-04-28 2021-06-11 深圳市大疆创新科技有限公司 Target tracking method, device and storage medium
CN114489093A (en) * 2020-10-27 2022-05-13 北京远度互联科技有限公司 Attitude adjusting method and device, storage medium, image acquisition equipment and unmanned aerial vehicle
CN114489093B (en) * 2020-10-27 2022-11-29 北京远度互联科技有限公司 Attitude adjusting method and device, storage medium, image acquisition equipment and unmanned aerial vehicle
CN113093814A (en) * 2021-04-07 2021-07-09 浙江大华技术股份有限公司 Method and device for controlling movement of holder
CN113238568A (en) * 2021-04-26 2021-08-10 天津小鲨鱼智能科技有限公司 Following method, aircraft and first equipment
WO2023070441A1 (en) * 2021-10-28 2023-05-04 深圳市大疆创新科技有限公司 Movable platform positioning method and apparatus
CN114136343A (en) * 2021-12-03 2022-03-04 中国人民解放军63660部队 Method for measuring dynamic pointing error of attitude stabilization tracking platform
CN114136343B (en) * 2021-12-03 2024-03-26 中国人民解放军63660部队 Measurement method for dynamic pointing error of attitude stable tracking platform
CN114239392A (en) * 2021-12-09 2022-03-25 南通大学 Unmanned aerial vehicle decision model training method, using method, equipment and medium
CN114285996A (en) * 2021-12-23 2022-04-05 中国人民解放军海军航空大学 Ground target coverage shooting method and system
CN114814970A (en) * 2022-04-14 2022-07-29 中交遥感天域科技江苏有限公司 Unmanned aerial vehicle discovery device for airport and disposal method thereof

Also Published As

Publication number Publication date
CN105120146A (en) 2015-12-02
CN105120146B (en) 2018-06-26

Similar Documents

Publication Publication Date Title
WO2017020856A1 (en) Photographing device and method using drone to automatically track and photograph moving object
US10979615B2 (en) System and method for providing autonomous photography and videography
CN105487552B (en) The method and device of unmanned plane track up
CN105242685B (en) A kind of accompanying flying unmanned plane system and method
CN110347171B (en) Aircraft control method and aircraft
US9641810B2 (en) Method for acquiring images from arbitrary perspectives with UAVs equipped with fixed imagers
WO2016138687A1 (en) Control system, terminal and airborne flight control system of multi-rotor craft
US11401045B2 (en) Camera ball turret having high bandwidth data transmission to external image processor
US11960284B2 (en) Multipoint cable cam system and method
CN205353774U (en) Accompany unmanned aerial vehicle system of taking photo by plane of shooing aircraft
WO2019061063A1 (en) Image collection method for unmanned aerial vehicle, and unmanned aerial vehicle
CN105468014B (en) A kind of integrated aerocraft system of list autopilot and its two-dimensional pan-tilt control method
CN105242684A (en) Unmanned plane aerial photographing system and method of photographing accompanying aircraft
WO2018214093A1 (en) Tracking method and apparatus
CN109976370B (en) Control method and device for vertical face surrounding flight, terminal and storage medium
US20230058405A1 (en) Unmanned aerial vehicle (uav) swarm control
WO2018059295A1 (en) Control method, device, and system for multirotor aerial vehicle
CN106094876A (en) A kind of unmanned plane target locking system and method thereof
CN108780321A (en) For the method for equipment pose adjustment, equipment, system and computer readable storage medium
WO2018053785A1 (en) Image processing in an unmanned autonomous vehicle
CN107734289A (en) Method, related computer program and the electronic system for capturing video of capture images
CN107144264A (en) A kind of aeroplane photography method that high definition pavement image is gathered for fixed-wing unmanned plane
CN204287973U (en) flight camera
CN111699454B (en) Flight planning method and related equipment
CN114281100B (en) Unmanned aerial vehicle inspection system and method without hovering

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16832344

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.07.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16832344

Country of ref document: EP

Kind code of ref document: A1