CN111279671A - Control method and device, unmanned aerial vehicle and storage medium - Google Patents

Control method and device, unmanned aerial vehicle and storage medium Download PDF

Info

Publication number
CN111279671A
CN111279671A CN201880065474.0A CN201880065474A CN111279671A CN 111279671 A CN111279671 A CN 111279671A CN 201880065474 A CN201880065474 A CN 201880065474A CN 111279671 A CN111279671 A CN 111279671A
Authority
CN
China
Prior art keywords
pulse signal
signal
shooting
aerial vehicle
synchronization pulse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880065474.0A
Other languages
Chinese (zh)
Inventor
王一皿
周琦
丁鹏
戴明峻
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN111279671A publication Critical patent/CN111279671A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/04Synchronising
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64DEQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00Equipment not otherwise provided for
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/024Guidance services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W56/00Synchronisation arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W56/00Synchronisation arrangements
    • H04W56/001Synchronization between nodes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a control method and a control device of an unmanned aerial vehicle and the unmanned aerial vehicle, wherein the control method of the unmanned aerial vehicle comprises the following steps: when the shooting device executes shooting operation, the multiplexing hot shoe signal interface transmits at least two pulse signals. According to the technical scheme of the invention, a standard connector and a hardware structure connected with the connector do not need to be changed, and at least two pulse signals are transmitted, so that the time alignment of the at least two signals can be realized, the time synchronization between the functional modules corresponding to the at least two pulse signals in the unmanned aerial vehicle system is met, the synchronism of operation execution in the unmanned aerial vehicle system is improved, further, the multiplexing of the transmission of the at least two pulse signals can be realized through the multiplexing form of the hot shoe signal interface for the shooting device applicable to the original hot shoe signal interface, and the compatibility of the application of the existing product is further realized.

Description

Control method and device, unmanned aerial vehicle and storage medium
Technical Field
The embodiment of the invention relates to the field of flight control, in particular to a control method and device and an unmanned aerial vehicle.
Background
In the related art, in order to meet the requirement that the conventional hot shoe signal and the new time synchronization pulse signal are simultaneously connected to the camera, a separate connector pin is required to be added to the interface between the camera and the drone system in addition to the hot shoe signal interface for inputting the time synchronization pulse signal, and the following defects exist:
to current camera and unmanned aerial vehicle hardware to and camera interface connector all need modify, it is very high to modify the cost, is difficult to guarantee moreover with the compatibility of preceding product.
Disclosure of Invention
The embodiment of the invention provides a control method of an unmanned aerial vehicle, which can reduce errors when a user selects an optimal synchronization pulse signal by himself while realizing the consistency of time synchronization signals among all functional units in the unmanned aerial vehicle, thereby realizing the consistency of actions of all functional modules in the unmanned aerial vehicle.
In order to achieve the above object, a first aspect of an embodiment of the present invention provides a control method of an unmanned aerial vehicle of the unmanned aerial vehicle, including: when the shooting device executes shooting operation, the multiplexing hot shoe signal interface transmits at least two pulse signals.
An aspect of the second aspect of the present invention provides a control device for an unmanned aerial vehicle, including: the method comprises the following steps: a processor to: when the shooting device executes shooting operation, the multiplexing hot shoe signal interface transmits at least two pulse signals.
An aspect of the third aspect of the present invention provides an unmanned aerial vehicle, including: the aircraft body comprises a power system and a control system, wherein the power system is used for providing flight power; the shooting device can be electrically connected with the unmanned aerial vehicle through a connector, and the connector comprises a hot boot signal interface; the control system is specifically configured to: when the shooting device executes shooting operation, the multiplexing hot shoe signal interface transmits at least two pulse signals.
In an embodiment of the fourth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the control method according to the first aspect of the embodiment of the present invention.
In the control method and the control device for the unmanned aerial vehicle and the unmanned aerial vehicle provided by the embodiment of the invention, the pulse signal transmission pins are multiplexed, on one hand, compared with the existing signal transmission module, the standard connector and the hardware structure connected with the connector do not need to be changed, on the other hand, the time alignment of at least two kinds of signals can be realized by transmitting at least two kinds of pulse signals, so that the time synchronization between the functional modules corresponding to the at least two kinds of pulse signals in the unmanned aerial vehicle system is met, the synchronism of operation execution in the unmanned aerial vehicle system is improved, on the other hand, the multiplexing of the transmission of the at least two kinds of pulse signals can be realized through the multiplexing form of the hot shoe signal interface for the shooting device applicable to the original hot shoe signal interface, and further, the compatibility of the application of the existing product is realized.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
FIG. 1 illustrates a schematic architectural block diagram of an unmanned aerial vehicle system of an embodiment of the present application;
FIG. 2 shows a schematic flow chart of a method of controlling an unmanned aerial vehicle according to an embodiment of the invention;
FIG. 3 shows a schematic flow chart of a method of controlling an unmanned aerial vehicle according to another embodiment of the invention;
FIG. 4 is a schematic flow chart diagram illustrating a method of controlling an unmanned aerial vehicle according to yet another embodiment of the present invention;
FIG. 5 shows a block schematic architecture diagram of a control device of one embodiment of the present invention;
fig. 6 shows a schematic block diagram of the control apparatus of another embodiment of the present invention;
fig. 7 shows a schematic block diagram of the architecture of a control device of a further embodiment of the present invention;
FIG. 8 shows a schematic block diagram of a control device of an embodiment of the present application;
FIG. 9 illustrates a schematic architectural block diagram of a control system of the UAV of one embodiment of the present invention;
FIG. 10 is a schematic flow chart diagram illustrating a method for timing a time signal according to an embodiment of the present application;
FIG. 11 shows a schematic flow chart diagram of a signal switching method of one embodiment of the present application;
FIG. 12 shows a schematic flow chart diagram of a signal switching method of another embodiment of the present application;
FIG. 13 is a block diagram showing a schematic architecture of a time signal timing device according to an embodiment of the present application;
FIG. 14 illustrates a block schematic architecture diagram of a control system of the UAV of an embodiment of the present application;
FIG. 15 is a schematic flow chart diagram illustrating a method of controlling an UAV in accordance with one embodiment of the present invention;
FIG. 16 is a schematic flow chart diagram illustrating a method of controlling an UAV in accordance with another embodiment of the present invention;
FIG. 17 illustrates a block schematic architecture diagram of a control system of an UAV in accordance with another embodiment of the present application;
FIG. 18 is a signal transmission diagram illustrating a switching scheme for a system time synchronization signal for an UAV of an embodiment of the present invention;
fig. 19 shows a signal transmission diagram of an unmanned aerial vehicle according to different load types according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When a component is referred to as being "connected" to another component, it can be directly connected to the other component or intervening components may also be present.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
Some embodiments of the invention are described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Fig. 1 is a schematic architecture diagram of an unmanned aerial vehicle system 10 provided in accordance with an embodiment of the present application.
Unmanned aerial vehicle system 10 may include unmanned aerial vehicle flight control system 110, positioning assembly 120, and load devices for collecting sensory data.
The positioning assembly includes a plurality of positioning modules, such as a positioning module 122, a positioning module 124, and a positioning module 12 n.
Flight control system 110 includes a central processor 112, flight controllers, and a built-in sensing system 116.
Information such as positioning information, signal strength, signal to noise ratio and the like of the plurality of positioning modules is transmitted to the central processing unit 112 through serial port data communication, and the central processing unit 112 can determine an optimal synchronization pulse signal in the positioning module according to the received positioning information and by combining environmental data acquired by the built-in sensing system 116 of the central processing unit, and transmit the optimal synchronization pulse signal to the flight controller 114, the built-in sensing system 116 and the load device.
The load device includes a camera 136, the camera 136 may be mounted on the unmanned aerial vehicle 100 through a load interface 152, the camera 136 may be a device for capturing an image such as a camera or a video camera, and a shooting signal of the camera 136 is aligned with the optimal synchronization pulse signal by the received optimal synchronization pulse signal.
The load device further includes a cradle head 130, the cradle head 130 may include a motor 134, and the cradle head 130 is used for carrying a camera 136, wherein the load interface 152 may be disposed on the body of the unmanned aerial vehicle, and may also be disposed on the cradle head 130.
The load device further includes a radar 142, and the radar 142 may be mounted on the UAV 100 through the load interface 154, and a detection signal of the radar 142 is aligned with the optimal synchronization pulse signal by the received optimal synchronization pulse signal.
The radar 142 is connected to the motor 144 to perform a rotation function.
The embodiment of the application provides a control method of an unmanned aerial vehicle, as shown in fig. 2, a method for multiplexing hot shoe signal interfaces is defined, and the method includes:
step 202, when the shooting device executes the shooting operation, multiplexing the hot shoe signal interface to transmit at least two pulse signals.
Specifically, the shooting device is used as a load device and is installed on the unmanned aerial vehicle through a connecting device so as to realize electric signal transmission between the shooting device and the unmanned aerial vehicle through the connecting device, wherein a standardized connector is provided with a hot shoe signal interface, and the standardized connector can be in the form of a group of pulse signal transmission pins (namely original hot shoe signal pins) in one connector or a single connecting port.
At least two pulse signals are multiplexed with the pulse signal transmission pin so as to realize the transmission of the at least two pulse signals through the same standardized connector, and the at least two pulse signals can comprise a pulse signal for indicating imaging and a time synchronization pulse signal from the positioning module.
By multiplexing the pulse signal transmission pins, on one hand, compared with the existing signal transmission module, the standard connector and the hardware structure connected with the connector do not need to be changed.
On the other hand, through transmitting two kinds of at least pulse signal, can realize the time alignment of these two kinds of at least signals to satisfy the time synchronization between the functional module that these two kinds of at least pulse signal correspond in the unmanned aerial vehicle system, in order to promote the synchronism of operation execution in the unmanned aerial vehicle system.
On the other hand, for a shooting device applicable to the original hot shoe signal interface, multiplexing of at least two pulse signal transmissions can be realized in a multiplexing mode of the hot shoe signal interface, and further compatibility of existing product applications is realized.
Specifically, in the multiplexing scheme of the present application, the same transmission pins may be multiplexed to transmit the pulse signals, and the existing transmission pins may be further classified to transmit the pulse signals respectively.
Further, the multiplexing hot shoe signal interface transmits at least two pulse signals, which may be transmitted in the same direction or in opposite directions according to different properties of the pulse signals, and when the at least two pulse signals include the above-mentioned pulse signal for indicating imaging and the time synchronization pulse signal from the positioning module, the two pulse signals are transmitted in opposite directions.
As shown in fig. 3, in some embodiments, the method for controlling an unmanned aerial vehicle further includes: when the shooting device carries out the shooting operation, multiplexing hot shoe signal interface transmission at least two kinds of pulse signals specifically include: step 302, when the shooting device executes shooting operation, transmitting a time synchronization pulse signal to the shooting device by adopting a hot shoe signal interface; and step 304, receiving a shooting indication pulse signal sent by the shooting device by adopting a hot shoe signal interface.
The two pulse signals can be transmitted synchronously or asynchronously, when synchronous transmission is carried out, the shooting device directly guides the hot shoe signal through the received time synchronization pulse signal so as to realize high alignment between image shooting and satellite time, and when asynchronous transmission is carried out, the shooting device corrects an operation clock through the received time synchronization pulse signal so as to realize alignment between the hot shoe signal and the time synchronization pulse signal generated during image shooting.
Specifically, the at least two pulse signals may include a pulse signal for indicating imaging (i.e., a hot shoe signal) and a time synchronization pulse signal from the positioning module, wherein the hot shoe signal is transmitted from the camera to the processor of the unmanned aerial vehicle, and the time synchronization pulse signal is transmitted from the positioning module to the processor and then transmitted from the processor to the camera, so as to ensure the high alignment between the image capturing time and the standard time provided by the satellite by aligning the two pulse signals, thereby realizing high-precision mapping activities performed by the unmanned aerial vehicle.
As shown in fig. 5, the transmission mode of the time synchronization pulse signal is a pure time synchronization pulse signal output mode when the shooting operation is not performed, and the time synchronization pulse signal is transmitted to the camera controller inside the shooting device through the hot shoe signal pin, from the perspective of the central processing unit of the unmanned aerial vehicle.
As shown in fig. 6, the transmission mode of the shooting indication pulse signal is a shooting indication pulse signal output mode when a shooting operation is performed, at this time, the hot shoe signal pin is multiplexed to transmit the time synchronization pulse signal to an internal controller of a camera inside the shooting device, and the cathode receives the hot shoe signal sent by the camera controller inside the shooting device through the hot shoe signal pin.
Fig. 7 shows a mode in which the shooting instruction pulse signal is transmitted in synchronization with the time synchronization pulse signal, where the signal transmitted from the unmanned aerial vehicle to the shooting device is the time synchronization pulse signal, and the signal transmitted from the shooting device to the unmanned aerial vehicle is the shooting instruction pulse signal (i.e., the hot shoe signal).
In some embodiments, further comprising: transmitting a time synchronization pulse signal by adopting a first group of pulse signal transmission pins on a hot shoe signal interface; and transmitting a shooting indication pulse signal by adopting a second group of pulse signal transmission pins on the hot shoe signal interface.
Specifically, as an implementation form of multiplexing hot shoe signal interface transmission, pulse signal transmission pins in an interface may be divided into two groups, where one group performs transmission of a time synchronization pulse signal, the other performs transmission of a shooting indication pulse signal (hot shoe signal), and the two groups of signals are transmitted in parallel to realize multiplexing of the hot shoe signal interface.
In some embodiments, further comprising: and controlling a pulse signal transmission pin on a hot shoe signal interface to transmit a time synchronization pulse signal and a shooting indication pulse signal respectively in a pin multiplexing mode.
The shot indication pulse signal, i.e. (hot shoe signal) is a kind of time pulse for indicating imaging, which is indicated by an image processor transmitted to the inside of the camera or the inside of the drone.
Specifically, as a second implementation form of multiplexing hot shoe signal interface transmission, a pin multiplexing manner is adopted to use the same transmission pin to transmit a time synchronization pulse signal and a shooting indication pulse signal (hot shoe signal), wherein a register may be adopted to record different users corresponding to different states of the transmission pin respectively, so as to control multiplexing of the transmission pin to transmit the hot shoe signal and the time synchronization pulse signal respectively.
In some embodiments, further comprising: and controlling a pulse signal transmission pin on a hot shoe signal interface to respectively transmit a time synchronization pulse signal and a shooting indication pulse signal by adopting a time division multiplexing mode.
Specifically, as a third implementation form of multiplexing hot shoe signal interface transmission, a time synchronization pulse signal and a shooting indication pulse signal (hot shoe signal) may be transmitted separately in a time division multiplexing manner, where the time division multiplexing means divides the time provided for transmission of the entire channel (a wired pin formed by a transmission pin) into a plurality of time slices (time slots) to allocate the time slots to each signal source for use, and each signal monopolizes the signal in its own time slot for data transmission.
As shown in fig. 4, in some embodiments, further comprising: and 402, when the shooting device is in an idle state, transmitting a time synchronization pulse signal to the shooting device by adopting a hot shoe signal interface.
Further, when detecting that the shooting device is in an idle state, at this time, because there is no generation of a shooting indication pulse signal (hot shoe signal), the hot shoe signal transmission pin only needs to transmit a time synchronization pulse signal to the controller of the shooting device by the processor of the unmanned aerial vehicle, so that time alignment is performed between the shooting execution time of the shooting device and the positioning module with the time synchronization pulse signal, an image needing to be shot can be accurately shot at a specified position, and the accuracy of shooting control is improved.
In some embodiments, further comprising: the unmanned aerial vehicle is provided with a positioning module, and the positioning module receives a time synchronization pulse signal; and carrying out unified time service operation on the shooting device by using the time synchronization pulse signal.
Specifically, positioning information sent by a satellite is received by a positioning module, the positioning information carries a time synchronization pulse signal representing satellite time, the same time service operation is carried out on a functional unit of the unmanned aerial vehicle, a control functional unit works by taking the time synchronization pulse signal as a standard time signal, the functional unit of the unmanned aerial vehicle can also comprise a data processing unit, a sensing data acquisition unit, a route control unit, a power unit, a remote control unit and the like besides the positioning module, the time synchronization pulse signal is determined according to a method for determining the optimal synchronization pulse signal, so that the unified time service is carried out on a shooting module, a flight control module, an image processing module and the like of the unmanned aerial vehicle, the control of the unmanned aerial vehicle is ensured, the planning of a flight path, the attitude of the unmanned aerial vehicle, the real-time positioning of the unmanned aerial vehicle and the time of triggering a sensor to acquire the sensing data are kept consistent, the method has the advantages that efficient flight is achieved, meanwhile, the moment of collecting the sensing data is kept consistent with the moment of collecting the actual position, so that collection efficiency is improved, furthermore, whether flight routes are corrected or not can be determined according to the sensing data, and due to the consistency of time, correction feedback is timely.
In some embodiments, the positioning module comprises a wireless communication module and/or at least one GNSS positioning module to receive time synchronization pulse signals transmitted by satellites and/or base stations.
At least one GNSS (Global Navigation Satellite System, generally all Satellite Navigation systems) positioning module and/or wireless communication module respectively receives the synchronization pulse signal; specifically, the method comprises the following setting modes: (1) carrying a GNSS positioning module, wherein a synchronous pulse signal acquired by the GNSS positioning module is directly taken as a time synchronous pulse signal, (2) carrying a wireless communication module, wherein network time is directly acquired from a wireless network through the wireless communication module to be taken as a time synchronous pulse signal, (3) carrying a plurality of GNSS positioning modules, wherein the synchronous pulse signal acquired by the GNSS with the best signal in the GNSS positioning modules is taken as the time synchronous pulse signal, (4) carrying a plurality of wireless communication modules, wherein the time signal acquired by the wireless communication module with the best communication quality is taken as the time synchronous pulse signal, (5) carrying a GNSS positioning module and a wireless communication module, wherein the satellite can output a signal with high precision and stability, therefore, the synchronous pulse signal in the GNSS positioning module is preferably taken as the time synchronous pulse signal in most cases, in addition, a GNDD positioning module and a wireless communication module can form an RTK positioning module (Real-time dynamic differential method), specifically, it applies a differential signal depending on a base station, and then calculates a difference on a receiver to calculate a coordinate position, the positioning accuracy of the calculated data can reach centimeter level, for example, the base station has a known position, the base station is closer to the unmanned aerial vehicle, so that the influence of the atmosphere on the base station when receiving satellite signals is basically similar, since the position coordinate of the base station is known, a new difference is made between the obtained coordinate provided by the satellite and the original position coordinate, and the difference result is informed to the unmanned aerial vehicle through wireless communication, so as to achieve the effect of improving the positioning accuracy of the unmanned aerial vehicle, (6) a GNSS positioning module and a plurality of wireless communication modules are mounted, by determining the signals in the GNSS positioning module and the optimal plurality of wireless communication modules, extracting a time signal as a time synchronization pulse signal, (7) carrying a plurality of GNSS positioning modules and a wireless communication module, and determining the synchronization pulse signal in the signal with the highest precision in the plurality of GNSS positioning modules as the time synchronization pulse signal, (8) carrying the plurality of GNSS positioning modules and the plurality of wireless communication modules, and determining the synchronization pulse signal in the signal with the highest precision in the plurality of GNSS positioning modules as the time synchronization pulse signal.
According to different system requirements, various different optimal selection rules can be provided to determine an optimal synchronization pulse signal in the synchronization pulse signals, for example, the optimal synchronization pulse signal is determined according to the signal intensity received by each positioning module, and/or the optimal synchronization pulse signal is determined according to the signal noise carried by each positioning module, for example, the optimal synchronization pulse signal is determined according to the satellite source attribute of communication in the GNSS positioning module, and the optimal synchronization pulse signal can also be determined according to the number of satellites in communication in the GNSS positioning module.
According to the control method of the unmanned aerial vehicle, the optimal synchronization pulse signal is selected as the time synchronization pulse signal through self-synthesis, and the function units are subjected to the same time service, on one hand, the consistency of the time synchronization signal among all the function units in the unmanned aerial vehicle can be achieved, for example, the time consistency of control of traveling flight and system positioning and the time consistency of control of data acquisition and system positioning can be achieved, and further the control precision of operations such as flight control and data acquisition is improved, on the other hand, the error and/or delay probability when the user selects the optimal synchronization pulse signal by self is reduced, and therefore the consistency of actions of all the function modules in the unmanned aerial vehicle is achieved.
In some embodiments, further comprising: and a data selection switch is adopted to control and adjust the conduction direction of a pulse signal transmission pin in the hot shoe signal interface so as to respectively transmit a time synchronization pulse signal and a shooting indication pulse signal.
Specifically, in order to realize multiplexing of hot shoe signal interfaces, the transmission direction of a pulse signal pin and the transmission type of a signal can be determined under different transmission modes by adding a data selection switch, the data selection switch is a logic combination circuit which selects a specified one from a group of input signals according to a given input address code and sends the selected one to an output end, and the transmission of corresponding pulse signals under different transmission modes can be realized by adding the data selection switch and corresponding logic control instructions, so that the improvement mode is simple and the compatibility is high.
In addition, as an alternative to the above embodiment, the data selection switch may also be not added, and the method may be implemented by directly connecting two pins on a controller inside the shooting device, but complex program logic is required to control the pull-up and pull-down of the processor interface to ensure normal transmission of the signal.
In some embodiments, further comprising: acquiring a state identifier of the shooting device by adopting a bus communication protocol; and determining the state information of the shooting device according to the state identifier so as to control the data selection switch to execute the selection operation according to the state information.
Specifically, as a further supplement to how to determine the transmission mode, the state identifier of the shooting device may be obtained through bus communication, for example, whether the shooting device is in a high-level output or a low-level output is detected to determine that the shooting device is in an on state or an off state, so that the signal transmission state of the hot shoe signal interface can be determined according to the obtained state identifier information, and thus a function of controlling the data selection switch based on state detection of the shooting device is realized, and accurate transmission of different pulse signals is further realized.
In some embodiments, further comprising: after sending a shooting instruction to the shooting device, triggering a flash lamp of the shooting device to generate a shooting instruction pulse signal according to the shooting instruction so as to generate a shot image according to the shooting instruction pulse signal.
Specifically, when shooting operation is executed, a flash lamp of the shooting device sends a pulse prompt signal, namely a hot boot signal, to an image processor, and the pulse prompt signal indicates that the shooting device completes imaging at the moment, so that shooting time is fixed, the fixed shooting time is aligned with satellite time through the alignment operation of the hot boot signal and a time synchronization pulse signal, and then a shot image which is accurate at the moment is obtained, so that detection information which is high in accuracy and used for detection is obtained, and finally, the high-accuracy detection function is realized by arranging the shooting device on the existing unmanned aerial vehicle, multiplexing a hot boot signal interface on a connector between the shooting device and the unmanned aerial vehicle and combining an added data selection switch.
In some embodiments, further comprising: the shooting device generates a shot image according to the shooting instruction pulse signal; or the unmanned aerial vehicle generates a shot image according to the shot instruction pulse signal.
Specifically, there may be two setting modes of the imaging module, one is to directly image on the shooting device, and the other is to transmit the shooting data to the unmanned aerial vehicle, and the imaging is realized by the unmanned aerial vehicle, for the first, an image processor is arranged in the shooting device, and for the second, an image processor is arranged on the unmanned aerial vehicle, and based on a shooting instruction pulse signal (hot shoe signal), image data is obtained on the shooting device or obtained on the unmanned aerial vehicle, so as to further derive the data, and in combination with a time synchronization pulse signal transmitted to the shooting device, the height alignment of the image shooting operation and the real-time positioning is realized.
In some embodiments, the performing a unified time service operation on the shooting device by using the time synchronization pulse signal specifically includes: and recording the generation time of the shooting indication pulse signal according to the time synchronization pulse signal so as to synchronize the signals between the positioning module and the shooting device.
Specifically, as an implementation manner of the unified time service operation, the generation time of the shooting instruction pulse signal may be recorded by the time synchronization pulse signal to implement time alignment, and in addition, the control clock of the controller in the shooting device may be corrected by the time synchronization pulse signal to implement time alignment.
In some embodiments, the camera is carried by a cradle head disposed on a fuselage of the unmanned aerial vehicle to adjust an attitude of the camera according to the attitude of the cradle head.
In particular, in some applications, in order to improve the stability of the shooting device during shooting, a cradle head needs to be arranged on the unmanned aerial vehicle, and the shooting device is installed on the cradle head.
In some embodiments, the hot shoe signal interface is disposed on the load interface, the method further comprising: and under the condition that the load interface is not detected to be in a high impedance state, detecting whether the load equipment accessed by the load interface is a shooting device or not according to the type information transmitted by the load interface, and transmitting a time synchronization pulse signal to the shooting device when the load equipment is detected to be the shooting device.
The embodiment of the application provides a control device. Fig. 8 is a structural diagram of a control device according to an embodiment of the present application. The control device according to the present embodiment may perform the control method as described above. As shown in fig. 8, the apparatus in this embodiment may include: a memory 802 and a processor 804.
The Processor 804 may be a Central Processing Unit (CPU), and the Processor 804 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 802 is used for storing the control methods of the program code steps 202 to 402.
As shown in fig. 9, an embodiment of the present application provides an unmanned aerial vehicle including: the aircraft body 90 comprises a power system 902 and a control system 904, wherein the power system 902 is used for providing flight power; the shooting device 100, the shooting device 100 can be electrically connected with the unmanned aerial vehicle through a connector, the connector comprises a hot boot signal interface 906; the control system 904 is specifically configured to: the multiplexed hot shoe signal interface 906 transmits at least two kinds of pulse signals when the photographing apparatus 100 performs a photographing operation.
Specifically, the unmanned aerial vehicle may include an aircraft body 90 and a load device, the load device is specifically the shooting device 100, the aircraft body 90 further includes a power system 902 and a control system 904, wherein the control system 904 controls the hot shoe signal interface 906 to perform multiplexing to perform transmission of at least two pulse signals by using the same signal interface, on one hand, compared with an existing signal transmission module, there is no need to change a connector of the above standard and a hardware structure connected with the connector, on the other hand, by transmitting at least two pulse signals, time alignment of the at least two signals can be achieved to satisfy time synchronization between functional modules corresponding to the at least two pulse signals in the unmanned aerial vehicle system, so as to improve synchronization of operation execution in the unmanned aerial vehicle system, on the other hand, for the shooting device 100 applicable to the original hot shoe signal interface 906, multiplexing of at least two pulse signal transmissions can be realized through a multiplexing form of the hot shoe signal interface 906, and further compatibility for existing product applications is realized.
In an alternative embodiment, the control system 904 is specifically configured to: when the photographing apparatus 100 performs a photographing operation, a hot shoe signal interface 906 is employed to transmit a time synchronization pulse signal to the photographing apparatus 100; and receiving the shooting instruction pulse signal transmitted by the shooting device 100 by using the hot shoe signal interface 906.
Specifically, the at least two pulse signals may include a pulse signal (i.e., a hot shoe signal) for indicating imaging and a time synchronization pulse signal from the positioning module, wherein the hot shoe signal is transmitted from the camera 100 to the processor of the drone, and the time synchronization pulse signal is transmitted from the positioning module to the processor and then transmitted from the processor to the camera 100, so as to ensure a high alignment between the image capturing time and a standard time provided by a satellite by aligning the two pulse signals, thereby realizing a high-precision mapping activity by the unmanned aerial vehicle.
In an alternative embodiment, the control system 904 includes: a positioning module 908 for receiving the time synchronization pulse signal.
Specifically, positioning information sent by a satellite is received by a positioning module, the positioning information carries a time synchronization pulse signal representing satellite time, the same time service operation is carried out on a functional unit of the unmanned aerial vehicle, a control functional unit works by taking the time synchronization pulse signal as a standard time signal, the functional unit of the unmanned aerial vehicle can also comprise a data processing unit, a sensing data acquisition unit, a route control unit, a power unit, a remote control unit and the like besides the positioning module, the time synchronization pulse signal is determined according to a method for determining the optimal synchronization pulse signal, so that the unified time service is carried out on a shooting module, a flight control module, an image processing module and the like of the unmanned aerial vehicle, the control of the unmanned aerial vehicle is ensured, the planning of a flight path, the attitude of the unmanned aerial vehicle, the real-time positioning of the unmanned aerial vehicle and the time of triggering a sensor to acquire the sensing data are kept consistent, the method has the advantages that efficient flight is achieved, meanwhile, the moment of collecting the sensing data is kept consistent with the moment of collecting the actual position, so that collection efficiency is improved, furthermore, whether flight routes are corrected or not can be determined according to the sensing data, and due to the consistency of time, correction feedback is timely.
In an alternative embodiment, the positioning module comprises a wireless communication module and/or at least one GNSS positioning module to receive time synchronization pulse signals transmitted by satellites and/or base stations.
In an alternative embodiment, the control system 904 further comprises: and the central processing unit 9042 is electrically connected with the positioning module and is used for acquiring a time synchronization pulse signal.
The control system 904 may specifically include a central processor 9042 and a flight controller, wherein the flight controller is configured to instruct the unmanned aerial vehicle to fly, and the central processor 9042 is configured to process various data, wherein the central processor 9042 transmits a time synchronization pulse signal to the photographing device 100 through the hot shoe signal interface 906 after receiving the time synchronization pulse signal transmitted by the positioning module.
In an alternative embodiment, the photographing apparatus 100 includes: an internal controller 1002; the control system 904 further includes: and the microcontroller 9044 is electrically connected to the internal controller 1002, and is configured to receive the state information of the shooting device 100 sent by the microcontroller 9044, and generate a selection instruction according to the state information, where the selection instruction is used to control the transmission directions of the time synchronization pulse signal and the shooting instruction pulse signal.
Specifically, the internal controller 1002 of the camera 100 generates a state identifier by detecting the current state of the camera 100, and the microcontroller 9044 in the unmanned aerial vehicle acquires the state identifier of the camera 100 through bus communication, for example, determines that the camera 100 is in an on state or an off state by detecting whether the camera 100 outputs at a high level or a low level, so as to determine the state of the camera 100 according to the acquired state identifier, further generate a selection instruction according to the state, determine the signal transmission state of the hot shoe signal interface 906 through the selection instruction, and thereby implement a function of controlling pulse signal transmission based on state detection of the camera 100.
In an alternative embodiment, the control system 904 further comprises: the data selection switch 9048 is communicatively coupled to the central processing unit 9042, the microcontroller 9044, and the connector, respectively, and the data selection switch 9048 is configured to control and adjust a conduction direction of a pulse signal transmission pin in the hot shoe signal interface 906 according to a selection instruction, so as to transmit the time synchronization pulse signal and the shooting instruction pulse signal, respectively.
Specifically, in order to implement multiplexing of the hot shoe signal interface 906, the data selection switch 9048 may be added to determine the transmission direction of the pulse signal pin and the transmission type of the signal in different transmission modes, the data selection switch 9048 is a logic combination circuit that selects a specified one of a group of input signals to send to the output end according to a given input address code, and the transmission of the corresponding pulse signal in different transmission modes may be implemented by adding the data selection switch 9048 and a corresponding logic control instruction, which is simple in improvement manner and high in compatibility.
Further, the function of controlling the data selection switch 9048 to select the pulse signal is realized by combining the internal controller 1002 of the shooting device 100, the microcontroller 9044 of the control system 904, the central processing unit 9042, and the like, and accurate transmission of different pulse signals is finally realized.
In an alternative embodiment, the control system 904 further comprises: an image processor 9046 for receiving the shooting instruction pulse signal and generating a shot image according to the shooting instruction pulse signal.
Specifically, there may be two setting modes of the imaging module, one is to directly image on the shooting device 100, and the other is to transmit the shooting data to the unmanned aerial vehicle, and the imaging is implemented by the unmanned aerial vehicle, for the first, the image processor 9046 is provided in the shooting device 100, and for the second, the image processor 9046 is provided on the unmanned aerial vehicle, and based on the shooting instruction pulse signal (hot shoe signal), the image data is obtained on the shooting device 100 or the image data is obtained on the unmanned aerial vehicle, so as to further derive the data, and in combination with the time synchronization pulse signal transmitted to the shooting device 100, the height alignment of the image shooting operation and the real-time positioning is implemented.
In an optional embodiment, the photographing apparatus 100 further includes: and a flash 1004 electrically connected to the internal controller 1002 for generating a photographing instruction pulse signal.
Specifically, when a shooting operation is performed, the flash 1004 of the shooting device 100 sends a pulse prompt signal, that is, a hot shoe signal, to the image processor 9046, indicating that the shooting device 100 has completed an imaging operation at that time, so as to freeze the shooting time, and through the above-mentioned alignment operation of the hot shoe signal and the time synchronization pulse signal, the frozen shooting time is aligned with the satellite time, so as to obtain a shot image accurate at that time, so as to obtain detection information for detection with high accuracy, and finally, a function of high-accuracy detection is realized by arranging the shooting device 100 on an existing unmanned aerial vehicle, and by multiplexing a hot shoe signal interface 906 on a connector between the shooting device 100 and the unmanned aerial vehicle, in combination with an added data selection switch 9048.
In some embodiments, the unmanned aerial vehicle further comprises: the GNSS positioning module and/or the wireless communication module are electrically connected with the central processing unit respectively and are used for receiving the synchronous pulse signals respectively; the input end of the data selection switch is also connected with at least one GNSS positioning module and/or wireless communication module which are connected in parallel, the data selection switch is also electrically connected with a central processing unit, and the central processing unit is used for: and after the optimal synchronization pulse signal in the synchronization pulse signals is determined, controlling the data selection switch to be communicated with the GNSS positioning module corresponding to the optimal synchronization pulse signal so as to determine the optimal synchronization pulse signal as a system time synchronization signal.
In some embodiments, the unmanned aerial vehicle is further provided with a standardized load interface, the standardized load interface is used for installing load equipment, and the central processing unit determines the type of a signal to be transmitted by the load interface according to the received type information of the load equipment transmitted by the standardized load interface; the data selection switch is also connected to the standardized load interface and is also used for selecting the pulse width modulation signal or the system time synchronization signal to be transmitted by the load interface according to the type of the signal.
In an optional embodiment, the unmanned aerial vehicle further comprises: the cradle head 110 is used for carrying the shooting device 100, and a connector is arranged on the cradle head 110.
In some embodiments, the photographing apparatus 100 is carried by a cradle head 110 disposed on a fuselage of the unmanned aerial vehicle to adjust an attitude of the photographing apparatus 100 according to the attitude of the cradle head 110.
Specifically, in some applications, in order to improve the stability of the shooting device 100 during shooting, it is also necessary to provide the pan/tilt head 110 on the unmanned aerial vehicle and mount the shooting device 100 on the pan/tilt head 110, and in such a configuration, the connector may be provided on the unmanned aerial vehicle or on the pan/tilt head 110.
Further, in order to achieve synchronization between the shooting operation of the shooting device and the time synchronization pulse signal in the unmanned aerial vehicle, time service processing needs to be performed on the shooting device, an embodiment of the present application provides a time signal time service method, as shown in fig. 10, that defines unified time service for functional units in the unmanned aerial vehicle, and includes:
step 1002, determining a synchronous pulse signal generated by a positioning module as a time synchronous pulse signal;
and 1004, performing unified time service operation on the functional units of the unmanned aerial vehicle by using the time synchronization pulse signals.
Specifically, the control function unit works by taking the time synchronization pulse signal as a standard time signal, the function unit of the unmanned aerial vehicle can also comprise a data processing unit, a sensing data acquisition unit, a route control unit, a power unit, a remote control unit and the like besides the positioning module, the time synchronization pulse signal is determined according to a method for determining the optimal synchronization pulse signal, so as to realize the unified time service of a shooting module, a flight control module, an image processing module and the like of the unmanned aerial vehicle, thereby ensuring the control of the unmanned aerial vehicle, keeping the same time for planning a flight path, the attitude of the unmanned aerial vehicle, the real-time positioning of the unmanned aerial vehicle and triggering the sensor to acquire the sensing data, realizing the high-efficiency flight, the method and the device have the advantages that the moment of collecting the sensing data is kept consistent with the moment of collecting the actual position, so that the collection efficiency is improved, furthermore, whether the flight path is corrected or not can be determined according to the sensing data, and due to the consistency of time, the corrected feedback is more timely.
In some embodiments, the step 1004 further includes: and performing time alignment processing on the sensing data acquired by the unmanned aerial vehicle by using the time synchronization pulse signal.
Specifically, by collecting the sensing data, the current attitude of the unmanned aerial vehicle is determined by the attitude sensor, the flying height of the unmanned aerial vehicle is determined by sending the longitudinal sensing signal, the surrounding environment sensing information is obtained by sending the detection signal, and when the sensing data is collected, if the operation pulse signal at the operation moment of the sensing data is inconsistent with the time pulse signal in the positioning module, the collected sensing data is deviated from the data to be collected, which causes the influence on the data collection efficiency and the data collection effect The positioning position, the unmanned aerial vehicle posture and the acquisition operation height are aligned, so that the aim of improving the data acquisition efficiency and accuracy is fulfilled.
In some embodiments, the step 1004 further includes: when the sensing data is collected through the load equipment, the type of the corresponding indicating signal is determined according to the type of the load equipment, so that time alignment processing is performed according to the indicating signal and the time synchronization pulse signal, and the indicating signal is used for indicating the load equipment to perform collection action.
Specifically, time alignment processing is performed on the sensing data, that is, a trigger pulse signal for triggering execution of the acquisition action and a system time synchronization pulse signal are triggered, and types of the indication signals are different due to different types of load devices, so that the types of the corresponding indication signals are determined by identifying the types of the load devices, and a consistency operation is performed on the indication signals and the time synchronization pulse signals, so that the alignment processing is realized.
For example, in a camera, the indication signal for indicating imaging is a hot shoe signal.
As shown in fig. 19, in some embodiments, determining the type of the corresponding indication signal according to the type of the load device specifically includes: extracting type information carried in a pulse signal transmitted to a flight controller by a load interface of load equipment; the central processing unit delays to receive the type information transmitted by the flight controller; when the load equipment of which the type information is the required pulse width modulation signal is identified, the type information comprises identification process information and identification result information, and the level selection signal of the pulse width modulation signal corresponding to the identification result information is controlled to be output to a corresponding data selection switch; when the load equipment of which the type information is the required time synchronization pulse signal is identified, the type information comprises identification result information, and the level selection signal of the time synchronization pulse signal corresponding to the identification result information is controlled to be output to the corresponding data selection switch.
In some embodiments, the step 1004 further includes: time-track correction is performed on the stored image data based on the time synchronization pulse signal.
Specifically, as an implementation manner of using the time synchronization pulse signal to perform the time alignment processing on the sensing data acquired by the unmanned aerial vehicle, in addition to correcting the sensing data or the control instruction execution time according to the time synchronization pulse signal, time orbit correction may be performed on the already stored sensing data (including image data and the like) to achieve consistency of the image data acquired before and after.
In some embodiments, the performing the temporal trajectory correction on the stored image data according to the time synchronization pulse signal specifically includes: and executing time track correction operation according to the difference value between the time synchronization pulse signal and the time signal during image data acquisition.
In some embodiments, the step 1004 further includes: and controlling an image sensor carried by the unmanned aerial vehicle to synchronously execute image acquisition operation according to the time synchronization pulse signal, wherein the image sensor comprises a shooting device.
Specifically, as a main implementation mode through unmanned aerial vehicle survey and drawing, gather image information through the shooting device, carry out time alignment ization processing through the hot boot signal of the shooting device that controls formation of image according to time synchronization pulse signal this moment to the realization is that the locating information that obtains is unanimous with the moment of carrying out the shooting operation at the assigned position, thereby guarantees image information acquisition's accuracy.
For the camera, each hot shoe signal corresponds to one acquired image, and for the video camera, each group of hot shoe signals corresponds to the acquisition time and the acquisition ending time of the video.
Taking a camera as an example, the time axis of image data collected by the camera is aligned with the time axis of a flight control system and the time axis in a positioning module, so that the synchronous pulse signals of the positioning module, the control information in the flight control system is aligned with the height of the image collected signals, a user does not need to perform differential operation aiming at errors, the user surveying and mapping activity is simplified, the user surveying and mapping efficiency is improved, manual control of the user is not needed for switching the synchronous pulse signals, the unmanned aerial vehicle automatically and comprehensively selects the signal source of the synchronous pulse signals through data such as the signal intensity of a sensor and the positioning module, and the user experience and the synchronization precision of system PPS signals are improved.
In some embodiments, when the load interface is a hot shoe signal interface, the shooting instruction pulse signal sent by the shooting device is received by using the hot shoe signal interface when the shooting operation is performed while the system time synchronization signal is transmitted to the shooting device through the hot shoe signal interface.
In some embodiments, the step 1004 further includes: and controlling an attitude sensor to synchronously acquire attitude information according to the time synchronization pulse signal.
Specifically, as another specific implementation way for performing time alignment processing on sensing data acquired by the unmanned aerial vehicle by using a time synchronization pulse signal, the time alignment between the time synchronization pulse signal and attitude information in the attitude sensor is realized by performing acquisition time on the attitude sensor according to the time synchronization pulse signal, so that the attitude information of a user at a certain position can be accurately sensed, and in combination with acquisition operations of other sensing data, required sensing data (including image data, radar detection data and the like) can be acquired at a specified position and a specified attitude, so that the sensing data can be accurately acquired.
In some embodiments, the step 204 further includes: the using of the time synchronization pulse signal to perform time alignment processing on the sensing data acquired by the unmanned aerial vehicle specifically includes: and controlling a radar carried by the unmanned aerial vehicle to send a wireless detection signal according to the time synchronization pulse signal.
Specifically, as another specific implementation manner of using the time synchronization pulse signal to perform time alignment processing on the sensing data acquired by the unmanned aerial vehicle, the radar detection at least includes static radar detection, dynamic radar detection (radar detection is detection of a surrounding static obstacle) and dynamic radar tracking, when the radar detection is performed, a radar trigger pulse signal is sent according to the determined time synchronization pulse signal, so as to trigger and send the radar detection signal through the radar trigger pulse signal, so as to obtain radar detection information according to a feedback signal of the detection signal, and by synchronously sending the radar trigger pulse signal according to the time synchronization pulse signal, so as to achieve time alignment between the position information of the unmanned aerial vehicle and the radar detection information, so as to improve accuracy of the radar detection.
Further, use time synchronization pulse signal to carry out the alignment to radar detection and handle better obvious at dynamic radar detection and dynamic radar tracking in-process effect, combine foretell RTK orientation module, when realizing the accurate positioning, position information based on the location uses time synchronization pulse signal to trigger the radar and sends wireless detection signal, with the assurance that the unmanned aerial vehicle position that carries the radar confirms and send wireless detection signal's uniformity, on the one hand, can reduce dynamic radar detection and radar tracking's error, on the other hand, because unmanned aerial vehicle's position information's error reduces, correspondingly just promote the accuracy of tracking, combine the synchronism of position detection, can more accurately confirm the position information of tracking the target.
In some embodiments, the step 1004 further includes: and controlling a surveying instrument carried by the unmanned aerial vehicle to acquire surveying and mapping data according to the time synchronization pulse signal.
Specifically, as another specific implementation way of performing time alignment processing on sensing data acquired by the unmanned aerial vehicle by using the time synchronization pulse signal, the sensing device may also be a detecting instrument, the radar may serve as a detection device of the detecting instrument, the detecting instrument may further include a metal detecting instrument, a life detecting instrument, and detection information according to which accurate position information is obtained, so that detection accuracy can be improved, and particularly when vital signs are detected, the life position can be accurately detected by combining with the RTK positioning module.
In some embodiments, the step 1004 further includes: and controlling a sound pickup carried by the unmanned aerial vehicle to collect audio data according to the time synchronization pulse signal.
Specifically, as another specific implementation way of performing time alignment processing on sensing data acquired by the unmanned aerial vehicle by using the time synchronization pulse signal, in some use occasions, sound information needs to be synchronously extracted, and at this time, synchronous sound pickup is realized by using the time synchronization pulse signal, so as to meet the requirement of synchronous sound pickup.
As shown in fig. 13, in some embodiments, the step 1004 further includes: and controlling the flight position, the flight attitude and the image shooting action of the unmanned aerial vehicle to be synchronously executed according to the time synchronization pulse signal.
Specifically, as a more accurate image acquisition mode, the flight control, the acquisition of the flight attitude and the image shooting action are highly aligned, wherein the flight control module can directly obtain an optimal synchronous pulse signal, and the attitude sensor and the image sensor are time aligned by adopting the signal, so that the image acquisition is synchronously performed while the real-time position and the real-time attitude of the unmanned aerial vehicle are determined, and a detection image with the highest accuracy is obtained, thereby omitting the step of correcting by a user.
In some embodiments, the step 1004 further includes: and controlling the flight controller and the image sensor to be aligned with the associated vision sensor in time according to the time synchronization pulse signal.
After the image is acquired by the image sensor or the image sensor, the image is detected by the vision sensor and compared with the set image information to determine whether the image meets the requirements. In some embodiments, the step 1002 specifically includes: at least one GNSS (Global Navigation Satellite System, generally all Satellite Navigation systems) positioning module and/or wireless communication module respectively receives the synchronization pulse signal; specifically, the method comprises the following setting modes: (1) carrying a GNSS positioning module, wherein a synchronous pulse signal acquired by the GNSS positioning module is directly taken as a time synchronous pulse signal, (2) carrying a wireless communication module, wherein network time is directly acquired from a wireless network through the wireless communication module to be taken as a time synchronous pulse signal, (3) carrying a plurality of GNSS positioning modules, wherein the synchronous pulse signal acquired by the GNSS with the best signal in the GNSS positioning modules is taken as the time synchronous pulse signal, (4) carrying a plurality of wireless communication modules, wherein the time signal acquired by the wireless communication module with the best communication quality is taken as the time synchronous pulse signal, (5) carrying a GNSS positioning module and a wireless communication module, wherein the satellite can output a signal with high precision and stability, therefore, the synchronous pulse signal in the GNSS positioning module is preferably taken as the time synchronous pulse signal in most cases, in addition, a GNSS positioning module and a wireless communication module can form an RTK positioning module (Real-time kinematic differential method), and specifically, it applies a differential signal depending on a base station, and then calculates a coordinate position by subtracting on a receiver, and the positioning accuracy of the calculated data can reach centimeter level, for example, a base station with a known position is provided, and the base station is closer to the unmanned aerial vehicle, so that the influence of the atmosphere on the base station when receiving satellite signals is basically similar, because the position coordinates of the base station are known, a new difference is made between the obtained coordinates provided by the satellite and the original position coordinates, and the difference result is notified to the unmanned aerial vehicle through wireless communication, so as to achieve the effect of improving the positioning accuracy of the unmanned aerial vehicle, (6) a GNSS positioning module and a plurality of wireless communication modules are mounted, and by determining the signals in the GNSS positioning module and the optimal plurality of wireless communication modules, extracting a time signal as a time synchronization pulse signal, (7) carrying a plurality of GNSS positioning modules and a wireless communication module, and determining the synchronization pulse signal in the signal with the highest precision in the plurality of GNSS positioning modules as the time synchronization pulse signal, (8) carrying the plurality of GNSS positioning modules and the plurality of wireless communication modules, and determining the synchronization pulse signal in the signal with the highest precision in the plurality of GNSS positioning modules as the time synchronization pulse signal.
Determining the optimal synchronization pulse signal in the synchronization pulse signals as a time synchronization pulse signal;
specifically, according to different system requirements, there may be a plurality of different optimal selection rules to determine an optimal synchronization pulse signal in the synchronization pulse signals, for example, determine the optimal synchronization pulse signal according to the signal strength received by each positioning module, and/or determine the optimal synchronization pulse signal according to the magnitude of the signal-to-noise ratio carried by each positioning module, for example, determine the optimal synchronization pulse signal according to the satellite source attribute of communication in the GNSS positioning module, and also determine the optimal synchronization pulse signal according to the number of satellites in communication in the GNSS positioning module.
In the time signal timing method provided by the embodiment of the application, the optimal synchronization pulse signal is selected as the time synchronization pulse signal by self-synthesis, so that the function units are timed in the same manner, on one hand, the consistency of the time synchronization signal among all the function units in the unmanned aerial vehicle can be realized, for example, the time consistency of control of traveling flight and system positioning and the time consistency of control of data acquisition and system positioning can be realized, and further, the control precision of operations such as flight control and data acquisition is improved, on the other hand, the error and/or delay probability when the user selects the optimal synchronization pulse signal by self is reduced, and therefore, the consistency of actions of all the function modules in the unmanned aerial vehicle is realized.
In some embodiments, as the switching condition of the time synchronization pulse signal, further comprising: in the process of carrying out unified time service operation on the functional units of the unmanned aerial vehicle by adopting the time synchronization pulse signals, detecting the signal-to-noise ratio of the time synchronization pulse signals and the signal-to-noise ratios of the synchronization pulse signals in other positioning modules in real time; in case a synchronization pulse signal with a higher signal to noise ratio is detected, the synchronization pulse signal with the higher signal to noise ratio is switched to a time synchronization pulse signal.
As shown in fig. 18, in which the signal-to-noise ratio (SNR) of the output of the positioning module is represented by using the duty ratio of the pulse signal, the SNR in the positioning module 1 is high, and when the SNR of the positioning module 2 is low, the central processing unit outputs a low level to the data selection switch to adopt the synchronization pulse signal of the positioning module 1 as the time synchronization pulse signal; when the SNR in the positioning module 2 is high, the central processing unit outputs a high level to the data selection switch to use the synchronization pulse signal of the positioning module 2 as the time synchronization pulse signal. In the embodiment shown in fig. 19, a one-way processor control signal is used to select between two different positioning modules as the synchronization signal for system time. When there are multiple positioning modules, a multipath processor control signal is used to select between two different positioning modules as a synchronization signal for system time.
In some embodiments, switching the synchronization pulse signal with the higher signal-to-noise ratio to the time synchronization pulse signal specifically includes: and sending a switching instruction of a high-low level signal to a corresponding data selection switch so as to control the input source of the switching time synchronization pulse signal.
In some embodiments, the determining an optimal synchronization pulse signal in the synchronization pulse signals as the time synchronization pulse signal specifically includes: for the GNSS positioning modules, analyzing the satellite source attribute, the satellite source number, the signal intensity and the signal-to-noise ratio of the positioning signals received by each GNSS positioning module; and determining the optimal synchronization pulse signal according to at least one of the satellite source attribute, the satellite source number, the signal strength and the signal-to-noise ratio.
Specifically, because the positioning system that different orientation module adopted is different, specifically can include GPS orientation module, big dipper satellite navigation module, GLONASS orientation module and Galileo satellite navigation module etc., because the satellite source is different, it is different at the region that unmanned vehicles is located, the precision of the orientation information that obtains through different orientation module also has the difference in fact, in addition, the intensity and the SNR of orientation signal also can influence the accuracy of orientation information, because the orientation information carries the synchronization pulse signal, therefore, confirm the optimum synchronization pulse signal based on the signal information of sending end, be favorable to promoting the accuracy of time synchronization pulse signal, thereby reduce system synchronization operation's error.
In some embodiments, the determining an optimal synchronization pulse signal according to at least one of the satellite source attribute, the number of satellite sources, the signal strength, and the signal-to-noise ratio specifically includes: and determining the optimal synchronous pulse signal according to the signal intensity, the corresponding weight value, the signal-to-noise ratio and the corresponding weight value.
Specifically, as a simpler and reliable determination method of the optimal synchronization pulse signal, the accuracy of the positioning signal may be determined based on only the signal strength and the preset weight value, the signal-to-noise ratio and the preset weight value, so as to determine the positioning module with the highest accuracy, and use the synchronization pulse signal of the positioning module as the optimal synchronization pulse signal, which is simple in determination method and high in reliability.
In some embodiments, the determining an optimal synchronization pulse signal in the synchronization pulse signals as the time synchronization pulse signal specifically includes: and determining a preferred positioning module in the plurality of positioning modules according to the working condition information and the environment sensing information of the unmanned aerial vehicle so as to determine the synchronous pulse signal of the preferred positioning module as an optimal synchronous pulse.
Specifically, the operating mode information of the aircraft includes flight speed, flight attitude, flight altitude and the like, the environment sensing information is obtained through an environment sensor arranged on the unmanned aircraft, the environment sensor can include an air humidity sensor, an atmospheric environment sensor, a rainfall sensor, a detection radar and the like, the optimal synchronous pulse signal mode is determined based on the operating mode information and the environment sensing information of the unmanned aircraft, and the adaptability of the better environment is achieved.
In some embodiments, the determining an optimal synchronization pulse signal in the synchronization pulse signals as the time synchronization pulse signal specifically includes: and determining the optimal synchronization pulse signal according to the signal intensity and the signal-to-noise ratio of the synchronization pulse signal, the working condition information of the unmanned aerial vehicle and the environment sensing information.
In an alternative embodiment, at least one of the positioning modules includes a GNSS positioning module and an RTK positioning module.
In an alternative embodiment, the GNSS positioning module comprises at least one of a GPS positioning module, a beidou satellite navigation module, a GLONASS positioning module, and a galileo satellite navigation module.
An embodiment of the present application further provides a method for switching a time synchronization pulse signal, as shown in fig. 11, where a switching manner of the time synchronization pulse signal under a scenario with at least one positioning module is defined, and the method includes:
1102, the at least one GNSS positioning module and/or the wireless communication module respectively receive a synchronization pulse signal
And 1104, determining an optimal synchronization pulse signal in the synchronization pulse signals as the time synchronization pulse signal.
As shown in fig. 12, in some embodiments, step 1102 specifically includes: step 1202, for the GNSS positioning modules, analyzing the satellite source attribute, the number of satellite sources, the signal strength, and the signal-to-noise ratio of the positioning signal received by each GNSS positioning module; step 1204, determining the optimal synchronization pulse signal according to at least one of the satellite source attributes, the number of the satellite sources, the signal strength and the signal-to-noise ratio.
In some embodiments, step 1204 specifically includes: and determining the optimal synchronization pulse signal according to the signal intensity and the corresponding weight value, and the signal-to-noise ratio and the corresponding weight value.
In some embodiments, step 1102 specifically includes: and determining a preferred positioning module in the plurality of positioning modules according to the working condition information and the environment sensing information of the unmanned aerial vehicle so as to determine the synchronous pulse signal of the preferred positioning module as the optimal synchronous pulse.
In some embodiments, step 1102 specifically includes: and determining the optimal synchronization pulse signal according to the signal intensity and the signal-to-noise ratio of the synchronization pulse signal, the working condition information of the unmanned aerial vehicle and the environment sensing information.
In an alternative embodiment, at least one of the positioning modules includes a GNSS positioning module and an RTK positioning module.
In an alternative embodiment, the GNSS positioning module comprises at least one of a GPS positioning module, a beidou satellite navigation module, a GLONASS positioning module, and a galileo satellite navigation module.
As shown in fig. 14, an embodiment of the present application provides a control system, including: and the central processing unit 1402 is used for performing unified time service operation on the functional unit 1412 of the unmanned aerial vehicle by using the time synchronization pulse signal.
In an alternative embodiment: the positioning module comprises at least one GNSS positioning module and/or wireless communication module, which are electrically connected to the central processor 1402, respectively, and are configured to receive the synchronization pulse signals, respectively; the input end of the data selection switch 1410 is connected with at least one GNSS positioning module and/or wireless communication module connected in parallel, the data selection switch 1410 is further electrically connected with the central processor 1402, and the central processor 1402 is configured to: after the optimal synchronization pulse signal in the synchronization pulse signals is determined, the data selection switch 1410 is controlled to communicate with the GNSS positioning module corresponding to the optimal synchronization pulse signal, so as to determine the optimal synchronization pulse signal as the time synchronization pulse signal.
As shown in fig. 14, the plurality of positioning modules includes a positioning module 1404, a positioning module 1406, and a positioning module 1408 to determine an optimal positioning module of the plurality of positioning modules.
In an alternative embodiment, at least one sensor module is connected to an output terminal of the data selection switch 1410, and is configured to receive a time synchronization pulse signal, and perform time alignment processing on the sensing data acquired by the sensor module using the time synchronization pulse signal.
In an alternative embodiment, the sensor module includes at least one of a camera, a video camera, a vision sensor, a posture sensor, a microphone, a radar, and a surveying instrument.
In an alternative embodiment, central processor 1402 is further configured to: analyzing the satellite source attribute, the satellite source number, the signal intensity and the signal-to-noise ratio of the positioning signal received by each GNSS positioning module; and determining the optimal synchronization pulse signal according to at least one of the satellite source attribute, the satellite source number, the signal strength and the signal-to-noise ratio.
In an alternative embodiment, central processor 1402 is further configured to: and determining a preferred positioning module in the plurality of positioning modules according to the working condition information and the environment sensing information of the unmanned aerial vehicle so as to determine the synchronous pulse signal of the preferred positioning module as an optimal synchronous pulse signal.
In an optional embodiment, further comprising: and the flight control module is connected with the output end of the data selection switch 1410 and used for receiving the time synchronization pulse signal and performing time alignment processing on the flight control by using the time synchronization pulse signal.
Specifically, a processor of each functional module in the unmanned aerial vehicle system is in PPS signal communication with a positioning module in the unmanned aerial vehicle;
the positioning module is communicated with the satellite, and the satellite can output the most accurate signals with the best long-term stability, the number of the satellites, the position, the ephemeris and other information from the satellite to the unmanned aerial vehicle;
after receiving the selected optimal synchronous pulse signal, a processor in each functional module processes the received sensor information and carries out time correspondence in the stored information;
the sensing data acquired after the unmanned aerial vehicle lands in flight activities such as surveying and mapping can be highly aligned with the position information of the acquired position points.
The intelligent selection of the optimal synchronous pulse signal is that serial port data communication is carried out through a central processing unit 1402 of the unmanned aerial vehicle and each positioning module of the airplane, the central processing unit 1402 sends back satellite types and quantity, positioning received signal strength, received signal-to-noise ratio and the like through each positioning module, the current flight state and surrounding environment sensing information are needed, the optimal synchronous pulse signal in a plurality of positioning modules is dynamically selected through controlling a data selection switch 1410 after data synthesis, and therefore dynamic, intelligent, comprehensive and accurate PPS signal automatic selection without user intervention is achieved.
In an optional embodiment, the unmanned aerial vehicle is provided with a shooting device, a hot shoe signal interface is arranged on a connector between the shooting device and the unmanned aerial vehicle, and the hot shoe signal interface is multiplexed to transmit at least two pulse signals comprising time synchronization pulse signals; the data selection switch is connected to the hot shoe signal interface and is also used for selecting the time synchronization pulse signal and/or the shooting indication pulse signal to transmit through the hot shoe signal interface.
Specifically, taking the shooting operation as an example, the at least two pulse signals are a time synchronization signal (i.e. an optimal time synchronization pulse signal) and a shooting instruction pulse signal for instructing to perform a shooting action, where the time synchronization pulse signal is transmitted from the unmanned aerial vehicle to the shooting device through the hot shoe signal interface, and the shooting instruction pulse signal is transmitted to the unmanned aerial vehicle through the hot shoe signal interface to instruct imaging.
In addition, the data rotation switch in this embodiment may be shared with the data selection switch for selecting the optimum synchronization pulse signal described above, or may be a data selection switch provided separately.
In an optional embodiment, the unmanned aerial vehicle is further provided with a standardized load interface, the standardized load interface is used for installing load equipment, and the central processing unit determines the type of a signal to be transmitted by the load interface according to the received type information of the load equipment transmitted by the standardized load interface; the data selection switch is also connected to the standardized load interface and is also used for selecting the pulse width modulation signal or the time synchronization pulse signal to be transmitted by the load interface according to the type of the signal.
Further, in order to ensure that the time synchronization pulse signal is transmitted to the shooting device, after the load device is inserted into the load interface, the type information of the load device is received to determine the type of the pulse signal which is transmitted to the load device and is matched with the type, for example, for the load device needing time service, the time synchronization pulse signal or the flight control sensing signal needs to be transmitted, and for the load device not needing time service, the pulse width modulation signal can be directly transmitted.
Further, based on an application scenario of determining a load device load type, an embodiment of the present application further provides a control method of an unmanned aerial vehicle, as shown in fig. 15, including:
step 1502, identifying type information of load equipment;
step 1504, determining the type of the signal transmitted by the designated port on the load interface according to the type information.
In the embodiment, for the standardized interface on the unmanned aerial vehicle, after the load equipment is plugged in, the type identification of the load equipment is used for determining whether a flight control perception synchronous signal or a pulse width modulation signal for indicating synchronization is output to the load equipment or not, so that the standardized interface is multiplexed.
In addition to the automatic intelligent identification of the device, the load may also push the load information of the load itself to a mobile device (e.g., a mobile phone) application program connected to the remote controller through a wireless communication link between the remote controller and the aircraft, and the identification of the load is realized in the application of the mobile device. However, this method has a long communication delay, and when the surrounding communication channel environment is not good, communication data errors or communication failures may occur, which affects user experience.
This application is through appointed port pin multiplex, receive the load type information of via appointed port pin transmission, in order to carry out intelligent load discernment, the demand that satisfies flight control perception synchronizing signal output under the prerequisite that need not to change appointed port has been realized, and carry out intelligent load discernment through communication and carry out automatic switch-over, the user has been removed from and has been switched over the puzzlement of output mode by oneself, the risk of damaging the load under the unmatched condition of load mode has also been eliminated, appointed port change cost has been saved, user experience of using has been improved.
In some embodiments, further comprising: and detecting the state of the load designated port to determine whether the load designated port is accessed to the load equipment according to the detection result.
In some embodiments, detecting the state of the load-designated port to determine whether the load-designated port is connected to the load device according to the detection result specifically includes: and detecting whether the load designated port is in a high impedance state, and determining that the load designated port is accessed to the load equipment when detecting that the load designated port is not in the high impedance state.
In some embodiments, identifying the type information of the load device specifically includes: and acquiring the equipment information of the load equipment, and determining the type information according to the equipment information.
In some embodiments, obtaining the device information of the load device, and determining the type information according to the device information specifically includes: and detecting whether the device parameters in the device information are matched with the pre-stored type parameters or not, and determining the type information according to the type parameters when the device parameters are detected to be matched with the type parameters.
In some embodiments, obtaining the device information of the load device, and determining the type information according to the device information specifically further includes: and determining whether the load equipment is an inductive load according to the equipment information.
In some embodiments, determining the type of the signal transmitted by the designated port on the load interface according to the type information specifically includes: the signal type comprises a flight control sensing synchronous signal and a pulse width modulation signal; and when the load equipment is determined to be the inductive load, transmitting a flight control sensing synchronous signal to the load equipment through the designated port.
According to the method, the pin multiplexing and intelligent identification switch control are adopted, the requirement for outputting the flight control sensing synchronous signals is met in the pin multiplexing mode on the premise that an interface is not required to be changed, the intelligent load identification mode is automatically switched through communication, the trouble that a user automatically switches the output mode is avoided, and the risk of load damage under the condition that the load modes are not matched is eliminated.
This application has add a data selection switch on the pin of the standardized appointed port of unmanned aerial vehicle, has a pulse width modulation signal appointed port in this appointed port standard definition, and a pulse width modulation signal pin of flight control links to each other with data selection switch, flies to control perception synchronizing signal promptly and flies to control the pulse width modulation signal of output and multiplex.
When the accessory load is not connected, the designated port does not output and is in a high-impedance state. For the control of the switch, the external load transmits the self equipment information to the flight control through a serial port data specified port on the original standardized specified port, a software development kit is operated in the flight control system, the load type is confirmed through the software development kit, the load identification result is provided for an unmanned aerial vehicle microcontroller, and if the load is a load (such as an external vision module) requiring a flight control sensing synchronous signal, the microcontroller controls a data selection switch to output the flight control sensing synchronous signal; if the load is determined to be the load requiring the PWM signal, the microcontroller controls the data selection switch to output the PWM signal.
The entire multiplexed signal chain that can output the pulse width signal/flight sensing synchronization signal is shown in fig. 17. A program flow diagram of a software development kit within the flight control is shown in fig. 16 below.
As shown in fig. 16, a load identification method according to the present application includes:
step 1602, detecting whether a load signal is accessed, if the detection result is yes, entering step 1604, and if the detection result is no, entering step 1614;
step 1604, detecting whether the load equipment needs to fly the sensing synchronization signal according to the load signal, if the detection result is yes, entering step 1606, and if the detection result is no, entering step 1610;
step 1606, the load device demands the flight sensing synchronization signal, and goes to step 1608;
step 1608, outputting the flight control sensing synchronization signal to the load device;
step 1610, the load device requests a pwm signal and proceeds to step 1612;
step 1612, outputting the pulse width modulated signal to a load device;
step 1614, the load device does not require an adjustment signal and the process goes to step 1616;
step 1616, no output.
In some embodiments, further comprising: and controlling the inductive load to acquire inductive information by adopting the flight control sensing synchronous signal so as to guide flight control according to the inductive information.
In some embodiments, the method for controlling the inductive load to acquire the inductive information by using the flight control sensing synchronization signal to guide flight control according to the inductive information specifically includes: the sensing type load comprises a visual information sensing load, and the visual information sensing load is controlled by adopting the flight control sensing signal to collect visual information so as to synchronously adjust the flight control signal according to the visual information.
In some embodiments, the method for controlling the inductive load to acquire the inductive information by using the flight control sensing synchronization signal to guide flight control according to the inductive information specifically includes: the inductive load comprises a detection information inductive load, and the detection information inductive load is controlled by the flight control sensing signal to collect detection information so as to synchronously adjust the flight control signal according to the detection information.
In some embodiments, the method for controlling the inductive load to acquire the inductive information by using the flight control sensing synchronization signal to guide flight control according to the inductive information specifically includes: the inductive load comprises an attitude information inductive load, and the attitude information inductive load is controlled by adopting the flight control sensing signal to acquire the attitude information of the unmanned aerial vehicle so as to synchronously adjust the flight control signal according to the attitude information.
In some embodiments, determining the type of the signal transmitted by the designated port on the load interface according to the type information specifically further includes: and when the load equipment is determined to be the non-inductive load, transmitting a pulse width adjusting signal to the load equipment through the designated port.
In some embodiments, the non-inductive load comprises an electric motor.
In some embodiments, further comprising: the data selection switch is used to select the type of signal to be transmitted through the designated port.
In some embodiments, the load interface is a standard interface for an unmanned aerial vehicle.
In some embodiments, the designated port is a serial port.
According to the application scenario of the load device load type-based determination, an unmanned aerial vehicle is further provided, which includes: the aircraft body comprises a power system and a control system, wherein the power system is used for providing flight power; the load interface can be arranged on the aircraft body and is electrically connected with the power system; load equipment can install on the aircraft body through the load interface, and control system specifically is used for: identifying type information of the load device; and determining the type of the signal transmitted by the appointed port on the load interface according to the type information.
In some embodiments, the load device comprises an inductive load, wherein the flight-aware synchronization signal is transmitted to the load device through the designated port when the load device is determined to be the inductive load, and the pulse-width adjustment signal is transmitted to the load device through the designated port when the load device is determined to be the non-inductive load.
In some embodiments, the inductive load comprises at least one of a visual information inductive load, a probe information inductive load, and a gesture information inductive load.
In some embodiments, the control system further comprises: and the central processing unit is used for determining and generating a flight control sensing synchronous signal or a pulse width adjusting signal according to the type information of the load equipment.
In some embodiments, the control system further comprises: the microcontroller is electrically connected with the central processing unit and used for receiving the type information so as to generate a corresponding control signal according to the type information; and the data selection switch is respectively electrically connected with the central processing unit, the microcontroller and the load interface and is used for controlling the transmission of the flight control sensing synchronous signal or the pulse width adjusting signal through the designated port according to the control signal.
In some embodiments, the load interface is a standard interface for an unmanned aerial vehicle.
In some embodiments, the designated port is a serial port.
The embodiment of the application also provides an unmanned aerial vehicle which comprises the control system of the unmanned aerial vehicle in any one of the embodiments.
Embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the timing method and/or the signal switching method in the above embodiments.
Further, it will be understood that any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and that the scope of the preferred embodiments of the present invention includes additional implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware that is related to instructions of a program, and the program may be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a separate product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (30)

1. A control method of an unmanned aerial vehicle, wherein the unmanned aerial vehicle is provided with a shooting device, and a hot boot signal interface is arranged on a connector between the shooting device and the unmanned aerial vehicle, and the method comprises the following steps:
and when the shooting device executes shooting operation, multiplexing the hot shoe signal interface to transmit at least two pulse signals.
2. The control method according to claim 1, wherein multiplexing the hot shoe signal interface to transmit at least two pulse signals when the photographing device performs a photographing operation includes:
when the shooting device executes shooting operation, transmitting a time synchronization pulse signal to the shooting device by adopting the hot shoe signal interface; and
and receiving a shooting indication pulse signal sent by the shooting device by adopting the hot shoe signal interface.
3. The control method according to claim 2, characterized by further comprising:
transmitting the time synchronization pulse signal by adopting a first group of pulse signal transmission pins on the hot shoe signal interface; and
and transmitting the shooting indication pulse signal by adopting a second group of pulse signal transmission pins on the hot shoe signal interface.
4. The control method according to claim 2, characterized by further comprising:
and controlling a pulse signal transmission pin on the hot shoe signal interface to transmit the time synchronization pulse signal and the shooting indication pulse signal respectively in a pin multiplexing mode.
5. The control method according to claim 2, characterized by further comprising:
and controlling a pulse signal transmission pin on the hot shoe signal interface to transmit the time synchronization pulse signal and the shooting indication pulse signal respectively in a time division multiplexing mode.
6. The control method according to any one of claims 2 to 5, characterized by further comprising:
and when the shooting device is in an idle state, the hot shoe signal interface is adopted to transmit the time synchronization pulse signal to the shooting device.
7. The control method according to any one of claims 2 to 6, characterized by further comprising:
the unmanned aerial vehicle is provided with a positioning module, and the positioning module receives the time synchronization pulse signal;
and carrying out unified time service operation on the shooting device by using the time synchronization pulse signal.
8. The control method according to claim 7,
the positioning module comprises a wireless communication module and/or at least one GNSS positioning module to receive the time synchronization pulse signals transmitted by satellites and/or base stations.
9. The control method according to claim 8, wherein the unified time service operation for the image capturing device by using the time synchronization pulse signal specifically includes:
the at least one GNSS positioning module and/or the wireless communication module respectively receive a synchronization pulse signal;
and determining the optimal synchronization pulse signal in the synchronization pulse signals as the time synchronization pulse signal.
10. The control method according to any one of claims 2 to 9, characterized by further comprising:
and adopting a data selection switch to control and adjust the conduction direction of a pulse signal transmission pin in the hot shoe signal interface so as to respectively transmit the time synchronization pulse signal and the shooting indication pulse signal.
11. The control method according to claim 10, characterized by further comprising:
acquiring a state identifier of the shooting device by adopting a bus communication protocol;
and determining the state information of the shooting device according to the state identifier so as to control the data selection switch to execute selection operation according to the state information.
12. The control method according to any one of claims 2 to 10, characterized by further comprising:
after a shooting instruction is sent to the shooting device, a flash lamp of the shooting device is triggered to generate the shooting instruction pulse signal according to the shooting instruction, and a shot image is generated according to the shooting instruction pulse signal.
13. The control method according to claim 12, characterized by further comprising:
the shooting device generates the shot image according to the shooting instruction pulse signal; or
And the unmanned aerial vehicle generates the shot image according to the shot instruction pulse signal.
14. The method according to any one of claims 7 to 9, wherein the performing a unified time service operation on the image capturing device using the time synchronization pulse signal specifically includes:
and recording the generation time of the shooting indication pulse signal according to the time synchronization pulse signal so as to synchronize the signals between the positioning module and the shooting device.
15. The control method according to any one of claims 1 to 14,
the shooting device is carried by a cradle head arranged on the unmanned aerial vehicle body, so that the posture of the shooting device is adjusted according to the posture of the cradle head.
16. The control method of any one of claims 2 to 15, wherein the hot shoe signal interface is disposed on a load interface, the method further comprising:
under the condition that the load interface is not detected to be in a high impedance state, whether the load equipment accessed by the load interface is the shooting device or not is detected according to the type information transmitted by the load interface, and when the load equipment is detected to be the shooting device, a time synchronization pulse signal is transmitted to the shooting device.
17. The utility model provides a controlling means of unmanned vehicles, characterized in that unmanned vehicles installs the shooting device, the shooting device with be provided with hot boots signal interface on the connector between the unmanned vehicles, the device still includes: a processor for, among other things,
the processor is configured to:
and when the shooting device executes shooting operation, multiplexing the hot shoe signal interface to transmit at least two pulse signals.
18. An unmanned aerial vehicle, comprising:
the aircraft comprises an aircraft body, a power system and a control system, wherein the power system is used for providing flight power;
a camera electrically connectable with the UAV through a connector, the connector including a hot shoe signal interface;
the control system is specifically configured to: and when the shooting device executes shooting operation, multiplexing the hot shoe signal interface to transmit at least two pulse signals.
19. The unmanned aerial vehicle of claim 18, wherein the control system is specifically configured to:
when the shooting device executes shooting operation, transmitting a time synchronization pulse signal to the shooting device by adopting the hot shoe signal interface; and
and receiving a shooting indication pulse signal sent by the shooting device by adopting the hot shoe signal interface.
20. The UAV of claim 19 wherein the control system comprises:
and the positioning module is used for receiving the time synchronization pulse signal.
21. The unmanned aerial vehicle of claim 20,
the positioning module comprises a wireless communication module and/or at least one GNSS positioning module to receive the time synchronization pulse signals transmitted by satellites and/or base stations.
22. The unmanned aerial vehicle of claim 20 or 21, wherein the control system further comprises:
and the central processing unit is electrically connected with the positioning module and is used for acquiring the time synchronization pulse signal.
23. The UAV according to claim 22,
the photographing apparatus includes: an internal controller;
the control system further comprises: and the microcontroller is electrically connected with the internal controller and used for receiving the state information of the shooting device sent by the microcontroller and generating a selection instruction according to the state information, wherein the selection instruction is used for controlling the transmission directions of the time synchronization pulse signal and the shooting indication pulse signal.
24. The UAV of claim 23 wherein the control system further comprises:
and the data selection switch is respectively in communication coupling connection with the central processing unit, the microcontroller and the connector, and is used for controlling and adjusting the conduction direction of a pulse signal transmission pin in the hot shoe signal interface according to the selection instruction so as to respectively transmit the time synchronization pulse signal and the shooting indication pulse signal.
25. The UAV of claim 24 wherein the control system further comprises:
and the image processor is used for receiving the shooting indication pulse signal and generating a shot image according to the shooting indication pulse signal.
26. The unmanned aerial vehicle of any one of claims 23 to 25, wherein the camera further comprises:
and the flash lamp is electrically connected with the internal controller and is used for generating the shooting indication pulse signal.
27. The unmanned aerial vehicle of any one of claims 24 to 26, further comprising:
the GNSS positioning module and/or the wireless communication module are electrically connected with the central processing unit respectively and are used for receiving synchronous pulse signals respectively;
the input end of the data selection switch is further connected with the at least one GNSS positioning module and/or the wireless communication module which are connected in parallel, the data selection switch is further electrically connected with the central processing unit, and the central processing unit is used for: and after the optimal synchronization pulse signal in the synchronization pulse signals is determined, controlling the data selection switch to be communicated with a GNSS positioning module corresponding to the optimal synchronization pulse signal so as to determine the optimal synchronization pulse signal as a system time synchronization signal.
28. The UAV according to any one of claims 23 to 26 wherein a standardized load interface is further provided on the UAV for mounting load devices,
the central processing unit determines the type of the signal to be transmitted by the load interface according to the received type information of the load equipment transmitted by the standardized load interface;
the data selection switch is also connected to the standardized load interface and is further used for selecting the pulse width modulation signal or the system time synchronization signal to be transmitted by the load interface according to the signal type.
29. The unmanned aerial vehicle of any one of claims 18-28, further comprising:
the cloud platform is used for carrying the shooting device, and the cloud platform is provided with the connector.
30. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the control method according to any one of claims 1 to 16.
CN201880065474.0A 2018-12-27 2018-12-27 Control method and device, unmanned aerial vehicle and storage medium Pending CN111279671A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/124480 WO2020133103A1 (en) 2018-12-27 2018-12-27 Control method and apparatus, and unmanned aerial vehicle and storage medium

Publications (1)

Publication Number Publication Date
CN111279671A true CN111279671A (en) 2020-06-12

Family

ID=71004128

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880065474.0A Pending CN111279671A (en) 2018-12-27 2018-12-27 Control method and device, unmanned aerial vehicle and storage medium

Country Status (2)

Country Link
CN (1) CN111279671A (en)
WO (1) WO2020133103A1 (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201403134Y (en) * 2009-04-10 2010-02-10 武汉高端天目电子有限公司 GPS locator for photographic/video camera
CN102932020A (en) * 2012-06-14 2013-02-13 张建城 Beidou multimode time service receiving device
CN202799299U (en) * 2012-08-30 2013-03-13 深圳市影歌科技有限公司 Flash trigger for digital camera
CN103744372A (en) * 2013-12-23 2014-04-23 广东电网公司电力科学研究院 Multisensor time synchronization method for unmanned plane power patrol and system thereof
CN104748730A (en) * 2015-04-15 2015-07-01 中测新图(北京)遥感技术有限责任公司 Device and method for determining exposure moment of aerial survey camera in unmanned aerial vehicle
US9529764B1 (en) * 2013-10-29 2016-12-27 Exelis, Inc. Near-to-eye display hot shoe communication line
CN106871874A (en) * 2017-02-27 2017-06-20 广西翼界科技有限公司 A kind of POS management systems for being applied to aerial survey of unmanned aerial vehicle
CN106885560A (en) * 2017-02-27 2017-06-23 广西翼界科技有限公司 A kind of aerial survey of unmanned aerial vehicle closed loop control method
CN107345808A (en) * 2017-07-12 2017-11-14 成都纵横自动化技术有限公司 Time of exposure acquisition methods, pulse signal acquisition device, unmanned plane and draw sudden strain of a muscle device
CN108255189A (en) * 2018-01-31 2018-07-06 佛山市神风航空科技有限公司 A kind of power patrol unmanned machine system
CN108700855A (en) * 2017-03-09 2018-10-23 深圳市大疆创新科技有限公司 The channels F control method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017107075A1 (en) * 2015-12-22 2017-06-29 SZ DJI Technology Co., Ltd. System, method, and mobile platform for supporting bracketing imaging

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201403134Y (en) * 2009-04-10 2010-02-10 武汉高端天目电子有限公司 GPS locator for photographic/video camera
CN102932020A (en) * 2012-06-14 2013-02-13 张建城 Beidou multimode time service receiving device
CN202799299U (en) * 2012-08-30 2013-03-13 深圳市影歌科技有限公司 Flash trigger for digital camera
US9529764B1 (en) * 2013-10-29 2016-12-27 Exelis, Inc. Near-to-eye display hot shoe communication line
CN103744372A (en) * 2013-12-23 2014-04-23 广东电网公司电力科学研究院 Multisensor time synchronization method for unmanned plane power patrol and system thereof
CN104748730A (en) * 2015-04-15 2015-07-01 中测新图(北京)遥感技术有限责任公司 Device and method for determining exposure moment of aerial survey camera in unmanned aerial vehicle
CN106871874A (en) * 2017-02-27 2017-06-20 广西翼界科技有限公司 A kind of POS management systems for being applied to aerial survey of unmanned aerial vehicle
CN106885560A (en) * 2017-02-27 2017-06-23 广西翼界科技有限公司 A kind of aerial survey of unmanned aerial vehicle closed loop control method
CN108700855A (en) * 2017-03-09 2018-10-23 深圳市大疆创新科技有限公司 The channels F control method and device
CN107345808A (en) * 2017-07-12 2017-11-14 成都纵横自动化技术有限公司 Time of exposure acquisition methods, pulse signal acquisition device, unmanned plane and draw sudden strain of a muscle device
CN108255189A (en) * 2018-01-31 2018-07-06 佛山市神风航空科技有限公司 A kind of power patrol unmanned machine system

Also Published As

Publication number Publication date
WO2020133103A1 (en) 2020-07-02

Similar Documents

Publication Publication Date Title
CN111279282A (en) Time service method, switching method, device, control system and unmanned aerial vehicle
CN111279283A (en) Control method and device, unmanned aerial vehicle and storage medium
JP7235144B2 (en) Apparatus, method and program
US10732298B2 (en) Operating device, operating method, operating system, and operating program
US10520605B2 (en) Satellite signal reception characteristic estimation apparatus, method thereof, and program thereof
EP2711737B1 (en) Method and System for Computing Universal Hybrid Navigation Information for a GNSS Enabled Device
CN111006650B (en) Ground observation whistle reconnaissance early warning system
JP2018112445A (en) Arithmetic unit, arithmetic method, arithmetic system, and program
CN111295567A (en) Course determining method, device, storage medium and movable platform
CN110261880B (en) Unmanned aerial vehicle searching method and system and unmanned aerial vehicle
RU2368873C1 (en) Device that assists in ground navigation of aircraft in airport
WO2020107195A1 (en) Information synchronization method, unmanned aerial vehicle, load device, system and storage medium
US11199629B2 (en) Method and device for providing raw correction data for correcting atmospheric disturbances for satellite navigation, and method and device for determining correction data for correcting atmospheric disturbances for satellite navigation
CN111279671A (en) Control method and device, unmanned aerial vehicle and storage medium
CN210927785U (en) High-precision multipath aerial survey camera exposure time synchronizing device
CN111856514A (en) Synchronous pseudolite positioning method and system
KR100937876B1 (en) Method and apparatus of satellite tracking and data transmission in the uplink station
CN116981044B (en) Clock synchronization system and method for expanding small base station to be compatible with multiple clock sources
CN117553795A (en) Method and device for determining the vertical positioning of a pilot aircraft during pilot testing
CN112690008B (en) Unmanned aerial vehicle positioning method, terminal equipment and unmanned aerial vehicle
US20220341751A1 (en) Systems and methods for multi-sensor mapping using a single device that can operate in multiple modes
JP2008191117A (en) Positioning device using gps receiver
KR20220011001A (en) Method and system for generating driving path of agricultural machine using drone
CN115113255A (en) Vehicle positioning and tracking device and method and vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned
AD01 Patent right deemed abandoned

Effective date of abandoning: 20230120