WO2018059295A1 - Control method, device, and system for multirotor aerial vehicle - Google Patents

Control method, device, and system for multirotor aerial vehicle Download PDF

Info

Publication number
WO2018059295A1
WO2018059295A1 PCT/CN2017/102598 CN2017102598W WO2018059295A1 WO 2018059295 A1 WO2018059295 A1 WO 2018059295A1 CN 2017102598 W CN2017102598 W CN 2017102598W WO 2018059295 A1 WO2018059295 A1 WO 2018059295A1
Authority
WO
WIPO (PCT)
Prior art keywords
aircraft
smart terminal
control system
horizontal
relative distance
Prior art date
Application number
PCT/CN2017/102598
Other languages
French (fr)
Chinese (zh)
Inventor
胡华智
Original Assignee
亿航智能设备(广州)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 亿航智能设备(广州)有限公司 filed Critical 亿航智能设备(广州)有限公司
Publication of WO2018059295A1 publication Critical patent/WO2018059295A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/12Target-seeking control

Definitions

  • the present invention relates to the field of aircraft control technology, and in particular, to a control method, device and system for a multi-rotor aircraft.
  • multi-rotor UAVs are gradually replacing traditional manned or unmanned helicopters and fixed-wing aircraft due to their stable performance and low cost. Used in many industries.
  • the multi-rotor drone can easily perform a variety of shooting tasks.
  • multi-rotor drones can be used for entertainment, film and television aerial photography, power line inspection, police patrol, etc.; in the military field, it can be used for monitoring and detection.
  • a multi-rotor drone performs a shooting task
  • at least two operators are required, one of which controls the flight of the drone and the other controls the gimbal.
  • the rotation This requires two operators to have a wealth of experience, but also requires the operator to pay attention to the movement of the subject in real time, resulting in higher shooting costs.
  • a method for controlling a multi-rotor aircraft includes the following steps:
  • a method for controlling a multi-rotor aircraft includes the following steps:
  • Generating control information according to the displacement transmitting the control information to the onboard flight control system, controlling the aircraft to move to the target position with the displacement, so that the lens of the camera on the aircraft is
  • the mobile device always faces or faces the location of the smart terminal.
  • a multi-rotor aircraft control device comprising:
  • a first calculating device configured to calculate a horizontal relative distance, a vertical relative distance, and a relative angle between the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
  • a second computing device configured to acquire first location information of the aircraft in real time, and acquire second location information of the smart terminal, and calculate an object of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information Positioning, calculating a displacement of the aircraft according to the first position information and the target position;
  • a first control device configured to generate control information according to the displacement, and send the control information to an onboard flight control system of the aircraft, and control the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement.
  • a multi-rotor aircraft control device comprising:
  • a location acquiring device configured to receive first location information of the aircraft acquired by the flight control system, and acquire second location information of the smart terminal
  • a third calculating device configured to calculate a target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second position information, and calculate the displacement of the aircraft according to the first position information and the target position;
  • the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, and the relative angle is a projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane.
  • a second control device configured to generate control information according to the displacement, send the control information to the onboard flight control system, and control the aircraft to move to the target position with the displacement, so that the aircraft
  • the lens of the upper camera is always facing or facing the position of the smart terminal during the movement.
  • a multi-rotor aircraft control system comprising: an onboard flight control system and a control system;
  • the control system is coupled to the aircraft by the onboard flight control system;
  • the airborne flight control system is configured to acquire first position information of the aircraft, and send the first position information to the control system;
  • the control system is configured to acquire current second location information of the smart terminal, and calculate a target location of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the first location information. Calculating a displacement of the aircraft with the target position, generating control information according to the displacement, and transmitting the control information to the onboard flight control system; wherein the horizontal relative distance and the vertical relative distance are respectively the aircraft and the intelligent terminal a desired distance in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
  • the onboard flight control system is further configured to control the aircraft to move to the target position with the displacement such that a lens of the camera device on the aircraft always faces or faces the smart terminal during the moving process. Where it is.
  • the method, device and system for controlling a multi-rotor aircraft when the terminal moves, calculating a target position of the aircraft according to a horizontal relative distance between the aircraft and the intelligent terminal, a vertical relative distance, a relative angle, and the second position information, according to the Calculating displacement of the aircraft according to the first position information and the target position, generating control information according to the displacement, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the target position with the displacement,
  • the automatic follow-up of the aircraft is achieved such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
  • FIG. 1 is a flow chart of a control method of a multi-rotor aircraft of a first embodiment
  • Figure 2 is a schematic perspective view of a relative angle of an embodiment
  • Figure 3 is a schematic illustration of the desired distance of one embodiment
  • Figure 4 is a schematic diagram of a follow-up of an embodiment
  • Figure 5 is a flow chart showing a control method of the multi-rotor aircraft of the second embodiment
  • Figure 6 is a schematic structural view of a control device for a multi-rotor aircraft of the first embodiment
  • Figure 7 is a schematic structural view of a control device for a multi-rotor aircraft of a second embodiment
  • Fig. 8 is a schematic structural view of a control system of a multi-rotor aircraft of an embodiment.
  • the present invention provides a control method for a multi-rotor aircraft, which may include the following steps:
  • the smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer.
  • the positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software.
  • GPS Global Positioning System
  • a time interval may be set in advance, and the first location information and the second location information are acquired once every said time interval.
  • the time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
  • the horizontal relative distance is:
  • the relative angle is:
  • X F0 , Y F0 , Z F0 are the coordinate values of the north axis, the east axis and the lower axis of the initial position of the aircraft in the NED coordinate system, respectively, X T0 , Y T0 , Z T0 are smart terminals respectively.
  • the initial position is the coordinate value of the north, east, and lower axes in the NED coordinate system.
  • FIG. 2 The schematic diagrams of the relative angle and the desired distance are shown in Figures 2 and 3, respectively.
  • Fig. 2 if the x-axis represents the east axis in the NED coordinate system, the y-axis represents the north axis in the NED coordinate system, the z-axis represents the lower axis in the NED coordinate system, and O is the origin.
  • the direction indicated in the xOy plane is the relative angle.
  • the relative angle may be 80° east and south.
  • the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
  • S12 acquiring first location information of the aircraft in real time, and acquiring second location information of the smart terminal, and calculating a target location of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the Calculating the displacement of the aircraft by the first position information and the target position;
  • the horizontal relative distance between the aircraft and the intelligent terminal is D
  • the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied.
  • the aircraft of the present invention can be moved according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left by 1 meter; When the terminal moves up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged.
  • the schematic diagram of the following process is shown in Figure 4.
  • the position before the smart terminal moves is recorded as P1
  • the position after the smart terminal moves is recorded as P1'
  • the current position of the aircraft is recorded as P2
  • the target position of the aircraft is recorded as P2'
  • the target of the aircraft a displacement vector formed by a position corresponding to the first position information is recorded as
  • the displacement vector formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as then versus Is equal.
  • the target location should satisfy:
  • (X F , Y F , Z F ) is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the horizontal distance
  • H is Vertical distance
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the horizontal distance
  • H is Vertical distance
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • S13 Generate control information according to the displacement, and send the control information to an airborne flight control system of the aircraft, and control the aircraft to move to the target position with the displacement to enable the imaging device on the aircraft.
  • the lens is always facing or facing the position of the smart terminal during the movement.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera.
  • the pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal.
  • the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state.
  • the pitch angle of the target position can be calculated according to the following formula:
  • is the pitch angle
  • H is the relative distance between the aircraft and the smart terminal in the vertical direction
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively.
  • D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F are the aircraft in the northeast.
  • the intelligent terminal After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
  • the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system.
  • the airborne flight control system receives the horizontal flight After the line speed, the aircraft can be controlled to fly at the horizontal flight speed, so that the aircraft follows the subject.
  • the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
  • the smart terminal can calculate the aircraft according to the position information of the aircraft and its position information. It has a horizontal flight speed and a vertical flight speed, and transmits the horizontal flight speed and the vertical flight speed to the airborne flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
  • the horizontal flight speed of the aircraft can be controlled as follows:
  • V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system
  • V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system
  • V is intelligent terminal obtained the aircraft ground speed
  • k is a gain coefficient
  • d is the radius of the dead zone
  • D is the distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the smart terminal in the NED coordinate system, respectively
  • X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
  • the vertical flight speed of the aircraft can also be controlled as follows:
  • V is the vertical flight speed
  • V m is the maximum following speed of the aircraft obtained by the intelligent terminal
  • k is the gain coefficient
  • d is the dead zone radius
  • H is the distance between the aircraft and the intelligent terminal in the vertical direction.
  • Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
  • the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
  • the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft movement when the aircraft is disconnected from the intelligent terminal The position corresponding to the last received second position information.
  • the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
  • the control method of the multi-rotor aircraft calculates the target position of the aircraft according to the horizontal relative distance between the aircraft and the intelligent terminal, the vertical relative distance, the relative angle, and the second position information, according to the Calculating a displacement vector of the aircraft by the first position information and the target position, generating control information according to the displacement vector, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the
  • the target position is such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft.
  • the fly can also be adjusted
  • the pitch angle of the image pickup device mounted on the line device keeps the smart terminal in the photographing screen of the image pickup device. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
  • the present invention also provides a control method for a multi-rotor aircraft, which may include the following steps:
  • the receiver acquires first location information of the aircraft acquired by the flight control system, and acquires second location information of the smart terminal.
  • the smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer.
  • the positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software.
  • GPS Global Positioning System
  • a time interval may be set in advance, and the first location information and the second location information are acquired once every said time interval.
  • the time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
  • the horizontal and vertical relative distances from the smart terminal when the aircraft follows the smart terminal can be set.
  • the aircraft can be set to follow the smart terminal at a horizontal distance and a vertical distance of 1 meter and 0.5 meters apart from each other.
  • the above 1 meter and 0.5 meters are the desired distances in the subsequent follow-up process, and the goal is to keep the horizontal and vertical relative distance between the aircraft and the intelligent terminal constant at 1 meter and 0.5 meters.
  • a schematic diagram of the desired distance is shown in FIG. Every time you turn it on, you can follow the The latitude and longitude of the smart terminal calculate the horizontal relative distance, the vertical relative distance, and the relative angle.
  • the subsequent follow-up process the following process can be directly performed according to the horizontal relative distance, the vertical relative distance and the relative angle calculated at the time of power-on.
  • FIG. 2 A schematic diagram of the relative angle is shown in Figure 2.
  • the x-axis represents the east axis in the NED coordinate system
  • the y-axis represents the north axis in the NED coordinate system
  • the z-axis represents the lower axis in the NED coordinate system
  • O is the origin.
  • the direction indicated in the xOy plane is the relative angle.
  • the relative angle may be 80° east and south.
  • the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
  • the horizontal relative distance between the aircraft and the intelligent terminal is D
  • the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied.
  • the target position, the displacement and the relative angle calculated in step S22 can make the aircraft of the present invention move according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left by 1 meter; the intelligent terminal When moving up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged.
  • the schematic diagram of the following process is shown in Figure 5.
  • the position before the smart terminal moves is recorded as P1
  • the position after the smart terminal moves is recorded as P1'
  • the current position of the aircraft is recorded as P2
  • the target position of the aircraft is recorded as P2'
  • the target of the aircraft is recorded as P2'
  • the target of the aircraft is recorded as then versus Is equal.
  • the target location should satisfy:
  • (X F , Y F , Z F ) is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the horizontal distance
  • H is Vertical distance
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the horizontal distance
  • H is Vertical distance
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • the relative angle may be calculated according to the initial position information (X F0 , Y F0 , Z F0 ) of the aircraft acquired by the onboard flight control system and the initial position information (X T0 , Y T0 , Z T0 ) of the intelligent terminal. It is obtained that the initial position information of the aircraft and the initial position information of the smart terminal may be position information acquired for the first time after the system starts running. After the relative angle is calculated, the relative angle can be stored in the system and the aircraft is controlled to maintain the relative angular movement during subsequent control.
  • the way to calculate the relative angle based on the initial position information is:
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera.
  • the pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal.
  • the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state.
  • the pitch angle of the target position can be calculated according to the following formula:
  • is the pitch angle
  • H is the relative distance between the aircraft and the smart terminal in the vertical direction
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively.
  • D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F are the aircraft in the northeast.
  • the intelligent terminal After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
  • the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. After receiving the horizontal flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed, so that the aircraft follows the subject.
  • the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
  • the smart terminal can calculate the aircraft according to the position information of the aircraft and its position information. It has a horizontal flight speed and a vertical flight speed, and transmits the horizontal flight speed and the vertical flight speed to the airborne flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
  • the horizontal flight speed of the aircraft can be controlled as follows:
  • V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system
  • V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system
  • V is intelligent terminal obtained the aircraft ground speed
  • k is a gain coefficient
  • d is the radius of the dead zone
  • D is the distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
  • the vertical flight speed of the aircraft can also be controlled as follows:
  • V is the vertical flight speed
  • V m is the maximum following speed of the aircraft obtained by the intelligent terminal
  • k is the gain coefficient
  • d is the dead zone radius
  • H is the distance between the aircraft and the intelligent terminal in the vertical direction.
  • Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
  • the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
  • the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft movement when the aircraft is disconnected from the intelligent terminal The position corresponding to the last received second position information.
  • the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
  • the control method of the multi-rotor aircraft calculates the target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle and the second position information, according to the first position information. Calculating a displacement of the aircraft with the target position, generating control information according to the displacement, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
  • the present invention provides a control device for a multi-rotor aircraft, which may include:
  • a first computing device 110 configured to calculate a horizontal relative distance, a vertical relative distance, and a relative angle between the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively Determining a desired distance between the aircraft and the intelligent terminal in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
  • the smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer.
  • the positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software.
  • GPS Global Positioning System
  • a time interval may be set in advance, and the first location information and the second location information are acquired once every said time interval.
  • the time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
  • the horizontal relative distance is:
  • the relative angle is:
  • X F0 , Y F0 , Z F0 are the coordinate values of the north axis, the east axis and the lower axis of the initial position of the aircraft in the NED coordinate system, respectively, X T0 , Y T0 , Z T0 are smart terminals respectively.
  • the initial position is the coordinate value of the north, east, and lower axes in the NED coordinate system.
  • FIG. 2 A schematic diagram of the relative angle is shown in Figure 2.
  • the x-axis represents the east axis in the NED coordinate system
  • the y-axis represents the north axis in the NED coordinate system
  • the z-axis represents the lower axis in the NED coordinate system
  • O is the origin.
  • the direction indicated in the xOy plane is the relative angle.
  • the relative angle may be 80° east and south.
  • the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
  • a second computing device 120 configured to acquire first location information of the aircraft in real time, and acquire second location information of the smart terminal, and calculate an aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information.
  • a target position calculating a displacement of the aircraft according to the first position information and the target position;
  • the aircraft of the present invention can be moved according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left.
  • the aircraft When the intelligent terminal moves up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged.
  • the schematic diagram of the following process is shown in Figure 5.
  • the position before the smart terminal moves is recorded as P1
  • the position after the smart terminal moves is recorded as P1'
  • the current position of the aircraft is recorded as P2
  • the target position of the aircraft is recorded as P2'
  • the target of the aircraft a displacement vector formed by a position corresponding to the first position information is recorded as
  • the displacement vector formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as then versus Is equal.
  • the target location should satisfy:
  • (X F , Y F , Z F ) is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the horizontal distance
  • H is Vertical distance
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the horizontal distance
  • H is Vertical distance
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • a first control device 130 configured to generate control information according to the displacement, and send the control information to an airborne flight control system of the aircraft, and control the aircraft to move to the target position with the displacement, so as to
  • the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera.
  • the pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal.
  • the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state.
  • the pitch angle of the target position can be calculated according to the following formula:
  • is the pitch angle
  • H is the relative distance between the aircraft and the smart terminal in the vertical direction
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively.
  • D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F are the aircraft in the northeast.
  • the intelligent terminal After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
  • the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. After receiving the horizontal flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed, so that the aircraft follows the subject.
  • the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
  • the smart terminal can calculate the aircraft according to the position information of the aircraft and its position information. It has a horizontal flight speed and a vertical flight speed, and transmits the horizontal flight speed and the vertical flight speed to the airborne flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
  • the horizontal flight speed of the aircraft can be controlled as follows:
  • V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system
  • V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system
  • V is intelligent terminal obtained the aircraft ground speed
  • k is a gain coefficient
  • d is the radius of the dead zone
  • D is the distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
  • the vertical flight speed of the aircraft can also be controlled as follows:
  • V is the vertical flight speed
  • V m is the maximum following speed of the aircraft obtained by the intelligent terminal
  • k is the gain coefficient
  • d is the dead zone radius
  • H is the distance between the aircraft and the intelligent terminal in the vertical direction.
  • Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
  • the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
  • the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft when the aircraft is disconnected from the intelligent terminal Move to the position corresponding to the last received second position information.
  • the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
  • the control device of the multi-rotor aircraft calculates the target position of the aircraft according to the horizontal relative distance between the aircraft and the intelligent terminal, the vertical relative distance, the relative angle and the second position information, according to the Calculating a displacement vector of the aircraft by the first position information and the target position, generating control information according to the displacement vector, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the
  • the target position is such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
  • the present invention further provides a control device for a multi-rotor aircraft.
  • the control device of the multi-rotor aircraft may include:
  • a location acquiring device 210 configured to receive first location information of the aircraft acquired by the flight control system, and acquire second location information of the smart terminal;
  • the smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer.
  • the positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software.
  • GPS Global Positioning System
  • the time interval may be preset, and the first location information and the second location information are acquired once every said time interval.
  • the time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
  • the third calculating device 220 is configured to calculate a target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second position information, and calculate the displacement of the aircraft according to the first position information and the target position;
  • the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction
  • the relative angle is a projection of the aircraft on a horizontal plane and a horizontal position of the intelligent terminal.
  • the horizontal and vertical relative distances from the smart terminal when the aircraft follows the smart terminal can be set.
  • the aircraft can be set to follow the smart terminal at a horizontal distance and a vertical distance of 1 meter and 0.5 meters apart from each other.
  • the above 1 meter and 0.5 meters are the desired distances in the subsequent follow-up process, and the goal is to keep the horizontal and vertical relative distance between the aircraft and the intelligent terminal constant at 1 meter and 0.5 meters.
  • a schematic diagram of the desired distance is shown in FIG.
  • the horizontal relative distance, the vertical relative distance, and the relative angle may be calculated according to the latitude and longitude of the aircraft and the latitude and longitude of the smart terminal.
  • the subsequent follow-up process the following process can be directly performed according to the horizontal relative distance, the vertical relative distance and the relative angle calculated at the time of power-on.
  • FIG. 2 A schematic diagram of the relative angle is shown in Figure 2.
  • the x-axis represents the east axis in the NED coordinate system
  • the y-axis represents the north axis in the NED coordinate system
  • the z-axis represents the lower axis in the NED coordinate system
  • O is the origin.
  • the direction indicated in the xOy plane is the relative angle.
  • the relative angle may be 80° east and south.
  • the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
  • the horizontal relative distance between the aircraft and the intelligent terminal is D
  • the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied.
  • a target position that satisfies the condition can be uniquely determined, and the process of moving the aircraft to the target position completely copies the moving process of the smart terminal.
  • the target position, displacement and relative angle calculated by the third computing device 220 can cause the aircraft of the present invention to move according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left by 1 meter.
  • the aircraft When the intelligent terminal moves up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged.
  • the schematic diagram of the following process is shown in Figure 5.
  • the position before the smart terminal moves is recorded as P1
  • the position after the smart terminal moves is recorded as P1'
  • the current position of the aircraft is recorded as P2
  • the target position of the aircraft is recorded as P2'
  • the target of the aircraft The displacement formed by the position corresponding to the first position information is recorded as
  • the displacement formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as then versus Is equal.
  • the target location should satisfy:
  • (X F , Y F , Z F ) is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the level of the aircraft and the intelligent terminal.
  • the relative distance in the direction, H is the relative distance between the aircraft and the intelligent terminal in the vertical direction.
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively
  • X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system.
  • the east axis position is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • D is the level of the aircraft and the intelligent terminal.
  • the relative distance in the direction, H is the relative distance between the aircraft and the intelligent terminal in the vertical direction.
  • Z T and Z F are the lower axis positions of the smart terminal and the target
  • the relative angle may be calculated according to the initial position information (X F0 , Y F0 , Z F0 ) of the aircraft acquired by the onboard flight control system and the initial position information (X T0 , Y T0 , Z T0 ) of the intelligent terminal. It is obtained that the initial position information of the aircraft and the initial position information of the smart terminal may be position information acquired for the first time after the system starts running. After the relative angle is calculated, the relative angle can be stored in the system and the aircraft is controlled to maintain the relative angular movement during subsequent control.
  • the way to calculate the relative angle based on the initial position information is:
  • a second control device 230 configured to send the control information to the onboard flight control system according to the displacement generation control information, and control the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera.
  • the pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal.
  • the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state.
  • the pitch angle of the target position can be calculated according to the following formula:
  • is the pitch angle
  • H is the relative distance between the aircraft and the smart terminal in the vertical direction
  • Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively.
  • D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F are the aircraft in the northeast.
  • the intelligent terminal After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
  • the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. After receiving the horizontal flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed, so that the aircraft follows the subject.
  • the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
  • the intelligent terminal can calculate the horizontal flight speed and the vertical flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed and the vertical flight speed to the aircraft.
  • Flight control system After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
  • the horizontal flight speed of the aircraft can be controlled as follows:
  • V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system
  • V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system
  • V is intelligent terminal obtained the aircraft ground speed
  • k is a gain coefficient
  • d is the radius of the dead zone
  • D is the distance between the aircraft and the intelligent terminal in the horizontal direction
  • X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively
  • X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
  • the vertical flight speed of the aircraft can also be controlled as follows:
  • V is the vertical flight speed
  • V m is the maximum following speed of the aircraft obtained by the intelligent terminal
  • k is the gain coefficient
  • d is the dead zone radius
  • H is the distance between the aircraft and the intelligent terminal in the vertical direction.
  • Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
  • the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
  • the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft movement when the aircraft is disconnected from the intelligent terminal The position corresponding to the last received second position information.
  • the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
  • the control device of the multi-rotor aircraft calculates the target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle and the second position information when the terminal moves, according to
  • the first position information and the target position calculate a displacement of the aircraft, generate control information according to the displacement, send the control information to the onboard flight control system, and control the aircraft to move to the target with the displacement
  • the position is such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
  • the present invention also provides a control system for a multi-rotor aircraft, the control system may include: an onboard flight control system 21 and a control system 22;
  • the control system 22 is coupled to the onboard flight control system 21, and the onboard flight control system 21 is coupled to the aircraft;
  • the airborne flight control system 21 is configured to acquire first position information of the aircraft 23, and send the first position information to the control system 22;
  • the control system 22 is configured to acquire current second location information of the smart terminal 24, and calculate a target location of the aircraft 23 according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the first Calculating the displacement of the aircraft 23 with a position information and a target position, and generating control information according to the displacement, and transmitting the control information to the onboard flight control system 21; wherein the horizontal relative distance and the vertical relative distance are respectively The desired distance between the aircraft 23 and the intelligent terminal 24 in the horizontal direction and the vertical direction, the relative angle is a relative position vector formed by the projection of the aircraft 23 on the horizontal plane and the projection of the intelligent terminal 24 on the horizontal plane on a horizontal plane. Angle;
  • the onboard flight control system 21 is further configured to control the aircraft 23 to move to the target position with the displacement such that the lens 25 of the camera on the aircraft 23 is always facing or facing each other during the movement.
  • the location where the smart terminal is located is further configured to control the aircraft 23 to move to the target position with the displacement such that the lens 25 of the camera on the aircraft 23 is always facing or facing each other during the movement.
  • the control system 22 may be a somatosensory control device such as a somatosensory manipulator, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer.
  • the positioning functions of the onboard flight control system 21 and the control system 22 can be implemented by installing software having positioning functions such as Global Positioning System (GPS) software.
  • GPS Global Positioning System
  • the time interval may be preset, and the first location information and the second location information are acquired once every said time interval.
  • the time interval can be set according to actual needs. For example, it can be set according to the flight speed of the control system 22. When the flight speed of the control system 22 is small, the time interval can be set to a small value, and when the flight speed of the control system 22 is large, the time interval can be set to a larger value. . It can also be obtained in other ways.
  • the horizontal and vertical relative distances from the smart terminal when the aircraft follows the smart terminal can be set.
  • the aircraft can be set to follow the smart terminal at a horizontal distance and a vertical distance of 1 meter and 0.5 meters apart from each other.
  • the above 1 meter and 0.5 meters are the desired distances in the subsequent follow-up process, and the goal is to keep the horizontal and vertical relative distance between the aircraft and the intelligent terminal constant at 1 meter and 0.5 meters.
  • a schematic diagram of the desired distance is shown in FIG.
  • the horizontal relative distance, the vertical relative distance, and the relative angle may be calculated according to the latitude and longitude of the aircraft and the latitude and longitude of the smart terminal.
  • the horizontal relative distance and vertical phase calculated directly at the time of power-on can be directly The following process is performed on the distance and the relative angle.
  • FIG. 2 A schematic diagram of the relative angle is shown in Figure 2.
  • the x-axis represents the east axis in the NED coordinate system
  • the y-axis represents the north axis in the NED coordinate system
  • the z-axis represents the lower axis in the NED coordinate system
  • O is the origin.
  • the direction indicated in the xOy plane is the relative angle.
  • the relative angle may be 80° east and south.
  • the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
  • the target location should satisfy:
  • (X F , Y F , Z F ) is the coordinate of the target position
  • X T and Y T are the north and east axis positions of the control system 22 in the NED coordinate system, respectively
  • D is the aircraft 23 and the control system 22 is the relative distance in the horizontal direction
  • H is the relative distance between the aircraft 23 and the control system 22 in the vertical direction.
  • Z T and Z F are the lower axis positions of the control system 22 and the target position in the NED coordinate system, respectively
  • X F and Y F are the northerly lower NED coordinate system of the aircraft 23 North and East axis positions.
  • the relative angle may be based on initial position information (X F0 , Y F0 , Z F0 ) of the aircraft acquired by the onboard flight control system 21 and initial position information of the intelligent terminal (X T0 , Y T0 , Z T0 ) It is calculated that the initial position information of the aircraft 23 and the initial position information of the control system 22 may be the position information acquired for the first time after the system starts running. After the relative angle is calculated, the relative angle can be stored in the system and the aircraft is controlled to maintain the relative angular movement during subsequent control.
  • the way to calculate the relative angle based on the initial position information is:
  • the pitch angle of the camera unit 25 mounted on the aircraft 23 can also be adjusted to maintain the control system 22 in the photographing screen of the camera unit.
  • the pitch angle is such that The lens of the camera 25 on the aircraft 23 is always facing or facing the pitch angle of the control system 22.
  • the aircraft 23 can continuously adjust the pitch angle during flight to the target position, so that the control system 22 is always held in the photographing screen of the imaging device 25. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state.
  • the pitch angle of the target position can be calculated according to the following formula:
  • is the pitch angle
  • H is the relative distance between the aircraft 23 and the control system 22 in the vertical direction
  • Z T and Z F are respectively under the control system 22 and the target position in the NED coordinate system.
  • the axial position, D is the relative distance between the aircraft 23 and the control system 22 in the horizontal direction
  • X T and Y T are the north and east axis positions of the control system 22 in the NED coordinate system, respectively
  • X F and Y F are The aircraft 23 is in the north and south axis positions in the northeast NED coordinate system.
  • control system 22 After acquiring the position information of the aircraft 23, the control system 22 can also calculate the flight speed that the aircraft should have according to the position information of the aircraft 23 and its own position information to ensure that the aircraft 23 can always follow the control system 22.
  • the control system 22 can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft 23 and its own position information, and send the horizontal flight speed.
  • the airborne flight control system 21 is provided. After receiving the horizontal flight speed, the onboard flight control system 21 can control the aircraft 23 to fly at the horizontal flight speed to cause the aircraft 23 to follow the subject.
  • the control system 22 can calculate the vertical flight that the aircraft 23 should have based on the position information of the aircraft 23 and its own position information. Speed and send the vertical flight speed to the onboard flight control system 21. After receiving the vertical flight speed, the onboard flight control system 21 can control the aircraft 23 to fly at the vertical flight speed to cause the aircraft 23 to follow the subject.
  • the control system 22 can be based on the position information of the aircraft 23.
  • the position information of the information and its own calculates the horizontal flight speed and the vertical flight speed that the aircraft 23 should have, and transmits the horizontal flight speed and the vertical flight speed to the onboard flight control system 21.
  • the airborne flight control system 21 can control the aircraft 23 to fly at the horizontal flight speed and the vertical flight speed to cause the aircraft 23 to follow the subject.
  • the horizontal flight speed of the aircraft 23 can be controlled as follows:
  • V X is the flight speed of the control system 22 indicating the aircraft 23 on the north axis in the NED coordinate system
  • V Y is the control system 22 indicating that the aircraft 23 is in the NED coordinate system.
  • east axis flight speed V is the aircraft control system 22 to obtain the ground speed of 23
  • V m is the control system 22 of the aircraft obtained following the maximum velocity is 23
  • k is a gain coefficient
  • d For the dead zone radius
  • D is the distance between the aircraft 23 and the control system 22 in the horizontal direction
  • X T and Y T are the north and east axes of the control system 22 in the NED coordinate system, respectively.
  • X F and Y F are the north and east axis positions of the aircraft 23 in the northeast down NED coordinate system.
  • the vertical flight speed of the aircraft 23 can also be controlled as follows:
  • V is the vertical flight velocity
  • V m is the maximum of the following speed control system 22 of the aircraft 23 is obtained
  • k is a gain coefficient
  • d is the radius of the dead zone
  • the distances of the terminals in the vertical direction, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively.
  • control system 22 can also send a command to take off, hover, land, or return to the onboard flight control system 21 to control the aircraft 21 to take off, hover, land, or return.
  • control system 22 can also transmit the second location information to the onboard flight control system 21, which can be lost when the aircraft is disconnected from the control system 22
  • the aircraft 23 is controlled to move to a position corresponding to the last received second position information.
  • control system 22 may further calculate a difference between the second location information and the initial second location information, where the initial second location information is location information of the smart terminal acquired by the smart terminal last time. If the difference is greater than a preset distance threshold, the control system 22 may calculate a target position of the aircraft based on the first position information and the second position information.
  • the control system of the multi-rotor aircraft provided by the embodiment generates, according to the first position information of the aircraft and the current second position information of the terminal, the target position adjusted by the aircraft following the shooting, and generates and sends the terminal.
  • the corresponding control system to the airborne flight control system correspondingly controls the aircraft to move to the target position at a pre-stored relative angle, thereby realizing automatic follow-up of the aircraft.
  • the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
  • control device of the multi-rotor aircraft described above may further include a communication relay device 26 for increasing the communication distance between the onboard flight control system 21 and the control system 22.
  • control system of the multi-rotor aircraft 23 can relay signals via a Bluetooth communication box.
  • the drone and the Bluetooth communication box can communicate wirelessly through the wireless data transmission module, and the Bluetooth communication box and the control system 22 can wirelessly communicate via Bluetooth, so that the drone and the smart phone can ensure reliable communication quality and speed within 1 km.
  • the present invention is not limited to relaying using the communication relay method, and is merely illustrative, not limiting.
  • the onboard flight control system 21 may include: a first GPS module 211, a microprocessor 212, a wireless data transmission module 213, and an Altitude Heading Reference System (Altitude Heading Reference System, Referred to as AHRS) 214 and barometer 215.
  • AHRS Altitude Heading Reference System
  • the microprocessor 211 can run a related algorithm for the single chip microcomputer, and acquires its posture and position through the GPS module 211, the azimuth reference system 214, and the barometer 215, so as to realize flight control of the aircraft where the airborne flight control system 21 is located, such as The attitude and position control of the multi-rotor drone completes the autonomous hover or cruise flight.
  • the microprocessor 211 can also perform bidirectional data communication with the control system 22 via the wireless data transmission module 213 to obtain control commands transmitted by the control system 22.
  • the control commands that the onboard flight control system 21 can receive include, but are not limited to, target positions in the horizontal and vertical directions, target speeds in the horizontal and vertical directions, target relative angles of the aircraft, and the like.
  • the onboard flight control system 21 can also control the attitude and position of the drone according to the received control commands.
  • the onboard flight control system 21 can also control the pitch and/or roll angle rotation of the camera device 25 by outputting a PWM (Pulse Width Modulation) signal according to the received control command, that is, controlling the pitch angle of the camera device 25 and At least one of the roll angles controls the shooting field of the image pickup device 25.
  • PWM Pulse Width Modulation
  • the communication relay device 26 may include a wireless data transmission module 261 and a Bluetooth module 262.
  • the communication relay device 26 can communicate with the onboard flight control system 21 via the wireless data transmission module 261, communicate with the control system 22 via the Bluetooth module 262, and forward the data transmitted between the two as a relay. A stable and long distance communication link is established between the drone and the control system 22.
  • the control system 22 can include a GPS module 221, a control module 222, and a Bluetooth module 223.
  • the control module 222 can be an APP (application) installed on the control system 22.
  • the APP can obtain the GPS positioning information of the control system 22 through the GPS module, and perform data communication with the UAV through the Bluetooth module 223, according to the position information of the UAV transmitted by the onboard flight control system 21 and the control system 22
  • the position information is obtained by running the following flight algorithm to obtain the relative angle and the flight speed, and is sent to the onboard flight control system 21 to control the flight and shooting of the drone.
  • the invention realizes that the drone fully follows the flight of the user carrying the intelligent terminal by the cooperation of the multi-rotor UAV flight control system and the intelligent terminal running the corresponding App, and aligns the camera with the user's area.
  • the user carries the smart terminal
  • the real-time following aerial photography can be automatically realized; when the smart terminal is placed on a car, a ship, etc., the following cruise and shooting of the drone can be automatically realized.
  • the invention can be widely applied to fields such as entertainment, aerial photography, extreme sports, monitoring, and detection.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Traffic Control Systems (AREA)

Abstract

A control method, device, and system (22) for a multirotor aerial vehicle (23). The method comprises: receiving first location information of the aerial vehicle (23) acquired by an onboard flight control system (21) and acquiring second location information of a smart terminal (24) (S21); calculating a target location of the aerial vehicle (23) on the basis of a preset horizontal relative distance, of a vertical relative distance, of a relative angle, and of the second location information, calculating the displacement of the aerial vehicle (23) on the basis of the first location information and of the target location (S22); generating control information on the basis of the displacement, transmitting the control information to the onboard flight control system (21), and controlling the aerial vehicle (23) to move by the displacement to the target location, thus allowing a lens of a camera device (25) on the aerial vehicle (23), while moving, to always aim at or face the location at where the smart terminal (24) is located (S23).

Description

多旋翼飞行器的控制方法、装置和系统Multi-rotor aircraft control method, device and system 技术领域Technical field
本发明涉及飞行器控制技术领域,尤其涉及一种多旋翼飞行器的控制方法、装置和系统。The present invention relates to the field of aircraft control technology, and in particular, to a control method, device and system for a multi-rotor aircraft.
背景技术Background technique
随着自动控制技术、微型传感器技术和微机电系统的发展,多旋翼无人机由于其性能稳定和成本较低等特点,正逐步取代传统的载人或无人的直升机和固定翼飞机,而应用于许多行业。With the development of automatic control technology, micro-sensor technology and MEMS, multi-rotor UAVs are gradually replacing traditional manned or unmanned helicopters and fixed-wing aircraft due to their stable performance and low cost. Used in many industries.
通过搭载摄像机或专业的成像设备和传感器,多旋翼无人机可以方便地完成各种拍摄任务。如在民用领域,多旋翼无人机可用于娱乐、影视航拍、电力线路巡检、警用巡逻等;在军用领域,可用于监控、侦查等。With a camera or professional imaging equipment and sensors, the multi-rotor drone can easily perform a variety of shooting tasks. For example, in the civilian field, multi-rotor drones can be used for entertainment, film and television aerial photography, power line inspection, police patrol, etc.; in the military field, it can be used for monitoring and detection.
目前,在多旋翼无人机执行拍摄任务时,为了使被拍摄的对象时刻保持在摄像设备视野内,至少需要两名操作手,其中一名操控无人机的飞行,另一名操控云台的转动。这需要两名操作手有丰富的经验,同时也要求操控手实时关注被拍摄对象的运动情况,导致拍摄成本较高。At present, when a multi-rotor drone performs a shooting task, in order to keep the object to be photographed in the field of view of the camera, at least two operators are required, one of which controls the flight of the drone and the other controls the gimbal. The rotation. This requires two operators to have a wealth of experience, but also requires the operator to pay attention to the movement of the subject in real time, resulting in higher shooting costs.
发明内容Summary of the invention
基于此,有必要针对拍摄成本较高的问题,提供一种多旋翼飞行器的控制方法、装置和系统。Based on this, it is necessary to provide a control method, device and system for a multi-rotor aircraft for the problem of high shooting cost.
一种多旋翼飞行器的控制方法,包括以下步骤:A method for controlling a multi-rotor aircraft includes the following steps:
根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的水平相对距离、垂直相对距离和相对角度;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;Calculating a horizontal relative distance, a vertical relative distance, and a relative angle of the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively horizontal directions of the aircraft and the intelligent terminal And a desired distance in a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
在智能终端移动过程中,执行以下步骤: During the smart terminal move, perform the following steps:
实时获取所述飞行器的第一位置信息,并获取智能终端的第二位置信息,根据所述水平相对距离、垂直相对距离、相对角度和第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;Acquiring first location information of the aircraft in real time, and acquiring second location information of the smart terminal, and calculating a target location of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the first Position information and target position to calculate the displacement of the aircraft;
根据所述位移生成控制信息,并将所述控制信息发送至飞行器的机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。Generating control information based on the displacement, and transmitting the control information to an onboard flight control system of the aircraft, controlling the aircraft to move to the target position with the displacement to cause a lens of the camera on the aircraft Always facing or facing the location of the smart terminal during the movement.
一种多旋翼飞行器的控制方法,包括以下步骤:A method for controlling a multi-rotor aircraft includes the following steps:
接收机载飞控系统获取的飞行器的第一位置信息,并获取智能终端的第二位置信息;Receiving, by the receiver, the first position information of the aircraft acquired by the flight control system, and acquiring the second position information of the intelligent terminal;
根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;Calculating a target position of the aircraft according to a preset horizontal relative distance, a vertical relative distance, a relative angle, and the second position information, and calculating a displacement of the aircraft according to the first position information and the target position; wherein the horizontal relative distance and The vertical relative distances are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, the relative angle being a relative position vector formed by the projection of the aircraft on a horizontal plane and the projection of the intelligent terminal on a horizontal plane. Angle on a horizontal plane;
根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。Generating control information according to the displacement, transmitting the control information to the onboard flight control system, controlling the aircraft to move to the target position with the displacement, so that the lens of the camera on the aircraft is The mobile device always faces or faces the location of the smart terminal.
一种多旋翼飞行器的控制装置,包括:A multi-rotor aircraft control device comprising:
第一计算装置,用于根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的水平相对距离、垂直相对距离和相对角度;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;a first calculating device, configured to calculate a horizontal relative distance, a vertical relative distance, and a relative angle between the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
在智能终端移动过程中,执行以下装置的功能:During the movement of the smart terminal, perform the functions of the following devices:
第二计算装置,用于实时获取所述飞行器的第一位置信息,并获取智能终端的第二位置信息,根据所述水平相对距离、垂直相对距离、相对角度和第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移; a second computing device, configured to acquire first location information of the aircraft in real time, and acquire second location information of the smart terminal, and calculate an object of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information Positioning, calculating a displacement of the aircraft according to the first position information and the target position;
第一控制装置,用于根据所述位移生成控制信息,并将所述控制信息发送至飞行器的机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。a first control device, configured to generate control information according to the displacement, and send the control information to an onboard flight control system of the aircraft, and control the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement.
一种多旋翼飞行器的控制装置,包括:A multi-rotor aircraft control device comprising:
位置获取装置,用于接收机载飞控系统获取的飞行器的第一位置信息,并获取智能终端的第二位置信息;a location acquiring device, configured to receive first location information of the aircraft acquired by the flight control system, and acquire second location information of the smart terminal;
第三计算装置,用于根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;a third calculating device, configured to calculate a target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second position information, and calculate the displacement of the aircraft according to the first position information and the target position; The horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, and the relative angle is a projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane. The angle of the formed relative position vector on the horizontal plane;
第二控制装置,用于根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。a second control device, configured to generate control information according to the displacement, send the control information to the onboard flight control system, and control the aircraft to move to the target position with the displacement, so that the aircraft The lens of the upper camera is always facing or facing the position of the smart terminal during the movement.
一种多旋翼飞行器的控制系统,包括:机载飞控系统和控制系统;A multi-rotor aircraft control system comprising: an onboard flight control system and a control system;
所述控制系统通过所述机载飞控系统连接到飞行器;The control system is coupled to the aircraft by the onboard flight control system;
所述机载飞控系统用于获取飞行器的第一位置信息,并将所述第一位置信息发送至所述控制系统;The airborne flight control system is configured to acquire first position information of the aircraft, and send the first position information to the control system;
所述控制系统用于获取智能终端当前的第二位置信息,根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移,根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度; The control system is configured to acquire current second location information of the smart terminal, and calculate a target location of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the first location information. Calculating a displacement of the aircraft with the target position, generating control information according to the displacement, and transmitting the control information to the onboard flight control system; wherein the horizontal relative distance and the vertical relative distance are respectively the aircraft and the intelligent terminal a desired distance in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
所述机载飞控系统还用于控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。The onboard flight control system is further configured to control the aircraft to move to the target position with the displacement such that a lens of the camera device on the aircraft always faces or faces the smart terminal during the moving process. Where it is.
上述多旋翼飞行器的控制方法、装置和系统,在终端发生移动时,根据飞行器与智能终端的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移,根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置,实现了飞行器的自动跟随。从而当被拍摄对象携带上述智能终端时,飞行器上安装的摄像装置可以自动跟随被拍摄者进行拍摄,避免了手动操控飞行器,不仅节约了拍摄成本,而且提高了拍摄效率。The method, device and system for controlling a multi-rotor aircraft, when the terminal moves, calculating a target position of the aircraft according to a horizontal relative distance between the aircraft and the intelligent terminal, a vertical relative distance, a relative angle, and the second position information, according to the Calculating displacement of the aircraft according to the first position information and the target position, generating control information according to the displacement, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the target position with the displacement, The automatic follow-up of the aircraft is achieved such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
附图说明DRAWINGS
图1为第一实施例的多旋翼飞行器的控制方法流程图;1 is a flow chart of a control method of a multi-rotor aircraft of a first embodiment;
图2为一个实施例的相对角度示意图;Figure 2 is a schematic perspective view of a relative angle of an embodiment;
图3为一个实施例的期望距离示意图;Figure 3 is a schematic illustration of the desired distance of one embodiment;
图4为一个实施例的跟随示意图;Figure 4 is a schematic diagram of a follow-up of an embodiment;
图5为第二实施例的多旋翼飞行器的控制方法流程图;Figure 5 is a flow chart showing a control method of the multi-rotor aircraft of the second embodiment;
图6为第一实施例的多旋翼飞行器的控制装置的结构示意图;Figure 6 is a schematic structural view of a control device for a multi-rotor aircraft of the first embodiment;
图7为第二实施例的多旋翼飞行器的控制装置的结构示意图;Figure 7 is a schematic structural view of a control device for a multi-rotor aircraft of a second embodiment;
图8为一个实施例的多旋翼飞行器的控制系统的结构示意图。Fig. 8 is a schematic structural view of a control system of a multi-rotor aircraft of an embodiment.
具体实施方式detailed description
为使本发明的目的、技术方案和优点更加清楚,以下将参照本发明实施例中的附图,通过实施方式清楚、完整地描述本发明的技术方案,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施 例,都属于本发明保护的范围。The present invention will be clearly and completely described by way of embodiments with reference to the accompanying drawings in the embodiments of the invention. Some embodiments, but not all of the embodiments. All other implementations obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts For example, all fall within the scope of protection of the present invention.
参考图1,本发明提供一种多旋翼飞行器的控制方法,所述控制方法可包括以下步骤:Referring to FIG. 1, the present invention provides a control method for a multi-rotor aircraft, which may include the following steps:
S11,根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的水平相对距离、垂直相对距离和相对角度;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;S11, calculating a horizontal relative distance, a vertical relative distance, and a relative angle between the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively the aircraft and the smart terminal a desired distance in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
其中,智能终端可以是体感操控设备如体感操控器,或者可为智能手机、便携式电脑等具有通信、数据处理和定位功能的便携式电子设备。机载飞控系统和智能终端的定位功能可通过安装全球定位系统(Global Positioning System,GPS)软件等具有定位功能的软件实现。可以预先设置一个时间间隔,并每隔所述时间间隔获取一次第一位置信息以及第二位置信息。所述时间间隔可以根据实际需要设定。例如,可以根据智能终端的飞行速度来设定。当智能终端的飞行速度较小时,可以将所述时间间隔设定为一个较小的值,当智能终端的飞行速度较大时,可以将所述时间间隔设定为一个较大的值。也可以根据其他方式来获取。The smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer. The positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software. A time interval may be set in advance, and the first location information and the second location information are acquired once every said time interval. The time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
假设飞行器的初始位置的坐标为(XF0,YF0,ZF0),智能终端的初始位置的坐标为(XT0,YT0,ZT0),则:Assuming that the coordinates of the initial position of the aircraft are (X F0 , Y F0 , Z F0 ) and the coordinates of the initial position of the intelligent terminal are (X T0 , Y T0 , Z T0 ), then:
所述水平相对距离为:
Figure PCTCN2017102598-appb-000001
The horizontal relative distance is:
Figure PCTCN2017102598-appb-000001
所述垂直相对距离为:H=|ZT0-ZTF|;The vertical relative distance is: H=|Z T0 -Z TF |;
所述相对角度为:
Figure PCTCN2017102598-appb-000002
The relative angle is:
Figure PCTCN2017102598-appb-000002
其中,
Figure PCTCN2017102598-appb-000003
为所述相对角度,XF0、YF0、ZF0分别为飞行器的初始位置在NED坐标系中的北轴、东轴和下轴的坐标值,XT0、YT0、ZT0分别为智能终端的初始位置在NED坐标系中的北轴、东轴和下轴的坐标值。
among them,
Figure PCTCN2017102598-appb-000003
For the relative angles, X F0 , Y F0 , Z F0 are the coordinate values of the north axis, the east axis and the lower axis of the initial position of the aircraft in the NED coordinate system, respectively, X T0 , Y T0 , Z T0 are smart terminals respectively. The initial position is the coordinate value of the north, east, and lower axes in the NED coordinate system.
相对角度和期望距离的示意图分别如图2和图3所示。在图2中,若x轴表示NED坐标系中的东轴,y轴表示NED坐标系中的北轴,z轴表示NED坐 标系中的下轴,O为原点,
Figure PCTCN2017102598-appb-000004
为飞行器与智能终端在NED坐标系中的位置矢量,
Figure PCTCN2017102598-appb-000005
Figure PCTCN2017102598-appb-000006
在NED坐标系中的xOy平面上的投影,则
Figure PCTCN2017102598-appb-000007
在xOy平面中所指的方向即为所述相对角度。在一个实施例中,如图2所示,该相对角度可以是东偏南80°。当然,该相对角度也可以是其他角度。具体数值可以根据实际需要设定。在跟随过程中,该相对角度保持不变。
The schematic diagrams of the relative angle and the desired distance are shown in Figures 2 and 3, respectively. In Fig. 2, if the x-axis represents the east axis in the NED coordinate system, the y-axis represents the north axis in the NED coordinate system, the z-axis represents the lower axis in the NED coordinate system, and O is the origin.
Figure PCTCN2017102598-appb-000004
For the position vector of the aircraft and the intelligent terminal in the NED coordinate system,
Figure PCTCN2017102598-appb-000005
for
Figure PCTCN2017102598-appb-000006
Projection on the xOy plane in the NED coordinate system, then
Figure PCTCN2017102598-appb-000007
The direction indicated in the xOy plane is the relative angle. In one embodiment, as shown in FIG. 2, the relative angle may be 80° east and south. Of course, the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
在智能终端移动过程中,执行以下步骤:During the smart terminal move, perform the following steps:
S12,实时获取所述飞行器的第一位置信息,并获取智能终端的第二位置信息,根据所述水平相对距离、垂直相对距离、相对角度和第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;S12: acquiring first location information of the aircraft in real time, and acquiring second location information of the smart terminal, and calculating a target location of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the Calculating the displacement of the aircraft by the first position information and the target position;
由于使飞行器与智能终端之间的水平相对距离为D,且垂直相对距离为H的位置有无数个(即,与所述智能终端的垂直相对距离为H,半径为D的圆上的任意一点都满足),通过设置该相对角度,可以唯一确定一个满足条件的目标位置,使飞行器移动到该目标位置的过程完全复制智能终端的移动过程。通过步骤S12计算出的目标位置、位移矢量以及相对角度,可以使本发明的飞行器按照智能终端的移动轨迹来移动,即当智能终端往左移动1米时,飞行器也往左移动1米;智能终端往上移动1米时,飞行器也往上移动1米;智能终端位置不变时,飞行器位置也不变,且飞行器与智能终端的水平相对距离与垂直相对距离均保持不变。跟随过程示意图如图4所示,智能终端移动前的位置记为P1,智能终端移动后的位置记为P1’,飞行器当前的位置记为P2,飞行器的目标位置记为P2’,飞行器的目标位置与所述第一位置信息对应的位置所形成的位移矢量记为
Figure PCTCN2017102598-appb-000008
智能终端移动前的位置与当前的第二位置信息对应的位置所形成的位移矢量记为
Figure PCTCN2017102598-appb-000009
Figure PCTCN2017102598-appb-000010
Figure PCTCN2017102598-appb-000011
是相等的。
Since the horizontal relative distance between the aircraft and the intelligent terminal is D, and the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied. By setting the relative angle, a target position that satisfies the condition can be uniquely determined, and the process of moving the aircraft to the target position completely copies the moving process of the smart terminal. By the target position, the displacement vector and the relative angle calculated in step S12, the aircraft of the present invention can be moved according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left by 1 meter; When the terminal moves up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged. The schematic diagram of the following process is shown in Figure 4. The position before the smart terminal moves is recorded as P1, the position after the smart terminal moves is recorded as P1', the current position of the aircraft is recorded as P2, and the target position of the aircraft is recorded as P2', the target of the aircraft a displacement vector formed by a position corresponding to the first position information is recorded as
Figure PCTCN2017102598-appb-000008
The displacement vector formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as
Figure PCTCN2017102598-appb-000009
then
Figure PCTCN2017102598-appb-000010
versus
Figure PCTCN2017102598-appb-000011
Is equal.
示例性的,所述目标位置应满足:Exemplarily, the target location should satisfy:
Figure PCTCN2017102598-appb-000012
Figure PCTCN2017102598-appb-000012
Figure PCTCN2017102598-appb-000013
Figure PCTCN2017102598-appb-000013
|ZT-ZF|=H; |Z T -Z F |=H;
其中,(XF,YF,ZF)为目标位置的坐标,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,D为所述水平距离,H为所述垂直距离,
Figure PCTCN2017102598-appb-000014
为所述相对角度,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Where (X F , Y F , Z F ) is the coordinate of the target position, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, D is the horizontal distance, and H is Vertical distance,
Figure PCTCN2017102598-appb-000014
For the relative angles, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively, and X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system. And the east axis position.
S13,根据所述位移生成控制信息,并将所述控制信息发送至飞行器的机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。S13. Generate control information according to the displacement, and send the control information to an airborne flight control system of the aircraft, and control the aircraft to move to the target position with the displacement to enable the imaging device on the aircraft. The lens is always facing or facing the position of the smart terminal during the movement.
在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。所述俯仰角是使所述飞行器上的摄像装置的镜头始终朝向或者正对着智能终端的俯仰角。飞行器在向目标位置飞行过程中,可以不断调整所述俯仰角,使智能终端始终保持在摄像装置的拍摄画面中。在飞行器到达目标位置之后,可以将俯仰角调回到与初始状态相同的俯仰角。目标位置的俯仰角可以根据如下公式计算:During the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera. The pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal. During the flight to the target position, the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state. The pitch angle of the target position can be calculated according to the following formula:
Figure PCTCN2017102598-appb-000015
Figure PCTCN2017102598-appb-000015
其中,H=|ZT-ZF|;
Figure PCTCN2017102598-appb-000016
Where H=|Z T -Z F |;
Figure PCTCN2017102598-appb-000016
式中,θ为所述俯仰角,H为所述飞行器与智能终端在垂直方向上的相对距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,D为所述飞行器与智能终端在水平方向上的相对距离,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。Where θ is the pitch angle, H is the relative distance between the aircraft and the smart terminal in the vertical direction, and Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively. D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and X F and Y F are the aircraft in the northeast. The north and east axis positions in the lower NED coordinate system.
智能终端获取到飞行器的位置信息后,还可以根据飞行器的位置信息及自身的位置信息,计算出飞行器应有的飞行速度,以保证飞行器始终能跟着智能终端飞行。After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
如当携带有智能终端的被拍摄对象在水平方向上移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度,并将该水平飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞 行速度后,可以控制飞行器以该水平飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in the horizontal direction, the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. The airborne flight control system receives the horizontal flight After the line speed, the aircraft can be controlled to fly at the horizontal flight speed, so that the aircraft follows the subject.
又如,当携带有智能终端的被拍摄对象在垂直方向上移动如跳伞或吊威亚时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的垂直飞行速度,并将该垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该垂直飞行速度后,可以控制飞行器以该垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the subject carrying the smart terminal moves in a vertical direction such as skydiving or swaying, the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
再如,当携带有智能终端的被拍摄对象在水平方向和垂直方向上均有移动,如倾斜向上或倾斜向下移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度和垂直飞行速度,并将该水平飞行速度和垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度和垂直飞行速度后,可以控制飞行器以该水平飞行速度和垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in both the horizontal direction and the vertical direction, such as tilting up or tilting downward, the smart terminal can calculate the aircraft according to the position information of the aircraft and its position information. It has a horizontal flight speed and a vertical flight speed, and transmits the horizontal flight speed and the vertical flight speed to the airborne flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
上述飞行器跟随被拍摄对象或者智能终端的情形,可以称之为跟随模式。The case where the above-described aircraft follows the subject or the intelligent terminal may be referred to as a follow mode.
示例性的,可以根据如下方式控制飞行器的水平飞行速度:Illustratively, the horizontal flight speed of the aircraft can be controlled as follows:
Figure PCTCN2017102598-appb-000017
Figure PCTCN2017102598-appb-000017
Figure PCTCN2017102598-appb-000018
Figure PCTCN2017102598-appb-000018
Figure PCTCN2017102598-appb-000019
Figure PCTCN2017102598-appb-000019
Figure PCTCN2017102598-appb-000020
Figure PCTCN2017102598-appb-000020
其中,VX为智能终端指示所述飞行器在所述NED坐标系中的北轴上的飞行速度,VY为智能终端指示所述飞行器在所述NED坐标系中的东轴上的飞行速度,V为智能终端得到的所述飞行器地速,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,
Figure PCTCN2017102598-appb-000021
为所述相对角度,D为所述飞行器与智能终端在水平方向上的距离,XT和YT分别为智能终端在所述NED坐 标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Wherein, V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system, and V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system, V is intelligent terminal obtained the aircraft ground speed, the maximum speed of the aircraft to follow as the intelligent terminal V m obtained, k is a gain coefficient, d is the radius of the dead zone,
Figure PCTCN2017102598-appb-000021
For the relative angle, D is the distance between the aircraft and the intelligent terminal in the horizontal direction, and X T and Y T are the north and east axis positions of the smart terminal in the NED coordinate system, respectively, X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
示例性的,还可以根据如下方式控制飞行器的垂直飞行速度:Illustratively, the vertical flight speed of the aircraft can also be controlled as follows:
Figure PCTCN2017102598-appb-000022
Figure PCTCN2017102598-appb-000022
H=|ZT-ZF|;H=|Z T -Z F |;
其中,V为所述垂直飞行速度,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,H为所述飞行器与智能终端在垂直方向上的距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置。Where V is the vertical flight speed, V m is the maximum following speed of the aircraft obtained by the intelligent terminal, k is the gain coefficient, d is the dead zone radius, and H is the distance between the aircraft and the intelligent terminal in the vertical direction. Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
另外,智能终端还可以将起飞、悬停、降落或返航的命令发送至所述机载飞控系统,相应控制所述飞行器起飞、悬停、降落或返航。In addition, the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
在一个实施例中,智能终端还可以将所述第二位置信息发送到所述机载飞控系统,所述机载飞控系统在所述飞行器与智能终端失联时,控制所述飞行器移动到最后一次接收到的第二位置信息对应的位置。In an embodiment, the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft movement when the aircraft is disconnected from the intelligent terminal The position corresponding to the last received second position information.
在一个实施例中,还可以计算所述第二位置信息与初始第二位置信息的差值;其中,所述初始第二位置信息为智能终端上次获取到的智能终端的位置信息;若所述差值大于预设的距离阈值,根据所述第一位置信息和所述第二位置信息计算所述飞行器的目标位置。In an embodiment, the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
可以看出,本实施例提供的多旋翼飞行器的控制方法,根据飞行器与智能终端之间的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移矢量,根据所述位移矢量生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移矢量移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置,实现了飞行器的自动跟随。并且,在所述飞行器移动过程中,还可以调整所述飞 行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。从而当被拍摄对象携带上述智能终端时,飞行器上安装的摄像装置可以自动跟随被拍摄者进行拍摄,避免了手动操控飞行器,不仅节约了拍摄成本,而且提高了拍摄效率。It can be seen that the control method of the multi-rotor aircraft provided by the embodiment calculates the target position of the aircraft according to the horizontal relative distance between the aircraft and the intelligent terminal, the vertical relative distance, the relative angle, and the second position information, according to the Calculating a displacement vector of the aircraft by the first position information and the target position, generating control information according to the displacement vector, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the The target position is such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft. And, during the movement of the aircraft, the fly can also be adjusted The pitch angle of the image pickup device mounted on the line device keeps the smart terminal in the photographing screen of the image pickup device. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
参考图5,本发明还提供一种多旋翼飞行器的控制方法,所述控制方法可包括以下步骤:Referring to FIG. 5, the present invention also provides a control method for a multi-rotor aircraft, which may include the following steps:
S21,接收机载飞控系统获取的飞行器的第一位置信息,并获取智能终端的第二位置信息;S21. The receiver acquires first location information of the aircraft acquired by the flight control system, and acquires second location information of the smart terminal.
其中,智能终端可以是体感操控设备如体感操控器,或者可为智能手机、便携式电脑等具有通信、数据处理和定位功能的便携式电子设备。机载飞控系统和智能终端的定位功能可通过安装全球定位系统(Global Positioning System,GPS)软件等具有定位功能的软件实现。可以预先设置一个时间间隔,并每隔所述时间间隔获取一次第一位置信息以及第二位置信息。所述时间间隔可以根据实际需要设定。例如,可以根据智能终端的飞行速度来设定。当智能终端的飞行速度较小时,可以将所述时间间隔设定为一个较小的值,当智能终端的飞行速度较大时,可以将所述时间间隔设定为一个较大的值。也可以根据其他方式来获取。The smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer. The positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software. A time interval may be set in advance, and the first location information and the second location information are acquired once every said time interval. The time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
S22,根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;S22. Calculate a target position of the aircraft according to a preset horizontal relative distance, a vertical relative distance, a relative angle, and the second position information, and calculate a displacement of the aircraft according to the first position information and the target position; wherein the horizontal relative The distance and the vertical relative distance are respectively a desired distance between the aircraft and the intelligent terminal in a horizontal direction and a vertical direction, and the relative angle is a relative position formed by the projection of the aircraft on a horizontal plane and the projection of the intelligent terminal on a horizontal plane. Vector angle on a horizontal plane;
在跟随时,可以设定飞行器跟随智能终端时与智能终端的水平和垂直相对距离。例如,可以设定飞行器在相距智能终端的水平距离与垂直距离分别是1米和0.5米处跟随智能终端。上述1米和0.5米即为后续跟随过程中的期望距离,跟随的目标是使飞行器与智能终端之间的水平和垂直相对距离始终保持1米和0.5米不变。期望距离的示意图如图3所示。每次开机时,可以根据飞行器的经 纬度和智能终端的经纬度计算所述水平相对距离、垂直相对距离和相对角度。在后续跟随过程中,可直接根据开机时计算得到的所述水平相对距离、垂直相对距离和相对角度执行跟随过程。When following, the horizontal and vertical relative distances from the smart terminal when the aircraft follows the smart terminal can be set. For example, the aircraft can be set to follow the smart terminal at a horizontal distance and a vertical distance of 1 meter and 0.5 meters apart from each other. The above 1 meter and 0.5 meters are the desired distances in the subsequent follow-up process, and the goal is to keep the horizontal and vertical relative distance between the aircraft and the intelligent terminal constant at 1 meter and 0.5 meters. A schematic diagram of the desired distance is shown in FIG. Every time you turn it on, you can follow the The latitude and longitude of the smart terminal calculate the horizontal relative distance, the vertical relative distance, and the relative angle. In the subsequent follow-up process, the following process can be directly performed according to the horizontal relative distance, the vertical relative distance and the relative angle calculated at the time of power-on.
相对角度的示意图如图2所示。在图2中,若x轴表示NED坐标系中的东轴,y轴表示NED坐标系中的北轴,z轴表示NED坐标系中的下轴,O为原点,
Figure PCTCN2017102598-appb-000023
为飞行器与智能终端在NED坐标系中的位置矢量,
Figure PCTCN2017102598-appb-000024
Figure PCTCN2017102598-appb-000025
在NED坐标系中的xOy平面上的投影,则
Figure PCTCN2017102598-appb-000026
在xOy平面中所指的方向即为所述相对角度。在一个实施例中,如图2所示,该相对角度可以是东偏南80°。当然,该相对角度也可以是其他角度。具体数值可以根据实际需要设定。在跟随过程中,该相对角度保持不变。
A schematic diagram of the relative angle is shown in Figure 2. In FIG. 2, if the x-axis represents the east axis in the NED coordinate system, the y-axis represents the north axis in the NED coordinate system, the z-axis represents the lower axis in the NED coordinate system, and O is the origin.
Figure PCTCN2017102598-appb-000023
For the position vector of the aircraft and the intelligent terminal in the NED coordinate system,
Figure PCTCN2017102598-appb-000024
for
Figure PCTCN2017102598-appb-000025
Projection on the xOy plane in the NED coordinate system, then
Figure PCTCN2017102598-appb-000026
The direction indicated in the xOy plane is the relative angle. In one embodiment, as shown in FIG. 2, the relative angle may be 80° east and south. Of course, the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
由于使飞行器与智能终端之间的水平相对距离为D,且垂直相对距离为H的位置有无数个(即,与所述智能终端的垂直相对距离为H,半径为D的圆上的任意一点都满足),通过设置该相对角度,可以唯一确定一个满足条件的目标位置,使飞行器移动到该目标位置的过程完全复制智能终端的移动过程。通过步骤S22计算出的目标位置、位移以及相对角度,可以使本发明的飞行器按照智能终端的移动轨迹来移动,即当智能终端往左移动1米时,飞行器也往左移动1米;智能终端往上移动1米时,飞行器也往上移动1米;智能终端位置不变时,飞行器位置也不变,且飞行器与智能终端的水平相对距离与垂直相对距离均保持不变。跟随过程示意图如图5所示,智能终端移动前的位置记为P1,智能终端移动后的位置记为P1’,飞行器当前的位置记为P2,飞行器的目标位置记为P2’,飞行器的目标位置与所述第一位置信息对应的位置所形成的位移记为
Figure PCTCN2017102598-appb-000027
智能终端移动前的位置与当前的第二位置信息对应的位置所形成的位移记为
Figure PCTCN2017102598-appb-000028
Figure PCTCN2017102598-appb-000029
Figure PCTCN2017102598-appb-000030
是相等的。
Since the horizontal relative distance between the aircraft and the intelligent terminal is D, and the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied. By setting the relative angle, a target position that satisfies the condition can be uniquely determined, and the process of moving the aircraft to the target position completely copies the moving process of the smart terminal. The target position, the displacement and the relative angle calculated in step S22 can make the aircraft of the present invention move according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left by 1 meter; the intelligent terminal When moving up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged. The schematic diagram of the following process is shown in Figure 5. The position before the smart terminal moves is recorded as P1, the position after the smart terminal moves is recorded as P1', the current position of the aircraft is recorded as P2, and the target position of the aircraft is recorded as P2', the target of the aircraft The displacement formed by the position corresponding to the first position information is recorded as
Figure PCTCN2017102598-appb-000027
The displacement formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as
Figure PCTCN2017102598-appb-000028
then
Figure PCTCN2017102598-appb-000029
versus
Figure PCTCN2017102598-appb-000030
Is equal.
示例性的,所述目标位置应满足:Exemplarily, the target location should satisfy:
Figure PCTCN2017102598-appb-000031
Figure PCTCN2017102598-appb-000031
Figure PCTCN2017102598-appb-000032
Figure PCTCN2017102598-appb-000032
|ZT-ZF|=H; |Z T -Z F |=H;
其中,(XF,YF,ZF)为目标位置的坐标,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,D为所述水平距离,H为所述垂直距离,
Figure PCTCN2017102598-appb-000033
为所述相对角度,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Where (X F , Y F , Z F ) is the coordinate of the target position, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, D is the horizontal distance, and H is Vertical distance,
Figure PCTCN2017102598-appb-000033
For the relative angles, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively, and X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system. And the east axis position.
其中,所述相对角度可以根据所述机载飞控系统获取的飞行器的初始位置信息(XF0,YF0,ZF0)以及智能终端的初始位置信息(XT0,YT0,ZT0)计算得到,所述飞行器的初始位置信息以及智能终端的初始位置信息可以是系统开始运行之后第一次获取到的位置信息。在计算出相对角度之后,可以将该相对角度存储在系统中,并在后续控制过程中控制飞行器保持该相对角度移动。根据初始位置信息计算相对角度的方式为:The relative angle may be calculated according to the initial position information (X F0 , Y F0 , Z F0 ) of the aircraft acquired by the onboard flight control system and the initial position information (X T0 , Y T0 , Z T0 ) of the intelligent terminal. It is obtained that the initial position information of the aircraft and the initial position information of the smart terminal may be position information acquired for the first time after the system starts running. After the relative angle is calculated, the relative angle can be stored in the system and the aircraft is controlled to maintain the relative angular movement during subsequent control. The way to calculate the relative angle based on the initial position information is:
Figure PCTCN2017102598-appb-000034
Figure PCTCN2017102598-appb-000034
S23、根据所述目标位置生成控制信息,并将所述控制信息发送到所述机载飞控系统,相应控制所述飞行器保持预存的相对角度移动到所述目标位置;其中,所述相对角度为飞行器与智能终端之间的相对角度。S23. Generate control information according to the target location, and send the control information to the onboard flight control system, and accordingly control the relative position of the aircraft to maintain pre-stored to move to the target position; wherein the relative angle It is the relative angle between the aircraft and the intelligent terminal.
在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。所述俯仰角是使所述飞行器上的摄像装置的镜头始终朝向或者正对着智能终端的俯仰角。飞行器在向目标位置飞行过程中,可以不断调整所述俯仰角,使智能终端始终保持在摄像装置的拍摄画面中。在飞行器到达目标位置之后,可以将俯仰角调回到与初始状态相同的俯仰角。目标位置的俯仰角可以根据如下公式计算:During the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera. The pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal. During the flight to the target position, the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state. The pitch angle of the target position can be calculated according to the following formula:
Figure PCTCN2017102598-appb-000035
Figure PCTCN2017102598-appb-000035
其中,H=|ZT-ZF|;
Figure PCTCN2017102598-appb-000036
Where H=|Z T -Z F |;
Figure PCTCN2017102598-appb-000036
式中,θ为所述俯仰角,H为所述飞行器与智能终端在垂直方向上的相对距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,D为所述飞行器与智能终端在水平方向上的相对距离,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系 中的北轴和东轴位置。Where θ is the pitch angle, H is the relative distance between the aircraft and the smart terminal in the vertical direction, and Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively. D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and X F and Y F are the aircraft in the northeast. The north and east axis positions in the lower NED coordinate system.
智能终端获取到飞行器的位置信息后,还可以根据飞行器的位置信息及自身的位置信息,计算出飞行器应有的飞行速度,以保证飞行器始终能跟着智能终端飞行。After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
如当携带有智能终端的被拍摄对象在水平方向上移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度,并将该水平飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度后,可以控制飞行器以该水平飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in the horizontal direction, the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. After receiving the horizontal flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed, so that the aircraft follows the subject.
又如,当携带有智能终端的被拍摄对象在垂直方向上移动如跳伞或吊威亚时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的垂直飞行速度,并将该垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该垂直飞行速度后,可以控制飞行器以该垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the subject carrying the smart terminal moves in a vertical direction such as skydiving or swaying, the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
再如,当携带有智能终端的被拍摄对象在水平方向和垂直方向上均有移动,如倾斜向上或倾斜向下移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度和垂直飞行速度,并将该水平飞行速度和垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度和垂直飞行速度后,可以控制飞行器以该水平飞行速度和垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in both the horizontal direction and the vertical direction, such as tilting up or tilting downward, the smart terminal can calculate the aircraft according to the position information of the aircraft and its position information. It has a horizontal flight speed and a vertical flight speed, and transmits the horizontal flight speed and the vertical flight speed to the airborne flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
上述飞行器跟随被拍摄对象或者智能终端的情形,可以称之为跟随模式。The case where the above-described aircraft follows the subject or the intelligent terminal may be referred to as a follow mode.
示例性的,可以根据如下方式控制飞行器的水平飞行速度:Illustratively, the horizontal flight speed of the aircraft can be controlled as follows:
Figure PCTCN2017102598-appb-000037
Figure PCTCN2017102598-appb-000037
Figure PCTCN2017102598-appb-000038
Figure PCTCN2017102598-appb-000038
Figure PCTCN2017102598-appb-000039
Figure PCTCN2017102598-appb-000039
Figure PCTCN2017102598-appb-000040
Figure PCTCN2017102598-appb-000040
其中,VX为智能终端指示所述飞行器在所述NED坐标系中的北轴上的飞行速度,VY为智能终端指示所述飞行器在所述NED坐标系中的东轴上的飞行速度,V为智能终端得到的所述飞行器地速,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,
Figure PCTCN2017102598-appb-000041
为所述相对角度,D为所述飞行器与智能终端在水平方向上的距离,XT和YT分别为智能终端在所述NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Wherein, V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system, and V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system, V is intelligent terminal obtained the aircraft ground speed, the maximum speed of the aircraft to follow as the intelligent terminal V m obtained, k is a gain coefficient, d is the radius of the dead zone,
Figure PCTCN2017102598-appb-000041
For the relative angle, D is the distance between the aircraft and the intelligent terminal in the horizontal direction, and X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
示例性的,还可以根据如下方式控制飞行器的垂直飞行速度:Illustratively, the vertical flight speed of the aircraft can also be controlled as follows:
Figure PCTCN2017102598-appb-000042
Figure PCTCN2017102598-appb-000042
H=|ZT-ZF|;H=|Z T -Z F |;
其中,V为所述垂直飞行速度,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,H为所述飞行器与智能终端在垂直方向上的距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置。Where V is the vertical flight speed, V m is the maximum following speed of the aircraft obtained by the intelligent terminal, k is the gain coefficient, d is the dead zone radius, and H is the distance between the aircraft and the intelligent terminal in the vertical direction. Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
另外,智能终端还可以将起飞、悬停、降落或返航的命令发送至所述机载飞控系统,相应控制所述飞行器起飞、悬停、降落或返航。In addition, the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
在一个实施例中,智能终端还可以将所述第二位置信息发送到所述机载飞控系统,所述机载飞控系统在所述飞行器与智能终端失联时,控制所述飞行器移动到最后一次接收到的第二位置信息对应的位置。In an embodiment, the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft movement when the aircraft is disconnected from the intelligent terminal The position corresponding to the last received second position information.
在一个实施例中,还可以计算所述第二位置信息与初始第二位置信息的差值;其中,所述初始第二位置信息为智能终端上次获取到的智能终端的位置信息;若所述差值大于预设的距离阈值,根据所述第一位置信息和所述第二位置信息计算所述飞行器的目标位置。 In an embodiment, the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
可以看出,本实施例提供的多旋翼飞行器的控制方法,根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移,根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置,实现了飞行器的自动跟随。并且,在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。从而当被拍摄对象携带上述智能终端时,飞行器上安装的摄像装置可以自动跟随被拍摄者进行拍摄,避免了手动操控飞行器,不仅节约了拍摄成本,而且提高了拍摄效率。It can be seen that the control method of the multi-rotor aircraft provided by the embodiment calculates the target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle and the second position information, according to the first position information. Calculating a displacement of the aircraft with the target position, generating control information according to the displacement, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft. Moreover, during the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
参考图6,与所述第一实施例的多旋翼飞行器的控制方法相对应地,本发明提供一种多旋翼飞行器的控制装置,可包括:Referring to FIG. 6, in accordance with the control method of the multi-rotor aircraft of the first embodiment, the present invention provides a control device for a multi-rotor aircraft, which may include:
第一计算装置110,用于根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的水平相对距离、垂直相对距离和相对角度;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;a first computing device 110, configured to calculate a horizontal relative distance, a vertical relative distance, and a relative angle between the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively Determining a desired distance between the aircraft and the intelligent terminal in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
其中,智能终端可以是体感操控设备如体感操控器,或者可为智能手机、便携式电脑等具有通信、数据处理和定位功能的便携式电子设备。机载飞控系统和智能终端的定位功能可通过安装全球定位系统(Global Positioning System,GPS)软件等具有定位功能的软件实现。可以预先设置一个时间间隔,并每隔所述时间间隔获取一次第一位置信息以及第二位置信息。所述时间间隔可以根据实际需要设定。例如,可以根据智能终端的飞行速度来设定。当智能终端的飞行速度较小时,可以将所述时间间隔设定为一个较小的值,当智能终端的飞行速度较大时,可以将所述时间间隔设定为一个较大的值。也可以根据其他方式来获取。The smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer. The positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software. A time interval may be set in advance, and the first location information and the second location information are acquired once every said time interval. The time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
假设飞行器的初始位置的坐标为(XF0,YF0,ZF0),智能终端的初始位置的坐标为(XT0,YT0,ZT0),则: Assuming that the coordinates of the initial position of the aircraft are (X F0 , Y F0 , Z F0 ) and the coordinates of the initial position of the intelligent terminal are (X T0 , Y T0 , Z T0 ), then:
所述水平相对距离为:
Figure PCTCN2017102598-appb-000043
The horizontal relative distance is:
Figure PCTCN2017102598-appb-000043
所述垂直相对距离为:H=|ZT0-ZTF|;The vertical relative distance is: H=|Z T0 -Z TF |;
所述相对角度为:
Figure PCTCN2017102598-appb-000044
The relative angle is:
Figure PCTCN2017102598-appb-000044
其中,
Figure PCTCN2017102598-appb-000045
为所述相对角度,XF0、YF0、ZF0分别为飞行器的初始位置在NED坐标系中的北轴、东轴和下轴的坐标值,XT0、YT0、ZT0分别为智能终端的初始位置在NED坐标系中的北轴、东轴和下轴的坐标值。
among them,
Figure PCTCN2017102598-appb-000045
For the relative angles, X F0 , Y F0 , Z F0 are the coordinate values of the north axis, the east axis and the lower axis of the initial position of the aircraft in the NED coordinate system, respectively, X T0 , Y T0 , Z T0 are smart terminals respectively. The initial position is the coordinate value of the north, east, and lower axes in the NED coordinate system.
相对角度的示意图如图2所示。在图2中,若x轴表示NED坐标系中的东轴,y轴表示NED坐标系中的北轴,z轴表示NED坐标系中的下轴,O为原点,
Figure PCTCN2017102598-appb-000046
为飞行器与智能终端在NED坐标系中的位置矢量,
Figure PCTCN2017102598-appb-000047
Figure PCTCN2017102598-appb-000048
在NED坐标系中的xOy平面上的投影,则
Figure PCTCN2017102598-appb-000049
在xOy平面中所指的方向即为所述相对角度。在一个实施例中,如图2所示,该相对角度可以是东偏南80°。当然,该相对角度也可以是其他角度。具体数值可以根据实际需要设定。在跟随过程中,该相对角度保持不变。
A schematic diagram of the relative angle is shown in Figure 2. In FIG. 2, if the x-axis represents the east axis in the NED coordinate system, the y-axis represents the north axis in the NED coordinate system, the z-axis represents the lower axis in the NED coordinate system, and O is the origin.
Figure PCTCN2017102598-appb-000046
For the position vector of the aircraft and the intelligent terminal in the NED coordinate system,
Figure PCTCN2017102598-appb-000047
for
Figure PCTCN2017102598-appb-000048
Projection on the xOy plane in the NED coordinate system, then
Figure PCTCN2017102598-appb-000049
The direction indicated in the xOy plane is the relative angle. In one embodiment, as shown in FIG. 2, the relative angle may be 80° east and south. Of course, the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
在智能终端移动过程中,执行以下装置的功能:During the movement of the smart terminal, perform the functions of the following devices:
第二计算装置120,用于实时获取所述飞行器的第一位置信息,并获取智能终端的第二位置信息,根据所述水平相对距离、垂直相对距离、相对角度和第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;a second computing device 120, configured to acquire first location information of the aircraft in real time, and acquire second location information of the smart terminal, and calculate an aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information. a target position, calculating a displacement of the aircraft according to the first position information and the target position;
由于使飞行器与智能终端之间的水平相对距离为D,且垂直相对距离为H的位置有无数个(即,与所述智能终端的垂直相对距离为H,半径为D的圆上的任意一点都满足),通过设置该相对角度,可以唯一确定一个满足条件的目标位置,使飞行器移动到该目标位置的过程完全复制智能终端的移动过程。通过第二计算装置120计算出的目标位置、位移矢量以及相对角度,可以使本发明的飞行器按照智能终端的移动轨迹来移动,即当智能终端往左移动1米时,飞行器也往左移动1米;智能终端往上移动1米时,飞行器也往上移动1米;智能终端位置不变时,飞行器位置也不变,且飞行器与智能终端的水平相对距离与垂直相对距离均保持不变。跟随过程示意图如图5所示,智能终端移动前的 位置记为P1,智能终端移动后的位置记为P1’,飞行器当前的位置记为P2,飞行器的目标位置记为P2’,飞行器的目标位置与所述第一位置信息对应的位置所形成的位移矢量记为
Figure PCTCN2017102598-appb-000050
智能终端移动前的位置与当前的第二位置信息对应的位置所形成的位移矢量记为
Figure PCTCN2017102598-appb-000051
Figure PCTCN2017102598-appb-000052
Figure PCTCN2017102598-appb-000053
是相等的。
Since the horizontal relative distance between the aircraft and the intelligent terminal is D, and the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied. By setting the relative angle, a target position that satisfies the condition can be uniquely determined, and the process of moving the aircraft to the target position completely copies the moving process of the smart terminal. By the target position, the displacement vector and the relative angle calculated by the second computing device 120, the aircraft of the present invention can be moved according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left. When the intelligent terminal moves up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged. The schematic diagram of the following process is shown in Figure 5. The position before the smart terminal moves is recorded as P1, the position after the smart terminal moves is recorded as P1', the current position of the aircraft is recorded as P2, and the target position of the aircraft is recorded as P2', the target of the aircraft a displacement vector formed by a position corresponding to the first position information is recorded as
Figure PCTCN2017102598-appb-000050
The displacement vector formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as
Figure PCTCN2017102598-appb-000051
then
Figure PCTCN2017102598-appb-000052
versus
Figure PCTCN2017102598-appb-000053
Is equal.
示例性的,所述目标位置应满足:Exemplarily, the target location should satisfy:
Figure PCTCN2017102598-appb-000054
Figure PCTCN2017102598-appb-000054
Figure PCTCN2017102598-appb-000055
Figure PCTCN2017102598-appb-000055
|ZT-ZF|=H;|Z T -Z F |=H;
其中,(XF,YF,ZF)为目标位置的坐标,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,D为所述水平距离,H为所述垂直距离,
Figure PCTCN2017102598-appb-000056
为所述相对角度,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Where (X F , Y F , Z F ) is the coordinate of the target position, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, D is the horizontal distance, and H is Vertical distance,
Figure PCTCN2017102598-appb-000056
For the relative angles, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively, and X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system. And the east axis position.
第一控制装置130,用于根据所述位移生成控制信息,并将所述控制信息发送至飞行器的机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。a first control device 130, configured to generate control information according to the displacement, and send the control information to an airborne flight control system of the aircraft, and control the aircraft to move to the target position with the displacement, so as to The lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement.
在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。所述俯仰角是使所述飞行器上的摄像装置的镜头始终朝向或者正对着智能终端的俯仰角。飞行器在向目标位置飞行过程中,可以不断调整所述俯仰角,使智能终端始终保持在摄像装置的拍摄画面中。在飞行器到达目标位置之后,可以将俯仰角调回到与初始状态相同的俯仰角。目标位置的俯仰角可以根据如下公式计算:During the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera. The pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal. During the flight to the target position, the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state. The pitch angle of the target position can be calculated according to the following formula:
Figure PCTCN2017102598-appb-000057
Figure PCTCN2017102598-appb-000057
其中,H=|ZT-ZF|;
Figure PCTCN2017102598-appb-000058
Where H=|Z T -Z F |;
Figure PCTCN2017102598-appb-000058
式中,θ为所述俯仰角,H为所述飞行器与智能终端在垂直方向上的相对 距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,D为所述飞行器与智能终端在水平方向上的相对距离,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。Where θ is the pitch angle, H is the relative distance between the aircraft and the smart terminal in the vertical direction, and Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively. D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and X F and Y F are the aircraft in the northeast. The north and east axis positions in the lower NED coordinate system.
智能终端获取到飞行器的位置信息后,还可以根据飞行器的位置信息及自身的位置信息,计算出飞行器应有的飞行速度,以保证飞行器始终能跟着智能终端飞行。After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
如当携带有智能终端的被拍摄对象在水平方向上移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度,并将该水平飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度后,可以控制飞行器以该水平飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in the horizontal direction, the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. After receiving the horizontal flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed, so that the aircraft follows the subject.
又如,当携带有智能终端的被拍摄对象在垂直方向上移动如跳伞或吊威亚时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的垂直飞行速度,并将该垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该垂直飞行速度后,可以控制飞行器以该垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the subject carrying the smart terminal moves in a vertical direction such as skydiving or swaying, the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
再如,当携带有智能终端的被拍摄对象在水平方向和垂直方向上均有移动,如倾斜向上或倾斜向下移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度和垂直飞行速度,并将该水平飞行速度和垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度和垂直飞行速度后,可以控制飞行器以该水平飞行速度和垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in both the horizontal direction and the vertical direction, such as tilting up or tilting downward, the smart terminal can calculate the aircraft according to the position information of the aircraft and its position information. It has a horizontal flight speed and a vertical flight speed, and transmits the horizontal flight speed and the vertical flight speed to the airborne flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
上述飞行器跟随被拍摄对象或者智能终端的情形,可以称之为跟随模式。The case where the above-described aircraft follows the subject or the intelligent terminal may be referred to as a follow mode.
示例性的,可以根据如下方式控制飞行器的水平飞行速度:Illustratively, the horizontal flight speed of the aircraft can be controlled as follows:
Figure PCTCN2017102598-appb-000059
Figure PCTCN2017102598-appb-000059
Figure PCTCN2017102598-appb-000060
Figure PCTCN2017102598-appb-000060
Figure PCTCN2017102598-appb-000061
Figure PCTCN2017102598-appb-000061
Figure PCTCN2017102598-appb-000062
Figure PCTCN2017102598-appb-000062
其中,VX为智能终端指示所述飞行器在所述NED坐标系中的北轴上的飞行速度,VY为智能终端指示所述飞行器在所述NED坐标系中的东轴上的飞行速度,V为智能终端得到的所述飞行器地速,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,
Figure PCTCN2017102598-appb-000063
为所述相对角度,D为所述飞行器与智能终端在水平方向上的距离,XT和YT分别为智能终端在所述NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Wherein, V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system, and V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system, V is intelligent terminal obtained the aircraft ground speed, the maximum speed of the aircraft to follow as the intelligent terminal V m obtained, k is a gain coefficient, d is the radius of the dead zone,
Figure PCTCN2017102598-appb-000063
For the relative angle, D is the distance between the aircraft and the intelligent terminal in the horizontal direction, and X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
示例性的,还可以根据如下方式控制飞行器的垂直飞行速度:Illustratively, the vertical flight speed of the aircraft can also be controlled as follows:
Figure PCTCN2017102598-appb-000064
Figure PCTCN2017102598-appb-000064
H=|ZT-ZF|;H=|Z T -Z F |;
其中,V为所述垂直飞行速度,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,H为所述飞行器与智能终端在垂直方向上的距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置。Where V is the vertical flight speed, V m is the maximum following speed of the aircraft obtained by the intelligent terminal, k is the gain coefficient, d is the dead zone radius, and H is the distance between the aircraft and the intelligent terminal in the vertical direction. Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
另外,智能终端还可以将起飞、悬停、降落或返航的命令发送至所述机载飞控系统,相应控制所述飞行器起飞、悬停、降落或返航。In addition, the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
在一个实施例中,智能终端还可以将所述第二位置信息发送到所述机载飞控系统,所述机载飞控系统在所述飞行器与智能终端失联时,控制所述飞行器 移动到最后一次接收到的第二位置信息对应的位置。In an embodiment, the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft when the aircraft is disconnected from the intelligent terminal Move to the position corresponding to the last received second position information.
在一个实施例中,还可以计算所述第二位置信息与初始第二位置信息的差值;其中,所述初始第二位置信息为智能终端上次获取到的智能终端的位置信息;若所述差值大于预设的距离阈值,根据所述第一位置信息和所述第二位置信息计算所述飞行器的目标位置。In an embodiment, the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
可以看出,本实施例提供的多旋翼飞行器的控制装置,根据飞行器与智能终端之间的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移矢量,根据所述位移矢量生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移矢量移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置,实现了飞行器的自动跟随。并且,在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。从而当被拍摄对象携带上述智能终端时,飞行器上安装的摄像装置可以自动跟随被拍摄者进行拍摄,避免了手动操控飞行器,不仅节约了拍摄成本,而且提高了拍摄效率。It can be seen that the control device of the multi-rotor aircraft provided by the embodiment calculates the target position of the aircraft according to the horizontal relative distance between the aircraft and the intelligent terminal, the vertical relative distance, the relative angle and the second position information, according to the Calculating a displacement vector of the aircraft by the first position information and the target position, generating control information according to the displacement vector, transmitting the control information to the onboard flight control system, and controlling the aircraft to move to the The target position is such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft. Moreover, during the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
与第二实施例的多旋翼飞行器的控制方法相对应地,本发明还提供一种多旋翼飞行器的控制装置,如图7所示,所述多旋翼飞行器的控制装置可包括:Corresponding to the control method of the multi-rotor aircraft of the second embodiment, the present invention further provides a control device for a multi-rotor aircraft. As shown in FIG. 7, the control device of the multi-rotor aircraft may include:
位置获取装置210,用于接收机载飞控系统获取的飞行器的第一位置信息,并获取智能终端的第二位置信息;a location acquiring device 210, configured to receive first location information of the aircraft acquired by the flight control system, and acquire second location information of the smart terminal;
其中,智能终端可以是体感操控设备如体感操控器,或者可为智能手机、便携式电脑等具有通信、数据处理和定位功能的便携式电子设备。机载飞控系统和智能终端的定位功能可通过安装全球定位系统(Global Positioning System,GPS)软件等具有定位功能的软件实现。可以预设时间间隔,并每隔所述时间间隔获取一次第一位置信息以及第二位置信息。所述时间间隔可以根据实际需要设定。例如,可以根据智能终端的飞行速度来设定。当智能终端的飞行速度较小时,可以将所述时间间隔设定为一个较小的值,当智能终端的飞行速度较大时,可以将所述时间间隔设定为一个较大的值。也可以根据其他方式来获取。 The smart terminal may be a somatosensory control device such as a somatosensory controller, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer. The positioning function of the airborne flight control system and the intelligent terminal can be realized by installing software with positioning functions such as Global Positioning System (GPS) software. The time interval may be preset, and the first location information and the second location information are acquired once every said time interval. The time interval can be set according to actual needs. For example, it can be set according to the flight speed of the smart terminal. When the flight speed of the smart terminal is small, the time interval may be set to a small value, and when the flight speed of the smart terminal is large, the time interval may be set to a larger value. It can also be obtained in other ways.
第三计算装置220,用于根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;The third calculating device 220 is configured to calculate a target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second position information, and calculate the displacement of the aircraft according to the first position information and the target position; Wherein the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, wherein the relative angle is a projection of the aircraft on a horizontal plane and a horizontal position of the intelligent terminal. The angle of the relative position vector formed by the projection on the horizontal plane;
在跟随时,可以设定飞行器跟随智能终端时与智能终端的水平和垂直相对距离。例如,可以设定飞行器在相距智能终端的水平距离与垂直距离分别是1米和0.5米处跟随智能终端。上述1米和0.5米即为后续跟随过程中的期望距离,跟随的目标是使飞行器与智能终端之间的水平和垂直相对距离始终保持1米和0.5米不变。期望距离的示意图如图3所示。每次开机时,可以根据飞行器的经纬度和智能终端的经纬度计算所述水平相对距离、垂直相对距离和相对角度。在后续跟随过程中,可直接根据开机时计算得到的所述水平相对距离、垂直相对距离和相对角度执行跟随过程。When following, the horizontal and vertical relative distances from the smart terminal when the aircraft follows the smart terminal can be set. For example, the aircraft can be set to follow the smart terminal at a horizontal distance and a vertical distance of 1 meter and 0.5 meters apart from each other. The above 1 meter and 0.5 meters are the desired distances in the subsequent follow-up process, and the goal is to keep the horizontal and vertical relative distance between the aircraft and the intelligent terminal constant at 1 meter and 0.5 meters. A schematic diagram of the desired distance is shown in FIG. Each time the power is turned on, the horizontal relative distance, the vertical relative distance, and the relative angle may be calculated according to the latitude and longitude of the aircraft and the latitude and longitude of the smart terminal. In the subsequent follow-up process, the following process can be directly performed according to the horizontal relative distance, the vertical relative distance and the relative angle calculated at the time of power-on.
相对角度的示意图如图2所示。在图2中,若x轴表示NED坐标系中的东轴,y轴表示NED坐标系中的北轴,z轴表示NED坐标系中的下轴,O为原点,
Figure PCTCN2017102598-appb-000065
为飞行器与智能终端在NED坐标系中的位置矢量,
Figure PCTCN2017102598-appb-000066
Figure PCTCN2017102598-appb-000067
在NED坐标系中的xOy平面上的投影,则
Figure PCTCN2017102598-appb-000068
在xOy平面中所指的方向即为所述相对角度。在一个实施例中,如图2所示,该相对角度可以是东偏南80°。当然,该相对角度也可以是其他角度。具体数值可以根据实际需要设定。在跟随过程中,该相对角度保持不变。
A schematic diagram of the relative angle is shown in Figure 2. In FIG. 2, if the x-axis represents the east axis in the NED coordinate system, the y-axis represents the north axis in the NED coordinate system, the z-axis represents the lower axis in the NED coordinate system, and O is the origin.
Figure PCTCN2017102598-appb-000065
For the position vector of the aircraft and the intelligent terminal in the NED coordinate system,
Figure PCTCN2017102598-appb-000066
for
Figure PCTCN2017102598-appb-000067
Projection on the xOy plane in the NED coordinate system, then
Figure PCTCN2017102598-appb-000068
The direction indicated in the xOy plane is the relative angle. In one embodiment, as shown in FIG. 2, the relative angle may be 80° east and south. Of course, the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
由于使飞行器与智能终端之间的水平相对距离为D,且垂直相对距离为H的位置有无数个(即,与所述智能终端的垂直相对距离为H,半径为D的圆上的任意一点都满足),通过设置该相对角度,可以唯一确定一个满足条件的目标位置,使飞行器移动到该目标位置的过程完全复制智能终端的移动过程。通过第三计算装置220计算出的目标位置、位移以及相对角度,可以使本发明的飞行器按照智能终端的移动轨迹来移动,即当智能终端往左移动1米时,飞行器也往左移动1米;智能终端往上移动1米时,飞行器也往上移动1米;智能终 端位置不变时,飞行器位置也不变,且飞行器与智能终端的水平相对距离与垂直相对距离均保持不变。跟随过程示意图如图5所示,智能终端移动前的位置记为P1,智能终端移动后的位置记为P1’,飞行器当前的位置记为P2,飞行器的目标位置记为P2’,飞行器的目标位置与所述第一位置信息对应的位置所形成的位移记为
Figure PCTCN2017102598-appb-000069
智能终端移动前的位置与当前的第二位置信息对应的位置所形成的位移记为
Figure PCTCN2017102598-appb-000070
Figure PCTCN2017102598-appb-000071
Figure PCTCN2017102598-appb-000072
是相等的。
Since the horizontal relative distance between the aircraft and the intelligent terminal is D, and the position of the vertical relative distance H is innumerable (ie, the vertical relative distance from the intelligent terminal is H, any point on the circle with the radius D All of them are satisfied. By setting the relative angle, a target position that satisfies the condition can be uniquely determined, and the process of moving the aircraft to the target position completely copies the moving process of the smart terminal. The target position, displacement and relative angle calculated by the third computing device 220 can cause the aircraft of the present invention to move according to the movement trajectory of the intelligent terminal, that is, when the intelligent terminal moves 1 meter to the left, the aircraft also moves to the left by 1 meter. When the intelligent terminal moves up 1 meter, the aircraft also moves up 1 meter; when the position of the intelligent terminal is unchanged, the position of the aircraft remains unchanged, and the horizontal relative distance and vertical relative distance between the aircraft and the intelligent terminal remain unchanged. The schematic diagram of the following process is shown in Figure 5. The position before the smart terminal moves is recorded as P1, the position after the smart terminal moves is recorded as P1', the current position of the aircraft is recorded as P2, and the target position of the aircraft is recorded as P2', the target of the aircraft The displacement formed by the position corresponding to the first position information is recorded as
Figure PCTCN2017102598-appb-000069
The displacement formed by the position of the smart terminal before the movement and the position corresponding to the current second position information is recorded as
Figure PCTCN2017102598-appb-000070
then
Figure PCTCN2017102598-appb-000071
versus
Figure PCTCN2017102598-appb-000072
Is equal.
示例性的,所述目标位置应满足:Exemplarily, the target location should satisfy:
Figure PCTCN2017102598-appb-000073
Figure PCTCN2017102598-appb-000073
Figure PCTCN2017102598-appb-000074
Figure PCTCN2017102598-appb-000074
|ZT-ZF|=H;|Z T -Z F |=H;
其中,(XF,YF,ZF)为目标位置的坐标,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,D为所述飞行器与智能终端在水平方向上的相对距离,H为所述飞行器与智能终端在垂直方向上的相对距离,
Figure PCTCN2017102598-appb-000075
为所述相对角度,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Where (X F , Y F , Z F ) is the coordinate of the target position, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and D is the level of the aircraft and the intelligent terminal. The relative distance in the direction, H is the relative distance between the aircraft and the intelligent terminal in the vertical direction.
Figure PCTCN2017102598-appb-000075
For the relative angles, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively, and X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system. And the east axis position.
其中,所述相对角度可以根据所述机载飞控系统获取的飞行器的初始位置信息(XF0,YF0,ZF0)以及智能终端的初始位置信息(XT0,YT0,ZT0)计算得到,所述飞行器的初始位置信息以及智能终端的初始位置信息可以是系统开始运行之后第一次获取到的位置信息。在计算出相对角度之后,可以将该相对角度存储在系统中,并在后续控制过程中控制飞行器保持该相对角度移动。根据初始位置信息计算相对角度的方式为:The relative angle may be calculated according to the initial position information (X F0 , Y F0 , Z F0 ) of the aircraft acquired by the onboard flight control system and the initial position information (X T0 , Y T0 , Z T0 ) of the intelligent terminal. It is obtained that the initial position information of the aircraft and the initial position information of the smart terminal may be position information acquired for the first time after the system starts running. After the relative angle is calculated, the relative angle can be stored in the system and the aircraft is controlled to maintain the relative angular movement during subsequent control. The way to calculate the relative angle based on the initial position information is:
Figure PCTCN2017102598-appb-000076
Figure PCTCN2017102598-appb-000076
第二控制装置230,用于根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。 a second control device 230, configured to send the control information to the onboard flight control system according to the displacement generation control information, and control the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement.
在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。所述俯仰角是使所述飞行器上的摄像装置的镜头始终朝向或者正对着智能终端的俯仰角。飞行器在向目标位置飞行过程中,可以不断调整所述俯仰角,使智能终端始终保持在摄像装置的拍摄画面中。在飞行器到达目标位置之后,可以将俯仰角调回到与初始状态相同的俯仰角。目标位置的俯仰角可以根据如下公式计算:During the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to maintain the smart terminal in the photographing screen of the camera. The pitch angle is a pitch angle at which the lens of the camera on the aircraft is always facing or facing the smart terminal. During the flight to the target position, the aircraft can continuously adjust the pitch angle so that the smart terminal is always kept in the shooting picture of the camera. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state. The pitch angle of the target position can be calculated according to the following formula:
Figure PCTCN2017102598-appb-000077
Figure PCTCN2017102598-appb-000077
其中,H=|ZT-ZF|;
Figure PCTCN2017102598-appb-000078
Where H=|Z T -Z F |;
Figure PCTCN2017102598-appb-000078
式中,θ为所述俯仰角,H为所述飞行器与智能终端在垂直方向上的相对距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,D为所述飞行器与智能终端在水平方向上的相对距离,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。Where θ is the pitch angle, H is the relative distance between the aircraft and the smart terminal in the vertical direction, and Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively. D is the relative distance between the aircraft and the intelligent terminal in the horizontal direction, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and X F and Y F are the aircraft in the northeast. The north and east axis positions in the lower NED coordinate system.
智能终端获取到飞行器的位置信息后,还可以根据飞行器的位置信息及自身的位置信息,计算出飞行器应有的飞行速度,以保证飞行器始终能跟着智能终端飞行。After acquiring the position information of the aircraft, the intelligent terminal can also calculate the flight speed of the aircraft according to the position information of the aircraft and its own position information, so as to ensure that the aircraft can always follow the intelligent terminal.
如当携带有智能终端的被拍摄对象在水平方向上移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度,并将该水平飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度后,可以控制飞行器以该水平飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the object carrying the smart terminal moves in the horizontal direction, the smart terminal can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed to the airborne. Flight control system. After receiving the horizontal flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed, so that the aircraft follows the subject.
又如,当携带有智能终端的被拍摄对象在垂直方向上移动如跳伞或吊威亚时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的垂直飞行速度,并将该垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该垂直飞行速度后,可以控制飞行器以该垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For example, when the subject carrying the smart terminal moves in a vertical direction such as skydiving or swaying, the smart terminal can calculate the vertical flying speed that the aircraft should have according to the position information of the aircraft and its own position information, and This vertical flight speed is sent to the onboard flight control system. After receiving the vertical flight speed, the airborne flight control system can control the aircraft to fly at the vertical flight speed to cause the aircraft to follow the subject.
再如,当携带有智能终端的被拍摄对象在水平方向和垂直方向上均有移动, 如倾斜向上或倾斜向下移动时,智能终端可以根据飞行器的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度和垂直飞行速度,并将该水平飞行速度和垂直飞行速度发送给机载飞控系统。机载飞控系统接收到该水平飞行速度和垂直飞行速度后,可以控制飞行器以该水平飞行速度和垂直飞行速度飞行,使飞行器跟着的被拍摄对象飞行。For another example, when a subject carrying a smart terminal moves in both the horizontal direction and the vertical direction, When moving obliquely upward or obliquely downward, the intelligent terminal can calculate the horizontal flight speed and the vertical flight speed that the aircraft should have according to the position information of the aircraft and the position information of the aircraft, and send the horizontal flight speed and the vertical flight speed to the aircraft. Flight control system. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system can control the aircraft to fly at the horizontal flight speed and the vertical flight speed, so that the aircraft follows the subject.
上述飞行器跟随被拍摄对象或者智能终端的情形,可以称之为跟随模式。The case where the above-described aircraft follows the subject or the intelligent terminal may be referred to as a follow mode.
示例性的,可以根据如下方式控制飞行器的水平飞行速度:Illustratively, the horizontal flight speed of the aircraft can be controlled as follows:
Figure PCTCN2017102598-appb-000079
Figure PCTCN2017102598-appb-000079
Figure PCTCN2017102598-appb-000080
Figure PCTCN2017102598-appb-000080
Figure PCTCN2017102598-appb-000081
Figure PCTCN2017102598-appb-000081
Figure PCTCN2017102598-appb-000082
Figure PCTCN2017102598-appb-000082
其中,VX为智能终端指示所述飞行器在所述NED坐标系中的北轴上的飞行速度,VY为智能终端指示所述飞行器在所述NED坐标系中的东轴上的飞行速度,V为智能终端得到的所述飞行器地速,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,
Figure PCTCN2017102598-appb-000083
为所述相对角度,D为所述飞行器与智能终端在水平方向上的距离,XT和YT分别为智能终端在所述NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
Wherein, V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system, and V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system, V is intelligent terminal obtained the aircraft ground speed, the maximum speed of the aircraft to follow as the intelligent terminal V m obtained, k is a gain coefficient, d is the radius of the dead zone,
Figure PCTCN2017102598-appb-000083
For the relative angle, D is the distance between the aircraft and the intelligent terminal in the horizontal direction, and X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, X F and Y F The north and east axis positions of the aircraft in the northeast NED coordinate system.
示例性的,还可以根据如下方式控制飞行器的垂直飞行速度:Illustratively, the vertical flight speed of the aircraft can also be controlled as follows:
Figure PCTCN2017102598-appb-000084
Figure PCTCN2017102598-appb-000084
H=|ZT-ZF|; H=|Z T -Z F |;
其中,V为所述垂直飞行速度,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,H为所述飞行器与智能终端在垂直方向上的距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置。Where V is the vertical flight speed, V m is the maximum following speed of the aircraft obtained by the intelligent terminal, k is the gain coefficient, d is the dead zone radius, and H is the distance between the aircraft and the intelligent terminal in the vertical direction. Z T and Z F are the smart terminal and the lower axis position of the target position in the NED coordinate system, respectively.
另外,智能终端还可以将起飞、悬停、降落或返航的命令发送至所述机载飞控系统,相应控制所述飞行器起飞、悬停、降落或返航。In addition, the smart terminal can also send a command to take off, hover, land or return to the onboard flight control system, and correspondingly control the aircraft to take off, hover, land or return.
在一个实施例中,智能终端还可以将所述第二位置信息发送到所述机载飞控系统,所述机载飞控系统在所述飞行器与智能终端失联时,控制所述飞行器移动到最后一次接收到的第二位置信息对应的位置。In an embodiment, the smart terminal may further send the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft movement when the aircraft is disconnected from the intelligent terminal The position corresponding to the last received second position information.
在一个实施例中,还可以计算所述第二位置信息与初始第二位置信息的差值;其中,所述初始第二位置信息为智能终端上次获取到的智能终端的位置信息;若所述差值大于预设的距离阈值,根据所述第一位置信息和所述第二位置信息计算所述飞行器的目标位置。In an embodiment, the difference between the second location information and the initial second location information may be calculated; wherein the initial second location information is location information of the smart terminal acquired by the smart terminal last time; The difference value is greater than a preset distance threshold, and the target position of the aircraft is calculated according to the first position information and the second position information.
可以看出,本实施例提供的多旋翼飞行器的控制装置,在终端发生移动时,根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移,根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置,实现了飞行器的自动跟随。并且,在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。从而当被拍摄对象携带上述智能终端时,飞行器上安装的摄像装置可以自动跟随被拍摄者进行拍摄,避免了手动操控飞行器,不仅节约了拍摄成本,而且提高了拍摄效率。It can be seen that the control device of the multi-rotor aircraft provided by the embodiment calculates the target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle and the second position information when the terminal moves, according to The first position information and the target position calculate a displacement of the aircraft, generate control information according to the displacement, send the control information to the onboard flight control system, and control the aircraft to move to the target with the displacement The position is such that the lens of the camera on the aircraft is always facing or facing the position of the smart terminal during the movement, realizing automatic follow-up of the aircraft. Moreover, during the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
如图8所示,本发明还提供一种多旋翼飞行器的控制系统,所述控制系统可包括:机载飞控系统21和控制系统22;As shown in Figure 8, the present invention also provides a control system for a multi-rotor aircraft, the control system may include: an onboard flight control system 21 and a control system 22;
所述控制系统22连接到所述机载飞控系统21,所述机载飞控系统21连接到飞行器; The control system 22 is coupled to the onboard flight control system 21, and the onboard flight control system 21 is coupled to the aircraft;
所述机载飞控系统21用于获取飞行器23的第一位置信息,并将所述第一位置信息发送至所述控制系统22;The airborne flight control system 21 is configured to acquire first position information of the aircraft 23, and send the first position information to the control system 22;
所述控制系统22用于获取智能终端24当前的第二位置信息,根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器23的目标位置,根据所述第一位置信息和目标位置计算飞行器23的位移,根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统21;其中,所述水平相对距离和垂直相对距离分别是所述飞行器23与智能终端24在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器23在水平面上的投影与智能终端24在水平面上的投影所形成的相对位置矢量在水平面上的角度;The control system 22 is configured to acquire current second location information of the smart terminal 24, and calculate a target location of the aircraft 23 according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the first Calculating the displacement of the aircraft 23 with a position information and a target position, and generating control information according to the displacement, and transmitting the control information to the onboard flight control system 21; wherein the horizontal relative distance and the vertical relative distance are respectively The desired distance between the aircraft 23 and the intelligent terminal 24 in the horizontal direction and the vertical direction, the relative angle is a relative position vector formed by the projection of the aircraft 23 on the horizontal plane and the projection of the intelligent terminal 24 on the horizontal plane on a horizontal plane. Angle;
所述机载飞控系统21还用于控制所述飞行器23以所述位移移动到所述目标位置,以使所述飞行器23上的摄像装置的镜头25在移动过程中始终朝向或者正对着所述智能终端所在的位置。The onboard flight control system 21 is further configured to control the aircraft 23 to move to the target position with the displacement such that the lens 25 of the camera on the aircraft 23 is always facing or facing each other during the movement. The location where the smart terminal is located.
其中,控制系统22可以是体感操控设备如体感操控器,或者可为智能手机、便携式电脑等具有通信、数据处理和定位功能的便携式电子设备。机载飞控系统21和控制系统22的定位功能可通过安装全球定位系统(Global Positioning System,GPS)软件等具有定位功能的软件实现。可以预设时间间隔,并每隔所述时间间隔获取一次第一位置信息以及第二位置信息。所述时间间隔可以根据实际需要设定。例如,可以根据控制系统22的飞行速度来设定。当控制系统22的飞行速度较小时,可以将所述时间间隔设定为一个较小的值,当控制系统22的飞行速度较大时,可以将所述时间间隔设定为一个较大的值。也可以根据其他方式来获取。The control system 22 may be a somatosensory control device such as a somatosensory manipulator, or may be a portable electronic device having communication, data processing, and positioning functions, such as a smart phone or a portable computer. The positioning functions of the onboard flight control system 21 and the control system 22 can be implemented by installing software having positioning functions such as Global Positioning System (GPS) software. The time interval may be preset, and the first location information and the second location information are acquired once every said time interval. The time interval can be set according to actual needs. For example, it can be set according to the flight speed of the control system 22. When the flight speed of the control system 22 is small, the time interval can be set to a small value, and when the flight speed of the control system 22 is large, the time interval can be set to a larger value. . It can also be obtained in other ways.
在跟随时,可以设定飞行器跟随智能终端时与智能终端的水平和垂直相对距离。例如,可以设定飞行器在相距智能终端的水平距离与垂直距离分别是1米和0.5米处跟随智能终端。上述1米和0.5米即为后续跟随过程中的期望距离,跟随的目标是使飞行器与智能终端之间的水平和垂直相对距离始终保持1米和0.5米不变。期望距离的示意图如图3所示。每次开机时,可以根据飞行器的经纬度和智能终端的经纬度计算所述水平相对距离、垂直相对距离和相对角度。在后续跟随过程中,可直接根据开机时计算得到的所述水平相对距离、垂直相 对距离和相对角度执行跟随过程。When following, the horizontal and vertical relative distances from the smart terminal when the aircraft follows the smart terminal can be set. For example, the aircraft can be set to follow the smart terminal at a horizontal distance and a vertical distance of 1 meter and 0.5 meters apart from each other. The above 1 meter and 0.5 meters are the desired distances in the subsequent follow-up process, and the goal is to keep the horizontal and vertical relative distance between the aircraft and the intelligent terminal constant at 1 meter and 0.5 meters. A schematic diagram of the desired distance is shown in FIG. Each time the power is turned on, the horizontal relative distance, the vertical relative distance, and the relative angle may be calculated according to the latitude and longitude of the aircraft and the latitude and longitude of the smart terminal. In the subsequent follow-up process, the horizontal relative distance and vertical phase calculated directly at the time of power-on can be directly The following process is performed on the distance and the relative angle.
相对角度的示意图如图2所示。在图2中,若x轴表示NED坐标系中的东轴,y轴表示NED坐标系中的北轴,z轴表示NED坐标系中的下轴,O为原点,
Figure PCTCN2017102598-appb-000085
为飞行器与智能终端在NED坐标系中的位置矢量,
Figure PCTCN2017102598-appb-000086
Figure PCTCN2017102598-appb-000087
在NED坐标系中的xOy平面上的投影,则
Figure PCTCN2017102598-appb-000088
在xOy平面中所指的方向即为所述相对角度。在一个实施例中,如图2所示,该相对角度可以是东偏南80°。当然,该相对角度也可以是其他角度。具体数值可以根据实际需要设定。在跟随过程中,该相对角度保持不变。
A schematic diagram of the relative angle is shown in Figure 2. In FIG. 2, if the x-axis represents the east axis in the NED coordinate system, the y-axis represents the north axis in the NED coordinate system, the z-axis represents the lower axis in the NED coordinate system, and O is the origin.
Figure PCTCN2017102598-appb-000085
For the position vector of the aircraft and the intelligent terminal in the NED coordinate system,
Figure PCTCN2017102598-appb-000086
for
Figure PCTCN2017102598-appb-000087
Projection on the xOy plane in the NED coordinate system, then
Figure PCTCN2017102598-appb-000088
The direction indicated in the xOy plane is the relative angle. In one embodiment, as shown in FIG. 2, the relative angle may be 80° east and south. Of course, the relative angle can also be other angles. The specific value can be set according to actual needs. This relative angle remains unchanged during the following process.
示例性的,所述目标位置应满足:Exemplarily, the target location should satisfy:
Figure PCTCN2017102598-appb-000089
Figure PCTCN2017102598-appb-000089
Figure PCTCN2017102598-appb-000090
Figure PCTCN2017102598-appb-000090
ZF=ZT-H;Z F =Z T -H;
其中,(XF,YF,ZF)为目标位置的坐标,XT和YT分别为控制系统22在NED坐标系中的北轴和东轴位置,D为所述飞行器23与控制系统22在水平方向上的相对距离,H为所述飞行器23与控制系统22在垂直方向上的相对距离,
Figure PCTCN2017102598-appb-000091
为所述相对角度,ZT和ZF分别为控制系统22和所述目标位置在NED坐标系下的下轴位置,XF和YF为所述飞行器23在北东下NED坐标系中的北轴和东轴位置。
Where (X F , Y F , Z F ) is the coordinate of the target position, X T and Y T are the north and east axis positions of the control system 22 in the NED coordinate system, respectively, and D is the aircraft 23 and the control system 22 is the relative distance in the horizontal direction, and H is the relative distance between the aircraft 23 and the control system 22 in the vertical direction.
Figure PCTCN2017102598-appb-000091
For the relative angles, Z T and Z F are the lower axis positions of the control system 22 and the target position in the NED coordinate system, respectively, and X F and Y F are the northerly lower NED coordinate system of the aircraft 23 North and East axis positions.
其中,所述相对角度可以根据所述机载飞控系统21获取的飞行器的初始位置信息(XF0,YF0,ZF0)以及智能终端的初始位置信息(XT0,YT0,ZT0)计算得到,所述飞行器23的初始位置信息以及控制系统22的初始位置信息可以是系统开始运行之后第一次获取到的位置信息。在计算出相对角度之后,可以将该相对角度存储在系统中,并在后续控制过程中控制飞行器保持该相对角度移动。根据初始位置信息计算相对角度的方式为:Wherein, the relative angle may be based on initial position information (X F0 , Y F0 , Z F0 ) of the aircraft acquired by the onboard flight control system 21 and initial position information of the intelligent terminal (X T0 , Y T0 , Z T0 ) It is calculated that the initial position information of the aircraft 23 and the initial position information of the control system 22 may be the position information acquired for the first time after the system starts running. After the relative angle is calculated, the relative angle can be stored in the system and the aircraft is controlled to maintain the relative angular movement during subsequent control. The way to calculate the relative angle based on the initial position information is:
Figure PCTCN2017102598-appb-000092
Figure PCTCN2017102598-appb-000092
在所述飞行器移动过程中,还可以调整所述飞行器23上安装的摄像装置25的俯仰角,使控制系统22保持在所述摄像装置的拍摄画面中。所述俯仰角是使 所述飞行器23上的摄像装置25的镜头始终朝向或者正对着控制系统22的俯仰角。飞行器23在向目标位置飞行过程中,可以不断调整所述俯仰角,使控制系统22始终保持在摄像装置25的拍摄画面中。在飞行器到达目标位置之后,可以将俯仰角调回到与初始状态相同的俯仰角。目标位置的俯仰角可以根据如下公式计算:During the movement of the aircraft, the pitch angle of the camera unit 25 mounted on the aircraft 23 can also be adjusted to maintain the control system 22 in the photographing screen of the camera unit. The pitch angle is such that The lens of the camera 25 on the aircraft 23 is always facing or facing the pitch angle of the control system 22. The aircraft 23 can continuously adjust the pitch angle during flight to the target position, so that the control system 22 is always held in the photographing screen of the imaging device 25. After the aircraft reaches the target position, the pitch angle can be adjusted back to the same pitch angle as the initial state. The pitch angle of the target position can be calculated according to the following formula:
Figure PCTCN2017102598-appb-000093
Figure PCTCN2017102598-appb-000093
其中,H=|ZT-ZF|;
Figure PCTCN2017102598-appb-000094
Where H=|Z T -Z F |;
Figure PCTCN2017102598-appb-000094
式中,θ为所述俯仰角,H为所述飞行器23与控制系统22在垂直方向上的相对距离,ZT和ZF分别为控制系统22和所述目标位置在NED坐标系下的下轴位置,D为所述飞行器23与控制系统22在水平方向上的相对距离,XT和YT分别为控制系统22在NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器23在北东下NED坐标系中的北轴和东轴位置。Where θ is the pitch angle, H is the relative distance between the aircraft 23 and the control system 22 in the vertical direction, and Z T and Z F are respectively under the control system 22 and the target position in the NED coordinate system. The axial position, D is the relative distance between the aircraft 23 and the control system 22 in the horizontal direction, X T and Y T are the north and east axis positions of the control system 22 in the NED coordinate system, respectively, X F and Y F are The aircraft 23 is in the north and south axis positions in the northeast NED coordinate system.
控制系统22获取到飞行器23的位置信息后,还可以根据飞行器23的位置信息及自身的位置信息,计算出飞行器应有的飞行速度,以保证飞行器23始终能跟着控制系统22飞行。After acquiring the position information of the aircraft 23, the control system 22 can also calculate the flight speed that the aircraft should have according to the position information of the aircraft 23 and its own position information to ensure that the aircraft 23 can always follow the control system 22.
如当携带有控制系统22的被拍摄对象在水平方向上移动时,控制系统22可以根据飞行器23的位置信息及自身的位置信息计算出飞行器应该具有的水平飞行速度,并将该水平飞行速度发送给机载飞控系统21。机载飞控系统21接收到该水平飞行速度后,可以控制飞行器23以该水平飞行速度飞行,使飞行器23跟着的被拍摄对象飞行。For example, when the subject carrying the control system 22 moves in the horizontal direction, the control system 22 can calculate the horizontal flight speed that the aircraft should have according to the position information of the aircraft 23 and its own position information, and send the horizontal flight speed. The airborne flight control system 21 is provided. After receiving the horizontal flight speed, the onboard flight control system 21 can control the aircraft 23 to fly at the horizontal flight speed to cause the aircraft 23 to follow the subject.
又如,当携带有控制系统22的被拍摄对象在垂直方向上移动如跳伞或吊威亚时,控制系统22可以根据飞行器23的位置信息及自身的位置信息计算出飞行器23应该具有的垂直飞行速度,并将该垂直飞行速度发送给机载飞控系统21。机载飞控系统21接收到该垂直飞行速度后,可以控制飞行器23以该垂直飞行速度飞行,使飞行器23跟着的被拍摄对象飞行。For another example, when the subject carrying the control system 22 moves in a vertical direction such as a skydiving or a suspension, the control system 22 can calculate the vertical flight that the aircraft 23 should have based on the position information of the aircraft 23 and its own position information. Speed and send the vertical flight speed to the onboard flight control system 21. After receiving the vertical flight speed, the onboard flight control system 21 can control the aircraft 23 to fly at the vertical flight speed to cause the aircraft 23 to follow the subject.
再如,当携带有控制系统22的被拍摄对象在水平方向和垂直方向上均有移动,如倾斜向上或倾斜向下移动时,控制系统22可以根据飞行器23的位置信 息及自身的位置信息计算出飞行器23应该具有的水平飞行速度和垂直飞行速度,并将该水平飞行速度和垂直飞行速度发送给机载飞控系统21。机载飞控系统21接收到该水平飞行速度和垂直飞行速度后,可以控制飞行器23以该水平飞行速度和垂直飞行速度飞行,使飞行器23跟着的被拍摄对象飞行。For another example, when the subject carrying the control system 22 moves in both the horizontal direction and the vertical direction, such as tilting up or tilting downward, the control system 22 can be based on the position information of the aircraft 23. The position information of the information and its own calculates the horizontal flight speed and the vertical flight speed that the aircraft 23 should have, and transmits the horizontal flight speed and the vertical flight speed to the onboard flight control system 21. After receiving the horizontal flight speed and the vertical flight speed, the airborne flight control system 21 can control the aircraft 23 to fly at the horizontal flight speed and the vertical flight speed to cause the aircraft 23 to follow the subject.
上述飞行器跟随被拍摄对象或者智能终端的情形,可以称之为跟随模式。The case where the above-described aircraft follows the subject or the intelligent terminal may be referred to as a follow mode.
示例性的,可以根据如下方式控制飞行器23的水平飞行速度:Illustratively, the horizontal flight speed of the aircraft 23 can be controlled as follows:
Figure PCTCN2017102598-appb-000095
Figure PCTCN2017102598-appb-000095
Figure PCTCN2017102598-appb-000096
Figure PCTCN2017102598-appb-000096
Figure PCTCN2017102598-appb-000097
Figure PCTCN2017102598-appb-000097
Figure PCTCN2017102598-appb-000098
Figure PCTCN2017102598-appb-000098
其中,VX为所述控制系统22指示所述飞行器23在所述NED坐标系中的北轴上的飞行速度,VY为所述控制系统22指示所述飞行器23在所述NED坐标系中的东轴上的飞行速度,V为所述控制系统22得到的所述飞行器23的地速,Vm为所述控制系统22得到的所述飞行器23的最大跟随速度,k为增益系数,d为死区半径,
Figure PCTCN2017102598-appb-000099
为所述相对角度,D为所述飞行器23与所述控制系统22在水平方向上的距离,XT和YT分别为控制系统22在所述NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器23在北东下NED坐标系中的北轴和东轴位置。
Wherein V X is the flight speed of the control system 22 indicating the aircraft 23 on the north axis in the NED coordinate system, and V Y is the control system 22 indicating that the aircraft 23 is in the NED coordinate system. east axis flight speed, V is the aircraft control system 22 to obtain the ground speed of 23, V m is the control system 22 of the aircraft obtained following the maximum velocity is 23, k is a gain coefficient, d For the dead zone radius,
Figure PCTCN2017102598-appb-000099
For the relative angle, D is the distance between the aircraft 23 and the control system 22 in the horizontal direction, and X T and Y T are the north and east axes of the control system 22 in the NED coordinate system, respectively. X F and Y F are the north and east axis positions of the aircraft 23 in the northeast down NED coordinate system.
示例性的,还可以根据如下方式控制飞行器23的垂直飞行速度:Illustratively, the vertical flight speed of the aircraft 23 can also be controlled as follows:
Figure PCTCN2017102598-appb-000100
Figure PCTCN2017102598-appb-000100
H=|ZT-ZF|;H=|Z T -Z F |;
其中,V为所述垂直飞行速度,Vm为所述控制系统22得到的所述飞行器23 的最大跟随速度,k为增益系数,d为死区半径,H为所述飞行器23与所述智能终端在垂直方向上的距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置。Wherein, V is the vertical flight velocity, V m is the maximum of the following speed control system 22 of the aircraft 23 is obtained, k is a gain coefficient, d is the radius of the dead zone, H of the aircraft 23 with the smart The distances of the terminals in the vertical direction, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively.
另外,控制系统22还可以将起飞、悬停、降落或返航的命令发送至所述机载飞控系统21,相应控制所述飞行器21起飞、悬停、降落或返航。In addition, the control system 22 can also send a command to take off, hover, land, or return to the onboard flight control system 21 to control the aircraft 21 to take off, hover, land, or return.
在一个实施例中,控制系统22还可以将所述第二位置信息发送到所述机载飞控系统21,所述机载飞控系统21在所述飞行器与控制系统22失联时,可以控制所述飞行器23移动到最后一次接收到的第二位置信息对应的位置。In one embodiment, the control system 22 can also transmit the second location information to the onboard flight control system 21, which can be lost when the aircraft is disconnected from the control system 22 The aircraft 23 is controlled to move to a position corresponding to the last received second position information.
在一个实施例中,控制系统22还可以计算所述第二位置信息与初始第二位置信息的差值;其中,所述初始第二位置信息为智能终端上次获取到的智能终端的位置信息;若所述差值大于预设的距离阈值,控制系统22可根据所述第一位置信息和所述第二位置信息计算所述飞行器的目标位置。In an embodiment, the control system 22 may further calculate a difference between the second location information and the initial second location information, where the initial second location information is location information of the smart terminal acquired by the smart terminal last time. If the difference is greater than a preset distance threshold, the control system 22 may calculate a target position of the aircraft based on the first position information and the second position information.
可以看出,本实施例提供的多旋翼飞行器的控制系统,在终端发生移动时,根据飞行器的第一位置信息以及终端当前的第二位置信息计算飞行器跟随拍摄需要调整的目标位置,生成并发送相应的控制系统至机载飞控系统,相应控制所述飞行器以预存的相对角度移动到所述目标位置,实现了飞行器的自动跟随。并且,在所述飞行器移动过程中,还可以调整所述飞行器上安装的摄像装置的俯仰角,使智能终端保持在所述摄像装置的拍摄画面中。从而当被拍摄对象携带上述智能终端时,飞行器上安装的摄像装置可以自动跟随被拍摄者进行拍摄,避免了手动操控飞行器,不仅节约了拍摄成本,而且提高了拍摄效率。It can be seen that the control system of the multi-rotor aircraft provided by the embodiment generates, according to the first position information of the aircraft and the current second position information of the terminal, the target position adjusted by the aircraft following the shooting, and generates and sends the terminal. The corresponding control system to the airborne flight control system correspondingly controls the aircraft to move to the target position at a pre-stored relative angle, thereby realizing automatic follow-up of the aircraft. Moreover, during the movement of the aircraft, the pitch angle of the camera mounted on the aircraft may also be adjusted to keep the smart terminal in the photographing screen of the camera. Therefore, when the object to be photographed carries the smart terminal, the camera mounted on the aircraft can automatically follow the subject to shoot, avoiding manual manipulation of the aircraft, not only saving the shooting cost, but also improving the shooting efficiency.
示例性的,上述多旋翼飞行器的控制装置还可包括通信中继设备26,用于增加所述机载飞控系统21和控制系统22之间的通信距离。例如,多旋翼飞行器23的控制系统可通过蓝牙通讯盒进行信号中继。无人机与蓝牙通讯盒可通过无线数传模块进行无线通讯,蓝牙通讯盒与控制系统22可通过蓝牙进行无线通讯,从而使无人机与智能手机在1km范围内保证可靠的通讯质量和速率。本发明不局限于使用该通信中继方式进行中继,这里只是解释说明,而非限制。Illustratively, the control device of the multi-rotor aircraft described above may further include a communication relay device 26 for increasing the communication distance between the onboard flight control system 21 and the control system 22. For example, the control system of the multi-rotor aircraft 23 can relay signals via a Bluetooth communication box. The drone and the Bluetooth communication box can communicate wirelessly through the wireless data transmission module, and the Bluetooth communication box and the control system 22 can wirelessly communicate via Bluetooth, so that the drone and the smart phone can ensure reliable communication quality and speed within 1 km. . The present invention is not limited to relaying using the communication relay method, and is merely illustrative, not limiting.
在一个实施例中,所述机载飞控系统21可包括:第一GPS模块211、微处理器212、无线数传模块213、航姿参考系统(Altitude Heading Reference System, 简称AHRS)214和气压计215。In one embodiment, the onboard flight control system 21 may include: a first GPS module 211, a microprocessor 212, a wireless data transmission module 213, and an Altitude Heading Reference System (Altitude Heading Reference System, Referred to as AHRS) 214 and barometer 215.
微处理器211可为单片机运行相关算法,通过GPS模块211、航姿参考系统214和气压计215获取自身的姿态和位置,以实现对机载飞控系统21所在的飞行器的飞行控制,如实现多旋翼无人机的姿态及位置控制,完成自主悬停或巡航飞行。The microprocessor 211 can run a related algorithm for the single chip microcomputer, and acquires its posture and position through the GPS module 211, the azimuth reference system 214, and the barometer 215, so as to realize flight control of the aircraft where the airborne flight control system 21 is located, such as The attitude and position control of the multi-rotor drone completes the autonomous hover or cruise flight.
微处理器211还可通过无线数传模块213与控制系统22进行双向数据通信,得到控制系统22发送的控制指令。机载飞控系统21可以接收的控制指令包括但不限于:水平和竖直方向上的目标位置、水平和竖直方向上的目标速度、飞机的目标相对角度等姿态指令。机载飞控系统21还可以根据接收的控制指令控制无人机的姿态及位置等。The microprocessor 211 can also perform bidirectional data communication with the control system 22 via the wireless data transmission module 213 to obtain control commands transmitted by the control system 22. The control commands that the onboard flight control system 21 can receive include, but are not limited to, target positions in the horizontal and vertical directions, target speeds in the horizontal and vertical directions, target relative angles of the aircraft, and the like. The onboard flight control system 21 can also control the attitude and position of the drone according to the received control commands.
机载飞控系统21还可根据接收的控制指令,通过输出PWM(Pulse Width Modulation,脉冲宽度调制)信号控制摄像装置25的俯仰和/或横滚角转动,即控制摄像装置25的俯仰角和横滚角中的至少一个,从而控制摄像装置25的拍摄视野。The onboard flight control system 21 can also control the pitch and/or roll angle rotation of the camera device 25 by outputting a PWM (Pulse Width Modulation) signal according to the received control command, that is, controlling the pitch angle of the camera device 25 and At least one of the roll angles controls the shooting field of the image pickup device 25.
通信中继设备26可包括:无线数传模块261和蓝牙模块262。通信中继设备26可通过无线数传模块261与机载飞控系统21通信,通过蓝牙模块262与控制系统22通信,作为一个中继转发两者之间互相传输的数据。以在无人机和控制系统22之间建立稳定且长距离的通信链路。The communication relay device 26 may include a wireless data transmission module 261 and a Bluetooth module 262. The communication relay device 26 can communicate with the onboard flight control system 21 via the wireless data transmission module 261, communicate with the control system 22 via the Bluetooth module 262, and forward the data transmitted between the two as a relay. A stable and long distance communication link is established between the drone and the control system 22.
所述控制系统22可包括:GPS模块221、控制模块222和蓝牙模块223。The control system 22 can include a GPS module 221, a control module 222, and a Bluetooth module 223.
其中,控制模块222可以是安装在控制系统22上的APP(应用程序)。该APP运行时可以通过GPS模块获取控制系统22的GPS定位信息,并通过蓝牙模块223与无人机进行数据通信,根据机载飞控系统21发送的无人机的位置信息及控制系统22的位置信息,通过运行跟随飞行算法得到相对角度及飞行速度,并发送给机载飞控系统21控制无人机的飞行和拍摄。The control module 222 can be an APP (application) installed on the control system 22. The APP can obtain the GPS positioning information of the control system 22 through the GPS module, and perform data communication with the UAV through the Bluetooth module 223, according to the position information of the UAV transmitted by the onboard flight control system 21 and the control system 22 The position information is obtained by running the following flight algorithm to obtain the relative angle and the flight speed, and is sent to the onboard flight control system 21 to control the flight and shooting of the drone.
本发明通过多旋翼无人机飞控系统和运行相应App的智能终端的配合,实现了无人机全自主地跟随携带智能终端的用户飞行,并将摄像头对准用户所在区域。当用户携带该智能终端时,即可自动实现对自己的实时跟随航拍;当将该智能终端放置在车、船等上时,即可自动实现无人机的跟随巡航和拍摄。该 发明可广泛应用于可用于娱乐、航拍、极限运动、监控、侦查等领域。The invention realizes that the drone fully follows the flight of the user carrying the intelligent terminal by the cooperation of the multi-rotor UAV flight control system and the intelligent terminal running the corresponding App, and aligns the camera with the user's area. When the user carries the smart terminal, the real-time following aerial photography can be automatically realized; when the smart terminal is placed on a car, a ship, etc., the following cruise and shooting of the drone can be automatically realized. The The invention can be widely applied to fields such as entertainment, aerial photography, extreme sports, monitoring, and detection.
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.
以上所述实施例仅表达了本发明的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。 The above-described embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims (16)

  1. 一种多旋翼飞行器的控制方法,其特征在于,包括以下步骤:A method for controlling a multi-rotor aircraft, comprising the steps of:
    根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的水平相对距离、垂直相对距离和相对角度;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;Calculating a horizontal relative distance, a vertical relative distance, and a relative angle of the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively horizontal directions of the aircraft and the intelligent terminal And a desired distance in a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
    在智能终端移动过程中,执行以下步骤:During the smart terminal move, perform the following steps:
    实时获取所述飞行器的第一位置信息,并获取智能终端的第二位置信息,根据所述水平相对距离、垂直相对距离、相对角度和第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;Acquiring first location information of the aircraft in real time, and acquiring second location information of the smart terminal, and calculating a target location of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information, according to the first Position information and target position to calculate the displacement of the aircraft;
    根据所述位移生成控制信息,并将所述控制信息发送至飞行器的机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。Generating control information based on the displacement, and transmitting the control information to an onboard flight control system of the aircraft, controlling the aircraft to move to the target position with the displacement to cause a lens of the camera on the aircraft Always facing or facing the location of the smart terminal during the movement.
  2. 根据权利要求1所述的多旋翼飞行器的控制方法,其特征在于,根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的相对角度步骤包括:The control method of a multi-rotor aircraft according to claim 1, wherein the calculating the relative angle between the aircraft and the intelligent terminal according to the initial position of the aircraft and the initial position of the intelligent terminal comprises:
    根据如下公式计算飞行器与智能终端的相对角度:Calculate the relative angle between the aircraft and the intelligent terminal according to the following formula:
    Figure PCTCN2017102598-appb-100001
    Figure PCTCN2017102598-appb-100001
    其中,
    Figure PCTCN2017102598-appb-100002
    为所述相对角度,XF0和YF0分别为飞行器的初始位置在NED坐标系中的北轴和东轴的坐标值,XT0和YT0分别为智能终端的初始位置在NED坐标系中的北轴和东轴的坐标值。
    among them,
    Figure PCTCN2017102598-appb-100002
    For the relative angles, X F0 and Y F0 are the coordinate values of the north and east axes of the initial position of the aircraft in the NED coordinate system, respectively, and X T0 and Y T0 are the initial positions of the smart terminals in the NED coordinate system, respectively. Coordinate values for the north and east axes.
  3. 一种多旋翼飞行器的控制方法,其特征在于,包括以下步骤:A method for controlling a multi-rotor aircraft, comprising the steps of:
    接收机载飞控系统获取的飞行器的第一位置信息,并获取智能终端的第二位置信息;Receiving, by the receiver, the first position information of the aircraft acquired by the flight control system, and acquiring the second position information of the intelligent terminal;
    根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平 方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;Calculating a target position of the aircraft according to a preset horizontal relative distance, a vertical relative distance, a relative angle, and the second position information, and calculating a displacement of the aircraft according to the first position information and the target position; wherein the horizontal relative distance and The vertical relative distance is the level of the aircraft and the intelligent terminal, respectively. a desired distance in a direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
    根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。Generating control information according to the displacement, transmitting the control information to the onboard flight control system, controlling the aircraft to move to the target position with the displacement, so that the lens of the camera on the aircraft is The mobile device always faces or faces the location of the smart terminal.
  4. 根据权利要求3所述的多旋翼飞行器的控制方法,其特征在于,还包括以下步骤:The method of controlling a multi-rotor aircraft according to claim 3, further comprising the steps of:
    根据如下公式算所述飞行器的目标位置:Calculate the target position of the aircraft according to the following formula:
    Figure PCTCN2017102598-appb-100003
    Figure PCTCN2017102598-appb-100003
    Figure PCTCN2017102598-appb-100004
    Figure PCTCN2017102598-appb-100004
    |ZT-ZF|=H;|Z T -Z F |=H;
    其中,(XF,YF,ZF)为目标位置的坐标,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,D为所述水平相对距离,H为所述垂直相对距离,
    Figure PCTCN2017102598-appb-100005
    为所述相对角度,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
    Where (X F , Y F , Z F ) is the coordinate of the target position, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and D is the horizontal relative distance, H is The vertical relative distance,
    Figure PCTCN2017102598-appb-100005
    For the relative angles, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively, and X F and Y F are the north axes of the aircraft in the northeast lower NED coordinate system. And the east axis position.
  5. 根据权利要求1所述的多旋翼飞行器的控制方法,其特征在于,在控制所述飞行器以所述位移移动到所述目标位置时,还包括以下步骤:The control method of a multi-rotor aircraft according to claim 1, wherein when the aircraft is controlled to move to the target position with the displacement, the method further comprises the following steps:
    在所述飞行器移动过程中,调整所述飞行器上安装的摄像装置的俯仰角,使本终端保持在所述摄像装置的拍摄画面中。During the movement of the aircraft, the pitch angle of the camera mounted on the aircraft is adjusted to maintain the terminal in the photographing screen of the camera.
  6. 根据权利要求5所述的多旋翼飞行器的控制方法,其特征在于,在飞行器到达目标位置之后,还包括以下步骤:The control method of a multi-rotor aircraft according to claim 5, further comprising the following steps after the aircraft reaches the target position:
    根据如下公式调整所述摄像装置的俯仰角:Adjust the pitch angle of the camera according to the following formula:
    Figure PCTCN2017102598-appb-100006
    Figure PCTCN2017102598-appb-100006
    其中,H=|ZT-ZF|;
    Figure PCTCN2017102598-appb-100007
    Where H=|Z T -Z F |;
    Figure PCTCN2017102598-appb-100007
    式中,θ为所述俯仰角,H为所述垂直相对距离,ZT和ZF分别为智能终端 和所述目标位置在NED坐标系下的下轴位置,D为所述水平相对距离,XT和YT分别为智能终端在NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。Where θ is the pitch angle, H is the vertical relative distance, Z T and Z F are the lower axis positions of the smart terminal and the target position in the NED coordinate system, respectively, and D is the horizontal relative distance, X T and Y T are the north and east axis positions of the intelligent terminal in the NED coordinate system, respectively, and X F and Y F are the north and east axis positions of the aircraft in the northeast lower NED coordinate system.
  7. 根据权利要求1所述的多旋翼飞行器的控制方法,其特征在于,还包括以下步骤:The method of controlling a multi-rotor aircraft according to claim 1, further comprising the steps of:
    将起飞、悬停、降落或返航的命令发送至所述机载飞控系统,相应控制所述飞行器起飞、悬停、降落或返航。Sending, hovering, landing or returning commands to the onboard flight control system, correspondingly controlling the aircraft to take off, hover, land or return.
  8. 根据权利要求1所述的多旋翼飞行器的控制方法,其特征在于,还包括以下步骤:The method of controlling a multi-rotor aircraft according to claim 1, further comprising the steps of:
    将所述第二位置信息发送到所述机载飞控系统,所述机载飞控系统在所述飞行器与智能终端失联时,控制所述飞行器移动到最后一次接收到的第二位置信息对应的位置。Transmitting the second location information to the onboard flight control system, the airborne flight control system controlling the aircraft to move to the last received second location information when the aircraft is disconnected from the intelligent terminal Corresponding location.
  9. 根据权利要求1所述的多旋翼飞行器的控制方法,其特征在于,还包括以下步骤:The method of controlling a multi-rotor aircraft according to claim 1, further comprising the steps of:
    根据如下公式控制所述飞行器的水平飞行速度:The horizontal flight speed of the aircraft is controlled according to the following formula:
    Figure PCTCN2017102598-appb-100008
    Figure PCTCN2017102598-appb-100008
    Figure PCTCN2017102598-appb-100009
    Figure PCTCN2017102598-appb-100009
    Figure PCTCN2017102598-appb-100010
    Figure PCTCN2017102598-appb-100010
    Figure PCTCN2017102598-appb-100011
    Figure PCTCN2017102598-appb-100011
    其中,VX为智能终端指示所述飞行器在所述NED坐标系中的北轴上的飞行速度,VY为智能终端指示所述飞行器在所述NED坐标系中的东轴上的飞行速度,V为智能终端得到的所述飞行器地速,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,
    Figure PCTCN2017102598-appb-100012
    为所述相对角度,D为所述水 平相对距离,XT和YT分别为智能终端在所述NED坐标系中的北轴和东轴位置,XF和YF为所述飞行器在北东下NED坐标系中的北轴和东轴位置。
    Wherein, V X is a smart terminal indicating a flight speed of the aircraft on a north axis in the NED coordinate system, and V Y is a smart terminal indicating a flight speed of the aircraft on an east axis in the NED coordinate system, V is intelligent terminal obtained the aircraft ground speed, the maximum speed of the aircraft to follow as the intelligent terminal V m obtained, k is a gain coefficient, d is the radius of the dead zone,
    Figure PCTCN2017102598-appb-100012
    For the relative angle, D is the horizontal relative distance, X T and Y T are the north and east axis positions of the smart terminal in the NED coordinate system, respectively, and X F and Y F are the aircraft in the northeast. The north and east axis positions in the lower NED coordinate system.
  10. 根据权利要求1所述的多旋翼飞行器的控制方法,其特征在于,还包括以下步骤:The method of controlling a multi-rotor aircraft according to claim 1, further comprising the steps of:
    根据如下公式控制所述飞行器的垂直飞行速度:The vertical flight speed of the aircraft is controlled according to the following formula:
    Figure PCTCN2017102598-appb-100013
    Figure PCTCN2017102598-appb-100013
    H=|ZT-ZF|;H=|Z T -Z F |;
    其中,V为所述垂直飞行速度,Vm为智能终端得到的所述飞行器的最大跟随速度,k为增益系数,d为死区半径,H为所述垂直相对距离,ZT和ZF分别为智能终端和所述目标位置在NED坐标系下的下轴位置。Where V is the vertical flight speed, V m is the maximum following speed of the aircraft obtained by the intelligent terminal, k is the gain coefficient, d is the dead zone radius, H is the vertical relative distance, Z T and Z F respectively The lower axis position of the smart terminal and the target position in the NED coordinate system.
  11. 根据权利要求5所述的多旋翼飞行器的控制方法,其特征在于,所述俯仰角是使所述飞行器上的摄像装置的镜头始终朝向或者正对着智能终端的俯仰角。The control method of a multi-rotor aircraft according to claim 5, wherein the pitch angle is a pitch angle at which the lens of the image pickup device on the aircraft is always oriented or facing the smart terminal.
  12. 根据权利要求3所述的多旋翼飞行器的控制方法,其特征在于,还包括以下步骤:The method of controlling a multi-rotor aircraft according to claim 3, further comprising the steps of:
    计算所述第二位置信息与初始第二位置信息的差值;其中,所述初始第二位置信息为智能终端上次获取到的智能终端的位置信息;Calculating a difference between the second location information and the initial second location information; where the initial second location information is location information of the smart terminal that is acquired by the smart terminal last time;
    若所述差值大于预设的距离阈值,根据所述第一位置信息和所述第二位置信息计算所述飞行器的目标位置。And if the difference is greater than a preset distance threshold, calculating a target position of the aircraft according to the first position information and the second position information.
  13. 一种多旋翼飞行器的控制装置,其特征在于,包括:A control device for a multi-rotor aircraft, comprising:
    第一计算装置,用于根据飞行器的初始位置和智能终端的初始位置计算飞行器与智能终端的水平相对距离、垂直相对距离和相对角度;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度; a first calculating device, configured to calculate a horizontal relative distance, a vertical relative distance, and a relative angle between the aircraft and the smart terminal according to an initial position of the aircraft and an initial position of the smart terminal; wherein the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, the relative angle being an angle of a relative position vector formed by the projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane on a horizontal plane;
    在智能终端移动过程中,执行以下装置的功能:During the movement of the smart terminal, perform the functions of the following devices:
    第二计算装置,用于实时获取所述飞行器的第一位置信息,并获取智能终端的第二位置信息,根据所述水平相对距离、垂直相对距离、相对角度和第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;a second computing device, configured to acquire first location information of the aircraft in real time, and acquire second location information of the smart terminal, and calculate an object of the aircraft according to the horizontal relative distance, the vertical relative distance, the relative angle, and the second location information Positioning, calculating a displacement of the aircraft according to the first position information and the target position;
    第一控制装置,用于根据所述位移生成控制信息,并将所述控制信息发送至飞行器的机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。a first control device, configured to generate control information according to the displacement, and send the control information to an onboard flight control system of the aircraft, and control the aircraft to move to the target position with the displacement, so that the The lens of the camera on the aircraft always faces or faces the position of the smart terminal during the movement.
  14. 一种多旋翼飞行器的控制装置,其特征在于,包括:A control device for a multi-rotor aircraft, comprising:
    位置获取装置,用于接收机载飞控系统获取的飞行器的第一位置信息,并获取智能终端的第二位置信息;a location acquiring device, configured to receive first location information of the aircraft acquired by the flight control system, and acquire second location information of the smart terminal;
    第三计算装置,用于根据预设的水平相对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;a third calculating device, configured to calculate a target position of the aircraft according to the preset horizontal relative distance, the vertical relative distance, the relative angle, and the second position information, and calculate the displacement of the aircraft according to the first position information and the target position; The horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the smart terminal in a horizontal direction and a vertical direction, and the relative angle is a projection of the aircraft on a horizontal plane and a projection of the intelligent terminal on a horizontal plane. The angle of the formed relative position vector on the horizontal plane;
    第二控制装置,用于根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统,控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。a second control device, configured to generate control information according to the displacement, send the control information to the onboard flight control system, and control the aircraft to move to the target position with the displacement, so that the aircraft The lens of the upper camera is always facing or facing the position of the smart terminal during the movement.
  15. 一种多旋翼飞行器的控制系统,其特征在于,包括:机载飞控系统和控制系统;A control system for a multi-rotor aircraft, comprising: an onboard flight control system and a control system;
    所述控制系统通过所述机载飞控系统连接到飞行器;The control system is coupled to the aircraft by the onboard flight control system;
    所述机载飞控系统用于获取飞行器的第一位置信息,并将所述第一位置信息发送至所述控制系统;The airborne flight control system is configured to acquire first position information of the aircraft, and send the first position information to the control system;
    所述控制系统用于获取智能终端当前的第二位置信息,根据预设的水平相 对距离、垂直相对距离、相对角度和所述第二位置信息计算飞行器的目标位置,根据所述第一位置信息和目标位置计算飞行器的位移,根据所述位移生成控制信息,将所述控制信息发送到所述机载飞控系统;其中,所述水平相对距离和垂直相对距离分别是所述飞行器与智能终端在水平方向和垂直方向上的期望距离,所述相对角度是所述飞行器在水平面上的投影与智能终端在水平面上的投影所形成的相对位置矢量在水平面上的角度;The control system is configured to acquire current second location information of the smart terminal according to a preset horizontal phase Calculating a target position of the aircraft for the distance, the vertical relative distance, the relative angle, and the second position information, calculating a displacement of the aircraft according to the first position information and the target position, generating control information according to the displacement, and using the control information Transmitting to the onboard flight control system; wherein the horizontal relative distance and the vertical relative distance are respectively a desired distance between the aircraft and the intelligent terminal in a horizontal direction and a vertical direction, wherein the relative angle is that the aircraft is at a horizontal plane The angle between the projection on the upper surface and the projection of the intelligent terminal on the horizontal plane on the horizontal plane;
    所述机载飞控系统还用于控制所述飞行器以所述位移移动到所述目标位置,以使所述飞行器上的摄像装置的镜头在移动过程中始终朝向或者正对着所述智能终端所在的位置。The onboard flight control system is further configured to control the aircraft to move to the target position with the displacement such that a lens of the camera device on the aircraft always faces or faces the smart terminal during the moving process. Where it is.
  16. 根据权利要求15所述的多旋翼飞行器的控制系统,其特征在于,还包括用于建立所述机载飞控系统和控制系统通信连接的通信中继设备。 A control system for a multi-rotor aircraft according to claim 15 further comprising communication relay means for establishing a communication connection between said onboard flight control system and said control system.
PCT/CN2017/102598 2016-09-27 2017-09-21 Control method, device, and system for multirotor aerial vehicle WO2018059295A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610860869.2 2016-09-27
CN201610860869.2A CN107340780A (en) 2016-09-27 2016-09-27 Control method, the device and system of multi-rotor aerocraft

Publications (1)

Publication Number Publication Date
WO2018059295A1 true WO2018059295A1 (en) 2018-04-05

Family

ID=60222325

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2017/102598 WO2018059295A1 (en) 2016-09-27 2017-09-21 Control method, device, and system for multirotor aerial vehicle
PCT/CN2017/103481 WO2018059398A1 (en) 2016-09-27 2017-09-26 Method, apparatus, and system for controlling multi-rotor aircraft

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/103481 WO2018059398A1 (en) 2016-09-27 2017-09-26 Method, apparatus, and system for controlling multi-rotor aircraft

Country Status (2)

Country Link
CN (1) CN107340780A (en)
WO (2) WO2018059295A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113287077A (en) * 2019-07-08 2021-08-20 松下知识产权经营株式会社 Information processing device, information processing method, and unmanned aerial vehicle

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110579736B (en) * 2018-06-08 2021-10-08 广州极飞科技股份有限公司 Method and device for correcting direction of machine head and flight controller
CN108803645B (en) * 2018-08-03 2021-07-13 成都纵横自动化技术股份有限公司 Forced landing method and device for unmanned aerial vehicle, automatic pilot and unmanned aerial vehicle
CN109753078A (en) * 2019-01-31 2019-05-14 浙江大学 Remote control method based on the unmanned vehicle that GPS positioning and spatial pose resolve
CN111526295B (en) * 2020-04-30 2023-02-28 臻迪科技股份有限公司 Audio and video processing system, acquisition method, device, equipment and storage medium
CN113970314B (en) * 2021-10-18 2023-12-01 国网辽宁省电力有限公司抚顺供电公司 Aerial survey method and system for transmission line clearance distance unmanned aerial vehicle

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100250022A1 (en) * 2006-12-29 2010-09-30 Air Recon, Inc. Useful unmanned aerial vehicle
CN104808674A (en) * 2015-03-03 2015-07-29 广州亿航智能技术有限公司 Multi-rotor aircraft control system, terminal and airborne flight control system
CN104808686A (en) * 2015-04-28 2015-07-29 零度智控(北京)智能科技有限公司 System and method enabling aircraft to be flied along with terminal
CN105068554A (en) * 2015-09-16 2015-11-18 唐山天乐智能科技有限公司 Intelligent follow-up shooting flying equipment
CN105068556A (en) * 2015-07-16 2015-11-18 深圳市前海疆域智能科技股份有限公司 Aircraft automatic tracking method, mobile intelligent equipment, aircraft, and mobile intelligent system
CN105843246A (en) * 2015-11-27 2016-08-10 深圳市星图智控科技有限公司 Unmanned aerial vehicle tracking method, unmanned aerial vehicle tracking system and unmanned aerial vehicle

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6029446B2 (en) * 2012-12-13 2016-11-24 セコム株式会社 Autonomous flying robot
CN103365298B (en) * 2013-07-05 2017-06-20 深圳市大疆创新科技有限公司 The flight assisting system and method for unmanned vehicle
CN104527978A (en) * 2014-12-31 2015-04-22 深圳雷柏科技股份有限公司 Followed shooting type aircraft and followed shooting method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100250022A1 (en) * 2006-12-29 2010-09-30 Air Recon, Inc. Useful unmanned aerial vehicle
CN104808674A (en) * 2015-03-03 2015-07-29 广州亿航智能技术有限公司 Multi-rotor aircraft control system, terminal and airborne flight control system
CN104808686A (en) * 2015-04-28 2015-07-29 零度智控(北京)智能科技有限公司 System and method enabling aircraft to be flied along with terminal
CN105068556A (en) * 2015-07-16 2015-11-18 深圳市前海疆域智能科技股份有限公司 Aircraft automatic tracking method, mobile intelligent equipment, aircraft, and mobile intelligent system
CN105068554A (en) * 2015-09-16 2015-11-18 唐山天乐智能科技有限公司 Intelligent follow-up shooting flying equipment
CN105843246A (en) * 2015-11-27 2016-08-10 深圳市星图智控科技有限公司 Unmanned aerial vehicle tracking method, unmanned aerial vehicle tracking system and unmanned aerial vehicle

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113287077A (en) * 2019-07-08 2021-08-20 松下知识产权经营株式会社 Information processing device, information processing method, and unmanned aerial vehicle

Also Published As

Publication number Publication date
WO2018059398A1 (en) 2018-04-05
CN107340780A (en) 2017-11-10

Similar Documents

Publication Publication Date Title
WO2016138687A1 (en) Control system, terminal and airborne flight control system of multi-rotor craft
WO2018059295A1 (en) Control method, device, and system for multirotor aerial vehicle
US11233943B2 (en) Multi-gimbal assembly
US11797009B2 (en) Unmanned aerial image capture platform
US11899472B2 (en) Aerial vehicle video and telemetric data synchronization
CN109074101B (en) Imaging using multiple drones
US11231726B2 (en) UAV hardware architecture
US9977434B2 (en) Automatic tracking mode for controlling an unmanned aerial vehicle
US9641810B2 (en) Method for acquiring images from arbitrary perspectives with UAVs equipped with fixed imagers
WO2016138690A1 (en) Motion sensing flight control system based on smart terminal and terminal equipment
US9811083B2 (en) System and method of controlling autonomous vehicles
US20200319642A1 (en) Gimbal control method and device, gimbal, and unmanned aerial vehicle
CN110716579B (en) Target tracking method and unmanned aerial vehicle
WO2020143677A1 (en) Flight control method and flight control system
CN105182992A (en) Unmanned aerial vehicle control method and device
CN108780321B (en) Method, device, system, and computer-readable storage medium for device pose adjustment
CN116830057A (en) Unmanned Aerial Vehicle (UAV) cluster control
CN203845021U (en) Panoramic aerial photographic unit system for aircrafts
CN106094876A (en) A kind of unmanned plane target locking system and method thereof
WO2021081830A1 (en) Computation load distribution
WO2020048365A1 (en) Flight control method and device for aircraft, and terminal device and flight control system
JP2017212528A (en) Imaging system, imaging control method, imaging control system, mobile body, control method, and program
CN204287973U (en) flight camera
JP6265576B1 (en) Imaging control apparatus, shadow position specifying apparatus, imaging system, moving object, imaging control method, shadow position specifying method, and program
KR101876829B1 (en) Induction control system for indoor flight control of small drones

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17854745

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14/08/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17854745

Country of ref document: EP

Kind code of ref document: A1