WO2022134301A1 - 无人机及其控制方法、系统、手持控制设备、头戴设备 - Google Patents

无人机及其控制方法、系统、手持控制设备、头戴设备 Download PDF

Info

Publication number
WO2022134301A1
WO2022134301A1 PCT/CN2021/077755 CN2021077755W WO2022134301A1 WO 2022134301 A1 WO2022134301 A1 WO 2022134301A1 CN 2021077755 W CN2021077755 W CN 2021077755W WO 2022134301 A1 WO2022134301 A1 WO 2022134301A1
Authority
WO
WIPO (PCT)
Prior art keywords
control device
uav
handheld control
information
drone
Prior art date
Application number
PCT/CN2021/077755
Other languages
English (en)
French (fr)
Inventor
张立天
许天野
黄筱莺
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202180006110.7A priority Critical patent/CN114641743A/zh
Publication of WO2022134301A1 publication Critical patent/WO2022134301A1/zh
Priority to US18/332,852 priority patent/US20230341875A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions

Definitions

  • the present application relates to the technical field of unmanned aerial vehicles, and in particular, to an unmanned aerial vehicle and its control method, system, handheld control device, head mounted device and storage medium.
  • UAVs are widely used in aerial photography, patrol inspection, forest protection, disaster investigation and pesticide spraying, etc.
  • the existing operators control the UAV mainly through the joystick of the remote control.
  • the method is single, and the user experience is not good.
  • the present application provides an unmanned aerial vehicle and its control method, system, handheld control device, head-mounted device and storage medium, which make the flight manipulation of the unmanned aerial vehicle easier and safer.
  • an embodiment of the present application provides a method for controlling an unmanned aerial vehicle, the method comprising:
  • the head-mounted device sends the control information of the drone to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the Describe the flight direction of the drone.
  • an embodiment of the present application provides a handheld control device, where the handheld control device includes:
  • an attitude sensor for acquiring attitude information of the handheld control device
  • the communication module is used to send the attitude information of the handheld control device to the drone, so that the drone determines the control information of the drone according to the attitude information of the handheld control device, and sends the
  • the control information of the drone is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the unmanned aerial vehicle.
  • the flight direction of the man-machine is used to send the attitude information of the handheld control device to the drone, so that the drone determines the control information of the drone according to the attitude information of the handheld control device, and sends the
  • the control information of the drone is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the unmanned aerial vehicle.
  • the flight direction of the man-machine is used to send the attitude information of the handheld control device to the drone, so that the drone determines the
  • an embodiment of the present application provides a handheld control device, where the handheld control device includes:
  • an attitude sensor for acquiring attitude information of the handheld control device
  • one or more processors operating individually or collectively, for determining control information of the unmanned aerial vehicle based on the attitude information of the hand-held control device;
  • a communication module configured to send the control information of the drone to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, the Markers are used to indicate the flight direction of the drone.
  • an embodiment of the present application provides an unmanned aerial vehicle, and the unmanned aerial vehicle includes:
  • a first communication module used for acquiring attitude information of the handheld control device
  • one or more processors operating individually or collectively, for determining control information of the unmanned aerial vehicle based on the attitude information of the hand-held control device;
  • a second communication module configured to send the control information of the drone to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone,
  • the marks are used to indicate the flight direction of the drone.
  • an embodiment of the present application provides a method for controlling an unmanned aerial vehicle, the method comprising:
  • control information of the UAV is determined according to the attitude information of the handheld control device, and the control information of the UAV is used to adjust the attitude of the UAV or adjust the UAV.
  • a mark is displayed on the display module of the head mounted device according to the control information of the drone, and the mark is used to indicate the flight direction of the drone.
  • an embodiment of the present application provides a head-mounted device, the head-mounted device comprising:
  • a communication module for acquiring control information of the UAV, the control information of the UAV is determined according to the attitude information of the handheld control device;
  • processors operating individually or collectively, for displaying indicia on a display module of the headset based on control information of the drone, the indicia indicating flight of the drone direction.
  • an embodiment of the present application provides a method for controlling an unmanned aerial vehicle, the method comprising:
  • the attitude information of the handheld control device is used to determine the control information of the drone, and the control information of the drone is used to adjust the attitude of the drone or adjust the The attitude of the gimbal of the drone;
  • a mark is displayed on the display module of the head mounted device according to the attitude information of the handheld control device, and the mark is used to indicate the flight direction of the drone.
  • an embodiment of the present application provides a head-mounted device, the head-mounted device comprising:
  • the communication module is used to obtain the attitude information of the handheld control device
  • processors operating individually or collectively, for displaying indicia on a display module of the headset based on attitude information of the handheld control device, the indicia being used to indicate flight of the drone direction.
  • an embodiment of the present application provides a control system for an unmanned aerial vehicle, the control system comprising:
  • a handheld control device for acquiring attitude information of the handheld control device, where the attitude information is used to determine the control information of the drone;
  • an unmanned aerial vehicle for adjusting the attitude of the unmanned aerial vehicle or adjusting the attitude of the gimbal of the unmanned aerial vehicle according to the control information of the unmanned aerial vehicle;
  • a head mounted device configured to display a mark on the display module of the head mounted device according to the control information of the drone, where the mark is used to indicate the flight direction of the drone.
  • an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the foregoing method.
  • the embodiments of the present application provide an unmanned aerial vehicle and its control method, system, handheld control device, head-mounted device, and storage medium.
  • the attitude information of the handheld control device determines the control information of the UAV; and send the control information of the UAV to the head-mounted device, so that the head-mounted device is displayed on the display module of the head-mounted device according to the control information of the UAV Mark
  • the mark is used to indicate the flight direction of the drone. It enables the user to control the drone by adjusting the posture of the handheld control device, which is in line with human intuition.
  • displaying the mark to indicate the flight direction of the drone a more intuitive control experience can be brought to the user, making the flight control easier and safer.
  • FIG. 1 is a schematic flowchart of a method for controlling an unmanned aerial vehicle provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of the communication connection between an unmanned aerial vehicle, a handheld control device, and a head-mounted device in an embodiment
  • FIG. 3 is a schematic structural diagram of a handheld control device in an embodiment
  • FIG. 4 is a schematic diagram of a coordinate system of a handheld control device in one embodiment
  • FIG. 5 is a schematic diagram of a handheld control device adjusting a posture in the Yaw direction in one embodiment
  • FIG. 6 is a schematic diagram of a handheld control device adjusting a posture in the Roll direction in one embodiment
  • FIG. 7 is a schematic diagram of a handheld control device adjusting a posture in the pitch direction in one embodiment
  • FIG. 8 is a schematic diagram of determining the rotation of the drone in the Yaw direction according to the Yaw angle of the handheld control device in one embodiment
  • FIG. 9 is a schematic diagram of determining the rotation of the drone in the Yaw direction according to the Roll angle of the handheld control device in one embodiment
  • FIG. 10 is a schematic diagram of determining that the pan/tilt of the drone rotates in the pitch direction according to the pitch angle of the handheld control device in one embodiment
  • 11 is a schematic diagram of controlling the drone to fly in the flight direction indicated by the mark in one embodiment
  • 12 is a schematic diagram of the speed mapping when the handheld control device controls the drone in one embodiment
  • Figure 13 is a schematic diagram of a drone control process in one embodiment
  • FIG. 14 is a schematic block diagram of a handheld control device provided by an embodiment of the present application.
  • FIG. 15 is a schematic block diagram of a handheld control device provided by another embodiment of the present application.
  • FIG. 16 is a schematic block diagram of an unmanned aerial vehicle provided by an embodiment of the present application.
  • FIG. 17 is a schematic block diagram of a head mounted device provided by an embodiment of the present application.
  • FIG. 18 is a schematic block diagram of a head mounted device provided by another embodiment of the present application.
  • 19 is a schematic flowchart of a control method for an unmanned aerial vehicle provided by another embodiment of the present application.
  • FIG. 20 is a schematic flowchart of a method for controlling an unmanned aerial vehicle provided by another embodiment of the present application.
  • FIG. 1 is a schematic flowchart of a control method for an unmanned aerial vehicle provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of an application scenario of the control method.
  • the UAV control system includes a UAV, a handheld control device, and a headset.
  • the control method of the unmanned aerial vehicle can be applied to the unmanned aerial vehicle or the hand-held control device, and is used for controlling the unmanned aerial vehicle and other processes according to the attitude information of the hand-held control device.
  • the control method of the drone is applied to the drone.
  • the drone can obtain the attitude information sent by the handheld control device, determine the control information of the drone according to the attitude information of the handheld control device, perform corresponding actions according to the control information, and send the control information of the drone to A head mounted device, so that the head mounted device displays a mark on the display module of the head mounted device according to the control information of the drone, where the mark is used to indicate the flight direction of the drone.
  • the control method of the drone is applied to a handheld control device.
  • the handheld control device obtains its own attitude information, determines the control information of the UAV according to the attitude information, and sends the control information of the UAV to the UAV so that the UAV performs corresponding actions according to the control information, and Send the control information of the drone to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the Describe the flight direction of the drone.
  • the control method of the drone can be applied to a head-mounted device.
  • the head mounted device can obtain the attitude information sent by the handheld control device, determine the control information of the UAV according to the attitude information of the handheld control device, and send the control information of the UAV to the UAV, so that no The human-machine performs corresponding actions according to the control information, and the head-mounted device can also display a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the flight direction of the drone .
  • the drone includes a camera device.
  • the drone may send the image information captured by the photographing device to the head-mounted device, so that the display module of the head-mounted device superimposes and displays the image information and the mark. Users can intuitively see the scene corresponding to the flight direction from the display module of the headset, so as to predict the shooting effect and collision risk.
  • the user can control the drone within the scope of his vision when wearing the headset to control the flight of the drone. Movement direction, control is more intuitive. It's like a bird flying.
  • the attitude information of the handheld control device can be directly sent to the UAV.
  • the attitude information is sent to the UAV through a channel with the UAV.
  • the communication connection between the handheld control device, the drone and the head-mounted device in FIG. 2 is only one embodiment.
  • the handheld control device can communicate with the drone through the head-mounted device. connection, or the headset can communicate with the drone via a handheld control device.
  • the handheld control device and the headset may be communicatively connected to the drone through a relay device.
  • the attitude information of the handheld control device can be sent to the drone through the head-mounted device.
  • the attitude information of the handheld control device is first sent to the head-mounted device, and then the head-mounted device is sent to the drone.
  • the device is forwarded to the UAV, and the attitude information can be transmitted through the channel between the headset and the UAV.
  • the channel has high gain and the transmission is more reliable.
  • control information of the drone determined by the handheld control device can be directly sent to the drone, or can be sent to the drone through a head-mounted device, and the transmission is more reliable.
  • the UAV may be a rotary-wing UAV, such as a quad-rotor UAV, a hexa-rotor UAV, an octa-rotor UAV, or a fixed-wing UAV.
  • the head mounted device may be flying glasses, for example, First Person View (FPV, First Person View) glasses.
  • FMV First Person View
  • the handheld control device includes, for example, a somatosensory remote control.
  • the handheld control device includes a plurality of buttons, and a throttle control component 11 , wherein the buttons include, for example, a lock button 12 , a gear button 13 , and an emergency stop (brake) button 14 .
  • the buttons include, for example, a lock button 12 , a gear button 13 , and an emergency stop (brake) button 14 .
  • the buttons corresponding to different functions and/or the function triggering logic of the buttons can be set according to the actual situation.
  • the throttle control component includes, for example, a pullable throttle lever. Of course, it may also include other forms of control components, such as knobs, triggers, and the like.
  • the user can control the flight of the UAV by changing the posture of the handheld control device, operating the buttons and throttle control components of the handheld control device.
  • the handheld control device includes a sensor, and the sensor of the handheld control device is used to collect attitude information of the handheld control device, and the attitude information includes the pitch angle, yaw angle, roll angle, horizontal movement speed, vertical At least one of the movement speed of the direction and the height above the ground.
  • the sensor of the handheld control device may include at least one of an inertial measurement unit (Inertial Measurement Unit, IMU), a compass, a gravity sensor, and a distance sensor.
  • IMU inertial measurement unit
  • IMU inertial Measurement Unit
  • data is transmitted between the handheld control device, the headset, and the drone over a wireless channel.
  • the wireless channel from the drone to the handheld control device and the head-mounted device is used to transmit the data collected by the drone, such as video, pictures, sensor data, And telemetry data such as the status information (OSD) of the drone.
  • the data collected by the drone such as video, pictures, sensor data,
  • telemetry data such as the status information (OSD) of the drone.
  • the wireless channel from the handheld control device, the head-mounted device to the UAV is used to transmit remote control data; for example, the uplink channel is used to transmit flight control instructions and take pictures and videos. , return home and other control commands.
  • control method for an unmanned aerial vehicle includes steps S110 to S130.
  • the attitude information of the handheld control device can be obtained through a fusion algorithm. arity.
  • the attitude information of the handheld control device includes attitude information in the northeast coordinate system, and optionally, other coordinate systems, such as the northeast sky coordinate system.
  • the coordinate system corresponding to the handheld control device is shown in FIG. 4 .
  • the bottom of the handheld control device is the Z-axis direction
  • the right side is the Y-axis direction
  • the front is the X-axis direction.
  • the handheld control device when the handheld control device rotates around the Z axis, it can be called adjusting the attitude in the Yaw (yaw) direction; as shown in FIG. 6, when the handheld control device rotates around the X axis, it can be called as adjusting the attitude in the Roll direction.
  • Adjusting the attitude in the (rolling) direction as shown in FIG. 7 , when the handheld control device rotates around the Y axis, it can be called adjusting the attitude in the pitching (pitch) direction.
  • the rotation angle of the handheld control device around the Z axis may be referred to as the Yaw angle
  • the rotation angle around the Y axis may be referred to as the Pitch angle
  • the rotation angle around the X axis may be referred to as the Roll angle.
  • the gesture information of the handheld control device includes at least one of Yaw angle, Roll angle, and Pitch angle. It can be understood that the attitude adjustment of the handheld control device can be decomposed into rotations in two directions, so the Yaw angle, Roll angle and Pitch angle of the handheld control device can be determined.
  • control information of the UAV can be determined according to the attitude adjustment angles of the handheld control device in various directions, and the control information of the UAV is used to control the UAV to adjust the attitude of the body of the UAV and/or the unmanned aerial vehicle.
  • the control information determined according to the Yaw angle of the handheld control device is used to control the UAV to rotate in the Yaw direction.
  • the control information determined according to the Roll angle of the handheld control device can also be used to control the UAV to rotate in the Yaw direction.
  • the control information determined according to the pitch angle of the handheld control device can also be used to control the rotation of the gimbal of the drone in the pitch direction.
  • the marker 21 when the control information of the drone is used to instruct the drone to move left or right (turn in the Yaw direction), the marker 21 is left or right Move, deviate from the central position in the lateral direction of the display module; as shown in Figure 10, when the control information of the drone is used to instruct the pan/tilt of the drone to do a pitching motion (rotate in the pitch direction), the mark 21 is upward Or move downward, deviating from the central position in the vertical direction of the display module; when the control information of the drone is used to instruct the drone to keep the attitude unchanged, the mark is at the preset position of the display interface of the display module Display, for example, the preset position is located in the middle of the display interface.
  • the preset position is located in the middle of the display interface.
  • a more intuitive control experience can be brought to the user.
  • the user can adjust the display position of the mark in the display module, and the mark can indicate the movement direction of the future drone on the display module, making the flight manipulation easier and safer.
  • the movement direction of the drone can be indicated according to the X-axis direction of the handheld control device.
  • the X-axis direction can be used as the light emitted by the "flashlight" to indicate the movement direction of the drone. Therefore, the movement direction of the drone is controlled according to the attitude information of the handheld control device, which can be called the flashlight mode.
  • the drone includes a camera device.
  • the method further includes: sending the image information captured by the photographing device to the head-mounted device, so that the display module of the head-mounted device superimposes and displays the image information and the mark.
  • Users can intuitively see the scene corresponding to the flight direction from the display module of the headset, so as to predict the shooting effect and collision risk.
  • the user can control the drone within his field of vision when wearing the headset to control the flight of the drone. Movement direction, control is more intuitive. It's like a bird flying.
  • the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, including: the head-mounted device, according to the control information of the drone, the display
  • the display parameter of the module calculates the pixel coordinates of the marker on the display module so as to display the marker on the display module.
  • the greater the range of attitude change of the drone indicated by the control information of the drone the greater the distance that the mark displayed by the display module deviates from the preset position. Therefore, the mark displayed by the display module can reflect the attitude change range of the UAV, which is convenient to feedback the flight direction of the UAV to the user.
  • the display parameters include a screen ratio and a resolution of the display module. Therefore, it can be adapted to display modules of different specifications to more accurately indicate the flying direction of the UAV.
  • the photographing device is mounted on the drone through a gimbal.
  • the attitude of the drone and/or the gimbal can be adjusted, so that the shooting direction of the shooting device can be adjusted, so that the user can observe the scene corresponding to the shooting direction on the display module of the headset.
  • the pan/tilt mounted on the drone can also be rotated following the adjustment of the attitude of the handheld control device, so that the flight direction of the drone and the mark displayed by the display module can be in the field of view of the head mounted device.
  • control information sent to the head-mounted device is the control information in the geodetic coordinate system, the body coordinate system of the drone, or the PTZ coordinate system, so that the head-mounted device uses the control information It is mapped to control information under the camera coordinate system of the photographing device, and the mark is displayed according to the control information under the camera coordinate system.
  • the method further includes: comparing the position and direction of the drone, the relative position and attitude of the drone and the pan/tilt, and/or the distance between the pan/tilt and the photographing device.
  • the relative position and attitude of the camera are sent to the head-mounted device, so that the head-mounted device maps the geodetic coordinate system, the drone's body coordinate system or the gimbal coordinate system to the camera coordinate system of the shooting device. control information.
  • the mapping of the control information under the geodetic coordinate system to the camera coordinate system corresponding to the photographing device includes: mapping the control information under the geodetic coordinate system to the UAV body coordinate system (according to the position and direction of the UAV; ); map the control information under the body coordinate system to the gimbal coordinate system (according to the relative position and attitude of the UAV and the gimbal, the relative position can be fixed, and the attitude can be determined by the sensors on the UAV and the gimbal The detection calculation is obtained; the control information under the gimbal coordinate system is mapped to the camera coordinate system (according to the relative position and attitude between the gimbal and the shooting device, the position can be fixed, and the attitude can be obtained by the control amount of the gimbal).
  • the position and orientation of the UAV, the relative position and attitude of the UAV and the gimbal, and the relative position and attitude between the gimbal and the photographing device can be sent by the UAV to the head-mounted device, so that the head-mounted device can be used.
  • the device performs the mapping of control information.
  • the drone can also directly transmit the control information in the camera coordinate system to the headset, so that the position and direction of the drone, the relative position and attitude of the drone and the gimbal, the gimbal and shooting The relative positions and attitudes between the devices may not be transmitted.
  • the control information of the UAV includes UAV attitude control information and/or PTZ attitude control information.
  • the control information of the UAV is used to indicate the angle and/or angular velocity of the attitude adjustment of the body and/or the gimbal of the UAV.
  • the control information of the drone is used to adjust the Yaw angle of the drone's body or the angular velocity of the body's rotation in the Yaw direction, or to adjust the pitch angle of the drone's gimbal or the gimbal's rotation in the Pitch direction angular velocity.
  • the control information of the UAV is used to adjust the Yaw angle of the drone's body or the angular velocity of the body's rotation in the Yaw direction, or to adjust the pitch angle of the drone's gimbal or the gimbal's rotation in the Pitch direction angular velocity.
  • the Yaw angle of the drone's body or the angular velocity of the body's rotation in the Yaw direction or to adjust the pitch angle of the drone's
  • the yaw attitude of the drone is related to the yaw and/or roll attitude of the handheld control device.
  • the yaw attitude of the drone can adjust the heading of the drone, and the handheld control device can adjust the heading of the drone when the attitude is adjusted in the Yaw direction and/or the Roll direction.
  • the flying direction of the drone can change with the rotation of the handheld control device in the horizontal direction, for example, it can be changed with the handheld control device.
  • the X-axis direction of the control device remains the same.
  • the flying direction of the drone can be changed following the rotation of the handheld control device in the vertical direction.
  • the drone rotates counterclockwise, and the mark displayed by the display module of the headset moves to the left; when the handheld control device is tilted and rotated to the right in the vertical direction, no one
  • the drone rotates clockwise, the mark displayed on the display module of the headset moves to the right; when the handheld control device is not tilted and rotated in the vertical direction, the drone can not rotate in the horizontal direction.
  • control information of the drone determined according to the yaw angle and/or the roll angle of the handheld control device is used to move the marker to the left or right.
  • the relationship between the movement direction of the mark and the posture adjustment direction of the handheld control device is more in line with the user's operating habits, and is more intuitive and convenient.
  • the control information for controlling the UAV and/or the gimbal of the UAV to turn left in the yaw direction is used to make the The marker moves to the left
  • the control information used to control the UAV and/or the gimbal of the UAV to turn right in the yaw direction is used to move the marker to the right.
  • the moving direction of the mark can better reflect the attitude adjustment direction of the drone and/or the gimbal of the drone, which is more in line with the user's operating habits and is more intuitive.
  • the pitch attitude of the gimbal is related to the pitch attitude of the handheld control device.
  • the gimbal can be rotated in the pitch direction.
  • the control information includes at least one of PTZ control information and UAV control information.
  • the gimbal control information can control the gimbal of the drone to drive the camera to adjust the attitude in the direction of the Pitch, and the display module of the headset displays the mark. Move up or down, for example off-center in the vertical direction of the display module. Exemplarily, as shown in FIG. 8 and FIG.
  • the drone drives the photographing device to adjust the attitude in the Yaw direction and/or the Roll direction, and the headset displays
  • the marker displayed by the module is moved to the left or right, eg off-center in the lateral direction of the display module.
  • the gimbal can be rotated in the Pitch direction, the Roll direction, and the Yaw direction.
  • the control information is used to control the UAV to adjust the attitude of the gimbal.
  • the control information includes gimbal control information.
  • the gimbal of the drone drives the shooting device to adjust the attitude in the direction of the pitch,
  • the mark displayed by the display module of the headset moves up or down; when the handheld control device adjusts the attitude in the Yaw direction and/or the Roll direction, the gimbal of the drone drives the camera to adjust the attitude in the Yaw direction, and the head mounted device adjusts the attitude in the Yaw direction.
  • the marker displayed by the display module moves left or right.
  • the gimbal of the drone drives the shooting.
  • the mark displayed by the display module of the headset may not move left or right.
  • the control information is used to control the UAV to adjust the attitude of the gimbal. and the posture of the body of the drone.
  • the control information further includes control information of the drone.
  • the partial angle of the rotation angle corresponding to the control information of the UAV outside the limit range of the gimbal may be used to control the UAV to adjust the attitude.
  • the handheld control device adjusts the attitude in the Yaw direction and/or the Roll direction, so that the rotation angle of the Yaw direction corresponding to the control information exceeds the limit range of the gimbal in the Yaw direction, then the control information also controls the body of the drone. Adjust the pose in the Yaw direction and move the marker displayed by the display module of the headset to the left or right.
  • the control information of the drone determined according to the pitch angle of the handheld control device is used to move the marker upward or downward.
  • the relationship between the movement direction of the mark and the posture adjustment direction of the handheld control device is more in line with the user's operating habits, and is more intuitive and convenient.
  • control information for controlling the UAV and/or the pan/tilt of the UAV to rotate upward in the pitch direction is used to move the mark upward, for Control information for controlling the UAV and/or the pan/tilt of the UAV to rotate downward in the pitch direction, so as to move the marker downward.
  • the moving direction of the mark can better reflect the attitude adjustment direction of the drone and/or the gimbal of the drone, which is more in line with the user's operating habits and is more intuitive.
  • determining the control information of the drone according to the attitude information of the handheld control device includes: acquiring reference attitude information of the handheld control device, and determining the control information of the drone according to the attitude of the handheld control device information and the reference attitude information of the handheld control device to determine the control information of the unmanned aerial vehicle.
  • the posture corresponding to the reference posture information of the handheld control device may also be the initial posture of the handheld control device, or may be referred to as the zero position of the handheld control device.
  • the control information of the UAV can be determined according to the difference between the current attitude of the handheld control device and the initial attitude of the handheld control device, that is, the control information of the UAV can be determined according to the relative attitude of the handheld control device relative to the initial attitude .
  • the relative quaternion is determined according to the current rotation quaternion of the handheld control device and the rotation quaternion corresponding to the initial posture.
  • Relative quaternions can be mapped to any desired rotation system, such as conversion to Euler angles, and the rotation order can be adjusted according to different needs.
  • the initial posture of the hand-held control device may be a preset posture, for example, the posture of the hand-held control device when the user naturally holds the hand-held control device.
  • the current posture of the handheld control device may be initialized and determined as the initial posture of the handheld control device at a certain moment.
  • the acquiring the reference attitude information of the handheld control device includes: using the attitude information of the handheld control device when an initialization operation is triggered as the reference attitude information of the handheld control device.
  • the current posture of the handheld control device is determined as the initial posture of the handheld control device.
  • the initialization operation may be triggered by a user.
  • the user can trigger (eg press a corresponding button on the handheld control device) at any time and at any position.
  • the handheld control device determines the reference attitude information of the handheld control device according to the current attitude of the handheld control device.
  • the user can press the emergency stop button on the handheld control device to make the drone stop flying and keep hovering.
  • the handheld control device can determine according to the current attitude Hold the reference attitude information of the control device.
  • the initialization operation may be automatically triggered when the drone automatically takes off.
  • the initialization operation can also be triggered by the flying state of the drone.
  • the reference attitude information of the handheld control device can be determined according to the current attitude of the handheld control device. It can prevent the drone from malfunctioning when the initial attitude of the handheld control device is not initialized.
  • the initialization operation can also be triggered by the state of the communication connection between the handheld control device and the drone.
  • the reference attitude information of the handheld control device can be determined according to the current attitude of the handheld control device. It can prevent the drone from malfunctioning when the initial attitude of the handheld control device is not initialized. Of course it is not limited to this.
  • the attitude information of the handheld control device when the attitude information of the handheld control device satisfies a preset condition when the initialization operation is triggered, the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device. , and use the attitude information of the UAV when the initialization operation is triggered as the reference attitude information of the UAV.
  • the initial posture of the handheld control device is enabled to be initialized.
  • the attitude information of the drone when the initialization operation is triggered is used as the Describe the reference attitude information of the UAV. It can avoid that the user defines an abnormal posture as the zero position of the handheld control device, that is, the initial posture, which is not conducive to the subsequent control of the flight direction of the drone by adjusting the posture of the gesture control device.
  • prompt information is output to prompt the user to adjust the gesture of the handheld control device.
  • prompt information is output when the current Yaw angle, Roll angle or Pitch angle of the handheld control device is not within the corresponding preset range.
  • the reference pitch angle and the reference roll angle of the handheld control device are preset values, that is, the zero position in the Roll direction and the zero position in the Pitch direction of the handheld control device are preset values, For example, the angle of the handheld control device in the Roll direction and the angle in the Pitch direction when the user naturally holds the handheld control device. It can prevent the user from operating the handheld control device in an abnormal attitude during the process of the drone from take-off to hovering, such as deflection of 90 degrees in the Roll direction, making the reference pitch angle and reference roll angle too large, and the user side is flat.
  • the control device that is, the drone rotates abnormally in the Roll direction and the Pitch direction when the handheld control device is naturally held.
  • the mark is displayed at a preset position of the display interface of the display module.
  • the preset position is located in the middle of the display interface.
  • the mark displayed on the display device can more accurately indicate the flying direction of the drone.
  • the mark is displayed at a preset position of the display interface of the display module.
  • the target angular velocity of the UAV for attitude adjustment can be determined according to the attitude information of the handheld control device. It can be understood that, in this embodiment, the reference attitude of the drone, that is, the initial attitude of the drone, may be determined, and the drone may rotate according to the target angular velocity to adjust the attitude.
  • the target angular velocity for the attitude adjustment of the drone in the corresponding direction may be determined according to at least one of the yaw angle, the pitch angle, and the roll angle of the handheld control device.
  • the Yaw angular velocity of the UAV rotating in the Yaw direction can be determined according to the Yaw angle of the handheld control device relative to the initial attitude, such as ⁇ , that is, the target yaw angular velocity of the UAV, which can be called the first method.
  • the determining the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: according to the yaw angle of the handheld control device, the The reference yaw angle of the handheld control device is used to determine the target yaw rate of the UAV.
  • the Yaw angular velocity of the drone is determined according to the angle between the current X-axis direction of the handheld control device and the X0Z plane of the initial attitude.
  • the handheld control device When the handheld control device generates a certain Yaw angle relative to the initial state, the drone can be controlled to rotate in the Yaw direction.
  • the Yaw angular velocity of the drone turning in the Yaw direction is the product of the Yaw angle ⁇ and the Yaw angular velocity gain s of the drone.
  • the Yaw angular velocity of the UAV rotating in the Yaw direction can be determined according to the Roll angle, such as ⁇ , of the handheld control device relative to the initial attitude, which can be referred to as the second method.
  • the determining the control information of the drone according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: according to the roll angle of the handheld control device, the The reference roll angle of the handheld control device is used to determine the target yaw rate of the UAV.
  • the drone can be controlled to rotate in the Yaw direction.
  • Yaw angular velocity of the direction it can be determined Yaw angular velocity of the direction turn. It can be understood that during the forward flight of the UAV in the body coordinate system, there are Yaw angular velocity and the forward speed of the body in the forward direction, and then the flight of forward, turning, etc. can be realized.
  • the angle at which the drone performs attitude adjustment may be determined according to the attitude information of the handheld control device.
  • the angle at which the drone performs attitude adjustment in the corresponding direction may be determined according to at least one of the yaw angle, pitch angle, and roll angle of the handheld control device.
  • the Yaw angle of the UAV rotating in the Yaw direction can be determined according to the Yaw angle of the handheld control device relative to the initial attitude, such as ⁇ , which can be referred to as the third method.
  • the determining the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: according to the yaw angle of the handheld control device, the The reference yaw angle of the handheld control device is used to determine the target yaw angle of the UAV.
  • the Yaw angle at which the drone rotates in the Yaw direction is determined according to the angle between the current X-axis direction of the handheld control device and the X0Z plane of the initial attitude.
  • the drone can be controlled to rotate in the Yaw direction.
  • the Yaw angle at which the UAV rotates in the Yaw direction can be determined according to the Yaw angle ⁇ .
  • the Yaw angle of the UAV rotating in the Yaw direction can be determined according to the Roll angle of the handheld control device relative to the initial attitude, such as ⁇ , which can be referred to as the fourth method.
  • the determining the control information of the drone according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: according to the roll angle of the handheld control device, the The reference roll angle of the handheld control device is used to determine the target yaw angle of the UAV.
  • the UAV can be controlled to rotate in the Yaw direction.
  • the Yaw angle at which the UAV rotates in the Yaw direction can be determined according to the Roll angle ⁇ .
  • the angle and angular velocity at which the drone performs attitude adjustment can be determined according to the attitude information of the handheld control device.
  • the Yaw angle that the UAV rotates in the Yaw direction can be determined according to the Yaw angle of the handheld control device relative to the initial attitude, and the Roll angle relative to the initial attitude of the handheld control device can be determined
  • the Yaw angular velocity rotating in the Yaw direction that is, the target yaw angular velocity
  • this control method can be called the fifth method.
  • the determining the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: according to the yaw angle of the handheld control device, the The reference yaw angle of the handheld control device is used to determine the target yaw angle of the UAV; according to the roll angle of the handheld control device and the reference roll angle of the handheld control device, the UAV is determined. target yaw rate.
  • the mapping method can be determined according to the user's body structure and hand habit, making it easier for people with different body structures and hand habit to get started Control the drone with a handheld control device.
  • the first method and the third method are more in line with the definition of the flashlight mode. Users can imagine in their minds that the actual use of the flashlight emits light to guide the drone to fly, but because the human wrist is operating the handheld control device to turn the Yaw angle. When the left and right are not symmetrical, some people will not be able to use it.
  • the user can control the UAV to turn by turning the small arm, which is relatively labor-saving.
  • the fifth method can determine the target yaw angle and target yaw angular velocity of the drone, so that the drone can follow the movement of the user's body to fly, and the user can rotate his arm while turning his body to continue to control the unmanned aerial vehicle. The rotation of the aircraft in the direction of Yaw can realize large maneuvering flight.
  • the Yaw angle of the UAV is determined according to the Yaw angle of the handheld control device relative to the initial attitude.
  • the Yaw angle of the drone is determined according to the angle between the current X-axis direction of the handheld control device and the X0Z plane of the initial attitude.
  • the Yaw angular velocity of the UAV can be determined according to the Roll angle of the handheld control device relative to the initial attitude.
  • the drone can be controlled to rotate at the Yaw angular velocity in the Yaw direction.
  • the attitude of the UAV can be adjusted according to the target yaw angle of the UAV and the target yaw angular velocity of the UAV.
  • the method further includes: controlling the UAV to continue to rotate at the target yaw angle speed after rotating the target yaw angle. For example, adjust the Yaw angle of the drone in the Yaw direction to determine the Yaw angle of the drone according to the Yaw angle of the handheld control device, and then adjust the Yaw angle of the drone in the Yaw direction to determine the Yaw angular velocity of the drone according to the Roll angle of the handheld control device Keep turning.
  • the method further includes: controlling the UAV to rotate at least the target yaw angle at the target yaw angle speed. For example, adjust the Yaw angle of the UAV determined according to the Yaw angle of the handheld control device when the UAV rotates in the Yaw direction, and the angular velocity of the UAV in the Yaw direction when the UAV rotates is determined according to the Roll angle of the handheld control device. Yaw angular velocity.
  • the method further includes: determining the control angle of the UAV in the yaw direction according to the integral of the target yaw angle and the target yaw angular velocity over a preset time interval.
  • the control angle can be calculated by the following formula:
  • the target yaw angle can be determined according to the following formula:
  • Yaw rc (0) represents the Yaw angle at the initial attitude of the handheld control device, that is, the reference yaw angle
  • t represents the current time at zero when the time triggered by the initialization operation
  • Yaw rc (t) represents the handheld control device
  • the current Yaw angle that is, the current yaw angle.
  • the integral of the target yaw rate over the preset time interval t can be expressed as:
  • time ⁇ is the time between 0 and time t
  • w( ⁇ ) represents the target yaw angular velocity at time ⁇ , for example, it can be determined according to the difference between the roll angle of the handheld control device at time ⁇ and the reference roll angle
  • the Yaw angular velocity of the drone rotating in the Yaw direction that is, the target yaw angular velocity
  • the Yaw angular velocity gain s of the drone is determined according to the product of the difference and the Yaw angular velocity gain s of the drone.
  • control angle of the UAV in the yaw direction may be determined according to the sum of the integral of the target yaw angle and the target yaw angular velocity over a preset time interval t.
  • the Yaw angle of the UAV at the initial attitude can be represented as Yaw uav (0).
  • the determining the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: acquiring the reference attitude information of the UAV ; According to the attitude information of the handheld control device and the reference attitude information of the handheld control device and the reference attitude information of the unmanned aerial vehicle, determine the control information of the unmanned aerial vehicle.
  • control information of the UAV can be used to control the attitude angle of the UAV relative to the initial attitude. It can be understood that the initial posture is the posture corresponding to the reference posture information. In other examples, the control information of the drone may be used to control the angle of rotation of the drone relative to the previous moment.
  • the mark is displayed at a preset position of the display interface of the display module.
  • the preset position is located in the middle of the display interface.
  • the mark displayed on the display device can more accurately indicate the flying direction of the drone.
  • the initial posture of the drone may be a preset posture, such as the posture when the drone is hovering.
  • the current attitude of the UAV can be initialized and determined as the initial attitude of the UAV at a certain moment.
  • acquiring the reference attitude information of the handheld control device and the reference attitude information of the UAV includes: using the attitude information of the handheld control device when an initialization operation is triggered as the handheld control device
  • the reference attitude information of the UAV, and the attitude information of the UAV when the initialization operation is triggered is used as the reference attitude information of the UAV.
  • the initialization operation may be triggered by the user, or the initialization operation may be performed when the drone is finished taking off, of course, it is not limited thereto.
  • the attitude information of the handheld control device when the attitude information of the handheld control device satisfies a preset condition when the initialization operation is triggered, the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device. , and use the attitude information of the UAV when the initialization operation is triggered as the reference attitude information of the UAV. It can avoid that the user defines an abnormal posture as the zero position of the handheld control device, that is, the initial posture, which is not conducive to the subsequent control of the flight direction of the drone by adjusting the posture of the gesture control device.
  • prompt information is output to prompt the user to adjust the gesture of the handheld control device.
  • the reference pitch angle and reference roll angle of the UAV are preset values, that is, the zero position in the Roll direction and the zero position in the Pitch direction of the UAV are preset values, such as: The angle in the Roll direction and the angle in the Pitch direction when the drone is hovering horizontally. to keep the drone steady.
  • the yaw angle of the handheld control device when the initialization operation is triggered may be used as the reference yaw angle of the handheld control device, and the yaw angle of the UAV when the initialization operation is triggered may be used as the The reference yaw angle of the man-machine.
  • the zero position of the UAV heading can be determined, which is convenient for the user to accurately adjust the heading of the UAV by operating the handheld control device.
  • the determining the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device includes: according to the pitch angle of the handheld control device, The reference pitch angle of the handheld control device determines the target pitch angle of the gimbal.
  • the handheld control device adjusts the attitude in the Yaw direction and/or the Roll direction
  • the body of the drone adjusts the attitude in the Yaw direction
  • the mark displayed by the display module of the headset moves to the left or right
  • the handheld control device When the attitude is adjusted in the Pitch direction, the gimbal of the drone adjusts the attitude in the Pitch direction, and the mark displayed by the display module of the headset moves up or down. It can prevent the risk caused by the large movement of the drone's body in the direction of the pitch.
  • the control information is used to control the drone.
  • the machine adjusts the posture of the gimbal in the direction of the pitch.
  • the control information is used to control the UAV.
  • the machine adjusts the posture of the gimbal in the direction of the pitch, and adjusts the posture of the body in the direction of the pitch.
  • the handheld control device includes a throttle control component 11 .
  • the throttle control component includes, for example, a steerable throttle, the position of the throttle, or can be called a key travel value, or can be called a throttle stick quantity, which can control the speed (scalar) of the drone in the body coordinate system.
  • pressing the accelerator in the direction shown in the figure can control the drone to move along the flight direction.
  • the method further includes: acquiring a throttle stick amount, the throttle stick amount is generated based on the operation of the throttle control component; controlling the drone to indicate the mark according to the throttle stick amount flight direction.
  • the keystroke value of the throttle is mapped to between [0, 1]. Assume that the maximum speed of the drone is V max . The speed of the drone in the speed direction is the product of the value mapped by the keystroke value and the maximum speed of the drone, V max .
  • the throttle stick amount is the minimum throttle stick amount
  • the position of the drone remains unchanged.
  • the mapped value of the key travel value is 0, the corresponding throttle stick amount is the minimum throttle stick amount, and the drone stops moving in the horizontal direction and/or the vertical direction, for example Keep hovering or rotate in place according to the attitude information of the handheld control device to adjust the flight direction. It can be understood that it is not necessary to manually control the throttle stick amount to keep the drone hovering.
  • the UAV starts to gradually accelerate in the flight direction determined according to the attitude information of the handheld control device.
  • the maximum speed of the machine is the product of V max .
  • the drone flies toward the flight direction indicated by the mark at a preset flight speed.
  • the mapped value of the key travel value is 1, and the drone flies at full speed, such as at the maximum speed V max , in the flight direction indicated by the mark.
  • the keystroke value of the accelerator is mapped to between [-1, 1].
  • the mapped value of the keystroke value is 0, and the drone stops in the horizontal direction. and/or movement in the vertical direction, such as keeping hovering or spinning in place;
  • the accelerator is released from the middle position, the value after mapping of the key travel value is less than 0, and the drone can move downward in the vertical direction;
  • the mapped value of the key travel value is greater than 0, and the drone can move upward in the vertical direction. This method requires manually keeping the drone hovering.
  • the noise and vibration of the keystroke value may be removed by filtering the keystroke value of the accelerator, and the keystroke value of the accelerator may be filtered by means of first-order filtering.
  • the increment of the flying speed of the drone gradually becomes larger.
  • the keystroke value of the accelerator is processed through a preset exponential curve (Exponential), which can make the front-end accelerator (such as between the middle position and the complete release of the accelerator) is relatively smooth, so as to achieve smooth acceleration, and the rear-end accelerator can be smoothly accelerated. (e.g. between mid-position and full throttle) can make the drone have a quicker response. Improve the feel of throttle control.
  • Expoential preset exponential curve
  • the motion of the drone can be decomposed into the angle of rotation in the yaw direction, the magnitude of the horizontal velocity in the forward direction of the body
  • the X-axis direction of the coordinate system of the handheld control device that is, the light emitted by the "flashlight” changes in the horizontal direction (rotating along the Z-axis of the geodetic coordinate system)
  • the movement of the drone can be decomposed into rotation in the yaw direction.
  • the X-axis direction of the handheld control device that is, the light emitted by the "flashlight” changes in the vertical direction (rotating along the Y-axis of the geodetic coordinate system)
  • the drone generates a vertical velocity.
  • the target speed direction of the UAV may be determined according to a preset direction on the body coordinate system of the handheld control device, such as the X-axis direction.
  • the X-axis direction will also rotate along with it.
  • the attitude information of the handheld control device may include at least one of the speed in the horizontal direction, the speed in the vertical direction, the yaw angle, and the yaw angular velocity of the body of the handheld control device.
  • the control information for controlling the rotation of the drone in the horizontal direction can be determined according to the yaw angle and the yaw angular velocity of the handheld control device in the horizontal direction.
  • the current X-axis direction of the handheld control device is mapped to the X0Z plane of the initial attitude to obtain a vector, according to which the movement direction of the drone in the body coordinate system can be determined, and the movement direction can be called It is the direction of the speed command vector, referred to as the speed command direction.
  • the mark is used to indicate that the drone is vertically lifted and lowered.
  • the control information of the UAV determined according to the attitude information is used to control the UAV. Ascending or descending, for example, controlling the speed of the motor to increase the lift of the drone or reducing the speed of the motor to reduce the lift of the drone. In order to prevent the risk caused by the large rotation of the drone in the direction of the Pitch.
  • an upward icon and a downward icon respectively directly above and below the display module of the head mounted device
  • the mark displayed by the display module can be overlapped with the upward icon or the downward icon, and the color of the upward icon or the downward icon will change after the coincidence, prompting the user that the current drone can be lifted vertically.
  • the user operates the throttle control components, such as pulling the throttle stick to control the vertical lift of the drone.
  • the method further includes: enabling the control information of the drone to be determined according to the attitude information of the handheld control device when the drone takes off to a preset height above the ground.
  • the drone automatically takes off vertically to hover at a height of 1.2 meters above the ground, and then the handheld control device can enter the flashlight mode. It can prevent the unmanned aerial vehicle from malfunctioning due to the posture of the handheld control device when the user does not hold the handheld control device correctly or does not perform an initialization operation.
  • the method further includes: when the UAV is in an automatic landing state, stopping determining the control information of the UAV according to the attitude information of the handheld control device.
  • the drone when the power of the drone is lower than the preset power threshold, the drone will trigger a low-power automatic landing.
  • the user can also trigger the automatic landing function by double-clicking the corresponding button on the handheld control device.
  • the handheld control device when the UAV is in an automatic landing state, the handheld control device is locked, that is, the change in the attitude of the handheld control device does not cause a change in the attitude of the UAV. It can improve the safety of the automatic landing of the drone.
  • the automatic landing function is simple to operate, which reduces the difficulty of landing the drone in flashlight mode and improves the reliability of the drone landing safely.
  • the method further includes: when the drone is in an automatic landing state, according to an unlocking operation of the handheld control device by the user, enabling the determination of the Describe the control information of the UAV.
  • the unmanned aerial vehicle when the unmanned aerial vehicle is in an automatic landing state, if the obtained throttle stick amount is greater than the preset throttle stick amount threshold, it is enabled to determine the unmanned aerial vehicle according to the attitude information of the handheld control device. control information.
  • the hand-held control device can be unlocked by pressing down the accelerator, for example, when the accelerator is pressed to the middle position or continued to be pressed from the middle position, and the hand-held control device can be unlocked to take over the control of the drone, that is, the attitude of the hand-held control device changes. It can be mapped to the change of the attitude of the drone and start to control the movement of the drone.
  • the attitude adjustment of the handheld control device in the Roll direction and/or the Yaw direction can control the UAV to rotate in the Yaw direction
  • the rotation of the handheld control device in the Pitch direction can control the body of the UAV and/or the pan/tilt pitch of the UAV.
  • pressing the throttle can slow down the descending speed of the drone, for example, when the throttle is pulled to the bottom, the drone can hover vertically.
  • the handheld control device is locked, and the drone autonomously lands.
  • the drone when the drone lands, the drone will descend vertically at a constant speed, hover 0.3 meters above the ground and trigger a second-stage landing, waiting for the user to double-click the button to confirm the landing.
  • the landing can be canceled by operating the handheld control device, for example, by clicking a corresponding button on the handheld control device.
  • the flight direction and/or the descending speed of the UAV can be adjusted through the handheld control device, so as to ensure the safety of landing, such as landing in a place without obstacles.
  • the speed of the drone in the vertical direction may be determined according to the pitch angle of the handheld control device relative to the initial attitude.
  • the component of the current unit vector of the hand-held control device in the X-axis direction projected onto the Z-axis of the geodetic coordinate system multiply the component by the speed V of the UAV controlled by the throttle to obtain the UAV in the vertical direction. target speed.
  • the target speed range of the drone in the vertical direction determined according to the attitude of the handheld control device may be [-V max , V max ]; when the drone lands automatically, if the handheld control device is unlocked and the movement of the drone can be controlled, the target speed range of the drone in the vertical direction determined according to the attitude of the handheld control device can be [ 0, V max ]. It can ensure that the drone can descend normally, and can also use the handheld control device to control the landing point of the drone.
  • the descending speed of the drone is forcibly set to the preset value Vlan, and when the target speed in the vertical direction and the descending speed Vlan are offset according to the attitude of the handheld control device, there is no value. People will stop declining.
  • the method further includes: when the drone is in an automatic landing state, controlling the gimbal to rotate downward by a preset angle in the pitch direction. Therefore, the image information captured by the shooting device and the image information displayed by the display module of the head-mounted device can reflect the scene below the drone, which is convenient for the user to judge whether the drone is safe or not, and to control it by hand when there is an obstacle at the landing point.
  • the device adjusts the flight direction and/or the descent speed of the drone to ensure the safety of the landing, such as landing in a place without obstacles.
  • the head mounted device may acquire the gesture information of the handheld control device, and display a mark on the display module of the head mounted device according to the gesture information of the handheld control device, where the mark is used to indicate the The flight direction of the drone.
  • the gesture of the handheld control device can be mapped to the adjustment of the display position of the marker. For example, when the handheld control device is turned left or right in the horizontal direction, or the handheld control device is tilted left or right in the vertical direction, the mark displayed by the display module of the headset moves left or right; When the handheld control device adjusts the posture in the direction of the pitch, the mark displayed by the display module of the headset moves up or down.
  • the greater the attitude adjustment range of the handheld control device the greater the distance that the mark displayed by the display module deviates from the preset position, and the greater the attitude change range of the drone indicated by the control information of the drone. , so the mark displayed by the display module can reflect the attitude change range of the UAV, which is convenient to feedback the flight direction of the UAV to the user.
  • the pixel coordinates of the mark on the display module can be calculated according to the gesture information of the handheld control device and the display parameters of the display module, so as to display the mark on the display module.
  • the display parameters include a screen ratio and a resolution of the display module. Therefore, it can be adapted to display modules of different specifications to more accurately indicate the flying direction of the UAV.
  • the mark displayed by the head mounted device on the display module of the head mounted device according to the control information of the drone is a flight indicator mark.
  • the method may further include: when the handheld control device is in a head mounted device operation mode, sending gesture information of the handheld control device to the head mounted device, so that the head mounted device can control the handheld device according to the handheld control device.
  • the gesture information of the device displays an operation mark on the display module of the head mounted device, and the operation mark is used to operate the virtual control part on the display module.
  • the user when the handheld control device is in the operation mode of the head mounted device, the user can adjust the position of the operation mark on the display module by adjusting the posture of the handheld control device, so as to realize the interface of the display module interact. For example, it can be used to select menus. For example, a user may use a one-handed handheld control device to implement menu selection of the display module. It can be understood that the gesture of the handheld control device can be mapped to the adjustment of the display position of the operation mark.
  • the operation mark displayed by the display module of the headset moves to the left or right ;
  • the operation mark displayed by the display module of the headset moves up or down.
  • a button of the corresponding menu is displayed on the screen of the head mounted device.
  • the button will change color to indicate that it is selected.
  • press the corresponding button of the handheld control device such as the mode button to indicate confirmation.
  • double-click the corresponding key such as the mode key to exit the selection.
  • the user can control the operation marks and the corresponding keys to arbitrarily manipulate the option settings of the menu bar by adjusting the posture of the handheld control device.
  • the acquiring the attitude information of the handheld control device includes: when the pitch angle of the handheld control device increases to a first threshold or decreases to a second threshold, recording the yaw of the handheld control device The angle is the locked yaw angle, and the first threshold is greater than the second threshold.
  • the locked yaw angle is used as the current yaw angle of the handheld control device, and according to the handheld control device
  • the angle between the preset direction on the body coordinate system and the second preset plane determines the roll angle of the handheld control device, and the second preset plane and the handheld control device are in the locked yaw
  • the predetermined direction at the angle is parallel, and the second predetermined plane is perpendicular to the earth plane.
  • the Roll angle and the Yaw angle of the handheld control device are already coupled at this time due to the limitation of the properties of Euler angles.
  • the handheld control device has a large pitch angle, then a certain Roll angle is given to the handheld control device, and the Yaw angle will also have an angle output at this time, which may easily lead to confusion in the control of the drone.
  • the pitch angle of the handheld control device is larger or smaller than the corresponding threshold, the Yaw angle at this time is recorded, which is called the locked Yaw angle.
  • the Yaw angle will remain unchanged.
  • the output Roll angle of the handheld control device is replaced by the angle between the X axis of the handheld control device and the vertical plane where the Yaw angle is locked (the plane is perpendicular to the x0y plane of the earth).
  • the handheld control device can implement at least one of the following functions: take-off, entry, braking, return, landing, hovering, obstacle avoidance, sub-point, APAS obstacle avoidance and detour, initialization at any angle .
  • Automatic take-off function For example, after placing the drone on the flat ground, turn on the battery of the drone, connect the handheld control device, first click the unlock button of the handheld control device, the drone will start the paddle, and then long press the handheld control device. With the unlock button, the drone automatically takes off vertically to hover 1.2 meters above the ground, for example, it can automatically enter the flashlight flight mode. By entering the flashlight flight mode after automatic take-off, the drone can be prevented from malfunctioning when the position of the handheld control device is not ready.
  • Automatic landing function When the drone is in any position in the air, the user can trigger the automatic landing function by long pressing the plus/unlock button. After entering the automatic landing, the drone will descend vertically at a constant speed, hover at 0.3 meters above the ground and trigger the second-stage landing, waiting for the user to confirm the landing by long pressing the plus/unlock button. In the process of landing, you can also click the big round button to cancel the landing.
  • the function of automatic landing is simple to operate, which reduces the difficulty of manual landing when the flashlight is flying, and improves the reliability of the safe landing of the drone.
  • Automatic return home function when the drone is in any position in the air, the user can long press the big circle button, such as the brake button, to trigger the automatic return home function. After entering the automatic return home, the drone first rises to the return altitude and then cruises back to the HOME point. During the return flight, you can also click the big round button to cancel the return flight. If the power of the drone is insufficient, in the flashlight mode, it will also trigger the low-battery automatic return to ensure that the drone can return safely.
  • the function of automatic return is simple to operate, which reduces the difficulty of manual return when the flashlight is flying, and improves the reliability of the safe return of the drone.
  • Brake hovering function The braking function of the flashlight mode can be realized by two operations: 1) Release the throttle stick in normal flight, the drone brakes normally, 2) Click the big round button, the drone brakes urgently.
  • Normal flight function After the drone is connected to the handheld control device, it enters the flashlight mode by default. After automatic take-off, the user can control the drone to fly normally by manipulating the handheld control device. Among them, manipulating the roll attitude and yaw attitude of the handheld control device can control the UAV to deflect the nose direction; manipulating the pitch attitude and throttle of the handheld control device can control the up and down movement of the UAV, and the pitch attitude of the handheld control device can also be manipulated.
  • the gimbal can be controlled to move up and down to ensure that the user's viewing angle in the headset matches the direction the handheld control device is pointing.
  • Obstacle avoidance flight function In the normal flight of the flashlight mode, the obstacles in the environment will be sensed, and the flight speed will be planned to decelerate, so that the drone and the obstacle can keep a safe distance and prevent the drone from hitting obstacles and crowds. Keep drones and people safe.
  • APAS obstacle avoidance and detour function During the flight in flashlight mode, if the user chooses to turn on the APAS obstacle avoidance function, the drone will automatically plan a detour route when encountering an obstacle, avoid obstacles and fly freely, reducing the number of users. The difficulty of judging the safety of the flight environment increases the fun of flying in a complex environment.
  • Arbitrary position initialization attitude function The handheld control device does not have a fixed return position, which can be used by the user in any position in the space and in any attitude. Therefore, the handheld control device attitude initialization function at any position is designed.
  • the posture of the handheld control device will be reset to the center, and the drone will also brake to the center, which reduces the difficulty of the user using the handheld control device and optimizes the user. Flight experience in flashlight mode.
  • the mode key can be used to switch to head-chasing mode: if there is an attitude sensor (IMU/gyroscope) in the head-mounted device, changes in the head of the person can be sensed. After entering head-chasing mode, the gimbal of the drone will follow the attitude of the headset.
  • attitude sensor IMU/gyroscope
  • the drone is also capable of following the pose of the headset.
  • attitude sensors IMU/gyroscope
  • the drone and/or gimbal will follow the attitude of the headset.
  • the attitude adjustment of the gimbal is controlled by the attitude change of the head mounted device, for example, the x-axis of the head mounted device controls the pitch angle and yaw angle of the gimbal (same definition as the handheld control device).
  • the head-mounted device controls the gimbal orientation
  • the handheld control device controls the movement direction of the drone, which can realize functions such as surround shooting and so on.
  • the unique interactions on the headset in flashlight mode include the following: HOME point display: the drone will record the HOME point when it takes off, and the headset will display HOME when the drone deviates from the HOME point Point to guide the user to return home correctly.
  • the smart function prevent the user from being confused by not being able to control the drone and guide the user to use the buttons to operate the drone correctly.
  • the compass when the drone is under power, the compass needs to be calibrated, the temperature of the drone is too high, the motor is locked, and other abnormal states, the headset will be marked in red to remind the user to ensure flight safety.
  • a brake locking and unlocking prompt can be provided: During the flight, the user can press the brake button to make the drone quickly brake and hover, and at the same time lock the lever of the handheld control device, and cannot control the drone.
  • the wearable device prompts the user to lock the brakes. If the user wants to control the drone again, he needs to level the handheld control device, and press the brake button again to unlock the handheld control device. If the unlock fails, the headset will prompt the user to level the handheld control device.
  • a spectator mode can be provided: the drone can be connected to two headsets at the same time in flashlight mode, and the handheld control device is used to control the flying master headset, and the other is a slave headset. Control the drone, which is mainly used to act as the role of the audience's perspective and increase the fun of multi-person flight experience.
  • the drone in the flashlight mode, can be connected to two head-mounted devices at the same time, and each of the two head-mounted devices corresponds to a handheld control device.
  • the other handheld control device can be unlocked. Control the drone.
  • the control information of the unmanned aerial vehicle is determined according to the attitude information of the handheld control device by acquiring the attitude information of the handheld control device;
  • the control information is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the flight direction of the drone . It enables the user to control the drone by adjusting the posture of the handheld control device, which is in line with human intuition. By displaying the mark to indicate the flight direction of the drone, a more intuitive control experience can be brought to the user, making the flight control easier and safer.
  • the rotation of the handheld control device can be more intuitively transformed into the attitude control of the drone, so as to achieve the purpose of three-way interaction between the human-handheld control device and the drone.
  • the user can operate the drone with only one hand . It can convert body movements such as wrist rotation into adjustment instructions for the drone's attitude in a way that is in line with human intuition.
  • FIG. 14 is a schematic block diagram of a handheld control device 610 provided by an embodiment of the present application.
  • the handheld control device 610 includes, for example, a somatosensory remote controller, but is not limited to this.
  • the handheld control device 610 includes an attitude sensor 611 and a communication module 612 .
  • the attitude sensor 611 is used to acquire the attitude information of the handheld control device 610; the communication module 612 is used to send the attitude information of the handheld control device 610 to the drone, so that the drone can Control the attitude information of the device 610, determine the control information of the drone, and send the control information of the drone to the head-mounted device, so that the head-mounted device can be stored in the head-mounted device according to the control information of the drone.
  • the display module of the head mounted device displays a mark, and the mark is used to indicate the flight direction of the drone.
  • the drone may acquire attitude information sent by the handheld control device, determine the control information of the drone according to the attitude information of the handheld control device, perform corresponding actions according to the control information, and convert the drone's
  • the control information is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the flight direction of the drone .
  • the handheld control device includes a throttle control component.
  • the handheld control device further includes: one or more processors 613, working individually or collectively, for: obtaining a throttle stick amount based on the control of the throttle control component generated by the operation.
  • the communication module is further configured to send the throttle stick amount to the UAV, so that the UAV controls the UAV toward the direction indicated by the mark according to the throttle stick amount. flight direction flight.
  • the position of the drone remains unchanged.
  • the drone flies toward the flight direction indicated by the mark at a preset flight speed.
  • the increment of the flying speed of the drone gradually becomes larger.
  • the UAV includes a photographing device, and the photographing device is installed on the UAV through a pan/tilt;
  • the control information of the UAV includes UAV attitude control information and/or PTZ attitude control information.
  • the yaw attitude and/or roll attitude of the handheld control device is used to determine the yaw attitude of the UAV;
  • the pitch attitude of the handheld control device is used to determine the pitch attitude of the gimbal.
  • control information of the drone determined according to the yaw angle and/or the roll angle of the handheld control device is used to move the marker to the left or right;
  • Control information of the drone determined from the pitch angle of the handheld control device is used to move the marker up or down.
  • the control information of the UAV and/or the pan/tilt of the UAV turning right in the yaw direction is used to move the mark to the right.
  • control information of the UAV is determined according to the attitude information of the handheld control device and the reference attitude information of the handheld control device.
  • control information of the UAV includes the target yaw rate of the UAV
  • the target yaw rate of the UAV is determined according to the yaw angle of the handheld control device and the reference yaw angle of the handheld control device, or according to the roll angle of the handheld control device, the handheld control device
  • the reference roll angle is determined.
  • the control information of the UAV includes a target yaw angle: the target yaw angle is determined according to the yaw angle of the handheld control device, the reference yaw angle of the handheld control device, or is determined according to the yaw angle of the handheld control device.
  • the roll angle of the handheld control device and the reference roll angle of the handheld control device are determined.
  • the control information of the UAV includes a target yaw angle and a target yaw rate, and the target yaw angle is based on the yaw angle of the handheld control device and the reference yaw angle of the handheld control device.
  • the determined target yaw angle of the UAV; the target yaw angular velocity of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • the target yaw angle of the UAV and the target yaw rate of the UAV are used for:
  • the UAV is controlled to continue to rotate at the target yaw angle speed after rotating the target yaw angle.
  • the target yaw angle of the UAV and the target yaw rate of the UAV are used for:
  • the UAV is controlled to rotate at least the target yaw angle at the target yaw rate.
  • the target yaw angle of the UAV and the target yaw rate of the UAV are used for:
  • the control angle of the UAV in the yaw direction is determined.
  • the UAV includes a photographing device, and the photographing device is installed on the UAV through a pan/tilt;
  • the control information of the UAV including:
  • the target pitch angle of the gimbal is determined according to the pitch angle of the handheld control device and the reference pitch angle of the handheld control device.
  • the mark is used to indicate that the UAV is vertically lifted.
  • the processor is further configured to use the gesture information of the handheld control device when the initialization operation is triggered as the reference gesture information of the handheld control device.
  • the processor uses the gesture information of the handheld control device when the initialization operation is triggered as the reference gesture information of the handheld control device, it is used to:
  • the reference pitch angle and reference roll angle of the handheld control device are preset values.
  • the processor uses the gesture information of the handheld control device when the initialization operation is triggered as the reference gesture information of the handheld control device, it is used to:
  • the attitude information of the handheld control device When the attitude information of the handheld control device satisfies a preset condition when the initialization operation is triggered, the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device;
  • prompt information is output to prompt the user to adjust the posture of the handheld control device.
  • processor is also used for:
  • the drone When the drone takes off to a preset height above the ground, it is enabled to determine the control information of the drone according to the attitude information of the handheld control device.
  • processor is also used for:
  • the control information of the unmanned aerial vehicle can be determined according to the attitude information of the handheld control device.
  • the mark is a flight indicator mark
  • the communication module is further used for:
  • the posture information of the hand-held control device is sent to the head-mounted device, so that the head-mounted device can perform a
  • the display module of the head mounted device displays operation marks for operating the virtual control components on the display module.
  • FIG. 15 is a schematic block diagram of a handheld control device 620 provided by an embodiment of the present application.
  • the handheld control device 620 includes, for example, a somatosensory remote controller, but is not limited to this.
  • the handheld control device 620 includes a gesture sensor 621 , one or more processors 622 and a communication module 623 .
  • the attitude sensor 621 is used to obtain the attitude information of the handheld control device 620; one or more processors 622, working individually or together, are used to determine the The control information of the man-machine; the communication module 623 is used to send the control information of the drone to the head-mounted device, so that the head-mounted device can display on the head-mounted device according to the control information of the drone
  • the module displays indicia indicating the direction of flight of the drone.
  • the handheld control device obtains its own attitude information, determines the control information of the UAV according to the attitude information, and sends the control information of the UAV to the UAV so that the UAV performs the corresponding operation according to the control information. action, and send the control information of the drone to the head mounted device, so that the head mounted device displays a mark on the display module of the head mounted device according to the control information of the drone, and the mark Used to indicate the flight direction of the drone.
  • the control information of the drone determined by the handheld control device can be directly sent to the drone, or can be sent to the drone through a head-mounted device, and the transmission is more reliable.
  • the handheld control device includes a throttle control component
  • the processor is further configured to:
  • the throttle stick amount is generated based on the operation of the throttle control component
  • the communication module is further configured to send the throttle stick amount to the UAV, so that the UAV controls the UAV to fly toward the flight direction indicated by the mark according to the throttle stick amount.
  • the position of the drone remains unchanged.
  • the drone flies toward the flight direction indicated by the mark at a preset flight speed.
  • the increment of the flying speed of the drone gradually becomes larger.
  • the UAV includes a photographing device, and the photographing device is installed on the UAV through a pan/tilt;
  • the control information of the UAV includes UAV attitude control information and/or PTZ attitude control information.
  • the yaw attitude and/or roll attitude of the handheld control device is used to determine the yaw attitude of the UAV;
  • the pitch attitude of the handheld control device is used to determine the pitch attitude of the gimbal.
  • control information of the drone determined according to the yaw angle and/or the roll angle of the handheld control device is used to move the marker to the left or right;
  • Control information of the drone determined from the pitch angle of the handheld control device is used to move the marker up or down.
  • the control information of the UAV and/or the pan/tilt of the UAV turning right in the yaw direction is used to move the mark to the right.
  • the processor determines the control information of the unmanned aerial vehicle according to the attitude information of the handheld control device, it is used for:
  • the control information of the UAV is determined according to the attitude information of the handheld control device and the reference attitude information of the handheld control device.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the target yaw angular velocity of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the target yaw angle of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the target yaw angular velocity of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • the target yaw angle of the UAV and the target yaw rate of the UAV are used to: control the UAV to yaw at the target after rotating the target yaw angle.
  • the angular velocity continues to rotate.
  • the target yaw angle of the UAV and the target yaw angle velocity of the UAV are used to: control the UAV to rotate at least the target yaw angle at the target yaw angle speed.
  • the target yaw angle of the UAV and the target yaw rate of the UAV are used for: according to the integration of the target yaw angle and the target yaw rate over a preset time interval , and determine the control angle of the UAV in the yaw direction.
  • the UAV includes a photographing device, and the photographing device is installed on the UAV through a pan/tilt;
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, it is used for:
  • the target pitch angle of the gimbal is determined according to the pitch angle of the handheld control device and the reference pitch angle of the handheld control device.
  • the mark is used to indicate that the UAV is vertically lifted.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the control information of the UAV is determined according to the attitude information of the handheld control device, the reference attitude information of the handheld control device, and the reference attitude information of the UAV.
  • the processor acquires the reference attitude information of the handheld control device and the reference attitude information of the UAV, it is used for:
  • the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device, and the attitude information of the drone when the initialization operation is triggered is used as the reference attitude information of the drone.
  • the processor acquires the reference attitude information of the handheld control device and the reference attitude information of the UAV, it is used for:
  • the yaw angle of the handheld control device when the initialization operation is triggered is used as the reference yaw angle of the handheld control device, and the yaw angle of the UAV when the initialization operation is triggered is used as the reference yaw angle of the UAV. navigation angle;
  • the reference pitch angle and reference roll angle of the handheld control device are preset values.
  • the processor uses the attitude information of the handheld control device when the initialization operation is triggered as the reference attitude information of the handheld control device, and uses the attitude information of the drone when the initialization operation is triggered as the unmanned aerial vehicle.
  • the reference attitude information of the man-machine is used for:
  • the attitude information of the handheld control device When the attitude information of the handheld control device satisfies a preset condition when the initialization operation is triggered, the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device, and all When the initialization operation is triggered, the attitude information of the UAV is used as the reference attitude information of the UAV;
  • prompt information is output to prompt the user to adjust the posture of the handheld control device.
  • processor is also used for:
  • the drone When the drone takes off to a preset height above the ground, it is enabled to determine the control information of the drone according to the attitude information of the handheld control device.
  • processor is also used for:
  • the gimbal of the UAV is controlled to rotate downward by a preset angle in the pitch direction.
  • processor is also used for:
  • the control information of the unmanned aerial vehicle can be determined according to the attitude information of the handheld control device.
  • the mark is a flight indicator mark
  • the communication module is further used for:
  • the posture information of the hand-held control device is sent to the head-mounted device, so that the head-mounted device can perform a
  • the display module of the head mounted device displays operation marks for operating the virtual control components on the display module.
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the processor enables the processor to realize the unmanned aerial vehicle provided by the foregoing embodiments.
  • the steps of the control method are described in detail below.
  • the computer-readable storage medium may be an internal storage unit of the handheld control device described in any of the foregoing embodiments, such as a hard disk or a memory of the handheld control device.
  • the computer-readable storage medium may also be an external storage device of the handheld control device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital) equipped on the handheld control device , SD) card, flash memory card (Flash Card), etc.
  • FIG. 16 is a schematic block diagram of an unmanned aerial vehicle 700 provided by an embodiment of the present application.
  • the UAV 700 may be a rotary-wing UAV, such as a quad-rotor UAV, a hexa-rotor UAV, an octa-rotor UAV, or a fixed-wing UAV.
  • the drone 700 includes a first communication module 701 , one or more processors 702 , and a second communication module 703 .
  • the first communication module 701 is used to obtain the attitude information of the handheld control device; one or more processors 702 work individually or jointly to determine the UAV according to the attitude information of the handheld control device 700; the second communication module 703 is configured to send the control information of the drone 700 to the head mounted device, so that the The display module of the wearable device displays a mark, and the mark is used to indicate the flight direction of the drone 700 .
  • the first communication module 701 and the second communication module 703 may be different communication modules, or may be the same communication module, for example, may be integrated communication modules.
  • the drone may acquire attitude information sent by the handheld control device, determine the control information of the drone according to the attitude information of the handheld control device, perform corresponding actions according to the control information, and convert the drone's
  • the control information is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the flight direction of the drone .
  • the first communication module is further configured to:
  • the throttle stick amount being generated based on an operation of a throttle control component of the handheld control device
  • the processor is further configured to control the UAV to fly toward the flight direction indicated by the mark according to the amount of the throttle stick.
  • the position of the drone remains unchanged.
  • the drone flies toward the flight direction indicated by the mark at a preset flight speed.
  • the increment of the flying speed of the drone gradually becomes larger.
  • the drone includes a photographing device, and the second communication module is further configured to:
  • the image information captured by the photographing device is sent to the head-mounted device, so that the display module of the head-mounted device superimposes and displays the image information and the mark.
  • the photographing device is installed on the drone through a pan/tilt
  • the control information of the UAV includes UAV attitude control information and/or PTZ attitude control information.
  • the yaw attitude of the UAV is related to the yaw attitude and/or the roll attitude of the handheld control device; and/or
  • the pitch attitude of the gimbal is related to the pitch attitude of the handheld control device.
  • control information of the drone determined according to the yaw angle and/or the roll angle of the handheld control device is used to move the marker to the left or right;
  • Control information of the drone determined from the pitch angle of the handheld control device is used to move the marker up or down.
  • the control information of the UAV and/or the pan/tilt of the UAV turning right in the yaw direction is used to move the mark to the right.
  • the processor determines the control information of the unmanned aerial vehicle according to the attitude information of the handheld control device, it is used for:
  • the control information of the UAV is determined according to the attitude information of the handheld control device and the reference attitude information of the handheld control device.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the target yaw angular velocity of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the target yaw angle of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the target yaw angular velocity of the UAV is determined according to the roll angle of the handheld control device and the reference roll angle of the handheld control device.
  • processor is also used for:
  • the UAV is controlled to continue to rotate at the target yaw angle speed after rotating the target yaw angle.
  • processor is also used for:
  • the UAV is controlled to rotate at least the target yaw angle at the target yaw rate.
  • processor is also used for:
  • the control angle of the UAV in the yaw direction is determined.
  • the UAV includes a photographing device, and the photographing device is installed on the UAV through a pan/tilt;
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, it is used for:
  • the target pitch angle of the gimbal is determined according to the pitch angle of the handheld control device and the reference pitch angle of the handheld control device.
  • the mark is used to indicate that the UAV is vertically lifted.
  • the processor determines the control information of the UAV according to the attitude information of the handheld control device and the reference attitude information of the handheld control device, the processor is used for:
  • the control information of the UAV is determined according to the attitude information of the handheld control device, the reference attitude information of the handheld control device, and the reference attitude information of the UAV.
  • processor is also used for:
  • the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device, and the attitude information of the drone when the initialization operation is triggered is used as the reference attitude information of the drone.
  • the processor uses the attitude information of the handheld control device when the initialization operation is triggered as the reference attitude information of the handheld control device, and uses the attitude information of the drone when the initialization operation is triggered as the unmanned aerial vehicle.
  • the reference attitude information of the man-machine is used for:
  • the yaw angle of the handheld control device when the initialization operation is triggered is used as the reference yaw angle of the handheld control device, and the yaw angle of the UAV when the initialization operation is triggered is used as the reference yaw angle of the UAV. navigation angle;
  • the reference pitch angle and reference roll angle of the handheld control device are preset values.
  • the processor uses the attitude information of the handheld control device when the initialization operation is triggered as the reference attitude information of the handheld control device, and uses the attitude information of the drone when the initialization operation is triggered as the unmanned aerial vehicle.
  • the reference attitude information of the man-machine is used for:
  • the attitude information of the handheld control device When the attitude information of the handheld control device satisfies a preset condition when the initialization operation is triggered, the attitude information of the handheld control device when the initialization operation is triggered is used as the reference attitude information of the handheld control device, and the When the initialization operation is triggered, the attitude information of the UAV is used as the reference attitude information of the UAV;
  • prompt information is output to prompt the user to adjust the posture of the handheld control device.
  • processor is also used for:
  • the drone When the drone takes off to a preset height above the ground, it is enabled to determine the control information of the drone according to the attitude information of the handheld control device.
  • processor is also used for:
  • the gimbal of the UAV is controlled to rotate downward by a preset angle in the pitch direction.
  • processor is also used for:
  • the control information of the unmanned aerial vehicle can be determined according to the attitude information of the handheld control device.
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, the computer program includes program instructions, and when the computer program is executed by a processor, the processor implements the The steps of the UAV control method provided by the above embodiments.
  • the computer-readable storage medium may be the internal storage unit of the UAV described in any of the foregoing embodiments, such as a hard disk or a memory of the UAV.
  • the computer-readable storage medium can also be an external storage device of the drone, such as a plug-in hard disk equipped on the drone, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc.
  • FIG. 17 is a schematic block diagram of a head mounted device 810 provided by an embodiment of the present application.
  • the head mounted device 810 may be flying glasses, such as First Person View (FPV, First Person View) glasses.
  • FV First Person View
  • the headset 810 includes a communication module 811 and one or more processors 812 .
  • the communication module 811 is used to obtain the control information of the UAV, and the control information of the UAV is determined according to the attitude information of the handheld control device; one or more processors 812, working individually or together, use A mark is displayed on the display module of the head mounted device 810 according to the control information of the drone, and the mark is used to indicate the flight direction of the drone.
  • the drone may acquire attitude information sent by the handheld control device, determine the control information of the drone according to the attitude information of the handheld control device, perform corresponding actions according to the control information, and convert the drone's
  • the control information is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the flight direction of the drone .
  • the handheld control device obtains its own attitude information, determines the control information of the UAV according to the attitude information, and sends the control information of the UAV to the UAV so that the UAV performs the corresponding operation according to the control information. action, and send the control information of the drone to the head mounted device, so that the head mounted device displays a mark on the display module of the head mounted device according to the control information of the drone, and the mark Used to indicate the flight direction of the drone.
  • the processor 812 when the processor 812 displays a mark on the display module of the head mounted device 810 according to the control information of the drone, the processor 812 is configured to display the mark according to the control information of the drone, the display module The display parameter calculates the pixel coordinates of the mark on the display module, so as to display the mark on the display module.
  • the display parameters include a screen ratio and a resolution of the display module.
  • FIG. 18 is a schematic block diagram of a head mounted device 820 provided by an embodiment of the present application.
  • the head mounted device 820 may be flying glasses, such as First Person View (FPV, First Person View) glasses.
  • FV First Person View
  • the headset 820 includes a communication module 821 and one or more processors 822 .
  • the communication module 821 is used to obtain the gesture information of the handheld control device; one or more processors 822, working individually or jointly, are used for displaying on the head mounted device 820 according to the gesture information of the handheld control device
  • the module displays indicia indicating the direction of flight of the drone.
  • the processor when the processor displays a mark on the display module of the head mounted device 820 according to the gesture information of the handheld control device, the processor is configured to, according to the gesture information of the handheld control device, the display module The display parameter calculates the pixel coordinates of the marker on the display module so as to display the marker on the display module.
  • the display parameters include a screen ratio and a resolution of the display module.
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the processor enables the processor to realize the unmanned aerial vehicle provided by the above embodiments.
  • the steps of the control method are described in detail below.
  • the computer-readable storage medium may be an internal storage unit of the head mounted device described in any of the foregoing embodiments, such as a hard disk or a memory of the head mounted device.
  • the computer-readable storage medium may also be an external storage device of the head-mounted device, such as a plug-in hard disk equipped on the head-mounted device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital) , SD) card, flash memory card (Flash Card), etc.
  • FIG. 19 is a schematic flowchart of a control method for an unmanned aerial vehicle provided by an embodiment of the present application.
  • control method of the drone can be used for a head-mounted device.
  • the control method of the UAV includes steps S210 to S220.
  • control information of the UAV includes the target yaw angle of the UAV and/or the target yaw rate of the UAV; wherein the target yaw angle of the UAV is used for
  • the drone is controlled to rotate at the target yaw angle in the yaw direction, and the target yaw angular velocity is used to control the drone to rotate at the target yaw angular velocity in the yaw direction.
  • the displaying a mark on the display module of the head-mounted device according to the control information of the drone includes: calculating the mark according to the control information of the drone and a display parameter of the display module. Pixel coordinates on the display module to display indicia on the display module.
  • the display parameters include a screen ratio and a resolution of the display module.
  • FIG. 20 is a schematic flowchart of a control method for an unmanned aerial vehicle provided by an embodiment of the present application.
  • control method of the drone can be used for a head-mounted device.
  • the control method of the UAV includes steps S310 to S320.
  • attitude information of the handheld control device where the attitude information of the handheld control device is used to determine the control information of the UAV, and the control information of the UAV is used to adjust the attitude or adjustment of the UAV The attitude of the gimbal of the UAV.
  • control information of the UAV includes the target yaw angle of the UAV and/or the target yaw rate of the UAV; wherein the target yaw angle of the UAV is used for
  • the drone is controlled to rotate at the target yaw angle in the yaw direction, and the target yaw angular velocity is used to control the drone to rotate at the target yaw angular velocity in the yaw direction.
  • the displaying a mark on the display module of the head-mounted device according to the control information of the drone includes: calculating the mark according to the control information of the drone and a display parameter of the display module. Pixel coordinates on the display module to display indicia on the display module.
  • the display parameters include a screen ratio and a resolution of the display module.
  • FIG. 2 is a schematic structural diagram of a control system of an unmanned aerial vehicle provided by an embodiment of the present application.
  • the control system of the drone includes a handheld control device, a drone, and a headset.
  • the communication connection between the handheld control device, the drone and the head-mounted device in FIG. 2 is only one embodiment.
  • the handheld control device can communicate with the drone through the head-mounted device. connection, or the headset can communicate with the drone via a handheld control device.
  • the handheld control device and the headset may be communicatively connected to the drone through a relay device.
  • the UAV may be a rotary-wing UAV, such as a quad-rotor UAV, a hexa-rotor UAV, an octa-rotor UAV, or a fixed-wing UAV.
  • the head mounted device may be flying glasses, for example, First Person View (FPV, First Person View) glasses.
  • the handheld control device includes, for example, a somatosensory remote control.
  • the handheld control device is used to obtain the attitude information of the handheld control device, and the attitude information is used to determine the control information of the drone; the drone is used to adjust the unmanned aerial vehicle according to the control information of the drone The attitude of the drone or the attitude of the gimbal of the drone is adjusted; the head-mounted device is used to display a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the Describe the flight direction of the drone.
  • the UAV can acquire attitude information sent by the handheld control device, determine the control information of the UAV according to the attitude information of the handheld control device, perform corresponding actions according to the control information, and transfer the UAV to the unmanned aerial vehicle.
  • the control information of the drone is sent to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, and the mark is used to indicate the control information of the drone. flight direction.
  • the handheld control device obtains its own attitude information, determines the control information of the UAV according to the attitude information, and sends the control information of the UAV to the UAV so that the UAV can control the UAV according to the control information. information to perform a corresponding action, and send the control information of the drone to the head-mounted device, so that the head-mounted device displays a mark on the display module of the head-mounted device according to the control information of the drone, The marks are used to indicate the flight direction of the drone.
  • the control information of the drone determined by the handheld control device can be directly sent to the drone, or can be sent to the drone through a head-mounted device, and the transmission is more reliable.
  • the unmanned aerial vehicle and its control method, system, handheld control device, head-mounted device, and computer-readable storage medium provided in the embodiments of the present application, by acquiring the attitude information of the handheld control device, according to the attitude information of the handheld control device, determining the control information of the drone; and sending the control information of the drone to the head-mounted device, so that the head-mounted device can display on the head-mounted device according to the control information of the drone
  • the module displays indicia indicating the direction of flight of the drone. It enables the user to control the drone by adjusting the posture of the handheld control device, which is in line with human intuition. By displaying the mark to indicate the flight direction of the drone, a more intuitive control experience can be brought to the user, making the flight control easier and safer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

一种无人机的控制方法,包括:获取手持控制设备的姿态信息(S110);根据手持控制设备的姿态信息,确定无人机的控制信息(S120);将无人机的控制信息发送给头戴设备,以使得头戴设备根据无人机的控制信息在头戴设备的显示模块显示标记,标记用于指示无人机的飞行方向(S130)。该控制方法能够使得无人机的飞行操纵更加容易和安全。还提供了手持控制设备、无人机及其控制系统、头戴设备和存储介质。

Description

无人机及其控制方法、系统、手持控制设备、头戴设备 技术领域
本申请涉及无人机技术领域,尤其涉及一种无人机及其控制方法、系统、手持控制设备、头戴设备和存储介质。
背景技术
无人机,在航拍、巡检、森林防护、灾情勘察及农药喷洒等场景,得到了广泛应用,但是现有的操作员对于无人机的控制,主要是通过遥控器的摇杆进行,控制方法单一,用户体验不好。
发明内容
本申请提供了一种无人机及其控制方法、系统、手持控制设备、头戴设备和存储介质,使得无人机的飞行操纵更加容易和安全。
第一方面,本申请实施例提供了一种无人机的控制方法,所述方法包括:
获取手持控制设备的姿态信息;
根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;
将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第二方面,本申请实施例提供了一种手持控制设备,所述手持控制设备包括:
姿态传感器,用于获取所述手持控制设备的姿态信息;
通信模块,用于将所述手持控制设备的姿态信息发送给无人机,以使得所述无人机根据所述手持控制设备的姿态信息,确定所述无人机的控制信息,并将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人 机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第三方面,本申请实施例提供了一种手持控制设备,所述手持控制设备包括:
姿态传感器,用于获取所述手持控制设备的姿态信息;
一个或多个处理器,单独地或共同地工作,用于根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;
通信模块,用于将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第四方面,本申请实施例提供了一种无人机,所述无人机包括:
第一通信模块,用于获取手持控制设备的姿态信息;
一个或多个处理器,单独地或共同地工作,用于根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;
第二通信模块,用于将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第五方面,本申请实施例提供了一种无人机的控制方法,所述方法包括:
获取无人机的控制信息,所述无人机的控制信息是根据手持控制设备的姿态信息确定的,所述无人机的控制信息用于调整所述无人机的姿态或者调整所述无人机的云台的姿态;
根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第六方面,本申请实施例提供了一种头戴设备,所述头戴设备包括:
通信模块,用于获取无人机的控制信息,所述无人机的控制信息是根据手持控制设备的姿态信息确定的;
一个或多个处理器,单独地或共同地工作,用于根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第七方面,本申请实施例提供了一种无人机的控制方法,所述方法包括:
获取手持控制设备的姿态信息,所述手持控制设备的姿态信息用于确定所述无人机的控制信息,所述无人机的控制信息用于调整所述无人机的姿态或者调整所述无人机的云台的姿态;
根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第八方面,本申请实施例提供了一种头戴设备,所述头戴设备包括:
通信模块,用于获取手持控制设备的姿态信息;
一个或多个处理器,单独地或共同地工作,用于根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第九方面,本申请实施例提供了一种无人机的控制系统,所述控制系统包括:
手持控制设备,用于获取所述手持控制设备的姿态信息,所述姿态信息用于确定无人机的控制信息;
无人机,用于根据所述无人机的控制信息调整所述无人机的姿态或者调整所述无人机的云台的姿态;
头戴设备,用于根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
第十方面,本申请实施例提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现上述的方法。
本申请实施例提供了一种无人机及其控制方法、系统、手持控制设备、头戴设备和存储介质,通过获取手持控制设备的姿态信息,根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。使得用户可以通过调整手持控制设备的姿态来控制无人机,符合人类直觉。通过显示标记指示所述无人机的飞行方向,能够带给用户更直观的操控体验,使得飞行操纵更加容易和安全。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的, 并不能限制本申请实施例的公开内容。
附图说明
为了更清楚地说明本申请实施例的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种无人机的控制方法的流程示意图;
图2是一实施方式中无人机、手持控制设备、头戴设备通信连接的示意图;
图3是一实施方式中手持控制设备的结构示意图;
图4是一实施方式中手持控制设备的坐标系的示意图;
图5是一实施方式中手持控制设备在Yaw方向调整姿态的示意图;
图6是一实施方式中手持控制设备在Roll方向调整姿态的示意图;
图7是一实施方式中手持控制设备在Pitch方向调整姿态的示意图;
图8是一实施方式中根据手持控制设备的Yaw角确定无人机在Yaw方向上转动的示意图;
图9是一实施方式中根据手持控制设备的Roll角确定无人机在Yaw方向上转动的示意图;
图10是一实施方式中根据手持控制设备的Pitch角确定无人机的云台在Pitch方向上转动的示意图;
图11是一实施方式中控制无人机朝向标记指示的飞行方向飞行的示意图;
图12是一实施方式中手持控制设备控制无人机时的速度映射示意图;
图13是一实施方式中无人机控制过程的示意图;
图14是本申请一实施例提供的一种手持控制设备的示意性框图;
图15是本申请另一实施例提供的一种手持控制设备的示意性框图;
图16是本申请实施例提供的一种无人机的示意性框图;
图17是本申请一实施例提供的一种头戴设备的示意性框图;
图18是本申请另一实施例提供的一种头戴设备的示意性框图;
图19是本申请另一实施例提供的一种无人机的控制方法的流程示意图;
图20是本申请又一实施例提供的一种无人机的控制方法的流程示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
附图中所示的流程图仅是示例说明,不是必须包括所有的内容和操作/步骤,也不是必须按所描述的顺序执行。例如,有的操作/步骤还可以分解、组合或部分合并,因此实际执行的顺序有可能根据实际情况改变。
下面结合附图,对本申请的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。
请参阅图1,图1是本申请实施例提供的一种无人机的控制方法的流程示意图。如图2是该控制方法的应用场景的示意图。
如图2所示,无人机控制系统包括无人机、手持控制设备和头戴设备。
所述无人机的控制方法可以应用在无人机或者手持控制设备,用于根据手持控制设备的姿态信息控制无人机等过程。
在一些实施方式中,无人机的控制方法应用在无人机。无人机可以获取手持控制设备发送的姿态信息,根据手持控制设备的姿态信息确定所述无人机的控制信息,根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在一些实施方式中,无人机的控制方法应用在手持控制设备。手持控制设备获取自身的姿态信息,根据姿态信息确定所述无人机的控制信息,将所述无人机的控制信息发送给无人机以使无人机根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在其他一些实施方式中,无人机的控制方法可以应用在头戴设备。例如头 戴设备可以获取手持控制设备发送的姿态信息,根据手持控制设备的姿态信息确定所述无人机的控制信息,以及将所述无人机的控制信息发送给无人机,以使无人机根据控制信息执行对应的动作,头戴设备还可以根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
通过在所述头戴设备的显示模块显示标记指示所述无人机的飞行方向,用户更加容易熟悉通过手持控制设备控制无人机飞行。
在一些实施方式中,无人机包括拍摄设备。无人机可以将所述拍摄设备拍摄得到的图像信息发送给所述头戴设备,以使的所述头戴设备的显示模块叠加显示所述图像信息和所述标记。用户可以直观的从头戴设备的显示模块上看到飞行方向对应的景物,从而预判拍摄效果和碰撞风险。通过在头戴设备的显示模块显示无人机回传给头戴设备的图像,即图传画面,用户在佩戴头戴设备控制无人机飞行时,能够在自己视野范围内控制无人机的运动方向,控制更加直观。有鸟儿飞行一般的体验。
示例性的,手持控制设备的姿态信息可以直接发给无人机,如图2所示,通过与所述无人机之间的信道将所述姿态信息发送给所述无人机。
可以理解的,图2中手持控制设备、无人机和头戴设备之间的通信连接仅为一种实施方式,在另一些实施方式中,手持控制设备可以通过头戴设备与无人机通信连接,或者头戴设备可以通过手持控制设备与无人机通信连接。在其他一些实施方式中,手持控制设备和头戴设备可以通过中继设备与无人机通信连接。
示例性的,手持控制设备的姿态信息可以通过头戴设备发给无人机,例如手持控制设备在连上头戴设备时,手持控制设备的姿态信息先发给头戴设备,再由头戴设备转发给无人机,可以通过头戴设备与无人机之间的信道传输姿态信息,该信道具有高增益,传输更可靠。
示例性的,手持控制设备确定的无人机的控制信息可以直接发给无人机,或者为可以通过头戴设备发给无人机,传输更可靠。
其中,无人机可以为旋翼型无人机,例如四旋翼无人机、六旋翼无人机、八旋翼无人机,也可以是固定翼无人机。头戴设备可以为飞行眼镜,例如为第一视角(FPV,First Person View)眼镜。
手持控制设备例如包括体感遥控器。在一实施方式中,如图3所示,手持控制设备包括多个按键,以及油门控制部件11,其中按键例如包括加解锁(Lock)键12、档位按键13、急停(刹车)按键14。可以理解的,不同功能对应的按键和/或按键的功能触发逻辑可以根据实际情况设置。
示例性的,油门控制部件例如包括可拉动的油门杆,当然也可以包括其他形式的控制部件,如旋钮、扳机等。用户通过改变手持控制设备的姿态、操作手持控制设备的按键、油门控制部件可以实现对无人机的飞行控制。
示例性的,手持控制设备包括传感器,手持控制设备的传感器用于采集手持控制设备的姿态信息,该姿态信息包括体感传感器的俯仰角、偏航角、横滚角、水平方式的移动速度、垂直方向的移动速度、离地高度中的至少一项。举例而言,手持控制设备的传感器可以包括惯性测量单元(Inertial Measurement Unit,IMU)、指南针、重力传感器、距离传感器的至少一项。
在一些实施方式中,手持控制设备、头戴设备和无人机之间通过无线信道传输数据。
示例性的,如图2所示,从无人机到手持控制设备、头戴设备的无线信道,称为下行信道,用于传输无人机采集到的数据,例如视频、图片、传感器数据、以及无人机的状态信息(OSD)等遥测数据。
示例性的,如图2所示,从手持控制设备、头戴设备到无人机的无线信道,称为上行信道,用于传输遥控数据;例如上行信道用于传输飞控指令以及拍照、录像、返航等控制指令。
如图1所示,本申请实施例的无人机的控制方法包括步骤S110至步骤S130。
S110、获取手持控制设备的姿态信息。
示例性的,根据手持控制设备自身的三轴加速度信号和角速度信号,通过融合算法可以得到手持控制设备的姿态信息,手持控制设备的姿态信息例如包括手持控制设备自身相对于大地坐标系的转动四元数。
示例性的,所述手持控制设备的姿态信息包括北东地坐标系下的姿态信息,可选的,也可以是其他坐标系,如东北天坐标系。
在一些实施方式中,手持控制设备对应的坐标系如图4所示。如图4所示,手持控制设备的下方为Z轴方向,右侧为Y轴方向,前方为X轴方向。
示例性的,如图5所示,手持控制设备绕Z轴转动时可以称为在Yaw(偏 航)方向调整姿态;如图6所示,手持控制设备绕X轴转动时可以称为在Roll(翻滚)方向调整姿态,如图7所示,手持控制设备绕Y轴转动时可以称为在Pitch(俯仰)方向调整姿态。
示例性的,手持控制设备绕Z轴转动的角度可以称为Yaw角,绕Y轴转动的角度可以称为Pitch角,绕X轴转动的角度可以称为Roll角。在一些实施方式中,手持控制设备的姿态信息包括Yaw角、Roll角、Pitch角中的至少一项。可以理解的,手持控制设备的姿态调整可以分解为个方向上的转动,因此可以确定手持控制设备的Yaw角、Roll角和Pitch角。
S120、根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,可以根据手持控制设备在各个方向上的姿态调整角度确定无人机的控制信息,无人机的控制信息用于控制无人机调整无人机的机体的姿态和/或无人机搭载的云台的姿态。
示例性的,如图8所示,根据手持控制设备的Yaw角确定的控制信息用于控制无人机在Yaw方向上转动。当然也不限于此。如图9所示,根据手持控制设备的Roll角确定的控制信息也可以用于控制无人机在Yaw方向上转动。如图10所示,根据手持控制设备的Pitch角确定的控制信息也可以用于控制无人机的云台在Pitch方向上的转动。
S130、将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在一些实施方式中,如图8和图9所示,在无人机的控制信息用于指示无人机向左或向右运动(在Yaw方向上转动)时,标记21向左或向右移动,在显示模块的横向方向上偏离中央位置;如图10所示,在无人机的控制信息用于指示无人机的云台做俯仰运动(在pitch方向上转动)时,标记21向上或向下移动,在显示模块的垂直方向上偏离中央位置;在无人机的控制信息用于指示无人机保持姿态不变时,所述标记在所述显示模块的显示界面的预设位置显示,举例而言,所述预设位置位于所述显示界面的正中间。从而可以实现例如用户将手持控制设备指向哪里,在对手持控制设备的油门控制部件进行操作时,无人机就飞向哪里的效果,用户更加容易熟悉通过手持控制设备控制无人机飞行。
通过在头戴设备的显示模块显示标记,指示所述无人机的飞行方向,能够 带给用户更直观的操控体验。用户通过调整手持控制设备的姿态,可以调整该标记在显示模块中的显示位置,该标记可以显示模块上指示未来无人机的运动方向,使得飞行操纵更加容易和安全。
示例性的,当手持控制设备的前方为X轴方向时,可以根据手持控制设备的X轴方向指示无人机的运动方向。可以理解的,X轴方向可以作为“手电筒”发出的光线指示无人机的运动方向,因此根据手持控制设备的姿态信息控制无人机的运动方向,可以称为手电筒模式。
在一些实施方式中,所述无人机包括拍摄设备。
示例性的,所述方法还包括:将所述拍摄设备拍摄得到的图像信息发送给所述头戴设备,以使的所述头戴设备的显示模块叠加显示所述图像信息和所述标记。用户可以直观的从头戴设备的显示模块上看到飞行方向对应的景物,从而预判拍摄效果和碰撞风险。通过在头戴设备的显示模块显示无人机回传给头戴设备的图像,即图传画面,用户在佩戴头戴设备控制无人机飞行时,能够在自己视野范围内控制无人机的运动方向,控制更加直观。有鸟儿飞行一般的体验。
示例性的,所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,包括:所述头戴设备根据所述无人机的控制信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
示例性的,无人机的控制信息指示的无人机的姿态变化幅度越大,则所述显示模块显示的标记偏离预设位置的距离越大。因此显示模块显示的标记可以体现无人机的姿态变化幅度,便于向用户反馈无人机的飞行方向。
示例性的,所述显示参数包括所述显示模块的画面比例和分辨率。因此可以与不同规格的显示模块适配,更准确的指示所述无人机的飞行方向。
在一些实施方式中,所述拍摄设备通过云台安装于所述无人机。根据所述手持控制设备的姿态信息,可以调整无人机和/或云台的姿态,从而可以调整拍摄设备的拍摄方向,便于用户在头戴设备的显示模块观察拍摄方向对应视场的景物。
示例性的,无人机搭载的云台也可以跟随手持控制设备姿态的调整而转动,可以使得无人机的飞行方向和显示模块显示的所述标记在头戴设备的视野中。
在一些实施方式中,发送给所述头戴设备的控制信息是大地坐标系、无人机的机体坐标系或者云台坐标系下的控制信息,以使得所述头戴设备将所述控制信息映射为拍摄设备的相机坐标系下的控制信息,以及根据所述相机坐标系下的控制信息显示所述标记。
示例性的,所述方法还包括:将所述无人机的位置和方向、所述无人机与所述云台的相对位置和姿态和/或所述云台和所述拍摄设备之间的相对位置和姿态发送给所述头戴设备,以便所述头戴设备将大地坐标系、无人机的机体坐标系或者云台坐标系下的映射为所述拍摄设备的相机坐标系下的控制信息。
示例性的,所述将大地坐标系下的控制信息映射到拍摄设备对应的相机坐标系包括:将大地坐标系下的控制信息映射到无人机机体坐标系(根据无人机的位置和方向);将机体坐标系下的控制信息映射到云台坐标系下(根据无人机与云台的相对位置和姿态,相对位置可以是固定的,姿态可以由无人机与云台上的传感器检测计算得到;将云台坐标系下的控制信息映射到相机坐标系下(根据云台和拍摄设备之间的相对位置和姿态,位置可以是固定的,姿态可以由云台控制量得到)。
示例性的,无人机的位置和方向、无人机与云台的相对位置和姿态、云台和拍摄设备之间的相对位置和姿态可以由无人机发送给头戴设备,以便头戴设备进行控制信息的映射。
在一些实施方式中,无人机也可以直接给头戴设备传输相机坐标系下的控制信息,这样无人机的位置和方向、无人机与云台的相对位置和姿态、云台和拍摄设备之间的相对位置和姿态可以不用传输。
示例性的,所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。示例性的,无人机的控制信息用于指示无人机的机体和/或云台的姿态调整的角度和/或角速度。例如,无人机的控制信息用于调整无人机的机体的Yaw角度或机体在Yaw方向上转动的角速度,或者用于调整无人机的云台的Pitch角度或云台在Pitch方向上转动的角速度。当然也不限于此。
在一些实施方式中,所述无人机的偏航姿态与所述手持控制设备的偏航姿态和/或横滚姿态有关。无人机的偏航姿态可以调整无人机的航向,手持控制设备在Yaw方向和/或Roll方向调整姿态时可以调整无人机的航向。
示例性的,如图5所示,在水平方向上向左或向右转动手持控制设备时, 无人机的飞行方向可以跟随手持控制设备在水平方向上的转动而变化,例如可以与手持控制设备的X轴方向保持一致。头戴设备的显示模块显示的标记向左或向右移动,拍摄装置的方向也相应变化,头戴设备的显示模块显示的所述图像信息也相应变化。
示例性的,如图6所示,在竖直方向向左或向右倾斜转动手持控制设备时,无人机的飞行方向可以跟随手持控制设备在竖直方向上的转动而变化。例如,手持控制设备在竖直方向向左倾斜转动时,无人机逆时针旋转,头戴设备的显示模块显示的标记向左移动;手持控制设备在竖直方向向右倾斜转动时,无人机顺时针旋转,头戴设备的显示模块显示的标记向右移动;手持控制设备未在竖直方向倾斜转动时,无人机可以不在水平方向上旋转。
示例性的,根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动。所述标记的移动方向与手持控制设备姿态调整方向的关系,更符合用户的操作习惯,更直观简便。
示例性的,如图8和图9所示,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。所述标记的移动方向可以更好的反映无人机和/或所述无人机的云台的姿态调整方向,更符合用户的操作习惯,更直观。
在一些实施方式中,所述云台的俯仰姿态与所述手持控制设备的俯仰姿态有关。
在一些实施方式中,云台能够在Pitch方向转动。所述控制信息包括云台控制信息和无人机控制信息中的至少一个。示例性的,如图10所示,手持控制设备在Pitch方向调整姿态时,云台控制信息能够控制无人机的云台带动拍摄装置在Pitch方向调整姿态,头戴设备的显示模块显示的标记向上或向下移动,例如在显示模块的垂直方向上偏离中央位置。示例性的,如图8和图9所示,手持控制设备在Yaw方向和/或Roll方向调整姿态时,无人机带动拍摄设备在Yaw方向和/或Roll方向调整姿态,头戴设备的显示模块显示的标记向左或向右移动,例如在显示模块的横向方向上偏离中央位置。
在另一些实施方式中,云台能够在Pitch方向、Roll方向、Yaw方向上转动。
示例性的,云台在Pitch方向、Roll方向、Yaw方向各方向转动时具有对应的限位范围。
示例性的,若根据所述姿态信息确定的所述无人机的转动角度处于所述云台的限位范围内,所述控制信息用于控制所述无人机调整所述云台的姿态。
示例性的,若所述无人机的控制信息对应的转动角度在云台限位范围内,则所述控制信息包括云台控制信息。示例性的,若所述无人机的控制信息对应的转动角度在云台限位范围内,手持控制设备在Pitch方向调整姿态时,无人机的云台带动拍摄设备在Pitch方向调整姿态,头戴设备的显示模块显示的标记向上或向下移动;手持控制设备在Yaw方向和/或Roll方向调整姿态时,无人机的云台带动拍摄设备在Yaw方向上调整姿态,头戴设备的显示模块显示的标记向左或向右移动。示例性的,若所述无人机的控制信息对应的转动角度在云台限位范围内,手持控制设备在Roll方向调整姿态而在Yaw方向未调整姿态时,无人机的云台带动拍摄设备在Roll方向调整姿态,头戴设备的显示模块显示的标记可以不向左或向右移动。
示例性的,若根据所述姿态信息确定的所述无人机的转动角度处于所述云台的限位范围外,所述控制信息用于控制所述无人机调整所述云台的姿态和所述无人机的机体的姿态。
示例性的,若所述无人机的控制信息对应的转动角度在云台限位范围外,则所述控制信息还包括无人机控制信息。示例性的,所述无人机的控制信息对应的转动角度在云台限位范围外的部分角度可以用于控制无人机调整姿态。例如手持控制设备在Yaw方向和/或Roll方向调整姿态,使得所述控制信息对应的Yaw方向的转动角度超出云台在Yaw方向的限位范围,则所述控制信息还控制无人机的机体在Yaw方向调整姿态,以及头戴设备的显示模块显示的标记向左或向右移动。
示例性的,如图10所示,根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。所述标记的移动方向与手持控制设备姿态调整方向的关系,更符合用户的操作习惯,更直观简便。
示例性的,如图10所示,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标 记向下移动。所述标记的移动方向可以更好的反映无人机和/或所述无人机的云台的姿态调整方向,更符合用户的操作习惯,更直观。
在一些实施方式中,所述根据所述手持控制设备的姿态信息,确定所述无人机的控制信息,包括:获取所述手持控制设备的参考姿态信息,以及根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息。
示例性的,手持控制设备的参考姿态信息对应的姿态也可以成为手持控制设备的初始姿态,或者可以称为手持控制设备的零位。
在一些实施方式中,可以根据手持控制设备的当前姿态和手持控制设备的初始姿态的差确定无人机的控制信息,即根据手持控制设备相对于初始姿态的相对姿态确定无人机的控制信息。例如根据手持控制设备的当前转动四元数和初始姿态对应的转动四元数确定相对四元数。相对四元数可以映射到任何想要的旋转系统,例如转化到欧拉角,还可以根据不同需求调整转序等。
示例性的,手持控制设备的初始姿态可以为预设的姿态,例如为用户自然手持该手持控制设备时手持控制设备的姿态。或者可以在某一时刻将手持控制设备的当前姿态初始化确定为手持控制设备的初始姿态。
在一些实施方式中,所述获取所述手持控制设备的参考姿态信息,包括:将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息。
示例性的,进行初始化操作时,将手持控制设备的当前姿态确定为手持控制设备的初始姿态。
示例性的,初始化操作可以由用户触发。例如,用户在可以在任意时刻,任意位置触发(如按下手持控制设备上的相应按键)手持控制设备根据手持控制设备当前的姿态确定手持控制设备的参考姿态信息。例如,用户可以按下手持控制设备上的急停按键使无人机停止飞行而保持悬停,在用户再次按下急停按键使无人机能够飞行时,手持控制设备可以根据当前的姿态确定持控制设备的参考姿态信息。
示例性的,初始化操作可以在无人机自动起飞完成时自动触发。
示例性的,初始化操作也可以由无人机的飞行状态触发。例如在无人机从起飞到预设高度悬停时,可以根据手持控制设备当前的姿态确定持控制设备的 参考姿态信息。可以防止手持控制设备的初始姿态未初始化时导致无人机误动作。
示例性的,初始化操作也可以由手持控制设备与无人机的通信连接状态触发。例如在手持控制设备与无人机通信连接预设时长时,可以根据手持控制设备当前的姿态确定持控制设备的参考姿态信息。可以防止手持控制设备的初始姿态未初始化时导致无人机误动作。当然也不限于此。
示例性的,当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
示例性的,在所述手持控制设备的当前姿态处于预设范围内时,使能初始化所述手持控制设备的初始姿态。例如,在手持控制设备当前的Yaw角、Roll角、Pitch角处于对应的预设范围内时,若所述初始化操作触发,则将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。可以避免用户定义了一个异常的姿态作为手持控制设备的零位,即初始姿态,不利于后续通过调整手势控制设备的姿态控制无人机的飞行方向。
示例性的,当所述初始化操作触发时所述手持控制设备的姿态信息不满足预设条件时,输出提示信息以提示用户调整所述手持控制设备的姿态。例如,在手持控制设备当前的Yaw角、Roll角或Pitch角未处于对应的预设范围内时,输出提示信息。
示例性的,在所述手持控制设备的当前姿态未处于所述预设范围内时,若检测到用户的初始化触发操作,输出提示信息,所述提示信息用于提示当前不能初始化所述手持控制设备的初始姿态和/或提示调整所述手持控制设备的当前姿态。
示例性的,所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值,即手持式控制设备的在Roll方向上的零位、在Pitch方向上的零位为预设值,例如为用户自然手持该手持控制设备时手持控制设备在Roll方向上的角度和在Pitch方向上的角度。可以防止在无人机从起飞到悬停过程中用户操作手持控制设备在一个异常的姿态,比如在Roll方向上偏转90度,使得参考俯仰角度、参考横滚角度过大,用户端平手持式控制设备,即自然手持该手持控制设 备时无人机在Roll方向上、Pitch方向上异常转动。
示例性的,所述手持控制设备的当前姿态为所述手持控制设备的参考姿态信息对应的姿态时,所述标记在所述显示模块的显示界面的预设位置显示。举例而言,所述预设位置位于所述显示界面的正中间。显示设备上显示的所述标记可以更准确的指示所述无人机的飞行方向。
示例性的,所述手持控制设备的偏航角度和/或横滚角度为零,且所述俯仰角度为零时,所述标记在所述显示模块的显示界面的预设位置显示。
在一些实施方式中,可以根据所述手持控制设备的姿态信息确定所述无人机进行姿态调整的目标角速度。可以理解的,在该实施方式中,可以不确定无人机的参考姿态,即无人机的初始姿态,无人机可以根据目标角速度转动而进行姿态调整。
示例性的,可以根据所述手持控制设备的偏航角度、俯仰角度、横滚角度中的至少一项,确定所述无人机在对应方向上进行姿态调整的目标角速度。
例如,可以根据手持控制设备的相对于初始姿态的Yaw角,如ε确定无人机在Yaw方向转动的Yaw角速度,即所述无人机的目标偏航角速度,可以称为第一方式。
示例性的,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角速度。例如,根据手持控制设备当前的X轴方向与所述初始姿态的X0Z平面之间的夹角确定无人机的Yaw角速度。当手持控制设备相对于初始状态产生一定的Yaw角时,可以以控制无人机在Yaw方向转动。例如,无人机在Yaw方向转动的Yaw角速度为Yaw角ε与无人机的Yaw角速度增益s的乘积。
例如,可以根据手持控制设备的相对于初始姿态的Roll角,如θ确定无人机在Yaw方向转动的Yaw角速度,即所述无人机的目标偏航角速度,可以称为第二方式。
示例性的,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。例如,当手持控制设备相对于初始状态产生一定的Roll角时,可以控制 无人机在Yaw方向转动,例如根据Roll角θ与无人机的Yaw角速度增益s的乘积可以确定无人机在Yaw方向转动的Yaw角速度。可以理解的,无人机在body坐标系下向前飞行的过程中,存在Yaw角速度和机体正方向前进的速度,进而可以实现前进、转弯等飞行。
在另一些实施方式中,可以根据所述手持控制设备的姿态信息确定所述无人机进行姿态调整的角度。
示例性的,可以根据所述手持控制设备的偏航角度、俯仰角度、横滚角度中的至少一项,确定所述无人机在对应方向上进行姿态调整的角度。
例如,可以根据手持控制设备的相对于初始姿态的Yaw角,如ε确定无人机在Yaw方向转动的Yaw角,即所述无人机的目标偏航角度,可以称为第三方式。
示例性的,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度。
例如,根据手持控制设备当前的X轴方向与所述初始姿态的X0Z平面之间的夹角确定无人机在Yaw方向转动的Yaw角。当手持控制设备相对于初始状态产生一定的Yaw角时,可以以控制无人机在Yaw方向转动。例如,可以根据所述Yaw角ε确定无人机在Yaw方向转动的Yaw角。
例如,可以根据手持控制设备的相对于初始姿态的Roll角,如θ确定无人机在Yaw方向转动的Yaw角,即所述无人机的目标偏航角度,可以称为第四方式。
示例性的,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角度。例如,当手持控制设备相对于初始状态产生一定的Roll角时,可以控制无人机在Yaw方向转动,例如,可以根据Roll角θ确定无人机在Yaw方向转动的Yaw角。
可以理解的,无人机在body坐标系下向前飞行的过程中,存在Yaw角和机体正方向前进的速度,进而可以实现前进、转弯等飞行。
在其他一些实施方式中,可以根据所述手持控制设备的姿态信息确定所述 无人机进行姿态调整的角度和角速度。
例如,可以根据手持控制设备的相对于初始姿态的Yaw角确定无人机在Yaw方向转动的Yaw角度,即无人机的目标偏航角度,以及根据手持控制设备的相对于初始姿态的Roll角确定在Yaw方向转动的Yaw角速度,即目标偏航角速度,该种控制方式可以称为第五方式。
示例性的,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
通过定义手持控制设备的姿态信息和无人机的控制信息之间的多种映射方式,可以根据用户的身体结构和用手习惯确定映射方式,使得不同身体结构和用手习惯的人均更加容易上手使用手持控制设备控制无人机。
示例性的,第一方式、第三方式比较符合手电筒模式的定义,使用者可以在脑海中想象出真实使用手电筒发出光线指引无人机飞行,但是由于人的手腕在操作手持控制设备转动Yaw角的时候左右不是对称的,会有人不适应该方式。第二方式和第四方式,使用者可以通过转动小手臂实现控制无人机转弯,相对省力。第五方式,能够确定无人机的目标偏航角度和目标偏航角速度,可以实现无人机跟随使用者转动身体的动作飞行,在使用者转动身体的同时还可以转动手臂来继续控制无人机在Yaw方向上的转动,能够实现大机动飞行。
示例性的,根据手持控制设备的相对于初始姿态的Yaw角,确定无人机的Yaw角。例如,根据手持控制设备当前的X轴方向与所述初始姿态的X0Z平面之间的夹角确定无人机的Yaw角。可以根据手持控制设备的相对于初始姿态的Roll角,确定无人机的Yaw角速度。当手持控制设备相对于初始状态产生一定的Roll角时,可以控制无人机在Yaw方向以所述Yaw角速度转动。
示例性的,可以根据所述无人机的目标偏航角度和所述无人机的目标偏航角速度调整无人机的姿态。
示例性的,所述方法还包括:控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。例如,调整无人机在Yaw方向转动根据手持控制设备的Yaw角确定的无人机的Yaw角,之后调整无人机在Yaw方向以 根据手持控制设备的Roll角确定的无人机的Yaw角速度继续转动。
示例性的,所述方法还包括:控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。例如,调整无人机在Yaw方向转动根据手持控制设备的Yaw角确定的无人机的Yaw角,且无人机转动时在Yaw方向的角速度为根据手持控制设备的Roll角确定的无人机的Yaw角速度。
在一些实施方式中,所述方法还包括:根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。示例的,控制角度可以通过如下公式计算:
Figure PCTCN2021077755-appb-000001
示例性的,所述目标偏航角度可以根据下式确定:
Yaw rc(t)-Yaw rc(0)
其中,Yaw rc(0)表示手持控制设备的初始姿态时的Yaw角,即参考偏航角度,t表示以所述初始化操作触发的时间为零点的当前时间,Yaw rc(t)表示手持控制设备当前的Yaw角,即当前的偏航角度。
所述目标偏航角速度在预设时间间隔t上的积分可以表示为:
Figure PCTCN2021077755-appb-000002
其中,τ时刻为0至t时刻之间的时刻,w(τ)表示τ时刻的目标偏航角速度,例如可以根据手持控制设备在τ时刻的横滚角度与参考横滚角度的差值确定,例如根据该差值与无人机的Yaw角速度增益s的乘积确定无人机在Yaw方向转动的Yaw角速度,即目标偏航角速度。
示例性的,所述无人机在偏航方向的控制角度可以根据所述目标偏航角度与所述目标偏航角速度在预设时间间隔t上的积分的和确定。
示例性的,无人机在初始姿态时的Yaw角可以表示为Yaw uav(0)。
在一些实施方式中,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:获取所述无人机的参考姿态信息;根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息以及所述无人机的参考姿态信息,确定所述无人机的控制信息。
示例性的,所述无人机的控制信息可以用于控制无人机相对于初始姿态的 姿态角度。可以理解的,所述初始姿态为参考姿态信息对应的姿态。在其他示例中,所述无人机的控制信息可以用于控制无人机相对于前一时刻转动的角度。
示例性的,所述无人机的当前姿态为所述无人机的参考姿态信息对应的姿态时,所述标记在所述显示模块的显示界面的预设位置显示。举例而言,所述预设位置位于所述显示界面的正中间。显示设备上显示的所述标记可以更准确的指示所述无人机的飞行方向。
示例性的,无人机在初始姿态可以为预设的姿态,例如为无人机悬停时的姿态。或者可以在某一时刻将无人机的当前姿态初始化确定为无人机的初始姿态。
在一些实施方式中,所述获取所述手持控制设备的参考姿态信息和所述无人机的参考姿态信息,包括:将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
示例性的,初始化操作可以由用户触发,或者可以在无人机起飞完成时进行初始化操作,当然也不限于此。
示例性的,当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。可以避免用户定义了一个异常的姿态作为手持控制设备的零位,即初始姿态,不利于后续通过调整手势控制设备的姿态控制无人机的飞行方向。示例性的,当所述初始化操作触发时所述手持控制设备的姿态信息不满足预设条件时,输出提示信息以提示用户调整所述手持控制设备的姿态。
示例性的,所述无人机的参考俯仰角度、参考横滚角度为预设值,即无人机的在Roll方向上的零位、在Pitch方向上的零位为预设值,例如为无人机水平悬停时在Roll方向上的角度和在Pitch方向上的角度。以便无人机保持平稳。
示例性的,可以将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度,并将初始化操作触发时所述无人机的偏航角度作为所述无人机的参考偏航角度。通过初始化无人机的参考偏航角度,可以确定无人机航向的零位,便于用户通过操作手持控制设备准确调整无人机的航 向。
在一些实施方式中,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角,确定所述云台的目标俯仰角。
示例性的,手持控制设备在Yaw方向和/或Roll方向调整姿态时,无人机的机体在在Yaw方向调整姿态,头戴设备的显示模块显示的标记向左或向右移动;手持控制设备在Pitch方向调整姿态时,无人机的云台在Pitch方向调整姿态,头戴设备的显示模块显示的标记向上或向下移动。可以防止无人机的机体在Pitch方向大幅度动作引起的风险。
示例性的,若根据所述姿态信息确定的所述无人机的在Pitch方向转动的角度处于所述云台在Pitch方向上的限位范围内,所述控制信息用于控制所述无人机调整所述云台在Pitch方向上的姿态。示例性的,若根据所述姿态信息确定的所述无人机的在Pitch方向转动的角度超过所述云台在Pitch方向上的限位范围内,所述控制信息用于控制所述无人机调整所述云台在Pitch方向上的姿态,以及调整所述机体在Pitch方向上的姿态。
在一些实施方式中,如图3和图11所示,所述手持控制设备包括油门控制部件11。油门控制部件例如包括可操纵的油门,油门的位置,或可称为键程值,或者可称为油门杆量,能够控制无人机在机体坐标系下的速度大小(标量)。如图11所示,向图示的方向按下油门,可以控制无人机沿着飞行方向运动。
示例性的,所述方法还包括:获取油门杆量,所述油门杆量是基于对所述油门控制部件的操作生成的;根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
在一些实施方式中,将油门的键程值映射到[0,1]之间。假设无人机的最大速度为V max。无人机在速度方向上的速度大小为键程值映射后的值与无人机的最大速度为V max的乘积。
示例性的,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。示例性的,当油门全部松开时,键程值映射后的值为0,对应的油门杆量为最小油门杆量,无人机停止在水平方向和/或竖直方向上的移动,例如保持悬停或者根据手持控制设备的姿态信息原地转动,调整飞行方向。可以理解的, 可以不需要手动控制油门杆量保持无人机悬停。
随着油门逐渐加大,键程值映射后的值大于0时,无人机开始向根据手持控制设备的姿态信息确定的飞行方向逐渐加速,例如加速至键程值映射后的值与无人机的最大速度为V max的乘积。
示例性的,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。当油门按到底时,键程值映射后的值为1,无人机以全速,如以最大速度V max向所述标记指示的飞行方向飞行。
在另一些实施方式中,将油门的键程值映射到[-1,1]之间,当油门维持在中间位置的时候,键程值映射后的值为0,无人机停止在水平方向和/或竖直方向上的移动,例如保持悬停或原地自转;油门从中间位置松开时,键程值映射后的值小于0,无人机可以在竖直方向上向下运动;油门从中间位置按下时,键程值映射后的值大于0,无人机可以在竖直方向上向上运动。这种方式需要手动保持无人机悬停。
示例性的,可以通过对油门的键程值进行滤波去除键程值的噪声和振动,可以采用一阶滤波的方式对油门的键程值进行滤波。
在一些实施方式中,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
示例性的,通过预设的指数曲线(Exponential)对油门的键程值进行处理,可以使得前段油门(如油门在中间位置到完全松开之间)比较平滑,做到平滑加速,后段油门(如油门在中间位置到完全按下之间)可以使无人机有一个更快的响应。提高油门操控的手感。
在一些实施方式中,无人机的运动可以分解成yaw方向上转动的角度、机体正方向的水平速度的大小|v|和/或垂直方向上的速度。当手持控制设备的坐标系的X轴方向,即“手电筒”发出的光线在水平方向上发生变化时(沿大地坐标系Z轴旋转),则无人机的运动可以分解成yaw方向上转动的角度和机体正方向的水平速度|v|。当手持控制设备的X轴方向,即“手电筒”发出的光线在垂直方向上发生变化时(沿大地坐标系Y轴旋转),无人机产生垂直方向上的速度。
示例性的,可以根据所述手持控制设备的机体坐标系上的预设方向,如X轴方向,确定所述无人机的目标速度方向。当手持控制设备姿态改变,如用户 转动手持控制设备的过程中,X轴方向也会跟着一起转动,跟随X轴方向可以分解得到手持控制设备的机身在水平方向的速度、垂直方向上的速度、yaw角、yaw角速度中的至少一种。所以,手持控制设备的姿态信息可以包括手持控制设备的机身在水平方向上的速度、垂直方向上的速度、yaw角、yaw角速度中的至少一种。例如,根据手持控制设备在水平方向上的yaw角、yaw角速度可以确定用于控制无人机在水平方向上转动的控制信息。
示例性的,将手持控制设备当前的X轴方向映射到所述初始姿态的X0Z平面上,得到一向量,根据该向量可以确定无人机在body坐标系下的运动方向,该运动方向可以称为速度指令向量的方向,简称速度指令方向。在一些实施方式中,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
示例性的,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,则根据所述姿态信息确定的无人机的控制信息用于控制无人机上升或下降,例如控制电机的转速增加使无人机的升力增加或者控制电机的转速降低使无人机的升力降低。以防止无人机在Pitch方向大幅度转动引起的风险。
示例性的,头戴设备的显示模块的正上方和正下方分别有向上的图标和向下的图标,当手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值时,显示模块显示的标记可以和所述向上的图标或向下的图标重合,重合后向上的图标或向下的图标的颜色会变化,提示用户当前无人机可以垂直升降。用户操作油门控制部件,如拉动油门杆可以控制无人机垂直升降。
在一些实施方式中,所述方法还包括:在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,无人机自动垂直起飞到离地1.2米的空中悬停,之后手持控制设备可以进入手电筒模式。可以防止在用户未正确手持该手持控制设备,或未进行初始化操作时手持控制设备的姿态引起无人机误动作。
在一些实施方式中,所述方法还包括:当所述无人机处于自动降落状态时,停止根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,当无人机的电量低于预设电量阈值时,无人机会触发低电量自动降落。
示例性的,无人机在空中任意位置时,用户双击手持控制设备上的相应按键,也可以触发自动降落功能。
示例性的,当所述无人机处于自动降落状态时,手持控制设备锁定,即手持控制设备的姿态变化不引起无人机姿态的变化。可以提高无人机自动降落的安全性。自动降落的功能操作简单,降低了手电筒模式时无人机降落的难度,提高了无人机安全落地的可靠性。
在一些实施方式中,所述方法还包括:当所述无人机处于自动降落状态时,根据用户对所述手持控制设备的解锁操作,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,无人机降落时,可以通过将油门压下,例如按压至中间位置或从中间位置继续按下时,手持控制设备解锁,接管无人机的控制,即手持控制设备的姿态变化可以映射为无人机姿态的变化,开始控制无人机的运动。例如手持控制设备在Roll方向和/或Yaw方向的姿态调整可以控制无人机在Yaw方向转动,手持控制设备在Pitch方向转动可以控制无人机的机体和/或无人机的云台俯仰。
示例性的,按压油门可以减缓无人机下降的速度,例如当油门拉到底时可以使无人机垂向悬停。示例性的,当油门松开回到中间位置或从中间位置松开时,手持控制设备锁定,无人机自主降落。
示例性的,无人机降落时,无人机会垂直匀速下降,在离地0.3米的地方悬停并触发二段降落,等待用户双击按键确认降落。在降落的过程中,可以通过操作手持控制设备,例如可以单击手持控制设备上的相应按键取消降落。
在一些实施方式中,无人机在降落时,可以通过手持控制设备调整无人机的飞行方向各/或下降速度,以保证降落的安全性,例如降落在没有障碍物的地方。
示例性的,可以根据手持控制设备的相对于初始姿态的Pitch角确定无人机在垂直方向上的速度。示例性的,根据手持控制设备当前的X轴方向的单位向量投影到大地坐标系的Z轴上的分量,将该分量乘以油门控制的无人机速度 V,得到无人机在垂直方向上的目标速度。
示例性的,如图12所示,根据手持控制设备的姿态信息控制无人机飞行时,根据手持控制设备的姿态确定的无人机在垂直方向上的目标速度范围可以为[﹣V max,V max]之间;无人机自动降落时,若手持控制设备解锁,能够控制无人机的运动,则根据手持控制设备的姿态确定的无人机在垂直方向上的目标速度范围可以为[0,V max]之间。可以保证无人机可以正常的下降,还可以利用手持控制设备控制无人机的落点。
示例性的,在无人机进入降落时,强制将无人机的下降速度置为预设值Vlan,根据手持控制设备的姿态映射到垂直方向上的目标速度与下降速度Vlan相抵的时候,无人机会停止下降。
在一些实施方式中,所述方法还包括:当所述无人机处于自动降落状态时,控制所述云台在俯仰方向上向下转动预设角度。从而拍摄设备拍摄得到的图像信息和头戴设备的显示模块显示的图像信息可以体现无人机下方的景物,便于用户判断无人机落点是否安全,以及在落点有障碍物时通过手持控制设备调整无人机的飞行方向各/或下降速度,以保证降落的安全性,例如降落在没有障碍物的地方。
在一些实施方式中,所述头戴设备可以获取手持控制设备的姿态信息,以及根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,手持控制设备的姿态可以映射为所述标记显示位置的调整。例如,在水平方向上向左或向右转动手持控制设备,或者在竖直方向向左或向右倾斜转动手持控制设备时,头戴设备的显示模块显示的标记向左或向右移动;手持控制设备在Pitch方向调整姿态时,头戴设备的显示模块显示的标记向上或向下移动。
示例性的,手持控制设备的姿态调整幅度越大,则所述显示模块显示的标记偏离预设位置的距离越大,同时无人机的控制信息指示的无人机的姿态变化幅度也越大,因此显示模块显示的标记可以体现无人机的姿态变化幅度,便于向用户反馈无人机的飞行方向。
在一些实施方式中,可以根据所述手持控制设备的姿态信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模 块显示标记。
示例性的,所述显示参数包括所述显示模块的画面比例和分辨率。因此可以与不同规格的显示模块适配,更准确的指示所述无人机的飞行方向。
在一些实施方式中,所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示的标记为飞行指示标记。
所述方法还可以包括:当所述手持控制设备处于头戴设备操作模式时,将所述手持控制设备的姿态信息发送给所述头戴设备,以使得所述头戴设备根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示操作标记,所述操作标记用于操作所述显示模块上的虚拟控制部件。
在一些实施方式中,当所述手持控制设备处于头戴设备操作模式时,用户可以通过调整手持控制设备的姿态调整所述操作标记在所述显示模块上的位置,实现所述显示模块的界面交互。例如,可以用于选择菜单。例如用户可以使用单手手持控制设备实现显示模块的菜单选择。可以理解的,手持控制设备的姿态可以映射为操作标记显示位置的调整。例如,在水平方向上向左或向右转动手持控制设备,或者在竖直方向向左或向右倾斜转动手持控制设备时,头戴设备的显示模块显示的操作标记向左或向右移动;手持控制设备在Pitch方向调整姿态时,头戴设备的显示模块显示的操作标记向上或向下移动。示例性的,在进行设置或者需要菜单切换的时候,先将无人机一键刹车悬停,再通过调整手持控制设备的姿态控制操作标记在显示模块上的显示位置,通过操作标记实现在显示模块界面中下拉菜单、选中虚拟控制部件等操作。
示例性的,头戴设备屏幕上显示相应菜单的按钮,当该操作标记移动到该按钮上时,该按钮会变颜色表示选中,此时按下手持控制设备的相应按键,如模式键表示确认,双击相应按键,如模式键表示退出选中。当菜单显示出来后,同理操作,用户可以通过调整手持控制设备的姿态控制所述操作标记和相应按键任意操纵菜单栏的选项设置。
在一些实施方式中,所述获取手持控制设备的姿态信息,包括:在所述手持控制设备的俯仰角度增加至第一阈值或减小至第二阈值时,记录所述手持控制设备的偏航角度为锁定偏航角度,所述第一阈值大于所述第二阈值。
在所述手持控制设备的俯仰角度大于所述第一阈值或小于所述第二阈值时,将所述锁定偏航角度作为所述手持控制设备当前的偏航角度,以及根据所述手 持控制设备的机体坐标系上的预设方向与第二预设平面之间的夹角确定所述手持控制设备的横滚角度,所述第二预设平面与所述手持控制设备处于所述锁定偏航角度时的所述预设方向平行,且所述第二预设平面与大地平面垂直。
示例性的,当手持控制设备的Pitch角度过大或过小的时候,由于欧拉角的性质所限制,手持控制设备的Roll角和Yaw角此时已经耦合。示例性的,如果手持控制设备有一个很大的Pitch角,此时再给手持控制设备以一定的Roll角,此时Yaw角也会有角度输出,容易导致无人机的控制混乱。通过在手持控制设备的Pitch角度大于或小于对应的阈值的时候,记录下此时的Yaw角,称为锁定Yaw角。之后在继续抬升或降低Pitch角度时,锁定Yaw角不变。此时手持控制设备的输出Roll角,使用手持控制设备的X轴相对于锁定Yaw角度的垂直平面(平面垂直于大地x0y平面)的夹角来代替。
请结合前述实施方式参阅图13,手持控制设备能够实现以下功能的至少一种:起飞、进入、刹车、返航、降落、悬停、避障,分小点、APAS避障绕行、任意角度初始化。
无人机在停桨时可以通过双击加解锁键控制无人机起桨。之后可以通过长按加解锁键控制无人机的起飞。
自动起飞功能:例如,将无人机放在平地上后,打开无人机电池,连上手持控制设备,先单击手持控制设备加解锁键,无人机起桨,后长按手持控制设备加解锁键,无人机自动垂直起飞到离地1.2米的空中悬停,例如可以自动进入手电筒飞行模式。通过在自动起飞后进入手电筒飞行模式,可以防止手持控制设备位置未准备好时无人机误动作。
自动降落功能:无人机在空中任意位置时,用户通过长按加解锁键,可以触发自动降落功能。进入自动降落后,无人机会垂直匀速下降,在离地0.3米的地方悬停并触发二段降落,等待用户通过长按加解锁键确认降落。在降落的过程中,也可以单击大圆键取消降落。自动降落的功能操作简单,降低了手电筒飞行时手动降落的难度,提高了无人机安全落地的可靠性。
自动返航功能,无人机在空中任意位置时,用户长按大圆键,如刹车键,可以触发自动返航功能。进入自动返航后,无人机先上升到返航高度再定速巡航返回到HOME点。在返航的过程中,也可以单击大圆键取消返航。若无人机的电量不足,在手电筒模式的飞行中,也会触发低电量自动返航,保证无人机能 安全返回。自动返航的功能操作简单,降低了手电筒飞行时手动返航的难度,提高了无人机安全返回的可靠性。
刹车悬停功能:手电筒模式的刹车功能可通过两种操作实现:1)在正常的飞行中松开油门杆,无人机正常刹车,2)单击大圆键,无人机紧急刹车。
正常飞行功能:无人机连上手持控制设备后默认进入手电筒模式,自动起飞后,用户通过操纵手持控制设备可控制无人机正常飞行。其中,操纵手持控制设备滚转姿态和偏航姿态,可控制无人机偏转机头方向,操纵手持控制设备的俯仰姿态和油门可控制无人机上下前后运动,操纵手持控制设备的俯仰姿态还可以控制云台上下运动,保证用户在头戴设备里的视角符合手持控制设备指向的方向。
避障飞行功能:在手电筒模式的正常飞行中,会感知环境的障碍物,从而对飞行速度做规划减速,使得无人机和障碍物保持安全距离,防止无人机撞击到障碍物和人群,保证无人机和人群的安全。
APAS避障绕行功能:在手电筒模式的飞行中,用户若选择打开APAS绕障飞行功能,无人机在遇到障碍物时会自动规划绕行路线,躲避障碍物自由飞行,减小了用户对飞行环境安全新判断的难度,增加了用户在复杂环境里飞行的乐趣。
任意位置初始化姿态功能:手持控制设备没有固定的回中位置,可供用户在空间的任意位置,以任意姿态使用,因此设计了任意位置初始化手持控制设备姿态功能。用户在任意时刻,任意位置,任意姿态单击大圆键,手持控制设备的姿态会重置回中,同时无人机也会刹车回中,降低了用户使用手持控制设备的操作难度,优化了用户手电筒模式的飞行体验。
示例性的,通过模式键可以切换至追头模式:如果头戴设备中有姿态传感器(IMU/陀螺仪),可以感应到人头部的变化。进入追头模式之后,无人机云台将跟随头戴设备的姿态。
在一些实施方式中,无人机还能够跟随头戴设备的姿态。例如,头戴设备中有姿态传感器(IMU/陀螺仪),可以感应到人头部的变化。进入追头模式之后为无人机和/或云台将跟随头戴设备的姿态。
示例性的,通过头戴设备的姿态变化控制云台的姿态调整,例如头戴设备的x轴控制云台的俯仰角和偏航角(与手持控制设备定义相同)。可以通过将 云台控制和无人机飞行解耦,头戴设备控制云台朝向,手持控制设备控制无人机的运动方向,可以实现例如环绕拍摄等等功能。
在一些实施方式中,手电筒模式下,头戴设备上特有的交互包括以下:HOME点显示:无人机在起飞时会记录HOME点,当无人机偏离HOME点时,头戴设备会显示HOME点指向引导用户正确返航。
在一些实施方式中,具有智能提示功能:当无人机执行自动起桨,自动起飞,自动返航,自动降落时,无人机是不可人为控制的,此时头戴设备会主动提示无人机在智能功能中,防止用户因无法控制无人机而感到困惑并引导用户正确使用按键操纵无人机。
在一些实施方式中,当无人机出现动力不足,指南针需要校准,无人机温度过高,电机堵转等异常状态时,头戴设备会标红提示用户,保证飞行安全。
在一些实施方式中,可以提供刹车锁定及解锁提示:在飞行过程中,用户可以按刹车键使得无人机快速刹车悬停,同时锁定手持控制设备杆量,无法控制无人机,此时头戴设备会提示用户刹车锁定。若用户想要再次控制无人机时,需把手持控制设备端平,再次点击刹车键解锁手持控制设备,若解锁失败,头戴设备会提示用户将手持控制设备端平。以上的刹车锁定及解锁交互,保证了多人体验同一手持控制设备飞行时的安全、可靠和一致性。
在一些实施方式中,可以提供观众模式:无人机在手电筒模式里可以同时连接两个头戴设备,用手持控制设备控制飞行的为主头戴设备,另一个则为从头戴设备,无法控制无人机,主要用于充当观众视角的角色,增加多人体验飞行的趣味性。
示例性的,无人机在手电筒模式里可以同时连接两个头戴设备,两个头戴设备各自对应一个手持控制设备,在其中一个手持控制设备锁定时,另一个手持控制设备可以解锁,来对无人机进行操控。
本申请实施例提供的无人机的控制方法,通过获取手持控制设备的姿态信息,根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。使得用户可以通过调整手持控制设备的姿态来控制无人机,符合人类直觉。通过显示标记指示所述无人机的飞行方向,能够带给用户更直观 的操控体验,使得飞行操纵更加容易和安全。
可以将手持控制设备的转动更加直观的转化为无人机的姿态控制,达到人-手持控制设备-无人机三方交互的目的,在一些实施方式中用户仅用单手即可操作无人机。能够以符合人类直觉的方式将手腕转动等肢体动作转化为无人机姿态的调整指令。
请结合上述实施例参阅图14,图14是本申请实施例提供的手持控制设备610的示意性框图。
其中手持控制设备610例如包括体感遥控器,当然也不限于此。
该手持控制设备610包括姿态传感器611和通信模块612。
其中,姿态传感器611用于获取所述手持控制设备610的姿态信息;通信模块612用于将所述手持控制设备610的姿态信息发送给无人机,以使得所述无人机根据所述手持控制设备610的姿态信息,确定所述无人机的控制信息,并将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,无人机可以获取手持控制设备发送的姿态信息,根据手持控制设备的姿态信息确定所述无人机的控制信息,根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在一些实施方式中,所述手持控制设备包括油门控制部件。
如图14所示,所述手持控制设备还包括:一个或多个处理器613,单独地或共同地工作,用于:获取油门杆量,所述油门杆量是基于对所述油门控制部件的操作生成的。
示例性的,所述通信模块还用于将所述油门杆量发送给所述无人机,以使所述无人机根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
示例性的,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
示例性的,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速 度朝向所述标记指示的飞行方向飞行。
示例性的,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
示例性的,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
示例性的,所述手持控制设备的偏航姿态和/或横滚姿态用于确定所述无人机的偏航姿态;和/或
所述手持控制设备的俯仰姿态用于确定所述云台的俯仰姿态。
示例性的,根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
示例性的,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
示例性的,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标记向下移动。
示例性的,所述无人机的控制信息根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息确定。
示例性的,所述无人机的控制信息包括所述无人机的目标偏航角速度;
所述无人机的目标偏航角速度根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度确定,或者根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度确定。
示例性的,所述无人机的控制信息包括目标偏航角度:所述目标偏航角度根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度确定,或者根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度确定。
示例性的,所述无人机的控制信息包括目标偏航角度和目标偏航角速度, 所述目标偏航角度根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度确定的所述无人机的目标偏航角度;所述无人机的目标偏航角速度根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度确定。
示例性的,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:
控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
示例性的,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:
控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
示例性的,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:
根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。
示例性的,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
所述无人机的控制信息,包括:
根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角确定的所述云台的目标俯仰角。
示例性的,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
示例性的,所述处理器还用于将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息。
示例性的,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息时,用于:
将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度;
所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
示例性的,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息时,用于:
当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息;
否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
示例性的,所述处理器还用于:
在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器还用于:
当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,所述标记为飞行指示标记,所述通信模块还用于:
当所述手持控制设备处于头戴设备操作模式时,将所述手持控制设备的姿态信息发送给所述头戴设备,以使得所述头戴设备根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示操作标记,所述操作标记用于操作所述显示模块上的虚拟控制部件。
本申请实施例提供的手持控制设备的具体原理和实现方式均与前述实施例的无人机的控制方法类似,此处不再赘述。
请结合上述实施例参阅图15,图15是本申请实施例提供的手持控制设备620的示意性框图。
其中手持控制设备620例如包括体感遥控器,当然也不限于此。
该手持控制设备620包括姿态传感器621、一个或多个处理器622以及通信模块623。
其中,姿态传感器621用于获取所述手持控制设备620的姿态信息;一个或多个处理器622,单独地或共同地工作,用于根据所述手持控制设备620的姿态信息,确定所述无人机的控制信息;通信模块623用于将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,手持控制设备获取自身的姿态信息,根据姿态信息确定所述无人机的控制信息,将所述无人机的控制信息发送给无人机以使无人机根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得 所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。示例性的,手持控制设备确定的无人机的控制信息可以直接发给无人机,或者为可以通过头戴设备发给无人机,传输更可靠。
示例性的,所述手持控制设备包括油门控制部件,所述处理器还用于:
获取油门杆量,所述油门杆量是基于对所述油门控制部件的操作生成的;
所述通信模块还用于将所述油门杆量发送给所述无人机,以使所述无人机根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
示例性的,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
示例性的,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。
示例性的,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
示例性的,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
示例性的,所述手持控制设备的偏航姿态和/或横滚姿态用于确定所述无人机的偏航姿态;和/或
所述手持控制设备的俯仰姿态用于确定所述云台的俯仰姿态。
示例性的,根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
示例性的,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
示例性的,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标记向下移动。
示例性的,所述处理器根据所述手持控制设备的姿态信息,确定所述无人机的控制信息时,用于:
获取所述手持控制设备的参考姿态信息;
根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角速度;或者
根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;或者
根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角度。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;
根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
示例性的,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
示例性的,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
示例性的,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分, 确定所述无人机在偏航方向的控制角度。
示例性的,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角,确定所述云台的目标俯仰角。
示例性的,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
获取所述无人机的参考姿态信息;
根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息以及所述无人机的参考姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器获取所述手持控制设备的参考姿态信息和所述无人机的参考姿态信息时,用于:
将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
示例性的,所述处理器获取所述手持控制设备的参考姿态信息和所述无人机的参考姿态信息时,用于:
将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度,并将初始化操作触发时所述无人机的偏航角度作为所述无人机的参考偏航角度;
所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
示例性的,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息时,用于:
当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备 的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息;
否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
示例性的,所述处理器还用于:
在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器还用于:
当所述无人机处于自动降落状态时,控制所述无人机的云台在俯仰方向上向下转动预设角度。
示例性的,所述处理器还用于:
当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,所述标记为飞行指示标记,所述通信模块还用于:
当所述手持控制设备处于头戴设备操作模式时,将所述手持控制设备的姿态信息发送给所述头戴设备,以使得所述头戴设备根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示操作标记,所述操作标记用于操作所述显示模块上的虚拟控制部件。
本申请实施例提供的手持控制设备的具体原理和实现方式均与前述实施例的无人机的控制方法类似,此处不再赘述。
本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现上述实施例提供的无人机的控制方法的步骤。
其中,所述计算机可读存储介质可以是前述任一实施例所述的手持控制设备的内部存储单元,例如所述手持控制设备的硬盘或内存。所述计算机可读存储介质也可以是所述手持控制设备的外部存储设备,例如所述手持控制设备上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。
请参阅图16,图16是本申请实施例提供的无人机700的示意性框图。示例性的,无人机700可以为旋翼型无人机,例如四旋翼无人机、六旋翼无人机、八旋翼无人机,也可以是固定翼无人机。
该无人机700包括第一通信模块701、一个或多个处理器702,以及第二通信模块703。
其中,第一通信模块701用于获取手持控制设备的姿态信息;一个或多个处理器702,单独地或共同地工作,用于根据所述手持控制设备的姿态信息,确定所述无人机700的控制信息;第二通信模块703,用于将所述无人机700的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机700的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机700的飞行方向。
可以理解的。第一通信模块701和第二通信模块703可以为不同的通信模块,也可以为同一个通信模块,例如可以为一体设置的通信模块。
示例性的,无人机可以获取手持控制设备发送的姿态信息,根据手持控制设备的姿态信息确定所述无人机的控制信息,根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,所述第一通信模块还用于:
获取所述手持控制设备的油门杆量,所述油门杆量是基于对所述手持控制设备的油门控制部件的操作生成的;
所述处理器还用于根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
示例性的,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
示例性的,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。
示例性的,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
示例性的,所述无人机包括拍摄设备,所述第二通信模块还用于:
将所述拍摄设备拍摄得到的图像信息发送给所述头戴设备,以使的所述头戴设备的显示模块叠加显示所述图像信息和所述标记。
示例性的,所述拍摄设备通过云台安装于所述无人机;
所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
示例性的,所述无人机的偏航姿态与所述手持控制设备的偏航姿态和/或横滚姿态有关;和/或
所述云台的俯仰姿态与所述手持控制设备的俯仰姿态有关。
示例性的,根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
示例性的,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
示例性的,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标记向下移动。
示例性的,所述处理器根据所述手持控制设备的姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角速度;或者
根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;或者
根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角度。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;
根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
示例性的,所述处理器还用于:
控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
示例性的,所述处理器还用于:
控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
示例性的,所述处理器还用于:
根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。
示例性的,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角,确定所述云台的目标俯仰角。
示例性的,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
示例性的,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息以及所述无人机的参考姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器还用于:
将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
示例性的,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息时,用于:
将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度,并将初始化操作触发时所述无人机的偏航角度作为所述无人机的参考偏航角度;
所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
示例性的,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息时,用于:
当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息;
否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
示例性的,所述处理器还用于:
在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
示例性的,所述处理器还用于:
当所述无人机处于自动降落状态时,控制所述无人机的云台在俯仰方向上向下转动预设角度。
示例性的,所述处理器还用于:
当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
本申请实施例提供的无人机的具体原理和实现方式均与前述实施例的无人机的控制方法类似,此处不再赘述。
本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序中包括程序指令,所述计算机程序被处理器执行时使所述处理器实现上述实施例提供的无人机的控制方法的步骤。
其中,所述计算机可读存储介质可以是前述任一实施例所述的无人机的内 部存储单元,例如所述无人机的硬盘或内存。所述计算机可读存储介质也可以是所述无人机的外部存储设备,例如所述无人机上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。
请结合上述实施例参阅图17,图17是本申请实施例提供的头戴设备810的示意性框图。
示例性的,头戴设备810可以为飞行眼镜,例如为第一视角(FPV,First Person View)眼镜。
该头戴设备810包括通信模块811以及一个或多个处理器812。
其中,通信模块811用于获取无人机的控制信息,所述无人机的控制信息是根据手持控制设备的姿态信息确定的;一个或多个处理器812,单独地或共同地工作,用于根据所述无人机的控制信息在所述头戴设备810的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,无人机可以获取手持控制设备发送的姿态信息,根据手持控制设备的姿态信息确定所述无人机的控制信息,根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,手持控制设备获取自身的姿态信息,根据姿态信息确定所述无人机的控制信息,将所述无人机的控制信息发送给无人机以使无人机根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在一些实施方式中,所述处理器812根据所述无人机的控制信息在所述头戴设备810的显示模块显示标记时,用于根据所述无人机的控制信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
示例性的,所述显示参数包括所述显示模块的画面比例和分辨率。
本申请实施例提供的头戴设备的具体原理和实现方式均与前述实施例的无人机的控制方法类似,此处不再赘述。
请结合上述实施例参阅图18,图18是本申请实施例提供的头戴设备820的示意性框图。
示例性的,头戴设备820可以为飞行眼镜,例如为第一视角(FPV,First Person View)眼镜。
该头戴设备820包括通信模块821以及一个或多个处理器822。
其中,通信模块821用于获取手持控制设备的姿态信息;一个或多个处理器822,单独地或共同地工作,用于根据所述手持控制设备的姿态信息在所述头戴设备820的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在一些实施方式中,所述处理器根据所述手持控制设备的姿态信息在所述头戴设备820的显示模块显示标记时,用于根据所述手持控制设备的姿态信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
示例性的,所述显示参数包括所述显示模块的画面比例和分辨率。
本申请实施例提供的头戴设备的具体原理和实现方式均与前述实施例的无人机的控制方法类似,此处不再赘述。
本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现上述实施例提供的无人机的控制方法的步骤。
其中,所述计算机可读存储介质可以是前述任一实施例所述的头戴设备的内部存储单元,例如所述头戴设备的硬盘或内存。所述计算机可读存储介质也可以是所述头戴设备的外部存储设备,例如所述头戴设备上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。
请结合前述实施例参阅图19,图19是本申请实施例提供的一种无人机的控制方法的流程示意图。
示例性的,所述无人机的控制方法可以用于头戴设备。
如图19所示,无人机的控制方法包括步骤S210至步骤S220。
S210、获取无人机的控制信息,所述无人机的控制信息是根据手持控制设备的姿态信息确定的,所述无人机的控制信息用于调整所述无人机的姿态或者调整所述无人机的云台的姿态;
S220、根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,所述无人机的控制信息包括所述无人机的目标偏航角度和/或所述无人机的目标偏航角速度;其中所述无人机的目标偏航角度用于控制所述无人机在偏航方向转动所述目标偏航角度,所述目标偏航角速度用于控制所述无人机在偏航方向以所述目标偏航角速度转动。
示例性的,所述根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,包括:根据所述无人机的控制信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
示例性的,所述显示参数包括所述显示模块的画面比例和分辨率。
请结合前述实施例参阅图20,图20是本申请实施例提供的一种无人机的控制方法的流程示意图。
示例性的,所述无人机的控制方法可以用于头戴设备。
如图20所示,无人机的控制方法包括步骤S310至步骤S320。
S310、获取手持控制设备的姿态信息,所述手持控制设备的姿态信息用于确定所述无人机的控制信息,所述无人机的控制信息用于调整所述无人机的姿态或者调整所述无人机的云台的姿态。
S320、根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
示例性的,所述无人机的控制信息包括所述无人机的目标偏航角度和/或所述无人机的目标偏航角速度;其中所述无人机的目标偏航角度用于控制所述无人机在偏航方向转动所述目标偏航角度,所述目标偏航角速度用于控制所述无人机在偏航方向以所述目标偏航角速度转动。
示例性的,所述根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,包括:根据所述无人机的控制信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
示例性的,所述显示参数包括所述显示模块的画面比例和分辨率。
请结合前述实施例参阅图2,图2是本申请实施例提供的无人机的控制系统的结构示意图。
如图2所示,无人机的控制系统包括手持控制设备、无人机和头戴设备。 可以理解的,图2中手持控制设备、无人机和头戴设备之间的通信连接仅为一种实施方式,在另一些实施方式中,手持控制设备可以通过头戴设备与无人机通信连接,或者头戴设备可以通过手持控制设备与无人机通信连接。在其他一些实施方式中,手持控制设备和头戴设备可以通过中继设备与无人机通信连接。
其中,无人机可以为旋翼型无人机,例如四旋翼无人机、六旋翼无人机、八旋翼无人机,也可以是固定翼无人机。头戴设备可以为飞行眼镜,例如为第一视角(FPV,First Person View)眼镜。手持控制设备例如包括体感遥控器。
其中,手持控制设备用于获取所述手持控制设备的姿态信息,所述姿态信息用于确定无人机的控制信息;无人机用于根据所述无人机的控制信息调整所述无人机的姿态或者调整所述无人机的云台的姿态;头戴设备,用于根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在一些实施方式中,无人机可以获取手持控制设备发送的姿态信息,根据手持控制设备的姿态信息确定所述无人机的控制信息,根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
在另一些实施方式中,手持控制设备获取自身的姿态信息,根据姿态信息确定所述无人机的控制信息,将所述无人机的控制信息发送给无人机以使无人机根据控制信息执行对应的动作,以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。示例性的,手持控制设备确定的无人机的控制信息可以直接发给无人机,或者为可以通过头戴设备发给无人机,传输更可靠。
本申请实施例提供的无人机及其控制方法、系统、手持控制设备、头戴设备,以及计算机可读存储介质,通过获取手持控制设备的姿态信息,根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;以及将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。使得用户可以通过调整手持控制设备的姿态来控制无人机,符合人类直觉。通 过显示标记指示所述无人机的飞行方向,能够带给用户更直观的操控体验,使得飞行操纵更加容易和安全。
应当理解,在此本申请中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。
还应当理解,在本申请和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。

Claims (119)

  1. 一种无人机的控制方法,其特征在于,所述方法包括:
    获取手持控制设备的姿态信息;
    根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;
    将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  2. 根据权利要求1所述的控制方法,其特征在于,所述手持控制设备包括油门控制部件,所述方法还包括:
    获取油门杆量,所述油门杆量是基于对所述油门控制部件的操作生成的;
    根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
  3. 根据权利要求2所述的控制方法,其特征在于,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
  4. 根据权利要求2所述的控制方法,其特征在于,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。
  5. 根据权利要求2所述的控制方法,其特征在于,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
  6. 根据权利要求1所述的控制方法,其特征在于,所述无人机包括拍摄设备,所述方法还包括:
    将所述拍摄设备拍摄得到的图像信息发送给所述头戴设备,以使的所述头戴设备的显示模块叠加显示所述图像信息和所述标记。
  7. 根据权利要求6所述的控制方法,其特征在于,所述拍摄设备通过云台 安装于所述无人机;
    所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
  8. 根据权利要求7所述的控制方法,其特征在于,
    所述无人机的偏航姿态与所述手持控制设备的偏航姿态和/或横滚姿态有关;和/或
    所述云台的俯仰姿态与所述手持控制设备的俯仰姿态有关。
  9. 根据权利要求1-8中任一项所述的控制方法,其特征在于,
    根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
    根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
  10. 根据权利要求9所述的控制方法,其特征在于,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
  11. 根据权利要求9所述的控制方法,其特征在于,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标记向下移动。
  12. 根据权利要求1所述的控制方法,其特征在于,所述根据所述手持控制设备的姿态信息,确定所述无人机的控制信息,包括:
    获取所述手持控制设备的参考姿态信息;
    根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息。
  13. 根据权利要求12所述的控制方法,其特征在于,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角速度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
  14. 根据权利要求12所述的控制方法,其特征在于,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角度。
  15. 根据权利要求12所述的控制方法,其特征在于,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
  16. 根据权利要求15所述的控制方法,其特征在于,所述方法还包括:
    控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
  17. 根据权利要求15或16所述的控制方法,其特征在于,所述方法还包括:
    控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
  18. 根据权利要求15所述的控制方法,其特征在于,所述方法还包括:
    根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。
  19. 根据权利要求12所述的控制方法,其特征在于,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
    所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:
    根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角,确定所述云台的目标俯仰角。
  20. 根据权利要求19所述的控制方法,其特征在于,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
  21. 根据权利要求12所述的控制方法,其特征在于,所述根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息,包括:
    获取所述无人机的参考姿态信息;
    根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息以及所述无人机的参考姿态信息,确定所述无人机的控制信息。
  22. 根据权利要求21所述的控制方法,其特征在于,所述获取所述手持控制设备的参考姿态信息和所述无人机的参考姿态信息,包括:
    将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
  23. 根据权利要求22所述的控制方法,其特征在于,所述获取所述手持控 制设备的参考姿态信息和所述无人机的参考姿态信息,包括:
    将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度,并将初始化操作触发时所述无人机的偏航角度作为所述无人机的参考偏航角度;
    所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
  24. 根据权利要求22所述的控制方法,其特征在于,所述将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息,包括:
    当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息;
    否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
  25. 根据权利要求1所述的控制方法,其特征在于,所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,包括:
    所述头戴设备根据所述无人机的控制信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
  26. 根据权利要求25所述的控制方法,其特征在于,所述显示参数包括所述显示模块的画面比例和分辨率。
  27. 根据权利要求1所述的控制方法,其特征在于,所述方法还包括:
    在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  28. 根据权利要求1所述的控制方法,其特征在于,当所述无人机处于自动降落状态时,控制所述无人机的云台在俯仰方向上向下转动预设角度。
  29. 根据权利要求1所述的控制方法,其特征在于,当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  30. 根据权利要求1所述的控制方法,其特征在于,所述标记为飞行指示标记,所述方法还包括:
    当所述手持控制设备处于头戴设备操作模式时,将所述手持控制设备的姿态信息发送给所述头戴设备,以使得所述头戴设备根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示操作标记,所述操作标记用于操作所述显示模块上的虚拟控制部件。
  31. 一种手持控制设备,其特征在于,所述手持控制设备包括:
    姿态传感器,用于获取所述手持控制设备的姿态信息;
    通信模块,用于将所述手持控制设备的姿态信息发送给无人机,以使得所述无人机根据所述手持控制设备的姿态信息,确定所述无人机的控制信息,并将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  32. 根据权利要求31所述的手持控制设备,其特征在于,所述手持控制设备包括油门控制部件,所述手持控制设备还包括:
    一个或多个处理器,单独地或共同地工作,用于:
    获取油门杆量,所述油门杆量是基于对所述油门控制部件的操作生成的;
    所述通信模块还用于将所述油门杆量发送给所述无人机,以使所述无人机根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
  33. 根据权利要求32所述的手持控制设备,其特征在于,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
  34. 根据权利要求32所述的手持控制设备,其特征在于,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。
  35. 根据权利要求32所述的手持控制设备,其特征在于,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
  36. 根据权利要求31所述的手持控制设备,其特征在于,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
    所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
  37. 根据权利要求36所述的手持控制设备,其特征在于,所述手持控制设备的偏航姿态和/或横滚姿态用于确定所述无人机的偏航姿态;和/或
    所述手持控制设备的俯仰姿态用于确定所述云台的俯仰姿态。
  38. 根据权利要求31-37中任一项所述的手持控制设备,其特征在于,
    根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
    根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
  39. 根据权利要求38所述的手持控制设备,其特征在于,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
  40. 根据权利要求38所述的手持控制设备,其特征在于,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转 动的控制信息,用于使所述标记向下移动。
  41. 根据权利要求32所述的手持控制设备,其特征在于,所述无人机的控制信息根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息确定。
  42. 根据权利要求41所述的手持控制设备,其特征在于,所述无人机的控制信息包括所述无人机的目标偏航角速度;
    所述无人机的目标偏航角速度根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度确定,或者根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度确定。
  43. 根据权利要求41所述的手持控制设备,其特征在于,所述无人机的控制信息,包括:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度确定的所述无人机的目标偏航角度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度确定的所述无人机的目标偏航角度。
  44. 根据权利要求41所述的手持控制设备,其特征在于,所述无人机的控制信息,包括:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度确定的所述无人机的目标偏航角度;
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度确定的所述无人机的目标偏航角速度。
  45. 根据权利要求44所述的手持控制设备,其特征在于,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:
    控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
  46. 根据权利要求44或45所述的手持控制设备,其特征在于,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:
    控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
  47. 根据权利要求44所述的手持控制设备,其特征在于,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:
    根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。
  48. 根据权利要求41所述的手持控制设备,其特征在于,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
    所述无人机的控制信息,包括:
    根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角确定的所述云台的目标俯仰角。
  49. 根据权利要求48所述的手持控制设备,其特征在于,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
  50. 根据权利要求41所述的手持控制设备,其特征在于,所述处理器还用于将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息。
  51. 根据权利要求50所述的手持控制设备,其特征在于,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息时,用于:
    将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度;
    所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
  52. 根据权利要求50所述的手持控制设备,其特征在于,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息时,用于:
    当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息;
    否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
  53. 根据权利要求32所述的手持控制设备,其特征在于,所述处理器还用于:
    在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  54. 根据权利要求32所述的手持控制设备,其特征在于,所述处理器还用于:
    当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  55. 根据权利要求31所述的手持控制设备,其特征在于,所述标记为飞行指示标记,所述通信模块还用于:
    当所述手持控制设备处于头戴设备操作模式时,将所述手持控制设备的姿态信息发送给所述头戴设备,以使得所述头戴设备根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示操作标记,所述操作标记用于操作所述显示模块上的虚拟控制部件。
  56. 一种手持控制设备,其特征在于,所述手持控制设备包括:
    姿态传感器,用于获取所述手持控制设备的姿态信息;
    一个或多个处理器,单独地或共同地工作,用于根据所述手持控制设备的姿态信息,确定无人机的控制信息;
    通信模块,用于将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  57. 根据权利要求56所述的手持控制设备,其特征在于,所述手持控制设备包括油门控制部件,所述处理器还用于:
    获取油门杆量,所述油门杆量是基于对所述油门控制部件的操作生成的;
    所述通信模块还用于将所述油门杆量发送给所述无人机,以使所述无人机根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
  58. 根据权利要求57所述的手持控制设备,其特征在于,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
  59. 根据权利要求57所述的手持控制设备,其特征在于,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。
  60. 根据权利要求57所述的手持控制设备,其特征在于,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
  61. 根据权利要求56所述的手持控制设备,其特征在于,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
    所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
  62. 根据权利要求61所述的手持控制设备,其特征在于,所述手持控制设备的偏航姿态和/或横滚姿态用于确定所述无人机的偏航姿态;和/或
    所述手持控制设备的俯仰姿态用于确定所述云台的俯仰姿态。
  63. 根据权利要求56-62中任一项所述的手持控制设备,其特征在于,
    根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
    根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
  64. 根据权利要求63所述的手持控制设备,其特征在于,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
  65. 根据权利要求63所述的手持控制设备,其特征在于,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标记向下移动。
  66. 根据权利要求56所述的手持控制设备,其特征在于,所述处理器根据所述手持控制设备的姿态信息,确定所述无人机的控制信息时,用于:
    获取所述手持控制设备的参考姿态信息;
    根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息。
  67. 根据权利要求66所述的手持控制设备,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角速度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
  68. 根据权利要求66所述的手持控制设备,其特征在于,所述处理器根据 所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角度。
  69. 根据权利要求66所述的手持控制设备,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
  70. 根据权利要求69所述的手持控制设备,其特征在于,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
  71. 根据权利要求69或70所述的手持控制设备,其特征在于,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
  72. 根据权利要求69所述的手持控制设备,其特征在于,所述无人机的目标偏航角度和所述无人机的目标偏航角速度用于:根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。
  73. 根据权利要求66所述的手持控制设备,其特征在于,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
    所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角,确定所述云台的目标俯仰角。
  74. 根据权利要求73所述的手持控制设备,其特征在于,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
  75. 根据权利要求66所述的手持控制设备,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    获取所述无人机的参考姿态信息;
    根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息以及所述无人机的参考姿态信息,确定所述无人机的控制信息。
  76. 根据权利要求75所述的手持控制设备,其特征在于,所述处理器获取所述手持控制设备的参考姿态信息和所述无人机的参考姿态信息时,用于:
    将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
  77. 根据权利要求76所述的手持控制设备,其特征在于,所述处理器获取所述手持控制设备的参考姿态信息和所述无人机的参考姿态信息时,用于:
    将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度,并将初始化操作触发时所述无人机的偏航角度作为所述无人机的参考偏航角度;
    所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
  78. 根据权利要求76所述的手持控制设备,其特征在于,所述处理器将初 始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息时,用于:
    当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息;
    否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
  79. 根据权利要求56所述的手持控制设备,其特征在于,所述处理器还用于:
    在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  80. 根据权利要求56所述的手持控制设备,其特征在于,所述处理器还用于:
    当所述无人机处于自动降落状态时,控制所述无人机的云台在俯仰方向上向下转动预设角度。
  81. 根据权利要求56所述的手持控制设备,其特征在于,所述处理器还用于:
    当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  82. 根据权利要求56所述的手持控制设备,其特征在于,所述标记为飞行指示标记,所述通信模块还用于:
    当所述手持控制设备处于头戴设备操作模式时,将所述手持控制设备的姿态信息发送给所述头戴设备,以使得所述头戴设备根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示操作标记,所述操作标记用于操作所述显示模块上的虚拟控制部件。
  83. 一种无人机,其特征在于,所述无人机包括:
    第一通信模块,用于获取手持控制设备的姿态信息;
    一个或多个处理器,单独地或共同地工作,用于根据所述手持控制设备的姿态信息,确定所述无人机的控制信息;
    第二通信模块,用于将所述无人机的控制信息发送给头戴设备,以使得所述头戴设备根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  84. 根据权利要求83所述的无人机,其特征在于,所述第一通信模块还用于:
    获取所述手持控制设备的油门杆量,所述油门杆量是基于对所述手持控制设备的油门控制部件的操作生成的;
    所述处理器还用于根据所述油门杆量控制所述无人机朝向所述标记指示的飞行方向飞行。
  85. 根据权利要求84所述的无人机,其特征在于,当所述油门杆量为最小油门杆量时,所述无人机的位置保持不变。
  86. 根据权利要求84所述的无人机,其特征在于,当所述油门杆量为最大油门杆量时,所述无人机以预设飞行速度朝向所述标记指示的飞行方向飞行。
  87. 根据权利要求84所述的无人机,其特征在于,当所述油门杆量从最小油门杆量到最大油门杆量均匀变化时,所述无人机的飞行速度的增量逐渐变大。
  88. 根据权利要求83所述的无人机,其特征在于,所述无人机包括拍摄设备,所述第二通信模块还用于:
    将所述拍摄设备拍摄得到的图像信息发送给所述头戴设备,以使的所述头戴设备的显示模块叠加显示所述图像信息和所述标记。
  89. 根据权利要求88所述的无人机,其特征在于,所述拍摄设备通过云台安装于所述无人机;
    所述无人机的控制信息包括无人机姿态控制信息和/或云台姿态控制信息。
  90. 根据权利要求89所述的无人机,其特征在于,
    所述无人机的偏航姿态与所述手持控制设备的偏航姿态和/或横滚姿态有关;和/或
    所述云台的俯仰姿态与所述手持控制设备的俯仰姿态有关。
  91. 根据权利要求83-90中任一项所述的无人机,其特征在于,
    根据所述手持控制设备的偏航角度和/或横滚角度确定的无人机的控制信息用于使所述标记向左或向右移动;和/或
    根据所述手持控制设备的俯仰角度确定的无人机的控制信息用于使所述标记向向上或向下移动。
  92. 根据权利要求91所述的无人机,其特征在于,用于控制所述无人机和/或所述无人机的云台在偏航方向上向左转动的控制信息,用于使所述标记向左移动,用于控制所述无人机和/或所述无人机的云台在偏航方向上向右转动的控制信息,用于使所述标记向右移动。
  93. 根据权利要求91所述的无人机,其特征在于,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向上转动的控制信息,用于使所述标记向上移动,用于控制所述无人机和/或所述无人机的云台在俯仰方向上向下转动的控制信息,用于使所述标记向下移动。
  94. 根据权利要求83所述的无人机,其特征在于,所述处理器根据所述手持控制设备的姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息。
  95. 根据权利要求94所述的无人机,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角速度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
  96. 根据权利要求94所述的无人机,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;或者
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角度。
  97. 根据权利要求94所述的无人机,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的偏航角度、所述手持控制设备的参考偏航角度,确定所述无人机的目标偏航角度;
    根据所述手持控制设备的横滚角度、所述手持控制设备的参考横滚角度,确定所述无人机的目标偏航角速度。
  98. 根据权利要求97所述的无人机,其特征在于,所述处理器还用于:
    控制所述无人机在转动所述目标偏航角度之后,以所述目标偏航角速度继续转动。
  99. 根据权利要求97或98所述的无人机,其特征在于,所述处理器还用于:
    控制所述无人机以所述目标偏航角速度至少转动所述目标偏航角度。
  100. 根据权利要求97所述的无人机,其特征在于,所述处理器还用于:
    根据所述目标偏航角度和所述目标偏航角速度在预设时间间隔上的积分,确定所述无人机在偏航方向的控制角度。
  101. 根据权利要求94所述的无人机,其特征在于,所述无人机包括拍摄设备,所述拍摄设备通过云台安装于所述无人机;
    所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的俯仰角、所述手持控制设备的参考俯仰角,确定所述云台的目标俯仰角。
  102. 根据权利要求101所述的无人机,其特征在于,若所述手持控制设备的俯仰角与所述手持控制设备的参考俯仰角的偏差大于预设阈值,所述标记用于指示所述无人机垂直升降。
  103. 根据权利要求94所述的无人机,其特征在于,所述处理器根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息,确定所述无人机的控制信息时,用于:
    根据所述手持控制设备的姿态信息和所述手持控制设备的参考姿态信息以及所述无人机的参考姿态信息,确定所述无人机的控制信息。
  104. 根据权利要求103所述的无人机,其特征在于,所述处理器还用于:
    将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息。
  105. 根据权利要求104所述的无人机,其特征在于,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态 信息时,用于:
    将初始化操作触发时所述手持控制设备的偏航角度作为所述手持控制设备的参考偏航角度,并将初始化操作触发时所述无人机的偏航角度作为所述无人机的参考偏航角度;
    所述手持式控制设备的参考俯仰角度、参考横滚角度为预设值。
  106. 根据权利要求104所述的无人机,其特征在于,所述处理器将初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息时,用于:
    当所述初始化操作触发时所述手持控制设备的姿态信息满足预设条件时,将所述初始化操作触发时所述手持控制设备的姿态信息作为所述手持控制设备的参考姿态信息,并将所述初始化操作触发时所述无人机的姿态信息作为所述无人机的参考姿态信息;
    否则,输出提示信息以提示用户调整所述手持控制设备的姿态。
  107. 根据权利要求83所述的无人机,其特征在于,所述处理器还用于:
    在所述无人机起飞到离地预设高度时,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  108. 根据权利要求83所述的无人机,其特征在于,所述处理器还用于:
    当所述无人机处于自动降落状态时,控制所述无人机的云台在俯仰方向上向下转动预设角度。
  109. 根据权利要求83所述的无人机,其特征在于,所述处理器还用于:
    当所述无人机处于自动降落状态时,若获取到的油门杆量大于预设油门杆量阈值,使能根据所述手持控制设备的姿态信息,确定所述无人机的控制信息。
  110. 一种无人机的控制方法,其特征在于,所述方法包括:
    获取无人机的控制信息,所述无人机的控制信息是根据手持控制设备的姿 态信息确定的,所述无人机的控制信息用于调整所述无人机的姿态或者调整所述无人机的云台的姿态;
    根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  111. 一种头戴设备,其特征在于,所述头戴设备包括:
    通信模块,用于获取无人机的控制信息,所述无人机的控制信息是根据手持控制设备的姿态信息确定的;
    一个或多个处理器,单独地或共同地工作,用于根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  112. 根据权利要求111所述的头戴设备,其特征在于,所述处理器执行根据所述无人机的控制信息在所述头戴设备的显示模块显示标记时,用于执行:
    根据所述无人机的控制信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
  113. 根据权利要求112所述的头戴设备,其特征在于,所述显示参数包括所述显示模块的画面比例和分辨率。
  114. 一种无人机的控制方法,其特征在于,所述方法包括:
    获取手持控制设备的姿态信息,所述手持控制设备的姿态信息用于确定所述无人机的控制信息,所述无人机的控制信息用于调整所述无人机的姿态或者调整所述无人机的云台的姿态;
    根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  115. 一种头戴设备,其特征在于,所述头戴设备包括:
    通信模块,用于获取手持控制设备的姿态信息;
    一个或多个处理器,单独地或共同地工作,用于根据所述手持控制设备的 姿态信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  116. 根据权利要求115所述的头戴设备,其特征在于,所述处理器根据所述手持控制设备的姿态信息在所述头戴设备的显示模块显示标记时,用于根据所述手持控制设备的姿态信息、所述显示模块的显示参数计算所述标记在所述显示模块上的像素坐标,以便在所述显示模块显示标记。
  117. 根据权利要求116所述的头戴设备,其特征在于,所述显示参数包括所述显示模块的画面比例和分辨率。
  118. 一种无人机的控制系统,其特征在于,所述控制系统包括:
    手持控制设备,用于获取所述手持控制设备的姿态信息,所述姿态信息用于确定无人机的控制信息;
    无人机,用于根据所述无人机的控制信息调整所述无人机的姿态或者调整所述无人机的云台的姿态;
    头戴设备,用于根据所述无人机的控制信息在所述头戴设备的显示模块显示标记,所述标记用于指示所述无人机的飞行方向。
  119. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如权利要求1-30中任一项所述的无人机的控制方法。
PCT/CN2021/077755 2020-12-25 2021-02-24 无人机及其控制方法、系统、手持控制设备、头戴设备 WO2022134301A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180006110.7A CN114641743A (zh) 2020-12-25 2021-02-24 无人机及其控制方法、系统、手持控制设备、头戴设备
US18/332,852 US20230341875A1 (en) 2020-12-25 2023-06-12 Unmanned aerial vehicle, control method and control system thereof, handheld control device, and head-mounted device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011567706.8 2020-12-25
CN202011567706 2020-12-25

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/332,852 Continuation US20230341875A1 (en) 2020-12-25 2023-06-12 Unmanned aerial vehicle, control method and control system thereof, handheld control device, and head-mounted device

Publications (1)

Publication Number Publication Date
WO2022134301A1 true WO2022134301A1 (zh) 2022-06-30

Family

ID=82157322

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/077755 WO2022134301A1 (zh) 2020-12-25 2021-02-24 无人机及其控制方法、系统、手持控制设备、头戴设备

Country Status (1)

Country Link
WO (1) WO2022134301A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020219A (zh) * 2016-05-17 2016-10-12 腾讯科技(深圳)有限公司 一种飞行器的控制方法和装置
CN108008730A (zh) * 2016-10-31 2018-05-08 广州亿航智能技术有限公司 无人机飞行控制方法及其系统
CN108170153A (zh) * 2017-12-19 2018-06-15 广州亿航智能技术有限公司 无人机飞行控制系统及其方法
CN207924888U (zh) * 2017-07-24 2018-09-28 深圳市大疆创新科技有限公司 遥控器和无人飞行器系统
CN109144378A (zh) * 2017-06-19 2019-01-04 中兴通讯股份有限公司 数据交互方法、装置、头戴设备和控制设备
WO2019040008A1 (en) * 2017-08-24 2019-02-28 Intensa, S. R.O. TECHNOLOGICAL EQUIPMENT FOR WORKING AT HEIGHT
CN112099529A (zh) * 2020-09-22 2020-12-18 苏州臻迪智能科技有限公司 虚拟现实设备控制系统和方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020219A (zh) * 2016-05-17 2016-10-12 腾讯科技(深圳)有限公司 一种飞行器的控制方法和装置
CN108008730A (zh) * 2016-10-31 2018-05-08 广州亿航智能技术有限公司 无人机飞行控制方法及其系统
CN109144378A (zh) * 2017-06-19 2019-01-04 中兴通讯股份有限公司 数据交互方法、装置、头戴设备和控制设备
CN207924888U (zh) * 2017-07-24 2018-09-28 深圳市大疆创新科技有限公司 遥控器和无人飞行器系统
WO2019040008A1 (en) * 2017-08-24 2019-02-28 Intensa, S. R.O. TECHNOLOGICAL EQUIPMENT FOR WORKING AT HEIGHT
CN108170153A (zh) * 2017-12-19 2018-06-15 广州亿航智能技术有限公司 无人机飞行控制系统及其方法
CN112099529A (zh) * 2020-09-22 2020-12-18 苏州臻迪智能科技有限公司 虚拟现实设备控制系统和方法

Similar Documents

Publication Publication Date Title
US11977380B2 (en) Safety system for operation of an unmanned aerial vehicle
JP6816156B2 (ja) Uav軌道を調整するシステム及び方法
US20200019189A1 (en) Systems and methods for operating unmanned aerial vehicle
WO2018209702A1 (zh) 无人机的控制方法、无人机以及机器可读存储介质
JP4012749B2 (ja) 遠隔操縦システム
WO2016192249A1 (zh) 一种飞行器的操控方法和装置
WO2018058320A1 (zh) 无人机控制方法及装置
JP6932405B2 (ja) 遠隔操縦システムおよびその操縦装置
KR20170090888A (ko) Hmd를 이용한 무인기 조종 장치
WO2021237481A1 (zh) 无人飞行器的控制方法和设备
JP6925671B1 (ja) 遠隔操縦システムおよびその操縦装置
US20230341875A1 (en) Unmanned aerial vehicle, control method and control system thereof, handheld control device, and head-mounted device
WO2022134301A1 (zh) 无人机及其控制方法、系统、手持控制设备、头戴设备
WO2022134321A1 (zh) 可移动平台的控制方法、体感遥控器及存储介质
EP3288828B1 (en) Unmanned aerial vehicle system and method for controlling an unmanned aerial vehicle
CN114641744A (zh) 控制方法、设备、系统及计算机可读存储介质
WO2022134299A1 (zh) 控制方法、设备、系统及计算机可读存储介质
WO2022134024A1 (en) Unmanned aerial vehicle with user-interactive components and a foldable structure
WO2022205116A1 (zh) 无人飞行器、控制终端、救机方法和救机系统
WO2021015201A1 (ja) 遠隔操縦システムおよびその操縦装置
WO2024009447A1 (ja) 飛行制御システム、及び飛行制御方法
JP7289152B2 (ja) 飛行制御システム
JP2021036452A (ja) Uav軌道を調整するシステム及び方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21908315

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21908315

Country of ref document: EP

Kind code of ref document: A1