WO2021217381A1 - 飞行提示方法、装置、控制终端、系统及存储介质 - Google Patents

飞行提示方法、装置、控制终端、系统及存储介质 Download PDF

Info

Publication number
WO2021217381A1
WO2021217381A1 PCT/CN2020/087339 CN2020087339W WO2021217381A1 WO 2021217381 A1 WO2021217381 A1 WO 2021217381A1 CN 2020087339 W CN2020087339 W CN 2020087339W WO 2021217381 A1 WO2021217381 A1 WO 2021217381A1
Authority
WO
WIPO (PCT)
Prior art keywords
drone
obstacle
information
prompt
icon
Prior art date
Application number
PCT/CN2020/087339
Other languages
English (en)
French (fr)
Inventor
唐梓清
张然
陈卓伟
李博文
杨舟
邹成
蒋一帆
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080005136.5A priority Critical patent/CN112771464A/zh
Priority to PCT/CN2020/087339 priority patent/WO2021217381A1/zh
Publication of WO2021217381A1 publication Critical patent/WO2021217381A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Definitions

  • This application relates to the technical field of drones, in particular to a flight prompt method, flight prompt device, control terminal, flight system and storage medium.
  • this application provides a flight prompt method, flight prompt device, flight system, control terminal, and storage medium to improve the safety of drone flight.
  • this application provides a flight prompt method, which is applied to a control terminal, the control terminal is used to control the flight of a drone, and the method includes:
  • an obstacle prompt icon is displayed at the bounding box of the interactive interface.
  • this application also provides a flight prompt method, which is applied to a control terminal, the control terminal is used to control the flight of a drone, and the method includes:
  • the display mode of the prompt icon is determined according to the movement information of the moving target.
  • the present application also provides a flight indication device, which is applied to a control terminal, and the flight indication device includes a processor and a memory;
  • the memory is used to store a computer program
  • the processor is configured to execute the computer program and, when executing the computer program, implement the steps of any one of the flight notification methods provided in the embodiments of the present application.
  • the present application also provides a control terminal, the control terminal including: a display device, a memory, and a processor;
  • the display device is used for display
  • the memory is used to store a computer program
  • the processor is configured to execute the computer program and, when executing the computer program, implement the steps of any one of the flight prompt methods provided in the embodiments of the present application.
  • this application also provides a flight system, which includes a drone and a control terminal according to any one of the embodiments of this application, and the control terminal is used to control the flight of the drone. .
  • the present application also provides a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, the processor realizes any of the The flight notification method described in the item.
  • the embodiments of the present application provide a flight prompt method, flight prompt device, system, control terminal, and storage medium, by displaying an interactive interface on the control terminal; obtaining obstacle information sensed by the drone; according to the obstacle Object information, an obstacle prompt icon is displayed at the bounding box of the interactive interface. This allows the user to clearly know the obstacles encountered by the drone and the obstacle information according to the obstacle prompt icon, which is convenient for the user to control the drone flight, thereby improving the safety of the drone flight and improving the user experience .
  • Fig. 1 is a schematic structural diagram of a flight system provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of steps of a flight notification method provided by an embodiment of the present application
  • 3a to 3c are schematic diagrams of display effects of interactive interfaces provided by embodiments of the present application.
  • FIGS. 4a to 4c are schematic diagrams of the position information of obstacles and drones provided by the present application.
  • FIG. 5 is a schematic diagram of angle information between obstacles and drones provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of the display effect of an obstacle prompt icon provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram showing the effect of another obstacle prompt icon display provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram showing the effect of another obstacle prompt icon display provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram showing the effect of another obstacle prompt icon display provided by the embodiment of the present application.
  • FIG. 10 is a schematic diagram showing the effect of another obstacle prompt icon display provided by an embodiment of the present application.
  • FIG. 11a and 11b are schematic diagrams of actual effects of the interactive interface provided by the embodiment of the present application.
  • FIGS. 12a and 12b are schematic diagrams showing the display effect of another obstacle prompt icon provided by an embodiment of the present application.
  • FIG. 13 is a schematic diagram showing the effect of another obstacle prompt icon display provided by an embodiment of the present application.
  • 15 is a schematic flowchart of steps of another flight prompt method provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram of the display effect of a prompt icon of a moving target provided by an embodiment of the present application.
  • FIG. 17 is a schematic diagram showing the effect of another moving target prompt icon display provided by an embodiment of the present application.
  • 18a and 18b are schematic diagrams of the actual effect of the display of the prompt icon of the moving target provided by the embodiment of the present application.
  • FIG. 19 is a schematic diagram showing the effect of another moving target prompt icon display provided by the embodiment of the present application.
  • FIG. 20 is a schematic diagram showing the effect of still another moving target prompt icon display provided by an embodiment of the present application.
  • FIG. 21 is a schematic flowchart of the steps of another flight notification method provided by an embodiment of the present application.
  • FIG. 22 is a schematic diagram of the effect of displaying a flight restriction and unbanning certificate provided by an embodiment of the present application.
  • FIG. 23 is a schematic flowchart of steps of yet another flight notification method provided by an embodiment of the present application.
  • FIG. 24 is a schematic diagram of the display effect of an authorization zone unblocking certificate provided by an embodiment of the present application.
  • FIG. 25 is a schematic diagram showing the effect of another type of authorization area unblocking certificate display provided by an embodiment of the present application.
  • FIG. 26 is a schematic diagram showing the effect of displaying another authorization zone release certificate provided by an embodiment of the present application.
  • FIG. 27 is a schematic diagram of the effect of a user verification display provided by an embodiment of the present application.
  • FIG. 28 is a schematic block diagram of a flight prompt device provided by an embodiment of the present application.
  • FIG. 29 is a schematic block diagram of a control terminal provided by an embodiment of the present application.
  • obstacles such as buildings, plants, pedestrians, etc.
  • special airspaces such as restricted height zones, no-fly zones, authorized areas, etc.
  • the embodiments of the present application provide a flight prompt method, a flight prompt device, a control terminal, a flight system, and a storage medium to solve the above-mentioned problems.
  • FIG. 1 is a schematic structural diagram of a flying system provided by an embodiment of the present application.
  • the flight system 100 includes a control terminal 10 and an unmanned aerial vehicle 20, and the control terminal 10 is in communication connection with the unmanned aerial vehicle 20 for controlling the flight of the unmanned aerial vehicle 10.
  • the control terminal 10 includes a display device 11, and the display device 11 is used to display an interactive interface.
  • the interactive interface can display the image transmission screen transmitted by the drone 20, and can also display a map screen.
  • the image transmission screen includes a shooting image of the drone, which is transmitted to the control terminal 10 through wireless image transmission technology, and the map image is a corresponding map when the drone 20 is flying.
  • the interactive interface may also include some control icons.
  • the control icons are specifically virtual keys for realizing the interaction between the user and the control terminal 10, or through the control terminal. 10 Realize the interaction with the UAV 10.
  • corresponding control instructions can be transmitted to the drone 20 to realize the user's control of the drone 20.
  • the drone 20 is controlled to perform the shooting function
  • the user clicks the return home button in the virtual buttons the drone 20 is controlled to perform the return home task.
  • the user when the user operates other virtual keys, he can view related parameters, such as viewing the flight route or flight parameters of the drone 20.
  • the screen can also be switched and displayed.
  • the switch button in the virtual button when the user clicks the switch button in the virtual button, the map screen and the image transmission screen are switched and displayed.
  • the flight parameters include flight speed, flight altitude, battery power and so on.
  • the display device 11 includes a display screen provided on the control terminal 10 or a display independent of the control terminal 10.
  • the display independent of the control terminal 10 may include a mobile phone, a tablet computer, a personal computer, etc., or may be a belt Other electronic devices with display screens.
  • the display includes LED display, OLED display, LCD display and so on.
  • the UAV 20 includes an obstacle sensing sensor 21, which is used to sense obstacles around the UAV 20 to obtain obstacle information.
  • the obstacle information includes azimuth information and/or distance information.
  • the position information refers to the position of the obstacle relative to the drone 20, such as directly in front, top left, top right, directly behind, bottom left and bottom right, etc.
  • distance information refers to the obstacle relative to the drone 20
  • the obstacle is the iron tower A, and the distance between the iron tower A and the drone 20 is 7m.
  • the obstacle sensing sensor 21 includes one or more sensors for sensing obstacles in one or more directions of the drone 20 information.
  • the obstacle sensing sensor 21 may include a direction sensor for sensing obstacle information in front of the drone 20.
  • the obstacle sensing sensor 21 may include two direction sensors, which are respectively used to sense obstacle information in the front and the rear of the drone 20.
  • the obstacle sensing sensor 21 may include four sensors, which are used to detect obstacles in the front, rear, left, and right of the drone 20, respectively.
  • an obstacle sensing sensor 21 can also be set on the rotating platform carried by the drone 20, and the obstacle sensing sensor 21 through the rotating platform can rotate relative to the drone to sense the drone. 20 Obstacle information in multiple directions.
  • the obstacle sensing sensor 21 includes a visual sensor, an ultrasonic sensor, a TOF sensor, a laser sensor, and so on.
  • the drone 20 may be a rotorcraft.
  • the drone 20 may be a multi-rotor aircraft that may include multiple rotors.
  • the multiple rotors can rotate to generate lifting force for the drone 20.
  • the rotor may be a propulsion unit, which allows the drone 20 to move freely in the air.
  • the rotor can rotate at the same rate and/or can generate the same amount of lift or thrust.
  • the rotor can rotate at different speeds at will, generate different amounts of lifting force or thrust, and/or allow the drone 20 to rotate.
  • one, two, three, four, five, six, seven, eight, nine, ten or more rotors may be provided on the drone 20.
  • These rotors can be arranged such that their rotation axes are parallel to each other.
  • the rotation axis of the rotors may be at any angle with respect to each other, which may affect the movement of the drone 20.
  • the drone 20 may include multiple rotors.
  • the rotor may be connected to the body of the drone 20, and the body of the drone 20 may include a control unit, an inertial measurement unit (IMU), a processor, a battery, a power supply, and/or other sensors.
  • the rotor may be connected to the body by one or more arms or extensions branching from the central part of the body. For example, one or more arms may extend radially from the central body of the drone 20, and may have rotors at or near the end of the arms.
  • the drone may be, for example, a quad-rotor drone, a hexa-rotor drone, or an eight-rotor drone.
  • it can also be a fixed-wing UAV, or a combination of a rotary-wing type and a fixed-wing UAV, which is not limited here.
  • the drone 20 is also provided with a photographing device.
  • the photographing device includes a camera or multiple cameras. For example, there are two cameras to form a binocular camera solution. The distance between the object and the drone.
  • the drone 20 is also provided with an ADS-B device (Automatic dependent surveillance-broadcast), through which an obstacle that is also provided with an ADS-B device can be detected, and the obstacle may specifically be Moving targets, such as manned aircraft.
  • ADS-B devices are usually installed in general manned aircraft.
  • the flight notification method provided by the embodiment of the present application will be introduced in detail in conjunction with the flight system in FIG. 1. It should be noted that the flight system in FIG. 1 is only used to explain the flight prompt method provided in the embodiment of the present application, but does not constitute a limitation on the application scenario of the flight control method provided in the embodiment of the present application.
  • FIG. 2 is a schematic flowchart of the steps of a flight notification method provided by an embodiment of the present application.
  • the flight prompt method is applied in the control terminal to show the user the obstacle information sensed by the drone, thereby improving the safety of the drone flight.
  • the flight notification method includes steps S101 to S103.
  • S101 Display the image transmission picture and/or map picture taken by the drone on the interactive interface of the control terminal;
  • the display device of the control terminal When the user uses the control terminal to control the flight of the drone, the display device of the control terminal will display an interactive interface, and the user controls the drone to fly through the interactive interface.
  • the interactive interface can also be used to display related content.
  • the interactive interface displays the image transmission screen shot by the drone; for example, the interactive interface also displays the map screen corresponding to the map used by the drone during the current flight; for another example, the interactive interface can also be used at the same time. Display image transmission screen and map screen.
  • the display screen of the display device 11 displays an interactive interface 12, which includes a bounding box 120, specifically including four bounding boxes 120.
  • the interactive interface 12 displays an image transmission. Picture 13.
  • the interactive interface 12 in FIG. 3b displays a map screen 14, and the flight icon of the drone 20 is also displayed on the map screen 14.
  • the interactive interface 12 displays the image transmission screen 13 and the map screen 14 at the same time.
  • the obstacles around the UAV can be sensed through the obstacle sensing sensor it carries, and the received sensing signals about the obstacles can be processed to obtain obstacle information.
  • the obstacle information is sent to the control terminal, so that the control terminal obtains the obstacle information sensed by the UAV.
  • the obstacle information includes azimuth information and/or distance information
  • the azimuth information is the direction of the obstacle relative to the drone
  • the distance information is the distance of the obstacle relative to the drone.
  • other information can be included, such as the shape information of obstacles.
  • the azimuth information is based on the flight direction of the UAV, that is, the specified flight direction is straight ahead.
  • the iron tower as an obstacle as an example to introduce.
  • the iron tower A is located directly in front of the UAV, that is, the azimuth information in the obstacle information is directly in front;
  • the iron tower B is located The right side of the drone, that is, the azimuth information in the obstacle information is the right;
  • the tower C is located on the right front of the drone, that is, the azimuth information in the obstacle information is the right; in Figure 4a, Figure 4b And in Figure 4c, d is the distance information.
  • the position information in order to let the user know the specific direction information of the obstacle, includes angle information.
  • a two-dimensional coordinate system is established, so that the angle of the obstacle relative to the drone can be determined
  • the angle of the iron tower 1 relative to the drone is ⁇ 1
  • the angle of the iron tower 2 relative to the drone is ⁇ 2
  • ⁇ 1 is 45°
  • ⁇ 2 is 135°.
  • an obstacle prompt icon is displayed at the bounding box of the interactive interface to remind the user that there are obstacles around the drone, and the user can be aware of the obstacle information, thereby preventing the user from performing misoperations.
  • the obstacle prompt icon is displayed in the bounding box, not only the obstacle information can be displayed to the user, but also the display content of the interactive interface can be avoided, and the user's use of the interactive interface will not be affected. This will not only improve the flight safety of the drone, but also It can also improve the user experience.
  • the obstacle prompt icon includes an obstacle prompt bar
  • the obstacle prompt bar is located in a bounding box of the interactive interface.
  • the obstacle prompt bar can reduce the obstruction of the content displayed on the interactive interface, and at the same time facilitate the display of obstacle information.
  • the image transmission screen or the map screen is displayed so as not to affect the display of the image transmission screen or the map screen to the greatest extent on the basis of displaying the obstacle information.
  • the obstacle reminder icon is an obstacle reminder bar as an example for introduction. It is understandable that, in some other embodiments, the obstacle prompt icon may not only be an obstacle prompt bar, but also other forms of icons, which are not limited here.
  • the obstacle prompt 121 may be displayed at the upper bounding box of the interactive interface 12.
  • the obstacle prompt 121 it is convenient for the user to know that there is an obstacle in front of the drone while watching the image transmission screen shot by the drone.
  • the drone includes a forward obstacle sensing sensor and/or a backward obstacle sensing sensor, so that it can sense that an obstacle may appear in front of or behind the drone.
  • displaying the obstacle prompt icon at the bounding box of the interactive interface specifically displaying the obstacle prompt icon at the upper bounding box and/or the lower bounding box of the interactive interface.
  • obstacle prompt bars 121 are displayed at the upper bounding box and the lower bounding box of the interactive interface 12, indicating that there are obstacles both in front of and behind the drone.
  • displaying an obstacle prompt icon at the boundary box of the interactive interface may specifically be: determining the target boundary in the multiple boundary boxes of the interactive interface according to the orientation information in the obstacle information And displaying an obstacle prompt icon at the target bounding box.
  • the azimuth information includes: obstacles are in any one of the front, rear, left and right of the drone; the target bounding box includes an upper bounding box, a lower bounding box, a left bounding box, and a right bounding box. Any one of the bounding boxes.
  • the front, the rear, the left and the right can be detected by the front obstacle sensing sensor, the rear obstacle sensing sensor, the left obstacle sensing sensor and/or the right obstacle sensing sensor installed on the drone. Sense separately.
  • the front, the rear, the left, and the right correspond to the upper bounding box, the lower bounding box, the left bounding box, and the right bounding box, respectively, so that the target bounding box can be determined.
  • the target bounding box is determined to be the upper bounding box in the multiple bounding boxes of the interactive interface, and an obstacle prompt icon is displayed at the upper bounding box , As shown in Figure 6.
  • obstacle tips can be displayed at the four bounding boxes of the interactive interface 12, as shown in Figure 8. Shown.
  • the width of the obstacle prompt bar may be set to be the same as the width of the bounding box used for displaying the obstacle prompt bar in the interactive interface.
  • the bounding box used for displaying the obstacle prompt bar in the interactive interface is an upper bounding box, and the width of the obstacle prompt bar is set to be the same as the width of the upper bounding box.
  • the width of the obstacle prompt bar may be set to be smaller than the width of the bounding box used for displaying the obstacle prompt bar in the interactive interface.
  • the bounding box used for displaying the obstacle prompt bar in the interactive interface 12 is an upper bounding box, and the width of the obstacle prompt bar is smaller than the width of the upper bounding box.
  • the position information of the obstacle can be determined by the position displayed by the obstacle prompt bar in the bounding box.
  • the obstacle prompt bar in Figure 9 is displayed in the middle of the upper bounding box, indicating that the obstacle is located in front of the drone; in Figure 10, the obstacle prompt bar is displayed on the top The left side of the bounding box indicates that the obstacle is located in the front left of the drone.
  • the obstacle prompt bar can be a certain transparent icon.
  • Figs. 11a and 11b are schematic diagrams of actual effects of the interactive interface provided by the embodiments of the application.
  • the interactive interface in FIG. 11a displays the image transmission screen 13
  • the obstacle prompt bar 121 is displayed at the upper and lower bounding boxes of the interactive interface.
  • the obstacle prompt bar 121 has a translucent effect, so the user experience can be improved.
  • an obstacle prompt bar is displayed on the interactive interface displayed by the control terminal to prompt the user that there are obstacles around the UAV.
  • the user does not need to do any operation, and the UAV can automatically avoid obstacles; of course, the user can also perform manual operations according to the prompt information to control the aircraft to fly for obstacle avoidance, thereby improving the flight safety of the UAV.
  • the UAV after the UAV completes automatic obstacle avoidance, it will continue to detect through the obstacle sensing sensor to determine whether the distance between the obstacle and the UAV is greater than the preset safe distance, or the UAV Whether there are obstacles around; if the distance information in the obstacle information is greater than the preset safe distance, or if the obstacle is not detected, the obstacle prompt icon is hidden.
  • the user can know that the drone is currently free of obstacles, and at the same time, it does not occupy the space of the interactive interface, thereby improving the user experience.
  • the obstacle prompt icon is displayed at the boundary box of the interactive interface.
  • the obstacle prompt icon displayed at the boundary box of the interactive interface can be determined according to the distance information in the obstacle information. Display color.
  • the display colors of different obstacle prompt bars indicate that the distance between the obstacle and the drone is different, so that the display color of the obstacle prompt bar can be changed to remind the user of obstacles. The distance of things.
  • the display color of the obstacle prompt bar in Figure 12a is lighter than the display color of the obstacle prompt bar in Figure 12b, indicating that the obstacle in Figure 12a and the obstacle in Figure 12b are farther from the drone, that is, the distance farther.
  • the determining the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface according to the distance information in the obstacle information is specifically: determining that the obstacle is relative to the drone If the distance of is less than the preset distance, if the distance of the obstacle relative to the drone is less than the preset distance, the preset color corresponding to the preset distance is determined as the display color of the obstacle prompt icon.
  • the preset distance is a safe distance. If the distance between the obstacle and the drone is less than the preset distance, it indicates that there is a potential safety hazard in the drone flight, so it is necessary to remind the user.
  • the preset distance is 6m
  • the preset color corresponding to the preset distance of 6m includes yellow, which has a warning effect.
  • the display color of the obstacle prompt icon is adjusted to yellow to prompt the user.
  • the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface determines the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface. Specifically, it can be: when it is determined that the drone is in an emergency hovering state, The preset color corresponding to the emergency hovering state is determined as the display color of the obstacle prompt icon; wherein, the emergency hovering state is the hovering state entered by the drone due to an obstacle.
  • the preset color corresponding to the emergency hovering state includes red, and red has a warning function.
  • the preset color corresponding to the emergency hovering state presents a dynamic diffusion effect. For example, when the drone enters the hovering state due to an obstacle, the obstacle prompt icon is displayed in red, and the displayed red is diffused, thereby effectively prompting the user.
  • the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface may be further output to prompt the user that there is an obstacle near the drone
  • the prompt information includes at least one of vibration prompt information, voice prompt information, and text prompt information.
  • the vibration prompt information can also be output through the control terminal, or the voice prompt information can be broadcast through the control terminal, or the display of the control terminal
  • the device displays text prompt messages.
  • the displaying an obstacle prompt icon at the boundary box of the interactive interface according to the obstacle information may specifically include: first determining a target position in the obstacle prompt icon according to the orientation information in the obstacle information, and then The display color of the obstacle indication icon at the target position is determined according to the distance information.
  • the target position is at the position of the obstacle prompt icon, which can indicate the direction information of the obstacle, and then it is displayed at the target position in different colors, which can attract the user's attention and achieve better results. Prompt effect.
  • the right position of the obstacle prompt bar 121 displayed on the upper bounding box of the interactive interface 12 is determined Is the target position, and then the display color at the target position is determined according to the distance. For example, if the distance is far, it can be displayed in green, indicating that it is within the safe range; for example, when the distance is close to the safe range, it can be displayed in yellow, indicating that the drone is approaching; for example, if the distance is less than the safe range, it can be displayed in red, indicating that the drone is In a dangerous state.
  • the obstacle prompt 121 can be divided into three areas according to the obstacles that may be located on the upper left, front, and upper right of the drone, respectively, area 1211, area 1212, and area 1213, corresponding to the upper left , Front and upper right. Therefore, the area corresponding to the orientation information can be determined as the target location based on the division method and the orientation information in the obstacle information.
  • the corresponding area 1211 is determined as the target position, and the area 1211 is displayed in a different color from other areas to indicate the orientation information of the obstacle.
  • the display color of the target position can also be adjusted according to the distance information in the obstacle information.
  • the display color of the area 1211 is changed to indicate the distance change of the obstacle relative to the drone, so that the user can observe the color change of the obstacle prompt bar at different positions, namely Can know the location information and distance information of obstacles.
  • the UAV in order to facilitate the user to know the specific location of the obstacle, the UAV may also be used to measure the deviation angle of the obstacle relative to the UAV. Therefore, on the obstacle prompt bar, the scale value can also be used to indicate the angle information.
  • the scale on the obstacle prompt bar 121 can be used to indicate the angle information of the obstacle relative to the drone. In practical applications, only the angle information of the obstacle relative to the drone is required. Mapping on the scale on the obstacle prompt bar 121 can prompt the user.
  • the angular range corresponding to one of the bounding boxes is consistent with the obstacle perception range of the UAV in one direction.
  • the obstacle perception range of the drone in front of the drone is 30 degrees left and right, a total of 60 degrees
  • the obstacle perception angle represented by the upper bounding box of the interactive interface is also 60 degrees
  • the obstacle The perception angles are distributed on an average scale.
  • the length of the obstacle indicator bar is related to the distribution of obstacles. The wider the distribution within the obstacle sensing range, the longer the length of the obstacle indicator bar on the bounding box.
  • the drone in order to more effectively remind the user that there are obstacles around the drone, and the obstacles are dangerous.
  • the obstacle information sensed by the drone it may be determined whether the drone triggers an early warning condition according to the obstacle information, and the early warning condition is used to trigger the display of an obstacle prompt icon; If the drone triggers the early warning condition, an obstacle reminder icon is displayed at the boundary box of the interactive interface; if the drone does not trigger the early warning condition, it is not displayed at the boundary box of the interactive interface Obstacle reminder icon.
  • determining whether the drone triggers an early warning condition according to the obstacle information can be specifically determined by determining whether the distance information in the obstacle information is less than or equal to a preset safe distance; if the obstacle information is If the distance information is less than or equal to the preset safety distance, it is determined that the drone triggers an early warning condition.
  • the determination can also be combined with the position information, for example, if the obstacle is in the flying direction of the drone and the distance information is less than or equal to the preset safety distance. Distance, it is determined that the drone triggers an early warning condition.
  • the obstacles may be moving targets.
  • the obstacle information includes motion information of a moving target, wherein the motion information includes at least one of a motion speed, a relative height, a relative distance, and a motion direction, and the relative height is the relative height of the moving target.
  • the height of the drone, and the relative distance is the distance of the moving target relative to the drone.
  • the obstacle reminder icon can also be displayed at the boundary box of the interactive interface to prompt the user to move around the drone.
  • the movement information of the target and the moving target can also be displayed at the boundary box of the interactive interface to prompt the user to move around the drone.
  • the obstacle prompt bar For example, use the position displayed by the obstacle prompt bar, or display different colors in different areas of the obstacle prompt bar to indicate the moving direction of the moving target; or use the obstacle prompt bar to display different colors to indicate that the moving target is relative to the drone Or, use the moving direction, speed, and color change of the obstacle prompt bar to roughly get the movement information of the moving obstacle.
  • the user may be prompted to have moving targets around the drone and movement information of the moving targets.
  • Other flight prompt methods can also be used to prompt the user.
  • FIG. 15 is a schematic flowchart of the steps of another flight notification method provided by an embodiment of the present application.
  • the flight prompt method is applied in a control terminal to solve the problem of obstacles as moving targets, thereby improving the safety of UAV flight.
  • the flight notification method includes steps S201 to S203.
  • S203 Determine a display mode of the prompt icon according to the movement information of the moving target.
  • the movement information includes at least one of a movement speed, a relative height, a relative distance, and a movement direction; the relative height is the height of the moving target relative to the drone, and the relative distance is the moving target The distance relative to the drone.
  • the UAV can sense the motion information of the moving target through the obstacle sensing sensor, and send the sensed motion information of the moving target to the control terminal, so that the control terminal can obtain the UAV sensing The movement information of the moving target.
  • the prompt icon corresponding to the moving target may be displayed in the interactive interface displayed by the control terminal, and the determination is made according to the motion information of the moving target
  • the display mode of the prompt icon includes, for example, determining the display color and display position of the prompt icon.
  • the prompt icon corresponding to the moving target is displayed in yellow.
  • the prompt icon can be changed.
  • the display color such as red, prompts the user to move distance information or distance change information.
  • the moving target may specifically be a manned airplane
  • the obstacle prompt icon includes an airplane icon, so that the airplane icon may be displayed at the boundary box of the interactive interface according to the movement information of the manned airplane.
  • the movement information of the manned aircraft is obtained through an ADS-B device.
  • the movement information may be displayed near the aircraft icon.
  • the movement information can be displayed in the form of a bullet frame display. It should be noted that part of the movement information can be displayed, such as movement speed and movement direction; and all movement information can be displayed, such as movement speed, relative height, relative distance, and movement direction.
  • the interactive interface includes the map screen, and the map screen is a map used when the drone is flying. It is also possible to display a prompt icon corresponding to the moving target on the map screen according to the motion information of the moving target. By displaying it on the map screen, users can more intuitively understand the surrounding moving targets and movement of the drone. Of course, the prompt icon of the moving target can also be displayed in the bounding box of the interactive interface.
  • the interactive interface 12 displays the image transmission screen 13 and the map screen 14.
  • the map screen 14 displays the flight icon 141 of the drone 20, and the manned aircraft is displayed on the map screen 14.
  • the prompt icon 142 can allow the user to more intuitively understand the surrounding moving targets and movement of the drone.
  • the display color of the bounding box of the map screen may also be changed. Changing the color can effectively remind the user that there are moving targets around the current drone.
  • the display color of the bounding box of the map screen 14 is changed in FIG. 17, specifically, for example, it is displayed as yellow, and yellow has a warning effect to remind the user .
  • the map screen in order to facilitate the user to watch the map screen, so as to improve the user's experience. It is also possible to detect whether the user performs a switching operation on the map screen, and if it is detected that the user performs a switching operation on the map screen, the map screen and the image transmission screen are switched and displayed.
  • the switching operation includes one of a tap operation, a double tap operation, a sliding operation, and a pressing operation.
  • the map screen includes a switch button; if it is detected that the user has operated the switch button, the map screen and the image transmission screen are switched and displayed. The details are shown in Figure 18a and Figure 18b.
  • the interactive interface displays the image transmission screen 13 and the map screen 14 at the same time.
  • the image transmission screen 13 is displayed on a large screen
  • the map screen 14 is displayed on a small screen
  • the map screen 14 includes a switch button 140.
  • the switch button 140 When the user clicks the switch button 140, the map screen 14 and the image transmission screen 13 are switched and displayed, that is, the map screen 14 is displayed on a large screen and the image transmission screen 13 is displayed on a small screen after switching.
  • the large-screen display includes a full-screen display, etc.
  • the small-screen display specifically refers to a smaller display size than the large-screen display.
  • the flight prompt method can also display text prompt information when detecting a manned aircraft around the drone.
  • the text prompt message is displayed on the displayed image transmission screen to remind the user that there is a manned aircraft around the drone. airplane.
  • text prompt messages such as "a manned aircraft nearby” and "a manned aircraft nearby, please fly with caution” are displayed in two display boxes, respectively.
  • the location near the prompt icon of the moving target displayed on the map screen The movement information is displayed at the location.
  • the exercise information may not be displayed on the map screen displayed on the small screen, and the exercise information may be displayed on the map screen after switching to the large screen display.
  • three airplane icons are displayed on the map screen 14 displayed on the large screen, namely, an airplane icon 1421, an airplane icon 1422, and an airplane icon 1423.
  • the movement information is displayed at a position close to the airplane icon 1421, and specifically the movement information is displayed in a bullet frame.
  • H represents the relative height of the manned aircraft and the UAV
  • D represents the relative distance between the manned aircraft and the UAV
  • S represents the flight speed of the manned aircraft. This facilitates users to learn more information, thereby improving user experience.
  • the take-off point position and current flight position of the drone may also be displayed on the map screen, and/or displayed Describe the flight trajectory of the drone.
  • the location of the drone's flight icon 141 is the current flight location
  • the take-off point location is the location of point H on the map screen 14
  • the trajectory 1410 is the flight trajectory of the drone. This allows users to learn more about drone flight information in order to make corresponding operations.
  • the obstacle corresponding to the obstacle is a moving target.
  • the display mode of the prompt icon of the moving target may be determined according to the motion information of the moving target. More specifically, the risk level of the moving target is determined according to the motion information of the moving target; and the display mode of the prompt icon is determined according to the risk level. Wherein, the display colors of the prompt icons corresponding to different risk levels are different.
  • three manned aircrafts correspond to three aircraft icons, namely aircraft icon 1421, aircraft icon 1422 and aircraft icon 1423, and then determine three manned aircrafts (aircraft 1, aircraft The hazard levels of aircraft 2 and aircraft 3) are level I, level II, and level III respectively, of which level I has the highest hazard level.
  • Different aircraft icons have different display colors, which are used to indicate different levels of danger, thereby prompting the user of different levels of danger of different manned aircraft.
  • the danger level of the moving target is determined, and it can be determined whether the moving target will approach the drone or how long will it take according to the moving direction and speed of the moving target's motion information There is no one to determine the degree of danger of the moving target.
  • the drone since the drone is also moving, it is also necessary to obtain the movement information of the drone.
  • the danger level of the moving target according to the flight trajectory of the UAV and the manned aircraft Such as determining the degree of danger based on whether it is possible to approach the drone and the distance of the approach.
  • the danger level can also be determined according to the distance range, for example, as shown in Table 1:
  • Table 1 shows the corresponding relationship between the distance range and the degree of danger
  • Grade I indicates the highest degree of danger, which is greater than Grade II, Grade III and Grade IV.
  • the level IV may indicate the security level, and the security level may not display the prompt icon of the moving target on the map screen. It should be noted that Table 1 is only an example of the principle, and does not constitute a limitation on the value setting of the actual application, and the specific setting can be set according to the actual scenario.
  • a risk level evaluation model can be used to determine the risk level of different moving targets. Specifically, the motion information of the drone and the motion information of the moving target are input into the risk level assessment model for simulation evaluation, and The danger level of the moving target.
  • the risk level assessment model may include some formula algorithms, or may be a machine learning model obtained by training using a neural network, which is not limited here.
  • the prompt icon includes a shape icon for representing the moving target.
  • the prompt icon is specifically represented by an aircraft icon, so that the user can know the type of the moving target according to the shape icon.
  • the prompt icon includes a shape icon and a ring icon
  • the shape icon is used to represent the moving target
  • the ring icon is used to represent the actual position range of the moving target
  • the shape icon is located in the ring-shaped icon.
  • the circular icon can also be displayed in different colors to indicate the degree of danger of different moving targets.
  • the restricted-flying area can be divided into multiple types of restricted-flying areas according to the requirements of different countries and regions, such as the national restricted-flying area, the height-restricted area (such as the 120M height restriction), and the special restricted-flying area (circular). Or polygon), the authorization area is lifted, and so on.
  • the national restricted-flying area such as the 120M height restriction
  • the special restricted-flying area circular. Or polygon
  • FIG. 21 is a schematic flowchart of the steps of another flight notification method provided by an embodiment of the present application.
  • the flight prompt method is applied in the control terminal to solve the problem of the restricted flight zone, thereby improving the user experience.
  • the flight notification method includes step S301 and step S302.
  • the flight restriction release certificate you need to apply for the flight restriction release certificate in advance from the official website, and download the requested flight restriction release certificate from the server directly to the local through the application on the control terminal, and upload it to the aircraft through the application to release the ban.
  • the certificate becomes effective, and the ban in the restricted-flying zone is lifted.
  • the aircraft can fly in the area specified by the certificate, without being restricted by the restricted-flying zone over the area.
  • the application program in the control terminal is an application program for controlling the flight of the aircraft, and it can be connected to the server of the official website to download some unbanned certificates or software versions.
  • the obtained certificate identification of the flight restriction and unblocking certificate and the corresponding sending button can be displayed in the interactive interface.
  • the sending button is specifically to import the aircraft, and it is detected whether the user clicks on the "import aircraft" Press the button, and if it is detected that the user has operated the sending button, the flight restriction and unblocking certificate is sent to the drone.
  • the imported aircraft display text displays "Imported", thereby prompting the user that the import has been successful, thereby improving the user experience.
  • Obtaining a flight restriction and unbanning certificate may specifically obtain a flight restriction and unbanning certificate set corresponding to the drone, and the flight restriction and unbanning certificate set includes a plurality of flight restriction and unbanning certificates.
  • the UAV Mavic Mini includes at least three flight restriction release certificates, all of which are displayed in the interactive interface. Due to the selection of which flight restriction release certificate is imported, the user experience is improved.
  • steps S301 and S302 provided in FIG. 21 can be applied before or after the drone encounters a fixed obstacle, such as before step S101, or after step S103; or, as shown in FIG. 21
  • the steps S301 and S302 provided can be applied before or after the drone encounters a moving obstacle, for example, before step S201, or after step S203.
  • the choice of specific application scenarios depends on actual needs.
  • FIG. 23 is a schematic flowchart of the steps of another flight notification method provided by an embodiment of the present application.
  • the flight prompt method is applied in the control terminal to solve the problem of the authorized area, thereby improving the user experience.
  • the flight notification method includes step S401 and step S402.
  • the unmanned aerial vehicle stores an authorization zone unblocking certificate corresponding to the certificate identifier.
  • the authorized area is relatively less restrictive than the restricted-flying zone. Users are allowed to choose to lift the ban according to their own choice, so that the authorized zone-unblocking certificate can be stored in the drone to improve the efficiency of unblocking.
  • the certificate identification of the authorization zone release certificate and the corresponding activation button may be displayed in the interactive interface; it is detected whether the user operates the activation button, and if it is detected that the user operates the activation button, the The certificate identifier generates an authorization instruction, and sends the authorization instruction to the drone.
  • the certificate identifiers corresponding to two authorized areas are displayed in the aircraft in-plane certificate interface of the interactive interface, which are New Matamoras 3 and New Matamoras 4, and the corresponding activation buttons after each certificate identifier.
  • an authorization instruction is generated according to the certificate identifier, and the authorization instruction is sent to the drone, so that the certificate identifier in the authorization instruction of the drone can be found and obtained According to the corresponding authorized area certificate, the authorization area corresponding to the certificate identifier is unlocked according to the authorized area certificate.
  • the current location of the drone can also be obtained, and a map corresponding to the current location of the drone can be displayed on the interactive interface of the control terminal, and the authorized area can be displayed on the map. Describe the corresponding area on the map.
  • the certificate information of the authorization area release certificate corresponding to the authorization area may also be displayed at a preset location on the map.
  • the area 144 corresponding to the authorized area on the map is displayed on the map.
  • the area 144 is a circular area. You can also click the authorization area release certificate to view the authorization.
  • the detailed information of the zone unbanned certificate, such as location, scope, validity period, etc., is shown in certificate information 145.
  • the flight prompt method before sending an authorization instruction to the drone, the flight prompt method further includes: obtaining the current position of the drone; if the current position of the drone meets the position of the authorized zone When the authorization conditions are preset, the location identifier corresponding to the authorization area and the corresponding authorization button are displayed in a pop-up box on the image transmission screen or the map screen; if it is detected that the user operates the authorization button, the authorization area The corresponding certificate identification generates an authorization instruction.
  • the current location of the drone and the location of the authorized area meet preset authorization conditions, specifically: determining whether the current location of the drone and the location of the authorized area are within a preset range, if the unmanned If the current location of the drone and the location of the authorized area are within the preset range, it is determined that the current location of the drone and the location of the authorized area meet the preset authorization conditions.
  • the preset range is within 2m, which means that the drone has approached the authorized area.
  • the authorization instruction is generated according to the certificate identifier corresponding to the authorized area, and the user can also be verified, and after the verification is passed, the authorization instruction is generated according to the certificate identifier corresponding to the authorized area.
  • the pop-up display includes the certificate identifier corresponding to at least one authorization zone unlocking certificate and the corresponding unlocking button "unlock".
  • the unlocking button When it is detected that the user clicks on the unlocking button, it jumps to the interface in FIG. 27 , Display the verification code input box, if the user enters the correct verification code within the specified time, the unlocking is successful and the verification of the user is completed, thereby improving the information security.
  • another verification method may be selected, such as using voice verification, thereby improving the user experience.
  • user verification includes SMS verification and voice verification, as well as email verification, fingerprint verification, password verification, and ID verification.
  • steps S401 and S402 provided in FIG. 23 can be applied before or after the drone encounters a fixed obstacle, such as before step S101, or after step S103; or, as shown in FIG. 23
  • the steps S401 and S402 provided can be applied before or after the drone encounters a moving obstacle, for example, before step S201, or after step S203.
  • the selection of specific application scenarios depends on actual needs.
  • the flight prompt method provided in the above embodiment can prompt the user when the drone encounters different obstacles, so as to avoid the user from performing misoperations. As a result, the safety of drone flight can be improved, and at the same time, the user experience can be improved.
  • FIG. 28 is a schematic block diagram of a flight notification device provided by an embodiment of the present application.
  • the flight prompt device can be applied to a control terminal.
  • the flight notification device 500 includes a processor 501 and a memory 502, and the processor 501 and the memory 502 are connected by a bus, such as an I2C (Inter-integrated Circuit) bus.
  • the flight prompting device 500 is applied to a control terminal, which communicates with the UAV and is used to control the flight of the UAV.
  • control terminal includes a display device.
  • the display device may be a liquid crystal display or a touch screen.
  • control terminal includes a carrier platform for carrying a display device. It is installed on the bearing platform and establishes a communication connection between the control terminal and the display device.
  • the processor 501 may be a micro-controller unit (MCU), a central processing unit (CPU), a digital signal processor (Digital Signal Processor, DSP), or the like.
  • MCU micro-controller unit
  • CPU central processing unit
  • DSP Digital Signal Processor
  • the memory 502 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.
  • the processor is configured to run a computer program stored in a memory, and when executing the computer program, implement any one of the flight prompt methods provided in the embodiments of the present application.
  • the processor is configured to run a computer program stored in a memory, and implement the following steps when the computer program is executed:
  • the obstacle information includes azimuth information and/or distance information
  • the azimuth information is the direction of the obstacle relative to the drone
  • the distance information is the direction of the obstacle relative to the drone. distance.
  • the orientation information includes angle information.
  • the drone includes a forward obstacle sensing sensor and/or a backward obstacle sensing sensor; the displaying an obstacle prompt icon at the boundary box of the interactive interface includes: The obstacle prompt icon is displayed at the upper bounding box and/or the lower bounding box of the interface.
  • the displaying an obstacle prompt icon at the bounding box of the interactive interface according to the obstacle information includes: according to the orientation information in the obstacle information, displaying the obstacle prompt icon on the interactive interface.
  • a target bounding box is determined in the bounding box; and an obstacle prompt icon is displayed at the target bounding box.
  • the drone includes a forward obstacle sensing sensor, a backward obstacle sensing sensor, a left obstacle sensing sensor, and/or a right obstacle sensing sensor;
  • the orientation information includes: obstacles In any one of the front, rear, left, and right of the drone;
  • the target bounding box includes any one of an upper bounding box, a lower bounding box, a left bounding box, and a right bounding box.
  • the obstacle prompt icon includes an obstacle prompt bar, and the obstacle prompt bar is located in a bounding box of the interactive interface.
  • the width of the obstacle prompt bar is the same as the width of the bounding box for displaying the obstacle prompt bar in the interactive interface; or the width of the obstacle prompt bar is smaller than that of the interactive interface Is used to display the width of the bounding box of the obstacle prompt bar.
  • the obstacle prompt bar is a semi-transparent icon or a transparent icon.
  • the processor is further configured to: if the distance information in the obstacle information is greater than a preset safe distance, or if an obstacle is not detected, hide the obstacle prompt icon.
  • the displaying an obstacle prompt icon at the boundary box of the interactive interface according to the obstacle information includes:
  • the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface is determined.
  • the determining the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface according to the distance information in the obstacle information includes:
  • the preset color corresponding to the preset distance is determined as the display color of the obstacle prompt icon.
  • the preset color corresponding to the preset distance includes yellow.
  • the determining the display color of the obstacle prompt icon displayed at the bounding box of the interactive interface according to the distance information in the obstacle information includes:
  • the preset color corresponding to the emergency hovering state is determined as the display color of the obstacle prompt icon; wherein, the emergency hovering state is the unmanned The hovering state of the machine due to obstacles.
  • the preset color corresponding to the emergency hovering state includes red, or the preset color corresponding to the emergency hovering state presents a dynamic diffusion effect.
  • the processor further implements:
  • the prompt information includes at least one of vibration prompt information, voice prompt information, and text prompt information.
  • the displaying an obstacle prompt icon at the boundary box of the interactive interface according to the obstacle information includes:
  • the processor after obtaining the obstacle information sensed by the drone, the processor further implements:
  • the obstacle information it is determined whether the drone triggers an early warning condition, the early warning condition is used to trigger the display of an obstacle prompt icon; if the drone triggers the early warning condition, it is displayed in the bounding box of the interactive interface The obstacle reminder icon is displayed everywhere.
  • the determining whether the drone triggers an early warning condition according to the obstacle information includes:
  • the obstacle information includes movement information of a moving target.
  • the movement information includes at least one of movement speed, relative height, relative distance, and movement direction; wherein, the relative height is the height of the moving target relative to the drone, and the relative The distance is the distance of the moving target relative to the UAV.
  • the moving target includes a manned aircraft
  • the obstacle prompt icon includes an aircraft icon
  • the movement information of the manned aircraft is obtained through an ADS-B device.
  • the processor further implements: displaying the motion information near the airplane icon.
  • the interactive interface includes the map screen, and the map screen is a map used when the drone is flying.
  • the processor further implements: displaying a prompt icon corresponding to the moving target on the map screen.
  • the processor further implements: changing the display color of the bounding box of the map screen.
  • the processor further implements: if it is detected that the user performs a switching operation on the map screen, switch and display the map screen and the image transmission screen.
  • the map screen includes a switch button; the processor further implements:
  • the map screen and the image transmission screen are switched and displayed.
  • the processor after switching the display of the map screen and the image transmission screen, the processor further implements:
  • the movement information is displayed at a position close to the prompt icon of the moving target displayed on the map screen.
  • the processor after switching the display of the map screen and the image transmission screen, the processor further implements:
  • the displaying an obstacle prompt icon at the boundary box of the interactive interface according to the obstacle information includes:
  • the determining the display mode of the prompt icon of the moving target according to the movement information of the moving target includes: determining the danger level of the moving target according to the moving information of the moving target; and according to the danger The degree level determines the display mode of the prompt icon.
  • the display colors of the prompt icons corresponding to different risk levels are different.
  • the prompt icon includes a shape icon for representing the moving target.
  • the prompt icon includes a shape icon for representing the moving target and a ring icon for representing the actual position range of the moving target, wherein the shape icon is located in the ring icon.
  • the processor further implements:
  • the processor further implements:
  • the obtained certificate identifier of the flight restriction and unblocking certificate and the corresponding sending button are displayed; if it is detected that the user has operated the sending button, the flight restriction and unblocking certificate is sent to the drone.
  • the obtaining the flight restriction lifting certificate includes:
  • the flight restriction and ban release certificate set includes a plurality of flight restriction and ban release certificates.
  • the processor further implements:
  • the certificate identification corresponding to the authorization area is displayed on the interactive interface; if an authorization sending operation triggered by the user is detected, an authorization instruction is sent to the drone, so that the drone is unbanned according to the certificate identification in the authorization instruction
  • the authorization area corresponding to the certificate identifier wherein the unmanned aerial vehicle stores an authorization area release certificate corresponding to the certificate identifier.
  • the processor further implements:
  • the certificate identifier of the unbanned certificate in the authorization area and the corresponding activation button are displayed; if it is detected that the user operates the activation button, an authorization instruction is generated based on the certificate identifier, and the authorization instruction is sent to all The drone.
  • the processor further implements:
  • a map corresponding to the current location of the drone is displayed, and the area corresponding to the authorized area on the map is displayed on the map.
  • the processor further implements:
  • the processor before the sending an authorization instruction to the drone, the processor further implements:
  • the bullet frame corresponding to the authorized area is displayed on the image transmission screen or the map screen.
  • the generating the authorization instruction according to the certificate identifier corresponding to the authorization area includes:
  • the user is verified, and an authorization instruction is generated according to the certificate identifier corresponding to the authorization area after the verification is passed.
  • the verification of the user includes one of SMS verification, email verification, voice verification, fingerprint verification, password verification, and ID verification.
  • the current location of the drone and the location of the authorized area meet preset authorization conditions, including:
  • the processor is configured to run a computer program stored in a memory, and implement the following steps when the computer program is executed:
  • the movement information includes at least one of movement speed, relative height, relative distance, and movement direction; wherein, the relative height is the height of the moving target relative to the drone, and the relative The distance is the distance of the moving target relative to the UAV.
  • the determining the display mode of the prompt icon according to the movement information of the moving target includes:
  • the display colors of the prompt icons corresponding to different risk levels are different.
  • the prompt icon includes a shape icon, and the shape icon is used to represent the moving target.
  • the prompt icon includes a shape icon and a ring icon, wherein the shape icon is located in the ring icon, the shape icon is used to represent the moving target, and the ring icon is Yu represents the actual position range of the moving target.
  • the moving target includes a manned aircraft
  • the prompt icon includes an aircraft icon
  • the movement information of the manned aircraft is obtained through an ADS-B device.
  • the processor further implements: displaying the motion information near the prompt icon.
  • the interactive interface includes the map screen and/or the image transmission screen, the map screen is a map used when the drone is flying, and the image transmission screen is the drone. The picture taken.
  • the processor further implements: changing the display color of the bounding box of the map screen.
  • the processor further implements:
  • the map screen and the image transmission screen are switched and displayed.
  • the map screen includes a switch button, and the processor further implements:
  • the map screen and the image transmission screen are switched and displayed.
  • the processor after switching the display of the map screen and the image transmission screen, the processor further implements:
  • the movement information is displayed at a position close to the prompt icon corresponding to the moving target with the highest risk level.
  • the processor after switching the display of the map screen and the image transmission screen, the processor further implements:
  • the processor further implements:
  • a flight icon corresponding to the drone is displayed on the map screen, and the flight icon is used to indicate the current flight position and flight direction of the drone.
  • the processor after obtaining the motion information of the moving target sensed by the drone, the processor further implements:
  • the prompt information includes at least one of vibration prompt information, voice prompt information, text prompt information, and interface change information.
  • the processor further implements:
  • the processor further implements:
  • the certificate identifier of the acquired flight restriction and unbanning certificate and the corresponding sending button are displayed in the interactive interface; if it is detected that the user has operated the sending button, the flight restriction and unbanning certificate is sent to the drone.
  • the obtaining the flight restriction lifting certificate includes:
  • the flight restriction and ban release certificate set includes a plurality of flight restriction and ban release certificates.
  • the processor further implements:
  • the certificate identification corresponding to the authorization area is displayed on the interactive interface; if an authorization sending operation triggered by the user is detected, an authorization instruction is sent to the drone, so that the drone is unbanned according to the certificate identification in the authorization instruction
  • the authorization area corresponding to the certificate identifier wherein the unmanned aerial vehicle stores an authorization area release certificate corresponding to the certificate identifier.
  • the processor further implements:
  • the certificate identifier of the unbanned certificate in the authorization area and the corresponding activation button are displayed; if it is detected that the user operates the activation button, an authorization instruction is generated based on the certificate identifier, and the authorization instruction is sent to all The drone.
  • the processor further implements:
  • a map corresponding to the current location of the drone is displayed, and the area corresponding to the authorized area on the map is displayed on the map.
  • the processor further implements:
  • the processor before the sending an authorization instruction to the drone, the processor further implements:
  • the bullet frame corresponding to the authorized area is displayed on the image transmission screen or the map screen.
  • the generating the authorization instruction according to the certificate identifier corresponding to the authorization area includes:
  • the user is verified, and an authorization instruction is generated according to the certificate identifier corresponding to the authorization area after the verification is passed.
  • the verification of the user includes one of SMS verification, email verification, voice verification, fingerprint verification, password verification, and ID verification.
  • the current location of the drone and the location of the authorized area meet preset authorization conditions, including:
  • FIG. 29 is a schematic block diagram of a flight control terminal according to an embodiment of the present application.
  • the control terminal 600 includes a processor 601, a memory 602, and a display device 603.
  • the memory 602 and the display device 603 are connected to the processor 601 through a bus, such as an I2C (Inter-integrated Circuit) bus.
  • the control terminal 600 communicates with the drone, and is used to control the flight of the drone.
  • the display device 603 is used for display, for example, for displaying an interactive interface, an image transmission screen, a map screen, and so on.
  • the display device 603 includes a display screen provided on the control terminal or a display independent of the control terminal.
  • the display independent of the control terminal may include a mobile phone, a tablet computer, a personal computer, etc., or may also be other electronic equipment with a display screen.
  • the display includes LED display, OLED display, LCD display, etc.
  • the processor 601 may be a micro-controller unit (MCU), a central processing unit (CPU), a digital signal processor (Digital Signal Processor, DSP), or the like.
  • MCU micro-controller unit
  • CPU central processing unit
  • DSP Digital Signal Processor
  • the memory 602 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.
  • the processor is configured to run a computer program stored in a memory, and when executing the computer program, implement any one of the flight prompt methods provided in the embodiments of the present application.
  • the embodiment of the present application also provides a flight system.
  • the flight system includes a control terminal 10 and a drone 20.
  • the control terminal 10 is used to control the flight of the drone 20 and execute the application. Any of the flight prompt methods provided in the embodiments.
  • the embodiments of the present application also provide a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes program instructions, and the processor executes the program instructions to implement the foregoing implementation Examples provide the steps of any of the flight notification methods described above.
  • the computer-readable storage medium may be the internal storage unit of the control terminal described in any of the foregoing embodiments, for example, the memory or memory of the control terminal.
  • the computer-readable storage medium may also be an external storage device of the control terminal, for example, a plug-in hard disk equipped on the control terminal, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) ) Card, Flash Card, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种飞行提示方法、装置、控制终端(10)、系统及存储介质,其中,该方法包括:在控制终端(10)的交互界面显示无人机(20)拍摄到的图传画面和/或地图画面(S101);获取无人机(20)感测的障碍物信息(S102);根据障碍物信息,在交互界面的边界框处显示障碍提示图标(S103)。

Description

飞行提示方法、装置、控制终端、系统及存储介质 技术领域
本申请涉及无人机技术领域,尤其涉及一种飞行提示方法、飞行提示装置、控制终端、飞行系统及存储介质。
背景技术
目前,随着无人机技术的快速发展,其应用范围也越来越广,比如摄影拍摄、电力巡检、农业植保等等。为了提高无人机在飞行过程中的安全性能,现有无人机均设有飞行安全管理方案,比如在无人机上设置传感器,用于感测障碍物并进行自动避障。然而当无人机飞行遇到障碍物(如建筑、植物、行人等),或者遇到载人飞机以及特殊空域(比如限高区、禁飞区、授权区等)时,用户并无法知晓,有可能因为误操作造成严重的安全隐患,同时用户体验也较差。
发明内容
基于此,本申请提供了一种飞行提示方法、飞行提示装置、飞行系统、控制终端及存储介质,以提高无人机飞行的安全性。
第一方面,本申请提供了一种飞行提示方法,应用于控制终端,所述控制终端用于控制无人机飞行,所述方法包括:
在所述控制终端的交互界面显示所述无人机拍摄到的图传画面和/或地图画面;
获取所述无人机感测的障碍物信息;
根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标。
此外,本申请还提供了一种飞行提示方法,应用于控制终端,所述控制终端用于控制无人机飞行,所述方法包括:
获取所述无人机感测的移动目标的运动信息;
在所述控制终端显示的交互界面中显示所述移动目标对应的提示图标;
根据所述移动目标的运动信息确定所述提示图标的显示方式。
第二方面,本申请还提供了一种飞行提示装置,应用于控制终端,所述飞行指示装置包括处理器和存储器;
所述存储器用于存储计算机程序;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现本申请实施例提供的任一项所述飞行提示方法的步骤。
第三方面,本申请还提供了一种控制终端,所述控制终端包括:显示装置、存储器和处理器;
所述显示装置用于显示;
所述存储器用于存储计算机程序;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现本申请的实施例提供的任一项所述飞行提示方法的步骤。
第四方面,本申请还提供了一种飞行系统,所述飞行系统包括无人机和本申请实施例提供任一项所述的控制终端,所述控制终端用于控制所述无人机飞行。
第五方面,本申请还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现本申请提供的任一项所述的飞行提示方法。
本申请实施例提供了一种飞行提示方法、飞行提示装置、系统、控制终端及存储介质,通过在控制终端上显示交互界面;获取所述无人机感测的障碍物信息;根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标。从而使得用户可以根据该障碍提示图标清晰地知晓无人机遇到的障碍物以及障碍物信息,方便用户控制无人机飞行,进而提高了无人机飞行的安全性,以及提高了用户的体验度。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。
附图说明
为了更清楚地说明本申请实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实 施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请的实施例提供的一种飞行系统的结构示意图;
图2是本申请实施例提供的一种飞行提示方法的步骤示意流程图;
图3a至图3c是本申请的实施例提供的交互界面的显示效果示意图;
图4a至图4c是本申请的提供的障碍物与无人机的方位信息的示意图;
图5是本申请的实施例提供的障碍物与无人机的角度信息的示意图;
图6是本申请的实施例提供的一种障碍提示图标显示的效果示意图;
图7是本申请的实施例提供的另一种障碍提示图标显示的效果示意图;
图8是本申请的实施例提供的另一种障碍提示图标显示的效果示意图;
图9是本申请的实施例提供的另一种障碍提示图标显示的效果示意图;
图10是本申请的实施例提供的另一种障碍提示图标显示的效果示意图;
图11a和图11b是本申请的实施例提供的交互界面的实际效果示意图;
图12a和图12b是本申请的实施例提供的另一种障碍提示图标显示的效果示意图;
图13是本申请的实施例提供的又一种障碍提示图标显示的效果示意图;
图14a至图14c是本申请的实施例提供的障碍物提示条的效果示意图;
图15是本申请的实施例提供的另一种飞行提示方法的步骤示意流程图;
图16是本申请的实施例提供的一种移动目标的提示图标显示的效果示意图;
图17是本申请的实施例提供的另一种移动目标的提示图标显示的效果示意图;
图18a和图18b是本申请的实施例提供的移动目标的提示图标显示的实际效果示意图;
图19是本申请的实施例提供的另一种移动目标的提示图标显示的效果示意图;
图20是本申请的实施例提供的又一种移动目标的提示图标显示的效果示意图;
图21是本申请的实施例提供的另一种飞行提示方法的步骤示意流程图;
图22是本申请的实施例提供的一种限飞解禁证书显示的效果示意图;
图23是本申请的实施例提供的又一种飞行提示方法的步骤示意流程图;
图24是本申请的实施例提供的一种授权区解禁证书显示的效果示意图;
图25是本申请的实施例提供的另一种授权区解禁证书显示的效果示意图;
图26是本申请的实施例提供的又一种授权区解禁证书显示的效果示意图;
图27是本申请的实施例提供的一种用户验证显示的效果示意图;
图28是本申请的实施例提供的一种飞行提示装置的示意框图;
图29是本申请的实施例提供的一种控制终端的示意框图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
还应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。
还应当进一步理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。
附图中所示的流程图仅是示例说明,不是必须包括所有的内容和操作/步骤,也不是必须按所描述的顺序执行。例如,有的操作/步骤还可以分解、组合或部分合并,因此实际执行的顺序有可能根据实际情况改变。
随着无人机技术的快速发展,其应用范围也越来越广,比如摄影拍摄、电力巡检、农业植保等等。为了提高无人机在飞行过程中的安全性能,现有无人机均设有设置障碍物感知传感器,用于感测障碍物并进行自动避障,以避免碰撞障碍物,进而提高无人机的安全性。
发明人发现,当无人机飞行遇到障碍物(如建筑、植物、行人等),或者遇到载人飞机以及特殊空域(比如限高区、禁飞区、授权区等)时,无人机虽 然可以感测障碍物并进行自动避障,然而用户却无法知晓无人机遇到障碍物,有可能因为误操作造成严重的安全隐患。
为此,本申请实施例提供一种飞行提示方法、飞行提示装置、控制终端、飞行系统和存储介质,以解决上述问题。
请参照图1,图1是实施本申请实施例提供的一种飞行系统的结构示意图。如图1所示,该飞行系统100包括控制终端10和无人机20,控制终端10与无人机20通信连接,用于控制无人机10的飞行。
其中,控制终端10包括显示装置11,显示装置11用于显示交互界面,该交互界面可以显示无人机20传输的图传画面,也可以显示地图画面。图传画面包括无人机的拍摄画面,通过无线图传技术传输给控制终端10,该地图画面为无人机20飞行时对应的地图。
可以理解的是,该交互界面除了可以显示图传画面和地图画面外,还可以包括一些控制图标,该控制图标具体为一些虚拟按键,用于实现用户与控制终端10的交互,或者通过控制终端10实现与无人机10的交互。
示例性的,当用户操作这些虚拟按键时,可以向无人机20发射相应的控制指令,以实现用户对无人机20的操控。比如,当用户点击虚拟按键中的拍摄按键时,则控制无人机20执行拍摄功能,当用户点击虚拟按键中的返航按键时,则控制无人机20执行返航任务。
示例性的,当用户操作另些虚拟按键时,可以查看相关参数,比如查看无人机20的飞行路线或者飞行参数等等。当然还可以进行画面切换显示,比如用户点击虚拟按键中的切换按键,则将地图画面和图传画面进行切换显示。其中,飞行参数包括飞行速度、飞行高度、电池电量等等。
需要说明的是,显示装置11包括设置在控制终端10上的显示屏或者独立于控制终端10的显示器,独立于控制终端10的显示器可以包括手机、平板电脑或者个人电脑等,或者也可以是带有显示屏的其他电子设备。其中,该显示屏包括LED显示屏、OLED显示屏、LCD显示屏等等。
无人机20包括障碍物感知传感器21,障碍物感知传感器21用于感测无人机20周围的障碍物,以得到障碍物信息,该障碍物信息包括方位信息和/或距离信息。
其中,该方位信息是指障碍物相对无人机20的方位,比如包括正前方、左 上方、右上方、正后方、左下方和右下方等等;距离信息是指障碍物相对无人机20的距离,比如障碍物为铁塔A,该铁塔A相对无人机20的距离为7m。
在一些实施方式中,为了精准地感知无人机在不同方位的障碍物,障碍物感知传感器21包括一个或者多个传感器,用于感测无人机20的一个或者多个方向上的障碍物信息。
比如,障碍物感知传感器21可以包括一个方向传感器,用于感测无人机20的前方的障碍物信息。比如,障碍物感知传感器21可以包括两个方向传感器,分别用于感测无人机20的前方和后方的障碍物信息。再比如,障碍物感知传感器21可以包括四个传感器,分别用于检测无人机20的前方、后方、左方、右方的障碍物。
在另一些实施例中,也可以将一个障碍物感知传感器21设置无人机20搭载的旋转台上,通过该旋转台的障碍物感知传感器21可相对无人机转动,以感测无人机20在多个方向上的障碍物信息。
其中,障碍物感知传感器21包括视觉传感器、超声波传感器、TOF传感器或激光传感器等等。
无人机20可以是旋翼飞机。在某些情形下,无人机20可以是可包括多个旋翼的多旋翼飞行器。多个旋翼可旋转而为无人机20产生提升力。旋翼可以是推进单元,可使得无人机20在空中自由移动。旋翼可按相同速率旋转和/或可产生相同量的提升力或推力。旋翼可按不同的速率随意地旋转,产生不同量的提升力或推力和/或允许无人机20旋转。在某些情形下,在无人机20上可提供一个、两个、三个、四个、五个、六个、七个、八个、九个、十个或更多个旋翼。这些旋翼可布置成其旋转轴彼此平行。在某些情形下,旋翼的旋转轴可相对于彼此呈任意角度,从而可影响无人机20的运动。
无人机20可包括多个旋翼。旋翼可连接至无人机20的本体,无人机20的本体可包含控制单元、惯性测量单元(inertial measuring unit,IMU)、处理器、电池、电源和/或其他传感器。旋翼可通过从本体中心部分分支出来的一个或多个臂或延伸而连接至本体。例如,一个或多个臂可从无人机20的中心本体放射状延伸出来,而且在臂末端或靠近末端处可具有旋翼。
示例性的,无人机可例如为四旋翼无人机、六旋翼无人机、八旋翼无人机。当然,也可以是固定翼无人机,还可以是旋翼型与固定翼无人机的组合,在此 不作限定。
其中,无人机20上还设置有拍摄装置,拍摄装置包括一个摄像头或者是多个摄像头,比如有两个摄像头构成双目摄像方案,该拍摄装置用于拍摄图像,当然也可以用于测量障碍物相对无人机的距离。
在一些实施例中,无人机20还设置有ADS-B装置(Automatic dependent surveillance–broadcast),通过该ADS-B装置可以检测同样设置有ADS-B装置的障碍物,该障碍物具体可能为移动目标,比如载人飞机。一般载人飞机里通常安装有ADS-B装置。
以下,将结合图1中的飞行系统对本申请的实施例提供的飞行提示方法进行详细介绍。需知,图1中的飞行系统仅用于解释本申请实施例提供的飞行提示方法,但并不构成对本申请实施例提供的飞行控制方法应用场景的限定。
请参阅图2,图2是本申请实施例提供的一种飞行提示方法的步骤示意流程图。该飞行提示方法应用于控制终端中,以向用户展示无人机感知的障碍物信息,进而提高无人机飞行的安全性。
如图2所示,该飞行提示方法包括步骤S101至步骤S103。
S101、在所述控制终端的交互界面显示所述无人机拍摄到的图传画面和/或地图画面;
S102、获取所述无人机感测的障碍物信息;
S103、根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标。
在用户使用控制终端控制无人机飞行时,控制终端的显示装置会显示交互界面,用户通过该交互界面控制无人机飞行。
当然该交互界面还可以用于显示相关内容。比如,该交互界面显示所述无人机拍摄到的图传画面;比如,该交互界面也显示所述无人机当前飞行时使用的地图对应的地图画面;再比如,该交互界面还可以同时显示图传画面和地图画面。
具体地,如图3a所示,显示装置11的显示屏显示有交互界面12,该交互界面12包括边界框120,具体包括四个边界框120,在图3a中交互界面12显示的是图传画面13。如图3b所示,在图3b中交互界面12显示的是地图画面14,在地图画面14还显示有无人机20的飞行图标。如图3c所示,在图3c中 交互界面12同时显示图传画面13和地图画面14,其中地图画面14是通过小窗口显示,具体可以采用画中画显示方式实现。
无人机在飞行的过程中,可以通过其搭载的障碍物感测传感器感测无人机周围的障碍物,并对接收到的关于障碍物的感测信号进行处理,得到障碍物信息。在无人机获取障碍物信息后,将该障碍物信息发送给控制终端,以使控制终端获取所述无人机感测的障碍物信息。
其中,所述障碍物信息包括方位信息和/或距离信息,所述方位信息为障碍物相对所述无人机的方向,所述距离信息为障碍物相对所述无人机的距离。当然还以包括其他信息,比如障碍物的形状信息等。
需要说明的是,方位信息是以无人机的飞行方向为基准,即规定飞行方向为正前方。以铁塔为障碍物为例进行介绍,具体如图4a所示,铁塔A位于无人机的正前方,即障碍物信息中的方位信息为正前方;比如,如图4b所示,铁塔B位于无人机的右方,即障碍物信息中的方位信息为右方;再比如,铁塔C位于无人机的右前方,即障碍物信息中的方位信息为右方;在图4a、图4b和图4c中,d为距离信息。
在一些实施例中,为了让用户了解障碍物的具体方向信息,所述方位信息包括角度信息,该角度信息可以为障碍物相对无人机飞行方向的夹角,或者也可以为障碍物相对与无人机飞行方向垂直的方向的夹角。
示例性的,如图5所示,以为无人机的飞行方向为Y轴,以垂直无人机飞行方向为X轴,建立二维坐标系,由此可以确定障碍物相对无人机的角度,比如铁塔1相对无人机的角度为β 1,铁塔2相对无人机的角度为β 2,具体地比如β 1为45°,β 2为135°。
根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,以提示用户无人机周围存在障碍物,并可以让用户知晓障碍物信息,进而防止用户进行误操作。通过在边界框出显示障碍提示图标,不仅可以向用户展示障碍物信息,还可以避免遮挡交互界面的显示内容,不会影响用户使用交互界面,由此不仅可以提高无人机的飞行安全性,还可以提高用户的体验度。
在一些实施例中,所述障碍提示图标包括障碍物提示条,所述障碍物提示条位于所述交互界面的边界框。其中,障碍物提示条可以减少遮挡交互界面显示的内容,同时还便于展示障碍物信息。在所述边界框不具有障碍物显示条的 位置,显示所述图传画面或地图画面,以在显示障碍物信息的基础上,最大限度不影响图传画面或地图画面的显示。
以下,将以障碍提示图标为障碍物提示条为例进行介绍。可以理解的是,在其他一些实施例中,该障碍提示图标除了可以为障碍物提示条,还可以包括其他形式图标,在此不做限定。
譬如,如图6所示,当获取的障碍物信息中方位信息为无人机前方有障碍物时,可以在交互界面12的上边界框处显示障碍物提示条121。通过在在交互界面12的上边界框处显示障碍物提示条121,由此方便用户在观看无人机拍摄的图传画面时知晓无人机的前方出现障碍物。
在一些实施例中,无人机包括前向障碍物感知传感器和/或后向障碍物感知传感器,由此可以感测到无人机的前方或后方可能出现障碍物。相应地,在所述交互界面的边界框处显示障碍提示图标,具体为在所述交互界面的上边界框和/或下边界框处显示所述障碍提示图标。
示例性的,如图7所示,交互界面12的上边界框和下边界框处显示障碍物提示条121,表示无人机的前方和后方均出现障碍物。
在一些实施例中,为了让用户清晰地知晓无人机周围出现障碍物,以及障碍物的方位信息。根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,具体可以为:根据所述障碍物信息中的方位信息,在所述交互界面的多个边界框中确定目标边界框;以及在所述目标边界框处显示障碍提示图标。
其中,所述方位信息包括:障碍物在所述无人机的前方、后方、左方和右方中任意一种;所述目标边界框包括上边界框、下边界框、左边界框和右边界框中任意一种。
其中,前方、后方、左方和右方,可以通过所述无人机上安装的前向障碍物感知传感器、后向障碍物感知传感器、左向障碍物感知传感器和/或右向障碍物感知传感器分别进行感测。
其中,前方、后方、左方和右方分别与上边界框、下边界框、左边界框和右边界框相对应,由此可以确定目标边界框。
比如,所述障碍物信息中的方位信息为位于无人机的前方,则在所述交互界面的多个边界框中确定目标边界框为上边界框,并在上边界框处显示障碍提示图标,具体如图6所示。
在某些场景下,比如在深谷中飞行,无人机的周围四个方向可能均出现障碍物,相应地可以在交互界面12的四个边界框处均显示障碍物提示条,具体如图8所示。
在一些实施例中,为了优化交互界面,以及提高用户体验度。可以将所述障碍物提示条的宽度设置为与所述交互界面中用于显示所述障碍物提示条的边界框的宽度相同。
示例性的,如图6所示,所述交互界面中用于显示所述障碍物提示条的边界框为上边界框,将该障碍物提示条的宽度设置为与上边界框的宽度相同。
在另一些实施例中,为了尽量少遮挡交互界面的内容,以提高用户的体验度。可以将所述障碍物提示条的宽度设置为小于所述交互界面中用于显示所述障碍物提示条的边界框的宽度。
示例性的,如图9所示,交互界面12中用于显示所述障碍物提示条的边界框为上边界框,该障碍物提示条的宽度小于上边界框的宽度。
需要说明的是,在该障碍物提示条的宽度小于边界框的宽度时,可以通过障碍物提示条在边界框显示的位置,确定障碍物的方位信息。
示例性的,如图9和图10所示,在图9中障碍物提示条显示在上边界框的中间,表示障碍物位于无人机的前方;在图10中障碍物提示条显示在上边界框的左侧,表示障碍物位于无人机的左前方。
在另一些实施例中,为了尽量少遮挡交互界面的内容,以提高用户的体验度。可以将所述障碍物提示条为具有一定透明的图标。
示例性的,如图11a和图11b所示,图11a和图11b为本申请实施例提供的交互界面的实际效果示意图。图11a中交互界面显示图传画面13,图11b中在交互界面的上边界框和下边界框处显示障碍物提示条121,该障碍物提示条121具有半透明效果,因此可以提高使用体验。
在无人机感测到障碍物时,通过控制终端显示的交互界面上显示障碍物提示条,提示用户无人机周围存在障碍物。此时用户可以不用做任何操作,由无人机进行自动避障;当然,用户也可以根据提示信息进行手动操作,以控制飞行器飞行进行避障,由此提高了无人机的飞行安全性。
在一些实施例中,在无人机完成自动避障后,还会持续通过障碍物感知传感器进行检测,以确定所述障碍物与无人机的距离是否大于预设安全距离,或 者无人机周围是否存在障碍物;若所述障碍物信息中距离信息大于预设安全距离,或者若未检测到障碍物,则隐藏所述障碍提示图标。
示例性的,比如图7至图6过程,通过隐藏障碍物提示条,可以让用户知晓无人机当前没有障碍物,同时不用占用交互界面的空间,进而提高了用户的体验。
在一些实施例中,为了让用户知晓障碍物的方位信息和距离信息。根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,具体可以根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色。
示例性的,如图12a和图12b所示,不同的障碍物提示条的显示颜色表示障碍物相对无人机距离不同,由此可以通过障碍物提示条的显示颜色的改变,以提示用户障碍物的远近。
比如,图12a中障碍物提示条的显示颜色,相对图12b中障碍物提示条的显示颜色为浅色调,表示图12a中障碍物与图12b中障碍物相对无人机更远一些,即距离更远。
在一些实施例中,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色,具体为:确定障碍物相对所述无人机的距离是否小于预设距离,若障碍物相对所述无人机的距离小于预设距离,将与所述预设距离对应的预设颜色确定为所述障碍提示图标的显示颜色。
其中,预设距离为安全距离,若障碍物与无人机之间距离小于该预设距离,表示无人机飞行存在安全隐患,因此有必要提示用户。
具体地,通过预先设置预设距离,以及该预设距离对应的预设颜色,可以很好提示用户。比如,预设距离为6m,与所述预设距离6m对应的预设颜色包括黄色,黄色具有警示作用。当障碍物与无人机之间的距离小于6m时,将所述障碍提示图标的显示颜色调整为黄色,以提示用户。
在一些实施例中,为了避免用户进行误操作,进而提高无人机飞行的安全性。根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色,具体可以:在确定所述无人机处于紧急悬停状态时,将与所述紧急悬停状态对应的预设颜色确定为所述障碍提示图标的显示颜 色;其中,所述紧急悬停状态为所述无人机因障碍物进入的悬停状态。
其中,所述与所述紧急悬停状态对应的预设颜色包括红色,红色具有警告作用。或者,所述与所述紧急悬停状态对应的预设颜色呈动态扩散效果。比如在无人机因障碍物进入悬停状态时,障碍提示图标显示为红色,并且显示的红色进行扩散,进而可以有效地提示用户。
在一些实施例中,为了更为有效地提醒用户无人机周围存在障碍物时。在根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色之后,还可以进一步地输出用于提示用户所述无人机附近出现障碍物的提示信息;其中,所述提示信息包括震动提示信息、语音提示信息、文字提示信息中至少一种。
比如,在所述交互界面的边界框处显示的障碍提示图标的显示颜色显示为黄色后,还可通过控制终端输出震动提示信息,或者通过控制终端播报语音提示信息,再或者通过控制终端的显示装置显示文字提示信息。
在一些实施例中,为了更好地通过障碍指示图标提示用户障碍物的方位信息。所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,具体可以为:先根据所述障碍物信息中的方位信息在所述障碍提示图标中确定目标位置,再根据所述距离信息确定所述障碍指示图标在所述目标位置处的显示颜色。
其中,该目标位置在障碍提示图标所处的位置,可以表示障碍物的方向信息,再用不同的颜色在所述目标位置处进行显示,由此可以更能吸引用户的注意,进而达到更好地提示效果。
示例性的,如图13所示,若障碍物信息中的方位信息为所述无人机的右上方,则确定在交互界面12的上边界框上显示的障碍物提示条121的右侧位置为目标位置,再根据距离的远近确定在所述目标位置处的显示颜色。比如,距离较远,可以显示绿色,表示在安全范围内;比如,距离接近安全范围时,可以显示黄色,表示无人机接近;再比如,距离小于安全范围,可以显示红色,表示无人机处于危险状态。
如图14a所示,可根据障碍物可能位于无人机的左上方、前方和右上方,将障碍物提示条121划分为三个区域,分别区域1211、区域1212和区域1213,分别对应左上方、前方和右上方。因此可以依据该划分方式以及障碍物信息中 方位信息,确定与该方位信息对应的区域为目标位置。
比如,若障碍物信息中方位信息为左上方,则确定对应的区域1211为目标位置,将该区域1211与其他区域显示不同的颜色,表示障碍物的方位信息。
需要说明的是,随着无人机继续飞行,障碍物距离无人机的距离也开始变小,即无人机越接近障碍物。因此,还可以根据障碍物信息中距离信息调整该目标位置的显示颜色。
示例性的,具体如图14a至图14b过程所示,通过改变区域1211的显示颜色,来表示障碍物相对无人机的距离变化,以便用户通过观察障碍物提示条不同位置的颜色变化,即可以知晓障碍物的方位信息和距离信息。
在一些实施例中,为了方便用户知晓障碍物的具体位置,还可以通过无人机测量障碍物相对无人机的偏离角度。由此在障碍物提示条上,也可以用刻度值来表示该角度信息。
示例性的,具体如图14c所示,该障碍物提示条121上的刻度可用来表示障碍物相对无人机的角度信息,在实际应用中,只需要将障碍物相对无人机的角度信息映射在障碍物提示条121上的刻度上,即可以提示用户。
在一实施例中,其中一个边界框所对应的角度范围与所述无人机在一个方向上的障碍物感知范围相一致。例如,当所述无人机在前方的障碍物感知范围为左右各30度,共60度时,所述交互界面的上边界框所代表的障碍物感知角度也为60度,且该障碍物感知角度以平均刻度进行分布。示例性的,障碍物指示条的长短与障碍物的分布相关,其在障碍物感知范围内的分布越广,障碍物指示条在所述边界框上的长度越长。
在一些实施例中,为了更为有效地提醒用户无人机周围存在障碍物,并且该障碍物有一定危险性。在所述获取所述无人机感测的障碍物信息之后,还可以根据所述障碍物信息确定所述无人机是否触发预警条件,所述预警条件用于触发显示障碍提示图标;若所述无人机触发所述预警条件,则在所述交互界面的边界框处显示障碍提示图标;若所述无人机未触发所述预警条件,则在所述交互界面的边界框处不显示障碍提示图标。
其中,所述根据所述障碍物信息确定所述无人机是否触发预警条件,具体可以通过确定所述障碍物信息中的距离信息是否小于或等于预设安全距离;若所述障碍物信息中的距离信息小于或等于所述预设安全距离,则确定所述无人 机触发预警条件。
在一些实施例中,除了使用预设安全距离进行判断是否触发预警条件,还可以结合方位信息进行判断,比如若障碍物在无人机的飞行方向上且距离信息小于或等于所述预设安全距离,则确定所述无人机触发预警条件。
在一些实施例中,因为无人机在飞行过程中,可能遇到固定不动的障碍物,也可能遇到移动的障碍物,即障碍物可能是移动目标。相应地,所述障碍物信息包括移动目标的运动信息,其中,所述运动信息包括运动速度、相对高度、相对距离以及运动方向中至少一种,所述相对高度为所述移动目标相对所述无人机的高度,所述相对距离为所述移动目标相对所述无人机的距离。
在无人机飞行的过程中,无人机遇到的障碍物若是移动目标,对于移动目标,同样可以利用在所述交互界面的边界框处显示障碍提示图标,以提示用户无人机周围出现移动目标以及移动目标的运动信息。
比如,使用障碍物提示条显示的位置、或者障碍物提示条中不同区域显示不同的颜色,表示移动目标的运动方向;或者,使用障碍物提示条显示不同的颜色,表示移动目标相对无人机的距离;或者,采用障碍物提示条的移动方向、速度和颜色变化来大概获知移动障碍物的运动信息。
对于移动目标,除了可以利用在所述交互界面的边界框处显示障碍提示图标,以提示用户无人机周围出现移动目标以及移动目标的运动信息。还可以其他飞行提示方式,对用户进行提示。
请参阅图15,图15是本申请实施例提供的另一种飞行提示方法的步骤示意流程图。该飞行提示方法应用于控制终端中,以解决障碍物为移动目标的问题,进而提高无人机飞行的安全性。
如图15所示,该飞行提示方法包括步骤S201至步骤S203。
S201、获取所述无人机感测的移动目标的运动信息;
S202、在所述控制终端显示的交互界面中显示所述移动目标对应的提示图标;
S203、根据所述移动目标的运动信息确定所述提示图标的显示方式。
其中,所述运动信息包括运动速度、相对高度、相对距离以及运动方向中至少一种;所述相对高度为所述移动目标相对所述无人机的高度,所述相对距离为所述移动目标相对所述无人机的距离。
无人机在飞行的过程中,可以通过障碍物感知传感器感测移动目标的运动信息,并将感测到的移动目标的运动信息发送给控制终端,使得控制终端获取所述无人机感测的移动目标的运动信息。
在控制终端获取所述无人机感测的移动目标的运动信息之后,可以在所述控制终端显示的交互界面中显示所述移动目标对应的提示图标,并根据所述移动目标的运动信息确定所述提示图标的显示方式。具体地,确定所述提示图标的显示方式,比如包括确定所述提示图标的显示颜色、显示位置等。
比如,在根据运动信息确定移动目标快接近该无人机时,将所述移动目标对应的提示图标显示为黄色,在根据运动信息确定移动目标接近该无人机,可以改变所述提示图标的显示颜色,比如显示为红色,进而提示用户移动距离的距离信息,或者距离的变化信息。
在一些实施例中,移动目标具体可以载人飞机,所述障碍提示图标包括飞机图标,由此可以在交互界面的边界框处,根据载人飞机的运动信息,显示所述飞机图标。其中,所述载人飞机的运动信息是通过ADS-B装置获取的。
在一些实施例中,为了让用户更清楚了解载人飞机的运动趋势,可以在靠近所述飞机图标处显示所述运动信息。具体地可以使用弹框显示的方式显示运动信息。需要说明的是,可以显示部分运动信息,比如显示运动速度和运动方向;也可以显示全部运动信息,比如显示运动速度、相对高度、相对距离以及运动方向。
在一些实施例中,所述交互界面中包括所述地图画面,所述地图画面为所述无人机飞行时使用的地图。还可以根据移动目标的运动信息,在所述地图画面上显示所述移动目标对应的提示图标。通过在地图画面展示,可以让用户更为直观地了解无人机的周围移动目标以及运动情况。当然,也可以在交互界面的边界框处显示移动目标的提示图标。
示例性的,如图16所示,交互界面12中显示有图传画面13和地图画面14,地图画面14上显示有无人机20的飞行图标141,其中在地图画面14上显示载人飞机的提示图标142,因此可以让用户更为直观地了解无人机的周围移动目标以及运动情况。
在一些实施例中,为了能够更好地提醒用户无人机周围遇到移动目标,还可以改变所述地图画面的边界框的显示颜色。通过改变颜色可以有效地提醒用 户,当前无人机周围出现移动目标。
示例性的,如图17所示,相对图16中的地图画面,在图17中改变了地图画面14的边界框的显示颜色,具体地比如显示为黄色,利用黄色具有警示作用对用户进行提醒。
在一些实施例中,为了方便用户观看地图画面,以提高用户的体验度。还可以检测用户是否对所述地图画面进行切换操作,若检测用户对所述地图画面进行切换操作,将所述地图画面与所述图传画面进行切换显示。该切换操作包括点击操作、双击操作、滑动操作、按压操作中的一种。
在一些实施例中,地图画面包括切换按键;若检测到用户操作所述切换按键,将所述地图画面与所述图传画面切换显示。具体如图18a和图18b所示。
具体地,如图18a所示,交互界面同时显示图传画面13和地图画面14。图传画面13大屏显示,地图画面14小屏显示,地图画面14中包括切换按键140。当用户点击切换按键140时,将地图画面14与图传画面13切换显示,即切换后地图画面14大屏显示,图传画面13小屏显示。需要说明的是,该大屏显示包括全屏显示等,该小屏显示具体是指相对大屏显示而言,显示的尺寸较小。
此外,该飞行提示方法在检测无人机周围遇到载人飞机时,还可以通过显示文字提示信息,具体在显示的图传画面上显示文字提示信息,以提示用户无人机周围存在载人飞机。具体地,如图18a所示,通过两个显示框分别显示“附近有载人飞机”和“附近有载人飞机,请谨慎飞行”等文字提示信息。
在一些实施例中,为了更好地显示运动信息,可以在所述将所述地图画面与所述图传画面切换显示之后,在靠近所述地图画面上显示的所述移动目标的提示图标的位置处显示所述运动信息。具体地,可以在小屏显示的地图画面中不显示所述运动信息,而在切换至大屏显示后的地图画面上显示所述运动信息。
具体地,如图18b所示,在大屏显示的地图画面14中显示有三个飞机图标,分别为飞机图标1421、飞机图标1422和飞机图标1423。其中,靠近飞机图标1421的位置处显示所述运动信息,具体以弹框显示运动信息。H表示载人飞机与无人机的相对高度,D表示载人飞机与无人机的相对距离,S表示载人飞机的飞行速度。由此方便用户了解更多信息,进而提高用户的体验度。
在一些实施例中,将所述地图画面与所述图传画面切换显示之后,还可以 在所述地图画面上显示所述无人机的起飞点位置和当前飞行位置,和/或,显示所述无人机的飞行轨迹。
具体地,如图18b所示,无人机的飞行图标141所在位置即为当前飞行位置,起飞点位置为地图画面14中H点所在的位置,轨迹线1410为无人机的飞行轨迹。由此可以让用户了解更多关于无人机的飞行信息,以便做出相应的操作。
在一些实施例中,对应于障碍物为移动目标。具体可以为根据所述移动目标的运动信息确定所述移动目标的提示图标的显示方式。更具体的是根据所述移动目标的运动信息,确定所述移动目标的危险程度等级;以及根据所述危险程度等级确定所述提示图标的显示方式。其中,不同危险程度等级对应的所述提示图标的显示颜色不同。
示例性的,如图19所示,三个载人飞机,对应三个飞机图标,分别为飞机图标1421、飞机图标1422和飞机图标1423,再根据运动信息确定三个载人飞机(飞机1、飞机2和飞机3)的危险程度等级分别为等级Ⅰ、等级Ⅱ、等级Ⅲ,其中等级Ⅰ危险等级最高。不同的飞机图标的显示颜色不同,用于表示不同的危险程度等级,进而提示用户不同的载人飞机的不同危险等级。
其中,根据所述移动目标的运动信息,确定所述移动目标的危险程度等级,可以根据移动目标的运动信息中运动方向和运动速度,确定移动目标是否会接近无人机或多长时间后接近无人,来确定所述移动目标的危险程度等级。
当然,由于无人机也在运动,因此还需要获取无人机的运动信息。以便根据移动目标的运动信息和所述无人机的运动信息,模拟无人机和载人飞机的飞行轨迹,再根据所述无人机和载人飞机的飞行轨迹确定移动目标的危险程度等级,比如根据是否可能接近该无人机以及接近距离的远近,确定危险程度等级。
具体地,还可以根据距离范围确定危险程度等级,比如,如表1所示:
表1为距离范围与危险程度等级的对应关系
距离范围 危险程度等级
2m范围内 等级Ⅰ
2m-4m范围内 等级Ⅱ
4m-6m范围内 等级Ⅲ
大于6m 等级Ⅳ
在表1中,等级Ⅰ表示危险程度等级最高,大于等级Ⅱ、等级Ⅲ和等级Ⅳ。其中,在一些实施例中,等级Ⅳ可以表示安全等级,安全等级可以不在地图画面上显示移动目标的提示图标。需要说明的是,表1仅仅是原理示例说明,并不够构成对实际应用的数值设置的限定,具体可以根据实际场景进行设定。
在一些实施例了,可以使用危险等级评估模型,确定不同移动目标的危险程度等级,具体地,将无人机的运动信息和移动目标的运动信息输入至该危险等级评估模型进行模拟评估,得到该移动目标的危险程度等级。
需要说明的是,该危险等级评估模型可以包括一些公式算法,也可以是使用神经网络进行训练得到的机器学习模型,在此不做限定。
在一些实施例中,所述提示图标包括用于表示所述移动目标的形状图标。比如,如图19所示,若移动目标为载人飞机,则提示图标具体用飞机图标进行表示,以方便用户根据该形状图标就可以知晓移动目标的类型。
在一些实施例中,所述提示图标包括形状图标和环状图标,所述形状图标用于表示所述移动目标,所述环状图标用于表示所述移动目标的实际位置范围,其中,所述形状图标位于所述环状图标内。具体地,如图20所示。还可以将环状图标以不同颜色显示,来表示不同移动目标的危险程度等级。
在无人机飞行过程中,除了可能遇到固定的障碍物和移动的障碍物,还可能会遇到限飞区域或授权区域等,在这些限飞区域只有具备安全飞行资质的无人机才可以飞行,但是需要用户可以通过控制终端申请与限飞解禁证书,以解锁限飞区的飞行限制后,才能飞行。由此降低了用户的体验度。
其中,限飞区域根据不同的国家、地区要求等,可以分为多个不同类型的限飞区,比如国家解禁限飞区、高度解禁限飞区(比如120M限高)、特殊解禁(圆形或多边形)、授权区解禁等等。
为此解决上述问题,请参阅图21,图21是本申请实施例提供的另一种飞行提示方法的步骤示意流程图。该飞行提示方法应用于控制终端中,以解决限飞区的问题,进而提高用户的体验度。
如图21,该飞行提示方法包括步骤S301和步骤S302。
S301、获取限飞解禁证书,在所述交互界面显示所述限飞解禁证书;
S302、若检测到用户触发的证书发送操作,将所述限飞解禁证书发送至所 述无人机,以使所述无人机根据所述限飞解禁证书解禁所述限飞解禁证书对应的限飞区域。
其中,获取限飞解禁证书,需要从官方网站提前申请的限飞解禁证书,在通过控制终端上应用程序从服务器将申请的限飞解禁证书直接下载到本地,并通过应用程序上传至飞机使解禁证书生效,实现限飞区解禁。证书生效后,飞机可以在证书规定的区域内飞行,不受该区域上空的限飞区限制。
需要说明的是,控制终端中的应用程序为控制飞行器飞行的应用程序,并且可以与官网的服务器连接,下载一些解禁证书或者软件版本等。
具体地,如图22所示,可以在所述交互界面中显示获取的限飞解禁证书的证书标识,以及对应的发送按键,该发送按键具体为导入飞机,检测用户是否点击该“导入飞机”按键,若检测到用户操作所述发送按键,将所述限飞解禁证书发送至所述无人机。
在一些实施例中,将所述限飞解禁证书发送至所述无人机后,导入飞机显示文字显示“已导入”,进而提示用户已经导入成功,由此提高了用户的体验度。
在一些实施例中,为了方便用户对更多限飞区进行解禁,并提高解禁效率。获取限飞解禁证书,具体可以获取与所述无人机对应的限飞解禁证书组,所述限飞解禁证书组包括多个限飞解禁证书。
比如,如图22所示,该无人机Mavic Mini包括至少三个限飞解禁证书,均显示交互界面中,由于进行选择导入哪一个限飞解禁证书,由此提高了用户体验度。
需要说明的是,图21中提供的步骤S301和步骤S302,可以应用于无人机遇到固定障碍物之前或者之后,比如在步骤S101之前执行,也可以在步骤S103之后执行;或者,图21中提供的步骤S301和步骤S302,可以应用于无人机遇到移动障碍物之前或者之后,比如在步骤S201之前执行,也可以在步骤S203之后执行。具体应用场景的选择,根据实际需求而定。
请参阅图23,图23是本申请实施例提供的另一种飞行提示方法的步骤示意流程图。该飞行提示方法应用于控制终端中,以解决授权区的问题,进而提高用户的体验度。
如图23,该飞行提示方法包括步骤S401和步骤S402。
S301、在所述交互界面显示授权区对应的证书标识;
S302、若检测到用户触发的授权发送操作,向所述无人机发送授权指令,以使所述无人机根据所述授权指令中的证书标识解禁所述证书标识对应的授权区。
其中,所述无人机内存储有所述证书标识对应的授权区解禁证书。相对于限飞区,该授权区相对限飞区,要求没有那么严格,允许用户根据自主选择进行选择解禁,由此可以将授权区解禁证书存储在所述无人机中,以便提高解禁效率。
在一些实施例中,可以在所述交互界面中显示授权区解禁证书的证书标识,以及对应的激活按键;检测用户是否操作所述激活按键,若检测到用户操作所述激活按键,则根据所述证书标识生成授权指令,并将所述授权指令发送至所述无人机。
具体地,如图24所示,在交互界面的飞机内证书界面内显示两个授权区对应的证书标识,分别为New Matamoras3和New Matamoras4,以及每个证书标识后对应的激活按键。当用户操作所述激活按键,则根据所述证书标识生成授权指令,并将所述授权指令发送至所述无人机,以使无人机所述授权指令中的证书标识,查找并获取到对应的授权区证书,根据该授权区证书解禁所述证书标识对应的授权区。
在一些实施例中,还可以获取无人机的当前位置,并在控制终端的交互界面中显示所述无人机的当前位置对应的地图,以及在所述地图上显示所述授权区在所述地图上对应的区域。还可以在所述地图上的预设位置显示所述授权区对应的授权区解禁证书的证书信息。
具体地,如图25所示,在所述地图上显示所述授权区在所述地图上对应的区域144,该区域144为一个圆形区域,还可以点击该授权区解禁证书以查看该授权区解禁证书的详细信息,如位置、范围、有效期等,具体如证书信息145所示。
在一些实施例中,向所述无人机发送授权指令之前,所述飞行提示方法还包括:获取所述无人机的当前位置;若所述无人机的当前位置与授权区的位置满足预设授权条件时,在所述图传画面或地图画面中弹框显示所述授权区对应的位置标识,以及对应的授权按键;若检测到用户操作所述授权按键,则根据 所述授权区对应的证书标识生成授权指令。
其中,所述无人机的当前位置与授权区的位置满足预设授权条件,具体为:确定所述无人机的当前位置与授权区的位置是否在预设范围内,若所述无人机的当前位置与授权区的位置在预设范围内,则确定所述无人机的当前位置与授权区的位置满足预设授权条件。比如预设范围为2m内,表示无人机已经靠近该授权区。
在一些实施例中,为了提高信息安全性。所述根据所述授权区对应的证书标识生成授权指令,还可以对用户进行验证,并在验证通过后根据所述授权区对应的证书标识生成授权指令。
具体地,如图26所示,弹框显示包括至少一个授权区解禁证书对应的证书标识和对应的解锁按键“解锁”,当检测到用户点击该解锁按键时,跳转到图27中的界面,显示验证码输入框,若用户在规定的时间内输入正确的验证码,则解锁成功,完成对该用户进行验证,由此提高了信息安全性。
在一些实施例中,在图27中,若用户在规定时间内,没有收到验证码,还可以选择另一种验证方式,比如使用语音验证,由此提高了用户的体验度。
可以理解的是,对用户进行验证包括短信验证和语音验证外,还可以使用邮箱验证、指纹验证、密码验证、身份证号验证中的一种。
需要说明的是,图23中提供的步骤S401和步骤S402,可以应用于无人机遇到固定障碍物之前或者之后,比如在步骤S101之前执行,也可以在步骤S103之后执行;或者,图23中提供的步骤S401和步骤S402,可以应用于无人机遇到移动障碍物之前或者之后,比如在步骤S201之前执行,也可以在步骤S203之后执行。具体应用场景选择,根据实际需求而定。
上述实施例提供的飞行提示方法,可以在无人机遇到不同的障碍物时,对用户进行提示,以避免用户进行误操作。由此,可以提高无人机飞行的安全性,同时还可以提高用户的体验度。
请参阅图28,图28是本申请实施例提供的一种飞行提示装置的示意性框图。该飞行提示装置可以应用于控制终端中。
如图28所示,飞行提示装置500包括处理器501和存储器502,处理器501和存储器502通过总线连接,该总线比如为I2C(Inter-integrated Circuit)总线。飞行提示装置500应用于控制终端,该控制终端与无人机进行通信,用于控制 无人机飞行。
在一些实施例中,该控制终端包括显示装置,显示装置可以为液晶显示屏,也可以为触控屏,或者,控制终端包括承载平台,该承载平台用于承载显示设备,用户可以将显示设备安装在承载平台上,并建立控制终端与显示设备之间的通信连接。
具体地,处理器501可以是微控制单元(Micro-controller Unit,MCU)、中央处理单元(Central Processing Unit,CPU)或数字信号处理器(Digital Signal Processor,DSP)等。
具体地,存储器502可以是Flash芯片、只读存储器(ROM,Read-Only Memory)磁盘、光盘、U盘或移动硬盘等。
其中,所述处理器用于运行存储在存储器中的计算机程序,并在执行所述计算机程序时实现本申请实施例提供的任意一种所述的飞行提示方法。
示例性的,所述处理器用于运行存储在存储器中的计算机程序,并在执行所述计算机程序时实现如下步骤:
在所述控制终端的交互界面显示所述无人机拍摄到的图传画面和/或地图画面;获取所述无人机感测的障碍物信息;根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标。
在一些实施例中,所述障碍物信息包括方位信息和/或距离信息,所述方位信息为障碍物相对所述无人机的方向,所述距离信息为障碍物相对所述无人机的距离。
在一些实施例中,所述方位信息包括角度信息。
在一些实施例中,所述无人机包括前向障碍物感知传感器和/或后向障碍物感知传感器;所述在所述交互界面的边界框处显示障碍提示图标,包括:在所述交互界面的上边界框和/或下边界框处显示所述障碍提示图标。
在一些实施例中,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:根据所述障碍物信息中的方位信息,在所述交互界面的多个边界框中确定目标边界框;以及在所述目标边界框处显示障碍提示图标。
在一些实施例中,所述无人机包括前向障碍物感知传感器、后向障碍物感知传感器、左向障碍物感知传感器和/或右向障碍物感知传感器;所述方位信息 包括:障碍物在所述无人机的前方、后方、左方和右方中任意一种;所述目标边界框包括上边界框、下边界框、左边界框和右边界框中任意一种。
在一些实施例中,所述障碍提示图标包括障碍物提示条,所述障碍物提示条位于所述交互界面的边界框。
在一些实施例中,所述障碍物提示条的宽度与所述交互界面中用于显示所述障碍物提示条的边界框的宽度相同;或者所述障碍物提示条的宽度小于所述交互界面中用于显示所述障碍物提示条的边界框的宽度。
在一些实施例中,所述障碍物提示条为半透明图标或透明图标。
在一些实施例中,所述处理器还用于实现:若所述障碍物信息中距离信息大于预设安全距离,或者若未检测到障碍物,隐藏所述障碍提示图标。
在一些实施例中,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色。
在一些实施例中,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色,包括:
若障碍物相对所述无人机的距离小于预设距离,将与所述预设距离对应的预设颜色确定为所述障碍提示图标的显示颜色。
在一些实施例中,所述与所述预设距离对应的预设颜色包括黄色。
在一些实施例中,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色,包括:
若确定所述无人机处于紧急悬停状态,将与所述紧急悬停状态对应的预设颜色确定为所述障碍提示图标的显示颜色;其中,所述紧急悬停状态为所述无人机因障碍物进入的悬停状态。
在一些实施例中,所述与所述紧急悬停状态对应的预设颜色包括红色,或者,所述与所述紧急悬停状态对应的预设颜色呈动态扩散效果。
在一些实施例中,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色之后,所述处理器还实现:
输出用于提示用户所述无人机附近出现障碍物的提示信息;其中,所述提示信息包括震动提示信息、语音提示信息、文字提示信息中至少一种。
在一些实施例中,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
根据所述障碍物信息中的方位信息在所述障碍提示图标中确定目标位置;以及根据所述距离信息确定所述障碍指示图标在所述目标位置处的显示颜色。
在一些实施例中,所述获取所述无人机感测的障碍物信息之后,所述处理器还实现:
根据所述障碍物信息确定所述无人机是否触发预警条件,所述预警条件用于触发显示障碍提示图标;若所述无人机触发所述预警条件,则在所述交互界面的边界框处显示障碍提示图标。
在一些实施例中,所述根据所述障碍物信息确定所述无人机是否触发预警条件,包括:
确定所述障碍物信息中的距离信息是否小于或等于预设安全距离;若所述障碍物信息中的距离信息小于或等于所述预设安全距离,则确定所述无人机触发预警条件。
在一些实施例中,所述障碍物信息包括移动目标的运动信息。
在一些实施例中,所述运动信息包括运动速度、相对高度、相对距离以及运动方向中至少一种;其中,所述相对高度为所述移动目标相对所述无人机的高度,所述相对距离为所述移动目标相对所述无人机的距离。
在一些实施例中,所述移动目标包括载人飞机,所述障碍提示图标包括飞机图标。
在一些实施例中,所述载人飞机的运动信息是通过ADS-B装置获取的。
在一些实施例中,所述处理器还实现:在靠近所述飞机图标处显示所述运动信息。
在一些实施例中,所述交互界面中包括所述地图画面,所述地图画面为所述无人机飞行时使用的地图。
在一些实施例中,所述处理器还实现:在所述地图画面上显示所述移动目标对应的提示图标。
在一些实施例中,所述处理器还实现:改变所述地图画面的边界框的显示颜色。
在一些实施例中,所述处理器还实现:若检测到用户对所述地图画面进行 切换操作,将所述地图画面与所述图传画面进行切换显示。
在一些实施例中,所述地图画面包括切换按键;所述处理器还实现:
若检测到用户操作所述切换按键,将所述地图画面与所述图传画面切换显示。
在一些实施例中,所述将所述地图画面与所述图传画面切换显示之后,所述处理器还实现:
在靠近所述地图画面上显示的所述移动目标的提示图标的位置处显示所述运动信息。
在一些实施例中,所述将所述地图画面与所述图传画面切换显示之后,所述处理器还实现:
在所述地图画面上显示所述无人机的起飞点位置和当前飞行位置,和/或,显示所述无人机的飞行轨迹。
在一些实施例中,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
根据所述移动目标的运动信息确定所述移动目标的提示图标的显示方式;
其中,所述根据所述移动目标的运动信息确定所述移动目标的提示图标的显示方式,包括:根据所述移动目标的运动信息,确定所述移动目标的危险程度等级;以及根据所述危险程度等级确定所述提示图标的显示方式。
在一些实施例中,不同危险程度等级对应的所述提示图标的显示颜色不同。
在一些实施例中,所述提示图标包括用于表示所述移动目标的形状图标。
在一些实施例中,所述提示图标包括用于表示所述移动目标的形状图标和用于表示所述移动目标的实际位置范围的环状图标,其中,所述形状图标位于所述环状图标内。
在一些实施例中,所述处理器还实现:
获取限飞解禁证书,在所述交互界面显示所述限飞解禁证书;若检测到用户触发的证书发送操作,将所述限飞解禁证书发送至所述无人机,以使所述无人机根据所述限飞解禁证书解禁所述限飞解禁证书对应的限飞区域。
在一些实施例中,所述处理器还实现:
在所述交互界面中显示获取的限飞解禁证书的证书标识,以及对应的发送按键;若检测到用户操作所述发送按键,将所述限飞解禁证书发送至所述无人 机。
在一些实施例中,所述获取限飞解禁证书,包括:
获取与所述无人机对应的限飞解禁证书组,所述限飞解禁证书组包括多个限飞解禁证书。
在一些实施例中,所述处理器还实现:
在所述交互界面显示授权区对应的证书标识;若检测到用户触发的授权发送操作,向所述无人机发送授权指令,以使所述无人机根据所述授权指令中的证书标识解禁所述证书标识对应的授权区;其中,所述无人机内存储有所述证书标识对应的授权区解禁证书。
在一些实施例中,所述处理器还实现:
在所述交互界面中显示授权区解禁证书的证书标识,以及对应的激活按键;若检测到用户操作所述激活按键,则根据所述证书标识生成授权指令,并将所述授权指令发送至所述无人机。
在一些实施例中,所述处理器还实现:
显示所述无人机的当前位置对应的地图,以及在所述地图上显示所述授权区在所述地图上对应的区域。
在一些实施例中,所述处理器还实现:
在所述地图上的预设位置显示所述授权区对应的授权区解禁证书的证书信息。
在一些实施例中,所述向所述无人机发送授权指令之前,所述处理器还实现:
获取所述无人机的当前位置;若所述无人机的当前位置与授权区的位置满足预设授权条件时,在所述图传画面或地图画面中弹框显示所述授权区对应的位置标识,以及对应的授权按键;若检测到用户操作所述授权按键,则根据所述授权区对应的证书标识生成授权指令。
在一些实施例中,所述根据所述授权区对应的证书标识生成授权指令,包括:
对用户进行验证,并在验证通过后根据所述授权区对应的证书标识生成授权指令。
在一些实施例中,所述对用户进行验证包括短信验证、邮箱验证、语音验 证、指纹验证、密码验证、身份证号验证中的一种。
在一些实施例中,所述无人机的当前位置与授权区的位置满足预设授权条件,包括:
若所述无人机的当前位置与授权区的位置在预设范围内,则确定所述无人机的当前位置与授权区的位置满足预设授权条件。
示例性的,所述处理器用于运行存储在存储器中的计算机程序,并在执行所述计算机程序时实现如下步骤:
获取所述无人机感测的移动目标的运动信息;在所述控制终端显示的交互界面中显示所述移动目标对应的提示图标;根据所述移动目标的运动信息确定所述提示图标的显示方式。
在一些实施例中,所述运动信息包括运动速度、相对高度、相对距离以及运动方向中至少一种;其中,所述相对高度为所述移动目标相对所述无人机的高度,所述相对距离为所述移动目标相对所述无人机的距离。
在一些实施例中,所述根据所述移动目标的运动信息确定所述提示图标的显示方式,包括:
根据所述移动目标的运动信息,确定所述移动目标的危险程度等级;以及根据所述危险程度等级确定所述提示图标的显示方式;其中,不同的所述危险程度等级对应的所述提示图标的显示方式不同。
在一些实施例中,不同危险程度等级对应的所述提示图标的显示颜色不同。
在一些实施例中,所述提示图标包括形状图标,所述形状图标用于表示所述移动目标。
在一些实施例中,所述提示图标包括形状图标和环状图标,其中,所述形状图标位于所述环状图标内,所述形状图标用于表示所述移动目标,所述环状图标用于表示所述移动目标的实际位置范围。
在一些实施例中,所述移动目标包括载人飞机,所述提示图标包括飞机图标。
在一些实施例中,所述载人飞机的运动信息是通过ADS-B装置获取的。
在一些实施例中,所述处理器还实现:在靠近所述提示图标处显示所述运动信息。
在一些实施例中,所述交互界面中包括所述地图画面和/或图传画面,所述 地图画面为所述无人机飞行时使用的地图,所述图传画面为所述无人机拍摄的画面。
在一些实施例中,所述处理器还实现:改变所述地图画面的边界框的显示颜色。
在一些实施例中,所述处理器还实现:
若检测到用户对所述地图画面进行切换操作,将所述地图画面与所述图传画面切换显示。
在一些实施例中,所述地图画面包括切换按键,所述处理器还实现:
若检测到用户操作所述切换按键时,将所述地图画面与所述图传画面切换显示。
在一些实施例中,所述将所述地图画面与所述图传画面切换显示之后,所述处理器还实现:
在靠近所述危险等级最高的移动目标对应的提示图标的位置处显示所述运动信息。
在一些实施例中,所述将所述地图画面与所述图传画面切换显示之后,所述处理器还实现:
在所述地图画面上显示所述无人机的起飞点位置和当前飞行位置,和/或,显示所述无人机的飞行轨迹。
在一些实施例中,所述处理器还实现:
在所述地图画面上显示所述无人机对应的飞行图标,所述飞行图标用于指示所述无人机的当前飞行位置和飞行方向。
在一些实施例中,所述获取所述无人机感测的移动目标的运动信息之后,所述处理器还实现:
输出用于提示用户所述无人机附近存在移动目标的提示信息;其中,所述提示信息包括震动提示信息、语音提示信息、文字提示信息、界面变化信息中至少一种。
在一些实施例中,所述处理器还实现:
获取限飞解禁证书,在所述交互界面显示所述限飞解禁证书;若检测到用户触发的证书发送操作,将所述限飞解禁证书发送至所述无人机,以使所述无人机根据所述限飞解禁证书解禁所述限飞解禁证书对应的限飞区域。
在一些实施例中,所述处理器还实现:
在所述交互界面中显示获取的限飞解禁证书的证书标识,以及对应的发送按键;若检测到用户操作所述发送按键,将所述限飞解禁证书发送至所述无人机。
在一些实施例中,所述获取限飞解禁证书,包括:
获取与所述无人机对应的限飞解禁证书组,所述限飞解禁证书组包括多个限飞解禁证书。
在一些实施例中,所述处理器还实现:
在所述交互界面显示授权区对应的证书标识;若检测到用户触发的授权发送操作,向所述无人机发送授权指令,以使所述无人机根据所述授权指令中的证书标识解禁所述证书标识对应的授权区;其中,所述无人机内存储有所述证书标识对应的授权区解禁证书。
在一些实施例中,所述处理器还实现:
在所述交互界面中显示授权区解禁证书的证书标识,以及对应的激活按键;若检测到用户操作所述激活按键,则根据所述证书标识生成授权指令,并将所述授权指令发送至所述无人机。
在一些实施例中,所述处理器还实现:
显示所述无人机的当前位置对应的地图,以及在所述地图上显示所述授权区在所述地图上对应的区域。
在一些实施例中,所述处理器还实现:
在所述地图上的预设位置显示所述授权区对应的授权区解禁证书的证书信息。
在一些实施例中,所述向所述无人机发送授权指令之前,所述处理器还实现:
获取所述无人机的当前位置;若所述无人机的当前位置与授权区的位置满足预设授权条件时,在所述图传画面或地图画面中弹框显示所述授权区对应的位置标识,以及对应的授权按键;若检测到用户操作所述授权按键,则根据所述授权区对应的证书标识生成授权指令。
在一些实施例中,所述根据所述授权区对应的证书标识生成授权指令,包括:
对用户进行验证,并在验证通过后根据所述授权区对应的证书标识生成授权指令。
在一些实施例中,所述对用户进行验证包括短信验证、邮箱验证、语音验证、指纹验证、密码验证、身份证号验证中的一种。
在一些实施例中,所述无人机的当前位置与授权区的位置满足预设授权条件,包括:
若所述无人机的当前位置与授权区的位置在预设范围内,则确定所述无人机的当前位置与授权区的位置满足预设授权条件。
请参阅图29,图29是本申请实施例提供的一种飞控制终端的示意性框图。如图29所示,该控制终端600包括处理器601、存储器602和显示装置603,存储器602和显示装置603通过总线与处理器601连接,该总线比如为I2C(Inter-integrated Circuit)总线。该控制终端600与无人机进行通信,用于控制无人机飞行。
其中,显示装置603用于显示,比如用于显示交互界面、图传画面、地图画面等等。显示装置603包括设置在控制终端上的显示屏或者独立于控制终端的显示器,独立于控制终端的显示器可以包括手机、平板电脑或者个人电脑等,或者也可以是带有显示屏的其他电子设备。其中,该显示屏包括LED显示屏、OLED显示屏、LCD显示屏等等
具体地,处理器601可以是微控制单元(Micro-controller Unit,MCU)、中央处理单元(Central Processing Unit,CPU)或数字信号处理器(Digital Signal Processor,DSP)等。
具体地,存储器602可以是Flash芯片、只读存储器(ROM,Read-Only Memory)磁盘、光盘、U盘或移动硬盘等。
其中,所述处理器用于运行存储在存储器中的计算机程序,并在执行所述计算机程序时实现本申请实施例提供的任意一种所述的飞行提示方法。
本申请的实施例还提供了一种飞行系统,具体如图1所示,所述飞行系统包括控制终端10和无人机20,控制终端10用于控制无人机20飞行,并执行本申请实施例提供的任意一种所述的飞行提示方法。
本申请的实施例中还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序中包括程序指令,所述处理器执行所 述程序指令,实现上述实施例提供的任一种所述的飞行提示方法的步骤。
其中,所述计算机可读存储介质可以是前述任一实施例所述的控制终端的内部存储单元,例如所述控制终端的存储器或内存。所述计算机可读存储介质也可以是所述控制终端的外部存储设备,例如所述控制终端上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。

Claims (80)

  1. 一种飞行提示方法,其特征在于,应用于控制终端,所述控制终端用于控制无人机飞行,所述方法包括:
    在所述控制终端的交互界面显示所述无人机拍摄到的图传画面和/或地图画面;
    获取所述无人机感测的障碍物信息;
    根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标。
  2. 根据权利要求1所述的方法,其特征在于,所述障碍物信息包括方位信息和/或距离信息,所述方位信息为障碍物相对所述无人机的方向,所述距离信息为障碍物相对所述无人机的距离。
  3. 根据权利要求2所述的方法,其特征在于,所述方位信息包括角度信息。
  4. 根据权利要求1所述的方法,其特征在于,所述无人机包括前向障碍物感知传感器和/或后向障碍物感知传感器;
    所述在所述交互界面的边界框处显示障碍提示图标,包括:
    在所述交互界面的上边界框和/或下边界框处显示所述障碍提示图标。
  5. 根据权利要求1所述的方法,其特征在于,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
    根据所述障碍物信息中的方位信息,在所述交互界面的多个边界框中确定目标边界框;以及
    在所述目标边界框处显示障碍提示图标。
  6. 根据权利要求5所述的方法,其特征在于,所述无人机包括前向障碍物感知传感器、后向障碍物感知传感器、左向障碍物感知传感器和/或右向障碍物感知传感器;所述方位信息包括:障碍物在所述无人机的前方、后方、左方和右方中任意一种;所述目标边界框包括上边界框、下边界框、左边界框和右边界框中任意一种。
  7. 根据权利要求1所述的方法,其特征在于,所述障碍提示图标包括障碍物提示条,所述障碍物提示条位于所述交互界面的边界框。
  8. 根据权利要求7所述的方法,其特征在于,所述障碍物提示条的宽度与所述交互界面中用于显示所述障碍物提示条的边界框的宽度相同;或者
    所述障碍物提示条的宽度小于所述交互界面中用于显示所述障碍物提示条的边界框的宽度。
  9. 根据权利要求7所述的方法,其特征在于,所述障碍物提示条为半透明图标或透明图标。
  10. 根据权利要求1至9任一项所述的方法,其特征在于,所述方法还包括:
    若所述障碍物信息中距离信息大于预设安全距离,或者若未检测到障碍物,隐藏所述障碍提示图标。
  11. 根据权利要求1至9任一项所述的方法,其特征在于,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
    根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色。
  12. 根据权利要求11所述的方法,其特征在于,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色,包括:
    若障碍物相对所述无人机的距离小于预设距离,将与所述预设距离对应的预设颜色确定为所述障碍提示图标的显示颜色。
  13. 根据权利要求12所述的方法,其特征在于,所述与所述预设距离对应的预设颜色包括黄色。
  14. 根据权利要求11所述的方法,其特征在于,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色,包括:
    若确定所述无人机处于紧急悬停状态,将与所述紧急悬停状态对应的预设颜色确定为所述障碍提示图标的显示颜色;
    其中,所述紧急悬停状态为所述无人机因障碍物进入的悬停状态。
  15. 根据权利要求14所述的方法,其特征在于,所述与所述紧急悬停状态对应的预设颜色包括红色,或者,所述与所述紧急悬停状态对应的预设颜色呈动态扩散效果。
  16. 根据权利要求11所述的方法,其特征在于,所述根据所述障碍物信息中的距离信息,确定在所述交互界面的边界框处显示的障碍提示图标的显示颜色之后,还包括:
    输出用于提示用户所述无人机附近出现障碍物的提示信息;
    其中,所述提示信息包括震动提示信息、语音提示信息、文字提示信息中至少一种。
  17. 根据权利要求1至9任一项所述的方法,其特征在于,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
    根据所述障碍物信息中的方位信息在所述障碍提示图标中确定目标位置;以及
    根据所述距离信息确定所述障碍指示图标在所述目标位置处的显示颜色。
  18. 根据权利要求1至9任一项所述的方法,其特征在于,所述获取所述无人机感测的障碍物信息之后,还包括:
    根据所述障碍物信息确定所述无人机是否触发预警条件,所述预警条件用于触发显示障碍提示图标;
    若所述无人机触发所述预警条件,则在所述交互界面的边界框处显示障碍提示图标。
  19. 根据权利要求18所述的方法,其特征在于,所述根据所述障碍物信息确定所述无人机是否触发预警条件,包括:
    确定所述障碍物信息中的距离信息是否小于或等于预设安全距离;
    若所述障碍物信息中的距离信息小于或等于所述预设安全距离,则确定所述无人机触发预警条件。
  20. 根据权利要求1所述的方法,其特征在于,所述障碍物信息包括移动目标的运动信息。
  21. 根据权利要求20所述的方法,其特征在于,所述运动信息包括运动速度、相对高度、相对距离以及运动方向中至少一种;
    其中,所述相对高度为所述移动目标相对所述无人机的高度,所述相对距离为所述移动目标相对所述无人机的距离。
  22. 根据权利要求20所述的方法,其特征在于,所述移动目标包括载人飞机,所述障碍提示图标包括飞机图标。
  23. 根据权利要求22所述的方法,其特征在于,所述载人飞机的运动信息是通过ADS-B装置获取的。
  24. 根据权利要求22所述的方法,其特征在于,所述方法还包括:在靠近所述飞机图标处显示所述运动信息。
  25. 根据权利要求20所述的方法,其特征在于,所述交互界面中包括所述地图画面,所述地图画面为所述无人机飞行时使用的地图。
  26. 根据权利要求25所述的方法,其特征在于,所述方法还包括:
    在所述地图画面上显示所述移动目标对应的提示图标。
  27. 根据权利要求25所述的方法,其特征在于,所述方法还包括:
    改变所述地图画面的边界框的显示颜色。
  28. 根据权利要求25所述的方法,其特征在于,所述方法包括:
    若检测到用户对所述地图画面进行切换操作,将所述地图画面与所述图传画面进行切换显示。
  29. 根据权利要求25所述的方法,其特征在于,所述地图画面包括切换按键;所述方法还包括:
    若检测到用户操作所述切换按键,将所述地图画面与所述图传画面切换显示。
  30. 根据权利要求28所述的方法,其特征在于,所述将所述地图画面与所述图传画面切换显示之后,所述方法还包括:
    在靠近所述地图画面上显示的所述移动目标的提示图标的位置处显示所述运动信息。
  31. 根据权利要求28所述的方法,其特征在于,所述将所述地图画面与所述图传画面切换显示之后,所述方法还包括:
    在所述地图画面上显示所述无人机的起飞点位置和当前飞行位置,和/或,显示所述无人机的飞行轨迹。
  32. 根据权利要求20所述的方法,其特征在于,所述根据所述障碍物信息,在所述交互界面的边界框处显示障碍提示图标,包括:
    根据所述移动目标的运动信息确定所述移动目标的提示图标的显示方式;
    其中,所述根据所述移动目标的运动信息确定所述移动目标的提示图标的显示方式,包括:
    根据所述移动目标的运动信息,确定所述移动目标的危险程度等级;以及
    根据所述危险程度等级确定所述提示图标的显示方式。
  33. 根据权利要求32所述的方法,其特征在于,不同危险程度等级对应的所述提示图标的显示颜色不同。
  34. 根据权利要求32所述的方法,其特征在于,所述提示图标包括用于表示所述移动目标的形状图标。
  35. 根据权利要求32所述的方法,其特征在于,所述提示图标包括用于表示所述移动目标的形状图标和用于表示所述移动目标的实际位置范围的环状图标,其中,所述形状图标位于所述环状图标内。
  36. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    获取限飞解禁证书,在所述交互界面显示所述限飞解禁证书;
    若检测到用户触发的证书发送操作,将所述限飞解禁证书发送至所述无人机,以使所述无人机根据所述限飞解禁证书解禁所述限飞解禁证书对应的限飞区域。
  37. 根据权利要求36所述的方法,其特征在于,所述方法还包括:
    在所述交互界面中显示获取的限飞解禁证书的证书标识,以及对应的发送按键;
    若检测到用户操作所述发送按键,将所述限飞解禁证书发送至所述无人机。
  38. 根据权利要求36所述的方法,其特征在于,所述获取限飞解禁证书,包括:
    获取与所述无人机对应的限飞解禁证书组,所述限飞解禁证书组包括多个限飞解禁证书。
  39. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    在所述交互界面显示授权区对应的证书标识;
    若检测到用户触发的授权发送操作,向所述无人机发送授权指令,以使所述无人机根据所述授权指令中的证书标识解禁所述证书标识对应的授权区;
    其中,所述无人机内存储有所述证书标识对应的授权区解禁证书。
  40. 根据权利要求39所述的方法,其特征在于,所述方法还包括:
    在所述交互界面中显示授权区解禁证书的证书标识,以及对应的激活按键;
    若检测到用户操作所述激活按键,则根据所述证书标识生成授权指令,并 将所述授权指令发送至所述无人机。
  41. 根据权利要求39所述的方法,其特征在于,所述方法还包括:
    显示所述无人机的当前位置对应的地图,以及在所述地图上显示所述授权区在所述地图上对应的区域。
  42. 根据权利要求41所述的方法,其特征在于,所述方法还包括:
    在所述地图上的预设位置显示所述授权区对应的授权区解禁证书的证书信息。
  43. 根据权利要求39所述的方法,其特征在于,所述向所述无人机发送授权指令之前,所述方法还包括:
    获取所述无人机的当前位置;
    若所述无人机的当前位置与授权区的位置满足预设授权条件时,在所述图传画面或地图画面中弹框显示所述授权区对应的位置标识,以及对应的授权按键;
    若检测到用户操作所述授权按键,则根据所述授权区对应的证书标识生成授权指令。
  44. 根据权利要求43所述的方法,其特征在于,所述根据所述授权区对应的证书标识生成授权指令,包括:
    对用户进行验证,并在验证通过后根据所述授权区对应的证书标识生成授权指令。
  45. 根据权利要求44所述的方法,其特征在于,所述对用户进行验证包括短信验证、邮箱验证、语音验证、指纹验证、密码验证、身份证号验证中的一种。
  46. 根据权利要求43所述的方法,其特征在于,所述无人机的当前位置与授权区的位置满足预设授权条件,包括:
    若所述无人机的当前位置与授权区的位置在预设范围内,则确定所述无人机的当前位置与授权区的位置满足预设授权条件。
  47. 一种飞行提示方法,其特征在于,应用于控制终端,所述控制终端用于控制无人机飞行,所述方法包括:
    获取所述无人机感测的移动目标的运动信息;
    在所述控制终端显示的交互界面中显示所述移动目标对应的提示图标;
    根据所述移动目标的运动信息确定所述提示图标的显示方式。
  48. 根据权利要求47所述的方法,其特征在于,所述运动信息包括运动速度、相对高度、相对距离以及运动方向中至少一种;
    其中,所述相对高度为所述移动目标相对所述无人机的高度,所述相对距离为所述移动目标相对所述无人机的距离。
  49. 根据权利要求48所述的方法,其特征在于,所述根据所述移动目标的运动信息确定所述提示图标的显示方式,包括:
    根据所述移动目标的运动信息,确定所述移动目标的危险程度等级;以及
    根据所述危险程度等级确定所述提示图标的显示方式;
    其中,不同的所述危险程度等级对应的所述提示图标的显示方式不同。
  50. 根据权利要求49所述的方法,其特征在于,不同危险程度等级对应的所述提示图标的显示颜色不同。
  51. 根据权利要求49所述的方法,其特征在于,所述提示图标包括形状图标,所述形状图标用于表示所述移动目标。
  52. 根据权利要求49所述的方法,其特征在于,所述提示图标包括形状图标和环状图标,其中,所述形状图标位于所述环状图标内,所述形状图标用于表示所述移动目标,所述环状图标用于表示所述移动目标的实际位置范围。
  53. 根据权利要求47至52任一项所述的方法,其特征在于,所述移动目标包括载人飞机,所述提示图标包括飞机图标。
  54. 根据权利要求53所述的方法,其特征在于,所述载人飞机的运动信息是通过ADS-B装置获取的。
  55. 根据权利要求47至52任一项所述的方法,其特征在于,所述方法还包括:在靠近所述提示图标处显示所述运动信息。
  56. 根据权利要求47至52任一项所述的方法,其特征在于,所述交互界面中包括所述地图画面和/或图传画面,所述地图画面为所述无人机飞行时使用的地图,所述图传画面为所述无人机拍摄的画面。
  57. 根据权利要求56所述的方法,其特征在于,所述方法还包括:
    改变所述地图画面的边界框的显示颜色。
  58. 根据权利要求56所述的方法,其特征在于,所述方法还包括:
    若检测到用户对所述地图画面进行切换操作,将所述地图画面与所述图传 画面切换显示。
  59. 根据权利要求56所述的方法,其特征在于,所述地图画面包括切换按键,所述方法还包括:
    若检测到用户操作所述切换按键时,将所述地图画面与所述图传画面切换显示。
  60. 根据权利要求59所述的方法,其特征在于,所述将所述地图画面与所述图传画面切换显示之后,所述方法还包括:
    在靠近所述危险等级最高的移动目标对应的提示图标的位置处显示所述运动信息。
  61. 根据权利要求59所述的方法,其特征在于,所述将所述地图画面与所述图传画面切换显示之后,所述方法还包括:
    在所述地图画面上显示所述无人机的起飞点位置和当前飞行位置,和/或,显示所述无人机的飞行轨迹。
  62. 根据权利要求47至52任一项所述的方法,其特征在于,所述方法还包括:
    在所述地图画面上显示所述无人机对应的飞行图标,所述飞行图标用于指示所述无人机的当前飞行位置和飞行方向。
  63. 根据权利要求47至52任一项所述的方法,其特征在于,所述获取所述无人机感测的移动目标的运动信息之后,所述方法还包括:
    输出用于提示用户所述无人机附近存在移动目标的提示信息;
    其中,所述提示信息包括震动提示信息、语音提示信息、文字提示信息、界面变化信息中至少一种。
  64. 根据权利要求47所述的方法,其特征在于,所述方法还包括:
    获取限飞解禁证书,在所述交互界面显示所述限飞解禁证书;
    若检测到用户触发的证书发送操作,将所述限飞解禁证书发送至所述无人机,以使所述无人机根据所述限飞解禁证书解禁所述限飞解禁证书对应的限飞区域。
  65. 根据权利要求64所述的方法,其特征在于,所述方法还包括:
    在所述交互界面中显示获取的限飞解禁证书的证书标识,以及对应的发送按键;
    若检测到用户操作所述发送按键,将所述限飞解禁证书发送至所述无人机。
  66. 根据权利要求64所述的方法,其特征在于,所述获取限飞解禁证书,包括:
    获取与所述无人机对应的限飞解禁证书组,所述限飞解禁证书组包括多个限飞解禁证书。
  67. 根据权利要求47所述的方法,其特征在于,所述方法还包括:
    在所述交互界面显示授权区对应的证书标识;
    若检测到用户触发的授权发送操作,向所述无人机发送授权指令,以使所述无人机根据所述授权指令中的证书标识解禁所述证书标识对应的授权区;
    其中,所述无人机内存储有所述证书标识对应的授权区解禁证书。
  68. 根据权利要求67所述的方法,其特征在于,所述方法还包括:
    在所述交互界面中显示授权区解禁证书的证书标识,以及对应的激活按键;
    若检测到用户操作所述激活按键,则根据所述证书标识生成授权指令,并将所述授权指令发送至所述无人机。
  69. 根据权利要求67所述的方法,其特征在于,所述方法还包括:
    显示所述无人机的当前位置对应的地图,以及在所述地图上显示所述授权区在所述地图上对应的区域。
  70. 根据权利要求69所述的方法,其特征在于,所述方法还包括:
    在所述地图上的预设位置显示所述授权区对应的授权区解禁证书的证书信息。
  71. 根据权利要求67所述的方法,其特征在于,所述向所述无人机发送授权指令之前,所述方法还包括:
    获取所述无人机的当前位置;
    若所述无人机的当前位置与授权区的位置满足预设授权条件时,在所述图传画面或地图画面中弹框显示所述授权区对应的位置标识,以及对应的授权按键;
    若检测到用户操作所述授权按键,则根据所述授权区对应的证书标识生成授权指令。
  72. 根据权利要求71所述的方法,其特征在于,所述根据所述授权区对应的证书标识生成授权指令,包括:
    对用户进行验证,并在验证通过后根据所述授权区对应的证书标识生成授权指令。
  73. 根据权利要求72所述的方法,其特征在于,所述对用户进行验证包括短信验证、邮箱验证、语音验证、指纹验证、密码验证、身份证号验证中的一种。
  74. 根据权利要求71所述的方法,其特征在于,所述无人机的当前位置与授权区的位置满足预设授权条件,包括:
    若所述无人机的当前位置与授权区的位置在预设范围内,则确定所述无人机的当前位置与授权区的位置满足预设授权条件。
  75. 一种飞行提示装置,其特征在于,应用于控制终端,所述飞行指示装置包括处理器和存储器;
    所述存储器用于存储计算机程序;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现权利要求1至46任一项所述方法的步骤。
  76. 一种飞行提示装置,其特征在于,应用于控制终端,所述飞行指示装置包括处理器和存储器;
    所述存储器用于存储计算机程序;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现权利要求47至74任一项所述方法的步骤。
  77. 一种控制终端,其特征在于,所述控制终端包括:显示装置、存储器和处理器;
    所述显示装置用于显示;
    所述存储器用于存储计算机程序;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现权利要求1至46任一项所述方法的步骤。
  78. 一种控制终端,其特征在于,所述控制终端包括:显示装置、存储器和处理器;
    所述显示装置用于显示;
    所述存储器用于存储计算机程序;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现 权利要求47至74任一项所述方法的步骤。
  79. 一种飞行系统,其特征在于,所述飞行系统包括无人机和如权利要求77或78所述的控制终端,所述控制终端用于控制所述无人机飞行。
  80. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现权利要求1至46任一项所述方法,或者实现权利要求47至74任一项所述方法的步骤。
PCT/CN2020/087339 2020-04-27 2020-04-27 飞行提示方法、装置、控制终端、系统及存储介质 WO2021217381A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080005136.5A CN112771464A (zh) 2020-04-27 2020-04-27 飞行提示方法、装置、控制终端、系统及存储介质
PCT/CN2020/087339 WO2021217381A1 (zh) 2020-04-27 2020-04-27 飞行提示方法、装置、控制终端、系统及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/087339 WO2021217381A1 (zh) 2020-04-27 2020-04-27 飞行提示方法、装置、控制终端、系统及存储介质

Publications (1)

Publication Number Publication Date
WO2021217381A1 true WO2021217381A1 (zh) 2021-11-04

Family

ID=75699479

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/087339 WO2021217381A1 (zh) 2020-04-27 2020-04-27 飞行提示方法、装置、控制终端、系统及存储介质

Country Status (2)

Country Link
CN (1) CN112771464A (zh)
WO (1) WO2021217381A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113703703A (zh) * 2021-08-23 2021-11-26 深圳市道通智能航空技术股份有限公司 一种无人机数据显示方法、装置、设备及存储介质
WO2023184487A1 (zh) * 2022-04-01 2023-10-05 深圳市大疆创新科技有限公司 无人机避障方法、装置、无人机、遥控设备和存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102591346A (zh) * 2011-12-05 2012-07-18 大连理工大学 一种手持式小型无人机地面监控系统
KR20130009894A (ko) * 2013-01-05 2013-01-23 이상윤 공간정보기술을 이용한 근거리 정밀타격 무인항공기시스템
CN107077145A (zh) * 2016-09-09 2017-08-18 深圳市大疆创新科技有限公司 显示无人飞行器的障碍检测的方法和系统
CN108521807A (zh) * 2017-04-27 2018-09-11 深圳市大疆创新科技有限公司 无人机的控制方法、设备及障碍物的提示方法、设备
CN109270522A (zh) * 2017-07-17 2019-01-25 极光飞行科学公司 用于在空中系统中检测障碍物的系统和方法
CN110291481A (zh) * 2018-06-30 2019-09-27 深圳市大疆创新科技有限公司 一种信息提示方法及控制终端
CN111065983A (zh) * 2018-10-18 2020-04-24 深圳市大疆创新科技有限公司 限飞区生成方法和设备、控制无人飞行器飞行的方法和设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102591346A (zh) * 2011-12-05 2012-07-18 大连理工大学 一种手持式小型无人机地面监控系统
KR20130009894A (ko) * 2013-01-05 2013-01-23 이상윤 공간정보기술을 이용한 근거리 정밀타격 무인항공기시스템
CN107077145A (zh) * 2016-09-09 2017-08-18 深圳市大疆创新科技有限公司 显示无人飞行器的障碍检测的方法和系统
CN108521807A (zh) * 2017-04-27 2018-09-11 深圳市大疆创新科技有限公司 无人机的控制方法、设备及障碍物的提示方法、设备
CN109270522A (zh) * 2017-07-17 2019-01-25 极光飞行科学公司 用于在空中系统中检测障碍物的系统和方法
CN110291481A (zh) * 2018-06-30 2019-09-27 深圳市大疆创新科技有限公司 一种信息提示方法及控制终端
CN111065983A (zh) * 2018-10-18 2020-04-24 深圳市大疆创新科技有限公司 限飞区生成方法和设备、控制无人飞行器飞行的方法和设备

Also Published As

Publication number Publication date
CN112771464A (zh) 2021-05-07

Similar Documents

Publication Publication Date Title
US11755041B2 (en) Objective-based control of an autonomous unmanned aerial vehicle
US11861892B2 (en) Object tracking by an unmanned aerial vehicle using visual sensors
US11749124B2 (en) User interaction with an autonomous unmanned aerial vehicle
US9691287B1 (en) Graphical method to set vertical and lateral flight management system constraints
US20190072949A1 (en) Network based operation of an unmanned aerial vehicle based on user commands and virtual flight assistance constraints
EP3345832B1 (en) Unmanned aerial vehicle and method for controlling the same
WO2021212519A1 (zh) 飞行指引方法、装置、系统、遥控终端及可读存储介质
WO2021217381A1 (zh) 飞行提示方法、装置、控制终端、系统及存储介质
US8860787B1 (en) Method and apparatus for telepresence sharing
US11613354B2 (en) Method and device for controlling flight, control terminal, flight system and processor
WO2018187889A1 (zh) 一种飞行处理方法及控制设备
JP6829513B1 (ja) 位置算出方法及び情報処理システム
WO2020107454A1 (zh) 障碍物的精准确定方法、设备及计算机可读存储介质
JP5971466B2 (ja) フライトパス表示システム、方法及びプログラム
CN113223328A (zh) 无人载具视线的增强
WO2021212518A1 (zh) 飞行指引方法、装置、系统、控制终端及可读存储介质
CN110832420A (zh) 无人机的控制方法、装置和无人机
WO2023193611A1 (zh) 无人飞行器及其控制方法、装置、系统
WO2023025202A1 (zh) 云台方向的控制方法、装置及终端
WO2023082257A1 (zh) 无人机的控制方法、控制装置、无人机及存储介质
WO2021134607A1 (zh) 无人机的飞行控制方法、设备、系统和计算机可读介质
Sedlmajer et al. Effective Remote Drone Control using Augmented Virtuality.
WO2023133772A1 (zh) 障碍物监测方法、装置、设备、雷达装置及可移动平台
KR102458270B1 (ko) 비가시권 비행 uav의 vr 기반 모니터링 장치 및 방법
WO2022227090A1 (zh) 点云数据处理方法、装置、终端设备、控制系统和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20933172

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20933172

Country of ref document: EP

Kind code of ref document: A1