WO2018045654A1 - Method and system for displaying state of mobile device and control device - Google Patents

Method and system for displaying state of mobile device and control device Download PDF

Info

Publication number
WO2018045654A1
WO2018045654A1 PCT/CN2016/109243 CN2016109243W WO2018045654A1 WO 2018045654 A1 WO2018045654 A1 WO 2018045654A1 CN 2016109243 W CN2016109243 W CN 2016109243W WO 2018045654 A1 WO2018045654 A1 WO 2018045654A1
Authority
WO
WIPO (PCT)
Prior art keywords
control device
information
drone
movable
display interface
Prior art date
Application number
PCT/CN2016/109243
Other languages
French (fr)
Chinese (zh)
Inventor
缪宝杰
张洁明
陈伟
杨秉臻
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201680002256.3A priority Critical patent/CN107077144B/en
Publication of WO2018045654A1 publication Critical patent/WO2018045654A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0044Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/42Determining position

Definitions

  • the present invention relates to a method, system and control device for displaying the status of a mobile device.
  • a mobile device such as a drone can carry a carrier, for example, some drones are equipped with a pan/tilt carrying a camera or a light to perform aerial photography using a camera.
  • the controller when the user manipulates the movable device through the remote control device, when it is away from the user's location (for example, away from four or five hundred meters), it is difficult to perform manipulation by visual observation.
  • the controller when using an unmanned aerial vehicle for aerial photography or the like, the controller often needs to know the relative position of the movable device and the user, and the motion state of the movable device, and operate according to the real-time relative position and motion state. .
  • the existing remote control device cannot effectively display the real-time relative position and motion state, etc., which makes the user's control experience poor and easily causes misoperation.
  • An aspect of the present invention provides a method for displaying a state of a movable device, comprising: acquiring state information of the movable device; acquiring state information of the control device, the control device for controlling movement of the movable device; Status information of each of the control device and the movable device is displayed on the same display interface.
  • Another aspect of the present invention provides a system for displaying a state of a movable device, the system comprising: communication means for acquiring state information of the movable device and state information of the control device, the control device And a storage device configured to execute the computer readable instructions to control display of the respective control device and the movable device on the same display interface Control information.
  • a further aspect of the present invention provides a control apparatus for displaying a state of a movable device, comprising: a communication interface for acquiring state information of the movable device and state information of the control device, the control device being used for Controlling the removable device; the memory storing computer readable instructions; and a processor for executing the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface.
  • the present invention is also a computer readable medium having stored thereon computer executable instructions for performing the aforementioned method for displaying a state of a removable device.
  • FIG. 1A is an application scenario diagram of one embodiment of a system for displaying a state of a movable device of the present invention
  • 1B is a flow chart of a method for displaying a state of a movable device of the present invention
  • FIG. 2A is a schematic view showing a first embodiment of a display interface in the control device of the present invention.
  • 2B is a schematic view showing a second embodiment of a display interface in the control device of the present invention.
  • Figure 3 is a schematic illustration of a third embodiment of a display interface in the control device of the present invention.
  • FIGS. 4A to 4C are schematic views showing a fourth embodiment of a display interface in the control device of the present invention.
  • Figure 5 is a schematic view showing a fifth embodiment of a display interface in the control device of the present invention.
  • FIG. 6 is a schematic structural diagram of a system for displaying a state of a movable device according to the present invention.
  • Figure 7 is a block diagram showing the construction of a control device for displaying the state of a movable device in accordance with the present invention.
  • the present invention mainly considers how to better display the relative position of the movable device and the remote control terminal and the real-time movement state of the movable device on the remote control terminal, so as to facilitate Users can control mobile devices more conveniently, efficiently, or with interest, improving the user's control experience.
  • the method, device and system of the present invention are not limited to the field, and any mobile control can be moved by wired or wireless remote control.
  • the present invention can be reasonably utilized in the field of devices, including, for example, various unmanned vehicles, and any application device and application scenarios that do not require humans to operate directly on the device body, such as satellite, robotics, virtual Reality technology, etc.
  • Removable refers to any relative movement in three-dimensional space, including translation, rotation, and various combinations of translation and rotation, such as movement in different spaces such as flight, road driving, and stealth. ,as well as Different movement modes such as pan, flip, pitch, and tilt.
  • the "module” and “unit” referred to in the present invention may be any hardware device or component of the device, such as a processor, or a logic module or unit of software.
  • the hardware device or components of the device may also execute the corresponding method in accordance with a computer program stored in a non-transitory computer readable medium stored in the memory.
  • control device means any device capable of operating a movable device by wire or wirelessly. It is usually provided with a button, a handle, etc. for the user to manipulate, so that the user can generate a control signal by manipulation to transmit to the movable device to control the movement state of the mobile device.
  • the present invention proposes to graphically display status information of the control device and the movable device on the same display interface.
  • the premise of displaying the status information of both is that the control device can acquire the status information of both in real time.
  • the status information may include various information related to the mobile device and the control device, such as location, attitude, load status, and the like.
  • Displaying the state information of the control device and the movable device in a graphical manner on the same display interface enables the user to intuitively understand the relative relationship between the current mobile device and the control device, and avoids displaying only the state information of the movable device when the display interface is displayed. It is difficult for the user to generate the real feeling of the distance and orientation of the movable device, the user's manipulation feedback is enhanced, and the manipulation experience is improved.
  • the status information includes location information.
  • the location information of the mobile device can be directly received from the mobile device or provided by a third party platform such as a base station, a satellite, or the like.
  • a location acquisition device such as a GPS module
  • it can obtain its real-time location information for transmission to the control device.
  • the position information of the control device can be generated by itself or externally. In a special application, the position can also be fixed, so that the position information can be obtained by direct input. When obtained by itself, it may also be provided with a location acquisition device (e.g., a GPS module).
  • the control device itself may be manipulated with the user, considering that the position of the movable device may occur in any orientation relative to the user's control device. Since the rotation occurs by the action, it is preferable to display the position information of the control device and the movable device in a circular area of the display interface. Thus, regardless of the change in the relative position and orientation of the movable device and the control device, the display effect is not changed in the display region due to the change in the angle.
  • the circular area as a preferred mode of the present invention indicates that the present invention is not limited to the shape of the display area, and the scheme for simultaneously displaying the movable device and the control device according to the present invention may also be displayed by using other shapes of display areas, such as a square. Or a triangle.
  • the movable device and the control device can be specified in the display interface Graphical logo to represent.
  • a circle, a triangle, an arrow, or the like may be used to represent a drone, and a control device may be represented by a circle, a square, or the like.
  • a more vivid image to indicate that the invention is not limited to the specific logo style.
  • the position of the movable device and the control device can be represented using the position of the graphical identification on the display interface.
  • the actual spatial geographic location may be represented in an equal scale manner to display the location of the graphical identification of both on an equal scale in the display interface.
  • the present invention is not limited to the proportional method, and other correspondences may be used for display. Since the positions of the two are displayed on the same display interface, the relative positional relationship between the two can be clearly understood.
  • the state information includes posture information of the movable device.
  • the present invention preferably displays the posture information of the movable device on the display interface.
  • the gesture information herein refers to any information that can reflect the posture of the mobile device during the movement process. Taking the drone as an example, the attitude information includes orientation information, pitch angle, roll angle, and the like.
  • the real-time attitude information of the mobile device can be acquired in real time by its own sensor and transmitted to the control device through its communication device.
  • the pitch angle is an angle at which the head of the drone is tilted or raised in the height direction; the roll angle is an angle at which the drone rotates around the head and the tail line relative to the horizontal plane.
  • the present invention graphically displays the gesture information on a display interface.
  • a geometry can be used to represent the drone, and the location of the geometry in the interface represents the location information of the drone.
  • the orientation information, posture information, and the like of the drone can also be represented graphically (for example, a pitch line and a roll angle are indicated by dynamic horizontal lines, which will be described in detail in the following embodiments).
  • the present invention is not limited to which graphical information is used to display the above-described state information, and those skilled in the art can carry out various designs under the guidance of the design concept of the present invention to increase the visual experience of the user.
  • the mobile device of the present invention may carry a load itself, and the load is likely to require the user to pay attention to its working state in real time or to manipulate it to change its working state. Therefore, the present invention is also preferably to simultaneously display status information of the load on the display interface.
  • the status information includes any information that reflects the operational status of the load during the move.
  • a camera can be mounted on the gimbal for real-time shooting, and the camera needs to change the angle and adjust the posture in real time when shooting.
  • the camera can be mounted on the head of the drone, and the user can adjust the attitude of the camera and control the camera to shoot by wirelessly controlling the pan/tilt.
  • the present invention can graphically display the orientation of the gimbal and the visual range of the camera and the like on the display interface of the control device, thereby reflecting the current posture of the pan/tilt and the camera so that the user can intuitively understand the current working state of the camera.
  • the present invention is not limited to graphical representation of the status information of the load. Those skilled in the art can carry out various designs under the guidance of the design concept of the present invention to increase the visual experience of the user.
  • FIG. 1A is an application scenario diagram of one embodiment of a system for displaying a state of a mobile device of the present invention.
  • the system is a drone remote control system including a remote control device 1 and a drone 2, and a camera 4 is mounted on the pan/tilt of the drone 2.
  • Wireless communication is possible between the remote control device 1 and the drone 2, so that the user manipulates the remote control device 1 to control the flight of the drone and control the operation of the camera 4.
  • the remote control device 1 has a display screen 3, and the display screen 3 has a display interface.
  • the display interface can display the operating status information about the drone and the camera mounted thereon, and the user can view the display 3 to control the drone 2 and the camera 4 mounted thereon in real time.
  • FIG. 1B is a flow chart of a method of the present invention for displaying the state of a mobile device.
  • the method includes: S1: acquiring state information of the movable device; S2, acquiring state information of the control device; and S3, displaying state information of each of the control device and the movable device on the same display interface.
  • Steps S1 and S2 generally do not have a fixed sequence.
  • the above steps S1 to S3 can be repeated at a fixed frequency to update the position and/or status information of the remote control device 1 and the drone 2 on the display interface in real time.
  • FIG. 2A is a schematic diagram of a first embodiment of a display interface in the control device of the present invention.
  • the remote control device of the drone is still taken as an example for illustration.
  • Both the movable device (unmanned aerial vehicle) and the control device (remote control device) are displayed as a graphical identifier, that is, the remote control device identification 11 and the drone identification 12, and the remote control identification 11 and the drone identification 12 are displayed in a circle.
  • the remote control identification 11 is always located at the center of the circular area, shown as a circle with a center mark "H", and the drone mark 12 is a smaller circle (Fig.
  • the drone identifier 12 is correspondingly displayed in the circular area 10 according to the actual distance and orientation of the movable device relative to the remote control device 11 to visually display the drone relative to the user (remote control The direction and distance of the device).
  • the scale of the circular area may vary with the distance between the drone and the remote control to display the two logos on the display interface at an appropriate scale.
  • the location information of the drone can be obtained by its own GPS module and transmitted to the control device, the location information of which is either fixed information or obtained by its own GPS module.
  • the remote control device identification 11 is always located at the center of the circular area 10, unlike the display mode, in the second embodiment, as shown in Fig. 2B, the center of the circular area 10 indicates a specific Location point. That is, the center cross point of the circular area 10 is used in the display interface to represent the specific address location information.
  • the specific geographic location point is the departure geographic location of the drone 12.
  • the remote control device is also carried away from the departure point of the drone, and thus the remote control device is also offset relative to a specific geographic location.
  • the identification of the remote control device also shifts to the upper left relative to the departure point of the drone in the display interface.
  • the specific geographic location point is not limited to the starting point of the mobile device (unmanned aerial vehicle), and may also be set to any geographical location, such as the destination of the mobile device, the specific set of takeoff and landing. Points or specific geographic locations, etc.
  • the display interface further includes an orientation information auxiliary identifier.
  • the orientation information assisted identification includes any visual identification that can assist the user in determining the orientation of the movable device or control device in the display interface.
  • the orientation information assistance indicator includes a control device front facing indicator 13, a north north direction identification 14 and a distance auxiliary identification 15.
  • the front face of the control device defines the frontal orientation of the control device (in this embodiment the remote control of the drone), which does not change position in the display interface, in this embodiment directly above the display interface Triangle logo.
  • the north north direction indicator 14 represents the direction of the north direction relative to the control device and may vary accordingly in the display interface as the orientation of the remote control device changes. In this embodiment it is located at the periphery of the circular area.
  • the distance auxiliary mark 15 is a concentric circle composed of a broken line in this embodiment, and is used to indicate a distance index in the display area.
  • FIG. 4A to 4C are schematic views of a fourth embodiment of a display interface in the control device of the present invention. As shown in the figure, in this embodiment, in addition to the elements shown in FIG. 3, it also graphically displays the status information of the drone and the status information of the loaded load (including the pan/tilt and the camera).
  • an arrow is used to indicate the drone
  • reference numeral 16 in the figure is the vertex angle direction of the arrow for representing the flight direction or head orientation of the drone.
  • reference numeral 17 is a dynamic water level line pattern for representing the flying posture of the drone.
  • the dynamic water level line is located below the circular area and simulates the manner in which water moves in a flat container with a change in flight attitude.
  • the height of the water line represents the pitch angle of the drone
  • the angle of inclination of the water level represents the roll angle of the drone.
  • FIG. 4A shows the case where the pitch angle of the drone is zero, but the roll angle is not zero, and the water line at this time is just at the center of the circle.
  • the water level to the left in the figure indicates that the drone is tilted leftward about the roll axis.
  • FIG. 4B when the pitch angle of the drone is not zero, its horizontal plane will be higher than the center of the circular area.
  • Figure 4B It shows that when the drone is swooping down, the center of the water level is higher than the center of the circular area. Similarly, when the drone is lifted up, its level is lower than the center of the circular area.
  • Fig. 4C shows the case where the drone produces an inclination at both the roll direction and the pitch direction.
  • FIG. 5 is a schematic illustration of a fifth embodiment of a display interface in the control device of the present invention.
  • the state information of the load is also displayed in this embodiment.
  • the load includes a pan/tilt and a camera on the gimbal.
  • Reference numeral 18 is a sector area for indicating the visual range of the camera.
  • the annular section 19 located around the circular area 10 represents the offset angle of the gimbal.
  • the visual range 18 has a deflection angle relative to the nose orientation 16 of the drone.
  • the deflection angle of the gimbal of the drone usually has an allowable range, for example, 0 to 270 degrees.
  • the color of the annular section 19 changes in the present embodiment to alert the user. For example, it is displayed in green when it is within the allowable range, turns yellow when it is close to the allowable range, and turns red when it is outside the allowable range.
  • the above embodiments mainly illustrate an exemplary embodiment of the method for displaying the state of a movable device of the present invention. It should be understood that the above method of the present invention can be implemented by hardware or software. The form that can be achieved by the mode of the present invention is schematically illustrated by way of specific embodiments.
  • Figure 6 is a block diagram showing the structure of a system for displaying the state of a movable device in accordance with the present invention.
  • the system 20 includes: a communication device 21 for acquiring current state information of the mobile device and current state information of the control device; and a storage device 22 storing computer readable instructions;
  • the processing device 23 is configured to execute the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface.
  • the display device 24 may or may not be included in the system.
  • the communication device 21 may be implemented by a communication capable sensor (for example, various wireless sensors) to acquire current status information of the movable device. And current status information of the control device.
  • the processing device can be implemented by a computer, a mobile phone, a tablet, or a PLA (Programmable Logic Array) having processing capabilities.
  • the storage device 22 can be implemented as a variety of media such as magnetic recording, semiconductor recording, optical recording, etc., depending on the application environment.
  • the system includes display device 24, it can be a variety of means such as liquid screens, projections, and the like.
  • FIG. 7 is a block diagram showing the construction of a control device for displaying the state of a movable device in accordance with the present invention.
  • a physical control device such as a remote control dedicated to a drone, or a control device 30 implemented by a mobile phone
  • it includes a communication interface 31, a processor 33, a memory 32, and a display 34.
  • the control device is also an implementation of the system of FIG. 6 , wherein the communication interface 31 is configured to acquire state information before the movable device and state information of the control device; the memory 32 is stored with a computer Read instruction
  • the processor 33 is configured to execute the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface of the display 34.
  • the above described method, system or apparatus in accordance with various embodiments of the present invention may be implemented by a computing device capable of executing software comprising computer instructions.
  • the system can include storage to implement the various stores described above.
  • the computing capable electronic device can include a general purpose processor, a digital signal processor, a dedicated processor, a reconfigurable processor, etc., but is not limited thereto. Executing such instructions causes the electronic device to be configured to perform the operations described above in accordance with the present invention.
  • the above methods and/or modules may be implemented in one electronic device or in different electronic devices.
  • Embodiments of the invention use software, which may be stored in the form of volatile memory or non-volatile storage (such as a storage device such as a ROM), whether erasable or rewritable, or stored as
  • volatile memory or non-volatile storage such as a storage device such as a ROM
  • ROM read-only memory
  • the form of the memory eg, RAM, memory chip, device, or integrated circuit
  • optically readable medium eg, CD, DVD, magnetic or tape, etc.
  • the storage device and the storage medium are embodiments of a machine-readable storage device adapted to store one or more programs, the program or programs comprising instructions that, when executed, implement the present invention Methods.
  • these programs can be routed via any medium, such as a communication signal carried via a wired connection or a wireless connection, and various embodiments suitably include such programs.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)

Abstract

A method and a corresponding system for use in displaying a state of a mobile device, a control device, and a computer-readable medium. The method comprises: acquiring state information of the mobile device (S1); acquiring state information of a control device (S2); and displaying the state information of the mobile device and of the control device on a same display interface (S3). The state information of the mobile device and the state information of a load thereof are displayed on the display interface, thus allowing a user to learn in real-time the real-time flight state of the mobile device and the operating state of the load, facilitating control for the user, and improving user control experience.

Description

显示可移动装置的状态的方法、系统和控制装置Method, system and control device for displaying the state of a mobile device
版权申明Copyright statement
本专利文件披露的内容包含受版权保护的材料。该版权为版权所有人所有。版权所有人不反对任何人复制专利与商标局的官方记录和档案中所存在的该专利文件或者专利披露。The disclosure of this patent document contains material that is subject to copyright protection. This copyright is the property of the copyright holder. The copyright owner has no objection to the reproduction of the patent document or patent disclosure contained in the official records and files of the Patent and Trademark Office.
技术领域Technical field
本发明涉及显示可移动装置的状态的方法、系统和控制装置。The present invention relates to a method, system and control device for displaying the status of a mobile device.
背景技术Background technique
近年来,无人驾驶的飞行器(包括固定翼无人机和旋翼式无人机)、机动车、潜艇和船只,以及卫星、空间站、飞船等都得到了广泛的应用,对于这些可移动装置的操控通常由用户通过遥控装置来实现。在很多应用中,无人机等可移动装置可以携带载体,例如有的无人机配备有承载相机或照明灯的云台,以使用相机进行航拍。In recent years, unmanned aerial vehicles (including fixed-wing drones and rotary-wing drones), motor vehicles, submarines and ships, as well as satellites, space stations, spacecraft, etc., have been widely used for these mobile devices. Manipulation is usually achieved by the user via a remote control. In many applications, a mobile device such as a drone can carry a carrier, for example, some drones are equipped with a pan/tilt carrying a camera or a light to perform aerial photography using a camera.
然而,用户通过遥控装置操控可移动装置时,当其远离用户所在位置时(如远离四五百米),就很难通过肉眼观察来进行操控。而且,在例如使用无人机进行航拍等应用时,操控者往往还需要了解可移动装置与用户的相对位置,以及可移动装置的运动状态,并便根据实时的相对位置和运动状态来进行操控。而现有的遥控装置无法有效地显示所述实时的相对位置和运动状态等,这使得用户的操控体验较差,容易造成误操作。However, when the user manipulates the movable device through the remote control device, when it is away from the user's location (for example, away from four or five hundred meters), it is difficult to perform manipulation by visual observation. Moreover, when using an unmanned aerial vehicle for aerial photography or the like, the controller often needs to know the relative position of the movable device and the user, and the motion state of the movable device, and operate according to the real-time relative position and motion state. . However, the existing remote control device cannot effectively display the real-time relative position and motion state, etc., which makes the user's control experience poor and easily causes misoperation.
发明内容Summary of the invention
本发明一方面提出一种用于显示可移动装置状态的方法,包括:获取所述可移动装置的状态信息;获取控制装置的状态信息,该控制装置用于控制所述可移动装置的移动;在同一显示界面显示控制装置与可移动装置各自的状态信息。An aspect of the present invention provides a method for displaying a state of a movable device, comprising: acquiring state information of the movable device; acquiring state information of the control device, the control device for controlling movement of the movable device; Status information of each of the control device and the movable device is displayed on the same display interface.
本发明另一方面提出一种用于显示可移动装置状态的系统,所述系统包括:通信装置,用于获取所述可移动装置的状态信息和所述控制装置的状态信息,所述控制装置用于控制所述可称动装置;存储装置,存储机算机可读指令;以及处理装置,用于执行所述计算机可读指令,以控制在同一显示界面显示控制装置与可移动装置各自的控制信息。 Another aspect of the present invention provides a system for displaying a state of a movable device, the system comprising: communication means for acquiring state information of the movable device and state information of the control device, the control device And a storage device configured to execute the computer readable instructions to control display of the respective control device and the movable device on the same display interface Control information.
本发明再一方面提出一种用于显示可移动装置状态的控制装置,包括:通信接口,用于获取所述可移动装置的状态信息和所述控制装置的状态信息,所述控制装置用于控制所述可移动装置;存储器,存储有计算机可读指令;处理器,用于执行所述计算机可读指令,以控制在同一显示界面显示控制装置与可移动装置各自的状态信息。A further aspect of the present invention provides a control apparatus for displaying a state of a movable device, comprising: a communication interface for acquiring state information of the movable device and state information of the control device, the control device being used for Controlling the removable device; the memory storing computer readable instructions; and a processor for executing the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface.
此外,本发明还一种计算机可读介质,其上存储有计算机可执行的指令,该指令用于执行前述的用于显示可移动装置状态的方法。Moreover, the present invention is also a computer readable medium having stored thereon computer executable instructions for performing the aforementioned method for displaying a state of a removable device.
附图说明DRAWINGS
图1A是本发明的显示可移动装置的状态的系统的一个实施例的应用场景图;1A is an application scenario diagram of one embodiment of a system for displaying a state of a movable device of the present invention;
图1B是本发明的用于显示可移动装置状态的方法的流程图;1B is a flow chart of a method for displaying a state of a movable device of the present invention;
图2A是本发明的控制装置中的显示界面的第一实施例的示意图;2A is a schematic view showing a first embodiment of a display interface in the control device of the present invention;
图2B是本发明的控制装置中的显示界面的第二实施例的示意图;2B is a schematic view showing a second embodiment of a display interface in the control device of the present invention;
图3是本发明的控制装置中的显示界面的第三实施例的示意图;Figure 3 is a schematic illustration of a third embodiment of a display interface in the control device of the present invention;
图4A~4C是本发明的控制装置中的显示界面的第四实施例的示意图;4A to 4C are schematic views showing a fourth embodiment of a display interface in the control device of the present invention;
图5是本发明的控制装置中的显示界面的第五实施例的示意图;Figure 5 is a schematic view showing a fifth embodiment of a display interface in the control device of the present invention;
图6为根据本发明的一种用于显示可移动装置状态的系统的结构示意图;6 is a schematic structural diagram of a system for displaying a state of a movable device according to the present invention;
图7为根据本发明的一种用于显示可移动装置状态的控制装置的结构示意图。Figure 7 is a block diagram showing the construction of a control device for displaying the state of a movable device in accordance with the present invention.
具体实施方式detailed description
对于无人机、无人驾驶汽车等遥控的可移动装置,本发明主要考虑的是遥控终端上如何更好地显示可移动装置与遥控终端的相对位置以及可移动装置的实时移动状态,以便于用户能够更加方便、高效或更有兴趣地来操控可移动装置,提高用户的操控体验。For a remotely movable device such as a drone or a driverless car, the present invention mainly considers how to better display the relative position of the movable device and the remote control terminal and the real-time movement state of the movable device on the remote control terminal, so as to facilitate Users can control mobile devices more conveniently, efficiently, or with interest, improving the user's control experience.
下面在具体描述本发明的方案时,尽管是采用无人机为例来进行说明,但本发明的方法、装置和系统并不限于该领域,任何通过有线、无线的远程控制的方式操控可移动装置的领域均可合理地利用本发明,例如包括各种无人驾驶的交通工具,以及任何不需要人直接在设备本体上进行操作的各种应用设备和应用场景,例如卫星、机器人技术、虚拟现实技术等。In the following, when the solution of the present invention is specifically described, although the description is made by taking an unmanned aerial vehicle as an example, the method, device and system of the present invention are not limited to the field, and any mobile control can be moved by wired or wireless remote control. The present invention can be reasonably utilized in the field of devices, including, for example, various unmanned vehicles, and any application device and application scenarios that do not require humans to operate directly on the device body, such as satellite, robotics, virtual Reality technology, etc.
本发明中提及的“可移动”是指在三维空间中的任何相对运动,包括平动、转动,以及各种平动与转动的组合,例如飞行、路面行驶、潜行等不同空间内的移动,以及 平移、翻转、俯仰、倾斜等不同的移动方式。"Removable" as used in the present invention refers to any relative movement in three-dimensional space, including translation, rotation, and various combinations of translation and rotation, such as movement in different spaces such as flight, road driving, and stealth. ,as well as Different movement modes such as pan, flip, pitch, and tilt.
本发明中提及的“模块”和“单元”可以是任何硬件设备或设备的部件,例如处理器,也可以是软件的逻辑模块或单元。所述硬件设备或设备的部件也可根据存储在存储器中的非易失性计算机可读介质中存储的计算机程序来执行相应的方法。The "module" and "unit" referred to in the present invention may be any hardware device or component of the device, such as a processor, or a logic module or unit of software. The hardware device or components of the device may also execute the corresponding method in accordance with a computer program stored in a non-transitory computer readable medium stored in the memory.
本发明中提及的“控制装置”是指任何能够通过有线或无线方式对可移动装置进行操作的装置。其通常提供有供用户进行操控的按钮、手柄等,以便用户通过操控来产生控制信号以发送给可移动装置,以便对移动装置的移动状态进行控制。The "control device" referred to in the present invention means any device capable of operating a movable device by wire or wirelessly. It is usually provided with a button, a handle, etc. for the user to manipulate, so that the user can generate a control signal by manipulation to transmit to the movable device to control the movement state of the mobile device.
总的来说,本发明提出在同一显示界面以图形化方式显示控制装置与可移动装置的状态信息。显示二者的状态信息的前提是该控制装置能够实时地获取二者的状态信息。所述状态信息可以包括位置、姿态、负载状态等等与可移动装置和控制装置相关的各种信息。In general, the present invention proposes to graphically display status information of the control device and the movable device on the same display interface. The premise of displaying the status information of both is that the control device can acquire the status information of both in real time. The status information may include various information related to the mobile device and the control device, such as location, attitude, load status, and the like.
在同一显示界面以图形化方式显示控制装置与可移动装置的状态信息可以使用户直观地了解当前可移动装置与控制装置之间的相对关系,避免在显示界面只显示可移动装置的状态信息时难以使用户产生可移动装置的远近、方位的切实感受的问题,增强了用户的操控反馈,改善了操控体验。Displaying the state information of the control device and the movable device in a graphical manner on the same display interface enables the user to intuitively understand the relative relationship between the current mobile device and the control device, and avoids displaying only the state information of the movable device when the display interface is displayed. It is difficult for the user to generate the real feeling of the distance and orientation of the movable device, the user's manipulation feedback is enhanced, and the manipulation experience is improved.
其中,所述状态信息包括位置信息。可移动装置的位置信息可以从可移动装置直接接收,或者由第三方平台提供,第三方平台例如是基站、卫星等。当可移动装置本身带有位置获取装置(例如GPS模块)时,其本身可获得其实时的位置信息,从而向控制装置发送。而控制装置的位置信息可以由其自身产生,也可以从外部获取,在特殊的应用情况下,其位置也可以是固定的,从而可以通过直接输入来获取其位置信息。当由其自身获得时,其也可以带有位置获取装置(例如GPS模块)。The status information includes location information. The location information of the mobile device can be directly received from the mobile device or provided by a third party platform such as a base station, a satellite, or the like. When the mobile device itself has a location acquisition device (such as a GPS module), it can obtain its real-time location information for transmission to the control device. The position information of the control device can be generated by itself or externally. In a special application, the position can also be fixed, so that the position information can be obtained by direct input. When obtained by itself, it may also be provided with a location acquisition device (e.g., a GPS module).
尽管本发明并不限于具体的图形化显示的方式,但是,作为优选的方式,考虑到可移动装置的位置可能出现在相对于用户的控制装置的任意方位,控制装置本身也可能随用户的操控动作而发生转动,因此,优选为在显示界面的一个圆形区域内显示控制装置与可移动装置的位置信息。这样,无论可移动装置和控制装置的相对位置和方向发生何种变化,其在显示区域中均不会因为角度的改变而改变显示效果。当然圆形区域作为本发明的优选的方式表示本发明并不局限于显示区域的形状,基于本发明的同时显示可移动装置与控制装置的方案也可以采用其他形状的显示区域来显示,例如方形或三角形。Although the invention is not limited to a specific graphical display, in a preferred manner, the control device itself may be manipulated with the user, considering that the position of the movable device may occur in any orientation relative to the user's control device. Since the rotation occurs by the action, it is preferable to display the position information of the control device and the movable device in a circular area of the display interface. Thus, regardless of the change in the relative position and orientation of the movable device and the control device, the display effect is not changed in the display region due to the change in the angle. Of course, the circular area as a preferred mode of the present invention indicates that the present invention is not limited to the shape of the display area, and the scheme for simultaneously displaying the movable device and the control device according to the present invention may also be displayed by using other shapes of display areas, such as a square. Or a triangle.
作为图形化显示的一种方式,可以将可移动装置和控制装置在显示界面中以特定 的图形化标识来表示。例如,可以用圆形、三角形、箭头形等代表无人机,用圆形、方形等代表控制装置。当然,也可以选择用更加生动的形象标识来表示,本发明不局限于具体的标识的样式。As a way of graphical display, the movable device and the control device can be specified in the display interface Graphical logo to represent. For example, a circle, a triangle, an arrow, or the like may be used to represent a drone, and a control device may be represented by a circle, a square, or the like. Of course, it is also possible to choose to use a more vivid image to indicate that the invention is not limited to the specific logo style.
更进一步,可以使用图形化标识在显示界面上的位置来表示可移动装置与控制装置实际的位置。优选地,可以采用等比例的方式来表示实际的空间地理位置,从而在显示界面上以等比例的方式来显示二者的图形化标识的位置。但本发明并不限于等比例方式,也可以采用其他的对应关系来进行显示。由于在同一显示界面上显示二者的位置,可以清楚地了解当前二者的相关位置关系。Still further, the position of the movable device and the control device can be represented using the position of the graphical identification on the display interface. Preferably, the actual spatial geographic location may be represented in an equal scale manner to display the location of the graphical identification of both on an equal scale in the display interface. However, the present invention is not limited to the proportional method, and other correspondences may be used for display. Since the positions of the two are displayed on the same display interface, the relative positional relationship between the two can be clearly understood.
为了更加形象化地显示可移动装置的状态,所述状态信息包括可移动装置的姿态信息本发明优选为在显示界面上显示可移动装置的姿态信息。姿态信息在此指的是可以反映可移动装置在移动过程姿态的任何信息。以无人机为例,姿态信息包括朝向信息、、俯仰角度、横滚角度等。可移动装置的实时的姿态信息可以通过其自身的传感器实时获取,并通过其通信装置向控制装置进行发送。In order to more visually display the state of the movable device, the state information includes posture information of the movable device. The present invention preferably displays the posture information of the movable device on the display interface. The gesture information herein refers to any information that can reflect the posture of the mobile device during the movement process. Taking the drone as an example, the attitude information includes orientation information, pitch angle, roll angle, and the like. The real-time attitude information of the mobile device can be acquired in real time by its own sensor and transmitted to the control device through its communication device.
所述俯仰角度为无人机机头在高度方向上俯下或仰起的角度;所述横滚角度为无人机绕机头和机尾连线相对水平面旋转的角度。The pitch angle is an angle at which the head of the drone is tilted or raised in the height direction; the roll angle is an angle at which the drone rotates around the head and the tail line relative to the horizontal plane.
本发明优选为在显示界面上以图形化方式显示所述的姿态信息。例如,对于无人机来说,可以用一个几何形状来表示无人机,用几何形状在界面中的位置表示无人机的位置信息。对于无人机的朝向信息、姿态信息等,也可用图形化方式来表示(例如用动态水平线来表示俯仰与横滚角等,这将在下面的实施例中详细说明)等。但应当理解,本发明并不限于以何种图形化方式来显示上述的状态信息,本领域的技术人员可以在本发明的设计理念的指导下进行各种设计来增加用户的视觉体验。Preferably, the present invention graphically displays the gesture information on a display interface. For example, for a drone, a geometry can be used to represent the drone, and the location of the geometry in the interface represents the location information of the drone. The orientation information, posture information, and the like of the drone can also be represented graphically (for example, a pitch line and a roll angle are indicated by dynamic horizontal lines, which will be described in detail in the following embodiments). However, it should be understood that the present invention is not limited to which graphical information is used to display the above-described state information, and those skilled in the art can carry out various designs under the guidance of the design concept of the present invention to increase the visual experience of the user.
此外,考虑到本发明的可移动装置本身可能会搭载负载,而负载在工作时也很可能需要用户实时关注其工作状态,或者对其进行操控以改变其工作状态。因此,本发明还优选为在显示界面上同时显示负载的状态信息。同样的,所述状态信息包括反映负载在移动过程中的运行状态的任何信息。例如,对于无人机来说,可以通过云台搭载相机以供实时拍摄,而相机在拍摄时需要实时的变换角度、调整姿态等。通常,可以将相机搭载在无人机的云台上,用户通过无线操控云台可以调整相机的姿态并控制相机进行拍摄。由此,本发明可以在控制装置的显示界面上以图形化方式显示云台的朝向和相机的可视范围等,从而反映出云台和相机的当前姿态以便用户直观地了解相机当前工作状态。同样地,本发明并不限于以何种图形化方式来显示负载的状态信息, 本领域的技术人员可以在本发明的设计理念的指导下进行各种设计来增加用户的视觉体验。In addition, it is considered that the mobile device of the present invention may carry a load itself, and the load is likely to require the user to pay attention to its working state in real time or to manipulate it to change its working state. Therefore, the present invention is also preferably to simultaneously display status information of the load on the display interface. Similarly, the status information includes any information that reflects the operational status of the load during the move. For example, for a drone, a camera can be mounted on the gimbal for real-time shooting, and the camera needs to change the angle and adjust the posture in real time when shooting. Usually, the camera can be mounted on the head of the drone, and the user can adjust the attitude of the camera and control the camera to shoot by wirelessly controlling the pan/tilt. Therefore, the present invention can graphically display the orientation of the gimbal and the visual range of the camera and the like on the display interface of the control device, thereby reflecting the current posture of the pan/tilt and the camera so that the user can intuitively understand the current working state of the camera. Similarly, the present invention is not limited to graphical representation of the status information of the load. Those skilled in the art can carry out various designs under the guidance of the design concept of the present invention to increase the visual experience of the user.
图1A是本发明的显示可移动装置的状态的系统的一个实施例的应用场景图。如图1A所示,该系统是无人机遥控系统,包括遥控装置1和无人机2,无人机2的云台上搭载有相机4。遥控装置1与无人机2之间能够进行无线通信,从而用户通过操作遥控装置1来操控无人机的飞行以及控制相机4的工作。如图1所示,该遥控装置1上具有一个显示屏3,显示屏3具有显示界面。显示界面上能够显示关于无人机及其搭载的相机的运行状态信息,用户能够通过查看该显示屏3来实时对无人机2及其搭载的相机4进行操控。1A is an application scenario diagram of one embodiment of a system for displaying a state of a mobile device of the present invention. As shown in FIG. 1A, the system is a drone remote control system including a remote control device 1 and a drone 2, and a camera 4 is mounted on the pan/tilt of the drone 2. Wireless communication is possible between the remote control device 1 and the drone 2, so that the user manipulates the remote control device 1 to control the flight of the drone and control the operation of the camera 4. As shown in FIG. 1, the remote control device 1 has a display screen 3, and the display screen 3 has a display interface. The display interface can display the operating status information about the drone and the camera mounted thereon, and the user can view the display 3 to control the drone 2 and the camera 4 mounted thereon in real time.
图1B是本发明的用于显示可移动装置状态的方法的流程图。如图1B所示,所述方法包括:S1、获取所述可移动装置的状态信息;S2、获取控制装置的状态信息;S3、在同一显示界面显示控制装置与可移动装置各自的状态信息。步骤S1与步骤S2通常没有固定的前后顺序。上述步骤S1~S3可以以固定的频率重复,以实时在显示界面上更新遥控装置1与无人机2的位置和/或状态信息。1B is a flow chart of a method of the present invention for displaying the state of a mobile device. As shown in FIG. 1B, the method includes: S1: acquiring state information of the movable device; S2, acquiring state information of the control device; and S3, displaying state information of each of the control device and the movable device on the same display interface. Steps S1 and S2 generally do not have a fixed sequence. The above steps S1 to S3 can be repeated at a fixed frequency to update the position and/or status information of the remote control device 1 and the drone 2 on the display interface in real time.
图2A是本发明的控制装置中的显示界面的第一实施例的示意图。如图2A所示,该实施例中,仍以无人机的遥控装置为例来说明。可移动装置(无人机)和控制装置(遥控装置)均显示为一个图形化标识,即遥控装置标识11和无人机标识12,遥控装置标识11和无人机标识12均显示在一个圆形区域10中。在该实施例中,遥控装置标识11始终位于圆形区域的中心处,显示为一个中心标识有“H”的圆圈,无人机标记12则是一个较小的圆圈(图2A为一个带有网格的圆圈)无人机标识12则根据可移动装置相对于遥控装置11的实际距离和方位而相应地显示于该圆形区域10中,以形象化地显示无人机相对于用户(遥控装置)的方向和距离。2A is a schematic diagram of a first embodiment of a display interface in the control device of the present invention. As shown in FIG. 2A, in this embodiment, the remote control device of the drone is still taken as an example for illustration. Both the movable device (unmanned aerial vehicle) and the control device (remote control device) are displayed as a graphical identifier, that is, the remote control device identification 11 and the drone identification 12, and the remote control identification 11 and the drone identification 12 are displayed in a circle. In the shape area 10. In this embodiment, the remote control identification 11 is always located at the center of the circular area, shown as a circle with a center mark "H", and the drone mark 12 is a smaller circle (Fig. 2A is a The circle of the grid) the drone identifier 12 is correspondingly displayed in the circular area 10 according to the actual distance and orientation of the movable device relative to the remote control device 11 to visually display the drone relative to the user (remote control The direction and distance of the device).
优选地,圆形区域的比例尺可以随无人机与遥控装置之间的距离而变化,以便在显示界面上以合适的尺度来显示两个标识。Preferably, the scale of the circular area may vary with the distance between the drone and the remote control to display the two logos on the display interface at an appropriate scale.
在该实施例中,无人机的位置信息可由其自身的GPS模块获得并传送给控制装置,遥控装置的位置信息则为固定信息或者由其自身的GPS模块获得。In this embodiment, the location information of the drone can be obtained by its own GPS module and transmitted to the control device, the location information of which is either fixed information or obtained by its own GPS module.
图2B是本发明的控制装置中的显示界面的第二实施例的示意图。在第一实施例中,遥控装置标识11始终位于圆形区域10的中心,与该显示方式不同的是,在第二实施例中,如图2B所示,圆形区域10的中心表示一个特定地理位置点。也就是说,该显示界面中使用圆形区域10的中心十字交叉点来表示特定地址位置信息。在该实施 例中,该特定地理位置点是无人机12的出发点地理位置。在一些场景中,人在操作遥控装置以控制无人机的同时,也会携带遥控装置离开无人机的出发点,因此遥控装置也会相对于特定地理位置发生偏移。在图2B中,随着操作者的走动,遥控装置的标识在显示界面中也相对于无人机的出发点向左上方发生了一定的偏移。2B is a schematic diagram of a second embodiment of a display interface in the control device of the present invention. In the first embodiment, the remote control device identification 11 is always located at the center of the circular area 10, unlike the display mode, in the second embodiment, as shown in Fig. 2B, the center of the circular area 10 indicates a specific Location point. That is, the center cross point of the circular area 10 is used in the display interface to represent the specific address location information. In this implementation In the example, the specific geographic location point is the departure geographic location of the drone 12. In some scenarios, when a person operates a remote control device to control a drone, the remote control device is also carried away from the departure point of the drone, and thus the remote control device is also offset relative to a specific geographic location. In FIG. 2B, as the operator walks, the identification of the remote control device also shifts to the upper left relative to the departure point of the drone in the display interface.
为了适应不同的应用场景,该特定地理位置点并不限于可移动装置(无人机)的出发点,其也可以设定为任意地理位置,例如可移动装置的目的地、特定设定的起降点或特定地理位置等。In order to adapt to different application scenarios, the specific geographic location point is not limited to the starting point of the mobile device (unmanned aerial vehicle), and may also be set to any geographical location, such as the destination of the mobile device, the specific set of takeoff and landing. Points or specific geographic locations, etc.
图3是本发明的控制装置中的显示界面的第三实施例的示意图。在该实施例中,除了图2A、图2B中显示的元素,显示界面中还包括有方位信息辅助标识。方位信息辅助标识包括任何能够帮助用户在显示界面中判断可移动装置或控制装置的方位的可视化标识。在该实施例中,方位信息辅助标识包括控制装置正面朝向标识13、正北方向标识14和距离辅助标识15。控制装置正面朝向标识13定义了控制装置(在该实施例中为无人机的遥控装置)的正面朝向,其在显示界面中不会变化位置,在该实施例中为在显示界面正上方的三角标识。正北方向标识14代表正北方向相对于控制装置的方向,可随着遥控装置的朝向变化而相应地在显示界面中变化。在该实施例中,其位于圆形区域的周边处。而距离辅助标识15在该实施例中是虚线组成的同心圆,用于表示显示区域中的距离指标。尽管在该实施例中是以特定的形状和标识图案来显示特定的方位信息辅助标识,但本领域的技术人员可以根据设计需要做出各种改变。3 is a schematic diagram of a third embodiment of a display interface in the control device of the present invention. In this embodiment, in addition to the elements shown in FIGS. 2A and 2B, the display interface further includes an orientation information auxiliary identifier. The orientation information assisted identification includes any visual identification that can assist the user in determining the orientation of the movable device or control device in the display interface. In this embodiment, the orientation information assistance indicator includes a control device front facing indicator 13, a north north direction identification 14 and a distance auxiliary identification 15. The front face of the control device defines the frontal orientation of the control device (in this embodiment the remote control of the drone), which does not change position in the display interface, in this embodiment directly above the display interface Triangle logo. The north north direction indicator 14 represents the direction of the north direction relative to the control device and may vary accordingly in the display interface as the orientation of the remote control device changes. In this embodiment it is located at the periphery of the circular area. The distance auxiliary mark 15 is a concentric circle composed of a broken line in this embodiment, and is used to indicate a distance index in the display area. Although a particular orientation information assisted logo is displayed in a particular shape and logo pattern in this embodiment, those skilled in the art can make various changes depending on the design needs.
图4A~4C是本发明的控制装置中的显示界面的第四实施例的示意图。如图所示,在该实施例中,除了图3中显示的元素,其还以图形化方式显示了无人机的状态信息和其搭载的负载(包括云台与相机)的状态信息。4A to 4C are schematic views of a fourth embodiment of a display interface in the control device of the present invention. As shown in the figure, in this embodiment, in addition to the elements shown in FIG. 3, it also graphically displays the status information of the drone and the status information of the loaded load (including the pan/tilt and the camera).
图4A~4C中使用一个箭头来表示无人机,图中的附图标记16为箭头的顶角方向,用于代表无人机的飞行方向或机头朝向。当无人机的飞行方向改变时,该箭头的方向随之改变。此外,附图标记17为一个动态水位线图形,其用于代表无人机的飞行姿态。该动态水位线位于所述圆形区域的下方,模拟水在平放的容器中的随飞行姿态变化的运动方式。在该实施例中,用水位线的高低来代表无人机的俯仰角,用水位的倾斜角来代表无人机的横滚角。这种方式能够形象地表示出当前无人机的姿态信息,方便用户识别。图4A显示了无人机的俯仰角度为零,但横滚角度不为零的情形,此时的水位线正好在圆的中心处。图中水位向左倾斜代表无人机绕横滚轴向左倾斜。此外,如图4B所示,当无人机的俯仰角不为零时,其水平面的将高于圆形区域的中心。图4B 中显示了当无人机向下俯冲时,水平面的中心高于圆形区域的中心。类似地,当无人机向上抬升时,其水平面低于圆形区域的中心。图4C显示的是无人机同时在横滚方向和俯仰方向均产生倾角的情形。4A to 4C, an arrow is used to indicate the drone, and reference numeral 16 in the figure is the vertex angle direction of the arrow for representing the flight direction or head orientation of the drone. When the direction of flight of the drone changes, the direction of the arrow changes. Further, reference numeral 17 is a dynamic water level line pattern for representing the flying posture of the drone. The dynamic water level line is located below the circular area and simulates the manner in which water moves in a flat container with a change in flight attitude. In this embodiment, the height of the water line represents the pitch angle of the drone, and the angle of inclination of the water level represents the roll angle of the drone. This method can visually represent the posture information of the current drone, which is convenient for the user to recognize. Fig. 4A shows the case where the pitch angle of the drone is zero, but the roll angle is not zero, and the water line at this time is just at the center of the circle. The water level to the left in the figure indicates that the drone is tilted leftward about the roll axis. Further, as shown in FIG. 4B, when the pitch angle of the drone is not zero, its horizontal plane will be higher than the center of the circular area. Figure 4B It shows that when the drone is swooping down, the center of the water level is higher than the center of the circular area. Similarly, when the drone is lifted up, its level is lower than the center of the circular area. Fig. 4C shows the case where the drone produces an inclination at both the roll direction and the pitch direction.
图5是本发明的控制装置中的显示界面的第五实施例的示意图。如图所示,该实施例中还显示负载的状态信息。在该实施例中,负载包括无人机的云台和云台上的相机。附图标记18是一个扇形区域,用于表示相机的可视范围。而位于圆形区域10周边的环形区段19则代表了云台的偏移角度。在该实施例中,可视范围18相对于无人机的机头朝向16具有一个偏转角。而对于云台来说,无人机的云台的偏转角通常具有一个容许范围,例如0~270度。如果将要达到或超过该容许范围,本实施例中通过环形区段19的颜色发生变化来向用户警示。例如,当其在容许范围内时显示为绿色,接近容许范围时变为黄色,超出容许范围则变为红色。Figure 5 is a schematic illustration of a fifth embodiment of a display interface in the control device of the present invention. As shown, the state information of the load is also displayed in this embodiment. In this embodiment, the load includes a pan/tilt and a camera on the gimbal. Reference numeral 18 is a sector area for indicating the visual range of the camera. The annular section 19 located around the circular area 10 represents the offset angle of the gimbal. In this embodiment, the visual range 18 has a deflection angle relative to the nose orientation 16 of the drone. For the gimbal, the deflection angle of the gimbal of the drone usually has an allowable range, for example, 0 to 270 degrees. If the allowable range is to be reached or exceeded, the color of the annular section 19 changes in the present embodiment to alert the user. For example, it is displayed in green when it is within the allowable range, turns yellow when it is close to the allowable range, and turns red when it is outside the allowable range.
以上的实施例中主要说明了本发明的用于显示可移动装置状态的方法的示例性实施方式。应当了解,本发明的上述方法可以由硬件或软件方式实现。下面以具体实施例的方式示意性地说明本发明的方式可以实现的形式。The above embodiments mainly illustrate an exemplary embodiment of the method for displaying the state of a movable device of the present invention. It should be understood that the above method of the present invention can be implemented by hardware or software. The form that can be achieved by the mode of the present invention is schematically illustrated by way of specific embodiments.
图6为根据本发明的一种用于显示可移动装置状态的系统的结构示意图。如图所示,所述系统20包括:通信装置21,其用于获取所述可移动装置当前的状态信息和所述控制装置当前的状态信息;存储装置22,存储有计算机可读指令;所述处理装置23,用于执行所述计算机可读指令,以控制在同一显示界面显示控制装置与可移动装置各自的状态信息。该实施例中,作为系统来说,其可以实现为独立的装置,也可以是由分布式的装置来实现。并且,系统中可以包括显示装置24,也可以不包括显示装置24,例如,可以由具有通信能力的传感器(例如各种无线传感器)实现通信装置21,以获取所述可移动装置当前的状态信息和所述控制装置当前的状态信息。可以由计算机、手机、平板或具有处理能力的PLA(可编程逻辑阵列)等实现处理装置。存储装置22则可根据应用环境实现为磁记录、半导体记录、光学记录等多种介质。此外,当系统包括显示装置24时,其可以是液显屏、投影等多种方式。Figure 6 is a block diagram showing the structure of a system for displaying the state of a movable device in accordance with the present invention. As shown, the system 20 includes: a communication device 21 for acquiring current state information of the mobile device and current state information of the control device; and a storage device 22 storing computer readable instructions; The processing device 23 is configured to execute the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface. In this embodiment, as a system, it may be implemented as a stand-alone device, or may be implemented by a distributed device. Moreover, the display device 24 may or may not be included in the system. For example, the communication device 21 may be implemented by a communication capable sensor (for example, various wireless sensors) to acquire current status information of the movable device. And current status information of the control device. The processing device can be implemented by a computer, a mobile phone, a tablet, or a PLA (Programmable Logic Array) having processing capabilities. The storage device 22 can be implemented as a variety of media such as magnetic recording, semiconductor recording, optical recording, etc., depending on the application environment. Moreover, when the system includes display device 24, it can be a variety of means such as liquid screens, projections, and the like.
图7为根据本发明的一种用于显示可移动装置状态的控制装置的结构示意图。如图所示,作为一种实体性的控制装置,例如专用于无人机的遥控器,或者由手机实现的控制装置30,其包括通信接口31、处理器33、存储器32和显示器34。该控制装置实质上也是对图6的系统的一种实现方式,其中,通信接口31用于获取所述可移动装置前的状态信息和所述控制装置的状态信息;存储器32,存储有计算机可读指令;所 述处理器33,用于执行所述计算机可读指令,以控制在显示器34的同一显示界面显示控制装置与可移动装置各自的状态信息。Figure 7 is a block diagram showing the construction of a control device for displaying the state of a movable device in accordance with the present invention. As shown, as a physical control device, such as a remote control dedicated to a drone, or a control device 30 implemented by a mobile phone, it includes a communication interface 31, a processor 33, a memory 32, and a display 34. The control device is also an implementation of the system of FIG. 6 , wherein the communication interface 31 is configured to acquire state information before the movable device and state information of the control device; the memory 32 is stored with a computer Read instruction The processor 33 is configured to execute the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface of the display 34.
根据本发明各实施例的上述方法、系统或装置可以通过有计算能力的电子设备执行包含计算机指令的软件来实现。系统可以包括存储装置,以实现上文所描述的各种存储。所述有计算能力的电子设备可以包含通用处理器、数字信号处理器、专用处理器、可重新配置处理器等能够执行计算机指令的装置,但不限于此。执行这样的指令使得电子设备被配置为执行根据本发明的上述各项操作。上述各方法和/或模块可以在一个电子设备中实现,也可以在不同电子设备中实现。The above described method, system or apparatus in accordance with various embodiments of the present invention may be implemented by a computing device capable of executing software comprising computer instructions. The system can include storage to implement the various stores described above. The computing capable electronic device can include a general purpose processor, a digital signal processor, a dedicated processor, a reconfigurable processor, etc., but is not limited thereto. Executing such instructions causes the electronic device to be configured to perform the operations described above in accordance with the present invention. The above methods and/or modules may be implemented in one electronic device or in different electronic devices.
本发明的实施例使用软件的,软件可以存储为易失性存储器或非易失性存储装置的形式(比如类似ROM等存储设备),不论是可擦除的还是可重写的,或者存储为存储器的形式(例如RAM、存储器芯片、设备或集成电路),或者被存储在光可读介质或磁可读介质上(比如,CD、DVD、磁盘或磁带等等)。Embodiments of the invention use software, which may be stored in the form of volatile memory or non-volatile storage (such as a storage device such as a ROM), whether erasable or rewritable, or stored as The form of the memory (eg, RAM, memory chip, device, or integrated circuit) is either stored on an optically readable medium or a magnetically readable medium (eg, CD, DVD, magnetic or tape, etc.).
应该意识到,存储设备和存储介质是适于存储一个或多个程序的机器可读存储装置的实施例,所述一个程序或多个程序包括指令,当所述指令被执行时,实现本发明的方法。此外,可以经由任何介质(比如,经由有线连接或无线连接携带的通信信号)来电传递这些程序,多个实施例适当地包括这些程序。It should be appreciated that the storage device and the storage medium are embodiments of a machine-readable storage device adapted to store one or more programs, the program or programs comprising instructions that, when executed, implement the present invention Methods. Moreover, these programs can be routed via any medium, such as a communication signal carried via a wired connection or a wireless connection, and various embodiments suitably include such programs.
以上所述的具体实施例,对本发明的目的、技术方案和有益效果进行了进一步详细说明,应理解的是,以上所述仅为本发明的具体实施例而已,并不用于限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。 The specific embodiments of the present invention have been described in detail in the foregoing detailed description of the embodiments of the present invention. All modifications, equivalents, improvements, etc., made within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims (56)

  1. 一种用于显示可移动装置状态的方法,包括:A method for displaying the status of a mobile device, comprising:
    获取所述可移动装置的状态信息;Obtaining state information of the movable device;
    获取控制装置的状态信息,该控制装置用于控制所述可移动装置的移动;Obtaining state information of the control device, the control device is configured to control movement of the movable device;
    在同一显示界面显示控制装置与可移动装置各自的状态信息。Status information of each of the control device and the movable device is displayed on the same display interface.
  2. 根据权利要求1所述的方法,其中,The method of claim 1 wherein
    所述状态信息包括位置信息,并且,在所述同一显示界面的一个圆形显示区域内显示控制装置与可移动装置各自的位置信息。The status information includes location information, and respective location information of the control device and the movable device is displayed in a circular display area of the same display interface.
  3. 根据权利要求2所述的方法,其中,所述圆形区域的比例尺随所述可移动装置与遥控装置之间的距离而变化。The method of claim 2 wherein the scale of the circular area varies with distance between the movable device and the remote control.
  4. 根据权利要求2所述的方法,其中,所述圆形区域的中心设为特定地理位置点或所述控制装置的实时位置。The method of claim 2 wherein the center of the circular area is set to a particular geographic location point or a real time location of the control device.
  5. 根据权利要求4所述的方法,其中,所述特定地理位置包括可移动装置的出发点、可移动装置的目的地中的任一种。The method of claim 4, wherein the particular geographic location comprises any one of a departure point of the mobile device and a destination of the mobile device.
  6. 根据权利要求1所述的方法,其中,采用图形化方式显示所述可移动装置和所述控制装置的状态信息。The method of claim 1 wherein the status information of the movable device and the control device is graphically displayed.
  7. 根据权利要求6所述的方法,其中,使用图形化标识表示所述可移动装置和所述控制装置。The method of claim 6 wherein said movable device and said control device are represented using a graphical identification.
  8. 根据权利要求7所述的方法,其中,所述状态信息包括位置信息,使用图形化标识在显示界面上的位置来表示可移动装置与控制装置实际的位置。The method of claim 7 wherein said status information comprises location information indicating the actual location of the removable device and the control device using the location of the graphical identification on the display interface.
  9. 根据权利要求8所述的方法,其中,所述显示界面中还包括有方位信息辅助标识。The method according to claim 8, wherein the display interface further comprises an orientation information auxiliary identifier.
  10. 根据权利要求9所述的方法,其中,所述方位信息辅助标识包括控制装置正面朝向标识、正北方向标识、距离辅助标识中的至少一种。The method of claim 9, wherein the orientation information auxiliary identification comprises at least one of a control device front orientation indicator, a north direction identification, and a distance assistance identification.
  11. 根据权利要求6所述的方法,其中,所述可移动装置为无人机,所述状态信息包括无人机的姿态信息,并在所述显示界面上以图形化方式显示所述姿态信息。The method according to claim 6, wherein the movable device is a drone, the status information includes posture information of the drone, and the posture information is graphically displayed on the display interface.
  12. 根据权利要求11所述的方法,其中,所述姿态信息包括朝向信息、俯仰角度、横滚角度中的至少一种。The method of claim 11, wherein the attitude information comprises at least one of orientation information, pitch angle, and roll angle.
  13. 根据权利要求12所述的方法,其中,使用箭头表示无人机,使用箭头的方向 表示所述无人机的朝向信息。The method of claim 12, wherein the arrow is used to indicate the drone, using the direction of the arrow Indicates the orientation information of the drone.
  14. 根据权利要求12所述的方法,其中,使用动态水位线表示所述无人机的俯仰角度和/或横滚角度。The method of claim 12 wherein the pitch angle and/or roll angle of the drone is represented using a dynamic water line.
  15. 根据权利要求6所述的方法,其中,所述状态信息包括可移动装置的负载信息。The method of claim 6, wherein the status information comprises load information of the mobile device.
  16. 根据权利要求15所述的方法,其中,所述可移动装置为无人机,所述负载包括无人机的云台,使用一个环形区段表示云台的偏移角度。The method of claim 15 wherein said movable means is a drone, said load comprising a head of the drone, and an annular section is used to indicate an offset angle of the head.
  17. 根据权利要求16所述的方法,其中,通过环形区段的颜色发生变化来向用户警示云台将要达到或超过一个容许范围。The method of claim 16 wherein the change in color of the annular segment is used to alert the user that the gimbal is about to reach or exceed an allowable range.
  18. 根据权利要求16所述的方法,其中,所述负载还包括云台上的相机,使用一个扇形区域来表示所述相机的可视范围。The method of claim 16 wherein said load further comprises a camera on the platform, using a sector area to represent the visual range of said camera.
  19. 一种用于显示可移动装置状态的系统,所述系统包括:A system for displaying the status of a mobile device, the system comprising:
    通信装置,用于获取所述可移动装置的状态信息和所述控制装置的状态信息,所述控制装置用于控制所述可称动装置;a communication device, configured to acquire state information of the movable device and state information of the control device, where the control device is configured to control the usable device;
    存储装置,存储机算机可读指令;以及a storage device that stores machine readable instructions;
    处理装置,用于执行所述计算机可读指令,以控制在同一显示界面显示控制装置与可移动装置各自的控制信息。Processing means for executing the computer readable instructions to control display of respective control information of the control device and the movable device on the same display interface.
  20. 根据权利要求19所述的系统,其中,The system of claim 19, wherein
    所述状态信息包括位置信息,并且,在所述同一显示界面的一个圆形显示区域内显示控制装置与可移动装置各自的位置信息。The status information includes location information, and respective location information of the control device and the movable device is displayed in a circular display area of the same display interface.
  21. 根据权利要求20所述的系统,其中,所述圆形区域的比例尺随所述可移动装置与遥控装置之间的距离而变化。The system of claim 20 wherein the scale of the circular area varies with distance between the movable device and the remote control.
  22. 根据权利要求20所述的系统,其中,所述圆形区域的中心设为特定地理位置点或所述控制装置的实时位置。The system of claim 20 wherein the center of the circular area is set to a particular geographic location point or a real time location of the control device.
  23. 根据权利要求22所述的系统,其中,所述特定地理位置包括可移动装置的出发点、可移动装置的目的地中的任一种。The system of claim 22, wherein the particular geographic location comprises any one of a departure point of the mobile device and a destination of the mobile device.
  24. 根据权利要求19所述的系统,其中,采用图形化方式显示所述可移动装置和所述控制装置的状态信息。The system of claim 19 wherein the status information of said movable device and said control device is graphically displayed.
  25. 根据权利要求24所述的系统,其中,使用图形化标识表示所述可移动装置和所述控制装置。 The system of claim 24 wherein said movable device and said control device are represented using a graphical identification.
  26. 根据权利要求25所述的系统,其中,所述状态信息包括位置信息,使用图形化标识在显示界面上的位置来表示可移动装置与控制装置实际的位置。The system of claim 25 wherein said status information comprises location information indicating the actual location of the removable device and the control device using the location of the graphical identification on the display interface.
  27. 根据权利要求26所述的系统,其中,所述显示界面中还包括有方位信息辅助标识。The system of claim 26, wherein the display interface further comprises an orientation information auxiliary identification.
  28. 根据权利要求27所述的系统,其中,所述方位信息辅助标识包括控制装置正面朝向标识、正北方向标识、距离辅助标识中的至少一种。The system of claim 27, wherein the orientation information assistance identification comprises at least one of a control device front orientation indicator, a north direction identification, and a distance assistance identification.
  29. 根据权利要求24所述的系统,其中,所述可移动装置为无人机,所述状态信息包括无人机的姿态信息,并在所述显示界面上以图形化方式显示所述姿态信息。The system according to claim 24, wherein said movable device is a drone, said status information includes posture information of the drone, and said posture information is graphically displayed on said display interface.
  30. 根据权利要求29所述的系统,其中,所述姿态信息包括朝向信息、俯仰角度、横滚角度中的至少一种。The system of claim 29, wherein the attitude information comprises at least one of orientation information, pitch angle, and roll angle.
  31. 根据权利要求30所述的系统,其中,使用箭头表示无人机,使用箭头的方向表示所述无人机的朝向信息。The system according to claim 30, wherein the arrow is used to indicate the drone, and the direction of the arrow is used to indicate the orientation information of the drone.
  32. 根据权利要求30所述的系统,其中,使用动态水位线表示所述无人机的俯仰角度和/或横滚角度。The system of claim 30 wherein the pitch angle and/or roll angle of the drone is represented using a dynamic water line.
  33. 根据权利要求24所述的系统,其中,所述状态信息包括可移动装置的负载信息。The system of claim 24 wherein said status information comprises load information for the mobile device.
  34. 根据权利要求33所述的系统,其中,所述可移动装置为无人机,所述负载包括无人机的云台,使用一个环形区段表示云台的偏移角度。The system of claim 33, wherein said movable device is a drone, said load comprises a gimbal of the drone, and an annular segment is used to indicate an offset angle of the gimbal.
  35. 根据权利要求34所述的系统,其中,通过环形区段的颜色发生变化来向用户警示云台将要达到或超过一个容许范围。The system of claim 34 wherein the change in color of the annular segment alerts the user that the gimbal is about to reach or exceed an allowable range.
  36. 根据权利要求34所述的系统,其中,所述负载还包括云台上的相机,使用一个扇形区域来表示所述相机的可视范围。The system of claim 34 wherein said load further comprises a camera on the pan/tilt, using a sector area to represent the visual range of said camera.
  37. 一种用于显示可移动装置状态的控制装置,包括:A control device for displaying the state of a movable device, comprising:
    通信接口,用于获取所述可移动装置的状态信息和所述控制装置的状态信息,所述控制装置用于控制所述可移动装置;a communication interface, configured to acquire state information of the movable device and state information of the control device, where the control device is configured to control the movable device;
    存储器,存储有计算机可读指令;a memory storing computer readable instructions;
    处理器,用于执行所述计算机可读指令,以控制在同一显示界面显示控制装置与可移动装置各自的状态信息。And a processor, configured to execute the computer readable instructions to control display of respective state information of the control device and the movable device on the same display interface.
  38. 根据权利要求37所述的控制装置,还包括显示器,用于显示所述显示界面。The control device according to claim 37, further comprising a display for displaying said display interface.
  39. 根据权利要求38所述的控制装置,其中,所述状态信息包括位置信息,并且, 在所述同一显示界面的一个圆形显示区域内显示控制装置与可移动装置各自的位置信息。The control device according to claim 38, wherein said status information includes location information, and Position information of each of the control device and the movable device is displayed in a circular display area of the same display interface.
  40. 根据权利要求39所述的控制装置,其中,所述圆形区域的比例尺随所述可移动装置与遥控装置之间的距离而变化。The control device according to claim 39, wherein the scale of the circular area varies with a distance between the movable device and the remote control device.
  41. 根据权利要求39所述的控制装置,其中,所述圆形区域的中心设为特定地理位置点或所述控制装置的实时位置。The control device according to claim 39, wherein the center of the circular area is set to a specific geographical point or a real-time position of the control device.
  42. 根据权利要求41所述的控制装置,其中,所述特定地理位置包括可移动装置的出发点、可移动装置的目的地中的任一种。The control device according to claim 41, wherein said specific geographic location comprises any one of a departure point of the movable device and a destination of the movable device.
  43. 根据权利要求38所述的控制装置,其中,采用图形化方式显示所述可移动装置和所述控制装置的状态信息。The control device according to claim 38, wherein the state information of said movable device and said control device is displayed in a graphical manner.
  44. 根据权利要求43所述的控制装置,其中,使用图形化标识表示所述可移动装置和所述控制装置。The control device according to claim 43, wherein said movable device and said control device are represented using a graphical identification.
  45. 根据权利要求44所述的控制装置,其中,所述状态信息包括位置信息,使用图形化标识在显示界面上的位置来表示可移动装置与控制装置实际的位置。The control device according to claim 44, wherein said status information includes position information indicating the actual position of the movable device and the control device using the position of the graphical identification on the display interface.
  46. 根据权利要求45所述的控制装置,其中,所述显示界面中还包括有方位信息辅助标识。The control device according to claim 45, wherein the display interface further comprises an orientation information auxiliary identifier.
  47. 根据权利要求46所述的控制装置,其中,所述方位信息辅助标识包括控制装置正面朝向标识、正北方向标识、距离辅助标识中的至少一种。The control device according to claim 46, wherein the orientation information auxiliary identifier comprises at least one of a control device front orientation indicator, a north direction identification, and a distance assistance identifier.
  48. 根据权利要求43所述的控制装置,其中,所述可移动装置为无人机,所述状态信息包括无人机的姿态信息,并在所述显示界面上以图形化方式显示所述姿态信息。The control device according to claim 43, wherein said movable device is a drone, said state information includes posture information of the drone, and said gesture information is graphically displayed on said display interface .
  49. 根据权利要求48所述的控制装置,其中,所述姿态信息包括朝向信息、俯仰角度、横滚角度中的至少一种。The control device according to claim 48, wherein the posture information includes at least one of orientation information, pitch angle, and roll angle.
  50. 根据权利要求49所述的控制装置,其中,使用箭头表示无人机,使用箭头的方向表示所述无人机的朝向信息。The control device according to claim 49, wherein the arrow is used to indicate the drone, and the direction of the arrow is used to indicate the orientation information of the drone.
  51. 根据权利要求49所述的控制装置,其中,使用动态水位线表示所述无人机的俯仰角度和/或横滚角度。The control device according to claim 49, wherein the pitch angle and/or the roll angle of the drone are represented using a dynamic water line.
  52. 根据权利要求43所述的控制装置,其中,所述状态信息包括可移动装置的负载信息。The control device according to claim 43, wherein said status information comprises load information of the mobile device.
  53. 根据权利要求52所述的控制装置,其中,所述可移动装置为无人机,所述负载包括无人机的云台,使用一个环形区段表示云台的偏移角度。 The control apparatus according to claim 52, wherein said movable means is a drone, said load includes a head of the drone, and an annular section is used to indicate an offset angle of the head.
  54. 根据权利要求53所述的控制装置,其中,通过环形区段的颜色发生变化来向用户警示云台将要达到或超过一个容许范围。The control device according to claim 53, wherein the change in color of the annular section is used to alert the user that the gimbal is about to reach or exceed an allowable range.
  55. 根据权利要求53所述的控制装置,其中,所述负载还包括云台上的相机,使用一个扇形区域来表示所述相机的可视范围。The control apparatus according to claim 53, wherein said load further comprises a camera on the pan/tilt, and a sector area is used to indicate a visual range of said camera.
  56. 一种计算机可读介质,其上存储有计算机可执行的指令,该指令用于执行如权利要求1至18中任一项所述的方法。 A computer readable medium having stored thereon computer executable instructions for performing the method of any one of claims 1 to 18.
PCT/CN2016/109243 2016-09-09 2016-12-09 Method and system for displaying state of mobile device and control device WO2018045654A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201680002256.3A CN107077144B (en) 2016-09-09 2016-12-09 Method, system and control device for displaying state of movable device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CNPCT/CN2016/098619 2016-09-09
CN2016098619 2016-09-09

Publications (1)

Publication Number Publication Date
WO2018045654A1 true WO2018045654A1 (en) 2018-03-15

Family

ID=61562426

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/109243 WO2018045654A1 (en) 2016-09-09 2016-12-09 Method and system for displaying state of mobile device and control device

Country Status (1)

Country Link
WO (1) WO2018045654A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110580051A (en) * 2019-08-16 2019-12-17 福建海图智能科技有限公司 Underwater robot motion state display method and terminal
CN113747011A (en) * 2021-08-31 2021-12-03 网易(杭州)网络有限公司 Auxiliary shooting method and device, electronic equipment and medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103345826A (en) * 2013-07-05 2013-10-09 深圳市大疆创新科技有限公司 Remote control terminal of unmanned flight vehicle, as well as flight auxiliary system and method of unmanned flight vehicle
CN103344240A (en) * 2013-07-05 2013-10-09 深圳市大疆创新科技有限公司 Unmanned aerial vehicle finding device and method
CN103344250A (en) * 2013-07-05 2013-10-09 深圳市大疆创新科技有限公司 Flight assisting method and device of unmanned aerial vehicle
CN103365298A (en) * 2013-07-05 2013-10-23 深圳市大疆创新科技有限公司 Flight assisting system and method for unmanned aerial vehicle
US20150046077A1 (en) * 2013-03-14 2015-02-12 Agjunction Llc Hovering control for helicopters using a gnss vector
CN105518487A (en) * 2014-10-27 2016-04-20 深圳市大疆创新科技有限公司 Method and apparatus for prompting position of air vehicle
CN105793792A (en) * 2014-12-25 2016-07-20 深圳市大疆创新科技有限公司 Flight auxiliary method and system of unmanned aerial vehicle, unmanned aerial vehicle, and mobile terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150046077A1 (en) * 2013-03-14 2015-02-12 Agjunction Llc Hovering control for helicopters using a gnss vector
CN103345826A (en) * 2013-07-05 2013-10-09 深圳市大疆创新科技有限公司 Remote control terminal of unmanned flight vehicle, as well as flight auxiliary system and method of unmanned flight vehicle
CN103344240A (en) * 2013-07-05 2013-10-09 深圳市大疆创新科技有限公司 Unmanned aerial vehicle finding device and method
CN103344250A (en) * 2013-07-05 2013-10-09 深圳市大疆创新科技有限公司 Flight assisting method and device of unmanned aerial vehicle
CN103365298A (en) * 2013-07-05 2013-10-23 深圳市大疆创新科技有限公司 Flight assisting system and method for unmanned aerial vehicle
CN105518487A (en) * 2014-10-27 2016-04-20 深圳市大疆创新科技有限公司 Method and apparatus for prompting position of air vehicle
CN105793792A (en) * 2014-12-25 2016-07-20 深圳市大疆创新科技有限公司 Flight auxiliary method and system of unmanned aerial vehicle, unmanned aerial vehicle, and mobile terminal

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110580051A (en) * 2019-08-16 2019-12-17 福建海图智能科技有限公司 Underwater robot motion state display method and terminal
CN113747011A (en) * 2021-08-31 2021-12-03 网易(杭州)网络有限公司 Auxiliary shooting method and device, electronic equipment and medium
CN113747011B (en) * 2021-08-31 2023-10-24 网易(杭州)网络有限公司 Auxiliary shooting method and device, electronic equipment and medium

Similar Documents

Publication Publication Date Title
US20210116944A1 (en) Systems and methods for uav path planning and control
US11217112B2 (en) System and method for supporting simulated movement
US10724505B2 (en) Aerial inspection in a movable object environment
CN108780325B (en) System and method for adjusting unmanned aerial vehicle trajectory
US20190016475A1 (en) Uav flight display
CN105912288A (en) Method and system for comprehensive processing display capable of monitoring flight state of unmanned aerial vehicle
US10983535B2 (en) System and method for positioning a movable object
JP6289750B1 (en) Mobile object, mobile object control method, mobile object control system, and mobile object control program
CN108628334B (en) Control method, device and system of unmanned aerial vehicle and unmanned aerial vehicle
WO2021199449A1 (en) Position calculation method and information processing system
WO2021168819A1 (en) Return control method and device for unmanned aerial vehicle
US20210208608A1 (en) Control method, control apparatus, control terminal for unmanned aerial vehicle
US20200221056A1 (en) Systems and methods for processing and displaying image data based on attitude information
CN107077144B (en) Method, system and control device for displaying state of movable device
JP6883628B2 (en) Control device, information processing method, and program
WO2018045654A1 (en) Method and system for displaying state of mobile device and control device
CN109661631A (en) Control method, device and the unmanned plane of unmanned plane
US20210181769A1 (en) Movable platform control method, movable platform, terminal device, and system
WO2021079516A1 (en) Flight route creation method for flying body and management server
CN112882645B (en) Channel planning method, control end, aircraft and channel planning system
KR20210106422A (en) Job control system, job control method, device and instrument
CN112313599B (en) Control method, device and storage medium
KR102542181B1 (en) Method and apparatus for controlling unmanned air vehicle for generating 360 degree virtual reality image
WO2023139628A1 (en) Area setting system and area setting method
WO2023187891A1 (en) Determination system and determination method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16915588

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16915588

Country of ref document: EP

Kind code of ref document: A1