WO2023025204A1 - Remote control method and device and first and second control ends - Google Patents

Remote control method and device and first and second control ends Download PDF

Info

Publication number
WO2023025204A1
WO2023025204A1 PCT/CN2022/114570 CN2022114570W WO2023025204A1 WO 2023025204 A1 WO2023025204 A1 WO 2023025204A1 CN 2022114570 W CN2022114570 W CN 2022114570W WO 2023025204 A1 WO2023025204 A1 WO 2023025204A1
Authority
WO
WIPO (PCT)
Prior art keywords
control terminal
remote control
control
unmanned aerial
aerial vehicle
Prior art date
Application number
PCT/CN2022/114570
Other languages
French (fr)
Chinese (zh)
Inventor
蒙露璐
Original Assignee
深圳市道通智能航空技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市道通智能航空技术股份有限公司 filed Critical 深圳市道通智能航空技术股份有限公司
Publication of WO2023025204A1 publication Critical patent/WO2023025204A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • G05D1/0808Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • G05D1/106Change initiated in response to external conditions, e.g. avoidance of elevated terrain or of no-fly zones

Definitions

  • the present application relates to the technical field of unmanned aerial vehicles, in particular to a remote control method, device and first and second control terminals.
  • Unmanned aerial vehicles are also gradually gaining popularity.
  • the control of the UAV is mainly performed by the pilot using the remote control.
  • the display interface of the remote control usually includes a map screen and a picture transmission screen. Limited, usually the pilot needs to switch the size of the window to control the display of the map screen and the image transmission screen, which leads to insufficient scheduling efficiency of the aircraft and affects the execution of the flight mission.
  • Embodiments of the present application provide a remote control method, device, and first and second control terminals to solve the problem of insufficient scheduling efficiency of unmanned aerial vehicles and improve the scheduling efficiency of unmanned aerial vehicles.
  • an embodiment of the present application provides a remote control method applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication.
  • the method includes :
  • the second control terminal sends a remote control request instruction to the first control terminal
  • the second control terminal receives the remote control confirmation instruction sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
  • the second control terminal enters the remote control interface, based on the remote control interface, remotely controls the UAV, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal.
  • the second control terminal includes an operation console
  • the remote control of the UAV includes:
  • the unmanned aerial vehicle is remotely controlled based on the preset operation mode of the operating console.
  • the console includes: a keyboard, the keyboard includes a plurality of buttons, and the preset operation mode includes: preset button operations, wherein each button corresponds to a button operation, the Based on the preset operation mode of the operating console, the remote control of the unmanned aerial vehicle includes:
  • key operation commands are obtained to control the flight direction of the UAV.
  • the acquisition of key operation commands based on preset keys to control the flight direction of the UAV includes:
  • a button operation command is generated, and the button operation command is sent to the UAV to control the flight direction of the UAV, wherein the preset Buttons, including: an up button, used to control the unmanned aerial vehicle to rise; a down button, used to control the unmanned aerial vehicle to descend; a left turn button, used to control the unmanned aerial vehicle to turn left; a right turn button, used to For controlling the unmanned aerial vehicle to turn right; the forward button is used to control the unmanned aerial vehicle to fly forward; the backward button is used to control the unmanned aerial vehicle to fly backward; the left button is used to control the unmanned aerial vehicle The unmanned aerial vehicle flies left; the right key is used to control the unmanned aerial vehicle to fly right.
  • the method before the second control terminal sends a remote control request instruction to the first control terminal, the method further includes:
  • the second control terminal obtains the remote control interface instruction
  • the second control terminal controls the display interface of the second control terminal to enter the remote control interface according to the remote control interface instruction.
  • the second control terminal communicates with a plurality of unmanned aerial vehicles, and the method further includes:
  • the unmanned aerial vehicle corresponding to the live broadcast window is controlled to be in the remote control state of the second control terminal.
  • the second control terminal includes a terminal device.
  • the embodiment of the present application provides a remote control method applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication.
  • the method includes :
  • the first control terminal When the unmanned aerial vehicle is in the remote control state of the first control terminal, the first control terminal receives the remote control request instruction sent by the second control terminal;
  • the first control terminal receives the remote control confirmation instruction, and sends the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
  • the method also includes:
  • the first control terminal includes a remote control device.
  • the embodiment of the present application provides a remote control device, which is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication, and the device includes :
  • a remote control request instruction sending unit configured to send a remote control request instruction to the first control terminal
  • the remote control state unit is configured to receive the remote control confirmation instruction sent by the first control terminal, and establish a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
  • the remote control interface unit is used to enter the remote control interface, and remotely control the UAV based on the remote control interface, wherein the screen of the second control terminal is larger than the screen of the first control terminal.
  • an embodiment of the present application provides a remote control device, which is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication.
  • the device includes :
  • the remote control request instruction receiving unit is used to receive the remote control request instruction sent by the second control terminal when the unmanned aerial vehicle is in the remote control state of the first control terminal;
  • the remote control state unit is configured to receive a remote control confirmation instruction, and send the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
  • the embodiment of the present application provides a first control terminal, including:
  • a memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processing
  • the device can be used to implement the remote control method as described in the first aspect.
  • the embodiment of the present application provides a second control terminal, including:
  • a memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processing
  • the device can be used to execute the remote control method as described in the second aspect.
  • the embodiments of the present application provide a remote control method, device, and first and second control terminals.
  • the remote control method is applied to unmanned aerial vehicles, and the unmanned aerial vehicle communicates with the first control terminal, and the first control terminal communicates with The second control terminal, the method includes: the second control terminal sends a remote control request command to the first control terminal; the second control terminal receives the remote control confirmation command sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle,
  • the unmanned aerial vehicle is in the remote control state of the second control terminal; the second control terminal enters the remote control interface, and based on the remote control interface, the unmanned aerial vehicle is remotely controlled, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal .
  • the unmanned aerial vehicle is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the unmanned aerial vehicle.
  • FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the present application
  • FIG. 2 is an interactive schematic diagram of a remote control method provided by an embodiment of the present application
  • FIG. 3 is a schematic flowchart of a remote control method provided in an embodiment of the present application.
  • Fig. 4a is a schematic diagram of a first display interface of a first control terminal provided by an embodiment of the present application.
  • Fig. 4b is a schematic diagram of a second display interface of a second control terminal provided by an embodiment of the present application.
  • Fig. 5 is a schematic diagram of a second control terminal provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of an interaction process between a PC end and a remote control end of a remote control method provided by an embodiment of the present application;
  • Fig. 7 is a schematic diagram of a remote control interface of a second control terminal provided by an embodiment of the present application.
  • Fig. 8 is a schematic flowchart of another remote control method provided by the embodiment of the present application.
  • Fig. 9 is a schematic structural diagram of a remote control device provided by an embodiment of the present application.
  • Fig. 10 is a schematic structural diagram of another remote control device provided by an embodiment of the present application.
  • Fig. 11 is a schematic structural diagram of a first control terminal provided by an embodiment of the present application.
  • Fig. 12 is a schematic structural diagram of a second control terminal provided by an embodiment of the present application.
  • orientation or positional relationship indicated by the terms “upper”, “lower”, “inner”, “outer”, and “bottom” used in this specification is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the The application and simplified description do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and thus should not be construed as limiting the application.
  • the terms “first”, “second”, “third”, etc. are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
  • FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the present application.
  • the application scenario includes an unmanned aerial vehicle 100, a first control terminal 200 and a second control terminal 300, wherein the unmanned aerial vehicle 100 is connected to the first control terminal 200 and the second control terminal 300 in communication, and the first control terminal Terminal 200 communicates with the second control terminal 300, for example: UAV 100 communicates with the first control terminal 200 and the second control terminal 300 through the wireless network, and the first control terminal 200 communicates with the second control terminal 300 through the wireless network.
  • the hand or the user can operate the first control terminal 200 to operate the UAV 100 through the wireless network, or the user can operate the second control terminal 200 to control the UAV 100 through the wireless network.
  • the UAV 100 includes: a multi-rotor UAV, a fixed-wing UAV, an unmanned helicopter, and a mixed-wing UAV.
  • the UAV 10 may also be an unmanned aerial vehicle driven by any type of power, including but not limited to a rotary-wing UAV, a fixed-wing UAV, an umbrella-wing UAV, a fluttering Wing drones and helicopter models, etc.
  • a mixed-wing unmanned aerial vehicle is used as an example to make a statement.
  • the unmanned aerial vehicle 100 may have a corresponding volume or power according to the needs of the actual situation, so as to provide a load capacity, flight speed and flight mileage that can meet the needs of use.
  • One or more sensors may also be added to the UAV 100, so that the UAV 100 can collect corresponding data.
  • the UAV 100 is provided with at least one sensor selected from accelerometers, gyroscopes, magnetometers, GPS navigators and vision sensors.
  • the unmanned aerial vehicle 100 also includes a flight controller, which serves as the control core of the flight and data transmission of the unmanned aerial vehicle, and integrates one or more modules to execute corresponding logic control programs.
  • a flight controller which serves as the control core of the flight and data transmission of the unmanned aerial vehicle, and integrates one or more modules to execute corresponding logic control programs.
  • the UAV includes a UAV control system
  • the UAV control system includes a state machine, a flight controller, a UAV power system, and UAV sensors.
  • the UAV control system includes: a state machine, a flight controller, and a UAV power system.
  • the state machine connects the flight controller and the UAV power system.
  • the input of the state machine is navigation data and user interaction commands, and the output
  • the main function of the state machine is to process user interaction commands and use navigation data to realize various functions of the UAV, such as flight mode switching, status monitoring, waypoint flight, return and other upper-level functions.
  • the user interaction command is an interaction command issued by a ground user, for example: remote control stick measurement data, key control commands and other commands.
  • the present application is mainly implemented in a state machine.
  • the control commands and corresponding flags output by the state machine include position commands, speed commands, acceleration commands, altitude commands, climb rate commands, climb acceleration commands, attitude angle commands, heading angle rate commands, and attitude mode flag bits. and positional mode flags.
  • the flight controller is connected to the state machine and the flight controller, and is used to receive the control commands and corresponding flag bits sent by the state machine, and receive the navigation data sent by the power system of the UAV, and output the motor speed control command, wherein,
  • the flight controller includes two flight modes, namely position mode and attitude mode.
  • the main function of the flight controller is to use control commands and navigation data to calculate the motor speed command through a certain algorithm, so that the aircraft can realize position and attitude control. , that is, to make the position and attitude of the aircraft reach the desired state.
  • the battery speed control command takes a common rotorcraft as an example, and the data is pulse width modulation (Pulse Width Modulation, PWM) of the control motor.
  • PWM pulse width modulation
  • the unmanned aerial vehicle power system is connected to the flight controller, and the unmanned aerial vehicle power system includes the execution system and the state monitoring system of the unmanned aerial vehicle, which are used to receive the motor speed control sent by the flight controller. commands to realize the corresponding rotational speed, thereby realizing the corresponding attitude angle and position, processing the sensor data, and calculating the navigation data indirectly or directly.
  • the UAV power system processes the UAV sensor data by using a fusion algorithm to obtain navigation data.
  • the power system of the UAV includes GPS, gyroscope, accelerometer, and magnetometer, and the position, speed, and acceleration data of the UAV can be calculated through GPS, gyroscope, accelerometer, and magnetometer.
  • the drone's position, velocity, and acceleration data can be calculated through binocular vision, gyroscope, accelerometer, and magnetometer.
  • the attitude angle and attitude angle rate of the UAV can be calculated through the gyroscope, accelerometer and magnetometer.
  • the first control terminal 200 includes a smart terminal, where the smart terminal can be any type of smart device used to establish a communication connection with the UAV 100, such as a mobile phone, a tablet computer or a smart remote control and other mobile terminals .
  • the first control terminal 200 may be equipped with one or more different user interaction devices for collecting user instructions or displaying and feeding back information to the user.
  • User interaction devices include, but are not limited to: devices such as buttons, display screens, touch screens, speakers, and remote control joysticks.
  • the first control terminal 200 may be equipped with a touch display screen, through which the user's remote control command to the unmanned aerial vehicle 100 is received and displayed map information to the user through the touch display screen, that is, a map screen, and to the user Display the image information obtained by aerial photography, that is, the image transmission screen, and the user can also switch the image information currently displayed on the display screen through the remote control touch screen.
  • the existing image and vision processing technology can also be integrated between the unmanned aerial vehicle 100 and the first control terminal 200 to further provide more intelligent services.
  • the UAV 100 can collect images through a dual-light camera, and the first control terminal 200 can analyze the images, so as to realize the user's gesture control on the UAV 100 .
  • the second control terminal 300 includes a terminal device, wherein the terminal device includes a computer device, a PC terminal, etc. to establish a communication connection with the UAV 100, and the second control terminal 300 can be equipped with one or more Different user interaction devices are used to collect user instructions or display and feedback information to users.
  • User interaction devices include, but are not limited to: display screens, touch screens, speakers, mice, keyboards and other devices.
  • the first control terminal 200 may be equipped with a touch display screen, through which the user's remote control command to the unmanned aerial vehicle 100 is received and displayed map information to the user through the touch display screen, that is, a map screen, and to the user Display the image information obtained by aerial photography, that is, the image transmission screen.
  • the user can also control the movement of the UAV through the operation of the mouse or the key operation of the keyboard, or control the direction of the gimbal of the UAV, and the gimbal of the UAV camera focal length etc.
  • the first control terminal 200 is a mobile terminal, and the difference from the first control terminal 200 is that the second control terminal 300 is a fixed terminal, and the display screen of the second control terminal 300 is larger than that of the first control terminal 200 screen, so that the second control terminal 300 can provide the user with a global perspective.
  • the wireless network can be a wireless communication network based on any type of data transmission principle for establishing a data transmission channel between two nodes, such as a Bluetooth network, a WiFi network, a wireless cellular network located in different signal frequency bands or a combination thereof.
  • FIG. 2 is an interactive schematic diagram of a remote control method provided by an embodiment of the present application.
  • the interaction of the remote control method includes:
  • Step S201 the second control terminal sends a remote control request command
  • the second control terminal sends a remote control request instruction to the first control terminal, wherein the remote control request instruction is generated by the user inputting an instruction to the second control terminal, for example: the user clicks on the connection on the display screen of the second control terminal
  • the first control terminal enables the second control terminal to generate a remote control request instruction and send the remote control request instruction to the first control terminal.
  • the first control terminal before the first control terminal receives the remote control request instruction sent by the second control terminal, the first control terminal establishes a communication connection with the unmanned aerial vehicle, for example: establishes the first control terminal and the unmanned aerial vehicle.
  • a communication channel wherein the first communication channel is used for message exchange or command exchange or data exchange between the first control terminal and the UAV.
  • Step S202 the first control terminal receives a remote control request command, and generates a remote control confirmation command
  • the first control terminal receives the remote control request instruction sent by the second control terminal, and after receiving the remote control request instruction, presents a corresponding message on the display interface of the first control terminal, and the user Click the corresponding confirmation button on the display interface of the terminal to generate a remote control confirmation command.
  • Step S203 the first control terminal sends a remote control confirmation command
  • the first control terminal sends a remote control confirmation instruction to the second control terminal, wherein the remote control confirmation instruction is used to confirm that the control right of the unmanned aerial vehicle is transferred to the second control terminal, that is, the second control terminal
  • the unmanned aerial vehicle takes control.
  • Step S204 the second control terminal receives the remote control confirmation instruction
  • the second control terminal receives the remote control confirmation command sent by the first control terminal, and the remote control confirmation command is used for the second control terminal to establish a communication connection with the unmanned aerial vehicle, and the unmanned aerial vehicle opens its control, and suspend the control of the first control terminal until the first control terminal regains the control of the unmanned aerial vehicle.
  • Step S205 enter the remote control state of the second control terminal
  • the first control terminal transfers the control right of the unmanned aerial vehicle to the second control terminal, that is, enters the remote control state of the second control terminal, and is controlled by the second control terminal. unmanned aerial vehicle.
  • a communication connection has been established between the second control terminal and the unmanned aerial vehicle, for example: establishing a second communication channel between the second control terminal and the unmanned aerial vehicle, wherein the first The second communication channel is used for message exchange, command exchange or data exchange between the second control terminal and the UAV.
  • the first communication channel and the second communication channel may be based on the same communication protocol, or may be based on different communication protocols, for example: the first communication channel is based on the TCP network protocol, and the second communication channel is based on the Netty network protocol .
  • Step S206 the second control terminal enters the remote control interface
  • the second control terminal After the second control terminal establishes a communication connection with the UAV and obtains the control right of the UAV, the second control terminal enters the remote control interface.
  • Step S207 The second control terminal remotely controls the UAV based on the remote control interface
  • the remote control interface is used to control the unmanned aerial vehicle, for example: control the flight direction of the unmanned aerial vehicle, control the direction of the gimbal of the unmanned aerial vehicle, control the focal length of the gimbal camera of the unmanned aerial vehicle, etc., wherein, A specific control command is generated by the user by manipulating the second control terminal, and sent to the UAV, so that the UAV executes the control command.
  • the following takes the first control terminal as a remote control and the second control terminal as a PC as an example for illustration.
  • FIG. 3 is a schematic flowchart of a remote control method provided by an embodiment of the present application.
  • the execution body of the remote control method is the second control terminal.
  • the second control terminal includes terminal equipment, such as computer equipment, PC terminal and other electronic equipment that establishes a communication connection with the unmanned aerial vehicle.
  • the execution subject of the remote control method is one or more processors of the first control terminal.
  • the remote control method includes:
  • Step S301 the second control terminal sends a remote control request command to the first control terminal
  • the second control terminal sends a remote control request instruction to the first control terminal, wherein the remote control request instruction is generated by the user inputting an instruction to the second control terminal, for example: the user clicks on the connection on the display screen of the second control terminal
  • the first control terminal enables the second control terminal to generate a remote control request instruction and send the remote control request instruction to the first control terminal.
  • the first control terminal before the first control terminal receives the remote control request instruction sent by the second control terminal, the first control terminal establishes a communication connection with the unmanned aerial vehicle, for example: establishes the first control terminal and the unmanned aerial vehicle.
  • a communication pipeline wherein the first communication pipeline is used for message interaction, command interaction or data interaction between the first control terminal and the UAV.
  • Step S302 the second control terminal receives the remote control confirmation instruction sent by the first control terminal, and establishes a communication connection with the UAV, so that the UAV is in the remote control state of the second control terminal;
  • the first control terminal after receiving the remote control request command sent by the second control terminal, the first control terminal presents a selection window on the display interface of the first control terminal, and the selection window provides a confirmation button and a cancel button.
  • the user clicks on the selection window After the confirmation button in the button, a remote control confirmation command will be generated, and the remote control confirmation command will be sent to the second control terminal, so that the second control terminal establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the second
  • the remote control status of the control terminal when the user clicks the cancel button in the selection window, a remote control cancel command will be generated and sent to the second control terminal.
  • the UAV is still in the remote control terminal of the first control terminal. control status.
  • the UAV after the UAV is started, a communication connection with the first control terminal and the second control terminal is established, and, after the first control terminal is started, the UAV is in the remote control state of the first control terminal by default.
  • Step S303 the second control terminal enters the remote control interface, and remotely controls the UAV based on the remote control interface, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal.
  • Figure 4a is a schematic diagram of a first display interface of a first control terminal provided by an embodiment of the present application
  • Fig. 4b is a schematic diagram of a second display interface of a second control terminal provided by an embodiment of the present application.
  • the first control terminal is the remote control terminal
  • the second control terminal is the PC terminal.
  • the display screen of the PC terminal is larger than the display screen of the remote control terminal, and, as shown in Figure 4a, in the first display interface of the usual remote control terminal
  • the display screen on the PC end Therefore, the PC end can obtain the required viewing angle by visually presenting the map interface and the image transmission interface.
  • the PC end can provide a global viewing angle. Therefore, the second display interface is larger than the first display interface, making the unmanned aerial vehicle Controls are more intuitive.
  • the second control end includes an operation console, which is used to control the flight direction of the UAV.
  • FIG. 5 is a schematic diagram of a second control terminal provided by an embodiment of the present application.
  • the second control terminal 300 includes: an operation console 310, wherein the operation console includes a plurality of buttons 311, for example: the operation console 310 is a keyboard, and the keyboard includes a plurality of buttons 311, wherein each Keys are assigned specific operating functions.
  • the remote control of the unmanned aerial vehicle includes:
  • the unmanned aerial vehicle is remotely controlled based on the preset operation mode of the operating console.
  • the console includes: a keyboard
  • the preset operation mode includes: preset button operations, wherein each button corresponds to a button operation, and the preset operation method based on the console
  • the mode of operation is to remotely control the unmanned aerial vehicle, including:
  • key operation commands are obtained to control the flight direction of the UAV.
  • the said key operation command is obtained based on the preset key, and the flight direction of the unmanned aerial vehicle is controlled, including:
  • a button operation command is generated, and the button operation command is sent to the UAV to control the flight direction of the UAV, wherein the preset Buttons, including: an up button, used to control the unmanned aerial vehicle to rise; a down button, used to control the unmanned aerial vehicle to descend; a left turn button, used to control the unmanned aerial vehicle to turn left; a right turn button, used to For controlling the unmanned aerial vehicle to turn right; the forward button is used to control the unmanned aerial vehicle to fly forward; the backward button is used to control the unmanned aerial vehicle to fly backward; the left button is used to control the unmanned aerial vehicle The unmanned aerial vehicle flies left; the right key is used to control the unmanned aerial vehicle to fly right.
  • the keyboard includes W key, A key, S key and D key, and also includes ⁇ , ⁇ , ⁇ , ⁇ four keys, wherein, the W key is the ascending key, the A key is the descending key, and the S key is the left turn key.
  • the D key is the right turn key, the ⁇ key is the forward key, the ⁇ key is the backward key, the ⁇ is the left key, and the ⁇ is the right key.
  • the second control terminal When the user clicks any of the above keys, the second control terminal will generate the corresponding key operation command, and send the key operation command to the unmanned aerial vehicle to control the flight direction of the unmanned aerial vehicle, for example: when the user clicks the W key, the second control terminal generates an ascending operation command, and sends the ascending operation command Go to the unmanned aerial vehicle and control the unmanned aerial vehicle to ascend.
  • the method before the second control terminal sends a remote control request instruction to the first control terminal, the method further includes:
  • the second control terminal obtains the remote control interface instruction
  • the second control terminal controls the display interface of the second control terminal to enter the remote control interface according to the remote control interface instruction.
  • FIG. 6 is a schematic diagram of an interaction process between the PC end and the remote control end of a remote control method provided by an embodiment of the present application;
  • the interaction process between the PC end and the remote control end of the remote control method includes:
  • Step S601 Acquiring remote control interface instructions
  • the PC end After the PC end starts, it will enter the live broadcast screen, wherein the live broadcast screen presents the image transmission screens of all unmanned aerial vehicles.
  • the live broadcast screen after the remote control interface command is obtained, the remote control screen will be entered, wherein the remote control interface command is triggered by the user clicking on the first screen position corresponding to an unmanned aerial vehicle, and the first screen position corresponding to the unmanned aerial vehicle is triggered.
  • a screen position is in the live screen.
  • Step S602 enter the remote control interface
  • the unmanned aerial vehicle after entering the remote control interface of a certain unmanned aerial vehicle, it means that the unmanned aerial vehicle enters the remote control state of the PC terminal, and at this time, the unmanned aerial vehicle can be controlled through the PC terminal.
  • Step S603 Control the flight direction through the keyboard
  • the flight direction of the UAV is controlled through the keyboard on the PC side.
  • Step S604 receiving a remote control exit instruction
  • the PC end receives a remote control exit command of an unmanned aerial vehicle, then exit the remote control interface of the unmanned aerial vehicle, wherein the remote control exit instruction is clicked by the user on the second screen corresponding to a certain unmanned aerial vehicle Position triggering, wherein the position of the second screen corresponding to the unmanned aerial vehicle is located in the remote control interface.
  • Step S605 exit the remote control interface
  • Step S606 receiving remote control prompt information
  • the remote controller receives the remote control request instruction, and presents a remote control prompt message on the display interface of the remote controller, which is used to prompt the pilot whether to accept the remote control.
  • Step S607 Accept remote control?
  • the remote control end accepts remote control, and if so, the PC end enters the remote control interface; if not, the remote control end sends a rejection command to the PC end; If the pilot chooses to confirm the command, it is confirmed that the remote control terminal accepts the remote control; if the pilot chooses to cancel the command, it is determined that the remote control terminal rejects the remote control.
  • Step S608 being remotely controlled by the PC
  • the pilot can click the exit button to make the UAV exit the remote control state at the PC end and return to the remote control state at the remote control end.
  • Step S609 exit the remote control
  • the PC end exits the remote control, and the UAV is remotely controlled by the remote control end.
  • the second control terminal communicates with a plurality of unmanned aerial vehicles, and the method also includes:
  • the unmanned aerial vehicle corresponding to the live broadcast window is controlled to be in the remote control state of the second control terminal.
  • FIG. 7 is a schematic diagram of a remote control interface of a second control terminal provided by an embodiment of the present application.
  • the remote control interface includes a map interface and an image transmission interface. After each unmanned aerial vehicle establishes a communication connection with the second control terminal, the remote control interface of the second control terminal presents the live broadcast corresponding to the unmanned aerial vehicle. Window, for example: the first UAV, the second UAV, the third UAV, the fourth UAV, the fifth UAV, the sixth UAV, ..., the live broadcast of the Nth UAV window.
  • the live broadcast window corresponding to the unmanned aerial vehicle is converted into a control window, for example: controlling the remote control interface of the second control terminal to present the image transmission of the unmanned aerial vehicle Interface, for example: when the first unmanned aerial vehicle is in the remote control state of the second control terminal, the remote control interface controlling the second control terminal presents the image transmission interface of the first unmanned aerial vehicle.
  • the user clicks the live window corresponding to the unmanned aerial vehicle, and the second control terminal sends a remote control request to the first control terminal in response to the click operation on the live window Instruction, after receiving the remote control confirmation instruction sent by the first control terminal, control the unmanned aerial vehicle corresponding to the live broadcast window to be in the remote control state of the second control terminal, and convert the live broadcast window into a control window, for example: Switch the image transmission interface in the remote control interface to the image transmission interface of the UAV, for example: switch the image transmission interface of the first UAV to the image transmission interface of the second UAV.
  • the remote control method is applied to an unmanned aerial vehicle, the unmanned aerial vehicle communicates with the first control terminal, and the first control terminal communicates with the second control terminal
  • the method includes : the second control terminal sends a remote control request command to the first control terminal; the second control terminal receives the remote control confirmation command sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the second control
  • the remote control state of the terminal the second control terminal enters the remote control interface, and based on the remote control interface, remotely controls the unmanned aerial vehicle, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal.
  • the unmanned aerial vehicle is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the unmanned aerial vehicle.
  • FIG. 8 is a schematic flowchart of another remote control method provided by the embodiment of the present application.
  • the execution subject of the remote control method is the first control terminal, and the first control terminal includes a remote control device, and the remote control device includes a smart terminal, such as a mobile terminal such as a mobile phone, a tablet computer, or a smart remote control.
  • the execution subject of the remote control method is one or more processors of the first control terminal.
  • the remote control method includes:
  • Step S801 When the UAV is in the remote control state of the first control terminal, the first control terminal receives the remote control request command sent by the second control terminal;
  • the first control terminal After the first control terminal is turned on, it will automatically communicate with the matching unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the first control terminal.
  • the unmanned aerial vehicle is in the remote control state of the first control terminal.
  • the second control terminal If the second control terminal needs to request the control right of the UAV, the second control terminal sends a remote control request command to the first control terminal, and the first control terminal receives the remote control request command sent by the second control terminal.
  • Step S802 the first control terminal receives the remote control confirmation instruction, and sends the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal;
  • the first control terminal receives the remote control request instruction sent by the second control terminal, it generates a remote control confirmation instruction in response to the operation of the display interface of the first control terminal, and the processor receives the remote control confirmation instruction, wherein , the display interface of the first control terminal presents remote control prompt information, which is used to prompt the pilot whether to accept the remote control. If the pilot chooses to confirm the command, it is determined to generate a remote control confirmation command, and the remote control confirmation command is sent to all
  • the second control terminal is used to obtain the control right of the unmanned aerial vehicle, so that the unmanned aerial vehicle enters the remote control state of the second control terminal.
  • the method further includes:
  • a remote control interruption instruction is received, wherein the remote control interruption instruction is triggered by the display interface of the first control terminal, for example: the pilot clicks the interruption button of the display interface of the first control terminal , so that the unmanned aerial vehicle is switched from the second remote control state to the first remote control state, which is equivalent to switching the control right of the unmanned aerial vehicle from the second control terminal back to the first control terminal, wherein the display interface of the first control terminal Smaller than the display interface of the second console.
  • the method includes : When the unmanned aerial vehicle is in the remote control state of the first control terminal, the first control terminal receives the remote control request command sent by the second control terminal; the first control terminal receives the remote control confirmation command, and sends the remote control confirmation command to the second control terminal, so that the unmanned aerial vehicle enters the remote control state of the second control terminal.
  • the UAV enters the remote control state of the second control terminal, and the application can improve the scheduling efficiency of the UAV.
  • FIG. 9 is a schematic structural diagram of a remote control device provided by an embodiment of the present application.
  • the remote control device is applied to an unmanned aerial vehicle, and the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication.
  • the remote control device 90 includes:
  • a remote control request instruction sending unit 901 configured to send a remote control request instruction to the first control terminal
  • the remote control state unit 902 is configured to receive the remote control confirmation instruction sent by the first control terminal, and establish a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
  • the remote control interface unit 903 is configured to enter a remote control interface, and remotely control the UAV based on the remote control interface, wherein the screen of the second control terminal is larger than the screen of the first control terminal.
  • the UAV is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the UAV.
  • the above-mentioned remote control device can execute the remote control method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method.
  • the remote control method provided in the embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of another remote control device provided by an embodiment of the present application.
  • the remote control device is applied to an unmanned aerial vehicle, and the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication.
  • the remote control device 10 includes:
  • the remote control request instruction receiving unit 101 is used to receive the remote control request instruction sent by the second control terminal when the unmanned aerial vehicle is in the remote control state of the first control terminal;
  • the remote control state unit 102 is configured to receive a remote control confirmation instruction, and send the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
  • the present application by receiving the remote control request command sent by the second control terminal, and sending the remote control confirmation command to the second control terminal, so that the unmanned aerial vehicle enters the remote control state of the second control terminal, the present application can improve Scheduling Efficiency for Unmanned Aerial Vehicles.
  • the above-mentioned remote control device can execute the remote control method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method.
  • the remote control method provided in the embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a first control terminal provided by an embodiment of the present application.
  • the first control terminal 110 includes, but is not limited to: a radio frequency unit 111, a network module 112, an audio output unit 113, an input unit 114, a sensor 115, a display unit 116, a user input unit 117, an interface unit 118, Memory 119, processor 1110, power supply 1111 and other components, the first control terminal 110 also includes a camera.
  • the structure of the first control terminal shown in Figure 11 does not constitute a limitation on the first control terminal, and the first control terminal may include more or less components than shown in the figure, or combine some components , or different component arrangements.
  • the first control terminal includes, but is not limited to, mobile terminals such as mobile phones, tablet computers, or smart remote controls.
  • the processor 1110 is used for the second control terminal to send a remote control request command to the first control terminal; the second control terminal receives the remote control confirmation command sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle
  • the aircraft is in the remote control state of the second control terminal; the second control terminal enters the remote control interface to remotely control the UAV based on the remote control interface, wherein the display interface of the second control terminal is larger than that of the first control terminal.
  • the UAV is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the UAV.
  • the radio frequency unit 111 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 1110; Uplink data is sent to the base station.
  • the radio frequency unit 111 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency unit 111 can also communicate with the network and other devices through a wireless communication system.
  • the first control terminal 110 provides users with wireless broadband Internet access through the network module 112 , such as helping users send and receive emails, browse web pages, and access streaming media.
  • the audio output unit 113 may convert audio data received by the radio frequency unit 111 or the network module 112 or stored in the memory 119 into an audio signal and output as sound. Moreover, the audio output unit 113 may also provide audio output related to a specific function performed by the first control terminal 110 (for example, call signal reception sound, message reception sound, etc.).
  • the audio output unit 113 includes a speaker, a buzzer, a receiver, and the like.
  • the input unit 114 is used to receive audio or video signals.
  • the input unit 114 can include a graphics processor (Graphics Processing Unit, GPU) 1141 and a microphone 1142, and the graphics processor 1141 can target still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode.
  • the image is processed.
  • the processed image frames may be displayed on the display unit 116 .
  • the image frames processed by the graphics processor 1141 may be stored in the memory 119 (or other storage media) or sent via the radio frequency unit 111 or the network module 112 .
  • the microphone 1142 can receive sound and can process such sound into audio data.
  • the processed audio data may be converted into a format transmittable to a mobile communication base station via the radio frequency unit 111 for output in case of a phone call mode.
  • the first control terminal 110 also includes at least one sensor 115, such as a light sensor, a motion sensor and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1161 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel when the first control terminal 110 moves to the ear. 1161 and/or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the attitude of the first control terminal (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, knocking), etc.; sensor 115 can also include fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, Thermometers, infrared sensors, etc., will not be repeated here.
  • the display unit 116 is used to display information input by the user or information provided to the user.
  • the display unit 116 may include a display panel 1161, and the display panel 1161 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • the user input unit 117 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the first control terminal.
  • the user input unit 117 includes a touch panel 1171 and other input devices 1172 .
  • the touch panel 1171 also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1171 or near the touch panel 1171). operate).
  • the touch panel 1171 may include two parts, a touch detection device and a touch controller.
  • the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 1110, receive the command sent by the processor 1110 and execute it.
  • the touch panel 1171 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the user input unit 117 may also include other input devices 1172 .
  • other input devices 1172 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
  • the touch panel 1171 can be covered on the display panel 1161, and when the touch panel 1171 detects a touch operation on or near it, it will be sent to the processor 1110 to determine the type of the touch event, and then the processor 1110 will The type of event provides a corresponding visual output on the display panel 1161 .
  • the touch panel 1171 and the display panel 1161 are used as two independent components to realize the input and output functions of the first control terminal, in some embodiments, the touch panel 1171 and the display panel 1161 can be combined The input and output functions of the first control terminal are realized through integration, which is not specifically limited here.
  • the interface unit 118 is an interface for connecting an external device to the first control terminal 110 .
  • an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more.
  • the interface unit 118 may be used to receive input from an external device (for example, data information, power, etc.) and transmit the received input to one or more elements in the first control terminal 110 or may be used to Data is transferred between the terminal 110 and an external device.
  • the memory 119 can be used to store software programs as well as various data.
  • Storer 119 can mainly comprise storage program area and storage data area, wherein, storage program area can store the required application program 1191 (such as sound playback function, image playback function etc.) and operating system 1192 etc. of at least one function; Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone.
  • the memory 119 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the processor 1110 is the control center of the first control terminal, which uses various interfaces and lines to connect various parts of the entire first control terminal, and runs or executes the software programs and/or modules stored in the memory 119, and calls the software programs stored in the memory 119. data, execute various functions of the first control terminal and process data, so as to monitor the first control terminal as a whole.
  • the processor 1110 may include one or more processing units; in the embodiment of the present application, the processor 1110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1110 .
  • the first control terminal 110 can also include a power supply 1111 (such as a battery) for supplying power to various components.
  • a power supply 1111 (such as a battery) for supplying power to various components.
  • the power supply 1111 can be logically connected to the processor 1110 through the power management system, so as to realize management charging, Discharge, and power management functions.
  • the first control terminal 110 includes some functional modules not shown, which will not be repeated here.
  • the embodiment of the present application also provides a first control terminal, including a processor 1110, a memory 119, and a computer program stored in the memory 119 and operable on the processor 1110, and the computer program is implemented when executed by the processor 1110.
  • a first control terminal including a processor 1110, a memory 119, and a computer program stored in the memory 119 and operable on the processor 1110, and the computer program is implemented when executed by the processor 1110.
  • FIG. 12 is a schematic structural diagram of a second control terminal provided by an embodiment of the present application.
  • the second control terminal 120 includes: a processor 121 , a memory 122 and a communication module 123 .
  • the processor 121 , the memory 122 and the communication module 123 establish any communication connection between them through a bus.
  • the processor 121 can be any type of processor with one or more processing cores. It can perform single-threaded or multi-threaded operations, and is used to parse instructions to perform operations such as obtaining data, performing logical operation functions, and delivering operation processing results.
  • the memory 122 as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/modules corresponding to the remote control method in the embodiment of the present application .
  • the processor 121 executes the non-transitory software programs, instructions and modules stored in the memory 122 to implement the remote control method in the above method embodiments.
  • the memory 122 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the remote control device, and the like.
  • the memory 122 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices.
  • the memory 122 may optionally include memory located remotely from the processor 121, and these remote memories may be connected to the UAV via a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the memory 122 stores instructions executable by the at least one processor 121; the at least one processor 121 is configured to execute the instructions, so as to implement the remote control method in any of the above method embodiments.
  • the communication module 123 is a functional module for establishing a communication connection and providing a physical channel.
  • the communication module 123 may be any type of wireless or wired communication module, including but not limited to a WiFi module or a Bluetooth module.
  • the embodiment of the present application also provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors 121, which may cause the above-mentioned one or more processors 121 to execute the remote control method in any of the above-mentioned method embodiments.
  • the device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Some or all of the modules are selected according to actual needs to realize the purpose of the solution of this embodiment.
  • each embodiment can be implemented by means of software plus a general hardware platform, and of course also by hardware.
  • the computer program can be stored in a non-transitory computer.
  • the computer program includes program instructions, and when the program instructions are executed by the relevant equipment, the relevant equipment can be made to execute the processes of the embodiments of the above-mentioned methods.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.
  • the above-mentioned product can execute the UAV protection method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the UAV protection method.
  • the drone protection method provided in the embodiment of this application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)

Abstract

A remote control method and device (10) and first and second control ends (110 and 120). The remote control method is applied to an unmanned aerial vehicle (100); the unmanned aerial vehicle (100) is communicatively connected to the first control end (110); the first control end (110) is communicatively connected to the second control end (120). The method comprises: S301: the second control end (120) sends a remote control request instruction to the first control end (110); S302: the second control end (120) receives a remote control determination instruction sent by the first control end (110), and establishes a communication connection with the unmanned aerial vehicle (100), such that the unmanned aerial vehicle (100) is in a remotely controlled state of the second control end (120); and S303: the second control end (120) enters a remote control interface, and remotely controls the unmanned aerial vehicle (100) on the basis of the remote control interface, wherein a display interface of the second control end (120) is larger than a display interface of the first control end (110). The second control end (120) enters the remote control interface to control the unmanned aerial vehicle (100), and the display interface of the second control end (120) is larger than the display interface of the first control end (110), such that the scheduling efficiency of the unmanned aerial vehicle (100) can be improved.

Description

远程控制方法、装置及第一、第二控制端Remote control method, device and first and second control terminals
本申请要求于2021年8月25日提交中国专利局、申请号为2021109824295、申请名称为“远程控制方法、装置及第一、第二控制端”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the China Patent Office on August 25, 2021, with the application number 2021109824295 and the application name "Remote Control Method, Device, and First and Second Control Terminals", the entire content of which is passed References are incorporated in this application.
【技术领域】【Technical field】
本申请涉及无人飞行器技术领域,尤其涉及一种远程控制方法、装置及第一、第二控制端。The present application relates to the technical field of unmanned aerial vehicles, in particular to a remote control method, device and first and second control terminals.
【背景技术】【Background technique】
随着无人飞行器航拍技术的不断发展,越来越多的消费级无人飞行器也正在生产研制。无人飞行器也逐步日趋普及。With the continuous development of unmanned aerial vehicle aerial photography technology, more and more consumer-grade unmanned aerial vehicles are also being produced and developed. Unmanned aerial vehicles are also gradually gaining popularity.
目前,在无人机在飞行过程中,无人飞行器的操控主要通过飞手利用遥控器去执行任务,遥控器的显示界面通常包括地图画面和图传画面,而由于遥控器的显示界面的大小有限,通常飞手需要进行大小窗切换来控制地图画面和图传画面的显示,导致飞行器的调度效率不足,影响飞行任务的执行。At present, during the flight of the UAV, the control of the UAV is mainly performed by the pilot using the remote control. The display interface of the remote control usually includes a map screen and a picture transmission screen. Limited, usually the pilot needs to switch the size of the window to control the display of the map screen and the image transmission screen, which leads to insufficient scheduling efficiency of the aircraft and affects the execution of the flight mission.
【申请内容】【Application content】
本申请实施例提供一种远程控制方法、装置及第一、第二控制端,以解决无人飞行器的调度效率不足的问题,提高无人飞行器的调度效率。Embodiments of the present application provide a remote control method, device, and first and second control terminals to solve the problem of insufficient scheduling efficiency of unmanned aerial vehicles and improve the scheduling efficiency of unmanned aerial vehicles.
为解决上述技术问题,本申请实施例提供以下技术方案:In order to solve the above technical problems, the embodiments of the present application provide the following technical solutions:
第一方面,本申请实施例提供一种远程控制方法,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端, 所述方法包括:In the first aspect, an embodiment of the present application provides a remote control method applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication. The method includes :
第二控制端向所述第一控制端发送远程控制请求指令;the second control terminal sends a remote control request instruction to the first control terminal;
第二控制端接收所述第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得所述无人飞行器处于第二控制端的远程控制状态;The second control terminal receives the remote control confirmation instruction sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
第二控制端进入远程控制界面,基于所述远程控制界面,对所述无人飞行器进行远程控制,其中,所述第二控制端的显示界面大于第一控制端的显示界面。The second control terminal enters the remote control interface, based on the remote control interface, remotely controls the UAV, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal.
在一些实施例中,所述第二控制端包括一操作台,所述对所述无人飞行器进行远程控制,包括:In some embodiments, the second control terminal includes an operation console, and the remote control of the UAV includes:
基于所述操作台预设的操作方式,对所述无人飞行器进行远程控制。The unmanned aerial vehicle is remotely controlled based on the preset operation mode of the operating console.
在一些实施例中,所述操作台包括:键盘,所述键盘包括多个按键,所述预设的操作方式,包括:预设的按键操作,其中,每一按键对应一个按键操作,所述基于所述操作台预设的操作方式,对所述无人飞行器进行远程控制,包括:In some embodiments, the console includes: a keyboard, the keyboard includes a plurality of buttons, and the preset operation mode includes: preset button operations, wherein each button corresponds to a button operation, the Based on the preset operation mode of the operating console, the remote control of the unmanned aerial vehicle includes:
基于预设的按键,获取按键操作命令,控制所述无人飞行器的飞行方向。Based on the preset keys, key operation commands are obtained to control the flight direction of the UAV.
在一些实施例中,所述基于预设的按键,获取按键操作命令,控制所述无人飞行器的飞行方向,包括:In some embodiments, the acquisition of key operation commands based on preset keys to control the flight direction of the UAV includes:
根据所述预设的按键对应的按键操作,生成按键操作命令,并将所述按键操作命令发送到所述无人飞行器,以控制所述无人飞行器的飞行方向,其中,所述预设的按键,包括:上升按键,用于控制所述无人飞行器上升;下降按键,用于控制所述无人飞行器下降;左转按键,用于控制所述无人飞行器左转;右转按键,用于控制所述无人飞行器右转;向前按键,用于控制所述无人飞行器前飞;向后按键,用于控制所述无人飞行器后飞;向左按键,用于控制所述无人飞行器左飞;向右按键,用于控制所述无人飞行器右飞。According to the button operation corresponding to the preset button, a button operation command is generated, and the button operation command is sent to the UAV to control the flight direction of the UAV, wherein the preset Buttons, including: an up button, used to control the unmanned aerial vehicle to rise; a down button, used to control the unmanned aerial vehicle to descend; a left turn button, used to control the unmanned aerial vehicle to turn left; a right turn button, used to For controlling the unmanned aerial vehicle to turn right; the forward button is used to control the unmanned aerial vehicle to fly forward; the backward button is used to control the unmanned aerial vehicle to fly backward; the left button is used to control the unmanned aerial vehicle The unmanned aerial vehicle flies left; the right key is used to control the unmanned aerial vehicle to fly right.
在一些实施例中,在第二控制端向所述第一控制端发送远程控制请求指令之前,所述方法还包括:In some embodiments, before the second control terminal sends a remote control request instruction to the first control terminal, the method further includes:
第二控制端获取远程控制界面指令;The second control terminal obtains the remote control interface instruction;
第二控制端根据所述远程控制界面指令,控制所述第二控制端的显示界面进入远程控制界面。The second control terminal controls the display interface of the second control terminal to enter the remote control interface according to the remote control interface instruction.
在一些实施例中,所述第二控制端通信连接多个无人飞行器,所述方法还包括:In some embodiments, the second control terminal communicates with a plurality of unmanned aerial vehicles, and the method further includes:
在所述远程控制界面中,生成每一无人飞行器一一对应的直播窗口;In the remote control interface, generate a one-to-one live broadcast window for each unmanned aerial vehicle;
响应于对直播窗口的操作,控制所述直播窗口对应的无人飞行器处于第二控制端的远程控制状态。In response to the operation on the live broadcast window, the unmanned aerial vehicle corresponding to the live broadcast window is controlled to be in the remote control state of the second control terminal.
在一些实施例中,所述第二控制端包括终端设备。In some embodiments, the second control terminal includes a terminal device.
第二方面,本申请实施例提供一种远程控制方法,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述方法包括:In the second aspect, the embodiment of the present application provides a remote control method applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication. The method includes :
在无人飞行器处于第一控制端的远程控制状态时,第一控制端接收第二控制端发送的远程控制请求指令;When the unmanned aerial vehicle is in the remote control state of the first control terminal, the first control terminal receives the remote control request instruction sent by the second control terminal;
第一控制端接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态。The first control terminal receives the remote control confirmation instruction, and sends the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
在一些实施例中,所述方法还包括:In some embodiments, the method also includes:
接收远程控制中断指令,控制所述无人飞行器由第二远程控制状态切换到第一远程控制状态,其中,所述第一远程控制状态为所述第一控制端远程控制所述无人飞行器,所述第二远程控制状态为所述第二控制端远程控制所述无人飞行器。receiving a remote control interruption command, controlling the unmanned aerial vehicle to switch from the second remote control state to the first remote control state, wherein the first remote control state is that the first control terminal remotely controls the unmanned aerial vehicle, The second remote control state is that the second control terminal remotely controls the UAV.
在一些实施例中,所述第一控制端包括遥控设备。In some embodiments, the first control terminal includes a remote control device.
第三方面,本申请实施例提供一种远程控制装置,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述装置包括:In the third aspect, the embodiment of the present application provides a remote control device, which is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication, and the device includes :
远程控制请求指令发送单元,用于向所述第一控制端发送远程控制请求 指令;A remote control request instruction sending unit, configured to send a remote control request instruction to the first control terminal;
远程控制状态单元,用于接收所述第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得所述无人飞行器处于第二控制端的远程控制状态;The remote control state unit is configured to receive the remote control confirmation instruction sent by the first control terminal, and establish a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
远程控制界面单元,用于进入远程控制界面,基于所述远程控制界面,对所述无人飞行器进行远程控制,其中,所述第二控制端的屏幕大于第一控制端的屏幕。The remote control interface unit is used to enter the remote control interface, and remotely control the UAV based on the remote control interface, wherein the screen of the second control terminal is larger than the screen of the first control terminal.
第四方面,本申请实施例提供一种远程控制装置,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述装置包括:In a fourth aspect, an embodiment of the present application provides a remote control device, which is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication. The device includes :
远程控制请求指令接收单元,用于在无人飞行器处于第一控制端的远程控制状态时,接收第二控制端发送的远程控制请求指令;The remote control request instruction receiving unit is used to receive the remote control request instruction sent by the second control terminal when the unmanned aerial vehicle is in the remote control state of the first control terminal;
远程控制状态单元,用于接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态。The remote control state unit is configured to receive a remote control confirmation instruction, and send the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
第五方面,本申请实施例提供一种第一控制端,包括:In the fifth aspect, the embodiment of the present application provides a first control terminal, including:
至少一个处理器;以及at least one processor; and
与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够用于执行如第一方面所述的远程控制方法。A memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processing The device can be used to implement the remote control method as described in the first aspect.
第六方面,本申请实施例提供一种第二控制端,包括:In a sixth aspect, the embodiment of the present application provides a second control terminal, including:
至少一个处理器;以及at least one processor; and
与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够用于执行如第二方面所述的远程控制方法。A memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processing The device can be used to execute the remote control method as described in the second aspect.
本申请实施例的提供的一种远程控制方法、装置及第一、第二控制端, 该远程控制方法,应用于无人飞行器,无人飞行器通信连接第一控制端,第一控制端通信连接第二控制端,该方法包括:第二控制端向第一控制端发送远程控制请求指令;第二控制端接收第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得无人飞行器处于第二控制端的远程控制状态;第二控制端进入远程控制界面,基于远程控制界面,对无人飞行器进行远程控制,其中,第二控制端的显示界面大于第一控制端的显示界面。通过第二控制端进入远程控制界面来控制无人飞行器,而第二控制端的显示界面大于第一控制端的显示界面,因此,本申请能够提高无人飞行器的调度效率。The embodiments of the present application provide a remote control method, device, and first and second control terminals. The remote control method is applied to unmanned aerial vehicles, and the unmanned aerial vehicle communicates with the first control terminal, and the first control terminal communicates with The second control terminal, the method includes: the second control terminal sends a remote control request command to the first control terminal; the second control terminal receives the remote control confirmation command sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, The unmanned aerial vehicle is in the remote control state of the second control terminal; the second control terminal enters the remote control interface, and based on the remote control interface, the unmanned aerial vehicle is remotely controlled, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal . The unmanned aerial vehicle is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the unmanned aerial vehicle.
【附图说明】【Description of drawings】
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplifications do not constitute a limitation to the embodiments. Elements with the same reference numerals in the drawings represent similar elements. Unless otherwise stated, the drawings in the drawings are not limited to scale.
图1是本申请实施例提供的一种应用场景的示意图;FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the present application;
图2是本申请实施例提供的一种远程控制方法的交互示意图;FIG. 2 is an interactive schematic diagram of a remote control method provided by an embodiment of the present application;
图3是本申请实施例提供的一种远程控制方法的流程示意图;FIG. 3 is a schematic flowchart of a remote control method provided in an embodiment of the present application;
图4a是本申请实施例提供的一种第一控制端的第一显示界面的示意图;Fig. 4a is a schematic diagram of a first display interface of a first control terminal provided by an embodiment of the present application;
图4b是本申请实施例提供的一种第二控制端的第二显示界面的示意图;Fig. 4b is a schematic diagram of a second display interface of a second control terminal provided by an embodiment of the present application;
图5是本申请实施例提供的一种第二控制端的示意图;Fig. 5 is a schematic diagram of a second control terminal provided by an embodiment of the present application;
图6是本申请实施例提供的一种远程控制方法的PC端和遥控器端的交互流程示意图;FIG. 6 is a schematic diagram of an interaction process between a PC end and a remote control end of a remote control method provided by an embodiment of the present application;
图7是本申请实施例提供的一种第二控制端的远程控制界面的示意图;Fig. 7 is a schematic diagram of a remote control interface of a second control terminal provided by an embodiment of the present application;
图8是本申请实施例提供的另一种远程控制方法的流程示意图;Fig. 8 is a schematic flowchart of another remote control method provided by the embodiment of the present application;
图9是本申请实施例提供的一种远程控制装置的结构示意图;Fig. 9 is a schematic structural diagram of a remote control device provided by an embodiment of the present application;
图10是本申请实施例提供的另一种远程控制装置的结构示意图;Fig. 10 is a schematic structural diagram of another remote control device provided by an embodiment of the present application;
图11是本申请实施例提供的一种第一控制端的结构示意图;Fig. 11 is a schematic structural diagram of a first control terminal provided by an embodiment of the present application;
图12是本申请实施例提供的一种第二控制端的结构示意图。Fig. 12 is a schematic structural diagram of a second control terminal provided by an embodiment of the present application.
【具体实施方式】【Detailed ways】
为了便于理解本申请,下面结合附图和具体实施例,对本申请进行更详细的说明。需要说明的是,当元件被表述“固定于”另一个元件,它可以直接在另一个元件上、或者其间可以存在一个或多个居中的元件。当一个元件被表述“连接”另一个元件,它可以是直接连接到另一个元件、或者其间可以存在一个或多个居中的元件。本说明书所使用的术语“上”、“下”、“内”、“外”、“底部”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本申请和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。此外,术语“第一”、“第二”“第三”等仅用于描述目的,而不能理解为指示或暗示相对重要性。In order to facilitate the understanding of the present application, the present application will be described in more detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that when an element is said to be "fixed" to another element, it may be directly on the other element, or there may be one or more intervening elements therebetween. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or one or more intervening elements may be present therebetween. The orientation or positional relationship indicated by the terms "upper", "lower", "inner", "outer", and "bottom" used in this specification is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the The application and simplified description do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and thus should not be construed as limiting the application. In addition, the terms "first", "second", "third", etc. are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
除非另有定义,本说明书所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本说明书中在本申请的说明书中所使用的术语只是为了描述具体的实施例的目的,不是用于限制本申请。本说明书所使用的术语“和/或”包括一个或多个相关的所列项目的任意的和所有的组合。Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the technical field of this application. The terms used in the description of the present application are only for the purpose of describing specific embodiments, and are not used to limit the present application. The term "and/or" used in this specification includes any and all combinations of one or more of the associated listed items.
此外,下面所描述的本申请不同实施例中所涉及的技术特征只要彼此之间未构成冲突就可以相互结合。In addition, the technical features involved in different embodiments of the present application described below may be combined with each other as long as they do not constitute a conflict with each other.
以下举例说明本申请实施例中的远程控制方法的应用环境。The following examples illustrate the application environment of the remote control method in the embodiment of the present application.
请参阅图1,图1是本申请实施例提供的一种应用场景的示意图;Please refer to FIG. 1, which is a schematic diagram of an application scenario provided by an embodiment of the present application;
如图1所示,该应用场景包括无人飞行器100、第一控制端200以及第二控制端300,其中,无人飞行器100通信连接第一控制端200以及第二控制端300,第一控制端200通信连接第二控制端300,例如:无人飞行器100通过 无线网络通信连接第一控制端200以及第二控制端300,第一控制端200通过无线网络通信连接第二控制端300,飞手或用户可操作第一控制端200通过无线网络操作无人飞行器100,或者,用户可操作第二控制端200通过无线网络操控无人飞行器100。As shown in FIG. 1 , the application scenario includes an unmanned aerial vehicle 100, a first control terminal 200 and a second control terminal 300, wherein the unmanned aerial vehicle 100 is connected to the first control terminal 200 and the second control terminal 300 in communication, and the first control terminal Terminal 200 communicates with the second control terminal 300, for example: UAV 100 communicates with the first control terminal 200 and the second control terminal 300 through the wireless network, and the first control terminal 200 communicates with the second control terminal 300 through the wireless network. The hand or the user can operate the first control terminal 200 to operate the UAV 100 through the wireless network, or the user can operate the second control terminal 200 to control the UAV 100 through the wireless network.
在一些实施例中,所述无人飞行器100包括:多旋翼无人机、固定翼无人机、无人直升机以及混合翼无人机等无人飞行器。在一些实施例中,所述无人机10也可以是以任何类型的动力驱动的无人飞行载具,包括但不限于旋翼无人机、固定翼无人机、伞翼无人机、扑翼无人机以及直升机模型等。在本实施例中以混合翼无人机为例进行陈述。In some embodiments, the UAV 100 includes: a multi-rotor UAV, a fixed-wing UAV, an unmanned helicopter, and a mixed-wing UAV. In some embodiments, the UAV 10 may also be an unmanned aerial vehicle driven by any type of power, including but not limited to a rotary-wing UAV, a fixed-wing UAV, an umbrella-wing UAV, a fluttering Wing drones and helicopter models, etc. In this embodiment, a mixed-wing unmanned aerial vehicle is used as an example to make a statement.
进一步地,该无人飞行器100可以根据实际情况的需要,具备相应的体积或者动力,从而提供能够满足使用需要的载重能力、飞行速度以及飞行续航里程等。无人飞行器100上还可以添加有一种或者多种传感器,使得无人飞行器100能够采集相应的数据。Furthermore, the unmanned aerial vehicle 100 may have a corresponding volume or power according to the needs of the actual situation, so as to provide a load capacity, flight speed and flight mileage that can meet the needs of use. One or more sensors may also be added to the UAV 100, so that the UAV 100 can collect corresponding data.
例如,在一些实施例中,该无人飞行器100设置有加速度计、陀螺仪、磁力计、GPS导航仪和视觉传感器中的至少一种传感器。For example, in some embodiments, the UAV 100 is provided with at least one sensor selected from accelerometers, gyroscopes, magnetometers, GPS navigators and vision sensors.
无人飞行器100还包括飞行控制器,作为无人机飞行和数据传输等的控制核心,整合一个或者多个模块,以执行相应的逻辑控制程序。The unmanned aerial vehicle 100 also includes a flight controller, which serves as the control core of the flight and data transmission of the unmanned aerial vehicle, and integrates one or more modules to execute corresponding logic control programs.
在本申请实施例中,所述无人飞行器包括一无人机控制系统,所述无人机控制系统包括状态机、飞行控制器、无人机动力系统以及无人机传感器等。In the embodiment of the present application, the UAV includes a UAV control system, and the UAV control system includes a state machine, a flight controller, a UAV power system, and UAV sensors.
该无人机控制系统包括:状态机、飞行控制器以及无人机动力系统,具体的,状态机连接飞行控制器和无人机动力系统,状态机的输入为导航数据和用户交互命令,输出为控制指令和相应标志位,所述状态机的主要功能在于处理用户交互命令,采用导航数据,实现无人机各个功能,例如飞行模式切换、状态监控、航点飞行、返航等上层功能。其中,所述用户交互命令为地面用户发出的交互命令,例如:遥控杆量数据、按键控制命令等命令,可以理解的是,本申请主要是在状态机中实现。具体的,所述状态机输出的控 制命令和相应标志位,有位置命令、速度命令、加速度命令、高度命令、爬升率命令、爬升加速度命令、姿态角命令、航向角速率命令、姿态模式标志位和位置模式标志位。The UAV control system includes: a state machine, a flight controller, and a UAV power system. Specifically, the state machine connects the flight controller and the UAV power system. The input of the state machine is navigation data and user interaction commands, and the output In order to control commands and corresponding flags, the main function of the state machine is to process user interaction commands and use navigation data to realize various functions of the UAV, such as flight mode switching, status monitoring, waypoint flight, return and other upper-level functions. Wherein, the user interaction command is an interaction command issued by a ground user, for example: remote control stick measurement data, key control commands and other commands. It can be understood that the present application is mainly implemented in a state machine. Specifically, the control commands and corresponding flags output by the state machine include position commands, speed commands, acceleration commands, altitude commands, climb rate commands, climb acceleration commands, attitude angle commands, heading angle rate commands, and attitude mode flag bits. and positional mode flags.
具体的,飞行控制器,连接状态机和飞行控制器,用于接收状态机发送的控制命令和相应标志位,以及接收无人机动力系统发送的导航数据,并输出电机转速控制命令,其中,所述飞行控制器包括两种飞行模式,分别为位置模式和姿态模式,所述飞行控制器主要功能在于采用控制命令和导航数据通过一定的算法计算出电机转速命令,使得飞机实现位置和姿态控制,即使得飞机的位置和姿态达到期望的状态。具体的,所述电池转速控制命令,以常见的旋翼机为例,该数据为控制电机的脉冲宽度调制(Pulse Width Modulation,PWM)。Specifically, the flight controller is connected to the state machine and the flight controller, and is used to receive the control commands and corresponding flag bits sent by the state machine, and receive the navigation data sent by the power system of the UAV, and output the motor speed control command, wherein, The flight controller includes two flight modes, namely position mode and attitude mode. The main function of the flight controller is to use control commands and navigation data to calculate the motor speed command through a certain algorithm, so that the aircraft can realize position and attitude control. , that is, to make the position and attitude of the aircraft reach the desired state. Specifically, the battery speed control command takes a common rotorcraft as an example, and the data is pulse width modulation (Pulse Width Modulation, PWM) of the control motor.
具体的,所述无人机动力系统,连接所述飞行控制器,所述无人机动力系统包括所述无人机的执行系统和状态监控系统,用于接收飞行控制器发送的电机转速控制命令,实现相应的转速,从而实现相应的姿态角和位置,对传感器数据进行处理,间接或直接计算出导航数据。具体的,所述无人机动力系统通过采用融合算法对无人机传感器数据进行处理,得到导航数据。例如,所述无人机动力系统包括GPS、陀螺仪、加速度计、磁力计,可以通过GPS、陀螺仪、加速度计、磁力计解算出无人机的位置、速度、加速度数据。可以通过双目视觉、陀螺仪、加速度计、磁力计解算出无人机的位置、速度、加速度数据。可以通过陀螺仪、加速度计和磁力计解算出无人机的姿态角,姿态角速率。Specifically, the unmanned aerial vehicle power system is connected to the flight controller, and the unmanned aerial vehicle power system includes the execution system and the state monitoring system of the unmanned aerial vehicle, which are used to receive the motor speed control sent by the flight controller. commands to realize the corresponding rotational speed, thereby realizing the corresponding attitude angle and position, processing the sensor data, and calculating the navigation data indirectly or directly. Specifically, the UAV power system processes the UAV sensor data by using a fusion algorithm to obtain navigation data. For example, the power system of the UAV includes GPS, gyroscope, accelerometer, and magnetometer, and the position, speed, and acceleration data of the UAV can be calculated through GPS, gyroscope, accelerometer, and magnetometer. The drone's position, velocity, and acceleration data can be calculated through binocular vision, gyroscope, accelerometer, and magnetometer. The attitude angle and attitude angle rate of the UAV can be calculated through the gyroscope, accelerometer and magnetometer.
在一些实施例中,第一控制端200包括智能终端,其中,智能终端可以是任何类型,用以与无人飞行器100建立通信连接的智能装置,例如手机、平板电脑或者智能遥控器等移动终端。该第一控制端200可以装配有一种或者多种不同的用户交互装置,用以采集用户指令或者向用户展示和反馈信息。In some embodiments, the first control terminal 200 includes a smart terminal, where the smart terminal can be any type of smart device used to establish a communication connection with the UAV 100, such as a mobile phone, a tablet computer or a smart remote control and other mobile terminals . The first control terminal 200 may be equipped with one or more different user interaction devices for collecting user instructions or displaying and feeding back information to the user.
用户交互装置包括但不限于:按键、显示屏、触摸屏、扬声器以及遥控 操作杆等装置。例如,第一控制端200可以装配有触控显示屏,通过该触控显示屏接收用户对无人飞行器100的遥控指令并通过触控显示屏向用户展示地图信息,即地图画面,以及向用户展示航拍获得的图像信息,即图传画面,用户还可以通过遥控触摸屏切换显示屏当前显示的图像信息。User interaction devices include, but are not limited to: devices such as buttons, display screens, touch screens, speakers, and remote control joysticks. For example, the first control terminal 200 may be equipped with a touch display screen, through which the user's remote control command to the unmanned aerial vehicle 100 is received and displayed map information to the user through the touch display screen, that is, a map screen, and to the user Display the image information obtained by aerial photography, that is, the image transmission screen, and the user can also switch the image information currently displayed on the display screen through the remote control touch screen.
在一些实施例中,无人飞行器100与第一控制端200之间还可以融合现有的图像视觉处理技术,进一步的提供更智能化的服务。例如:无人飞行器100可以通过双光相机采集图像的方式,由第一控制端200对图像进行解析,从而实现用户对于无人飞行器100的手势控制。In some embodiments, the existing image and vision processing technology can also be integrated between the unmanned aerial vehicle 100 and the first control terminal 200 to further provide more intelligent services. For example, the UAV 100 can collect images through a dual-light camera, and the first control terminal 200 can analyze the images, so as to realize the user's gesture control on the UAV 100 .
在一些实施例中,第二控制端300包括终端设备,其中,终端设备包括计算机设备、PC端等与无人飞行器100建立通信连接的设备,该第二控制端300可以装配有一种或者多种不同的用户交互装置,用以采集用户指令或者向用户展示和反馈信息。In some embodiments, the second control terminal 300 includes a terminal device, wherein the terminal device includes a computer device, a PC terminal, etc. to establish a communication connection with the UAV 100, and the second control terminal 300 can be equipped with one or more Different user interaction devices are used to collect user instructions or display and feedback information to users.
用户交互装置包括但不限于:显示屏、触摸屏、扬声器以及鼠标、键盘等装置。例如,第一控制端200可以装配有触控显示屏,通过该触控显示屏接收用户对无人飞行器100的遥控指令并通过触控显示屏向用户展示地图信息,即地图画面,以及向用户展示航拍获得的图像信息,即图传画面,用户还可以通过鼠标的操作,或者键盘的按键操作来控制无人飞行器的运动,或者,控制无人飞行器的云台方向,无人飞行器的云台相机的焦距等。User interaction devices include, but are not limited to: display screens, touch screens, speakers, mice, keyboards and other devices. For example, the first control terminal 200 may be equipped with a touch display screen, through which the user's remote control command to the unmanned aerial vehicle 100 is received and displayed map information to the user through the touch display screen, that is, a map screen, and to the user Display the image information obtained by aerial photography, that is, the image transmission screen. The user can also control the movement of the UAV through the operation of the mouse or the key operation of the keyboard, or control the direction of the gimbal of the UAV, and the gimbal of the UAV camera focal length etc.
在一些实施例中,第一控制端200为移动终端,与第一控制端200不同的是,第二控制端300为固定终端,第二控制端300的显示屏大于第一控制端200的显示屏,使得第二控制端300能够为用户提供全局视角。In some embodiments, the first control terminal 200 is a mobile terminal, and the difference from the first control terminal 200 is that the second control terminal 300 is a fixed terminal, and the display screen of the second control terminal 300 is larger than that of the first control terminal 200 screen, so that the second control terminal 300 can provide the user with a global perspective.
在一些实施例中,无线网络可以是基于任何类型的数据传输原理,用于建立两个节点之间的数据传输信道的无线通信网络,例如位于不同信号频段的蓝牙网络、WiFi网络、无线蜂窝网络或者其结合。In some embodiments, the wireless network can be a wireless communication network based on any type of data transmission principle for establishing a data transmission channel between two nodes, such as a Bluetooth network, a WiFi network, a wireless cellular network located in different signal frequency bands or a combination thereof.
下面结合说明书附图来说明本申请的技术方案:The technical scheme of the present application will be described below in conjunction with the accompanying drawings:
请参阅图2,图2是本申请实施例提供的一种远程控制方法的交互示意图;Please refer to FIG. 2, which is an interactive schematic diagram of a remote control method provided by an embodiment of the present application;
如图2所示,该远程控制方法的交互,包括:As shown in Figure 2, the interaction of the remote control method includes:
步骤S201:第二控制端发送远程控制请求指令;Step S201: the second control terminal sends a remote control request command;
具体的,第二控制端向第一控制端发送远程控制请求指令,其中,所述远程控制请求指令由用户向第二控制端输入指令生成,例如:用户在第二控制端的显示屏上点击连接第一控制端,使得第二控制端生成远程控制请求指令,并向第一控制端发送远程控制请求指令。Specifically, the second control terminal sends a remote control request instruction to the first control terminal, wherein the remote control request instruction is generated by the user inputting an instruction to the second control terminal, for example: the user clicks on the connection on the display screen of the second control terminal The first control terminal enables the second control terminal to generate a remote control request instruction and send the remote control request instruction to the first control terminal.
在本申请实施例中,第一控制端在接收第二控制端发送的远程控制请求指令之前,第一控制端与无人飞行器建立通信连接,例如:建立第一控制端与无人飞行器的第一通信管道,其中,所述第一通信管道用于第一控制端和无人飞行器之间的消息交互或命令交互或数据交互。In the embodiment of the present application, before the first control terminal receives the remote control request instruction sent by the second control terminal, the first control terminal establishes a communication connection with the unmanned aerial vehicle, for example: establishes the first control terminal and the unmanned aerial vehicle. A communication channel, wherein the first communication channel is used for message exchange or command exchange or data exchange between the first control terminal and the UAV.
步骤S202:第一控制端接收远程控制请求指令,生成远程控制确认指令;Step S202: the first control terminal receives a remote control request command, and generates a remote control confirmation command;
具体的,第一控制端接收第二控制端发送的远程控制请求指令,并在接收到所述远程控制请求指令之后,在第一控制端的显示界面中呈现相应的消息,由用户在第一控制端的显示界面中点击相应的确认按钮,生成远程控制确认指令。Specifically, the first control terminal receives the remote control request instruction sent by the second control terminal, and after receiving the remote control request instruction, presents a corresponding message on the display interface of the first control terminal, and the user Click the corresponding confirmation button on the display interface of the terminal to generate a remote control confirmation command.
步骤S203:第一控制端发送远程控制确认指令;Step S203: the first control terminal sends a remote control confirmation command;
具体的,第一控制端向第二控制端发送远程控制确认指令,其中,所述远程控制确认指令用于确认将无人飞行器的控制权转让给第二控制端,即由第二控制端对无人飞行器进行控制。Specifically, the first control terminal sends a remote control confirmation instruction to the second control terminal, wherein the remote control confirmation instruction is used to confirm that the control right of the unmanned aerial vehicle is transferred to the second control terminal, that is, the second control terminal The unmanned aerial vehicle takes control.
步骤S204:第二控制端接收远程控制确认指令;Step S204: the second control terminal receives the remote control confirmation instruction;
具体的,第二控制端接收第一控制端发送的远程控制确认指令,该远程控制确认指令用于第二控制端与无人飞行器建立通信连接,并且,无人飞行器向第二控制端开放其控制权,并暂停第一控制端的控制权,直至第一控制端重新获取无人飞行器的控制权。Specifically, the second control terminal receives the remote control confirmation command sent by the first control terminal, and the remote control confirmation command is used for the second control terminal to establish a communication connection with the unmanned aerial vehicle, and the unmanned aerial vehicle opens its control, and suspend the control of the first control terminal until the first control terminal regains the control of the unmanned aerial vehicle.
步骤S205:进入第二控制端的远程控制状态;Step S205: enter the remote control state of the second control terminal;
具体的,当第二控制端接收到远程控制确认指令之后,第一控制端将无 人飞行器的控制权转移到第二控制端,即进入第二控制端的远程控制状态,由第二控制端控制无人飞行器。Specifically, after the second control terminal receives the remote control confirmation instruction, the first control terminal transfers the control right of the unmanned aerial vehicle to the second control terminal, that is, enters the remote control state of the second control terminal, and is controlled by the second control terminal. unmanned aerial vehicle.
可以理解的是,在接收远程控制确认指令之前,第二控制端与无人飞行器之间已建立通信连接,例如:建立第二控制端与无人飞行器的第二通信管道,其中,所述第二通信管道用于第二控制端和无人飞行器之间的消息交互、命令交互或数据交互。It can be understood that, before receiving the remote control confirmation instruction, a communication connection has been established between the second control terminal and the unmanned aerial vehicle, for example: establishing a second communication channel between the second control terminal and the unmanned aerial vehicle, wherein the first The second communication channel is used for message exchange, command exchange or data exchange between the second control terminal and the UAV.
在本申请实施例中,第一通信管道和第二通信管道可以基于相同的通信协议,也可以基于不同的通信协议,例如:第一通信管道基于TCP网络协议,第二通信管道基于Netty网络协议。In this embodiment of the application, the first communication channel and the second communication channel may be based on the same communication protocol, or may be based on different communication protocols, for example: the first communication channel is based on the TCP network protocol, and the second communication channel is based on the Netty network protocol .
步骤S206:第二控制端进入远程控制界面;Step S206: the second control terminal enters the remote control interface;
具体的,当第二控制端与无人飞行器建立通信连接,并取得无人飞行器的控制权之后,第二控制端进入远程控制界面。Specifically, after the second control terminal establishes a communication connection with the UAV and obtains the control right of the UAV, the second control terminal enters the remote control interface.
步骤S207:第二控制端基于远程控制界面,对无人飞行器进行远程控制;Step S207: The second control terminal remotely controls the UAV based on the remote control interface;
具体的,所述远程控制界面用于对无人飞行器进行操控,例如:控制无人飞行器的飞行方向、控制无人飞行器的云台方向、控制无人飞行器的云台相机的焦距等,其中,具体的控制命令由用户通过操纵所述第二控制端生成,并发送到无人飞行器,使得无人飞行器执行该控制命令。Specifically, the remote control interface is used to control the unmanned aerial vehicle, for example: control the flight direction of the unmanned aerial vehicle, control the direction of the gimbal of the unmanned aerial vehicle, control the focal length of the gimbal camera of the unmanned aerial vehicle, etc., wherein, A specific control command is generated by the user by manipulating the second control terminal, and sent to the UAV, so that the UAV executes the control command.
下面以第一控制端为遥控器,第二控制端为PC端为例进行说明。The following takes the first control terminal as a remote control and the second control terminal as a PC as an example for illustration.
请再参阅图3,图3是本申请实施例提供的一种远程控制方法的流程示意图;Please refer to FIG. 3 again. FIG. 3 is a schematic flowchart of a remote control method provided by an embodiment of the present application;
其中,该远程控制方法的执行主体为第二控制端,在本申请实施例中,所述第二控制端包括终端设备,例如:计算机设备、PC端等与无人飞行器建立通信连接的电子设备。具体的,该远程控制方法的执行主体为第一控制端的一个或多个处理器。Wherein, the execution body of the remote control method is the second control terminal. In the embodiment of the present application, the second control terminal includes terminal equipment, such as computer equipment, PC terminal and other electronic equipment that establishes a communication connection with the unmanned aerial vehicle. . Specifically, the execution subject of the remote control method is one or more processors of the first control terminal.
如图3所示,该远程控制方法,包括:As shown in Figure 3, the remote control method includes:
步骤S301:第二控制端向所述第一控制端发送远程控制请求指令;Step S301: the second control terminal sends a remote control request command to the first control terminal;
具体的,第二控制端向第一控制端发送远程控制请求指令,其中,所述远程控制请求指令由用户向第二控制端输入指令生成,例如:用户在第二控制端的显示屏上点击连接第一控制端,使得第二控制端生成远程控制请求指令,并向第一控制端发送远程控制请求指令。Specifically, the second control terminal sends a remote control request instruction to the first control terminal, wherein the remote control request instruction is generated by the user inputting an instruction to the second control terminal, for example: the user clicks on the connection on the display screen of the second control terminal The first control terminal enables the second control terminal to generate a remote control request instruction and send the remote control request instruction to the first control terminal.
在本申请实施例中,第一控制端在接收第二控制端发送的远程控制请求指令之前,第一控制端与无人飞行器建立通信连接,例如:建立第一控制端与无人飞行器的第一通信管道,其中,所述第一通信管道用于第一控制端和无人飞行器之间的消息交互、命令交互或数据交互。In the embodiment of the present application, before the first control terminal receives the remote control request instruction sent by the second control terminal, the first control terminal establishes a communication connection with the unmanned aerial vehicle, for example: establishes the first control terminal and the unmanned aerial vehicle. A communication pipeline, wherein the first communication pipeline is used for message interaction, command interaction or data interaction between the first control terminal and the UAV.
步骤S302:第二控制端接收所述第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得所述无人飞行器处于第二控制端的远程控制状态;Step S302: the second control terminal receives the remote control confirmation instruction sent by the first control terminal, and establishes a communication connection with the UAV, so that the UAV is in the remote control state of the second control terminal;
具体的,第一控制端在接收到第二控制端发送的远程控制请求指令之后,于第一控制端的显示界面中呈现选择窗口,该选择窗口提供确认按键和取消按键,当用户点击该选择窗口中的确认按键之后,将生成远程控制确认指令,并向第二控制端发送该远程控制确认指令,使得第二控制端建立与无人飞行器的通信连接,以使所述无人飞行器处于第二控制端的远程控制状态;当用户点击该选择窗口中的取消按键之后,将生成远程控制取消指令,并向第二控制端发送该远程控制取消指令,此时无人飞行器仍然处于第一控制端的远程控制状态。Specifically, after receiving the remote control request command sent by the second control terminal, the first control terminal presents a selection window on the display interface of the first control terminal, and the selection window provides a confirmation button and a cancel button. When the user clicks on the selection window After the confirmation button in the button, a remote control confirmation command will be generated, and the remote control confirmation command will be sent to the second control terminal, so that the second control terminal establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the second The remote control status of the control terminal; when the user clicks the cancel button in the selection window, a remote control cancel command will be generated and sent to the second control terminal. At this time, the UAV is still in the remote control terminal of the first control terminal. control status.
在一些实施例中,当无人飞行器启动之后,建立与第一控制端和第二控制端的通信连接,并且,在第一控制端启动之后,无人飞行器默认处于第一控制端的远程控制状态。In some embodiments, after the UAV is started, a communication connection with the first control terminal and the second control terminal is established, and, after the first control terminal is started, the UAV is in the remote control state of the first control terminal by default.
步骤S303:第二控制端进入远程控制界面,基于所述远程控制界面,对所述无人飞行器进行远程控制,其中,所述第二控制端的显示界面大于第一控制端的显示界面。Step S303: the second control terminal enters the remote control interface, and remotely controls the UAV based on the remote control interface, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal.
请一并参阅图4a和图4b,其中,图4a是本申请实施例提供的一种第一 控制端的第一显示界面的示意图;Please refer to Figure 4a and Figure 4b together, wherein Figure 4a is a schematic diagram of a first display interface of a first control terminal provided by an embodiment of the present application;
图4b是本申请实施例提供的一种第二控制端的第二显示界面的示意图;Fig. 4b is a schematic diagram of a second display interface of a second control terminal provided by an embodiment of the present application;
例如:第一控制端为遥控器端,第二控制端为PC端,显然,PC端的显示屏幕大于遥控器端的显示屏幕,并且,如图4a所示,通常的遥控器端的第一显示界面中会呈现地图界面和图传界面,但是,由于遥控器端的显示屏幕大小有限,通常飞手需要切换地图界面和图传界面来更清晰地获取需要的视角,与之不同的是,PC端的显示屏幕较大,因此,PC端可以通过直观地呈现地图界面和图传界面来获取需要的视角,显然,PC端能够提供全局视角,因此,第二显示界面大于第一显示界面,使得无人飞行器的操控更为直观。For example: the first control terminal is the remote control terminal, and the second control terminal is the PC terminal. Obviously, the display screen of the PC terminal is larger than the display screen of the remote control terminal, and, as shown in Figure 4a, in the first display interface of the usual remote control terminal There will be a map interface and an image transmission interface. However, due to the limited size of the display screen on the remote control, usually the pilot needs to switch between the map interface and the image transmission interface to obtain the required viewing angle more clearly. The difference is that the display screen on the PC end Therefore, the PC end can obtain the required viewing angle by visually presenting the map interface and the image transmission interface. Obviously, the PC end can provide a global viewing angle. Therefore, the second display interface is larger than the first display interface, making the unmanned aerial vehicle Controls are more intuitive.
进一步地,所述第二控制端包括一操作台,该操作台用于控制所述无人飞行器的飞行方向。Further, the second control end includes an operation console, which is used to control the flight direction of the UAV.
请再参阅图5,图5是本申请实施例提供的一种第二控制端的示意图;Please refer to FIG. 5 again. FIG. 5 is a schematic diagram of a second control terminal provided by an embodiment of the present application;
如图5所示,该第二控制端300,包括:操作台310,其中,该操作台包括多个按键311,例如:该操作台310为键盘,键盘包括多个按键311,其中,每一按键被赋予特定的操作功能。As shown in FIG. 5 , the second control terminal 300 includes: an operation console 310, wherein the operation console includes a plurality of buttons 311, for example: the operation console 310 is a keyboard, and the keyboard includes a plurality of buttons 311, wherein each Keys are assigned specific operating functions.
具体的,所述对所述无人飞行器进行远程控制,包括:Specifically, the remote control of the unmanned aerial vehicle includes:
基于所述操作台预设的操作方式,对所述无人飞行器进行远程控制。The unmanned aerial vehicle is remotely controlled based on the preset operation mode of the operating console.
在本申请实施例中,所述操作台包括:键盘,所述预设的操作方式,包括:预设的按键操作,其中,每一按键对应一个按键操作,所述基于所述操作台预设的操作方式,对所述无人飞行器进行远程控制,包括:In the embodiment of the present application, the console includes: a keyboard, and the preset operation mode includes: preset button operations, wherein each button corresponds to a button operation, and the preset operation method based on the console The mode of operation is to remotely control the unmanned aerial vehicle, including:
基于预设的按键,获取按键操作命令,控制所述无人飞行器的飞行方向。Based on the preset keys, key operation commands are obtained to control the flight direction of the UAV.
具体的,所述基于预设的按键,获取按键操作命令,控制所述无人飞行器的飞行方向,包括:Specifically, the said key operation command is obtained based on the preset key, and the flight direction of the unmanned aerial vehicle is controlled, including:
根据所述预设的按键对应的按键操作,生成按键操作命令,并将所述按键操作命令发送到所述无人飞行器,以控制所述无人飞行器的飞行方向,其中,所述预设的按键,包括:上升按键,用于控制所述无人飞行器上升;下 降按键,用于控制所述无人飞行器下降;左转按键,用于控制所述无人飞行器左转;右转按键,用于控制所述无人飞行器右转;向前按键,用于控制所述无人飞行器前飞;向后按键,用于控制所述无人飞行器后飞;向左按键,用于控制所述无人飞行器左飞;向右按键,用于控制所述无人飞行器右飞。According to the button operation corresponding to the preset button, a button operation command is generated, and the button operation command is sent to the UAV to control the flight direction of the UAV, wherein the preset Buttons, including: an up button, used to control the unmanned aerial vehicle to rise; a down button, used to control the unmanned aerial vehicle to descend; a left turn button, used to control the unmanned aerial vehicle to turn left; a right turn button, used to For controlling the unmanned aerial vehicle to turn right; the forward button is used to control the unmanned aerial vehicle to fly forward; the backward button is used to control the unmanned aerial vehicle to fly backward; the left button is used to control the unmanned aerial vehicle The unmanned aerial vehicle flies left; the right key is used to control the unmanned aerial vehicle to fly right.
例如:键盘包括W键、A键、S键以及D键,还包括↑、↓、←、→四个按键,其中,W键为上升按键,A键为下降按键,S键为左转按键,D键为右转按键,↑键为向前按键,↓键为向后按键,←为向左按键,→为向右按键,当用户点击上述任意一个按键时,第二控制端将生成对应的按键操作命令,并将所述按键操作命令发送到无人飞行器,以控制无人飞行器的飞行方向,例如:当用户点击W键时,第二控制端生成上升操作命令,并将上升操作命令发送到无人飞行器,控制无人飞行器进行上升。For example: the keyboard includes W key, A key, S key and D key, and also includes ↑, ↓, ←, → four keys, wherein, the W key is the ascending key, the A key is the descending key, and the S key is the left turn key. The D key is the right turn key, the ↑ key is the forward key, the ↓ key is the backward key, the ← is the left key, and the → is the right key. When the user clicks any of the above keys, the second control terminal will generate the corresponding key operation command, and send the key operation command to the unmanned aerial vehicle to control the flight direction of the unmanned aerial vehicle, for example: when the user clicks the W key, the second control terminal generates an ascending operation command, and sends the ascending operation command Go to the unmanned aerial vehicle and control the unmanned aerial vehicle to ascend.
在本申请实施例中,在第二控制端向所述第一控制端发送远程控制请求指令之前,所述方法还包括:In the embodiment of the present application, before the second control terminal sends a remote control request instruction to the first control terminal, the method further includes:
第二控制端获取远程控制界面指令;The second control terminal obtains the remote control interface instruction;
第二控制端根据所述远程控制界面指令,控制所述第二控制端的显示界面进入远程控制界面。The second control terminal controls the display interface of the second control terminal to enter the remote control interface according to the remote control interface instruction.
具体的,请再参阅图6,图6是本申请实施例提供的一种远程控制方法的PC端和遥控器端的交互流程示意图;Specifically, please refer to FIG. 6 again. FIG. 6 is a schematic diagram of an interaction process between the PC end and the remote control end of a remote control method provided by an embodiment of the present application;
如图6所示,该远程控制方法的PC端和遥控器端的交互流程,包括:As shown in Figure 6, the interaction process between the PC end and the remote control end of the remote control method includes:
步骤S601:获取远程控制界面指令;Step S601: Acquiring remote control interface instructions;
具体的,在PC端开始之后,将进入直播画面,其中,该直播画面呈现所有无人飞行器的图传画面。在直播画面中,当获取到远程控制界面指令之后,将进入远程控制画面,其中,所述远程控制界面指令由用户点击某一无人飞行器对应的第一画面位置触发,无人飞行器对应的第一画面位置处于直播画面中。Specifically, after the PC end starts, it will enter the live broadcast screen, wherein the live broadcast screen presents the image transmission screens of all unmanned aerial vehicles. In the live broadcast screen, after the remote control interface command is obtained, the remote control screen will be entered, wherein the remote control interface command is triggered by the user clicking on the first screen position corresponding to an unmanned aerial vehicle, and the first screen position corresponding to the unmanned aerial vehicle is triggered. A screen position is in the live screen.
步骤S602:进入远程控制界面;Step S602: enter the remote control interface;
具体的,当进入某一无人飞行器的远程控制界面之后,意味着该无人飞行器进入PC端的远程控制状态,此时可以通过PC端控制无人飞行器。Specifically, after entering the remote control interface of a certain unmanned aerial vehicle, it means that the unmanned aerial vehicle enters the remote control state of the PC terminal, and at this time, the unmanned aerial vehicle can be controlled through the PC terminal.
步骤S603:通过键盘控制飞行方向;Step S603: Control the flight direction through the keyboard;
具体的,通过PC端的键盘控制无人飞行器的飞行方向。Specifically, the flight direction of the UAV is controlled through the keyboard on the PC side.
步骤S604:接收远程控制退出指令;Step S604: receiving a remote control exit instruction;
具体的,若PC端接收到某一无人飞行器的远程控制退出指令,则退出该无人飞行器的远程控制界面,其中,该远程控制退出指令由用户点击某一无人飞行器对应的第二画面位置触发,其中,无人飞行器对应的第二画面位置位于远程控制界面中。Specifically, if the PC end receives a remote control exit command of an unmanned aerial vehicle, then exit the remote control interface of the unmanned aerial vehicle, wherein the remote control exit instruction is clicked by the user on the second screen corresponding to a certain unmanned aerial vehicle Position triggering, wherein the position of the second screen corresponding to the unmanned aerial vehicle is located in the remote control interface.
步骤S605:退出远程控制界面;Step S605: exit the remote control interface;
步骤S606:接收远程控制提示信息;Step S606: receiving remote control prompt information;
具体的,当PC端向遥控器端发送远程控制请求指令之后,遥控器端接收远程控制请求指令,并在遥控器端的显示界面中呈现远程控制提示信息,用于提示飞手是否接受远程控制。Specifically, after the PC sends a remote control request instruction to the remote controller, the remote controller receives the remote control request instruction, and presents a remote control prompt message on the display interface of the remote controller, which is used to prompt the pilot whether to accept the remote control.
步骤S607:是否接受远程控制?Step S607: Accept remote control?
具体的,判断遥控器端是否接受远程控制,若是,则PC端进入远程控制界面;若否,则遥控器端向PC端发送拒绝指令;其中,遥控器端是否接受远程控制由遥控器端的飞手进行控制,若飞手选择确定指令,则确定遥控器端接受远程控制;若飞手选择取消指令,则确定遥控器端拒绝远程控制。Specifically, it is judged whether the remote control end accepts remote control, and if so, the PC end enters the remote control interface; if not, the remote control end sends a rejection command to the PC end; If the pilot chooses to confirm the command, it is confirmed that the remote control terminal accepts the remote control; if the pilot chooses to cancel the command, it is determined that the remote control terminal rejects the remote control.
步骤S608:被PC端远程控制中;Step S608: being remotely controlled by the PC;
具体的,当无人飞行器处于PC端的远程控制状态,此时飞手可以通过点击退出键,使得无人飞行器退出PC端的远程控制状态,返回到遥控器端的远程控制状态。Specifically, when the UAV is in the remote control state at the PC end, the pilot can click the exit button to make the UAV exit the remote control state at the PC end and return to the remote control state at the remote control end.
步骤S609:退出远程控制;Step S609: exit the remote control;
具体的,PC端退出远程控制,由遥控器端对无人飞行器进行远程控制。Specifically, the PC end exits the remote control, and the UAV is remotely controlled by the remote control end.
在本申请实施例中,所述第二控制端通信连接多个无人飞行器,所述方 法还包括:In the embodiment of the present application, the second control terminal communicates with a plurality of unmanned aerial vehicles, and the method also includes:
在所述远程控制界面中,生成每一无人飞行器一一对应的直播窗口;In the remote control interface, generate a one-to-one live broadcast window for each unmanned aerial vehicle;
响应于对直播窗口的操作,控制所述直播窗口对应的无人飞行器处于第二控制端的远程控制状态。In response to the operation on the live broadcast window, the unmanned aerial vehicle corresponding to the live broadcast window is controlled to be in the remote control state of the second control terminal.
具体的,请参阅图7,图7是本申请实施例提供的一种第二控制端的远程控制界面的示意图;Specifically, please refer to FIG. 7, which is a schematic diagram of a remote control interface of a second control terminal provided by an embodiment of the present application;
如图7所示,远程控制界面中包括地图界面和图传界面,当每一无人飞行器与第二控制端建立通信连接之后,于第二控制端的远程控制界面呈现该无人飞行器对应的直播窗口,例如:第一无人飞行器、第二无人飞行器、第三无人飞行器、第四无人飞行器、第五无人飞行器、第六无人飞行器,……,第N无人飞行器的直播窗口。As shown in Figure 7, the remote control interface includes a map interface and an image transmission interface. After each unmanned aerial vehicle establishes a communication connection with the second control terminal, the remote control interface of the second control terminal presents the live broadcast corresponding to the unmanned aerial vehicle. Window, for example: the first UAV, the second UAV, the third UAV, the fourth UAV, the fifth UAV, the sixth UAV, ..., the live broadcast of the Nth UAV window.
其中,当某一无人飞行器处于第二控制端的远程控制状态时,将该无人飞行器对应的直播窗口转换为控制窗口,例如:控制第二控制端的远程控制界面呈现该无人飞行器的图传界面,例如:当第一无人飞行器处于第二控制端的远程控制状态时,控制第二控制端的远程控制界面呈现第一无人飞行器的图传界面。Wherein, when an unmanned aerial vehicle is in the remote control state of the second control terminal, the live broadcast window corresponding to the unmanned aerial vehicle is converted into a control window, for example: controlling the remote control interface of the second control terminal to present the image transmission of the unmanned aerial vehicle Interface, for example: when the first unmanned aerial vehicle is in the remote control state of the second control terminal, the remote control interface controlling the second control terminal presents the image transmission interface of the first unmanned aerial vehicle.
进一步地,当需要切换某一无人飞行器的图传界面时,用户点击该无人飞行器对应的直播窗口,第二控制端响应于对直播窗口的点击操作,向第一控制端发送远程控制请求指令,在接收到第一控制端发送的远程控制确认指令之后,控制所述直播窗口对应的无人飞行器处于第二控制端的远程控制状态,并且,将所述直播窗口转换为控制窗口,例如:将远程控制界面中图传界面切换为该无人飞行器的图传界面,例如:将第一无人飞行器的图传界面切换为第二无人飞行器的图传界面。Further, when it is necessary to switch the image transmission interface of a certain unmanned aerial vehicle, the user clicks the live window corresponding to the unmanned aerial vehicle, and the second control terminal sends a remote control request to the first control terminal in response to the click operation on the live window Instruction, after receiving the remote control confirmation instruction sent by the first control terminal, control the unmanned aerial vehicle corresponding to the live broadcast window to be in the remote control state of the second control terminal, and convert the live broadcast window into a control window, for example: Switch the image transmission interface in the remote control interface to the image transmission interface of the UAV, for example: switch the image transmission interface of the first UAV to the image transmission interface of the second UAV.
在本申请实施例中,通过提供一种远程控制方法,该远程控制方法,应用于无人飞行器,无人飞行器通信连接第一控制端,第一控制端通信连接第二控制端,该方法包括:第二控制端向第一控制端发送远程控制请求指令; 第二控制端接收第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得无人飞行器处于第二控制端的远程控制状态;第二控制端进入远程控制界面,基于远程控制界面,对无人飞行器进行远程控制,其中,第二控制端的显示界面大于第一控制端的显示界面。通过第二控制端进入远程控制界面来控制无人飞行器,而第二控制端的显示界面大于第一控制端的显示界面,因此,本申请能够提高无人飞行器的调度效率。In the embodiment of the present application, by providing a remote control method, the remote control method is applied to an unmanned aerial vehicle, the unmanned aerial vehicle communicates with the first control terminal, and the first control terminal communicates with the second control terminal, the method includes : the second control terminal sends a remote control request command to the first control terminal; the second control terminal receives the remote control confirmation command sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the second control The remote control state of the terminal; the second control terminal enters the remote control interface, and based on the remote control interface, remotely controls the unmanned aerial vehicle, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal. The unmanned aerial vehicle is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the unmanned aerial vehicle.
请再参阅图8,图8是本申请实施例提供的另一种远程控制方法的流程示意图;Please refer to FIG. 8 again. FIG. 8 is a schematic flowchart of another remote control method provided by the embodiment of the present application;
其中,该远程控制方法的执行主体为第一控制端,所述第一控制端包括遥控设备,遥控设备包括智能终端,例如:手机、平板电脑或者智能遥控器等移动终端。具体的,该远程控制方法的执行主体为第一控制端的一个或多个处理器。Wherein, the execution subject of the remote control method is the first control terminal, and the first control terminal includes a remote control device, and the remote control device includes a smart terminal, such as a mobile terminal such as a mobile phone, a tablet computer, or a smart remote control. Specifically, the execution subject of the remote control method is one or more processors of the first control terminal.
如图8所示,该远程控制方法,包括:As shown in Figure 8, the remote control method includes:
步骤S801:在无人飞行器处于第一控制端的远程控制状态时,第一控制端接收第二控制端发送的远程控制请求指令;Step S801: When the UAV is in the remote control state of the first control terminal, the first control terminal receives the remote control request command sent by the second control terminal;
具体的,当第一控制端开机之后,将自动通信连接与其匹配的无人飞行器,使得该无人飞行器处于第一控制端的远程控制状态,在无人飞行器处于第一控制端的远程控制状态时,若第二控制端需要请求无人飞行器的控制权,则第二控制端向第一控制端发送远程控制请求指令,第一控制端接收第二控制端发送的远程控制请求指令。Specifically, after the first control terminal is turned on, it will automatically communicate with the matching unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the first control terminal. When the unmanned aerial vehicle is in the remote control state of the first control terminal, If the second control terminal needs to request the control right of the UAV, the second control terminal sends a remote control request command to the first control terminal, and the first control terminal receives the remote control request command sent by the second control terminal.
步骤S802:第一控制端接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态;Step S802: the first control terminal receives the remote control confirmation instruction, and sends the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal;
具体的,当第一控制端接收到第二控制端发送的远程控制请求指令之后,响应于第一控制端的显示界面的操作,生成远程控制确认指令,由处理器接收该远程控制确认指令,其中,该第一控制端的显示界面呈现远程控制提示 信息,用于提示飞手是否接收远程控制,若飞手选择确定指令,则确定生成远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,由第二控制端获取无人飞行器的控制权,使得无人飞行器进入第二控制端的远程控制状态。Specifically, after the first control terminal receives the remote control request instruction sent by the second control terminal, it generates a remote control confirmation instruction in response to the operation of the display interface of the first control terminal, and the processor receives the remote control confirmation instruction, wherein , the display interface of the first control terminal presents remote control prompt information, which is used to prompt the pilot whether to accept the remote control. If the pilot chooses to confirm the command, it is determined to generate a remote control confirmation command, and the remote control confirmation command is sent to all The second control terminal is used to obtain the control right of the unmanned aerial vehicle, so that the unmanned aerial vehicle enters the remote control state of the second control terminal.
在本申请实施例中,所述方法还包括:In the embodiment of the present application, the method further includes:
接收远程控制中断指令,控制所述无人飞行器由第二远程控制状态切换到第一远程控制状态,其中,所述第一远程控制状态为所述第一控制端远程控制所述无人飞行器,所述第二远程控制状态为所述第二控制端远程控制所述无人飞行器。receiving a remote control interruption command, controlling the unmanned aerial vehicle to switch from the second remote control state to the first remote control state, wherein the first remote control state is that the first control terminal remotely controls the unmanned aerial vehicle, The second remote control state is that the second control terminal remotely controls the UAV.
具体的,当无人飞行器处于第一控制端的远程控制状态时,确定该无人飞行器处于第一远程控制状态;当无人飞行器处于第二控制端的远程控制状态时,确定该无人飞行器处于第二远程控制状态;Specifically, when the UAV is in the remote control state of the first control terminal, it is determined that the UAV is in the first remote control state; when the UAV is in the remote control state of the second control terminal, it is determined that the UAV is in the first remote control state. Two remote control status;
当所述无人飞行器处于第二远程控制状态时,接收远程控制中断指令,其中,该远程控制中断指令由第一控制端的显示界面触发,例如:飞手点击第一控制端的显示界面的中断按钮,使得所述无人飞行器由第二远程控制状态切换到第一远程控制状态,相当于将无人飞行器的控制权由第二控制端切换回第一控制端,其中,第一控制端的显示界面小于第二控制端的显示界面。When the unmanned aerial vehicle is in the second remote control state, a remote control interruption instruction is received, wherein the remote control interruption instruction is triggered by the display interface of the first control terminal, for example: the pilot clicks the interruption button of the display interface of the first control terminal , so that the unmanned aerial vehicle is switched from the second remote control state to the first remote control state, which is equivalent to switching the control right of the unmanned aerial vehicle from the second control terminal back to the first control terminal, wherein the display interface of the first control terminal Smaller than the display interface of the second console.
在本申请实施例中,通过提供一种远程控制方法,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述方法包括:在无人飞行器处于第一控制端的远程控制状态时,第一控制端接收第二控制端发送的远程控制请求指令;第一控制端接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态。通过接收第二控制端发送的远程控制请求指令,并将发送远程控制确认指令到第二控制端,使得无人飞行器进入第二控制端的远程控制状态,本申请能够提高无人飞行器的调度效率。In the embodiment of the present application, by providing a remote control method applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to the first control terminal by communication, and the first control terminal is connected to the second control terminal by communication, the method includes : When the unmanned aerial vehicle is in the remote control state of the first control terminal, the first control terminal receives the remote control request command sent by the second control terminal; the first control terminal receives the remote control confirmation command, and sends the remote control confirmation command to the second control terminal, so that the unmanned aerial vehicle enters the remote control state of the second control terminal. By receiving the remote control request command sent by the second control terminal, and sending the remote control confirmation command to the second control terminal, the UAV enters the remote control state of the second control terminal, and the application can improve the scheduling efficiency of the UAV.
需要说明的是,在上述各个实施例中,上述各步骤之间并不必然存在一 定的先后顺序,本领域普通技术人员,根据本申请实施例的描述可以理解,不同实施例中,上述各步骤可以有不同的执行顺序,亦即,可以并行执行,亦可以交换执行等等。It should be noted that, in each of the above-mentioned embodiments, there is not necessarily a certain sequence between the above-mentioned steps. Those of ordinary skill in the art can understand from the description of the embodiments of the present application that in different embodiments, the above-mentioned steps There can be different execution orders, that is, they can be executed in parallel, they can be executed interchangeably, and so on.
请再参阅图9,图9是本申请实施例提供的一种远程控制装置的结构示意图;Please refer to FIG. 9 again. FIG. 9 is a schematic structural diagram of a remote control device provided by an embodiment of the present application;
其中,该远程控制装置应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端。Wherein, the remote control device is applied to an unmanned aerial vehicle, and the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication.
如图9所示,该远程控制装置90,包括:As shown in Figure 9, the remote control device 90 includes:
远程控制请求指令发送单元901,用于向所述第一控制端发送远程控制请求指令;A remote control request instruction sending unit 901, configured to send a remote control request instruction to the first control terminal;
远程控制状态单元902,用于接收所述第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得所述无人飞行器处于第二控制端的远程控制状态;The remote control state unit 902 is configured to receive the remote control confirmation instruction sent by the first control terminal, and establish a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
远程控制界面单元903,用于进入远程控制界面,基于所述远程控制界面,对所述无人飞行器进行远程控制,其中,所述第二控制端的屏幕大于第一控制端的屏幕。The remote control interface unit 903 is configured to enter a remote control interface, and remotely control the UAV based on the remote control interface, wherein the screen of the second control terminal is larger than the screen of the first control terminal.
在本申请实施例中,通过第二控制端进入远程控制界面来控制无人飞行器,而第二控制端的显示界面大于第一控制端的显示界面,因此,本申请能够提高无人飞行器的调度效率。In the embodiment of the present application, the UAV is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the UAV.
需要说明的是,上述远程控制装置可执行本申请实施例所提供的远程控制方法,具备执行方法相应的功能模块和有益效果。未在远程控制装置实施例中详尽描述的技术细节,可参见本申请实施例所提供的远程控制方法。It should be noted that the above-mentioned remote control device can execute the remote control method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in the embodiment of the remote control device, refer to the remote control method provided in the embodiment of the present application.
请再参阅图10,图10是本申请实施例提供的另一种远程控制装置的结构示意图;Please refer to FIG. 10 again. FIG. 10 is a schematic structural diagram of another remote control device provided by an embodiment of the present application;
其中,该远程控制装置应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端。Wherein, the remote control device is applied to an unmanned aerial vehicle, and the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication.
如图10所示,该远程控制装置10,包括:As shown in Figure 10, the remote control device 10 includes:
远程控制请求指令接收单元101,用于在无人飞行器处于第一控制端的远程控制状态时,接收第二控制端发送的远程控制请求指令;The remote control request instruction receiving unit 101 is used to receive the remote control request instruction sent by the second control terminal when the unmanned aerial vehicle is in the remote control state of the first control terminal;
远程控制状态单元102,用于接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态。The remote control state unit 102 is configured to receive a remote control confirmation instruction, and send the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
在本申请实施例中,通过接收第二控制端发送的远程控制请求指令,并将发送远程控制确认指令到第二控制端,使得无人飞行器进入第二控制端的远程控制状态,本申请能够提高无人飞行器的调度效率。In the embodiment of the present application, by receiving the remote control request command sent by the second control terminal, and sending the remote control confirmation command to the second control terminal, so that the unmanned aerial vehicle enters the remote control state of the second control terminal, the present application can improve Scheduling Efficiency for Unmanned Aerial Vehicles.
需要说明的是,上述远程控制装置可执行本申请实施例所提供的远程控制方法,具备执行方法相应的功能模块和有益效果。未在远程控制装置实施例中详尽描述的技术细节,可参见本申请实施例所提供的远程控制方法。It should be noted that the above-mentioned remote control device can execute the remote control method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in the embodiment of the remote control device, refer to the remote control method provided in the embodiment of the present application.
请参阅图11,图11是本申请实施例提供的一种第一控制端的结构示意图;Please refer to FIG. 11, which is a schematic structural diagram of a first control terminal provided by an embodiment of the present application;
如图11所示,该第一控制端110包括但不限于:射频单元111、网络模块112、音频输出单元113、输入单元114、传感器115、显示单元116、用户输入单元117、接口单元118、存储器119、处理器1110、以及电源1111等部件,所述第一控制端110还包括摄像头。本领域技术人员可以理解,图11中示出的第一控制端的结构并不构成对第一控制端的限定,第一控制端可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。在本申请实施例中,第一控制端包括但不限于手机、平板电脑或者智能遥控器等移动终端。As shown in Figure 11, the first control terminal 110 includes, but is not limited to: a radio frequency unit 111, a network module 112, an audio output unit 113, an input unit 114, a sensor 115, a display unit 116, a user input unit 117, an interface unit 118, Memory 119, processor 1110, power supply 1111 and other components, the first control terminal 110 also includes a camera. Those skilled in the art can understand that the structure of the first control terminal shown in Figure 11 does not constitute a limitation on the first control terminal, and the first control terminal may include more or less components than shown in the figure, or combine some components , or different component arrangements. In the embodiment of the present application, the first control terminal includes, but is not limited to, mobile terminals such as mobile phones, tablet computers, or smart remote controls.
处理器1110,用于第二控制端向第一控制端发送远程控制请求指令;第二控制端接收第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得无人飞行器处于第二控制端的远程控制状态;第二控制端进入远程控制界面,基于远程控制界面,对无人飞行器进行远程控制,其中,第二控制端的显示界面大于第一控制端的显示界面。The processor 1110 is used for the second control terminal to send a remote control request command to the first control terminal; the second control terminal receives the remote control confirmation command sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle The aircraft is in the remote control state of the second control terminal; the second control terminal enters the remote control interface to remotely control the UAV based on the remote control interface, wherein the display interface of the second control terminal is larger than that of the first control terminal.
在本申请实施例中,通过第二控制端进入远程控制界面来控制无人飞行器,而第二控制端的显示界面大于第一控制端的显示界面,因此,本申请能够提高无人飞行器的调度效率。In the embodiment of the present application, the UAV is controlled by entering the remote control interface through the second control terminal, and the display interface of the second control terminal is larger than that of the first control terminal. Therefore, the application can improve the scheduling efficiency of the UAV.
应当理解的是,本申请实施例中,射频单元111可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器1110处理;另外,将上行的数据发送给基站。通常,射频单元111包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元111还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present application, the radio frequency unit 111 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 1110; Uplink data is sent to the base station. Generally, the radio frequency unit 111 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 111 can also communicate with the network and other devices through a wireless communication system.
第一控制端110通过网络模块112为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The first control terminal 110 provides users with wireless broadband Internet access through the network module 112 , such as helping users send and receive emails, browse web pages, and access streaming media.
音频输出单元113可以将射频单元111或网络模块112接收的或者在存储器119中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元113还可以提供与第一控制端110执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元113包括扬声器、蜂鸣器以及受话器等。The audio output unit 113 may convert audio data received by the radio frequency unit 111 or the network module 112 or stored in the memory 119 into an audio signal and output as sound. Moreover, the audio output unit 113 may also provide audio output related to a specific function performed by the first control terminal 110 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 113 includes a speaker, a buzzer, a receiver, and the like.
输入单元114用于接收音频或视频信号。输入单元114可以包括图形处理器(Graphics Processing Unit,GPU)1141和麦克风1142,图形处理器1141对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的目标图像进行处理。处理后的图像帧可以显示在显示单元116上。经图形处理器1141处理后的图像帧可以存储在存储器119(或其它存储介质)中或者经由射频单元111或网络模块112进行发送。麦克风1142可以接收声音,并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元111发送到移动通信基站的格式输出。The input unit 114 is used to receive audio or video signals. The input unit 114 can include a graphics processor (Graphics Processing Unit, GPU) 1141 and a microphone 1142, and the graphics processor 1141 can target still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The image is processed. The processed image frames may be displayed on the display unit 116 . The image frames processed by the graphics processor 1141 may be stored in the memory 119 (or other storage media) or sent via the radio frequency unit 111 or the network module 112 . The microphone 1142 can receive sound and can process such sound into audio data. The processed audio data may be converted into a format transmittable to a mobile communication base station via the radio frequency unit 111 for output in case of a phone call mode.
第一控制端110还包括至少一种传感器115,比如光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中, 环境光传感器可根据环境光线的明暗来调节显示面板1161的亮度,接近传感器可在第一控制端110移动到耳边时,关闭显示面板1161和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别第一控制端姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器115还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。The first control terminal 110 also includes at least one sensor 115, such as a light sensor, a motion sensor and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1161 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel when the first control terminal 110 moves to the ear. 1161 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the attitude of the first control terminal (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, knocking), etc.; sensor 115 can also include fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, Thermometers, infrared sensors, etc., will not be repeated here.
显示单元116用于显示由用户输入的信息或提供给用户的信息。显示单元116可包括显示面板1161,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板1161。The display unit 116 is used to display information input by the user or information provided to the user. The display unit 116 may include a display panel 1161, and the display panel 1161 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
用户输入单元117可用于接收输入的数字或字符信息,以及产生与第一控制端的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元117包括触控面板1171以及其他输入设备1172。触控面板1171,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板1171上或在触控面板1171附近的操作)。触控面板1171可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器1110,接收处理器1110发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板1171。除了触控面板1171,用户输入单元117还可以包括其他输入设备1172。具体地,其他输入设备1172可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。The user input unit 117 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the first control terminal. Specifically, the user input unit 117 includes a touch panel 1171 and other input devices 1172 . The touch panel 1171, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1171 or near the touch panel 1171). operate). The touch panel 1171 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 1110, receive the command sent by the processor 1110 and execute it. In addition, the touch panel 1171 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1171 , the user input unit 117 may also include other input devices 1172 . Specifically, other input devices 1172 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
进一步的,触控面板1171可覆盖在显示面板1161上,当触控面板1171 检测到在其上或附近的触摸操作后,传送给处理器1110以确定触摸事件的类型,随后处理器1110根据触摸事件的类型在显示面板1161上提供相应的视觉输出。虽然在图11中,触控面板1171与显示面板1161是作为两个独立的部件来实现第一控制端的输入和输出功能,但是在某些实施例中,可以将触控面板1171与显示面板1161集成而实现第一控制端的输入和输出功能,具体此处不做限定。Furthermore, the touch panel 1171 can be covered on the display panel 1161, and when the touch panel 1171 detects a touch operation on or near it, it will be sent to the processor 1110 to determine the type of the touch event, and then the processor 1110 will The type of event provides a corresponding visual output on the display panel 1161 . Although in FIG. 11 , the touch panel 1171 and the display panel 1161 are used as two independent components to realize the input and output functions of the first control terminal, in some embodiments, the touch panel 1171 and the display panel 1161 can be combined The input and output functions of the first control terminal are realized through integration, which is not specifically limited here.
接口单元118为外部装置与第一控制端110连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元118可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到第一控制端110内的一个或多个元件或者可以用于在第一控制端110和外部装置之间传输数据。The interface unit 118 is an interface for connecting an external device to the first control terminal 110 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 118 may be used to receive input from an external device (for example, data information, power, etc.) and transmit the received input to one or more elements in the first control terminal 110 or may be used to Data is transferred between the terminal 110 and an external device.
存储器119可用于存储软件程序以及各种数据。存储器119可主要包括存储程序区和存储数据区,其中,存储程序区可存储至少一个功能所需的应用程序1191(比如声音播放功能、图像播放功能等)以及操作系统1192等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器119可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 119 can be used to store software programs as well as various data. Storer 119 can mainly comprise storage program area and storage data area, wherein, storage program area can store the required application program 1191 (such as sound playback function, image playback function etc.) and operating system 1192 etc. of at least one function; Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone. In addition, the memory 119 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
处理器1110是第一控制端的控制中心,利用各种接口和线路连接整个第一控制端的各个部分,通过运行或执行存储在存储器119内的软件程序和/或模块,以及调用存储在存储器119内的数据,执行第一控制端的各种功能和处理数据,从而对第一控制端进行整体监控。处理器1110可包括一个或多个处理单元;在本申请实施例中,处理器1110可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制 解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1110中。The processor 1110 is the control center of the first control terminal, which uses various interfaces and lines to connect various parts of the entire first control terminal, and runs or executes the software programs and/or modules stored in the memory 119, and calls the software programs stored in the memory 119. data, execute various functions of the first control terminal and process data, so as to monitor the first control terminal as a whole. The processor 1110 may include one or more processing units; in the embodiment of the present application, the processor 1110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1110 .
第一控制端110还可以包括给各个部件供电的电源1111(比如电池),在本申请实施例中,电源1111可以通过电源管理系统与处理器1110逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The first control terminal 110 can also include a power supply 1111 (such as a battery) for supplying power to various components. In the embodiment of the present application, the power supply 1111 can be logically connected to the processor 1110 through the power management system, so as to realize management charging, Discharge, and power management functions.
另外,第一控制端110包括一些未示出的功能模块,在此不再赘述。In addition, the first control terminal 110 includes some functional modules not shown, which will not be repeated here.
本申请实施例还提供一种第一控制端,包括处理器1110,存储器119,存储在存储器119上并可在所述处理器1110上运行的计算机程序,该计算机程序被处理器1110执行时实现上述远程控制方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application also provides a first control terminal, including a processor 1110, a memory 119, and a computer program stored in the memory 119 and operable on the processor 1110, and the computer program is implemented when executed by the processor 1110. The various processes of the above remote control method embodiment can achieve the same technical effect, so in order to avoid repetition, details are not repeated here.
请参阅图12,图12是本申请实施例提供的一种第二控制端的结构示意图;Please refer to FIG. 12, which is a schematic structural diagram of a second control terminal provided by an embodiment of the present application;
如图12所示,该第二控制端120,包括:处理器121、存储器122和通信模块123。其中,所述处理器121、存储器122以及通信模块123之间通过总线的方式,建立任意两者之间的通信连接。As shown in FIG. 12 , the second control terminal 120 includes: a processor 121 , a memory 122 and a communication module 123 . Wherein, the processor 121 , the memory 122 and the communication module 123 establish any communication connection between them through a bus.
处理器121可以为任何类型,具备一个或者多个处理核心的处理器。其可以执行单线程或者多线程的操作,用于解析指令以执行获取数据、执行逻辑运算功能以及下发运算处理结果等操作。The processor 121 can be any type of processor with one or more processing cores. It can perform single-threaded or multi-threaded operations, and is used to parse instructions to perform operations such as obtaining data, performing logical operation functions, and delivering operation processing results.
存储器122作为一种非暂态计算机可读存储介质,可用于存储非暂态软件程序、非暂态性计算机可执行程序以及模块,如本申请实施例中的远程控制方法对应的程序指令/模块。处理器121通过运行存储在存储器122中的非暂态软件程序、指令以及模块,从而实现上述方法实施例中远程控制方法。The memory 122, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/modules corresponding to the remote control method in the embodiment of the present application . The processor 121 executes the non-transitory software programs, instructions and modules stored in the memory 122 to implement the remote control method in the above method embodiments.
存储器122可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储根据远程控制装置的使用所创建的数据等。此外,存储器122可以包括高速随机存取存储器,还可以包括非暂态存储器,例如至少一个磁盘存储器件、闪存器件、或其他非暂态固态存储器件。在一些实施例中,存储器122可选包括相对于 处理器121远程设置的存储器,这些远程存储器可以通过网络连接至无人飞行器。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 122 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the remote control device, and the like. In addition, the memory 122 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory 122 may optionally include memory located remotely from the processor 121, and these remote memories may be connected to the UAV via a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
所述存储器122存储有可被所述至少一个处理器121执行的指令;所述至少一个处理器121用于执行所述指令,以实现上述任意方法实施例中的远程控制方法。The memory 122 stores instructions executable by the at least one processor 121; the at least one processor 121 is configured to execute the instructions, so as to implement the remote control method in any of the above method embodiments.
通信模块123是用于建立通信连接,提供物理信道的功能模块。通信模块123以是任何类型的无线或者有线通信模块,包括但不限于WiFi模块或者蓝牙模块等。The communication module 123 is a functional module for establishing a communication connection and providing a physical channel. The communication module 123 may be any type of wireless or wired communication module, including but not limited to a WiFi module or a Bluetooth module.
进一步地,本申请实施例还提供了一种非暂态计算机可读存储介质,所述非暂态计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器121执行,可使得上述一个或多个处理器121执行上述任意方法实施例中远程控制方法。Further, the embodiment of the present application also provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors 121, which may cause the above-mentioned one or more processors 121 to execute the remote control method in any of the above-mentioned method embodiments.
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Some or all of the modules are selected according to actual needs to realize the purpose of the solution of this embodiment.
通过以上的实施方式的描述,本领域普通技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程是可以通过计算机程序产品中的计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非暂态计算机可读取存储介质中,该计算机程序包括程序指令,当所述程序指令被相关设备执行时,可使相关设备执行上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体 (Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and of course also by hardware. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related hardware through the computer program in the computer program product, and the computer program can be stored in a non-transitory computer. In the read storage medium, the computer program includes program instructions, and when the program instructions are executed by the relevant equipment, the relevant equipment can be made to execute the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.
上述产品可执行本申请实施例所提供的无人机保护方法,具备执行无人机保护方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的无人机保护方法。The above-mentioned product can execute the UAV protection method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the UAV protection method. For technical details that are not described in detail in this embodiment, please refer to the drone protection method provided in the embodiment of this application.
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;在本申请的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本申请的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; under the thinking of the present application, the above embodiments or technical features in different embodiments can also be combined, The steps can be performed in any order, and there are many other variations of the different aspects of the application as described above, which have not been presented in detail for the sake of brevity; although the application has been described in detail with reference to the preceding examples, those of ordinary skill in the art The skilled person should understand that: it is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the implementation of the present application. The scope of technical solutions.

Claims (14)

  1. 一种远程控制方法,其特征在于,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述方法包括:A remote control method, characterized in that it is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication. The method includes:
    第二控制端向所述第一控制端发送远程控制请求指令;the second control terminal sends a remote control request instruction to the first control terminal;
    第二控制端接收所述第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得所述无人飞行器处于第二控制端的远程控制状态;The second control terminal receives the remote control confirmation instruction sent by the first control terminal, and establishes a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
    第二控制端进入远程控制界面,基于所述远程控制界面,对所述无人飞行器进行远程控制,其中,所述第二控制端的显示界面大于第一控制端的显示界面。The second control terminal enters the remote control interface, based on the remote control interface, remotely controls the UAV, wherein the display interface of the second control terminal is larger than the display interface of the first control terminal.
  2. 根据权利要求1所述的方法,其特征在于,所述第二控制端包括一操作台,所述对所述无人飞行器进行远程控制,包括:The method according to claim 1, wherein the second control terminal includes an operating console, and the remote control of the unmanned aerial vehicle includes:
    基于所述操作台预设的操作方式,对所述无人飞行器进行远程控制。The unmanned aerial vehicle is remotely controlled based on the preset operation mode of the operating console.
  3. 根据权利要求2所述的方法,其特征在于,所述操作台包括:键盘,所述键盘包括多个按键,所述预设的操作方式,包括:预设的按键操作,其中,每一按键对应一个按键操作,所述基于所述操作台预设的操作方式,对所述无人飞行器进行远程控制,包括:The method according to claim 2, wherein the console comprises: a keyboard, the keyboard includes a plurality of keys, and the preset operation mode includes: preset key operations, wherein each key Corresponding to a button operation, the remote control of the unmanned aerial vehicle based on the preset operation mode of the console includes:
    基于预设的按键,获取按键操作命令,控制所述无人飞行器的飞行方向。Based on the preset keys, key operation commands are obtained to control the flight direction of the UAV.
  4. 根据权利要求3所述的方法,其特征在于,所述基于预设的按键,获取按键操作命令,控制所述无人飞行器的飞行方向,包括:The method according to claim 3, wherein the obtaining of key operation commands based on preset keys to control the flight direction of the unmanned aerial vehicle includes:
    根据所述预设的按键对应的按键操作,生成按键操作命令,并将所述按键操作命令发送到所述无人飞行器,以控制所述无人飞行器的飞行方向,其 中,所述预设的按键,包括:上升按键,用于控制所述无人飞行器上升;下降按键,用于控制所述无人飞行器下降;左转按键,用于控制所述无人飞行器左转;右转按键,用于控制所述无人飞行器右转;向前按键,用于控制所述无人飞行器前飞;向后按键,用于控制所述无人飞行器后飞;向左按键,用于控制所述无人飞行器左飞;向右按键,用于控制所述无人飞行器右飞。According to the button operation corresponding to the preset button, a button operation command is generated, and the button operation command is sent to the UAV to control the flight direction of the UAV, wherein the preset Buttons, including: an up button, used to control the unmanned aerial vehicle to rise; a down button, used to control the unmanned aerial vehicle to descend; a left turn button, used to control the unmanned aerial vehicle to turn left; a right turn button, used to For controlling the unmanned aerial vehicle to turn right; the forward button is used to control the unmanned aerial vehicle to fly forward; the backward button is used to control the unmanned aerial vehicle to fly backward; the left button is used to control the unmanned aerial vehicle The unmanned aerial vehicle flies left; the right key is used to control the unmanned aerial vehicle to fly right.
  5. 根据权利要求1所述的方法,其特征在于,在第二控制端向所述第一控制端发送远程控制请求指令之前,所述方法还包括:The method according to claim 1, wherein before the second control terminal sends a remote control request instruction to the first control terminal, the method further comprises:
    第二控制端获取远程控制界面指令;The second control terminal obtains the remote control interface instruction;
    第二控制端根据所述远程控制界面指令,控制所述第二控制端的显示界面进入远程控制界面。The second control terminal controls the display interface of the second control terminal to enter the remote control interface according to the remote control interface instruction.
  6. 根据权利要求1所述的方法,其特征在于,所述第二控制端通信连接多个无人飞行器,所述方法还包括:The method according to claim 1, wherein the second control terminal communicates with a plurality of unmanned aerial vehicles, and the method also includes:
    在所述远程控制界面中,生成每一无人飞行器一一对应的直播窗口;In the remote control interface, generate a one-to-one live broadcast window for each unmanned aerial vehicle;
    响应于对直播窗口的操作,控制所述直播窗口对应的无人飞行器处于第二控制端的远程控制状态。In response to the operation on the live broadcast window, the unmanned aerial vehicle corresponding to the live broadcast window is controlled to be in the remote control state of the second control terminal.
  7. 根据权利要求1-6任一项所述的方法,其特征在于,所述第二控制端包括终端设备。The method according to any one of claims 1-6, wherein the second control terminal includes a terminal device.
  8. 一种远程控制方法,其特征在于,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述方法包括:A remote control method, characterized in that it is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication. The method includes:
    在无人飞行器处于第一控制端的远程控制状态时,第一控制端接收第二控制端发送的远程控制请求指令;When the unmanned aerial vehicle is in the remote control state of the first control terminal, the first control terminal receives the remote control request instruction sent by the second control terminal;
    第一控制端接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态。The first control terminal receives the remote control confirmation instruction, and sends the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
  9. 根据权利要求8所述的方法,其特征在于,所述方法还包括:The method according to claim 8, characterized in that the method further comprises:
    接收远程控制中断指令,控制所述无人飞行器由第二远程控制状态切换到第一远程控制状态,其中,所述第一远程控制状态为所述第一控制端远程控制所述无人飞行器,所述第二远程控制状态为所述第二控制端远程控制所述无人飞行器。receiving a remote control interruption command, controlling the unmanned aerial vehicle to switch from the second remote control state to the first remote control state, wherein the first remote control state is that the first control terminal remotely controls the unmanned aerial vehicle, The second remote control state is that the second control terminal remotely controls the UAV.
  10. 根据权利要求8-9任一项所述的方法,其特征在于,所述第一控制端包括遥控设备。The method according to any one of claims 8-9, wherein the first control terminal includes a remote control device.
  11. 一种远程控制装置,其特征在于,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述装置包括:A remote control device, characterized in that it is applied to an unmanned aerial vehicle, the unmanned aerial vehicle is connected to a first control terminal by communication, and the first control terminal is connected to a second control terminal by communication, and the device includes:
    远程控制请求指令发送单元,用于向所述第一控制端发送远程控制请求指令;a remote control request instruction sending unit, configured to send a remote control request instruction to the first control terminal;
    远程控制状态单元,用于接收所述第一控制端发送的远程控制确认指令,并建立与无人飞行器的通信连接,使得所述无人飞行器处于第二控制端的远程控制状态;The remote control state unit is configured to receive the remote control confirmation instruction sent by the first control terminal, and establish a communication connection with the unmanned aerial vehicle, so that the unmanned aerial vehicle is in the remote control state of the second control terminal;
    远程控制界面单元,用于进入远程控制界面,基于所述远程控制界面,对所述无人飞行器进行远程控制,其中,所述第二控制端的屏幕大于第一控制端的屏幕。The remote control interface unit is used to enter the remote control interface, and remotely control the UAV based on the remote control interface, wherein the screen of the second control terminal is larger than the screen of the first control terminal.
  12. 一种远程控制装置,其特征在于,应用于无人飞行器,所述无人飞行器通信连接第一控制端,所述第一控制端通信连接第二控制端,所述装置 包括:A remote control device, characterized in that it is applied to an unmanned aerial vehicle, the unmanned aerial vehicle communicates with a first control terminal, and the first control terminal communicates with a second control terminal, and the device includes:
    远程控制请求指令接收单元,用于在无人飞行器处于第一控制端的远程控制状态时,接收第二控制端发送的远程控制请求指令;The remote control request instruction receiving unit is used to receive the remote control request instruction sent by the second control terminal when the unmanned aerial vehicle is in the remote control state of the first control terminal;
    远程控制状态单元,用于接收远程控制确认指令,并将所述远程控制确认指令发送到所述第二控制端,使得所述无人飞行器进入第二控制端的远程控制状态。The remote control state unit is configured to receive a remote control confirmation instruction, and send the remote control confirmation instruction to the second control terminal, so that the UAV enters the remote control state of the second control terminal.
  13. 一种第一控制端,其特征在于,包括:A first control terminal, characterized by comprising:
    至少一个处理器;以及at least one processor; and
    与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够用于执行如权利要求1-7中任一项所述的远程控制方法。A memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processing The device can be used to execute the remote control method according to any one of claims 1-7.
  14. 一种第二控制端,其特征在于,包括:A second control terminal, characterized by comprising:
    至少一个处理器;以及at least one processor; and
    与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够用于执行如权利要求8-10中任一项所述的远程控制方法。A memory connected in communication with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processing The device can be used to execute the remote control method according to any one of claims 8-10.
PCT/CN2022/114570 2021-08-25 2022-08-24 Remote control method and device and first and second control ends WO2023025204A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110982429.5A CN113759945A (en) 2021-08-25 2021-08-25 Remote control method and device and first control end and second control end
CN202110982429.5 2021-08-25

Publications (1)

Publication Number Publication Date
WO2023025204A1 true WO2023025204A1 (en) 2023-03-02

Family

ID=78791183

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/114570 WO2023025204A1 (en) 2021-08-25 2022-08-24 Remote control method and device and first and second control ends

Country Status (2)

Country Link
CN (1) CN113759945A (en)
WO (1) WO2023025204A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113759945A (en) * 2021-08-25 2021-12-07 深圳市道通智能航空技术股份有限公司 Remote control method and device and first control end and second control end

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180181119A1 (en) * 2016-12-26 2018-06-28 Samsung Electronics Co., Ltd. Method and electronic device for controlling unmanned aerial vehicle
CN108885463A (en) * 2017-02-27 2018-11-23 深圳市大疆创新科技有限公司 Long-range control method, equipment and the system of unmanned plane
WO2020014740A1 (en) * 2018-07-17 2020-01-23 Emesent IP Pty Ltd Method for exploration and mapping using an aerial vehicle
US20200410874A1 (en) * 2019-06-29 2020-12-31 Rumfert, Llc Method and system for pre-flight programming of a remote identification (remote id) system for monitoring the flight of an unmanned aircraft system (uas) in the national airspace system (nas)
CN113204249A (en) * 2021-04-23 2021-08-03 北京云圣智能科技有限责任公司 Unmanned aerial vehicle near-remote combined control system and method and unmanned aerial vehicle
CN113759945A (en) * 2021-08-25 2021-12-07 深圳市道通智能航空技术股份有限公司 Remote control method and device and first control end and second control end

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107294926B (en) * 2016-03-31 2021-05-14 比亚迪股份有限公司 Vehicle remote control authorization system and method, vehicle, terminal and server
CN107438227B (en) * 2016-05-25 2021-06-25 中兴通讯股份有限公司 Unmanned aerial vehicle delivery method
CN105867363A (en) * 2016-05-26 2016-08-17 北京飞旋天行科技有限公司 UAV (unmanned aerial vehicle) control method, equipment and system
CN106814749A (en) * 2017-02-06 2017-06-09 珠海市磐石电子科技有限公司 A kind of UAS and control method based on multiparty control
CN111221331B (en) * 2020-01-08 2024-04-26 北京航天发射技术研究所 Synchronous control processing system and method for multiple control terminals of small-sized boats

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180181119A1 (en) * 2016-12-26 2018-06-28 Samsung Electronics Co., Ltd. Method and electronic device for controlling unmanned aerial vehicle
CN108885463A (en) * 2017-02-27 2018-11-23 深圳市大疆创新科技有限公司 Long-range control method, equipment and the system of unmanned plane
WO2020014740A1 (en) * 2018-07-17 2020-01-23 Emesent IP Pty Ltd Method for exploration and mapping using an aerial vehicle
US20200410874A1 (en) * 2019-06-29 2020-12-31 Rumfert, Llc Method and system for pre-flight programming of a remote identification (remote id) system for monitoring the flight of an unmanned aircraft system (uas) in the national airspace system (nas)
CN113204249A (en) * 2021-04-23 2021-08-03 北京云圣智能科技有限责任公司 Unmanned aerial vehicle near-remote combined control system and method and unmanned aerial vehicle
CN113759945A (en) * 2021-08-25 2021-12-07 深圳市道通智能航空技术股份有限公司 Remote control method and device and first control end and second control end

Also Published As

Publication number Publication date
CN113759945A (en) 2021-12-07

Similar Documents

Publication Publication Date Title
WO2018095158A1 (en) Flight control method, apparatus and system for use in aircraft
EP3345832B1 (en) Unmanned aerial vehicle and method for controlling the same
EP4071606A1 (en) Application sharing method, first electronic device and computer-readable storage medium
CN107952242B (en) Terminal software experience method, terminal and computer readable storage medium
US20180024546A1 (en) Method, storage medium, and electronic device for controlling unmanned aerial vehicle
CN110913066A (en) Display method and electronic equipment
CN111083684A (en) Method for controlling electronic equipment and electronic equipment
WO2019149028A1 (en) Application download method and terminal
KR102290746B1 (en) Device for controlling unmanned aerial vehicle, unmanned aerial vehicle controlled by the device and system
WO2021259252A1 (en) Flight simulation method and apparatus, electronic device, and unmanned aerial vehicle
WO2021136266A1 (en) Virtual image synchronization method and wearable device
CN108881719B (en) Method for switching shooting mode and terminal equipment
WO2019228296A1 (en) Display processing method and terminal device
US11989330B2 (en) Permission management method and terminal device
US12028476B2 (en) Conversation creating method and terminal device
CN109710130B (en) Display method and terminal
CN111381602B (en) Unmanned aerial vehicle flight control method and device and unmanned aerial vehicle
US20220286622A1 (en) Object display method and electronic device
EP4084511A1 (en) Application sharing method, first electronic device, and computer-readable storage medium
WO2019184902A1 (en) Method for controlling icon display, and terminal
WO2020042921A1 (en) Screen control method and electronic device
WO2023025204A1 (en) Remote control method and device and first and second control ends
Zhao et al. Web-based interactive drone control using hand gesture
WO2023193611A1 (en) Unmanned aerial vehicle, and control method, apparatus and system therefor
WO2023193604A1 (en) Route task online planning method and related apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22860550

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE