WO2018076367A1 - Lever amount control method, apparatus, and related device - Google Patents

Lever amount control method, apparatus, and related device Download PDF

Info

Publication number
WO2018076367A1
WO2018076367A1 PCT/CN2016/104116 CN2016104116W WO2018076367A1 WO 2018076367 A1 WO2018076367 A1 WO 2018076367A1 CN 2016104116 W CN2016104116 W CN 2016104116W WO 2018076367 A1 WO2018076367 A1 WO 2018076367A1
Authority
WO
WIPO (PCT)
Prior art keywords
amount
control
rod
generated
external device
Prior art date
Application number
PCT/CN2016/104116
Other languages
French (fr)
Chinese (zh)
Inventor
崔健
钱杰
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2016/104116 priority Critical patent/WO2018076367A1/en
Priority to CN201680014294.0A priority patent/CN107438808B/en
Publication of WO2018076367A1 publication Critical patent/WO2018076367A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Definitions

  • the present invention relates to the field of flight control technologies, and in particular, to a method, device and related device for lever amount control.
  • Unmanned Aerial Vehicle UAV
  • UAV Unmanned Aerial Vehicle
  • the user can select one or more control modes that he likes to control the drone.
  • the user can also according to actual needs. Switching between multiple control modes Under the existing control strategy, the user needs to manually control to switch between the control mode or the control device, and the user experience is not good.
  • the embodiment of the invention discloses a method, a device and a related device for controlling the amount of the rod, which can realize automatic fusion of the plurality of control rods and automatically switch between the plurality of control modes and the control device.
  • a first aspect of the embodiments of the present invention discloses a method for controlling the amount of the pole, comprising:
  • the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device are obtained.
  • the amount of the rod generated by the motion and the amount of the rod generated by the input are fused to obtain a lever amount for the aircraft.
  • the second aspect of the embodiment of the invention discloses a device for controlling the amount of the rod, comprising:
  • the acquisition module is configured to acquire the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
  • a processing module configured to fuse the amount of the rod generated by the motion acquired by the acquiring module with the amount of the rod generated by the input, to obtain a lever amount for the aircraft.
  • a third aspect of the embodiments of the present invention discloses a control device, including:
  • the communication device is configured to acquire motion data generated by motion of the external device and a lever amount generated by input through the external device.
  • a processor configured to obtain, according to the motion data acquired by the communication device, a rod amount generated by the movement of the external device, and combine a rod amount generated by the motion with a rod amount generated by the input to obtain a pair The amount of joystick for the aircraft.
  • a fourth aspect of the embodiments of the present invention discloses an aircraft, including:
  • a power system used to provide flight power to the aircraft.
  • the control device disclosed in the third aspect is configured to control the aircraft by using a control lever amount of the aircraft obtained by the control device.
  • a fifth aspect of the embodiments of the present invention discloses a control device, including:
  • a communication device for acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
  • a processor for fusing the amount of the rod generated by the motion and the amount of the rod generated by the input to obtain a lever amount for the aircraft.
  • a sixth aspect of the embodiments of the present invention discloses an aircraft, including:
  • a power system used to provide flight power to the aircraft.
  • the control device disclosed in the fifth aspect is configured to control the aircraft by using a control lever amount of the aircraft obtained by the control device.
  • a seventh aspect of the embodiments of the present invention discloses an external device, including a processor, a motion sensor, and a communication device, where the processor is respectively connected to the motion sensor and the communication device, where:
  • the motion sensor is configured to detect motion of the external device and output motion data
  • the processor is configured to calculate a rod amount generated by the movement of the external device according to the motion data, control a communication device to send the rod amount to an aircraft, and control the aircraft by using the rod amount;
  • the communication device is configured to transmit the amount of the rod generated by the motion to the aircraft.
  • the embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input.
  • the aircraft can be controlled according to the amount of the control rod, so that multiple Automatic fusion of the amount of joystick and automatic switching between various control modes and control devices.
  • FIG. 1 is a schematic structural diagram of a drone control system disclosed in an embodiment of the present invention.
  • FIG. 2 is a schematic flow chart of a method for controlling the amount of the rod disclosed in the embodiment of the present invention
  • FIG. 3 is a schematic diagram of a gesture control aircraft disclosed in an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of another gesture control aircraft disclosed in an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of still another gesture control aircraft disclosed in an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of an apparatus for controlling the amount of the rod disclosed in the embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a control device according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of another control device according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an external device according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of a drone control system in accordance with an embodiment of the present invention.
  • the drone system of the present embodiment includes a drone 1, a wearable device 2, and a remote controller 3, wherein the drone 1 includes a flight body, a pan/tilt head, and an image forming apparatus.
  • the flying body includes a plurality of rotors and a rotor motor that drives the rotor to rotate, thereby providing the power required for the drone 1 to fly.
  • Imaging equipment It is mounted on the main body of the flight through the gimbal.
  • the imaging device is used for image or video capture during flight of the drone, including but not limited to multi-spectral imagers, hyperspectral imagers, visible light cameras, and infrared cameras.
  • the pan/tilt is a multi-axis transmission and stabilization system, including multiple rotating shafts and pan/tilt motors.
  • the pan/tilt motor compensates the shooting angle of the imaging device by adjusting the rotation angle of the rotating shaft, and prevents or reduces the jitter of the imaging device by setting an appropriate buffer mechanism.
  • the imaging device can be mounted on the flying body either directly or by other means.
  • the drone control system shown in FIG. 1 there are two external devices, a wearable device and a remote controller, which control the aircraft.
  • the wearable device 2 has a built-in motion sensor.
  • the motion sensor senses the motion of the hand and outputs corresponding motion data, and calculates the amount of the rod generated by the movement of the wearable device based on the motion data, and controls the drone according to the amount of the rod.
  • the remote controller is provided with a rocker, a button (virtual button or physical button) and a dial wheel, and the lever can be obtained by inputting a rocker, a button (virtual button or a physical button) of the remote controller and a dial, the lever The amount can control the drone.
  • FIG. 2 is a schematic flowchart diagram of a method for controlling the amount of the rod according to an embodiment of the present invention.
  • the method for controlling the amount of the rod described in this embodiment includes:
  • the external device may specifically include: a wearable device such as a watch or a wristband or a handheld device, or a smart phone, a tablet computer, a remote controller, a ground control station, a combination thereof, and the like.
  • a wearable device such as a watch or a wristband or a handheld device, or a smart phone, a tablet computer, a remote controller, a ground control station, a combination thereof, and the like.
  • Some external devices are equipped with motion sensors (such as inertial measurement unit IMU), which can sense the motion and motion of the external device and control the aircraft according to the motion or action, in particular, when the external device moves or follows the user
  • the motion sensor outputs corresponding motion data, and according to the motion data, the amount of the rod can be obtained, and the amount of the rod can control the aircraft, and the rod amount is used as a rod generated by the movement of the external device. the amount.
  • a motion sensor is arranged inside the wristband, and the user wears a wristband.
  • the motion sensor outputs motion data, which can be calculated according to the motion data of the wristband.
  • the amount of the rod generated by the preset action of the bracelet can be used to control the aircraft.
  • the user can control the aircraft with gestures.
  • the amount of the rod generated by the movement of the external device may specifically include: movement by a wearable device such as a watch or a wristband (for example, when a user wears a wearable device such as a wristwatch or a wristband, and performs some gestures) or a movement of the holding device. Rod amount.
  • the input of the external device may include one or more of key input of an external device, a rocker input of an external device, and a dial input of an external device.
  • the button may specifically include a physical button of the entity and a touch button in the interaction interface, and the user may operate the button, the joystick, the dial, and the like of the external device, and the external device may obtain a corresponding amount of the rod, and the amount of the rod may be The aircraft is controlled to use the amount of the rod as the amount of the rod generated by the input from the external device.
  • the amount of the rod generated by the input of the external device may specifically include the amount of the rod generated by one or more inputs of the watch, the wristband, the smartphone, the tablet, the remote controller, and the ground control station, for example, through the watch.
  • the wristband, the smart phone, the tablet computer, the remote controller and the ground control station generate the amount of the lever with the combination of the button, the joystick and the dial wheel.
  • the button may specifically include the physical button of the entity and the touch button in the interaction interface. Wait.
  • the aircraft can receive the amount of the rod generated by the movement of the external device and the amount of the rod generated by the external device input, and the aircraft can fuse the amount of the rod generated by the movement with the amount of the rod generated by the input.
  • the amount of the control rod for the aircraft is obtained, and the amount of the control rod obtained by the fusion is used to control the aircraft.
  • acquiring by using the first network model, a weight amount corresponding to each of the amount of the rod generated by the motion, and the amount of the rod generated by the input, acquiring the amount of the rod generated by the motion, and the input The product of each of the amount of the rod and the corresponding weighting factor, superimposed by the product to obtain a superimposed amount, which is used as a lever amount for the aircraft.
  • the amount of the lever A generated by the movement of the bracelet, the amount of the lever B generated by the input of the button on the wristband, and the amount of the lever C generated by the input of the button on the remote controller are taken as an example, when the flight control system exists
  • the first network model can be used to obtain the amount of the rod generated by the movement of the bracelet, the amount of the rod generated by the button input on the bracelet, and the amount of the rod generated by the button input on the remote controller.
  • the parameter associated with the motion of the external device, the amount of the rod generated by the input of the external device is input to the first network model, and the amount of the rod generated by the motion is obtained, and the amount of the rod generated by the input is obtained.
  • the weight coefficient corresponding to each rod amount in the middle is obtained.
  • the external device takes the wristband as an example, and the user wears the wristband.
  • the user wants to enter the mode of controlling the aircraft by using the motion of the wristband (ie, the gesture control mode)
  • the following can be specified as needed:
  • the user points the aircraft to the hand;
  • the preset action G is completed, such as turning the wrist wearing the wristband.
  • the user can use the motion of the wristband to align the aircraft. Controlling, wherein when the angle between the wristband and the aircraft and the axial direction of an axis of the coordinate system defined by the motion sensor of the bracelet is less than a preset value, the user is considered to have pointed with the finger Aircraft.
  • the amount of the rod generated by the input from the external device is input to the first network model, and the amount of the rod generated by the motion of the bracelet is obtained.
  • the amount of the rod generated by the input of the external device corresponds to the weight coefficient. After the weight coefficient is obtained, the amount of the control rod for the aircraft can be calculated by the above method, and details are not described herein.
  • the preset weight coefficient is combined as the target output of the first network model, and the parameter associated with the external device motion corresponding to the weight coefficient combination and the amount of the rod generated by the input are used as the input and output.
  • the first network model is trained.
  • the first network when the first network is used to acquire the weight coefficient corresponding to each of the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input from the external device, it is necessary to adequately train the first network.
  • a plurality of parameters associated with the movement of the external device corresponding to the preset weight coefficient combination are collected, and the first network is trained by the amount of the rod generated by the input from the external device.
  • the input dimension is very low, the input state space can be artificially sampled, and the target output can be labeled with a reasonable weight coefficient by expert experience.
  • acquiring the amount of the rod generated by the external device comprises: acquiring motion data generated by the motion of the external device, and acquiring a tangential speed rod amount and a radial direction controlled by the aircraft on the sphere coordinate system according to the motion data. a speed lever amount, converting the tangential speed lever amount and the radial speed lever amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device, wherein the specific reference point is The origin of the sphere coordinate system.
  • a specific reference point is for a user wearing or holding an external device.
  • the external device takes the wristband as an example, and the user wearing the wristband is taken as the origin, and the wristband is equipped with a motion sensor.
  • the wristband When the user's hand performs the corresponding action, the wristband will follow the user's hand.
  • the corresponding motion is generated, and the motion sensor outputs corresponding motion data.
  • the tangential speed lever amount V t and the radial velocity lever amount V r can be obtained according to the motion data.
  • the tangential speed lever amount V t and the radial speed lever amount V r in the spherical coordinate system can be converted into the rod amounts V x , V y , V z in the Cartesian coordinates.
  • the amount of rods V x , V y , and V z is the amount of the rod generated by the movement of the bracelet.
  • the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere
  • the second control mode is to control the aircraft at the aircraft and the specific The radial flight on the connecting line between the reference points, as shown in Fig. 4,
  • the external device takes the wristband as an example
  • the specific reference point takes the wristband as an example.
  • the first control The mode is to control the aircraft in a tangential flight with a wristband as the center of the sphere and a radius of the initial distance between the wristband and the aircraft.
  • the second control mode is to control the aircraft in the wristband as the center of the sphere, in the aircraft and the wristband.
  • the axis of the coordinate system defined by the motion sensor flies radially, specifically as the aircraft flies away from or near the user.
  • the control amount of the first control mode can be calculated according to the motion data output by the motion sensor of the wristband, and the spherical coordinate is calculated according to the control amount.
  • the tangential speed lever amount V t in the system , in the second control mode, the control amount of the second control mode can be calculated according to the motion data output by the motion sensor of the wristband, and the spherical coordinate system is calculated according to the control amount
  • the radial velocity rod amount V r is calculated according to the above method, and the amount of the rod generated by the movement of the bracelet is not described here.
  • control quantity of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is that the external device rotates on the axis of the certain axis angle.
  • the external device takes a wristband as an example, and a specific reference point takes a wristband as an example.
  • the control amount of the first control mode is a connection between the aircraft and the specific reference point.
  • the control amount of the first control mode is the coordinate system defined by the connection of the wristband and the aircraft and the wristband.
  • the angle ⁇ between the axial direction of the certain axis (X-axis) (the positive direction of the X-axis) can continuously collect the angle ⁇ , and input it into the PD controller to calculate the radial velocity rod amount V r .
  • the output of the PD controller may be filtered and limited to obtain a radial velocity lever amount Vr ;
  • the control amount of the second control mode is the external device with the certain axis (X-axis)
  • the control amount of the second control mode is the angle ⁇ of the rotation of the wristband when the certain axis is the axis, and the angle ⁇ can be continuously collected, and the input to the PD controller can be calculated.
  • the amount of the radial speed of the rod V r additionally, alternatively, may enter the output of the PD controller Obtained after filtering and limiting the amount of radial velocity of the rod V r.
  • control quantity of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is a moving distance of the external device on the certain axis.
  • the external device takes a wristband as an example, and a specific reference point takes a wristband as an example.
  • the control amount of the first control mode is a connection between the aircraft and the specific reference point, and an external device.
  • the control amount of the first control mode is the coordinate defined by the motion sensor of the wristband and the aircraft connection and the wristband.
  • the angle ⁇ between the axis of the axis (X-axis) of the system can continuously collect the angle ⁇ , and input it into the PD controller to calculate the radial velocity V r , in addition, optionally, the output of the PD controller may be filtered and limited to obtain a radial velocity rod amount V r ;
  • the control amount of the second control mode is that the external device is on the certain axis
  • the moving distance, at this time, the control amount of the second control mode is the distance d of the wristband moving on the certain axis (X-axis), and the distance d can be continuously collected, and the input to the PD controller can be calculated.
  • radial velocity rod amount V r additionally, alternatively, may be input to the PD controller After filtering and limiting the amount of the lever to obtain the radial velocity V r.
  • the motion data generated by the motion of the external device is acquired, and the amount of the rod generated by the motion of the external device corresponding to the motion data is acquired by using the second network model.
  • the external device takes the wristband as an example.
  • the motion data corresponding to the motion is acquired, and the motion data is input into the second network model, and the second network model can output the phase.
  • the motion data may be used to acquire one or more control quantities, and the one or more control quantities are input into the second network model, and the network model can be output.
  • the external device takes a wristband as an example, and the wristband is a center of the ball, and the first control mode is to control the tangential direction of the aircraft on a spherical surface with the specific reference point as a center of the sphere.
  • the second control mode is to control the aircraft to fly radially on a line between the aircraft and the specific reference point
  • the control amount of the first control mode is the aircraft and the specific reference point
  • the control amount of the first control mode is the connection between the wristband and the aircraft and the wristband.
  • the angle ⁇ between the axial direction (the positive direction of the X-axis) of an axis (X-axis) of the coordinate system defined by the motion sensor, and the angle ⁇ is input to the second network model to obtain the angle
  • the tangential velocity rod amount V t corresponding to ⁇ , and the control amount of the second control mode is the angle ⁇ of the rotation of the bracelet when the certain axis (X axis) is the axis
  • the angle ⁇ is input to the second network model, that is, the angle ⁇ can be obtained with an amount of radial velocity V r corresponding to the lever, then the method described above
  • the amount of movement of the ring by a hand lever not described herein again.
  • a large amount of control quantity (such as the angle ⁇ ) corresponding to the preset tangential speed rod amount should be collected, and the collection corresponds to the preset radial speed rod amount.
  • the control quantity of the first control mode trains the second network model, and after the training is completed, the second network model output can be used to correspond to the control quantity of the first control mode and the control quantity of the second control mode.
  • the tangential speed rod amount V t and the radial speed rod amount V r .
  • the embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input.
  • the aircraft is controlled according to the amount of the control rod, so that the automatic fusion of the plurality of control levers can be realized, and the automatic switching between the various control modes and the control devices can be realized.
  • the embodiment of the invention further discloses a computer storage medium, wherein the computer storage medium stores program instructions, and the program execution may include part or all of the method of the rod amount control according to any one of the corresponding embodiments of FIG. step.
  • FIG. 6 is a schematic structural diagram of an apparatus for controlling the amount of the rod according to an embodiment of the present invention.
  • the device for controlling the amount of the rod described in this embodiment includes:
  • the acquisition module 601 is configured to acquire the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
  • the processing module 602 is configured to fuse the amount of the rod generated by the motion acquired by the acquiring module with the amount of the rod generated by the input to obtain a lever amount for the aircraft.
  • the amount of the rod generated by the input includes the amount of the rod generated by one or more inputs of the watch, the wristband, the remote controller, the smart phone, and the ground control station.
  • the processing module 602 is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input.
  • the processing module 602 is specifically configured to acquire a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount.
  • the amount of superposition is used as the amount of the lever for the aircraft.
  • the processing module 602 is configured to input a parameter associated with the motion of the external device and a bar amount generated by inputting by the external device into the first network model to obtain the pole generated by the motion.
  • the processing module 602 is further configured to combine preset weight coefficients as a target output of the first network model, and associate parameters related to the external device motion corresponding to the weight coefficient combination.
  • the amount of the rod generated by the input is used as an input to train the first network model.
  • the processing module 602 is further configured to: when training the first network model, when a parameter associated with the motion of the external device and a bar amount generated by the input are simultaneously present, The weight coefficients corresponding to the amount of the rod other than the highest rod amount are all set to zero.
  • the acquiring module 601 is configured to acquire motion data generated by the motion of the external device, and acquire, according to the motion data, a tangential speed of the aircraft control on a sphere coordinate system.
  • the amount of the rod and the amount of the radial speed rod convert the amount of the tangential speed rod and the amount of the radial speed rod to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device.
  • the specific reference point is the origin of the sphere coordinate system.
  • the specific reference point is a user who wears or holds the external device.
  • the acquiring module 601 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain the tangential speed lever amount according to the control quantity of the first control mode. .
  • the acquiring module 601 is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and obtain the radial speed lever amount according to the control quantity of the second control mode.
  • the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere
  • the second control mode is to control the aircraft at the aircraft and the specific reference Radial flight on the line between points.
  • control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  • control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is a moving distance of the external device on the certain axis.
  • the obtaining module 601 is configured to acquire motion data generated by the motion of the external device, and acquire, by using a second network model, a lever amount generated by the motion of the external device corresponding to the motion data.
  • the acquiring module 601 is configured to acquire, according to the motion data, a control quantity of the first control mode of the aircraft, and input the control quantity of the first control mode into the second network model, to obtain a tangential speed lever amount controlled by the aircraft on the sphere coordinate system;
  • the acquiring module 601 is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and input a control quantity of the second control mode into the second network model, to obtain the The amount of radial velocity rods controlled by the aircraft on the sphere coordinate system;
  • the obtaining module 601 is specifically configured to obtain a rod amount generated by the motion according to the tangential speed lever amount and the radial speed lever amount;
  • the specific reference point is the origin of the sphere coordinate system.
  • the first network model and the second network model are artificial neural networks.
  • the embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input.
  • the aircraft is controlled according to the amount of the control rod, so that the automatic fusion of the plurality of control levers can be realized, and the automatic switching between the various control modes and the control devices can be realized.
  • FIG. 7 is a schematic structural diagram of a control device according to an embodiment of the present invention.
  • the control device described in this embodiment includes a communication device 701, a processor 702, and a memory 703.
  • the communication device 701, the processor 702, and the memory 703 are connected by a bus.
  • the processor 702 may be a central processing unit (CPU), and the processor may be another general-purpose processor, a digital signal processor (DSP), or an application specific integrated circuit (ASIC). ), a Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, and the like.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the above-described memory 703 may include read only memory and random access memory, and provides instructions and data to the processor 702.
  • a portion of the memory 703 may also include a non-volatile random access memory. among them:
  • the communication device 701 is configured to acquire motion data generated by motion of the external device and a lever amount generated by input through the external device.
  • the processor 702 is configured to obtain, according to the motion data acquired by the communication device 701, a rod amount generated by the movement of the external device, and combine a rod amount generated by the motion with a rod amount generated by the input, Get the amount of control rod for the aircraft.
  • the amount of the rod generated by the input comprises a rod amount generated by one or more inputs of a watch, a wristband, a remote controller, a smart phone, and a ground control station.
  • the processor 702 is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input.
  • the processor 702 is specifically configured to obtain a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount.
  • the amount of superposition is used as the amount of the lever for the aircraft.
  • the processor 702 is specifically configured to input a parameter associated with the motion of the external device and a bar amount generated by inputting by the external device into the first network model to obtain the pole generated by the motion.
  • the processor 702 is further configured to combine preset weight coefficients as a target output of the first network model, and associate parameters related to the external device motion corresponding to the weight coefficient combination.
  • the amount of the rod generated by the input is used as an input to train the first network model.
  • the processor 702 is further configured to: when training the first network model, when a parameter associated with the motion of the external device and a bar amount generated by the input are simultaneously present, The weight coefficients corresponding to the amount of the rod other than the highest rod amount are all set to zero.
  • the processor 702 is configured to acquire, according to the motion data, a tangential speed lever amount and a radial speed lever amount that are controlled by the aircraft on a sphere coordinate system, and the tangential speed lever amount And converting the radial velocity rod amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device.
  • the specific reference point is the origin of the sphere coordinate system.
  • the specific reference point is a user who wears or holds the external device.
  • the processor 702 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain the tangential speed bar quantity according to the control quantity of the first control mode. .
  • the processor 702 is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and obtain the radial speed lever amount according to the control quantity of the second control mode.
  • the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere
  • the second control mode is to control the aircraft at the aircraft and the specific reference Radial flight on the line between points.
  • control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  • control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is a moving distance of the external device on the certain axis.
  • the processor 702 is configured to acquire, by using a second network model, a rod amount generated by the motion of the external device corresponding to the motion data.
  • the processor 702 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a tangential speed lever amount controlled by the aircraft on the sphere coordinate system;
  • the processor 702 is specifically configured to acquire, according to the motion data, a control quantity in a second control mode of the aircraft, and input a control quantity of the second control mode into the second network model, to obtain the The amount of radial velocity rods controlled by the aircraft on the sphere coordinate system.
  • the processor 702 is specifically configured to obtain the amount of the rod generated by the motion according to the tangential speed lever amount and the radial speed lever amount.
  • the specific reference point is the origin of the sphere coordinate system.
  • the first network model and the second network model are artificial neural networks.
  • An embodiment of the present invention also discloses an aircraft comprising a power system and a control device of any of the embodiments provided in FIG. 7, a power system for providing flight power to the aircraft, and a control device for utilizing the control device The resulting amount of control rods for the aircraft controls the aircraft.
  • the communication device 701, the processor 702, and the memory 703 described in the embodiments of the present invention may implement the implementation manner described in the method for controlling the amount of the bar provided in the embodiment of the present invention, and may also implement the implementation of the present invention.
  • the implementation of the device for controlling the amount of the rod described in FIG. 6 is not described here.
  • the embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input. , the aircraft is controlled according to the amount of the control rod, so that multiple controls can be realized Automatic integration of the amount of the pole and automatic switching between various control modes and control devices.
  • FIG. 8 is a schematic structural diagram of another control device according to an embodiment of the present invention.
  • the control device described in this embodiment includes a communication device 801, a processor 802, and a memory 803.
  • the communication device 801, the processor 802, and the memory 803 described above are connected by a bus.
  • the processor 802 may be a central processing unit (CPU), and the processor may be another general-purpose processor, a digital signal processor (DSP), or an application specific integrated circuit (ASIC). ), a Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, and the like.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the above memory 803 may include read only memory and random access memory, and provides instructions and data to the processor 802.
  • a portion of the memory 803 may also include a non-volatile random access memory. among them:
  • the communication device 801 is configured to acquire the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
  • the processor 802 is configured to fuse the amount of the rod generated by the motion and the amount of the rod generated by the input to obtain a lever amount for the aircraft.
  • the amount of the rod generated by the input comprises a rod amount generated by one or more inputs of a watch, a wristband, a remote controller, a smart phone, and a ground control station.
  • the processor 802 is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input.
  • the processor 802 is specifically configured to acquire a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount.
  • the amount of superposition is used as the amount of the lever for the aircraft.
  • An embodiment of the present invention also discloses an aircraft comprising a power system and a control device according to any of the embodiments provided in FIG. 8, a power system for providing flight power to the aircraft, and a control device for utilizing the control device The resulting amount of control rods for the aircraft controls the aircraft.
  • the communication device 801, the processor 802, and the memory are described in the embodiments of the present invention.
  • the implementation of the apparatus described in the method for controlling the amount of the rods provided in the embodiment of the present invention can be implemented in the embodiment of the present invention.
  • the implementation of the apparatus for controlling the amount of the rods described in FIG. 6 of the embodiment of the present invention can be performed, and details are not described herein.
  • the embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input.
  • the aircraft is controlled according to the amount of the control rod, so that the automatic fusion of the plurality of control levers can be realized, and the automatic switching between the various control modes and the control devices can be realized.
  • FIG. 9 is a schematic structural diagram of an external device according to an embodiment of the present invention.
  • the control device described in this embodiment includes a communication device 901, a processor 902, a motion sensor 903, and a memory 904.
  • the above communication device 901, processor 902, motion sensor 903, and memory 904 are connected by a bus.
  • the processor 902 may be a CPU, and the processor may also be other general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and the like.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 904 described above can include read only memory and random access memory and provides instructions and data to the processor 902.
  • a portion of the memory 904 may also include a non-volatile random access memory.
  • the motion sensor 903 described above may be an IMU, a three-axis acceleration sensor, a three-axis gyroscope, a gravity sensor, or the like.
  • a motion sensor 903 configured to detect motion of the external device, and output motion data
  • the processor 902 is configured to calculate a rod amount generated by the movement of the external device according to the motion data, control a communication device to send the rod amount to an aircraft, and control the aircraft by using the rod amount;
  • the communication device 901 is configured to transmit the amount of the rod generated by the motion to the aircraft.
  • the processor 902 is configured to acquire, according to the motion data, a tangential speed lever amount and a radial speed lever amount that are controlled by the aircraft on a sphere coordinate system, and the tangential speed lever amount Converting the radial velocity rod amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device;
  • the specific reference point is the origin of the sphere coordinate system.
  • the user wearing or holding the external device may be the specific reference point.
  • the processor 902 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain a tangential speed lever amount according to the control quantity of the first control mode.
  • the processor 902 is specifically configured to acquire a control amount of the second control mode in the aircraft according to the motion data, and obtain a radial speed lever amount according to the control amount of the second control mode.
  • the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere
  • the second control mode is to control the aircraft at the aircraft and the specific reference Radial flight on the line between points.
  • control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  • control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
  • the control amount of the second control mode is a moving distance of the external device on the certain axis.
  • the processor 902 is configured to acquire, by using the second network model, the amount of the rod generated by the motion of the external device corresponding to the motion data.
  • the processor 902 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a tangential speed lever amount controlled by the aircraft on the sphere coordinate system;
  • the processor 902 is configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and input a control quantity of the second control mode into the second network model, to obtain the The amount of radial velocity rods controlled by the aircraft on the sphere coordinate system;
  • the processor 902 is specifically configured to obtain the amount of the rod generated by the motion according to the tangential speed lever amount and the radial speed lever amount.
  • the specific reference point is the origin of the sphere coordinate system.
  • a specific reference point is an external device.
  • the second network model is an artificial neural network.
  • the external device may be any device configured with a motion sensor, and may specifically be a wearable device such as a watch, a wristband, or a glasses, or a handheld device configured with a motion sensor, such as a control pen, a dedicated remote controller, etc. It is not specifically limited here.
  • the communication device 901, the processor 902, the motion sensor 903, and the memory 904 described in the embodiments of the present invention may implement the implementation manner described in the method for controlling the amount of the bar provided in the embodiment of the present invention.
  • the implementation of the device for controlling the amount of the rods described in the embodiment of the present invention is not described herein.
  • the embodiment of the invention detects the movement of the external device, outputs the motion data, calculates the amount of the rod generated by the movement of the external device according to the motion data, and then transmits the amount of the rod generated by the motion to the aircraft, so that the aircraft acquires the motion generated by the external device.
  • the amount of the rod and the amount of the rod generated by the input from the external device, the amount of the lever for the aircraft is obtained, so that the automatic fusion of the plurality of levers can be realized, and the automatic switching between the various control modes and the control device can be realized.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Toys (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A lever amount control method, apparatus, and related device, wherein the method comprises: acquiring a lever amount produced by a motion of an external device, and a lever amount produced by inputting by means of the external device (201); merging the lever amount produced by the motion and the lever amount produced by inputting, so as to obtain a control lever amount for an aircraft (202). The present invention may achieve the automatic merging of a plurality of control lever amounts, and may automatically switch between a plurality of control modes and control devices.

Description

一种杆量控制的方法、装置及相关设备Method, device and related equipment for rod amount control 技术领域Technical field
本发明涉及飞行控制技术领域,尤其涉及一种杆量控制的方法、装置及相关设备。The present invention relates to the field of flight control technologies, and in particular, to a method, device and related device for lever amount control.
背景技术Background technique
目前,无人机(Unmanned Aerial Vehicle,UAV)的控制模式越来越丰富多样,包括:遥控器控制,手环、手表、视频眼镜等穿戴式设备控制,智能手机、平板电脑等移动终端控制,以及地面控制站控制等。用户可以选择自己喜欢的一种或多种控制模式对无人机进行控制,当然,当无人机控制系统中,存在多种控制设备对同一无人机进行控制时,用户也可以根据实际需求在多种控制模式之间进行切换现有的控制策略下,用户需通过手动操作才能实现控制模式或者控制设备之间的切换,用户体验不好。At present, the control modes of Unmanned Aerial Vehicle (UAV) are more and more diverse, including: remote control, wristband, watch, video glasses and other wearable device controls, smart phones, tablets and other mobile terminal controls. And ground control station control. The user can select one or more control modes that he likes to control the drone. Of course, when there are multiple control devices in the UAV control system to control the same drone, the user can also according to actual needs. Switching between multiple control modes Under the existing control strategy, the user needs to manually control to switch between the control mode or the control device, and the user experience is not good.
发明内容Summary of the invention
本发明实施例公开了一种杆量控制的方法、装置及相关设备,可以实现多个控制杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。The embodiment of the invention discloses a method, a device and a related device for controlling the amount of the rod, which can realize automatic fusion of the plurality of control rods and automatically switch between the plurality of control modes and the control device.
本发明实施例第一方面公开了一种杆量控制的方法,包括:A first aspect of the embodiments of the present invention discloses a method for controlling the amount of the pole, comprising:
获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量。The amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device are obtained.
对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。The amount of the rod generated by the motion and the amount of the rod generated by the input are fused to obtain a lever amount for the aircraft.
本发明实施例第二方面公开了一种杆量控制的装置,包括:The second aspect of the embodiment of the invention discloses a device for controlling the amount of the rod, comprising:
获取模块,用于获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量。The acquisition module is configured to acquire the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
处理模块,用于对所述获取模块获取的所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。And a processing module, configured to fuse the amount of the rod generated by the motion acquired by the acquiring module with the amount of the rod generated by the input, to obtain a lever amount for the aircraft.
本发明实施例第三方面公开了一种控制设备,包括: A third aspect of the embodiments of the present invention discloses a control device, including:
通信装置,用于获取由外部设备运动产生的运动数据和由通过所述外部设备输入而产生的杆量。The communication device is configured to acquire motion data generated by motion of the external device and a lever amount generated by input through the external device.
处理器,用于根据所述通信装置获取的所述运动数据得到由所述外部设备运动产生的杆量,对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。a processor, configured to obtain, according to the motion data acquired by the communication device, a rod amount generated by the movement of the external device, and combine a rod amount generated by the motion with a rod amount generated by the input to obtain a pair The amount of joystick for the aircraft.
本发明实施例第四方面公开了一种飞行器,包括:A fourth aspect of the embodiments of the present invention discloses an aircraft, including:
动力系统,用于为飞行器提供飞行动力。A power system used to provide flight power to the aircraft.
所述第三方面公开的控制设备,用于利用所述控制设备得到的对所述飞行器的控制杆量,对所述飞行器进行控制。The control device disclosed in the third aspect is configured to control the aircraft by using a control lever amount of the aircraft obtained by the control device.
本发明实施例第五方面公开了一种控制设备,包括:A fifth aspect of the embodiments of the present invention discloses a control device, including:
通信装置,用于获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量。A communication device for acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
处理器,用于对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。And a processor for fusing the amount of the rod generated by the motion and the amount of the rod generated by the input to obtain a lever amount for the aircraft.
本发明实施例第六方面公开了一种飞行器,包括:A sixth aspect of the embodiments of the present invention discloses an aircraft, including:
动力系统,用于为飞行器提供飞行动力。A power system used to provide flight power to the aircraft.
所述第五方面公开的控制设备,用于利用所述控制设备得到的对所述飞行器的控制杆量,对所述飞行器进行控制。The control device disclosed in the fifth aspect is configured to control the aircraft by using a control lever amount of the aircraft obtained by the control device.
本发明实施例第七方面公开了一种外部设备,包括处理器、运动传感器和通信装置,所述处理器分别与所述运动传感器和所述通信装置连接,其中:A seventh aspect of the embodiments of the present invention discloses an external device, including a processor, a motion sensor, and a communication device, where the processor is respectively connected to the motion sensor and the communication device, where:
所述运动传感器,用于对所述外部设备的运动进行检测,输出运动数据;The motion sensor is configured to detect motion of the external device and output motion data;
所述处理器,用于根据所述运动数据计算由所述外部设备运动产生的杆量,控制通信装置来向飞行器发送所述杆量,并利用所述杆量对飞行器进行控制;The processor is configured to calculate a rod amount generated by the movement of the external device according to the motion data, control a communication device to send the rod amount to an aircraft, and control the aircraft by using the rod amount;
所述通信装置,用于将所述运动产生的杆量发送给飞行器。The communication device is configured to transmit the amount of the rod generated by the motion to the aircraft.
本发明实施例通过获取由外部设备运动产生的杆量和由通过外部设备输入而产生的杆量,并对运动产生的杆量和输入而产生的杆量进行融合,得到对飞行器的控制杆量,按照控制杆量对飞行器进行控制,从而可以实现多个 控制杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。The embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input. , the aircraft can be controlled according to the amount of the control rod, so that multiple Automatic fusion of the amount of joystick and automatic switching between various control modes and control devices.
附图说明DRAWINGS
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying for creative labor.
图1是本发明实施例公开的一种无人机控制系统的结构示意图;1 is a schematic structural diagram of a drone control system disclosed in an embodiment of the present invention;
图2是本发明实施例公开的一种杆量控制的方法的流程示意图;2 is a schematic flow chart of a method for controlling the amount of the rod disclosed in the embodiment of the present invention;
图3是本发明实施例公开的一种手势控制飞行器的示意图;3 is a schematic diagram of a gesture control aircraft disclosed in an embodiment of the present invention;
图4是本发明实施例公开的另一种手势控制飞行器的示意图;4 is a schematic diagram of another gesture control aircraft disclosed in an embodiment of the present invention;
图5是本发明实施例公开的又一种手势控制飞行器的示意图;FIG. 5 is a schematic diagram of still another gesture control aircraft disclosed in an embodiment of the present invention; FIG.
图6是本发明实施例公开的一种杆量控制的装置的结构示意图;6 is a schematic structural diagram of an apparatus for controlling the amount of the rod disclosed in the embodiment of the present invention;
图7是本发明实施例公开的一种控制设备的结构示意图;7 is a schematic structural diagram of a control device according to an embodiment of the present invention;
图8是本发明实施例公开的另一种控制设备的结构示意图;8 is a schematic structural diagram of another control device according to an embodiment of the present invention;
图9是本发明实施例公开的一种外部设备的结构示意图。FIG. 9 is a schematic structural diagram of an external device according to an embodiment of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
以下对本发明的描述使用无人机作为飞行器的示例。对于本领域技术人员将会显而易见的是,可以不受限制地使用其他类型的飞行器。The following description of the invention uses a drone as an example of an aircraft. It will be apparent to those skilled in the art that other types of aircraft can be used without limitation.
如图1所示,图1是根据本发明一种实施例的无人机控制系统的示意图。本实施例的无人机系统包括无人机1、穿戴式设备2、遥控器3,其中无人机1包括飞行主体、云台以及成像设备。在本实施例中,飞行主体包括多个旋翼以及驱动旋翼转动的旋翼电机,由此提供无人机1飞行所需动力。成像设备 通过云台搭载于飞行主体上。成像设备用于在无人机的飞行过程中进行图像或视频拍摄,包括但不限于多光谱成像仪、高光谱成像仪、可见光相机及红外相机等。云台为多轴传动及增稳系统,包括多个转动轴和云台电机。云台电机通过调整转动轴的转动角度来对成像设备的拍摄角度进行补偿,并通过设置适当的缓冲机构来防止或减小成像设备的抖动。当然,在其他实施例中,成像设备可以直接或通过其他方式搭载于飞行主体上。在图1所示的无人机控制系统中,存在穿戴式设备和遥控器两种外部设备对飞行器进行控制,穿戴式设备2内置运动传感器,当穿戴式设备随着操作者的手运动时,运动传感器会感知手的运动并输出相应的运动数据,并根据所述运动数据计算出由穿戴式设备运动产生的杆量,并根据所述杆量对无人机进行相应的控制。另外,遥控器上设置有摇杆、按键(虚拟按键或实体按键)和拨轮,通过遥控器的摇杆、按键(虚拟按键或实体按键)和拨轮的输入可以得到杆量,所述杆量可以对无人机进行控制。As shown in FIG. 1, FIG. 1 is a schematic diagram of a drone control system in accordance with an embodiment of the present invention. The drone system of the present embodiment includes a drone 1, a wearable device 2, and a remote controller 3, wherein the drone 1 includes a flight body, a pan/tilt head, and an image forming apparatus. In the present embodiment, the flying body includes a plurality of rotors and a rotor motor that drives the rotor to rotate, thereby providing the power required for the drone 1 to fly. Imaging equipment It is mounted on the main body of the flight through the gimbal. The imaging device is used for image or video capture during flight of the drone, including but not limited to multi-spectral imagers, hyperspectral imagers, visible light cameras, and infrared cameras. The pan/tilt is a multi-axis transmission and stabilization system, including multiple rotating shafts and pan/tilt motors. The pan/tilt motor compensates the shooting angle of the imaging device by adjusting the rotation angle of the rotating shaft, and prevents or reduces the jitter of the imaging device by setting an appropriate buffer mechanism. Of course, in other embodiments, the imaging device can be mounted on the flying body either directly or by other means. In the drone control system shown in FIG. 1, there are two external devices, a wearable device and a remote controller, which control the aircraft. The wearable device 2 has a built-in motion sensor. When the wearable device moves with the operator's hand, The motion sensor senses the motion of the hand and outputs corresponding motion data, and calculates the amount of the rod generated by the movement of the wearable device based on the motion data, and controls the drone according to the amount of the rod. In addition, the remote controller is provided with a rocker, a button (virtual button or physical button) and a dial wheel, and the lever can be obtained by inputting a rocker, a button (virtual button or a physical button) of the remote controller and a dial, the lever The amount can control the drone.
请参阅图2,为本发明实施例公开的一种杆量控制的方法的流程示意图。本实施例中所描述的杆量控制的方法,包括:Please refer to FIG. 2 , which is a schematic flowchart diagram of a method for controlling the amount of the rod according to an embodiment of the present invention. The method for controlling the amount of the rod described in this embodiment includes:
201、获取由外部设备运动产生的杆量和通过所述外部设备输入而产生的杆量。201. Acquire an amount of the rod generated by the movement of the external device and the amount of the rod generated by the input from the external device.
其中,外部设备具体可以包括:手表、手环等穿戴式设备或手持式设备,也可以智能手机、平板电脑、遥控器、以及地面控制站及其组合等。The external device may specifically include: a wearable device such as a watch or a wristband or a handheld device, or a smart phone, a tablet computer, a remote controller, a ground control station, a combination thereof, and the like.
某些外部设备配置了运动传感器(如惯性测量单元IMU),运动传感器可以感知外部设备的运动和动作,并根据所述运动或动作对飞行器进行控制,具体地,当外部设备运动或者随着用户做了相应的动作时,运动传感器会输出对应的运动数据,根据所述的运动数据可以得到杆量,所述杆量可以对飞行器进行控制,将所述杆量作为由外部设备运动产生的杆量。以手环为例,手环内部设置了运动传感器,用户佩戴手环,当用户使用佩戴手环的手做了预设的动作时,运动传感器会输出运动数据,可以根据手环的运动数据计算出由手环做了预设动作所产生的杆量,可以使用该杆量对飞行器进行控制。具体表现为用户可以用手势动作控制飞行器。 Some external devices are equipped with motion sensors (such as inertial measurement unit IMU), which can sense the motion and motion of the external device and control the aircraft according to the motion or action, in particular, when the external device moves or follows the user When the corresponding action is performed, the motion sensor outputs corresponding motion data, and according to the motion data, the amount of the rod can be obtained, and the amount of the rod can control the aircraft, and the rod amount is used as a rod generated by the movement of the external device. the amount. Taking the wristband as an example, a motion sensor is arranged inside the wristband, and the user wears a wristband. When the user performs a preset motion using the hand wearing the wristband, the motion sensor outputs motion data, which can be calculated according to the motion data of the wristband. The amount of the rod generated by the preset action of the bracelet can be used to control the aircraft. Specifically, the user can control the aircraft with gestures.
由外部设备运动产生的杆量具体可以包括:由手表、手环等穿戴式设备运动(比如用户佩戴手表、手环等穿戴式设备时做了某些手势动作)或持有式设备运动产生的杆量。The amount of the rod generated by the movement of the external device may specifically include: movement by a wearable device such as a watch or a wristband (for example, when a user wears a wearable device such as a wristwatch or a wristband, and performs some gestures) or a movement of the holding device. Rod amount.
某些外部设备配置了按键、摇杆、拨轮等输入接口,外部设备的输入可以包括外部设备的按键输入、外部设备的摇杆输入、外部设备的拨轮输入中的一种或多种,其中按键具体可以包括实体的物理按键以及交互界面中的触摸按键等,用户可以对外部设备的按键、摇杆、拨轮等进行操作,外部设备会得到相应的杆量,所述杆量可以对飞行器进行控制,将所述杆量作为由外部设备输入产生的杆量。Some external devices are equipped with input interfaces such as buttons, joysticks, and dials. The input of the external device may include one or more of key input of an external device, a rocker input of an external device, and a dial input of an external device. The button may specifically include a physical button of the entity and a touch button in the interaction interface, and the user may operate the button, the joystick, the dial, and the like of the external device, and the external device may obtain a corresponding amount of the rod, and the amount of the rod may be The aircraft is controlled to use the amount of the rod as the amount of the rod generated by the input from the external device.
通过外部设备输入而产生的杆量具体可以包括:通过手表、手环、智能手机、平板电脑、遥控器和地面控制站等中的一种或多种输入而产生的杆量,例如,通过手表、手环、智能手机、平板电脑、遥控器和地面控制站以其组合的按键、摇杆、拨轮输入产生的杆量,其中,按键具体可以包括实体的物理按键以及交互界面中的触摸按键等。The amount of the rod generated by the input of the external device may specifically include the amount of the rod generated by one or more inputs of the watch, the wristband, the smartphone, the tablet, the remote controller, and the ground control station, for example, through the watch. The wristband, the smart phone, the tablet computer, the remote controller and the ground control station generate the amount of the lever with the combination of the button, the joystick and the dial wheel. The button may specifically include the physical button of the entity and the touch button in the interaction interface. Wait.
202、对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。202. Align the amount of the rod generated by the motion with the amount of the rod generated by the input to obtain a lever amount for the aircraft.
具体地,在飞行控制系统中,飞行器可以接收由外部设备运动产生的杆量和通过外部设备输入产生的杆量,飞行器可以将所述运动产生的杆量和所述输入产生的杆量进行融合,得到对飞行器的控制杆量,利用所述融合后得到的控制杆量来对飞行器进行控制。Specifically, in the flight control system, the aircraft can receive the amount of the rod generated by the movement of the external device and the amount of the rod generated by the external device input, and the aircraft can fuse the amount of the rod generated by the movement with the amount of the rod generated by the input. The amount of the control rod for the aircraft is obtained, and the amount of the control rod obtained by the fusion is used to control the aircraft.
可选地,利用第一网络模型获取所述运动产生的杆量、所述输入产生的杆量中每一个杆量对应的权重系数,获取所述运动产生的杆量、所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。Optionally, acquiring, by using the first network model, a weight amount corresponding to each of the amount of the rod generated by the motion, and the amount of the rod generated by the input, acquiring the amount of the rod generated by the motion, and the input The product of each of the amount of the rod and the corresponding weighting factor, superimposed by the product to obtain a superimposed amount, which is used as a lever amount for the aircraft.
具体地,以由手环运动产生的杆量A、手环上通过手环上按键输入产生的杆量B和通过遥控器上按键输入产生的杆量C为例,当飞行控制系统中,存在这三种杆量对飞行器进行控制时,可以利用第一网络模型获取出由手环运动产生的杆量、手环上通过按键输入产生的杆量和遥控器上通过按键输入产生的杆量中每一个对应的权重系数,分别为Ka、Kb和Kc,对飞行器的控制杆量 R=Ka*A+Kb*B+Kc*C,利用所述控制杆量R对飞行器进行控制。Specifically, the amount of the lever A generated by the movement of the bracelet, the amount of the lever B generated by the input of the button on the wristband, and the amount of the lever C generated by the input of the button on the remote controller are taken as an example, when the flight control system exists When the three rods are used to control the aircraft, the first network model can be used to obtain the amount of the rod generated by the movement of the bracelet, the amount of the rod generated by the button input on the bracelet, and the amount of the rod generated by the button input on the remote controller. Each corresponding weight coefficient is K a , K b and K c , respectively, and the amount of control rod for the aircraft R=K a *A+K b *B+K c *C, using the lever amount R to the aircraft Take control.
可选地,将与所述外部设备运动相关联的参数、由通过所述外部设备输入而产生的杆量输入第一网络模型,获取所述运动产生的杆量、所述输入产生的杆量中每一个杆量对应的权重系数。Optionally, the parameter associated with the motion of the external device, the amount of the rod generated by the input of the external device is input to the first network model, and the amount of the rod generated by the motion is obtained, and the amount of the rod generated by the input is obtained. The weight coefficient corresponding to each rod amount in the middle.
具体地,如图3所述,外部设备以手环为例,用户佩戴手环,当用户想进入利用手环的运动控制飞行器的模式时(即手势控制模式),可以根据需要作如下规定:第一步,用户用手指向飞行器;第二步,完成预设的动作G,比如转动佩戴有手环的手腕,当用户完成这两个步骤后,用户即可利用手环的运动来对飞行器进行控制,其中当手环与飞行器的连线和手环的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角α小于一个预设值时,则认为用户已经用手指指向飞行器。将与手环运动相关联的预设的动作G和夹角α、由通过所述外部设备输入而产生的杆量输入第一网络模型,即可得到由手环运动产生的杆量和由通过所述外部设备输入而产生的杆量对应地权重系数,在得到权重系数后,即可利用上述方法计算得到对飞行器的控制杆量,在此不再赘述。Specifically, as shown in FIG. 3, the external device takes the wristband as an example, and the user wears the wristband. When the user wants to enter the mode of controlling the aircraft by using the motion of the wristband (ie, the gesture control mode), the following can be specified as needed: In the first step, the user points the aircraft to the hand; in the second step, the preset action G is completed, such as turning the wrist wearing the wristband. When the user completes the two steps, the user can use the motion of the wristband to align the aircraft. Controlling, wherein when the angle between the wristband and the aircraft and the axial direction of an axis of the coordinate system defined by the motion sensor of the bracelet is less than a preset value, the user is considered to have pointed with the finger Aircraft. By inputting the preset motion G and the angle α associated with the bracelet motion, the amount of the rod generated by the input from the external device is input to the first network model, and the amount of the rod generated by the motion of the bracelet is obtained. The amount of the rod generated by the input of the external device corresponds to the weight coefficient. After the weight coefficient is obtained, the amount of the control rod for the aircraft can be calculated by the above method, and details are not described herein.
可选地,将预设的权重系数组合作为第一网络模型的目标输出,将与所述权重系数组合对应的所述外部设备运动相关联的参数和所述输入而产生的杆量作为出入,来对所述第一网络模型进行训练。Optionally, the preset weight coefficient is combined as the target output of the first network model, and the parameter associated with the external device motion corresponding to the weight coefficient combination and the amount of the rod generated by the input are used as the input and output. The first network model is trained.
具体地,在使用第一网络来获取由外部设备运动产生的杆量和由外部设备输入而产生的杆量中每一个杆量对应的权重系数,要对第一网络进行充分的训练,则需要采集大量的与预设的权重系数组合对应的所述外部设备运动相关联的参数、由通过所述外部设备输入而产生的杆量来对第一网络进行训练。其中,当输入的维度很低时,输入的状态空间可以人为地抽样列举,目标输出则可以通过专家经验标注合理的权重系数组合。当训练完成后,当第一网络模型输入所述外部设备运动相关联的参数、由通过所述外部设备输入而产生的杆量时,将会输出与之对应的权重系数。Specifically, when the first network is used to acquire the weight coefficient corresponding to each of the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input from the external device, it is necessary to adequately train the first network. A plurality of parameters associated with the movement of the external device corresponding to the preset weight coefficient combination are collected, and the first network is trained by the amount of the rod generated by the input from the external device. Among them, when the input dimension is very low, the input state space can be artificially sampled, and the target output can be labeled with a reasonable weight coefficient by expert experience. When the training is completed, when the first network model inputs the parameters associated with the movement of the external device and the amount of the rod generated by the input from the external device, the weight coefficient corresponding thereto is output.
可选地,获取外部设备产生的杆量包括:获取由所述外部设备运动产生的运动数据,根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量,其中,以特定参考点为所 述球体坐标系的原点。Optionally, acquiring the amount of the rod generated by the external device comprises: acquiring motion data generated by the motion of the external device, and acquiring a tangential speed rod amount and a radial direction controlled by the aircraft on the sphere coordinate system according to the motion data. a speed lever amount, converting the tangential speed lever amount and the radial speed lever amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device, wherein the specific reference point is The origin of the sphere coordinate system.
可选地,特定的参考点以佩戴或持有外部设备的用户。Optionally, a specific reference point is for a user wearing or holding an external device.
其中如图4所示,外部设备以手环为例,以佩戴手环的用户为原点,手环配置有运动传感器,当用户的手做了相应的动作时,手环会随着用户的手产生相应的运动,运动传感器会输出相应的运动数据,在以佩戴手环的用户为原点的球体坐标系上,可以根据运动数据得到切向速度杆量Vt和径向速度杆量Vr,最后可以根据人和手环的位置关系,将处于球体坐标系上的切向速度杆量Vt和径向速度杆量Vr转换成直角坐标下的杆量Vx、Vy、Vz,杆量Vx、Vy、Vz则为由手环运动产生的杆量。As shown in FIG. 4, the external device takes the wristband as an example, and the user wearing the wristband is taken as the origin, and the wristband is equipped with a motion sensor. When the user's hand performs the corresponding action, the wristband will follow the user's hand. The corresponding motion is generated, and the motion sensor outputs corresponding motion data. On the sphere coordinate system with the user wearing the bracelet as the origin, the tangential speed lever amount V t and the radial velocity lever amount V r can be obtained according to the motion data. Finally, according to the positional relationship between the person and the bracelet, the tangential speed lever amount V t and the radial speed lever amount V r in the spherical coordinate system can be converted into the rod amounts V x , V y , V z in the Cartesian coordinates. The amount of rods V x , V y , and V z is the amount of the rod generated by the movement of the bracelet.
可选地,根据所述运动数据获取在所述飞行器的第一控制模式下的控制量,根据所述第一控制模式的控制量得到所述切向速度杆量;Optionally, acquiring a control quantity in the first control mode of the aircraft according to the motion data, and obtaining the tangential speed lever amount according to the control quantity of the first control mode;
根据所述运动数据获取在所述飞行器的第二控制模式下的控制量,根据所述第二控制模式的控制量得到所述径向速度杆量。Obtaining a control amount in a second control mode of the aircraft based on the motion data, and obtaining the radial velocity lever amount according to a control amount of the second control mode.
具体地,所述第一控制模式为控制所述飞行器在以所述特定参考点为球心的球面上切向飞行,所述第二控制模式为控制所述飞行器在所述飞行器与所述特定参考点之间的连线上径向飞行,如图4所示,外部设备以手环为例,特定的参考点以手环为例,当用户的手做了相应的动作时,第一控制模式为控制飞行器在以手环为球心,以手环和飞行器的初始距离为半径的球面上切向飞行,第二控制模式为控制飞行器在以手环为球心,在飞行器与手环的运动传感器所规定的坐标系的某个轴线上径向地飞行,具体表现为飞行器朝着远离或靠近用户的方向飞行。当用户佩戴手环的手做了特定动作时,在第一控制模式中,可以根据手环的运动传感器输出的运动数据计算出第一控制模式的控制量,根据该控制量计算出处于球体坐标系上的切向速度杆量Vt,在第二控制模式中,可以根据手环的运动传感器输出的运动数据计算出第二控制模式的控制量,根据该控制量计算出处于球体坐标系上的径向速度杆量Vr,根据上述方法计算出由手环运动产生的杆量,在此不再赘述。Specifically, the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere, and the second control mode is to control the aircraft at the aircraft and the specific The radial flight on the connecting line between the reference points, as shown in Fig. 4, the external device takes the wristband as an example, and the specific reference point takes the wristband as an example. When the user's hand performs the corresponding action, the first control The mode is to control the aircraft in a tangential flight with a wristband as the center of the sphere and a radius of the initial distance between the wristband and the aircraft. The second control mode is to control the aircraft in the wristband as the center of the sphere, in the aircraft and the wristband. The axis of the coordinate system defined by the motion sensor flies radially, specifically as the aircraft flies away from or near the user. When the user wears the wristband to perform a specific action, in the first control mode, the control amount of the first control mode can be calculated according to the motion data output by the motion sensor of the wristband, and the spherical coordinate is calculated according to the control amount. The tangential speed lever amount V t in the system , in the second control mode, the control amount of the second control mode can be calculated according to the motion data output by the motion sensor of the wristband, and the spherical coordinate system is calculated according to the control amount The radial velocity rod amount V r is calculated according to the above method, and the amount of the rod generated by the movement of the bracelet is not described here.
可选地,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的 角度。The control amount of the second control mode is that the external device rotates on the axis of the certain axis angle.
具体地,如图4所示,外部设备以手环为例,特定的参考点以手环为例,第一控制模式的控制量为所述飞行器与所述特定参考点之间的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角,此时,第一控制模式的控制量即是手环和飞行器的连线与手环所规定的坐标系的某个轴线(X轴)的轴向(X轴的正向)之间的夹角α,可以不断地采集夹角α,将其输入PD控制器可以计算出径向速度杆量Vr,另外,可选地,可以对PD控制器的输出进行滤波和限幅以后得到径向速度杆量Vr;第二控制模式的控制量为所述外部设备以所述某个轴线(X轴)为轴转动的角度,此时,第二控制模式的控制量即是手环以所述某个轴线为轴时转动的角度ω,可以不断地采集夹角ω,将其输入PD控制器可以计算出径向速度杆量Vr,另外,可选地,可以对PD控制器的输出进行滤波和限幅以后得到径向速度杆量VrSpecifically, as shown in FIG. 4, the external device takes a wristband as an example, and a specific reference point takes a wristband as an example. The control amount of the first control mode is a connection between the aircraft and the specific reference point. The angle between the axes of an axis of the coordinate system defined by the motion sensor of the external device. At this time, the control amount of the first control mode is the coordinate system defined by the connection of the wristband and the aircraft and the wristband. The angle α between the axial direction of the certain axis (X-axis) (the positive direction of the X-axis) can continuously collect the angle α, and input it into the PD controller to calculate the radial velocity rod amount V r . In addition, optionally, the output of the PD controller may be filtered and limited to obtain a radial velocity lever amount Vr ; the control amount of the second control mode is the external device with the certain axis (X-axis) For the angle of rotation of the shaft, at this time, the control amount of the second control mode is the angle ω of the rotation of the wristband when the certain axis is the axis, and the angle ω can be continuously collected, and the input to the PD controller can be calculated. the amount of the radial speed of the rod V r, additionally, alternatively, may enter the output of the PD controller Obtained after filtering and limiting the amount of radial velocity of the rod V r.
可选地,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
具体地,如图5所示,外部设备以手环为例,特定的参考点以手环为例,第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角,此时,第一控制模式的控制量即是手环和飞行器的连线与手环的运动传感器所规定的坐标系的某个轴线(X轴)的轴向(X轴的正向)之间之间的夹角α,可以不断地采集夹角α,将其输入PD控制器可以计算出径向速度杆量Vr,另外,可选地,可以对PD控制器的输出进行滤波和限幅以后得到径向速度杆量Vr;第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离,此时,第二控制模式的控制量即是手环在所述某个轴线(X轴)上运动的距离d,可以不断地采集距离d,将其输入PD控制器可以计算出径向速度杆量Vr,另外,可选地,可以对PD控制器的输出进行滤波和限幅以后得到径向速度杆量VrSpecifically, as shown in FIG. 5, the external device takes a wristband as an example, and a specific reference point takes a wristband as an example. The control amount of the first control mode is a connection between the aircraft and the specific reference point, and an external device. The angle between the axes of an axis of the coordinate system defined by the motion sensor. At this time, the control amount of the first control mode is the coordinate defined by the motion sensor of the wristband and the aircraft connection and the wristband. The angle α between the axis of the axis (X-axis) of the system (the positive direction of the X-axis) can continuously collect the angle α, and input it into the PD controller to calculate the radial velocity V r , in addition, optionally, the output of the PD controller may be filtered and limited to obtain a radial velocity rod amount V r ; the control amount of the second control mode is that the external device is on the certain axis The moving distance, at this time, the control amount of the second control mode is the distance d of the wristband moving on the certain axis (X-axis), and the distance d can be continuously collected, and the input to the PD controller can be calculated. radial velocity rod amount V r, additionally, alternatively, may be input to the PD controller After filtering and limiting the amount of the lever to obtain the radial velocity V r.
可选地,获取由所述外部设备运动产生的运动数据,利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。 Optionally, the motion data generated by the motion of the external device is acquired, and the amount of the rod generated by the motion of the external device corresponding to the motion data is acquired by using the second network model.
具体地,外部设备以手环为例,当佩戴手环的用户运动时,获取与所述运动相对应的运动数据,将所述运动数据输入第二网络模型,第二网络模型即可输出相对应的由所述外部设备运动产生的杆量,另外,还可以利用所述运动数据获取一个或多个控制量,将所述一个或多个控制量输入第二网络模型,网络模型即可输出相对应的由所述外部设备运动产生的杆量。Specifically, the external device takes the wristband as an example. When the user wearing the wristband moves, the motion data corresponding to the motion is acquired, and the motion data is input into the second network model, and the second network model can output the phase. Corresponding the amount of the rod generated by the movement of the external device. In addition, the motion data may be used to acquire one or more control quantities, and the one or more control quantities are input into the second network model, and the network model can be output. Corresponding rod amounts resulting from the movement of the external device.
可选地,根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到切向速度杆量;Optionally, acquiring a control quantity of the first control mode of the aircraft according to the motion data, and inputting a control quantity of the first control mode into a second network model to obtain a tangential speed lever amount;
根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到径向速度杆量。And acquiring a control amount of the second control mode of the aircraft according to the motion data, and inputting a control amount of the second control mode into the second network model to obtain a radial speed lever amount.
具体地,如图4所示,外部设备以手环为例,以手环为球心,所述第一控制模式为控制所述飞行器在以所述特定参考点为球心的球面上切向飞行,所述第二控制模式为控制所述飞行器在所述飞行器与所述特定参考点之间的连线上径向飞行,第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角,此时,第一控制模式的控制量即是手环和飞行器的连线与手环的运动传感器所规定的坐标系的某个轴线(X轴)的轴向(X轴的正向)之间的夹角α,将夹角α输入第二网络模型,即可得到与所述夹角α对应的切向速度杆量Vt,第二控制模式的控制量即是手环以所述某个轴线(X轴)为轴时转动的角度ω,将角度ω输入第二网络模型,即可得到与所述角度ω对应的径向速度杆量Vr,然后利用上述方法得到由手环运动的杆量,在此不再赘述。其中,在使用第二网络模型之前,应该采集大量的与预设的切向速度杆量对应的第一控制模式的控制量(比如夹角α),采集与预设的径向速度杆量对应的第一控制模式的控制量(比如角度ω)对第二网络模型进行训练,完成训练以后,即可利用第二网络模型输出与第一控制模式的控制量、第二控制模式的控制量对应的切向速度杆量Vt和径向速度杆量VrSpecifically, as shown in FIG. 4, the external device takes a wristband as an example, and the wristband is a center of the ball, and the first control mode is to control the tangential direction of the aircraft on a spherical surface with the specific reference point as a center of the sphere. Flying, the second control mode is to control the aircraft to fly radially on a line between the aircraft and the specific reference point, the control amount of the first control mode is the aircraft and the specific reference point The angle between the connection and the axial direction of an axis of the coordinate system defined by the motion sensor of the external device. At this time, the control amount of the first control mode is the connection between the wristband and the aircraft and the wristband. The angle α between the axial direction (the positive direction of the X-axis) of an axis (X-axis) of the coordinate system defined by the motion sensor, and the angle α is input to the second network model to obtain the angle The tangential velocity rod amount V t corresponding to α, and the control amount of the second control mode is the angle ω of the rotation of the bracelet when the certain axis (X axis) is the axis, and the angle ω is input to the second network model, that is, the angle ω can be obtained with an amount of radial velocity V r corresponding to the lever, then the method described above The amount of movement of the ring by a hand lever, not described herein again. Wherein, before using the second network model, a large amount of control quantity (such as the angle α) corresponding to the preset tangential speed rod amount should be collected, and the collection corresponds to the preset radial speed rod amount. The control quantity of the first control mode (such as the angle ω) trains the second network model, and after the training is completed, the second network model output can be used to correspond to the control quantity of the first control mode and the control quantity of the second control mode. The tangential speed rod amount V t and the radial speed rod amount V r .
本发明实施例通过获取由外部设备运动产生的杆量和由通过外部设备输入而产生的杆量,并对运动产生的杆量和输入而产生的杆量进行融合,得到对飞行器的控制杆量,按照控制杆量对飞行器进行控制,从而可以实现多个控制杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。 The embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input. The aircraft is controlled according to the amount of the control rod, so that the automatic fusion of the plurality of control levers can be realized, and the automatic switching between the various control modes and the control devices can be realized.
本发明实施例还公开了一种计算机存储介质,该计算机存储介质中存储有程序指令,所述程序执行时可包括如图2对应实施例中任一项的杆量控制的方法的部分或全部步骤。The embodiment of the invention further discloses a computer storage medium, wherein the computer storage medium stores program instructions, and the program execution may include part or all of the method of the rod amount control according to any one of the corresponding embodiments of FIG. step.
请参阅图6,为本发明实施例公开的一种杆量控制的装置的结构示意图。本实施例中所描述的杆量控制的装置,包括:Please refer to FIG. 6 , which is a schematic structural diagram of an apparatus for controlling the amount of the rod according to an embodiment of the present invention. The device for controlling the amount of the rod described in this embodiment includes:
获取模块601,用于获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量。The acquisition module 601 is configured to acquire the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
处理模块602,用于对所述获取模块获取的所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。The processing module 602 is configured to fuse the amount of the rod generated by the motion acquired by the acquiring module with the amount of the rod generated by the input to obtain a lever amount for the aircraft.
其中,所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控制站中的一种或多种输入而产生的杆量。Wherein, the amount of the rod generated by the input includes the amount of the rod generated by one or more inputs of the watch, the wristband, the remote controller, the smart phone, and the ground control station.
可选的,所述处理模块602,具体用于利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数。Optionally, the processing module 602 is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input.
所述处理模块602,具体用于获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。The processing module 602 is specifically configured to acquire a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount. The amount of superposition is used as the amount of the lever for the aircraft.
可选的,所述处理模块602,具体用于将与所述外部设备运动相关联的参数和由通过所述外部设备输入而产生的杆量输入第一网络模型,获取所述运动产生的杆量和所述输入产生的杆量中每一个杆量对应的权重系数。Optionally, the processing module 602 is configured to input a parameter associated with the motion of the external device and a bar amount generated by inputting by the external device into the first network model to obtain the pole generated by the motion. A weight coefficient corresponding to each of the amount of the rods generated by the input.
可选的,所述处理模块602,还用于将预设的权重系数组合作为所述第一网络模型的目标输出,将与所述权重系数组合对应的所述外部设备运动相关联的参数和所述输入而产生的杆量作为输入,来对所述第一网络模型进行训练。Optionally, the processing module 602 is further configured to combine preset weight coefficients as a target output of the first network model, and associate parameters related to the external device motion corresponding to the weight coefficient combination. The amount of the rod generated by the input is used as an input to train the first network model.
可选的,所述处理模块602,还用于在训练所述第一网络模型时,当与所述外部设备运动相关联的参数和所述输入而产生的杆量同时存在时,将除优先级最高的杆量以外的杆量对应的权重系数全部置零。Optionally, the processing module 602 is further configured to: when training the first network model, when a parameter associated with the motion of the external device and a bar amount generated by the input are simultaneously present, The weight coefficients corresponding to the amount of the rod other than the highest rod amount are all set to zero.
可选的,所述获取模块601,具体用于获取由所述外部设备运动产生的运动数据,根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度 杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量。Optionally, the acquiring module 601 is configured to acquire motion data generated by the motion of the external device, and acquire, according to the motion data, a tangential speed of the aircraft control on a sphere coordinate system. The amount of the rod and the amount of the radial speed rod convert the amount of the tangential speed rod and the amount of the radial speed rod to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device.
可选的,以特定参考点为所述球体坐标系的原点。Optionally, the specific reference point is the origin of the sphere coordinate system.
可选的,所述特定参考点为佩戴或者持有所述外部设备的用户。Optionally, the specific reference point is a user who wears or holds the external device.
可选的,所述获取模块601,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到所述切向速度杆量。Optionally, the acquiring module 601 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain the tangential speed lever amount according to the control quantity of the first control mode. .
所述获取模块601,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到所述径向速度杆量。The acquiring module 601 is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and obtain the radial speed lever amount according to the control quantity of the second control mode.
其中,所述第一控制模式为控制所述飞行器在以所述特定参考点为球心的球面上切向飞行,所述第二控制模式为控制所述飞行器在所述飞行器与所述特定参考点之间的连线上径向飞行。Wherein the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere, and the second control mode is to control the aircraft at the aircraft and the specific reference Radial flight on the line between points.
可选的,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
可选的,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
可选的,所述获取模块601,具体用于获取由所述外部设备运动产生的运动数据,利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。Optionally, the obtaining module 601 is configured to acquire motion data generated by the motion of the external device, and acquire, by using a second network model, a lever amount generated by the motion of the external device corresponding to the motion data.
可选的,所述获取模块601,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;Optionally, the acquiring module 601 is configured to acquire, according to the motion data, a control quantity of the first control mode of the aircraft, and input the control quantity of the first control mode into the second network model, to obtain a tangential speed lever amount controlled by the aircraft on the sphere coordinate system;
所述获取模块601,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在所述球体坐标系上对所述飞行器控制的径向速度杆量; The acquiring module 601 is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and input a control quantity of the second control mode into the second network model, to obtain the The amount of radial velocity rods controlled by the aircraft on the sphere coordinate system;
所述获取模块601,具体用于根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量;The obtaining module 601 is specifically configured to obtain a rod amount generated by the motion according to the tangential speed lever amount and the radial speed lever amount;
其中,以特定的参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
可选的,所述第一网络模型和所述第二网络模型为人工神经网络。Optionally, the first network model and the second network model are artificial neural networks.
需要说明的是,本发明实施例的杆量控制的装置的各功能模块的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可以参照上述方法实施例的相关描述,此处不再赘述。It should be noted that the functions of the functional modules of the device for controlling the amount of the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiments, and the specific implementation process may refer to the related description of the foregoing method embodiments, where Let me repeat.
本发明实施例通过获取由外部设备运动产生的杆量和由通过外部设备输入而产生的杆量,并对运动产生的杆量和输入而产生的杆量进行融合,得到对飞行器的控制杆量,按照控制杆量对飞行器进行控制,从而可以实现多个控制杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。The embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input. The aircraft is controlled according to the amount of the control rod, so that the automatic fusion of the plurality of control levers can be realized, and the automatic switching between the various control modes and the control devices can be realized.
请参阅图7,为本发明实施例公开的一种控制设备的结构示意图。本实施例中所描述的控制设备,包括:通信装置701、处理器702和存储器703。上述通信装置701、处理器702和存储器703通过总线连接。FIG. 7 is a schematic structural diagram of a control device according to an embodiment of the present invention. The control device described in this embodiment includes a communication device 701, a processor 702, and a memory 703. The communication device 701, the processor 702, and the memory 703 are connected by a bus.
上述处理器702可以是中央处理单元(Central Processing Unit,CPU),该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor 702 may be a central processing unit (CPU), and the processor may be another general-purpose processor, a digital signal processor (DSP), or an application specific integrated circuit (ASIC). ), a Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
上述存储器703可以包括只读存储器和随机存取存储器,并向处理器702提供指令和数据。存储器703的一部分还可以包括非易失性随机存取存储器。其中:The above-described memory 703 may include read only memory and random access memory, and provides instructions and data to the processor 702. A portion of the memory 703 may also include a non-volatile random access memory. among them:
通信装置701,用于获取由外部设备运动产生的运动数据和由通过所述外部设备输入而产生的杆量。The communication device 701 is configured to acquire motion data generated by motion of the external device and a lever amount generated by input through the external device.
处理器702,用于根据所述通信装置701获取的所述运动数据得到由所述外部设备运动产生的杆量,对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。 The processor 702 is configured to obtain, according to the motion data acquired by the communication device 701, a rod amount generated by the movement of the external device, and combine a rod amount generated by the motion with a rod amount generated by the input, Get the amount of control rod for the aircraft.
可选的,所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控制站中的一种或多种输入而产生的杆量。Optionally, the amount of the rod generated by the input comprises a rod amount generated by one or more inputs of a watch, a wristband, a remote controller, a smart phone, and a ground control station.
可选的,所述处理器702,具体用于利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数。Optionally, the processor 702 is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input.
所述处理器702,具体用于获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。The processor 702 is specifically configured to obtain a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount. The amount of superposition is used as the amount of the lever for the aircraft.
可选的,所述处理器702,具体用于将与所述外部设备运动相关联的参数和由通过所述外部设备输入而产生的杆量输入第一网络模型,获取所述运动产生的杆量和所述输入产生的杆量中每一个杆量对应的权重系数。Optionally, the processor 702 is specifically configured to input a parameter associated with the motion of the external device and a bar amount generated by inputting by the external device into the first network model to obtain the pole generated by the motion. A weight coefficient corresponding to each of the amount of the rods generated by the input.
可选的,所述处理器702,还用于将预设的权重系数组合作为所述第一网络模型的目标输出,将与所述权重系数组合对应的所述外部设备运动相关联的参数和所述输入而产生的杆量作为输入,来对所述第一网络模型进行训练。Optionally, the processor 702 is further configured to combine preset weight coefficients as a target output of the first network model, and associate parameters related to the external device motion corresponding to the weight coefficient combination. The amount of the rod generated by the input is used as an input to train the first network model.
可选的,所述处理器702,还用于在训练所述第一网络模型时,当与所述外部设备运动相关联的参数和所述输入而产生的杆量同时存在时,将除优先级最高的杆量以外的杆量对应的权重系数全部置零。Optionally, the processor 702 is further configured to: when training the first network model, when a parameter associated with the motion of the external device and a bar amount generated by the input are simultaneously present, The weight coefficients corresponding to the amount of the rod other than the highest rod amount are all set to zero.
可选的,所述处理器702,具体用于根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量。以特定参考点为所述球体坐标系的原点。Optionally, the processor 702 is configured to acquire, according to the motion data, a tangential speed lever amount and a radial speed lever amount that are controlled by the aircraft on a sphere coordinate system, and the tangential speed lever amount And converting the radial velocity rod amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device. The specific reference point is the origin of the sphere coordinate system.
可选的,所述特定参考点为佩戴或者持有所述外部设备的用户。Optionally, the specific reference point is a user who wears or holds the external device.
可选的,所述处理器702,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到所述切向速度杆量。Optionally, the processor 702 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain the tangential speed bar quantity according to the control quantity of the first control mode. .
所述处理器702,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到所述径向速度杆量。The processor 702 is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and obtain the radial speed lever amount according to the control quantity of the second control mode.
其中,所述第一控制模式为控制所述飞行器在以所述特定参考点为球心的球面上切向飞行,所述第二控制模式为控制所述飞行器在所述飞行器与所述特定参考点之间的连线上径向飞行。 Wherein the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere, and the second control mode is to control the aircraft at the aircraft and the specific reference Radial flight on the line between points.
可选的,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
可选的,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
可选的,所述处理器702,具体用于利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。Optionally, the processor 702 is configured to acquire, by using a second network model, a rod amount generated by the motion of the external device corresponding to the motion data.
可选的,所述处理器702,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;Optionally, the processor 702 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a tangential speed lever amount controlled by the aircraft on the sphere coordinate system;
所述处理器702,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在所述球体坐标系上对所述飞行器控制的径向速度杆量。The processor 702 is specifically configured to acquire, according to the motion data, a control quantity in a second control mode of the aircraft, and input a control quantity of the second control mode into the second network model, to obtain the The amount of radial velocity rods controlled by the aircraft on the sphere coordinate system.
所述处理器702,具体用于根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量。The processor 702 is specifically configured to obtain the amount of the rod generated by the motion according to the tangential speed lever amount and the radial speed lever amount.
其中,以特定的参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
可选的,所述第一网络模型和所述第二网络模型为人工神经网络。Optionally, the first network model and the second network model are artificial neural networks.
本发明实施例还公开了一种飞行器,包括动力系统和图7提供的实施例中任一项的控制设备,动力系统,用于为飞行器提供飞行动力;控制设备,用于利用所述控制设备得到的对所述飞行器的控制杆量,对所述飞行器进行控制。An embodiment of the present invention also discloses an aircraft comprising a power system and a control device of any of the embodiments provided in FIG. 7, a power system for providing flight power to the aircraft, and a control device for utilizing the control device The resulting amount of control rods for the aircraft controls the aircraft.
具体实现中,本发明实施例中所描述的通信装置701、处理器702和存储器703可执行本发明实施例图2提供的杆量控制的方法中所描述的实现方式,也可执行本发明实施例图6所描述的杆量控制的装置的实现方式,在此不再赘述。In a specific implementation, the communication device 701, the processor 702, and the memory 703 described in the embodiments of the present invention may implement the implementation manner described in the method for controlling the amount of the bar provided in the embodiment of the present invention, and may also implement the implementation of the present invention. The implementation of the device for controlling the amount of the rod described in FIG. 6 is not described here.
本发明实施例通过获取由外部设备运动产生的杆量和由通过外部设备输入而产生的杆量,并对运动产生的杆量和输入而产生的杆量进行融合,得到对飞行器的控制杆量,按照控制杆量对飞行器进行控制,从而可以实现多个控制 杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。The embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input. , the aircraft is controlled according to the amount of the control rod, so that multiple controls can be realized Automatic integration of the amount of the pole and automatic switching between various control modes and control devices.
请参阅图8,为本发明实施例公开的另一种控制设备的结构示意图。本实施例中所描述的控制设备,包括:通信装置801、处理器802和存储器803。上述通信装置801、处理器802和存储器803通过总线连接。FIG. 8 is a schematic structural diagram of another control device according to an embodiment of the present invention. The control device described in this embodiment includes a communication device 801, a processor 802, and a memory 803. The communication device 801, the processor 802, and the memory 803 described above are connected by a bus.
上述处理器802可以是中央处理单元(Central Processing Unit,CPU),该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor 802 may be a central processing unit (CPU), and the processor may be another general-purpose processor, a digital signal processor (DSP), or an application specific integrated circuit (ASIC). ), a Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
上述存储器803可以包括只读存储器和随机存取存储器,并向处理器802提供指令和数据。存储器803的一部分还可以包括非易失性随机存取存储器。其中:The above memory 803 may include read only memory and random access memory, and provides instructions and data to the processor 802. A portion of the memory 803 may also include a non-volatile random access memory. among them:
通信装置801,用于获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量。The communication device 801 is configured to acquire the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device.
处理器802,用于对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。The processor 802 is configured to fuse the amount of the rod generated by the motion and the amount of the rod generated by the input to obtain a lever amount for the aircraft.
可选的,所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控制站中的一种或多种输入而产生的杆量。Optionally, the amount of the rod generated by the input comprises a rod amount generated by one or more inputs of a watch, a wristband, a remote controller, a smart phone, and a ground control station.
可选的,所述处理器802,具体用于利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数。Optionally, the processor 802 is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input.
所述处理器802,具体用于获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。The processor 802 is specifically configured to acquire a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount. The amount of superposition is used as the amount of the lever for the aircraft.
本发明实施例还公开了一种飞行器,包括动力系统和图8提供的实施例中任一项的控制设备,动力系统,用于为飞行器提供飞行动力;控制设备,用于利用所述控制设备得到的对所述飞行器的控制杆量,对所述飞行器进行控制。An embodiment of the present invention also discloses an aircraft comprising a power system and a control device according to any of the embodiments provided in FIG. 8, a power system for providing flight power to the aircraft, and a control device for utilizing the control device The resulting amount of control rods for the aircraft controls the aircraft.
具体实现中,本发明实施例中所描述的通信装置801、处理器802和存储器 803可执行本发明实施例图2提供的杆量控制的方法中所描述的实现方式,也可执行本发明实施例图6所描述的杆量控制的装置的实现方式,在此不再赘述。In a specific implementation, the communication device 801, the processor 802, and the memory are described in the embodiments of the present invention. The implementation of the apparatus described in the method for controlling the amount of the rods provided in the embodiment of the present invention can be implemented in the embodiment of the present invention. The implementation of the apparatus for controlling the amount of the rods described in FIG. 6 of the embodiment of the present invention can be performed, and details are not described herein.
本发明实施例通过获取由外部设备运动产生的杆量和由通过外部设备输入而产生的杆量,并对运动产生的杆量和输入而产生的杆量进行融合,得到对飞行器的控制杆量,按照控制杆量对飞行器进行控制,从而可以实现多个控制杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。The embodiment of the present invention obtains the amount of the lever of the aircraft by acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device, and merging the amount of the rod generated by the movement and the amount of the rod generated by the input. The aircraft is controlled according to the amount of the control rod, so that the automatic fusion of the plurality of control levers can be realized, and the automatic switching between the various control modes and the control devices can be realized.
请参阅图9,为本发明实施例公开的一种外部设备的结构示意图。本实施例中所描述的控制设备,包括:通信装置901、处理器902、运动传感器903和存储器904。上述通信装置901、处理器902、运动传感器903和存储器904通过总线连接。FIG. 9 is a schematic structural diagram of an external device according to an embodiment of the present invention. The control device described in this embodiment includes a communication device 901, a processor 902, a motion sensor 903, and a memory 904. The above communication device 901, processor 902, motion sensor 903, and memory 904 are connected by a bus.
上述处理器902可以是CPU,该处理器还可以是其他通用处理器、DSP、ASIC、FPGA或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor 902 may be a CPU, and the processor may also be other general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
上述存储器904可以包括只读存储器和随机存取存储器,并向处理器902提供指令和数据。存储器904的一部分还可以包括非易失性随机存取存储器。The memory 904 described above can include read only memory and random access memory and provides instructions and data to the processor 902. A portion of the memory 904 may also include a non-volatile random access memory.
上述运动传感器903可以是IMU、三轴加速度传感器、三轴陀螺仪以及重力传感器等。The motion sensor 903 described above may be an IMU, a three-axis acceleration sensor, a three-axis gyroscope, a gravity sensor, or the like.
运动传感器903,用于对所述外部设备的运动进行检测,输出运动数据;a motion sensor 903, configured to detect motion of the external device, and output motion data;
处理器902,用于根据所述运动数据计算由所述外部设备运动产生的杆量,控制通信装置来向飞行器发送所述杆量,并利用所述杆量对飞行器进行控制;The processor 902 is configured to calculate a rod amount generated by the movement of the external device according to the motion data, control a communication device to send the rod amount to an aircraft, and control the aircraft by using the rod amount;
通信装置901,用于将所述运动产生的杆量发送给飞行器。The communication device 901 is configured to transmit the amount of the rod generated by the motion to the aircraft.
可选的,所述处理器902,具体用于根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量;Optionally, the processor 902 is configured to acquire, according to the motion data, a tangential speed lever amount and a radial speed lever amount that are controlled by the aircraft on a sphere coordinate system, and the tangential speed lever amount Converting the radial velocity rod amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device;
其中,以特定参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
可选地,可以将佩戴或者持有所述外部设备的用户为所述特定参考点。 Alternatively, the user wearing or holding the external device may be the specific reference point.
可选的,所述处理器902,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到切向速度杆量。Optionally, the processor 902 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain a tangential speed lever amount according to the control quantity of the first control mode.
所述处理器902,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到径向速度杆量。The processor 902 is specifically configured to acquire a control amount of the second control mode in the aircraft according to the motion data, and obtain a radial speed lever amount according to the control amount of the second control mode.
其中,所述第一控制模式为控制所述飞行器在以所述特定参考点为球心的球面上切向飞行,所述第二控制模式为控制所述飞行器在所述飞行器与所述特定参考点之间的连线上径向飞行。Wherein the first control mode is to control the aircraft to tangentially fly on a spherical surface with the specific reference point as a center of the sphere, and the second control mode is to control the aircraft at the aircraft and the specific reference Radial flight on the line between points.
可选的,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
可选的,所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;Optionally, the control quantity of the first control mode is an angle between a line connecting the aircraft and the specific reference point and an axis of an axis of a coordinate system defined by a motion sensor of the external device;
所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
可选的,所述处理器902,具体用于利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。Optionally, the processor 902 is configured to acquire, by using the second network model, the amount of the rod generated by the motion of the external device corresponding to the motion data.
可选的,所述处理器902,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;Optionally, the processor 902 is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a tangential speed lever amount controlled by the aircraft on the sphere coordinate system;
所述处理器902,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在所述球体坐标系上对所述飞行器控制的径向速度杆量;The processor 902 is configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and input a control quantity of the second control mode into the second network model, to obtain the The amount of radial velocity rods controlled by the aircraft on the sphere coordinate system;
所述处理器902,具体用于根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量。The processor 902 is specifically configured to obtain the amount of the rod generated by the motion according to the tangential speed lever amount and the radial speed lever amount.
其中,以特定的参考点为所述球体坐标系的原点。比如特定的参考点为外部设备。Wherein, the specific reference point is the origin of the sphere coordinate system. For example, a specific reference point is an external device.
可选的,所述第二网络模型为人工神经网络。 Optionally, the second network model is an artificial neural network.
其中,外部设备可以为配置运动传感器的任何设备,其中具体可以为手表、手环,眼镜等穿戴式设备,也可以为配置有配置为运动传感器的手持式设备,比如控制笔,专用遥控器等,在此不作具体限定。The external device may be any device configured with a motion sensor, and may specifically be a wearable device such as a watch, a wristband, or a glasses, or a handheld device configured with a motion sensor, such as a control pen, a dedicated remote controller, etc. It is not specifically limited here.
具体实现中,本发明实施例中所描述的通信装置901、处理器902、运动传感器903和存储器904可执行本发明实施例图2提供的杆量控制的方法中所描述的实现方式,也可执行本发明实施例图6所描述的杆量控制的装置的实现方式,在此不再赘述。In a specific implementation, the communication device 901, the processor 902, the motion sensor 903, and the memory 904 described in the embodiments of the present invention may implement the implementation manner described in the method for controlling the amount of the bar provided in the embodiment of the present invention. The implementation of the device for controlling the amount of the rods described in the embodiment of the present invention is not described herein.
本发明实施例通过对外部设备的运动进行检测,输出运动数据,根据运动数据计算由外部设备运动产生的杆量,再将运动产生的杆量发送给飞行器,使得飞行器获取由外部设备运动产生的杆量和由通过外部设备输入而产生的杆量,得到对飞行器的控制杆量,从而可以实现多个控制杆量的自动融合,以及在多种控制模式、控制设备之间自动切换。The embodiment of the invention detects the movement of the external device, outputs the motion data, calculates the amount of the rod generated by the movement of the external device according to the motion data, and then transmits the amount of the rod generated by the motion to the aircraft, so that the aircraft acquires the motion generated by the external device. The amount of the rod and the amount of the rod generated by the input from the external device, the amount of the lever for the aircraft is obtained, so that the automatic fusion of the plurality of levers can be realized, and the automatic switching between the various control modes and the control device can be realized.
需要说明的是,对于前述的各个方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本申请,某一些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本申请所必须的。It should be noted that, for the foregoing various method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because some steps may be performed in other orders or concurrently in accordance with the present application. In the following, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、只读存储器(Read-Only Memory,ROM)、随机存取器(Random Access Memory,RAM)、磁盘或光盘等。A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.
以上对本发明实施例所提供的一种杆量控制的方法、装置及相关设备进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。 The method, the device and the related device for controlling the amount of the rod provided by the embodiment of the present invention are described in detail. The principle and the embodiment of the present invention are described in the following. The description of the above embodiment is only used. To help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in specific embodiments and application scopes. The content should not be construed as limiting the invention.

Claims (54)

  1. 一种杆量控制的装置,其特征在于,包括:A device for controlling the amount of the rod, comprising:
    获取模块,用于获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量;An acquisition module, configured to acquire a rod amount generated by an external device movement and a rod amount generated by input through the external device;
    处理模块,用于对所述获取模块获取的所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。And a processing module, configured to fuse the amount of the rod generated by the motion acquired by the acquiring module with the amount of the rod generated by the input, to obtain a lever amount for the aircraft.
  2. 根据权利要求1所述的装置,其特征在于,The device of claim 1 wherein:
    所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控制站中的一种或多种输入而产生的杆量。The amount of the rod generated by the input includes the amount of the rod generated by one or more inputs of a watch, a wristband, a remote controller, a smartphone, and a ground control station.
  3. 根据权利要求1或2所述的装置,其特征在于,Device according to claim 1 or 2, characterized in that
    所述处理模块,具体用于利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数;The processing module is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input;
    所述处理模块,具体用于获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。The processing module is specifically configured to obtain a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and the corresponding weight coefficient, and superimpose the product to obtain a superimposed amount, The amount of superposition is used as the amount of the lever for the aircraft.
  4. 根据权利要求3所示的装置,其特征在于,The device according to claim 3, characterized in that
    所述处理模块,具体用于将与所述外部设备运动相关联的参数和由通过所述外部设备输入而产生的杆量输入第一网络模型,获取所述运动产生的杆量和所述输入产生的杆量中每一个杆量对应的权重系数。The processing module is specifically configured to input a parameter associated with the motion of the external device and a bar amount generated by inputting by the external device into a first network model, and obtain a bar amount and the input generated by the motion The weight coefficient corresponding to each of the generated rod amounts.
  5. 根据权利要求3所述的装置,其特征在于,The device according to claim 3, characterized in that
    所述处理模块,还用于将预设的权重系数组合作为所述第一网络模型的目标输出,将与所述权重系数组合对应的所述外部设备运动相关联的参数和所述输入而产生的杆量作为输入,来对所述第一网络模型进行训练。The processing module is further configured to use a preset weight coefficient combination as a target output of the first network model, and generate a parameter associated with the external device motion corresponding to the weight coefficient combination and the input The amount of the bar is used as an input to train the first network model.
  6. 根据权利要求5所述的装置,其特征在于, The device according to claim 5, characterized in that
    所述处理模块,还用于在训练所述第一网络模型时,当与所述外部设备运动相关联的参数和所述输入而产生的杆量同时存在时,将除优先级最高的杆量以外的杆量对应的权重系数全部置零。The processing module is further configured to: when the first network model is trained, when the parameter associated with the motion of the external device and the amount of the rod generated by the input simultaneously exist, the amount of the highest priority is The weight coefficients corresponding to the amount of the rods are all set to zero.
  7. 根据权利要求1所述的装置,其特征在于,The device of claim 1 wherein:
    所述获取模块,具体用于获取由所述外部设备运动产生的运动数据,根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量;The acquiring module is specifically configured to acquire motion data generated by the motion of the external device, and acquire, according to the motion data, a tangential speed lever amount and a radial velocity lever amount that are controlled by the aircraft on a sphere coordinate system, and Converting the tangential speed lever amount and the radial speed lever amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device;
    其中,以特定参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  8. 根据权利要求7所述的装置,其特征在于,The device of claim 7 wherein:
    所述特定参考点为外部设备。The specific reference point is an external device.
  9. 根据权利要求7或8所述的装置,其特征在于,Device according to claim 7 or 8, characterized in that
    所述获取模块,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到所述切向速度杆量;The acquiring module is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain the tangential speed lever amount according to the control quantity of the first control mode;
    所述获取模块,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到所述径向速度杆量。The acquiring module is specifically configured to acquire a control amount of the second control mode in the aircraft according to the motion data, and obtain the radial speed lever amount according to the control amount of the second control mode.
  10. 根据权利要求9所述的装置,其特征在于,The device of claim 9 wherein:
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  11. 根据权利要求9所述的装置,其特征在于,The device of claim 9 wherein:
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角; The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
  12. 根据权利要求1所述的装置,其特征在于,The device of claim 1 wherein:
    所述获取模块,具体用于获取由所述外部设备运动产生的运动数据,利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。The acquiring module is specifically configured to acquire motion data generated by the motion of the external device, and acquire, by using a second network model, a lever amount generated by the motion of the external device corresponding to the motion data.
  13. 根据权利要求12所述的装置,其特征在于,The device according to claim 12, characterized in that
    所述获取模块,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;The acquiring module is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a pair on a spherical coordinate system. The amount of tangential speed rod controlled by the aircraft;
    所述获取模块,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在所述球体坐标系上对所述飞行器控制的径向速度杆量;The acquiring module is configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and input a control quantity of the second control mode into the second network model to obtain the sphere. a radial velocity rod amount controlled by the aircraft on the coordinate system;
    所述获取模块,具体用于根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量;The acquiring module is specifically configured to obtain a rod amount generated by the motion according to the tangential speed lever amount and the radial speed lever amount;
    其中,以特定的参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  14. 根据权利要求3或12所述的装置,其特征在于,Device according to claim 3 or 12, characterized in that
    所述第一网络模型和所述第二网络模型为人工神经网络。The first network model and the second network model are artificial neural networks.
  15. 一种杆量控制的方法,其特征在于,包括:A method for controlling the amount of the rod, characterized in that it comprises:
    获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量;Obtaining the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device;
    对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。The amount of the rod generated by the motion and the amount of the rod generated by the input are fused to obtain a lever amount for the aircraft.
  16. 根据权利要求15所述的方法,其特征在于,The method of claim 15 wherein:
    所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控 制站中的一种或多种输入而产生的杆量。The amount of the rod generated by the input includes through the watch, the wristband, the remote controller, the smart phone, the ground control The amount of rod produced by one or more inputs in the station.
  17. 根据权利要求15或16所述的方法,其特征在于,所述对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量,包括:The method according to claim 15 or 16, wherein the amount of the rod generated by the movement and the amount of the rod generated by the input are fused to obtain a lever amount for the aircraft, comprising:
    利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数;Obtaining, by the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input;
    获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。Obtaining a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, superimposing the product to obtain a superposition amount, and using the superimposed amount as an aircraft The amount of the lever.
  18. 根据权利要求17所述的方法,其特征在于,所述利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数,包括:The method according to claim 17, wherein the obtaining a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input by using the first network model comprises:
    将与所述外部设备运动相关联的参数和由通过所述外部设备输入而产生的杆量输入第一网络模型,获取所述运动产生的杆量和所述输入产生的杆量中每一个杆量对应的权重系数。Inputting a parameter associated with the movement of the external device and a amount of the rod generated by the input of the external device into the first network model, acquiring each of the amount of the rod generated by the motion and the amount of the rod generated by the input The weight coefficient corresponding to the quantity.
  19. 根据权利要求17所述的方法,其特征在于,所述方法还包括:The method of claim 17, wherein the method further comprises:
    将预设的权重系数组合作为所述第一网络模型的目标输出,将与所述权重系数组合对应的所述外部设备运动相关联的参数和所述输入而产生的杆量作为输入,来对所述第一网络模型进行训练。Combining a preset weight coefficient as a target output of the first network model, inputting a parameter associated with the external device motion corresponding to the weight coefficient combination and a lever amount generated by the input as an input, The first network model is trained.
  20. 根据权利要求19所述的方法,其特征在于,所述方法还包括:The method of claim 19, wherein the method further comprises:
    当与所述外部设备运动相关联的参数和所述输入而产生的杆量同时存在时,将除优先级最高的杆量以外的杆量对应的权重系数全部置零。When the parameter associated with the movement of the external device and the amount of the rod generated by the input are simultaneously present, the weight coefficients corresponding to the amount of the rod other than the amount of the highest priority are all set to zero.
  21. 根据权利要求15所述的方法,其特征在于,所述获取由外部设备运动产生的杆量,包括:The method according to claim 15, wherein said obtaining the amount of the rod generated by the movement of the external device comprises:
    获取由所述外部设备运动产生的运动数据,根据所述运动数据获取在球体 坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量;Acquiring motion data generated by the motion of the external device, and acquiring the sphere according to the motion data a tangential speed lever amount and a radial speed lever amount controlled by the aircraft on a coordinate system, converting the tangential speed lever amount and the radial velocity lever amount to a Cartesian coordinate system to obtain the external The amount of rod produced by the movement of the equipment;
    其中,以特定参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  22. 根据权利要求21所述的方法,其特征在于,The method of claim 21 wherein
    所述特定参考点为外部设备。The specific reference point is an external device.
  23. 根据权利要求21或22所述的方法,其特征在于,所述根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,包括:The method according to claim 21 or 22, wherein the acquiring the tangential speed lever amount and the radial speed lever amount for controlling the aircraft on the sphere coordinate system according to the motion data comprises:
    根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到所述切向速度杆量;Obtaining a control amount of the first control mode of the aircraft according to the motion data, and obtaining the tangential speed lever amount according to the control amount of the first control mode;
    根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到所述径向速度杆量。And acquiring, according to the motion data, a control amount of the second control mode of the aircraft, and obtaining the radial velocity lever amount according to the control amount of the second control mode.
  24. 根据权利要求23所述的方法,其特征在于,The method of claim 23 wherein:
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  25. 根据权利要求23所述的方法,其特征在于,The method of claim 23 wherein:
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
  26. 根据权利要求15所述的方法,其特征在于,所述获取由外部设备运动 产生的杆量,包括:The method of claim 15 wherein said obtaining is moved by an external device The amount of shots produced, including:
    获取由所述外部设备运动产生的运动数据,利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。Acquiring the motion data generated by the motion of the external device, and acquiring the amount of the rod generated by the motion of the external device corresponding to the motion data by using the second network model.
  27. 根据权利要求26所述的方法,其特征在于,所述利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量,包括:The method according to claim 26, wherein the obtaining, by the second network model, the amount of the rod generated by the movement of the external device corresponding to the motion data comprises:
    根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;Obtaining a control quantity of the first control mode of the aircraft according to the motion data, and inputting a control quantity of the first control mode into a second network model to obtain a tangential speed of the aircraft control on a sphere coordinate system Rod amount
    根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在球体坐标系上对所述飞行器控制的径向速度杆量;Obtaining a control amount of the second control mode of the aircraft according to the motion data, and inputting a control quantity of the second control mode into the second network model to obtain a path controlled by the aircraft on a sphere coordinate system Amount to the speed lever;
    根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量;Obtaining a rod amount generated by the movement according to the tangential speed rod amount and the radial speed rod amount;
    其中,以特定的参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  28. 根据权利要求17或26所述的方法,其特征在于,A method according to claim 17 or 26, wherein
    所述第一网络模型和所述第二网络模型为人工神经网络。The first network model and the second network model are artificial neural networks.
  29. 一种控制设备,其特征在于,包括:A control device, comprising:
    通信装置,用于获取由外部设备运动产生的运动数据和由通过所述外部设备输入而产生的杆量;a communication device for acquiring motion data generated by motion of the external device and a lever amount generated by input by the external device;
    处理器,用于根据所述通信装置获取的所述运动数据得到由所述外部设备运动产生的杆量,对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。a processor, configured to obtain, according to the motion data acquired by the communication device, a rod amount generated by the movement of the external device, and combine a rod amount generated by the motion with a rod amount generated by the input to obtain a pair The amount of joystick for the aircraft.
  30. 根据权利要求29所述的控制设备,其特征在于,The control device according to claim 29, characterized in that
    所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控制站中的一种或多种输入而产生的杆量。 The amount of the rod generated by the input includes the amount of the rod generated by one or more inputs of a watch, a wristband, a remote controller, a smartphone, and a ground control station.
  31. 根据权利要求29或30所述的控制设备,其特征在于,A control device according to claim 29 or 30, wherein
    所述处理器,具体用于利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数;The processor is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input;
    所述处理器,具体用于获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。The processor is specifically configured to obtain a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount, The amount of superposition is used as the amount of the lever for the aircraft.
  32. 根据权利要求31所述的控制设备,其特征在于,The control device according to claim 31, characterized in that
    所述处理器,具体用于将与所述外部设备运动相关联的参数和由通过所述外部设备输入而产生的杆量输入第一网络模型,获取所述运动产生的杆量和所述输入产生的杆量中每一个杆量对应的权重系数。The processor is specifically configured to input a parameter associated with the motion of the external device and a bar amount generated by inputting by the external device into a first network model, and obtain a bar amount and the input generated by the motion The weight coefficient corresponding to each of the generated rod amounts.
  33. 根据权利要求31所述的控制设备,其特征在于,The control device according to claim 31, characterized in that
    所述处理器,还用于将预设的权重系数组合作为所述第一网络模型的目标输出,将与所述权重系数组合对应的所述外部设备运动相关联的参数和所述输入而产生的杆量作为输入,来对所述第一网络模型进行训练。The processor is further configured to combine a preset weight coefficient as a target output of the first network model, generate a parameter associated with the external device motion corresponding to the weight coefficient combination, and generate the input The amount of the bar is used as an input to train the first network model.
  34. 根据权利要求33所述的控制设备,其特征在于,The control device according to claim 33, wherein
    所述处理器,还用于在训练所述第一网络模型时,当与所述外部设备运动相关联的参数和所述输入而产生的杆量同时存在时,将除优先级最高的杆量以外的杆量对应的权重系数全部置零。The processor is further configured to: when training the first network model, when the parameter associated with the motion of the external device and the amount of the rod generated by the input simultaneously exist, the amount of the highest priority is The weight coefficients corresponding to the amount of the rods are all set to zero.
  35. 根据权利要求29所述的控制设备,其特征在于,The control device according to claim 29, characterized in that
    所述处理器,具体用于根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量;The processor is specifically configured to acquire, according to the motion data, a tangential speed rod amount and a radial speed rod amount controlled by the aircraft on a sphere coordinate system, and the tangential speed rod amount and the radial direction Converting the speed lever amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device;
    其中,以特定参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  36. 根据权利要求35所述的控制设备,其特征在于, The control device according to claim 35, characterized in that
    所述特定参考点为所述外部设备。The specific reference point is the external device.
  37. 根据权利要求35或36所述的控制设备,其特征在于,A control device according to claim 35 or 36, wherein
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到所述切向速度杆量;The processor is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain the tangential speed lever amount according to the control quantity of the first control mode;
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到所述径向速度杆量。The processor is specifically configured to acquire a control amount of the second control mode in the aircraft according to the motion data, and obtain the radial speed lever amount according to the control amount of the second control mode.
  38. 根据权利要求37所述的控制设备,其特征在于,The control device according to claim 37, characterized in that
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  39. 根据权利要求37所述的控制设备,其特征在于,The control device according to claim 37, characterized in that
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
  40. 根据权利要求29所述的控制设备,其特征在于,The control device according to claim 29, characterized in that
    所述处理器,具体用于利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。The processor is specifically configured to acquire, by using a second network model, a rod amount generated by the motion of the external device corresponding to the motion data.
  41. 根据权利要求40所述的控制设备,其特征在于,The control device according to claim 40, characterized in that
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;The processor is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a pair on a spherical coordinate system. The amount of tangential speed rod controlled by the aircraft;
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第二控制模 式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在所述球体坐标系上对所述飞行器控制的径向速度杆量;The processor is specifically configured to acquire, according to the motion data, a second control mode in the aircraft a control quantity, the control quantity of the second control mode is input to the second network model, to obtain a radial speed rod amount controlled by the aircraft on the spherical coordinate system;
    所述处理器,具体用于根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量;The processor is specifically configured to obtain a rod amount generated by the motion according to the tangential speed lever amount and the radial speed lever amount;
    其中,以特定的参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  42. 根据权利要求31或40所述的控制设备,其特征在于,A control device according to claim 31 or 40, characterized in that
    所述第一网络模型和所述第二网络模型为人工神经网络。The first network model and the second network model are artificial neural networks.
  43. 一种控制设备,其特征在于,包括:A control device, comprising:
    通信装置,用于获取由外部设备运动产生的杆量和由通过所述外部设备输入而产生的杆量;a communication device for acquiring the amount of the rod generated by the movement of the external device and the amount of the rod generated by the input through the external device;
    处理器,用于对所述运动产生的杆量和所述输入而产生的杆量进行融合,得到对飞行器的控制杆量。And a processor for fusing the amount of the rod generated by the motion and the amount of the rod generated by the input to obtain a lever amount for the aircraft.
  44. 根据权利要求43所述的控制设备,其特征在于,The control device according to claim 43, wherein
    所述输入而产生的杆量包括通过手表、手环、遥控器、智能手机、地面控制站中的一种或多种输入而产生的杆量。The amount of the rod generated by the input includes the amount of the rod generated by one or more inputs of a watch, a wristband, a remote controller, a smartphone, and a ground control station.
  45. 根据权利要求43或44所述的控制设备,其特征在于,A control device according to claim 43 or 44, wherein
    所述处理器,具体用于利用第一网络模型获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量对应的权重系数;The processor is configured to acquire, by using the first network model, a weight coefficient corresponding to each of the amount of the rod generated by the motion and the amount of the rod generated by the input;
    所述处理器,具体用于获取所述运动产生的杆量和所述输入而产生的杆量中每一个杆量与对应的权重系数之间的乘积,将所述乘积叠加获得叠加量,将所述叠加量作为对飞行器的控制杆量。The processor is specifically configured to obtain a product between each of the amount of the rod generated by the motion and the amount of the rod generated by the input and a corresponding weight coefficient, and superimpose the product to obtain a superimposed amount, The amount of superposition is used as the amount of the lever for the aircraft.
  46. 一种飞行器,其特征在于,包括:An aircraft characterized by comprising:
    动力系统,用于为飞行器提供飞行动力;a power system for providing flight power to the aircraft;
    权利要求29-45中任一项所述的控制设备,用于利用所述控制设备得到的 对所述飞行器的控制杆量,对所述飞行器进行控制。The control device according to any one of claims 29 to 45, which is obtained by using the control device The aircraft is controlled for the amount of control rod of the aircraft.
  47. 一种外部设备,包括处理器、运动传感器和通信装置,所述处理器分别与所述运动传感器和所述通信装置连接,其特征在于,An external device includes a processor, a motion sensor, and a communication device, the processor being respectively coupled to the motion sensor and the communication device, wherein
    所述运动传感器,用于对所述外部设备的运动进行检测,输出运动数据;The motion sensor is configured to detect motion of the external device and output motion data;
    所述处理器,用于根据所述运动数据计算由所述外部设备运动产生的杆量,控制通信装置来向飞行器发送所述杆量,并利用所述杆量对飞行器进行控制;The processor is configured to calculate a rod amount generated by the movement of the external device according to the motion data, control a communication device to send the rod amount to an aircraft, and control the aircraft by using the rod amount;
    所述通信装置,用于将所述运动产生的杆量发送给飞行器。The communication device is configured to transmit the amount of the rod generated by the motion to the aircraft.
  48. 根据权利要求47所述的外部设备,其特征在于,The external device according to claim 47, wherein
    所述处理器,具体用于根据所述运动数据获取在球体坐标系上对所述飞行器控制的切向速度杆量和径向速度杆量,将所述切向速度杆量和所述径向速度杆量转换到直角坐标系,得到所述由所述外部设备运动产生的杆量;The processor is specifically configured to acquire, according to the motion data, a tangential speed rod amount and a radial speed rod amount controlled by the aircraft on a sphere coordinate system, and the tangential speed rod amount and the radial direction Converting the speed lever amount to a Cartesian coordinate system to obtain the amount of the rod generated by the movement of the external device;
    其中,以特定参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  49. 根据权利要求48所述的外部设备,其特征在于,The external device according to claim 48, wherein
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,根据所述第一控制模式的控制量得到切向速度杆量;The processor is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and obtain a tangential speed lever amount according to the control quantity of the first control mode;
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,根据所述第二控制模式的控制量得到径向速度杆量。The processor is specifically configured to acquire a control amount of the second control mode in the aircraft according to the motion data, and obtain a radial speed lever amount according to the control amount of the second control mode.
  50. 根据权利要求49所述的外部设备,其特征在于,The external device according to claim 49, wherein
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备以所述某个轴线为轴转动的角度。The control amount of the second control mode is an angle at which the external device rotates on the certain axis.
  51. 根据权利要求49所述的外部设备,其特征在于, The external device according to claim 49, wherein
    所述第一控制模式的控制量为所述飞行器与所述特定参考点的连线和外部设备的运动传感器所规定的坐标系的某个轴线的轴向之间的夹角;The control amount of the first control mode is an angle between an alignment of the aircraft and the specific reference point and an axial direction of a certain axis of a coordinate system defined by a motion sensor of the external device;
    所述第二控制模式的控制量为所述外部设备在所述某个轴线上的运动距离。The control amount of the second control mode is a moving distance of the external device on the certain axis.
  52. 根据权利要求47所述的外部设备,其特征在于,The external device according to claim 47, wherein
    所述处理器,具体用于获取由所述外部设备运动产生的运动数据,利用第二网络模型获取所述运动数据对应的由所述外部设备运动产生的杆量。The processor is specifically configured to acquire motion data generated by the motion of the external device, and acquire, by using a second network model, a lever amount generated by the motion of the external device corresponding to the motion data.
  53. 根据权利要求52所述的外部设备,其特征在于,The external device according to claim 52, characterized in that
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第一控制模式的控制量,将所述第一控制模式的控制量输入第二网络模型,得到在球体坐标系上对所述飞行器控制的切向速度杆量;The processor is configured to acquire a control quantity of the first control mode of the aircraft according to the motion data, and input a control quantity of the first control mode into a second network model to obtain a pair on a spherical coordinate system. The amount of tangential speed rod controlled by the aircraft;
    所述处理器,具体用于根据所述运动数据获取在所述飞行器的第二控制模式的控制量,将所述第二控制模式的控制量输入所述第二网络模型,得到在所述球体坐标系上对所述飞行器控制的径向速度杆量;The processor is specifically configured to acquire a control quantity of the second control mode of the aircraft according to the motion data, and input a control quantity of the second control mode into the second network model to obtain the sphere a radial velocity rod amount controlled by the aircraft on the coordinate system;
    所述处理器,具体用于根据所述切向速度杆量和所述径向速度杆量得到所述运动产生的杆量;The processor is specifically configured to obtain a rod amount generated by the motion according to the tangential speed lever amount and the radial speed lever amount;
    其中,以特定的参考点为所述球体坐标系的原点。Wherein, the specific reference point is the origin of the sphere coordinate system.
  54. 根据权利要求52或53所述的外部设备,其特征在于,An external device according to claim 52 or 53, wherein
    所述第二网络模型为人工神经网络。 The second network model is an artificial neural network.
PCT/CN2016/104116 2016-10-31 2016-10-31 Lever amount control method, apparatus, and related device WO2018076367A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2016/104116 WO2018076367A1 (en) 2016-10-31 2016-10-31 Lever amount control method, apparatus, and related device
CN201680014294.0A CN107438808B (en) 2016-10-31 2016-10-31 Method and device for controlling rod amount and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/104116 WO2018076367A1 (en) 2016-10-31 2016-10-31 Lever amount control method, apparatus, and related device

Publications (1)

Publication Number Publication Date
WO2018076367A1 true WO2018076367A1 (en) 2018-05-03

Family

ID=60459052

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/104116 WO2018076367A1 (en) 2016-10-31 2016-10-31 Lever amount control method, apparatus, and related device

Country Status (2)

Country Link
CN (1) CN107438808B (en)
WO (1) WO2018076367A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109062259A (en) * 2018-10-31 2018-12-21 西安天问智能科技有限公司 A kind of unmanned plane automatic obstacle-avoiding method and device thereof
CN110069078B (en) * 2019-05-21 2021-06-01 深圳市道通智能航空技术股份有限公司 Flight control method, device and system and unmanned aerial vehicle

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101710243A (en) * 2009-12-23 2010-05-19 北京航空航天大学 Method for selecting remote control mode of unmanned plane
US20140008496A1 (en) * 2012-07-05 2014-01-09 Zhou Ye Using handheld device to control flying object
US20150279131A1 (en) * 2014-03-28 2015-10-01 Denso International America, Inc. Key fob and smartdevice gestures for vehicle functions
CN105487547A (en) * 2015-11-23 2016-04-13 杨珊珊 Flight control system, flight controller and flight control method
CN105607640A (en) * 2016-01-20 2016-05-25 南京工业大学 Pose controller for four-rotor aircraft
CN105836127A (en) * 2016-03-18 2016-08-10 普宙飞行器科技(深圳)有限公司 Control method of unmanned plane and unmanned plane system

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6397136B1 (en) * 1997-02-06 2002-05-28 Automotive Technologies International Inc. System for determining the occupancy state of a seat in a vehicle
US7979173B2 (en) * 1997-10-22 2011-07-12 Intelligent Technologies International, Inc. Autonomous vehicle travel control systems and methods
JP2009301299A (en) * 2008-06-12 2009-12-24 Tokai Rika Co Ltd Gesture determination device
WO2015157670A1 (en) * 2014-04-10 2015-10-15 Medelius Pedro J Wearable environmental interaction unit
JP6671375B2 (en) * 2014-12-25 2020-03-25 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd How to fly a drone
CN104501779A (en) * 2015-01-09 2015-04-08 中国人民解放军63961部队 High-accuracy target positioning method of unmanned plane on basis of multi-station measurement
CN105005383A (en) * 2015-07-10 2015-10-28 昆山美莱来工业设备有限公司 Wearable arm band that manipulates mobile robot by using hand gesture
CN105426961B (en) * 2015-11-11 2018-04-17 西安电子科技大学 The method for catching user's intention using Intelligent bracelet and smart mobile phone
CN105867114B (en) * 2016-04-21 2019-02-01 北京航空航天大学 A kind of novel Electric Loading System control method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101710243A (en) * 2009-12-23 2010-05-19 北京航空航天大学 Method for selecting remote control mode of unmanned plane
US20140008496A1 (en) * 2012-07-05 2014-01-09 Zhou Ye Using handheld device to control flying object
US20150279131A1 (en) * 2014-03-28 2015-10-01 Denso International America, Inc. Key fob and smartdevice gestures for vehicle functions
CN105487547A (en) * 2015-11-23 2016-04-13 杨珊珊 Flight control system, flight controller and flight control method
CN105607640A (en) * 2016-01-20 2016-05-25 南京工业大学 Pose controller for four-rotor aircraft
CN105836127A (en) * 2016-03-18 2016-08-10 普宙飞行器科技(深圳)有限公司 Control method of unmanned plane and unmanned plane system

Also Published As

Publication number Publication date
CN107438808B (en) 2021-05-04
CN107438808A (en) 2017-12-05

Similar Documents

Publication Publication Date Title
US11914370B2 (en) System and method for providing easy-to-use release and auto-positioning for drone applications
JP7160371B2 (en) Remote control method and terminal
US11649052B2 (en) System and method for providing autonomous photography and videography
JP6281730B2 (en) Image acquisition system and unmanned aerial vehicle
US11625034B2 (en) One-handed remote-control device for aerial system
CN108351574A (en) System, method and apparatus for camera parameter to be arranged
WO2018098704A1 (en) Control method, apparatus, and system, unmanned aerial vehicle, and mobile platform
WO2019242553A1 (en) Method and device for controlling capturing angle of image capturing device, and wearable device
CN105045279A (en) System and method for automatically generating panorama photographs through aerial photography of unmanned aerial aircraft
FR3031402A1 (en) METHOD OF AUTOMATICALLY CONTROLLING A ROTARY SAILING DRONE FOR OPERATING CAMERA MOVEMENTS BY AN EMBEDDED CAMERA
JP2018507617A (en) Imaging system, unmanned aerial vehicle, and method
WO2018187916A1 (en) Cradle head servo control method and control device
WO2019227289A1 (en) Time-lapse photography control method and device
EP3273318A1 (en) Autonomous system for collecting moving images by a drone with target tracking and improved target positioning
WO2021081774A1 (en) Parameter optimization method and apparatus, control device, and aircraft
JP6844898B2 (en) Mobile maneuvering system, maneuvering signal transmission system, mobile maneuvering method, program, and recording medium
WO2018076367A1 (en) Lever amount control method, apparatus, and related device
JP6744033B2 (en) Mobile control system, control signal transmission system, mobile control method, program, and recording medium
WO2021251441A1 (en) Method, system, and program
CN110099206A (en) Photographic method, robot and computer readable storage medium based on robot
WO2018076371A1 (en) Gesture recognition method, network training method, apparatus and equipment
JP2018078433A (en) Mobile imaging device and control method thereof, and imaging apparatus and control method thereof, drone, program, recording medium
WO2018214015A1 (en) Course correction method and device, and aerial vehicle
US20220404841A1 (en) Information processing system, information processing method, and information processing program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16919672

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16919672

Country of ref document: EP

Kind code of ref document: A1