WO2018098904A1 - Unmanned aerial vehicle control method and device - Google Patents

Unmanned aerial vehicle control method and device Download PDF

Info

Publication number
WO2018098904A1
WO2018098904A1 PCT/CN2017/073885 CN2017073885W WO2018098904A1 WO 2018098904 A1 WO2018098904 A1 WO 2018098904A1 CN 2017073885 W CN2017073885 W CN 2017073885W WO 2018098904 A1 WO2018098904 A1 WO 2018098904A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
feature information
stored
instruction
unit
Prior art date
Application number
PCT/CN2017/073885
Other languages
French (fr)
Chinese (zh)
Inventor
刘均
孙建勋
张跃博
Original Assignee
深圳市元征科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市元征科技股份有限公司 filed Critical 深圳市元征科技股份有限公司
Publication of WO2018098904A1 publication Critical patent/WO2018098904A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/28Recognition of hand or arm movements, e.g. recognition of deaf sign language

Definitions

  • the present invention relates to the field of drone technology, and in particular, to a drone control method and apparatus.
  • Embodiments of the present invention provide a drone control method and apparatus, which can improve the diversity of drone control
  • a first aspect of the embodiments of the present invention provides a drone control method, including:
  • target information includes at least one of expression information, voice information, and gesture information
  • Square The law also includes:
  • the preset correspondence between the stored pre-stored feature information and the UAV control command is After acquiring the first instruction corresponding to the pre-stored feature information that matches the target information, the method further includes
  • the comparing the target information with the pre-stored feature information in the feature information database includes:
  • the The first instruction corresponding to the pre-stored feature information matched by the target information further includes:
  • the second instruction is determined as the first instruction.
  • the method further includes: [0027] filtering noise in the target information to obtain target information after filtering noise;
  • comparing the target information with the pre-stored feature information in the feature information database includes: [0029] comparing the filtered target information with the pre-stored feature information in the feature information database.
  • a second aspect of the present invention provides a drone control apparatus, including:
  • a first acquiring unit configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information;
  • a comparing unit configured to compare the target information acquired by the first acquiring unit with the pre-stored feature information in the feature information database
  • a second obtaining unit configured to: when the comparison result of the comparing unit is that the pre-stored feature information matching the target information exists in the feature information database, according to the stored pre-stored feature information and the drone control a first instruction corresponding to the pre-stored feature information that matches the target information, where the UAV control instruction includes the first instruction;
  • an execution unit configured to execute the first instruction acquired by the second acquiring unit, to control the drone.
  • the apparatus further includes:
  • the third obtaining unit is configured to acquire the verification information, and match the pre-stored verification information in the verification information database, where the pre-stored verification information that matches the verification information acquired by the third acquiring unit exists in the verification information database. And triggering the execution unit to perform the step of comparing the target information with the pre-stored feature information in the feature information library.
  • the device further includes:
  • an output unit configured to output prompt information for prompting the user whether to execute the first instruction
  • the execution unit is further configured to: when the confirmation command for the prompt information is detected, execute the first instruction.
  • the comparing unit includes:
  • a calculation unit configured to calculate a matching degree of the target information acquired by the first acquiring unit and each pre-stored feature information in the feature information database;
  • an arranging unit configured to sort the pre-stored feature information in the feature information library in descending order according to the matching degree calculated by the calculating unit, to obtain a descending row list;
  • the second acquiring unit further includes:
  • a fourth obtaining unit configured to acquire at least two pre-stored feature information arranged in the top row in the descending row list of the permuting unit arrangement
  • a fifth acquiring unit configured to acquire a drone control instruction corresponding to the at least two pre-stored feature information acquired by the fourth acquiring unit, to obtain at least two instructions
  • a determining unit configured to determine the second instruction as the first instruction when detecting the selecting operation of the second instruction in the at least two instructions acquired by the fifth acquiring unit.
  • the device when the target information acquired by the first acquiring unit is the voice information, the device further includes:
  • a sixth obtaining unit configured to acquire the noise information
  • a noise filtering unit configured to filter out noise information in the target information, to obtain target information after filtering the noise
  • the comparing unit is specifically configured to compare the target information after filtering the noise obtained by the filtering unit with the pre-stored feature information in the feature information database.
  • acquiring target information includes at least one of expression information, voice information, and gesture information; comparing the target information with the pre-stored feature information in the feature information database; There is pre-stored feature information matching the target information, and according to the preset correspondence between the stored pre-stored feature information and the UAV control command, acquiring a first instruction corresponding to the pre-stored feature information matching the target information, wherein,
  • the machine control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone can be controlled by the collected expression information, voice information and gesture information, overcoming the excessive dependence on the manual remote controller or
  • the problem of moving the control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
  • FIG. 1 is a schematic flow chart of a drone control method according to an embodiment of the present invention
  • FIG. 2 is a schematic flow chart of another drone control method according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a drone control device according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of another drone control device according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of still another UAV control device according to an embodiment of the present invention.
  • Embodiments of the present invention provide a drone control method and apparatus, which can increase the control mode of the drone, thereby improving the diversity of the drone control. The details are described below separately.
  • FIG. 1 is a schematic flowchart diagram of a drone control method according to an embodiment of the present invention. Among them, the drone control method is described from the perspective of the drone control device. As shown in Fig. 1, the man-machineless control method may include the following steps.
  • the target information includes at least one of expression information, voice information, and gesture information.
  • the acquiring the target information may include: acquiring at least one of a face image, a voice, a gesture image, or a touch gesture, where the face image and the gesture image may be a dynamic image, that is, an image stream formed by at least two frames of images, touching
  • the gesture may be detected by the touch screen and the operating system; detecting the facial expression information of the acquired facial image, the voice information in the voice, the gesture image, or the gesture information in the touch gesture to obtain at least at least one of the expression information, the voice information, and the gesture information.
  • a kind of information may be detected by the touch screen and the operating system.
  • the expression information may be obtained through facial contour recognition analysis, and the expression information, the voice information, and the gesture information or the touch gesture correspondingly control the control instruction of the drone; the control instruction may include: controlling the drone to fly according to the specified orientation, and increasing Reduce, fly to the controller, fly around the target, load direction and pitch motion commands carried by the flight platform. [0065] S102. Compare the target information with the pre-stored feature information in the feature information database.
  • the feature information library is preset, and the face image, the voice, the gesture image, or the touch gesture may be collected in advance through a camera or a microphone, and the faces are extracted.
  • the pre-stored feature information of the image, voice, gesture image or touch gesture is stored in the feature information library for subsequent calls.
  • the pre-stored feature information in the feature information database may be in one-to-one correspondence with the drone control command.
  • the correspondence is preset, wherein the drone control instruction includes the first instruction.
  • S104 Perform a first instruction to control the drone.
  • the first instruction is an instruction of the UAV control device for controlling the UAV
  • the flight instruction may be sent to the UAV flight platform to perform a corresponding flight action
  • the flight action may include :
  • the drone is flying in the specified direction, raising and lowering, flying to the controller, flying around the target, the load azimuth and pitching motion carried by the flight platform.
  • the target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information
  • An instruction wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
  • FIG. 2 is a schematic flowchart diagram of another UAV control method according to an embodiment of the present invention.
  • the drone control method is described from the perspective of the drone control device. As shown in FIG. 2, the drone control method may include the following steps.
  • the target information includes at least one of expression information, voice information, and gesture information. Its The obtaining the target information may include: acquiring at least one of a face image, a voice, a gesture image, or a touch gesture, where the face image and the gesture image may be a dynamic image, that is, an image stream formed by at least two frames of images, touching The gesture may be detected by the touch screen and the operating system; detecting the facial expression information of the acquired facial image, the voice information in the voice, the gesture image, or the gesture information in the touch gesture to obtain at least at least one of the expression information, the voice information, and the gesture information.
  • a kind of information is acquiring at least one of a face image, a voice, a gesture image, or a touch gesture, where the face image and the gesture image may be a dynamic image, that is, an image stream formed by at least two frames of images, touching
  • the gesture may be detected by the touch screen and the operating system; detecting the facial expression information of the acquired facial image, the voice information in the voice, the gesture image
  • the expression information may be obtained through facial contour recognition analysis, and the expression information, the voice information, and the gesture information or the touch gesture correspondingly control the control instruction of the drone; the control instruction may include: controlling the drone to fly according to the specified orientation, and increasing Reduce, fly to the controller, fly around the target, load direction and pitch motion commands carried by the flight platform.
  • S202 Acquire verification information, and match the pre-stored verification information in the verification information base.
  • the verification information is required to be verified.
  • the verification information may be a facial feature of the user inputting the face image, and may be a voiceprint feature of the voice. It may be fingerprint information input by a gesture image or a touch gesture, or may be other verification information.
  • the verification information base is preset, and the face image, the voice, the gesture image, or the touch gesture may be collected in advance through a camera or a microphone, and the face images are extracted.
  • the verification information of the voice, gesture image or touch gesture is stored in the verification information base for subsequent calls.
  • the entered verification information exists in the verification information base, the verification is passed.
  • comparing the target information with the pre-stored feature information in the feature information database may include: calculating a matching degree between the target information and each of the pre-stored feature information in the feature information database; and pre-stored feature information in the feature information database Sort in descending order by matching degree to get a descending list.
  • S204 when there is pre-stored feature information matching the target information in the feature information database, acquiring pre-stored feature information matching the target information according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command Corresponding first instruction.
  • the drone control command includes the first instruction.
  • the feature information library is preset, and the face image, the voice, the gesture may be collected in advance through a device such as a camera or a microphone. Image or touch gestures, and extract these face images, speech, gesture images or touch hands
  • the pre-stored feature information of the potential is stored in the feature information base for subsequent calls.
  • the pre-stored feature information in the feature information database may be in one-to-one correspondence with the UAV control command, and the corresponding relationship is preset, and the first instruction corresponding to the pre-stored feature information may be acquired by the corresponding relationship.
  • the first instruction corresponding to the pre-stored feature information that matches the target information may further include: obtaining, in the descending row list, the first instruction in the descending row list according to the preset correspondence between the stored pre-stored feature information and the UAV control command At least two pre-stored feature information; obtaining at least two unmanned machine control instructions corresponding to the pre-stored feature information to obtain at least two instructions; when detecting a selection operation of the second one of the at least two instructions, The second instruction is determined to be the first instruction.
  • S205 Output prompt information for prompting the user whether to execute the first instruction.
  • the prompt message is used to enable the user to confirm execution of the first instruction, for example, when the first instruction is used to control the drone to perform an action, such as landing, displaying on the display or by voice.
  • the confirmation command may be a click confirmation button, a voice confirmation is input, or other operations are used to confirm the execution of the first instruction.
  • the first instruction is an instruction of the drone control device for controlling the drone.
  • the flight instruction may be sent to the drone flight platform to perform a corresponding flight action, and the flight action may include: the drone according to the specified Azimuth flight, elevation reduction, flying to the controller, flying around the target, load orientation and pitching motion carried by the flight platform.
  • the control method may further include: filtering out noise in the target information to obtain target information after filtering noise; and selecting target information and features Comparing the pre-stored feature information in the information base may include: comparing the target information after filtering the noise with the pre-stored feature information in the feature information base.
  • target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparison; when there is pre-stored feature information matching the target information in the feature information base, according to The preset correspondence between the stored pre-stored feature information and the UAV control command acquires a first instruction corresponding to the pre-stored feature information matching the target information, and the UAV control instruction includes the first instruction; and executes the first instruction to control
  • the drone visible, can control the drone through the collected expression information, voice information and gesture information, overcomes the problem of over-reliance on the hand-controlled remote controller or the mobile control terminal, improves the human-computer interaction performance, and thus improves the The diversity of drone control.
  • FIG. 3 is a structural diagram of a drone control device according to an embodiment of the present invention. As shown in Figure 3
  • the drone control device can include:
  • the first obtaining unit 301 is configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information;
  • the comparing unit 302 is configured to compare the target information acquired by the first acquiring unit 301 with the pre-stored feature information in the feature information database;
  • the second obtaining unit 303 is configured to: when the comparison result of the comparing unit 302 is that the pre-stored feature information matching the target information exists in the feature information base, according to the stored pre-stored feature information and the preset of the drone control instruction Corresponding relationship, obtaining a first instruction corresponding to the pre-stored feature information that matches the target information, where the drone control instruction includes the first instruction;
  • the executing unit 304 is configured to execute the first instruction acquired by the second obtaining unit 303, to control the drone
  • target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information
  • An instruction wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
  • FIG. 4 is a schematic structural diagram of another UAV control device according to an embodiment of the present invention.
  • the UAV control device shown in FIG. 4 is optimized by the UAV control device shown in FIG. 3, wherein the device may further include: [0097]
  • the third obtaining unit 305 is configured to acquire the verification information, and match the pre-stored verification information in the verification information base; and the pre-stored verification information that matches the verification information acquired by the third obtaining unit 305 exists in the verification information database.
  • the trigger comparison unit 302 performs the step of comparing the target information acquired by the first acquisition unit 301 with the pre-stored feature information in the feature information library.
  • the third obtaining unit 305 is triggered to acquire the verification information.
  • the apparatus may further include:
  • the output unit 306 is configured to output prompt information for prompting the user whether to execute the first instruction.
  • the executing unit 304 is further configured to: when the confirmation command for the prompt information output by the output unit 306 is detected,
  • the second obtaining unit 303 acquires, according to the preset correspondence between the stored pre-stored feature information and the UAV control command, the first corresponding to the pre-stored feature information that is acquired by the first acquiring unit 301 and matches the target information.
  • the output unit 306 outputs prompt information for prompting the user whether to execute the first instruction acquired by the second acquisition unit 303.
  • the comparing unit 302 may include:
  • the calculating unit 3021 is configured to calculate a matching degree between the target information acquired by the first acquiring unit 301 and each pre-stored feature information in the feature information library;
  • the arranging unit 3022 is configured to perform the descending order of the pre-stored feature information in the feature information database according to the matching degree calculated by the calculating unit 3021 to obtain a descending row list;
  • the second obtaining unit 303 may further include:
  • the fourth obtaining unit 3031 is configured to obtain at least two pre-stored feature information arranged in the top row in the descending row list arranged by the arranging unit 3022;
  • the fifth obtaining unit 3032 is configured to acquire the drone control instruction corresponding to the at least two pre-stored feature information acquired by the fourth acquiring unit 3031, to obtain at least two instructions;
  • the determining unit 3033 is configured to determine, as the first instruction, the selecting operation of the second instruction of the at least two instructions acquired by the fifth obtaining unit 3032.
  • the executing unit 304 is configured to execute the first instruction determined by the determining unit 3033 to control the drone;
  • the output unit 306 is configured to output prompt information for prompting the user whether to execute the first instruction determined by the determining unit 3033.
  • the device may further include:
  • a noise filtering unit 307 configured to filter out noise in the target information, to obtain target information after filtering the noise
  • the comparing unit 302 is specifically configured to compare the filtered target information obtained by the filtering unit 307 with the pre-stored feature information in the feature information database.
  • the calculating unit 3021 in the comparing unit 302 is configured to calculate the matching degree of the filtered noise target information obtained by the filtering unit 307 and each pre-stored feature information in the feature information library.
  • target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information
  • An instruction wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
  • FIG. 5 is a schematic structural diagram of still another communication apparatus according to an embodiment of the present invention.
  • the communication device can include: at least one processor 501, such as a CPU, a memory 502, an information acquisition device 503, and at least one communication bus 504.
  • the information acquiring device 503 may be at least one of a camera and a microphone.
  • the communication bus 504 is used to implement connection communication between these components.
  • the memory 502 may be a high speed RAM memory or a non-volatile memory such as at least one disk memory.
  • the memory 502 can optionally include at least one storage device located remotely from the aforementioned processor 501. among them:
  • the information acquiring device 503 is configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information;
  • the processor 501 is configured to call the program code stored in the memory 502 to perform the following operations:
  • the processor 501 before the processor 501 compares the target information with the pre-stored feature information in the feature information library, the processor 501 is further configured to invoke the program code stored in the memory 502 to perform the following operations:
  • the processor 501 after acquiring the first instruction corresponding to the pre-stored feature information that matches the target information, according to the preset correspondence between the stored pre-stored feature information and the UAV control command, processing The 501 is further configured to call the program code stored in the memory 502 to perform the following operations:
  • comparing, by the processor 501, the target information with the pre-stored feature information in the feature information database specifically includes:
  • the processor 501 acquires the target information according to the preset correspondence between the stored pre-stored feature information and the UAV control command.
  • the first instruction corresponding to the pre-stored feature information further includes:
  • the processor 501 is further configured to invoke the program code stored in the memory 502 to perform the following operations:
  • the comparing, by the processor 501, the target information with the pre-stored feature information in the feature information library includes: [0139] comparing the filtered target information with the pre-stored feature information in the feature information database.
  • target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information
  • An instruction wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
  • a person of ordinary skill in the art may understand that all or part of the various methods of the foregoing embodiments may be completed by a program instructing related hardware, and the program may be stored in a computer readable storage medium, the storage medium It can include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An unmanned aerial vehicle control method and device. The method comprises: acquiring target information (S101); comparing the target information against pre-stored feature information in a feature information database (S102); if the feature information database contains the pre-stored feature information matching the target information, acquiring, according to a stored pre-determined correspondence relationship between the pre-stored feature information and an unmanned aerial vehicle control instruction, a first instruction corresponding to the pre-stored feature information matching the target information (S103); and executing the first instruction to control the unmanned aerial vehicle (S104). The method of the present invention improves variety of control modes of an unmanned aerial vehicle.

Description

一种无人机控制方法及装置  Unmanned aerial vehicle control method and device
[0001] 本申请要求于 2016年 11月 29日提交中国专利局、 申请号为 201611075404.2发明 名称为 "一种无人机控制方法及装置"的中国专利申请的优先权, 其全部内容通过 引用结合在本申请中。 [0001] This application claims the priority of the Chinese Patent Application entitled "A UAV Control Method and Apparatus" of the Chinese Patent Office, filed on Nov. 29, 2016, the entire disclosure of which is hereby incorporated by reference. In this application.
[0002] 技术领域 Technical Field
[0003] 本发明涉及无人机技术领域, 具体涉及一种无人机控制方法及装置。  [0003] The present invention relates to the field of drone technology, and in particular, to a drone control method and apparatus.
[0004] 背景技术 BACKGROUND OF THE INVENTION
[0005] 目前, 无人机在航空摄影、 国家应急救援、 物流物资运输、 交通监察和环境监 测等领域已得到了广泛应用。 现有的无人机控制方法主要为通过手控遥控器或 者移动控制端进行控制, 然而, 在实践中发现, 以上无人机的控制方法操作复 杂、 对操作者要求高, 且无人机的控制过度依赖手控遥控器或者移动控制端, 欠缺人机交互性能, 从而降低了无人机控制的多样性。  [0005] Currently, drones have been widely used in the fields of aerial photography, national emergency rescue, logistics and material transportation, traffic monitoring, and environmental monitoring. The existing drone control method is mainly controlled by a manual remote controller or a mobile control terminal. However, in practice, it is found that the control method of the above drone is complicated to operate, requires high operator, and the drone is Over-reliance on the hand-controlled remote control or mobile control terminal lacks human-computer interaction performance, which reduces the diversity of drone control.
[0006] 发明内容  SUMMARY OF THE INVENTION
[0007] 本发明实施例提供一种无人机控制方法及装置, 可以提高无人机控制的多样性  [0007] Embodiments of the present invention provide a drone control method and apparatus, which can improve the diversity of drone control
[0008] 本发明实施例第一方面提供一种无人机控制方法, 包括: A first aspect of the embodiments of the present invention provides a drone control method, including:
[0009] 获取目标信息, 所述目标信息包括表情信息、 语音信息和手势信息中的至少一 种;  [0009] acquiring target information, where the target information includes at least one of expression information, voice information, and gesture information;
[0010] 将所述目标信息与特征信息库中的预存特征信息进行比较; [0010] comparing the target information with pre-stored feature information in the feature information library;
[0011] 当所述特征信息库中存在与所述目标信息相匹配的预存特征信息吋, 根据存储 的预存特征信息与无人机控制指令的预设对应关系, 获取所述与目标信息相匹 配的预存特征信息对应的第一指令, 其中, 所述无人机控制指令包含所述第一 指令;  [0011] when there is pre-stored feature information 匹配 matching the target information in the feature information database, according to the preset correspondence between the stored pre-stored feature information and the UAV control command, obtaining the matching with the target information a first instruction corresponding to the pre-stored feature information, wherein the UAV control instruction includes the first instruction;
[0012] 执行所述第一指令, 以控制所述无人机。  [0012] executing the first instruction to control the drone.
[0013] 结合本发明实施例第一方面, 在本发明实施例第一方面的第一种可能的实现方 式中, 所述将目标信息与特征信息库中的预存特征信息进行比较之前, 所述方 法还包括: [0013] In conjunction with the first aspect of the embodiments of the present invention, in a first possible implementation manner of the first aspect of the embodiments of the present disclosure, before the comparing the target information with the pre-stored feature information in the feature information database, Square The law also includes:
[0014] 获取验证信息, 并与验证信息库中的预存验证信息进行匹配;  [0014] obtaining verification information, and matching with the pre-stored verification information in the verification information base;
[0015] 当验证信息库中存在与所述验证信息匹配的预存验证信息吋, 执行所述将所述 目标信息与特征信息库中的预存特征信息进行比较的步骤。  [0015] when there is pre-stored verification information 匹配 matching the verification information in the verification information base, performing the step of comparing the target information with the pre-stored feature information in the feature information library.
[0016] 结合本发明实施例第一方面, 在本发明实施例第一方面的第二种可能的实现方 式中, 所述根据存储的预存特征信息与无人机控制指令的预设对应关系, 获取 所述与目标信息相匹配的预存特征信息对应的第一指令之后, 所述方法还包括 [0016] In conjunction with the first aspect of the embodiments of the present invention, in a second possible implementation manner of the first aspect of the embodiment, the preset correspondence between the stored pre-stored feature information and the UAV control command is After acquiring the first instruction corresponding to the pre-stored feature information that matches the target information, the method further includes
[0017] 输出用于提示用户是否执行所述第一指令的提示信息; [0017] outputting prompt information for prompting the user whether to execute the first instruction;
[0018] 当检测到针对所述提示信息的确认指令吋, 执行所述第一指令。 [0018] When a confirmation command for the prompt information is detected, the first instruction is executed.
[0019] 结合本发明实施例第一方面, 在本发明实施例第一方面的第三种可能的实现方 式中, 所述将所述目标信息与特征信息库中的预存特征信息进行比较具体包括 With reference to the first aspect of the embodiments of the present invention, in a third possible implementation manner of the first aspect of the embodiments, the comparing the target information with the pre-stored feature information in the feature information database includes:
[0020] 计算所述目标信息与所述特征信息库中的每个预存特征信息的匹配度; [0020] calculating a matching degree between the target information and each pre-stored feature information in the feature information database;
[0021] 将所述特征信息库中的预存特征信息按照所述匹配度进行降序排列, 以得到降 序排列表; [0021] arranging the pre-stored feature information in the feature information library in descending order according to the matching degree to obtain a descending row list;
[0022] 其中, 所述当所述特征信息库中存在与所述目标信息相匹配的预存特征信息吋 , 根据存储的预存特征信息与无人机控制指令的预设对应关系, 获取所述与目 标信息相匹配的预存特征信息对应的第一指令还包括:  [0022] wherein, when there is pre-stored feature information 匹配 matching the target information in the feature information database, according to the preset correspondence between the stored pre-stored feature information and the UAV control command, the The first instruction corresponding to the pre-stored feature information matched by the target information further includes:
[0023] 获取所述降序排列表中排列在最前面的至少两个预存特征信息; [0023] acquiring at least two pre-stored feature information arranged in the top row of the descending row list;
[0024] 获取所述至少两个预存特征信息对应的无人机控制指令, 以获得至少两个指令 [0024] acquiring the drone control instruction corresponding to the at least two pre-stored feature information, to obtain at least two instructions
[0025] 当检测到所述至少两个指令中的第二指令的选取操作吋, 将所述第二指令确定 为第一指令。 [0025] when a selection operation 第二 of the second instruction of the at least two instructions is detected, the second instruction is determined as the first instruction.
[0026] 结合本发明实施例第一方面、 第一方面的第一种可能的实现方式、 第一方面的 第二种可能的实现方式和第一方面的第三种可能的实现方式中的任一种可能的 实现方式, 在本发明实施例第一方面的第四种可能的实现方式中, 当所述目标 信息为语音信息吋, 所述方法还包括: [0027] 滤除所述目标信息中的噪声, 以得到滤除噪声后的目标信息; [0026] In combination with the first aspect of the embodiments of the present invention, the first possible implementation of the first aspect, the second possible implementation of the first aspect, and any of the third possible implementations of the first aspect In a possible implementation manner, in a fourth possible implementation manner of the first aspect of the embodiments of the present disclosure, when the target information is voice information, the method further includes: [0027] filtering noise in the target information to obtain target information after filtering noise;
[0028] 其中, 所述将所述目标信息与特征信息库中的预存特征信息进行比较包括: [0029] 将所述滤除噪声后的目标信息与特征信息库中的预存特征信息进行比较。 [0028] wherein comparing the target information with the pre-stored feature information in the feature information database includes: [0029] comparing the filtered target information with the pre-stored feature information in the feature information database.
[0030] 本发明第二方面提供一种无人机控制装置, 包括: [0030] A second aspect of the present invention provides a drone control apparatus, including:
[0031] 第一获取单元, 用于获取目标信息, 所述目标信息包括表情信息、 语音信息和 手势信息中的至少一种;  [0031] a first acquiring unit, configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information;
[0032] 比较单元, 用于将所述第一获取单元获取的目标信息与特征信息库中的预存特 征信息进行比较; [0032] a comparing unit, configured to compare the target information acquired by the first acquiring unit with the pre-stored feature information in the feature information database;
[0033] 第二获取单元, 用于当所述比较单元的比较结果是所述特征信息库中存在与所 述目标信息相匹配的预存特征信息吋, 根据存储的预存特征信息与无人机控制 指令的预设对应关系, 获取所述与目标信息相匹配的预存特征信息对应的第一 指令, 其中, 所述无人机控制指令包含所述第一指令;  [0033] a second obtaining unit, configured to: when the comparison result of the comparing unit is that the pre-stored feature information matching the target information exists in the feature information database, according to the stored pre-stored feature information and the drone control a first instruction corresponding to the pre-stored feature information that matches the target information, where the UAV control instruction includes the first instruction;
[0034] 执行单元, 用于执行所述第二获取单元获取的第一指令, 以控制所述无人机。  [0034] an execution unit, configured to execute the first instruction acquired by the second acquiring unit, to control the drone.
[0035] 结合本发明实施例第二方面, 在本发明实施例第二方面的第一种可能的实现方 式中, 所述装置还包括:  [0035] In conjunction with the second aspect of the embodiments of the present invention, in a first possible implementation manner of the second aspect of the embodiments, the apparatus further includes:
[0036] 第三获取单元, 用于获取验证信息, 并与验证信息库中的预存验证信息进行匹 配, 当验证信息库中存在与所述第三获取单元获取的验证信息匹配的预存验证 信息吋, 触发所述执行单元执行所述将所述目标信息与特征信息库中的预存特 征信息进行比较的步骤。  [0036] The third obtaining unit is configured to acquire the verification information, and match the pre-stored verification information in the verification information database, where the pre-stored verification information that matches the verification information acquired by the third acquiring unit exists in the verification information database. And triggering the execution unit to perform the step of comparing the target information with the pre-stored feature information in the feature information library.
[0037] 结合本发明实施例第二方面, 在本发明实施例第二方面的第二种可能的实现方 式中, 所述装置还包括:  [0037] In conjunction with the second aspect of the embodiments of the present invention, in a second possible implementation manner of the second aspect of the embodiments of the present disclosure, the device further includes:
[0038] 输出单元, 用于输出用于提示用户是否执行所述第一指令的提示信息;  [0038] an output unit, configured to output prompt information for prompting the user whether to execute the first instruction;
[0039] 其中, 所述执行单元还用于, 当检测到针对所述提示信息的确认指令吋, 执行 所述第一指令。  [0039] The execution unit is further configured to: when the confirmation command for the prompt information is detected, execute the first instruction.
[0040] 结合本发明实施例第二方面, 在本发明实施例第二方面的第三种可能的实现方 式中, 所述比较单元包括:  [0040] In conjunction with the second aspect of the embodiments of the present invention, in a third possible implementation manner of the second aspect of the embodiments of the present disclosure, the comparing unit includes:
[0041] 计算单元, 用于计算所述第一获取单元获取的目标信息与特征信息库中的每个 预存特征信息的匹配度; [0042] 排列单元, 用于将所述特征信息库中的预存特征信息按照所述计算单元计算的 匹配度进行降序排列, 以得到降序排列表; [0041] a calculation unit, configured to calculate a matching degree of the target information acquired by the first acquiring unit and each pre-stored feature information in the feature information database; [0042] an arranging unit, configured to sort the pre-stored feature information in the feature information library in descending order according to the matching degree calculated by the calculating unit, to obtain a descending row list;
[0043] 其中, 所述第二获取单元进一步包括: [0043] The second acquiring unit further includes:
[0044] 第四获取单元, 用于获取所述排列单元排列的降序排列表中排列在最前面的至 少两个预存特征信息;  [0044] a fourth obtaining unit, configured to acquire at least two pre-stored feature information arranged in the top row in the descending row list of the permuting unit arrangement;
[0045] 第五获取单元, 用于获取所述第四获取单元获取的至少两个预存特征信息对应 的无人机控制指令, 以获得至少两个指令; [0045] a fifth acquiring unit, configured to acquire a drone control instruction corresponding to the at least two pre-stored feature information acquired by the fourth acquiring unit, to obtain at least two instructions;
[0046] 确定单元, 用于当检测到所述第五获取单元获取的至少两个指令中第二指令的 选取操作吋, 将所述第二指令确定为第一指令。  And a determining unit, configured to determine the second instruction as the first instruction when detecting the selecting operation of the second instruction in the at least two instructions acquired by the fifth acquiring unit.
[0047] 结合本发明实施例第二方面、 第二方面的第一种可能的实现方式、 第二方面的 第二种可能的实现方式和第二方面的第三种可能的实现方式中的任一种可能的 实现方式, 在本发明实施例第二方面中第四种可能的实现方式中, 当所述第一 获取单元获取的目标信息为语音信息吋, 所述装置还包括:  [0047] combining the second aspect of the embodiments of the present invention, the first possible implementation manner of the second aspect, the second possible implementation manner of the second aspect, and the third possible implementation manner of the second aspect A possible implementation manner, in a fourth possible implementation manner of the second aspect of the embodiment of the present invention, when the target information acquired by the first acquiring unit is the voice information, the device further includes:
[0048] 第六获取单元, 用于获取所述的噪声信息;  [0048] a sixth obtaining unit, configured to acquire the noise information;
[0049] 滤噪单元, 用于滤除目标信息中的噪声信息, 以得到滤除噪声后的目标信息; [0049] a noise filtering unit, configured to filter out noise information in the target information, to obtain target information after filtering the noise;
[0050] 其中, 所述比较单元具体用于将所述滤噪单元得到的滤除噪声后的目标信息与 特征信息库中的预存特征信息进行比较。 [0050] wherein the comparing unit is specifically configured to compare the target information after filtering the noise obtained by the filtering unit with the pre-stored feature information in the feature information database.
[0051] 本发明实施例中, 获取目标信息, 目标信息包括表情信息、 语音信息和手势信 息中的至少一种; 将目标信息与特征信息库中的预存特征信息进行比较; 当特 征信息库中存在与目标信息相匹配的预存特征信息吋, 根据存储的预存特征信 息与无人机控制指令的预设对应关系, 获取与目标信息相匹配的预存特征信息 对应的第一指令, 其中, 无人机控制指令包含第一指令; 执行第一指令, 以控 制无人机, 可见, 可以通过采集的表情信息、 语音信息和手势信息实现对无人 机的控制, 克服了过度依赖手控遥控器或者移动控制端的问题, 提升了人机交 互性能, 从而提高了无人机控制的多样性。  [0051] In the embodiment of the present invention, acquiring target information, the target information includes at least one of expression information, voice information, and gesture information; comparing the target information with the pre-stored feature information in the feature information database; There is pre-stored feature information matching the target information, and according to the preset correspondence between the stored pre-stored feature information and the UAV control command, acquiring a first instruction corresponding to the pre-stored feature information matching the target information, wherein, The machine control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone can be controlled by the collected expression information, voice information and gesture information, overcoming the excessive dependence on the manual remote controller or The problem of moving the control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
[0052] 附图说明  BRIEF DESCRIPTION OF THE DRAWINGS
[0053] 为了更清楚地说明本发明实施例中的技术方案, 下面将对实施例中所需要使用 的附图作简单地介绍, 显而易见地, 下面描述中的附图是本发明的一些实施例 , 对于本领域普通技术人员来讲, 在不付出创造性劳动的前提下, 还可以根据 这些附图获得其他的附图。 [0053] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are some embodiments of the present invention. For those skilled in the art, other drawings may be obtained based on these drawings without any creative work.
[0054] 图 1是本发明实施例提供的一种无人机控制方法的流程示意图;  1 is a schematic flow chart of a drone control method according to an embodiment of the present invention;
[0055] 图 2是本发明实施例提供的另一种无人机控制方法的流程示意图; 2 is a schematic flow chart of another drone control method according to an embodiment of the present invention;
[0056] 图 3是本发明实施例提供的一种无人机控制装置的结构示意图; 3 is a schematic structural diagram of a drone control device according to an embodiment of the present invention;
[0057] 图 4是本发明实施例提供的另一种无人机控制装置的结构示意图; 4 is a schematic structural diagram of another drone control device according to an embodiment of the present invention;
[0058] 图 5是本发明实施例提供的又一种无人机控制装置的结构示意图。 5 is a schematic structural diagram of still another UAV control device according to an embodiment of the present invention.
[0059] 具体实施方式 DETAILED DESCRIPTION
[0060] 下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案进行清楚、 完整地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是全部的实 施例。 基于本发明中的实施例, 本领域普通技术人员在没有做出创造性劳动前 提下所获得的所有其他实施例, 都属于本发明保护的范围。  The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. . All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without departing from the inventive work are all within the scope of the present invention.
[0061] 本发明实施例提供一种无人机控制方法及装置, 可以增加对无人机的控制方式 , 从而提高无人机控制的多样性。 以下分别进行详细说明。  [0061] Embodiments of the present invention provide a drone control method and apparatus, which can increase the control mode of the drone, thereby improving the diversity of the drone control. The details are described below separately.
[0062] 请参阅图 1, 图 1是本发明实施例提供的一种无人机控制方法的流程示意图。 其 中, 该无人机控制方法是从无人机控制装置的角度来描述的。 如图 1所示, 该无 人机控制方法可以包括以下步骤。  Please refer to FIG. 1. FIG. 1 is a schematic flowchart diagram of a drone control method according to an embodiment of the present invention. Among them, the drone control method is described from the perspective of the drone control device. As shown in Fig. 1, the man-machineless control method may include the following steps.
[0063] S101、 获取目标信息。  [0063] S101. Acquire target information.
[0064] 本实施例中, 目标信息包括表情信息、 语音信息和手势信息中的至少一种。 其 中, 获取目标信息可以包括: 获取人脸图像、 语音、 手势图像或触摸手势中的 至少一种, 其中, 人脸图像和手势图像可以是动态图像, 即至少两帧图像形成 的图像流, 触摸手势可以是通过触摸屏和操作系统来检测; 检测获取的人脸图 像的表情信息、 语音中的语音信息、 手势图像或触摸手势中的手势信息, 以得 到表情信息、 语音信息和手势信息中的至少一种信息。 其中, 表情信息可以通 过人脸轮廓识别分析得到, 表情信息、 语音信息和手势信息或触摸手势对应控 制无人机的控制指令; 该控制指令可以包括: 控制无人机按照指定方位飞行、 升高降低、 向操控者飞近飞远、 绕目标飞行、 飞行平台所携带的载荷方位和俯 仰动作的指令等。 [0065] S102、 将目标信息与特征信息库中的预存特征信息进行比较。 [0064] In this embodiment, the target information includes at least one of expression information, voice information, and gesture information. The acquiring the target information may include: acquiring at least one of a face image, a voice, a gesture image, or a touch gesture, where the face image and the gesture image may be a dynamic image, that is, an image stream formed by at least two frames of images, touching The gesture may be detected by the touch screen and the operating system; detecting the facial expression information of the acquired facial image, the voice information in the voice, the gesture image, or the gesture information in the touch gesture to obtain at least at least one of the expression information, the voice information, and the gesture information. A kind of information. The expression information may be obtained through facial contour recognition analysis, and the expression information, the voice information, and the gesture information or the touch gesture correspondingly control the control instruction of the drone; the control instruction may include: controlling the drone to fly according to the specified orientation, and increasing Reduce, fly to the controller, fly around the target, load direction and pitch motion commands carried by the flight platform. [0065] S102. Compare the target information with the pre-stored feature information in the feature information database.
[0066] 本实施例中, 为了对预存特征信息进行管理, 特征信息库为预设的, 可以提前 通过摄像头或者麦克风等装置采集人脸图像、 语音、 手势图像或触摸手势, 并 提取这些人脸图像、 语音、 手势图像或触摸手势的预存特征信息并存储在特征 信息库中, 以便后续调用。 [0066] In this embodiment, in order to manage the pre-stored feature information, the feature information library is preset, and the face image, the voice, the gesture image, or the touch gesture may be collected in advance through a camera or a microphone, and the faces are extracted. The pre-stored feature information of the image, voice, gesture image or touch gesture is stored in the feature information library for subsequent calls.
[0067] S103、 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据存储的 预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹配的预 存特征信息对应的第一指令。  [0067] S103. When the feature information database has pre-stored feature information that matches the target information, obtain pre-stored feature information that matches the target information according to the preset correspondence between the stored pre-stored feature information and the UAV control command. Corresponding first instruction.
[0068] 本实施例中, 特征信息库中的预存特征信息与无人机控制指令可以是一一对应 的。 该对应关系是预设的, 其中, 无人机控制指令包含第一指令。  [0068] In this embodiment, the pre-stored feature information in the feature information database may be in one-to-one correspondence with the drone control command. The correspondence is preset, wherein the drone control instruction includes the first instruction.
[0069] S104、 执行第一指令, 以控制所述无人机。  [0069] S104. Perform a first instruction to control the drone.
[0070] 本实施例中, 该第一指令是无人机控制装置用于控制无人机的指令, 例如, 可 以是发送飞行指令给无人机飞行平台执行相应的飞行动作, 飞行动作可以包括 : 无人机按照指定方位飞行、 升高降低、 向操控者飞近飞远、 绕目标飞行、 飞 行平台所携带的载荷方位和俯仰动作等。  [0070] In this embodiment, the first instruction is an instruction of the UAV control device for controlling the UAV, for example, the flight instruction may be sent to the UAV flight platform to perform a corresponding flight action, and the flight action may include : The drone is flying in the specified direction, raising and lowering, flying to the controller, flying around the target, the load azimuth and pitching motion carried by the flight platform.
[0071] 在图 1所描述的无人机控制方法中, 获取目标信息, 目标信息包括表情信息、 语音信息和手势信息中的至少一种; 将目标信息与特征信息库中的预存特征信 息进行比较; 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据 存储的预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹 配的预存特征信息对应的第一指令, 其中, 无人机控制指令包含第一指令; 执 行第一指令, 以控制无人机, 可见, 可以通过采集的表情信息、 语音信息和手 势信息实现对无人机的控制, 克服了过度依赖手控遥控器或者移动控制端的问 题, 提升了人机交互性能, 从而提高了无人机控制的多样性。  [0071] In the drone control method described in FIG. 1, the target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information An instruction, wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
[0072] 请参阅图 2, 图 2是本发明实施例提供的另一种无人机控制方法的流程示意图。  [0072] Please refer to FIG. 2. FIG. 2 is a schematic flowchart diagram of another UAV control method according to an embodiment of the present invention.
其中, 该无人机控制方法是从无人机控制装置的角度来描述的。 如图 2所示, 该 无人机控制方法可以包括以下步骤。  Wherein, the drone control method is described from the perspective of the drone control device. As shown in FIG. 2, the drone control method may include the following steps.
[0073] S201、 获取目标信息。  [0073] S201. Acquire target information.
[0074] 本实施例中, 目标信息包括表情信息、 语音信息和手势信息中的至少一种。 其 中, 获取目标信息可以包括: 获取人脸图像、 语音、 手势图像或触摸手势中的 至少一种, 其中, 人脸图像和手势图像可以是动态图像, 即至少两帧图像形成 的图像流, 触摸手势可以是通过触摸屏和操作系统来检测; 检测获取的人脸图 像的表情信息、 语音中的语音信息、 手势图像或触摸手势中的手势信息, 以得 到表情信息、 语音信息和手势信息中的至少一种信息。 其中, 表情信息可以通 过人脸轮廓识别分析得到, 表情信息、 语音信息和手势信息或触摸手势对应控 制无人机的控制指令; 该控制指令可以包括: 控制无人机按照指定方位飞行、 升高降低、 向操控者飞近飞远、 绕目标飞行、 飞行平台所携带的载荷方位和俯 仰动作的指令等。 [0074] In this embodiment, the target information includes at least one of expression information, voice information, and gesture information. Its The obtaining the target information may include: acquiring at least one of a face image, a voice, a gesture image, or a touch gesture, where the face image and the gesture image may be a dynamic image, that is, an image stream formed by at least two frames of images, touching The gesture may be detected by the touch screen and the operating system; detecting the facial expression information of the acquired facial image, the voice information in the voice, the gesture image, or the gesture information in the touch gesture to obtain at least at least one of the expression information, the voice information, and the gesture information. A kind of information. The expression information may be obtained through facial contour recognition analysis, and the expression information, the voice information, and the gesture information or the touch gesture correspondingly control the control instruction of the drone; the control instruction may include: controlling the drone to fly according to the specified orientation, and increasing Reduce, fly to the controller, fly around the target, load direction and pitch motion commands carried by the flight platform.
[0075] S202、 获取验证信息, 并与验证信息库中的预存验证信息进行匹配。  [0075] S202. Acquire verification information, and match the pre-stored verification information in the verification information base.
[0076] 本实施例中, 为保证操作无人机的私密性, 需要通过验证信息进行验证, 其中 , 验证信息可以是用户输入人脸图像的人脸特征, 可以是语音的声纹特征, 也 可以是手势图像或者触摸手势输入的指纹信息, 也可以是其他验证信息。  [0076] In this embodiment, in order to ensure the privacy of the operating drone, the verification information is required to be verified. The verification information may be a facial feature of the user inputting the face image, and may be a voiceprint feature of the voice. It may be fingerprint information input by a gesture image or a touch gesture, or may be other verification information.
[0077] S203、 当验证信息库中存在与验证信息匹配的预存验证信息吋, 将目标信息与 特征信息库中的预存特征信息进行比较。  [0077] S203. When there is pre-stored verification information 匹配 matching the verification information in the verification information base, compare the target information with the pre-stored feature information in the feature information database.
[0078] 本实施例中, 为了对验证信息进行管理, 验证信息库为预设的, 可以提前通过 摄像头或者麦克风等装置采集人脸图像、 语音、 手势图像或触摸手势, 并提取 这些人脸图像、 语音、 手势图像或触摸手势的验证信息并存储在验证信息库中 , 以便后续调用。 当输入的验证信息在验证信息库中存在吋, 说明验证通过。  [0078] In this embodiment, in order to manage the verification information, the verification information base is preset, and the face image, the voice, the gesture image, or the touch gesture may be collected in advance through a camera or a microphone, and the face images are extracted. The verification information of the voice, gesture image or touch gesture is stored in the verification information base for subsequent calls. When the entered verification information exists in the verification information base, the verification is passed.
[0079] 进一步地, 将目标信息与特征信息库中的预存特征信息进行比较可以包括: 计 算目标信息与特征信息库中的每个预存特征信息的匹配度; 将特征信息库中的 预存特征信息按照匹配度进行降序排列, 以得到降序排列表。  [0079] Further, comparing the target information with the pre-stored feature information in the feature information database may include: calculating a matching degree between the target information and each of the pre-stored feature information in the feature information database; and pre-stored feature information in the feature information database Sort in descending order by matching degree to get a descending list.
[0080] S204、 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据存储的 预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹配的预 存特征信息对应的第一指令。  [0080] S204, when there is pre-stored feature information matching the target information in the feature information database, acquiring pre-stored feature information matching the target information according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command Corresponding first instruction.
[0081] 本实施例中, 无人机控制指令包含第一指令, 为了对预存特征信息进行管理, 特征信息库为预设的, 可以提前通过摄像头或者麦克风等装置采集人脸图像、 语音、 手势图像或触摸手势, 并提取这些人脸图像、 语音、 手势图像或触摸手 势的预存特征信息并存储在特征信息库中, 以便后续调用。 其中, 特征信息库 中的预存特征信息与无人机控制指令可以是一一对应的, 该对应关系是预设的 , 可以通过该对应关系获取预存特征信息对应的第一指令。 [0081] In this embodiment, the drone control command includes the first instruction. In order to manage the pre-stored feature information, the feature information library is preset, and the face image, the voice, the gesture may be collected in advance through a device such as a camera or a microphone. Image or touch gestures, and extract these face images, speech, gesture images or touch hands The pre-stored feature information of the potential is stored in the feature information base for subsequent calls. The pre-stored feature information in the feature information database may be in one-to-one correspondence with the UAV control command, and the corresponding relationship is preset, and the first instruction corresponding to the pre-stored feature information may be acquired by the corresponding relationship.
[0082] 进一步地, 根据存储的预存特征信息与无人机控制指令的预设对应关系, 获取 与目标信息相匹配的预存特征信息对应的第一指令还可以包括: 获取降序排列 表中排列在最前面的至少两个预存特征信息; 获取至少两个预存特征信息对应 的无人机控制指令, 以获得至少两个指令; 当检测到至少两个指令中的第二指 令的选取操作吋, 将第二指令确定为第一指令。  [0082] Further, the first instruction corresponding to the pre-stored feature information that matches the target information may further include: obtaining, in the descending row list, the first instruction in the descending row list according to the preset correspondence between the stored pre-stored feature information and the UAV control command At least two pre-stored feature information; obtaining at least two unmanned machine control instructions corresponding to the pre-stored feature information to obtain at least two instructions; when detecting a selection operation of the second one of the at least two instructions, The second instruction is determined to be the first instruction.
[0083] 由于图像识别及语音识别存在较高的错误率, 识别后输出匹配率最大的至少两 个指令, 至少两个指令中用户确认的指令作为要执行的第一指令, 这样可以避 免图像识别及语音识别较高的错误率带来的误操作。  [0083] Since image recognition and speech recognition have a high error rate, at least two instructions having the largest matching ratio are output after recognition, and the user-confirmed instruction of at least two instructions is used as the first instruction to be executed, thereby avoiding image recognition. And the high error rate caused by speech recognition.
[0084] S205、 输出用于提示用户是否执行第一指令的提示信息。  [0084] S205. Output prompt information for prompting the user whether to execute the first instruction.
[0085] 本实施例中, 提示消息用于使用户确认执行第一指令, 例如, 当第一指令是用 于控制无人机执行某一动作, 如降落吋, 在显示屏上显示或者通过语音输出提 示消息: 是否执行降落?  [0085] In this embodiment, the prompt message is used to enable the user to confirm execution of the first instruction, for example, when the first instruction is used to control the drone to perform an action, such as landing, displaying on the display or by voice. Output prompt message: Do you want to perform a landing?
[0086] S206、 当检测到针对提示信息的确认指令吋, 执行第一指令。  [0086] S206. When the confirmation command for the prompt information is detected, executing the first instruction.
[0087] 本实施例中, 确认指令可以是点击确认按键, 输入语音确认, 或者其它操作用 于确认继续执行第一指令。 其中, 该第一指令是无人机控制装置用于控制无人 机的指令, 例如, 可以是发送飞行指令给无人机飞行平台执行相应的飞行动作 , 飞行动作可以包括: 无人机按照指定方位飞行、 升高降低、 向操控者飞近飞 远、 绕目标飞行、 飞行平台所携带的载荷方位和俯仰动作等。  In this embodiment, the confirmation command may be a click confirmation button, a voice confirmation is input, or other operations are used to confirm the execution of the first instruction. The first instruction is an instruction of the drone control device for controlling the drone. For example, the flight instruction may be sent to the drone flight platform to perform a corresponding flight action, and the flight action may include: the drone according to the specified Azimuth flight, elevation reduction, flying to the controller, flying around the target, load orientation and pitching motion carried by the flight platform.
[0088] 本实施例中, 进一步地, 当该目标信息为语音信息吋, 该控制方法还可以包括 : 滤除目标信息中的噪声, 以得到滤除噪声后的目标信息; 将目标信息与特征 信息库中的预存特征信息进行比较可以包括: 将滤除噪声后的目标信息与特征 信息库中的预存特征信息进行比较。  [0088] In this embodiment, further, when the target information is voice information, the control method may further include: filtering out noise in the target information to obtain target information after filtering noise; and selecting target information and features Comparing the pre-stored feature information in the information base may include: comparing the target information after filtering the noise with the pre-stored feature information in the feature information base.
[0089] 在图 2所描述的无人机控制方法中, 获取目标信息, 目标信息包括表情信息、 语音信息和手势信息中的至少一种; 将目标信息与特征信息库中的预存特征信 息进行比较; 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据 存储的预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹 配的预存特征信息对应的第一指令, 无人机控制指令包含第一指令; 执行第一 指令, 以控制无人机, 可见, 可以通过采集的表情信息、 语音信息和手势信息 实现对无人机的控制, 克服了过度依赖手控遥控器或者移动控制端的问题, 提 升了人机交互性能, 从而提高了无人机控制的多样性。 [0089] In the UAV control method described in FIG. 2, target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparison; when there is pre-stored feature information matching the target information in the feature information base, according to The preset correspondence between the stored pre-stored feature information and the UAV control command acquires a first instruction corresponding to the pre-stored feature information matching the target information, and the UAV control instruction includes the first instruction; and executes the first instruction to control The drone, visible, can control the drone through the collected expression information, voice information and gesture information, overcomes the problem of over-reliance on the hand-controlled remote controller or the mobile control terminal, improves the human-computer interaction performance, and thus improves the The diversity of drone control.
[0090] 请参阅图 3, 图 3是本发明实施例提供的无人机控制装置的结构图。 如图 3所示 Please refer to FIG. 3. FIG. 3 is a structural diagram of a drone control device according to an embodiment of the present invention. As shown in Figure 3
, 该无人机控制装置可以包括: The drone control device can include:
[0091] 第一获取单元 301, 用于获取目标信息, 目标信息包括表情信息、 语音信息和 手势信息中的至少一种; [0091] The first obtaining unit 301 is configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information;
[0092] 比较单元 302, 用于将第一获取单元 301获取的目标信息与特征信息库中的预存 特征信息进行比较; [0092] The comparing unit 302 is configured to compare the target information acquired by the first acquiring unit 301 with the pre-stored feature information in the feature information database;
[0093] 第二获取单元 303, 用于当比较单元 302的比较结果是特征信息库中存在与目标 信息相匹配的预存特征信息吋, 根据存储的预存特征信息与无人机控制指令的 预设对应关系, 获取与目标信息相匹配的预存特征信息对应的第一指令, 其中 , 无人机控制指令包含第一指令;  [0093] The second obtaining unit 303 is configured to: when the comparison result of the comparing unit 302 is that the pre-stored feature information matching the target information exists in the feature information base, according to the stored pre-stored feature information and the preset of the drone control instruction Corresponding relationship, obtaining a first instruction corresponding to the pre-stored feature information that matches the target information, where the drone control instruction includes the first instruction;
[0094] 执行单元 304, 用于执行第二获取单元 303获取的第一指令, 以控制所述无人机  [0094] The executing unit 304 is configured to execute the first instruction acquired by the second obtaining unit 303, to control the drone
[0095] 在图 3所描述的无人机控制装置中, 获取目标信息, 目标信息包括表情信息、 语音信息和手势信息中的至少一种; 将目标信息与特征信息库中的预存特征信 息进行比较; 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据 存储的预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹 配的预存特征信息对应的第一指令, 其中, 无人机控制指令包含第一指令; 执 行第一指令, 以控制无人机, 可见, 可以通过采集的表情信息、 语音信息和手 势信息实现对无人机的控制, 克服了过度依赖手控遥控器或者移动控制端的问 题, 提升了人机交互性能, 从而提高了无人机控制的多样性。 [0095] In the UAV control device described in FIG. 3, target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information An instruction, wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
[0096] 请参阅图 4, 图 4是本发明实施例提供的另一种无人机控制装置的结构示意图。  [0096] Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of another UAV control device according to an embodiment of the present invention.
其中, 图 4所示的无人机控制装置是由图 3所示的无人机控制装置优化得到的, 其中, 该装置还可以包括: [0097] 第三获取单元 305, 用于获取验证信息, 并与验证信息库中的预存验证信息进 行匹配; 当验证信息库中存在与第三获取单元 305获取的验证信息匹配的预存验 证信息吋, 触发比较单元 302执行所述将第一获取单元 301获取的目标信息与特 征信息库中的预存特征信息进行比较的步骤。 The UAV control device shown in FIG. 4 is optimized by the UAV control device shown in FIG. 3, wherein the device may further include: [0097] The third obtaining unit 305 is configured to acquire the verification information, and match the pre-stored verification information in the verification information base; and the pre-stored verification information that matches the verification information acquired by the third obtaining unit 305 exists in the verification information database. The trigger comparison unit 302 performs the step of comparing the target information acquired by the first acquisition unit 301 with the pre-stored feature information in the feature information library.
[0098] 具体地, 比较单元 302将目标信息与特征信息库中的预存特征信息进行比较之 前, 将触发第三获取单元 305获取验证信息。  [0098] Specifically, before the comparing unit 302 compares the target information with the pre-stored feature information in the feature information database, the third obtaining unit 305 is triggered to acquire the verification information.
[0099] 作为一种可能的实施方式, 该装置还可以包括:  [0099] As a possible implementation manner, the apparatus may further include:
[0100] 输出单元 306, 用于输出用于提示用户是否执行第一指令的提示信息; 其中, 执行单元 304还用于, 当检测到针对输出单元 306输出的提示信息的确认指令吋 [0100] The output unit 306 is configured to output prompt information for prompting the user whether to execute the first instruction. The executing unit 304 is further configured to: when the confirmation command for the prompt information output by the output unit 306 is detected,
, 执行第一指令。 , execute the first instruction.
[0101] 具体地, 第二获取单元 303根据存储的预存特征信息与无人机控制指令的预设 对应关系, 获取第一获取单元 301获取的与目标信息相匹配的预存特征信息对应 的第一指令之后, 输出单元 306输出用于提示用户是否执行第二获取单元 303获 取的第一指令的提示信息。  [0101] Specifically, the second obtaining unit 303 acquires, according to the preset correspondence between the stored pre-stored feature information and the UAV control command, the first corresponding to the pre-stored feature information that is acquired by the first acquiring unit 301 and matches the target information. After the instruction, the output unit 306 outputs prompt information for prompting the user whether to execute the first instruction acquired by the second acquisition unit 303.
[0102] 作为一种可能的实施方式, 比较单元 302可以包括:  [0102] As a possible implementation manner, the comparing unit 302 may include:
[0103] 计算单元 3021, 用于计算第一获取单元 301获取的目标信息与特征信息库中的 每个预存特征信息的匹配度;  [0103] The calculating unit 3021 is configured to calculate a matching degree between the target information acquired by the first acquiring unit 301 and each pre-stored feature information in the feature information library;
[0104] 排列单元 3022, 用于将特征信息库中的预存特征信息按照计算单元 3021计算的 匹配度进行降序排列, 以得到降序排列表; [0104] The arranging unit 3022 is configured to perform the descending order of the pre-stored feature information in the feature information database according to the matching degree calculated by the calculating unit 3021 to obtain a descending row list;
[0105] 具体地, 当验证信息库中存在第三获取单元 305获取的验证信息吋, 计算单元 3[0105] Specifically, when the verification information acquired by the third obtaining unit 305 exists in the verification information base, the calculating unit 3
021计算目标信息与特征信息库中的每个预存特征信息的匹配度; 021 calculating a matching degree between the target information and each pre-stored feature information in the feature information database;
[0106] 其中, 第二获取单元 303可以进一步包括: [0106] The second obtaining unit 303 may further include:
[0107] 第四获取单元 3031, 用于获取排列单元 3022排列的降序排列表中排列在最前面 的至少两个预存特征信息;  [0107] The fourth obtaining unit 3031 is configured to obtain at least two pre-stored feature information arranged in the top row in the descending row list arranged by the arranging unit 3022;
[0108] 第五获取单元 3032, 用于获取第四获取单元 3031获取的至少两个预存特征信息 对应的无人机控制指令, 以获得至少两个指令;  [0108] The fifth obtaining unit 3032 is configured to acquire the drone control instruction corresponding to the at least two pre-stored feature information acquired by the fourth acquiring unit 3031, to obtain at least two instructions;
[0109] 确定单元 3033, 用于当检测到第五获取单元 3032获取的至少两个指令中的第二 指令的选取操作吋, 将第二指令确定为第一指令。 [0110] 具体地, 执行单元 304, 用于执行确定单元 3033确定的第一指令, 以控制无人 机; [0109] The determining unit 3033 is configured to determine, as the first instruction, the selecting operation of the second instruction of the at least two instructions acquired by the fifth obtaining unit 3032. [0110] Specifically, the executing unit 304 is configured to execute the first instruction determined by the determining unit 3033 to control the drone;
[0111] 具体地, 输出单元 306, 用于输出用于提示用户是否执行确定单元 3033确定的 第一指令的提示信息。  [0111] Specifically, the output unit 306 is configured to output prompt information for prompting the user whether to execute the first instruction determined by the determining unit 3033.
[0112] 作为一种可能的实施方式, 当第一获取单元 301获取的目标信息为语音信息吋 , 该装置还可以包括:  [0112] As a possible implementation manner, when the target information acquired by the first acquiring unit 301 is voice information, the device may further include:
[0113] 滤噪单元 307, 用于滤除目标信息中的噪声, 以得到滤除噪声后的目标信息; [0113] a noise filtering unit 307, configured to filter out noise in the target information, to obtain target information after filtering the noise;
[0114] 其中, 比较单元 302具体用于将滤噪单元 307得到的滤除噪声后的目标信息与特 征信息库中的预存特征信息进行比较。 [0114] The comparing unit 302 is specifically configured to compare the filtered target information obtained by the filtering unit 307 with the pre-stored feature information in the feature information database.
[0115] 具体地, 比较单元 302中的计算单元 3021用于计算滤噪单元 307得到的滤除噪声 后的目标信息与特征信息库中的每个预存特征信息的匹配度。  [0115] Specifically, the calculating unit 3021 in the comparing unit 302 is configured to calculate the matching degree of the filtered noise target information obtained by the filtering unit 307 and each pre-stored feature information in the feature information library.
[0116] 在图 4所描述的无人机控制装置中, 获取目标信息, 目标信息包括表情信息、 语音信息和手势信息中的至少一种; 将目标信息与特征信息库中的预存特征信 息进行比较; 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据 存储的预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹 配的预存特征信息对应的第一指令, 其中, 无人机控制指令包含第一指令; 执 行第一指令, 以控制无人机, 可见, 可以通过采集的表情信息、 语音信息和手 势信息实现对无人机的控制, 克服了过度依赖手控遥控器或者移动控制端的问 题, 提升了人机交互性能, 从而提高了无人机控制的多样性。  [0116] In the drone control device described in FIG. 4, target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information An instruction, wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
[0117] 请参阅图 5, 图 5是本发明实施例提供的又一种通信装置的结构示意图。 如图 5 所示, 该通信装置可以包括: 至少一个处理器 501, 例如 CPU、 存储器 502、 信息 获取装置 503以及至少一个通信总线 504。 其中, 信息获取装置 503可以是摄像头 、 麦克风中的至少一种。 其中, 通信总线 504用于实现这些组件之间的连接通信 。 存储器 502可以是高速 RAM存储器, 还可以是非不稳定的存储器 (non- volatile memory) , 例如至少一个磁盘存储器。 存储器 502可选的可以包含至少一个位于 远离前述处理器 501的存储装置。 其中:  [0117] Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of still another communication apparatus according to an embodiment of the present invention. As shown in FIG. 5, the communication device can include: at least one processor 501, such as a CPU, a memory 502, an information acquisition device 503, and at least one communication bus 504. The information acquiring device 503 may be at least one of a camera and a microphone. Among them, the communication bus 504 is used to implement connection communication between these components. The memory 502 may be a high speed RAM memory or a non-volatile memory such as at least one disk memory. The memory 502 can optionally include at least one storage device located remotely from the aforementioned processor 501. among them:
[0118] 信息获取装置 503, 用于获取目标信息, 目标信息包括表情信息、 语音信息和 手势信息中的至少一种; [0119] 处理器 501用于调用存储器 502中存储的程序代码执行以下操作: [0118] The information acquiring device 503 is configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information; [0119] The processor 501 is configured to call the program code stored in the memory 502 to perform the following operations:
[0120] 将目标信息与特征信息库中的预存特征信息进行比较; [0120] comparing the target information with the pre-stored feature information in the feature information library;
[0121] 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据存储的预存特 征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹配的预存特征 信息对应的第一指令, 其中, 无人机控制指令包含第一指令;  [0121] when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, acquiring pre-stored feature information corresponding to the target information a first instruction, wherein the drone control instruction includes a first instruction;
[0122] 执行第一指令, 以控制所述无人机。  [0122] executing a first instruction to control the drone.
[0123] 作为一种可能的实施方式, 处理器 501将目标信息与特征信息库中的预存特征 信息进行比较之前, 处理器 501还用于调用存储器 502中存储的程序代码执行以 下操作:  [0123] As a possible implementation, before the processor 501 compares the target information with the pre-stored feature information in the feature information library, the processor 501 is further configured to invoke the program code stored in the memory 502 to perform the following operations:
[0124] 获取验证信息, 并与验证信息库中的预存验证信息进行匹配;  [0124] obtaining verification information, and matching with the pre-stored verification information in the verification information base;
[0125] 当验证信息库中存在与验证信息匹配的预存验证信息吋, 执行将目标信息与特 征信息库中的预存特征信息进行比较的步骤。  [0125] When there is pre-stored verification information 匹配 matching the verification information in the verification information base, a step of comparing the target information with the pre-stored feature information in the feature information library is performed.
[0126] 作为一种可能的实施方式, 处理器 501根据存储的预存特征信息与无人机控制 指令的预设对应关系, 获取与目标信息相匹配的预存特征信息对应的第一指令 之后, 处理器 501还用于调用存储器 502中存储的程序代码执行以下操作: [0126] As a possible implementation manner, the processor 501, after acquiring the first instruction corresponding to the pre-stored feature information that matches the target information, according to the preset correspondence between the stored pre-stored feature information and the UAV control command, processing The 501 is further configured to call the program code stored in the memory 502 to perform the following operations:
[0127] 输出用于提示用户是否执行第一指令的提示信息; [0127] outputting prompt information for prompting the user whether to execute the first instruction;
[0128] 当检测到针对提示信息的确认指令吋, 执行该执行第一指令。 [0128] When the confirmation command for the prompt information is detected, the execution of the first instruction is executed.
[0129] 作为一种可能的实施方式, 处理器 501将目标信息与特征信息库中的预存特征 信息进行比较具体包括: [0129] As a possible implementation manner, comparing, by the processor 501, the target information with the pre-stored feature information in the feature information database specifically includes:
[0130] 计算目标信息与特征信息库中的每个预存特征信息的匹配度; [0130] calculating a matching degree of the target information and each of the pre-stored feature information in the feature information database;
[0131] 将特征信息库中的预存特征信息按照匹配度进行降序排列, 以得到降序排列表 [0131] arranging the pre-stored feature information in the feature information library in descending order according to the matching degree to obtain a descending row list
[0132] 其中, 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 处理器 501 根据存储的预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息 相匹配的预存特征信息对应的第一指令还包括: [0132] wherein, when there is pre-stored feature information in the feature information database that matches the target information, the processor 501 acquires the target information according to the preset correspondence between the stored pre-stored feature information and the UAV control command. The first instruction corresponding to the pre-stored feature information further includes:
[0133] 获取降序排列表中排列在最前面的至少两个预存特征信息; [0133] acquiring at least two pre-stored feature information arranged in the top row in the descending row list;
[0134] 获取至少两个预存特征信息对应的无人机控制指令, 以获得至少两个指令; [0135] 当检测到至少两个指令中的第二指令的选取操作吋, 处理器 501将第二指令确 定为第一指令。 [0134] acquiring at least two unmanned machine control instructions corresponding to the pre-stored feature information to obtain at least two instructions; [0135] when detecting a selection operation of the second one of the at least two instructions, the processor 501 Second instruction Set as the first instruction.
[0136] 作为一种可能的实施方式, 当目标信息为语音信息吋, 处理器 501还用于调用 存储器 502中存储的程序代码执行以下操作:  [0136] As a possible implementation manner, when the target information is voice information, the processor 501 is further configured to invoke the program code stored in the memory 502 to perform the following operations:
[0137] 滤除目标信息中的噪声噪声, 以得到滤除噪声后的目标信息; [0137] filtering out noise noise in the target information to obtain target information after filtering the noise;
[0138] 其中, 处理器 501将目标信息与特征信息库中的预存特征信息进行比较包括: [0139] 将滤除噪声后的目标信息与特征信息库中的预存特征信息进行比较。 [0138] The comparing, by the processor 501, the target information with the pre-stored feature information in the feature information library includes: [0139] comparing the filtered target information with the pre-stored feature information in the feature information database.
[0140] 在图 5所描述的无人机控制装置中, 获取目标信息, 目标信息包括表情信息、 语音信息和手势信息中的至少一种; 将目标信息与特征信息库中的预存特征信 息进行比较; 当特征信息库中存在与目标信息相匹配的预存特征信息吋, 根据 存储的预存特征信息与无人机控制指令的预设对应关系, 获取与目标信息相匹 配的预存特征信息对应的第一指令, 其中, 无人机控制指令包含第一指令; 执 行第一指令, 以控制无人机, 可见, 可以通过采集的表情信息、 语音信息和手 势信息实现对无人机的控制, 克服了过度依赖手控遥控器或者移动控制端的问 题, 提升了人机交互性能, 从而提高了无人机控制的多样性。 [0140] In the drone control device described in FIG. 5, target information is acquired, and the target information includes at least one of expression information, voice information, and gesture information; and the target information and the pre-stored feature information in the feature information database are performed. Comparing; when there is pre-stored feature information matching the target information in the feature information base, according to the preset correspondence relationship between the stored pre-stored feature information and the UAV control command, obtaining the corresponding corresponding to the pre-stored feature information matching the target information An instruction, wherein the drone control instruction includes a first instruction; the first instruction is executed to control the drone, and the drone control can be realized by collecting the expression information, the voice information, and the gesture information, thereby overcoming Over-reliance on the problem of the hand-controlled remote control or the mobile control terminal improves the human-computer interaction performance, thereby improving the diversity of drone control.
[0141] 本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可 以通过程序来指令相关的硬件来完成, 该程序可以存储于一计算机可读存储介 质中, 存储介质可以包括: 闪存盘、 只读存储器 (Read-Only Memory, ROM) 、 随机存取器 (Random Access Memory , RAM) 、 磁盘或光盘等。 [0141] A person of ordinary skill in the art may understand that all or part of the various methods of the foregoing embodiments may be completed by a program instructing related hardware, and the program may be stored in a computer readable storage medium, the storage medium It can include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disc.
[0142] 以上对本发明实施例提供的无人机控制方法及装置进行了详细介绍, 本文中应 用了具体个例对本发明的原理及实施方式进行了阐述, 以上实施例的说明只是 用于帮助理解本发明的方法及其核心思想; 同吋, 对于本领域的一般技术人员 , 依据本发明的思想, 在具体实施方式及应用范围上均会有改变之处, 综上所 述, 本说明书内容不应理解为对本发明的限制。 The method and device for controlling the drone provided by the embodiment of the present invention are described in detail. The principle and the embodiment of the present invention are described in the following. The description of the above embodiment is only used to help understanding. The method of the present invention and its core idea; at the same time, those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and the scope of application, in summary, the contents of this specification are not It should be understood that the invention is limited.
技术问题  technical problem
问题的解决方案  Problem solution
发明的有益效果  Advantageous effects of the invention

Claims

权利要求书 Claim
[权利要求 1] 一种无人机控制方法, 其特征在于, 包括:  [Claim 1] A method for controlling a drone, comprising:
获取目标信息, 所述目标信息包括表情信息、 语音信息和手势信息中 的至少一种; 将所述目标信息与特征信息库中的预存特征信息进行比较; 当所述特征信息库中存在与所述目标信息相匹配的预存特征信息吋, 根据存储的预存特征信息与无人机控制指令的预设对应关系, 获取所 述与目标信息相匹配的预存特征信息对应的第一指令, 其中, 所述无 人机控制指令包含所述第一指令;  Obtaining target information, where the target information includes at least one of expression information, voice information, and gesture information; comparing the target information with pre-stored feature information in the feature information library; and presenting in the feature information database The pre-stored feature information matching the target information, the first instruction corresponding to the pre-stored feature information matching the target information is obtained according to the preset correspondence between the stored pre-stored feature information and the UAV control command, where Said drone control instruction comprising said first instruction;
执行所述第一指令, 以控制所述无人机。  The first instruction is executed to control the drone.
[权利要求 2] 根据权利要求 1所述的方法, 其特征在于, 所述将目标信息与特征信 息库中的预存特征信息进行比较之前, 所述方法还包括: [Claim 2] The method according to claim 1, wherein the method further comprises: comparing the target information with the pre-stored feature information in the feature information database, the method further comprising:
获取验证信息, 并与验证信息库中的预存验证信息进行匹配; 当验证信息库中存在与所述验证信息匹配的预存验证信息吋, 执行所 述将目标信息与特征信息库中的预存特征信息进行比较的步骤。  Obtaining verification information, and matching with the pre-stored verification information in the verification information base; when there is pre-stored verification information matching the verification information in the verification information base, performing the pre-stored feature information in the target information and the feature information database The steps to compare.
[权利要求 3] 根据权利要求 1所述的方法, 其特征在于, 所述根据存储的预存特征 信息与无人机控制指令的预设对应关系, 获取所述与目标信息相匹配 的预存特征信息对应的第一指令之后, 所述方法还包括: [Claim 3] The method according to claim 1, wherein the pre-stored feature information matching the target information is obtained according to the preset correspondence between the stored pre-stored feature information and the UAV control command After the corresponding first instruction, the method further includes:
输出用于提示用户是否执行所述第一指令的提示信息;  Outputting prompt information for prompting the user whether to execute the first instruction;
当检测到针对所述提示信息的确认指令吋, 执行所述第一指令。  The first instruction is executed when a confirmation command for the prompt information is detected.
[权利要求 4] 根据权利要求 1所述的方法, 其特征在于, 所述将所述目标信息与特 征信息库中的预存特征信息进行比较具体包括: 计算所述目标信息与所述特征信息库中的每个预存特征信息的匹配度 [Claim 4] The method according to claim 1, wherein the comparing the target information with the pre-stored feature information in the feature information database comprises: calculating the target information and the feature information database Matching degree of each pre-stored feature information in
将所述特征信息库中的预存特征信息按照所述匹配度进行降序排列, 以得到降序排列表; Pre-storing the feature information in the feature information database in descending order according to the matching degree, To get a descending list;
其中, 所述当所述特征信息库中存在与所述目标信息相匹配的预存特 征信息吋, 根据存储的预存特征信息与无人机控制指令的预设对应关 系, 获取所述与目标信息相匹配的预存特征信息对应的第一指令还包 括:  The pre-stored feature information 与 matching the target information is stored in the feature information database, and the target information is obtained according to a preset correspondence between the stored pre-stored feature information and the UAV control command. The first instruction corresponding to the matched pre-stored feature information further includes:
获取所述降序排列表中排列在最前面的至少两个预存特征信息; 获取所述至少两个预存特征信息对应的无人机控制指令, 以获得至少 两个指令;  Acquiring at least two pre-stored feature information arranged in the top row of the descending row list; acquiring the drone control commands corresponding to the at least two pre-stored feature information, to obtain at least two instructions;
当检测到所述至少两个指令中的第二指令的选取操作吋, 将所述第二 指令确定为第一指令。  When the selection operation of the second instruction of the at least two instructions is detected, the second instruction is determined as the first instruction.
[权利要求 5] 根据权利要求 1至 4任一项所述的方法, 其特征在于, 当所述目标信息 为语音信息吋, 所述方法还包括: [Claim 5] The method according to any one of claims 1 to 4, wherein, when the target information is voice information, the method further includes:
滤除所述目标信息中的噪声, 以得到滤除噪声后的目标信息; 其中, 所述将所述目标信息与特征信息库中的预存特征信息进行比较 包括:  Filtering the noise in the target information to obtain target information after filtering the noise; wherein comparing the target information with the pre-stored feature information in the feature information database includes:
将所述滤除噪声后的目标信息与特征信息库中的预存特征信息进行比 较。  The target information after filtering the noise is compared with the pre-stored feature information in the feature information base.
[权利要求 6] —种无人机控制装置, 其特征在于, 包括: [Claim 6] A drone control device, comprising:
第一获取单元, 用于获取目标信息, 所述目标信息包括表情信息、 语 音信息和手势信息中的至少一种;  a first acquiring unit, configured to acquire target information, where the target information includes at least one of expression information, voice information, and gesture information;
比较单元, 用于将所述第一获取单元获取的目标信息与特征信息库中 的预存特征信息进行比较;  a comparing unit, configured to compare the target information acquired by the first acquiring unit with the pre-stored feature information in the feature information database;
第二获取单元, 用于当所述比较单元的比较结果是所述特征信息库中 存在与所述目标信息相匹配的预存特征信息吋, 根据存储的预存特征 信息与无人机控制指令的预设对应关系, 获取所述第一获取单元获取 的与目标信息相匹配的预存特征信息对应的第一指令, 其中, 所述无 人机控制指令包含所述第一指令; a second obtaining unit, configured to: when the comparison result of the comparing unit is that the pre-stored feature information matching the target information exists in the feature information database, according to the stored pre-stored feature information and the pre-control of the drone control instruction Corresponding relationship, acquiring a first instruction corresponding to the pre-stored feature information that is matched by the first acquiring unit and matching the target information, where the The human machine control instruction includes the first instruction;
执行单元, 用于执行所述第二获取单元获取的第一指令, 以控制所述 无人机。  And an execution unit, configured to execute the first instruction acquired by the second obtaining unit to control the drone.
[权利要求 7] 根据权利要求 6所述的装置, 其特征在于, 所述装置还包括: [Claim 7] The device according to claim 6, wherein the device further comprises:
第三获取单元, 用于获取验证信息, 并与验证信息库中的预存验证信 息进行匹配, 当验证信息库中存在所述第三获取单元获取的验证信息 匹配的预存验证信息吋, 触发所述比较单元执行所述将所述目标信息 与特征信息库中的预存特征信息进行比较的步骤。  a third obtaining unit, configured to acquire the verification information, and match the pre-stored verification information in the verification information base, and when the verification information library has the pre-stored verification information matched by the verification information acquired by the third obtaining unit, triggering the The comparing unit performs the step of comparing the target information with the pre-stored feature information in the feature information library.
[权利要求 8] 根据权利要求 6所述的装置, 其特征在于, 所述装置还包括: [Claim 8] The device according to claim 6, wherein the device further comprises:
输出单元, 用于输出用于提示用户是否执行所述第一指令的提示信息 其中, 所述执行单元还用于, 当检测到针对所述提示信息的确认指令 吋, 执行所述第一指令。  And an output unit, configured to output prompt information for prompting the user whether to execute the first instruction, where the executing unit is further configured to: when the confirmation instruction for the prompt information is detected, execute the first instruction.
[权利要求 9] 根据权利要求 6所述的装置, 其特征在于, 所述比较单元包括: [Claim 9] The device according to claim 6, wherein the comparing unit comprises:
计算单元, 用于计算所述第一获取单元获取的目标信息与特征信息库 中的每个预存特征信息的匹配度;  a calculating unit, configured to calculate a matching degree between the target information acquired by the first acquiring unit and each pre-stored feature information in the feature information database;
排列单元, 用于将所述特征信息库中的预存特征信息按照所述计算单 元计算的匹配度进行降序排列, 以得到降序排列表;  An arranging unit, configured to perform pre-sequence sorting of the pre-stored feature information in the feature information base according to the matching degree calculated by the calculating unit, to obtain a descending row list;
其中, 所述第二获取单元进一步包括:  The second obtaining unit further includes:
第四获取单元, 用于获取所述排列单元排列的降序排列表中排列在最 前面的至少两个预存特征信息;  a fourth obtaining unit, configured to acquire at least two pre-stored feature information arranged in the top row in the descending row list of the permuting unit arrangement;
第五获取单元, 用于获取所述第四获取单元获取的至少两个预存特征 信息对应的无人机控制指令, 以获得至少两个指令;  a fifth acquiring unit, configured to acquire a drone control instruction corresponding to the at least two pre-stored feature information acquired by the fourth acquiring unit, to obtain at least two instructions;
确定单元, 用于当检测到所述至少两个指令中的第二指令的选取操作 吋, 将所述第二指令确定为第一指令。 [权利要求 10] 根据权利要求 6至 9任一项所述的装置, 其特征在于, 当所述第一获取 单元获取的目标信息为语音信息吋, 所述装置还包括: a determining unit, configured to determine the second instruction as the first instruction when detecting a selection operation of the second one of the at least two instructions. [Claim 10] The device according to any one of claims 6 to 9, wherein, when the target information acquired by the first acquiring unit is voice information, the device further includes:
滤噪单元, 用于滤除所述目标信息中的噪声, 以得到滤除噪声后的目 标信息;  a noise filtering unit, configured to filter out noise in the target information to obtain target information after filtering noise;
其中, 所述比较单元具体用于将所述滤噪单元得到的滤除噪声后的目 标信息与特征信息库中的预存特征信息进行比较。  The comparing unit is specifically configured to compare the target information after filtering the noise obtained by the filtering unit with the pre-stored feature information in the feature information database.
PCT/CN2017/073885 2016-11-29 2017-02-17 Unmanned aerial vehicle control method and device WO2018098904A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611075404.2A CN106682091A (en) 2016-11-29 2016-11-29 Method and device for controlling unmanned aerial vehicle
CN201611075404.2 2016-11-29

Publications (1)

Publication Number Publication Date
WO2018098904A1 true WO2018098904A1 (en) 2018-06-07

Family

ID=58866146

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/073885 WO2018098904A1 (en) 2016-11-29 2017-02-17 Unmanned aerial vehicle control method and device

Country Status (2)

Country Link
CN (1) CN106682091A (en)
WO (1) WO2018098904A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107390714A (en) * 2017-06-13 2017-11-24 深圳市易成自动驾驶技术有限公司 Control method, device and the computer-readable recording medium of unmanned plane
CN107831791B (en) * 2017-11-17 2020-12-15 深圳意动航空科技有限公司 Unmanned aerial vehicle control method and device, control equipment and storage medium
CN108122553B (en) * 2017-12-20 2020-12-08 深圳市道通智能航空技术有限公司 Unmanned aerial vehicle control method and device, remote control equipment and unmanned aerial vehicle system
WO2019144295A1 (en) * 2018-01-23 2019-08-01 深圳市大疆创新科技有限公司 Flight control method and device, and aircraft, system and storage medium
CN110825121B (en) * 2018-08-08 2023-02-17 纬创资通股份有限公司 Control device and unmanned aerial vehicle control method
CN110720123A (en) * 2018-10-31 2020-01-21 深圳市大疆创新科技有限公司 Control method and control equipment for mobile platform
JP6949974B2 (en) 2019-05-15 2021-10-13 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Imaging control method, device and control device, imaging device
CN112257434B (en) * 2019-07-02 2023-09-08 Tcl科技集团股份有限公司 Unmanned aerial vehicle control method, unmanned aerial vehicle control system, mobile terminal and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677806A (en) * 2015-12-31 2016-06-15 联想(北京)有限公司 Information processing method and electronic equipment
CN105892474A (en) * 2016-03-31 2016-08-24 深圳奥比中光科技有限公司 Unmanned plane and control method of unmanned plane
CN106020227A (en) * 2016-08-12 2016-10-12 北京奇虎科技有限公司 Control method and device for unmanned aerial vehicle
CN106377228A (en) * 2016-09-21 2017-02-08 中国人民解放军国防科学技术大学 Monitoring and hierarchical-control method for state of unmanned aerial vehicle operator based on Kinect

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103823561B (en) * 2014-02-27 2017-01-18 广州华多网络科技有限公司 expression input method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677806A (en) * 2015-12-31 2016-06-15 联想(北京)有限公司 Information processing method and electronic equipment
CN105892474A (en) * 2016-03-31 2016-08-24 深圳奥比中光科技有限公司 Unmanned plane and control method of unmanned plane
CN106020227A (en) * 2016-08-12 2016-10-12 北京奇虎科技有限公司 Control method and device for unmanned aerial vehicle
CN106377228A (en) * 2016-09-21 2017-02-08 中国人民解放军国防科学技术大学 Monitoring and hierarchical-control method for state of unmanned aerial vehicle operator based on Kinect

Also Published As

Publication number Publication date
CN106682091A (en) 2017-05-17

Similar Documents

Publication Publication Date Title
WO2018098904A1 (en) Unmanned aerial vehicle control method and device
US11720126B2 (en) Motion and image-based control system
US11861264B2 (en) Portable terminal device and information processing system
CN107336243B (en) Robot control system and control method based on intelligent mobile terminal
US8761964B2 (en) Computing device and method for controlling unmanned aerial vehicle in flight space
US11900708B2 (en) Neural network-based recognition of trade workers present on industrial sites
US20170229121A1 (en) Information processing device, method of information processing, and program
US11036216B2 (en) Voice-controllable unmanned aerial vehicle for object retrieval and delivery
JP2015510197A (en) Engagement-dependent gesture recognition
CN107430856B (en) Information processing system and information processing method
JP2009248193A (en) Reception system and reception method
US20200106835A1 (en) Using visual recognition and micro-location data to trigger internet of things sensor events
JP6949974B2 (en) Imaging control method, device and control device, imaging device
WO2017167109A1 (en) Air vehicle control method and device
CN107390714A (en) Control method, device and the computer-readable recording medium of unmanned plane
JP5776544B2 (en) Robot control method, robot control device, and robot
CN112712498A (en) Vehicle damage assessment method and device executed by mobile terminal, mobile terminal and medium
US10720154B2 (en) Information processing device and method for determining whether a state of collected sound data is suitable for speech recognition
CN105741256B (en) Electronic equipment and shaving prompt system and method thereof
US10522140B2 (en) Information processing system and information processing method
WO2021043333A1 (en) Photography control method and apparatus, aircraft, and flight system
TW201419051A (en) Remote control system and method for computer
CN112908329B (en) Voice control method and device, electronic equipment and medium
CN115476366A (en) Control method, device, control equipment and storage medium for foot type robot
CN117198281A (en) Voice interaction method and device, electronic equipment and vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17876287

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17876287

Country of ref document: EP

Kind code of ref document: A1