CN112151033A - Unmanned aerial vehicle voice control method and device, electronic equipment and storage medium - Google Patents
Unmanned aerial vehicle voice control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112151033A CN112151033A CN202011012028.9A CN202011012028A CN112151033A CN 112151033 A CN112151033 A CN 112151033A CN 202011012028 A CN202011012028 A CN 202011012028A CN 112151033 A CN112151033 A CN 112151033A
- Authority
- CN
- China
- Prior art keywords
- control instruction
- information
- operation information
- aerial vehicle
- unmanned aerial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000004590 computer program Methods 0.000 claims description 13
- 238000000605 extraction Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 7
- 238000013507 mapping Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Selective Calling Equipment (AREA)
Abstract
The application provides an unmanned aerial vehicle voice control method, an unmanned aerial vehicle voice control device, electronic equipment and a storage medium, wherein the method comprises the steps of collecting first voice information of a user, wherein the first voice information carries first operation information to be executed by an unmanned aerial vehicle; identifying the first voice information to extract first operation information in the first voice information; matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier; judging whether the first control instruction is a primary instruction or not according to the first identifier; if not, the first control instruction is sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
Description
Technical Field
The application relates to the technical field of unmanned aerial vehicle control, in particular to an unmanned aerial vehicle voice control method, an unmanned aerial vehicle voice control device, electronic equipment and a storage medium.
Background
The existing unmanned aerial vehicle mostly depends on a manual control remote controller or a mobile terminal to realize the control of the operation of the unmanned aerial vehicle, but the control mode needs a user to have a higher unmanned aerial vehicle operation technology, the operation process is complex and the misoperation rate is higher.
Disclosure of Invention
An object of the embodiment of the application is to provide a voice control method and device for an unmanned aerial vehicle, electronic equipment and a storage medium, so as to solve the problems that the operation process is complex and the operation error rate is high when the control of the operation of the unmanned aerial vehicle is realized through a manual control remote controller or a mobile terminal at present.
In a first aspect, an embodiment of the present invention provides an unmanned aerial vehicle voice control method, including: acquiring first voice information of a user, wherein the first voice information carries first operation information to be executed by an unmanned aerial vehicle; recognizing the first voice information to extract the first operation information in the first voice information; matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier; judging whether the first control instruction is a primary instruction or not according to the first identifier; if not, the first control instruction is sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
In the unmanned aerial vehicle voice control method designed above, the first voice information of the user is collected, and then the first voice information is subjected to voice recognition to extract the first operation information corresponding to the first voice information, then the corresponding first control instruction with the first identifier is matched in the preset control instruction library according to the first operation information, and then whether the first control instruction is a primary instruction or not is judged according to the first identifier of the first control instruction, when the first control instruction is not the primary instruction, the first control instruction is directly sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle can directly execute the operation corresponding to the first operation information, the method for controlling the unmanned aerial vehicle information operation based on the user voice is realized, and the problems of complex operation process and high operation error rate existing in the existing unmanned aerial vehicle operation control realized by manually controlling a remote controller or a mobile terminal are solved, make unmanned aerial vehicle operation only need can control based on user's speech, improved the convenience of unmanned aerial vehicle operation, can reduce the error rate of manual operation under the environment of complicacy through speech control.
In an optional implementation manner of the first aspect, after the determining, according to the first identifier, whether the first control instruction is a primary instruction, the method further includes: if the first-level instruction is received, judging whether second voice information of the user is acquired within a first preset time period; if so, identifying the second voice information to extract second operation information in the second voice information; judging whether the second operation information is the same as the first operation information or not; and if the first control instruction is the same as the first control instruction, sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
In an optional implementation manner of the first aspect, after the determining whether the second operation information is the same as the first operation information, the method further includes: if not, matching a second control instruction corresponding to the second operation information in the preset control instruction library according to the second operation information, wherein the second control instruction carries a second identifier; judging whether the second control instruction is a primary instruction or not according to the second identifier; and if the command is not the primary command, sending the second control command to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the second operation information according to the second control command.
In an optional implementation manner of the first aspect, after the determining, according to the second identifier, whether the second control instruction is a primary instruction, the method further includes: and if the second control instruction is not a primary instruction, outputting instruction error information.
In an optional implementation manner of the first aspect, before the determining whether the second voice information of the user is collected within the first preset time period, the method further includes: generating audio prompt information according to first operation information corresponding to the first control instruction; and outputting the audio prompt information.
In an optional implementation manner of the first aspect, the recognizing the first speech information to extract the first operation information in the first speech information includes: converting the first voice information into corresponding first text information; and extracting operation keywords in the first text message to obtain the first operation message.
In an optional implementation manner of the first aspect, before the collecting the first voice information of the user, the method further includes: judging whether third voice information is acquired or not after power-on; if yes, judging whether the third voice message has a preset awakening word; if yes, outputting a wake-up success prompt message.
In a second aspect, an embodiment of the present invention provides an unmanned aerial vehicle voice control apparatus, including: the system comprises an acquisition module, a processing module and a control module, wherein the acquisition module is used for acquiring first voice information of a user, and the first voice information carries first operation information to be executed by the unmanned aerial vehicle; the recognition extraction module is used for recognizing the first voice information so as to extract the first operation information in the first voice information; the matching module is used for matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier; the judging module is used for judging whether the first control instruction is a primary instruction or not according to the first identifier; and the sending module is used for sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
In the unmanned aerial vehicle voice control device designed above, the first voice information of the user is collected, and then the first voice information is subjected to voice recognition to extract the first operation information corresponding to the first voice information, then the corresponding first control instruction with the first identifier is matched in the preset control instruction library according to the first operation information, and then whether the first control instruction is a primary instruction or not is judged according to the first identifier of the first control instruction, when the first control instruction is not the primary instruction, the first control instruction is directly sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle can directly execute the operation corresponding to the first operation information, the method for controlling the unmanned aerial vehicle information operation based on the user voice is realized, and the problems of complex operation process and high operation error rate existing in the existing unmanned aerial vehicle operation control realized by manually controlling a remote controller or a mobile terminal are solved, make unmanned aerial vehicle operation only need can control based on user's speech, improved the convenience of unmanned aerial vehicle operation, can reduce the error rate of manual operation under the environment of complicacy through speech control.
In an optional implementation manner of the second aspect, the determining module is further configured to determine whether second voice information of the user is acquired within a first preset time period; the recognition extraction module is further configured to recognize the second voice information to extract second operation information in the second voice information; the judging module is further configured to judge whether the second operation information is the same as the first operation information; the sending module is further configured to send the first control instruction to the unmanned aerial vehicle after the second operation information is the same as the first operation information, so that the unmanned aerial vehicle executes an operation corresponding to the first operation information according to the first control instruction.
In an optional implementation manner of the second aspect, the matching module is further configured to match, after second operation information is different from the first operation information, a second control instruction corresponding to the second operation information in the preset control instruction library according to the second operation information, where the second control instruction carries a second identifier; the judging module is further configured to judge whether the second control instruction is a primary instruction according to the second identifier; the sending module is further configured to send the second control instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes an operation corresponding to the second operation information according to the second control instruction.
In an optional implementation manner of the second aspect, the output module is configured to output instruction error information when the second control instruction is not a primary instruction.
In an optional implementation manner of the second aspect, the output module is further configured to generate audio prompt information according to the first operation information corresponding to the first control instruction; and outputting the audio prompt information.
In an optional implementation manner of the second aspect, the recognition and extraction module is specifically configured to convert the voice information into corresponding text information; and extracting operation keywords in the text information to obtain the first operation information.
In an optional implementation manner of the second aspect, the determining module is further configured to determine whether third voice information is acquired after the power is turned on, and determine whether a preset wake-up word is included in the third voice information after the third voice information is acquired; the output module is further used for outputting awakening success prompt information.
In a third aspect, an embodiment provides an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor executes the computer program to perform the method in the first aspect or any optional implementation manner of the first aspect.
In a fourth aspect, embodiments provide a non-transitory readable storage medium having stored thereon a computer program which, when executed by a processor, performs the method of the first aspect, any optional implementation manner of the first aspect.
In a fifth aspect, embodiments provide a computer program product, which when run on a computer, causes the computer to execute the method of the first aspect or any optional implementation manner of the first aspect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a first flowchart of a voice control method for an unmanned aerial vehicle according to an embodiment of the present application;
fig. 2 is a second flowchart of a voice control method for an unmanned aerial vehicle according to an embodiment of the present application;
fig. 3 is a third flowchart of a voice control method for an unmanned aerial vehicle according to an embodiment of the present disclosure;
fig. 4 is a fourth flowchart of a voice control method for an unmanned aerial vehicle according to an embodiment of the present application;
fig. 5 is a fifth flowchart of a voice control method for an unmanned aerial vehicle according to an embodiment of the present application;
fig. 6 is a sixth flowchart of a voice control method for an unmanned aerial vehicle according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an unmanned aerial vehicle voice control apparatus provided in an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Icon: 200-an acquisition module; 201-identifying and extracting module; 202-a matching module; 203-a judgment module; 204-a sending module; 205-an output module; 3-an electronic device; 301-a processor; 302-a memory; 303-communication bus.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
First embodiment
As shown in fig. 1, an embodiment of the present application provides an unmanned aerial vehicle voice control method, where the unmanned aerial vehicle voice control method may be applied to a server or a chip, and the chip may be disposed on a controller of an unmanned aerial vehicle, and the method may specifically include the following steps:
step S100: gather user's first voice message, this first voice message carries and waits to treat the first operating information that unmanned aerial vehicle carried out.
Step S102: the first voice information is recognized to extract first operation information in the first voice information.
Step S104: and matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier.
Step S106: judging whether the first control instruction is a primary instruction or not according to the first identifier, and if so, turning to the step S1070; if not, go to step S1080.
Step S1080: and sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
In step S100, the first voice information of the user may be collected by setting a voice collecting module, and the user may speak into the voice collecting module when using the device, so as to collect the first voice information of the user, where the first voice information may carry operation information words, such as "take off", "land", "take a picture", and "record", and then step S102 is executed.
In step S102, the present disclosure may recognize the first voice message to extract the first operation information in the first voice message, specifically, a voice recognition technology may be used to extract a preset key word in the first voice message, and then use the extracted key word as the first operation information, for example, when the first voice message includes information such as takeoff, the foregoing "takeoff" keyword may be extracted as the first operation information, and then step S104 is executed.
Before the description of step S104, it should be noted that, in the present scheme, a control instruction corresponding to each kind of operation information is set in advance according to various operation information that may occur, and then a mapping relationship is established between each kind of operation information and the corresponding control instruction, and then all data of the established mapping relationship is stored in a preset control instruction library, and the control instruction performs distribution of control instruction classes according to the content of the operation information, where the instruction classes may be specifically divided into a first-class instruction and other instructions, and the first-class instruction is different from the other instructions in that the first-class instruction requires the drone to wait for receiving a next instruction to perform an operation, and when the other instructions are executed, operations corresponding to the other instructions may be directly performed, and different identifiers may be set between the first-class instruction and the other instructions in the present scheme to distinguish them, for example, the first-class instruction may be set as an identifier a, the secondary instruction may be set to the B flag. Specifically, according to the foregoing example, a mapping relationship may be established between operation information such as "take-off" and "landing" and a control instruction corresponding to the operation information, and an identifier a corresponding to a primary instruction is set in the control instruction corresponding to the operation information; the mapping relation between the operation information such as 'photographing' and 'recording' and the corresponding control instruction can be established, the identification B corresponding to other instructions is set in the corresponding control instruction, and then all the control instructions and the mapping relation thereof are stored in a preset control instruction library. It should be noted that, in the present embodiment, the specific control instruction included in the first-level instruction and the other instructions may be set according to an actual situation, and not only includes the situation in the foregoing example; in addition, the identification distinction between the first-level instruction and the other instructions is only used as an example to better understand the present solution.
On the basis of the above, when step S104 is executed, the present solution matches the first operation information extracted in step S102 in a preset control instruction library to obtain a first control instruction having a mapping relation with the first operation information, and further obtains the matched first control instruction, wherein according to the foregoing, the first control instruction includes a first identifier corresponding to the first control instruction and indicating that the control instruction is a primary instruction or another instruction.
On the basis of the above-mentioned first control command, the present solution executes step S106 to determine whether the first control command is a primary command according to the first identifier in the first control command, based on the foregoing example, this step can determine whether the first flag in the first control instruction is flag a to determine whether the first control instruction is a first-level instruction, and if not, it indicates that the first control instruction is another instruction, and then step S1080 is executed to directly send the first control instruction to the drone, so that the drone executes the operation corresponding to the first operation information according to the first control instruction, for example, according to the foregoing example, when the first control command is a control command corresponding to "take a picture", if the command is not a primary command, the control command corresponding to the photographing is directly sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes the photographing operation according to the control command corresponding to the photographing.
In the unmanned aerial vehicle voice control method designed above, the first voice information of the user is collected, and then the first voice information is subjected to voice recognition to extract the first operation information corresponding to the first voice information, then the corresponding first control instruction with the first identifier is matched in the preset control instruction library according to the first operation information, and then whether the first control instruction is a primary instruction or not is judged according to the first identifier of the first control instruction, when the first control instruction is not the primary instruction, the first control instruction is directly sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle can directly execute the operation corresponding to the first operation information, the method for controlling the unmanned aerial vehicle information operation based on the user voice is realized, and the problems of complex operation process and high operation error rate existing in the existing unmanned aerial vehicle operation control realized by manually controlling a remote controller or a mobile terminal are solved, make unmanned aerial vehicle operation only need can control based on user's speech, improved the convenience of unmanned aerial vehicle operation, can reduce the error rate of manual operation under the environment of complicacy through speech control.
In an optional implementation manner of this embodiment, the step of recognizing the first voice information to extract the first operation information in step S102 may specifically be, as shown in fig. 2:
step S1020: and converting the first voice information into corresponding first text information, and extracting operation keywords in the first text information to obtain first operation information.
In the above step, firstly, the first voice message may be subjected to text conversion to be converted into corresponding first text message, and then the operation keyword in the first text message is extracted based on the preset operation keyword to obtain the first operation message.
In an alternative implementation manner of this embodiment, it has been described above that when the step S106 is executed to determine that the first control instruction is a primary instruction according to the first identifier in the first control instruction, the step S1070 is executed, and the following description is made on a case of being a primary instruction, and as shown in fig. 3, the method specifically includes the following steps:
step S1070: and judging whether the second voice information of the user is acquired within the first preset time period, if so, turning to the step S10710.
Step S10710: and recognizing the second voice information to extract second operation information in the second voice information.
Step S10711: judging whether the second operation information is the same as the first operation information, if so, turning to the step S10720; if not, go to step S10730.
Step S10720: and sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
In step S1070, when step S1060 is executed to determine that the first control instruction is the primary instruction, it is determined whether the second voice information of the user is collected within a first preset time period, that is, when the first control instruction is the primary instruction, the scheme waits for the first preset time period, then determines whether the second voice information of the user is collected within the first preset time period, and when the second voice information is collected, step S10710 is executed. It should be noted that, when the second voice information of the user is collected every time within the first preset time period, the record of the first control instruction is deleted, and the collection of the first voice information of the user is waited for again.
In step S10710, the present solution recognizes the second speech information and extracts the second operation information in the second speech information, where the specific recognition and extraction manner is consistent with the manner of recognizing and extracting the first speech information in step S102, and is not repeated here, and step S10711 may be executed after the second operation information in the second speech information is extracted.
In step S10711, it is determined whether the second operation information is the same as the first operation information, for example, if the first operation information is "take off", it is determined whether the second operation information is the same as the "take off" operation information, and if the second operation information is the same as the "take off" operation information, step S10720 is executed to send a first control instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes an operation corresponding to the first operation information according to the first control instruction.
The above embodiment illustrates that, when the first control instruction is a primary instruction, it is further necessary to wait for the user to input second voice information, and then when the second operation information in the second voice information is the same as the first operation information corresponding to the first control instruction, that is, when the same operation information is repeated, the first control instruction corresponding to the first operation information is sent to the unmanned aerial vehicle only under the condition that the two times of operation information are the same, so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
In an alternative embodiment of this embodiment, it has been described above that when the step S10711 is executed to determine that the second operation information is different from the first operation information, the step S10730 is executed, and the following describes a case when the second operation information is different from the first operation information, as shown in fig. 4, the method specifically includes the following steps:
step S10730: and matching a second control instruction corresponding to the second operation information in a preset control instruction library according to the second operation information, wherein the second control instruction carries a second identifier.
Step S10731: judging whether the second control instruction is a primary instruction or not according to the second identifier, and if so, turning to step S10732; if not, the process goes to step S10733.
Step S10732: and outputting instruction error information.
Step S10733: and sending the second control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the second operation information according to the second control instruction.
In step S10730, when it is determined in the above step S10711 that the second operation information is different from the first operation information, it indicates that the second operation information input by the user in the waiting first preset time period is an operation different from the first operation information, then step S10730 is executed to match a corresponding second control instruction in the above preset control instruction library according to the second operation information, where the second control instruction also carries a second identifier thereof, and then step S10731 is executed to determine whether the second control instruction is a primary instruction based on the second identifier, where if the second control instruction is a primary instruction, it indicates that the user inputs two different primary instructions before and after waiting, and in such a case, instruction error information is directly output; if the command is not the first-level command and is the other command, the extracted second control command is directly sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes the operation corresponding to the second operation information according to the second control command.
In an optional implementation manner of this embodiment, before determining whether the second voice information of the user is collected within the first preset time period in step S1070, the method may further include the following steps to play a role in prompting the user, as shown in fig. 5, which specifically includes:
step S1069: generating audio prompt information according to first operation information corresponding to the first control instruction; and outputting the audio prompt information.
In the step S1069, during or before the waiting for the first preset time period, the present solution may generate corresponding audio prompt information based on the first operation information corresponding to the first control instruction, and then output the audio prompt information, that is, the present solution may repeat the first operation information in the first voice information of the user before or during the waiting for the first preset time period, so as to prompt the user.
In an optional implementation manner of this embodiment, before the step S100 collects the first voice information of the user, the present solution may further perform the following steps to perform function wake-up on the voice recognition function, as shown in fig. 6, which specifically includes the following steps:
step S90: and judging whether the third voice information is collected or not after power-on, and if so, turning to the step S91.
Step S91: and judging whether the third voice message has a preset awakening word, if so, turning to the step S91.
Step S92: and outputting awakening success prompt information.
In the above steps, the device of the present disclosure may continuously monitor whether there is voice information (i.e., the third voice information) after being powered on, and after the voice information is collected, may execute step S91, in step S91, the present disclosure converts the voice information into text information according to the above steps, and further determines whether there is a preset wakeup word in the text information, and if so, the wakeup is successful and a wakeup success prompt message is output.
Second embodiment
Fig. 7 shows a schematic structural block diagram of the voice control device of the unmanned aerial vehicle provided by the present application, and it should be understood that the device corresponds to the above-mentioned method embodiments executed in fig. 1 to 6, and can execute the steps involved in the method executed by the processing unit in the second embodiment, and the specific functions of the device can be referred to the above description, and in order to avoid repetition, the detailed description is appropriately omitted here. The device includes at least one software function that can be stored in memory in the form of software or firmware (firmware) or solidified in the Operating System (OS) of the device. Specifically, the apparatus includes: the acquisition module 200 is configured to acquire first voice information of a user, where the first voice information carries first operation information to be executed by the unmanned aerial vehicle; the recognition extraction module 201 is configured to recognize the first voice information to extract first operation information in the first voice information; the matching module 202 is configured to match a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, where the first control instruction carries a first identifier; the judging module 203 is configured to judge whether the first control instruction is a primary instruction according to the first identifier; the sending module 204 is configured to send the first control instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes an operation corresponding to the first operation information according to the first control instruction.
In the unmanned aerial vehicle voice control device designed above, the first voice information of the user is collected, and then the first voice information is subjected to voice recognition to extract the first operation information corresponding to the first voice information, then the corresponding first control instruction with the first identifier is matched in the preset control instruction library according to the first operation information, and then whether the first control instruction is a primary instruction or not is judged according to the first identifier of the first control instruction, when the first control instruction is not the primary instruction, the first control instruction is directly sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle can directly execute the operation corresponding to the first operation information, the method for controlling the unmanned aerial vehicle information operation based on the user voice is realized, and the problems of complex operation process and high operation error rate existing in the existing unmanned aerial vehicle operation control realized by manually controlling a remote controller or a mobile terminal are solved, make unmanned aerial vehicle operation only need can control based on user's speech, improved the convenience of unmanned aerial vehicle operation, can reduce the error rate of manual operation under the environment of complicacy through speech control.
In an optional implementation manner of this embodiment, the determining module 203 is further configured to determine whether second voice information of the user is collected within a first preset time period; the recognition extraction module 201 is further configured to recognize the second voice information to extract second operation information in the second voice information; the judging module 203 is further configured to judge whether the second operation information is the same as the first operation information; the sending module 204 is further configured to send the first control instruction to the unmanned aerial vehicle after the second operation information is the same as the first operation information, so that the unmanned aerial vehicle executes an operation corresponding to the first operation information according to the first control instruction.
In an optional implementation manner of this embodiment, the matching module 202, after the second operation information is different from the first operation information, is further configured to match a second control instruction corresponding to the second operation information in a preset control instruction library according to the second operation information, where the second control instruction carries a second identifier; the judging module 203 is further configured to judge whether the second control instruction is a primary instruction according to the second identifier; the sending module 204 is further configured to send the second control instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes an operation corresponding to the second operation information according to the second control instruction.
In an optional implementation manner of this embodiment, the output module 205 is configured to output the instruction error information when the second control instruction is not the primary instruction.
In an optional implementation manner of this embodiment, the output module 205 is further configured to generate an audio prompt message according to the first operation information corresponding to the first control instruction; and outputting the audio prompt information.
In an optional implementation manner of this embodiment, the recognition and extraction module 201 is specifically configured to convert the voice information into corresponding text information; and extracting operation keywords in the text information to obtain first operation information.
In an optional implementation manner of this embodiment, the determining module 203 is further configured to determine whether third voice information is acquired after the power is turned on, and determine whether a preset wake-up word is included in the third voice information after the third voice information is acquired; the output module 205 is further configured to output a wake-up success prompt message.
Third embodiment
As shown in fig. 8, the present application provides an electronic device 3 including: a processor 301 and a memory 302, the processor 301 and the memory 302 being interconnected and communicating with each other via a communication bus 303 and/or other form of connection mechanism (not shown), the memory 302 storing a computer program executable by the processor 301, the processor 301 executing the computer program when the computing device is running to perform the method of the first embodiment, any alternative implementation of the first embodiment, such as steps S100 to S1080: acquiring first voice information of a user, wherein the first voice information carries first operation information to be executed by the unmanned aerial vehicle; identifying the first voice information to extract first operation information in the first voice information; matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier; and judging whether the first control instruction is a primary instruction or not according to the first identifier, and if so, sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
The present application provides a storage medium having a computer program stored thereon, where the computer program is executed by a processor to perform the method of the first embodiment or any alternative implementation manner of the first embodiment.
The storage medium may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as a Static Random Access Memory (SRAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable Read-Only Memory (PROM), a Read-Only Memory (ROM), a magnetic Memory, a flash Memory, a magnetic disk, or an optical disk.
The present application provides a computer program product which, when run on a computer, causes the computer to perform the method of the first embodiment, any of its alternative implementations.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
It should be noted that the functions, if implemented in the form of software functional modules and sold or used as independent products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. An unmanned aerial vehicle voice control method is characterized by comprising the following steps:
acquiring first voice information of a user, wherein the first voice information carries first operation information to be executed by an unmanned aerial vehicle;
recognizing the first voice information to extract the first operation information in the first voice information;
matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier;
judging whether the first control instruction is a primary instruction or not according to the first identifier;
if not, the first control instruction is sent to the unmanned aerial vehicle, so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
2. The method of claim 1, wherein after said determining whether the first control instruction is a primary instruction according to the first identifier, the method further comprises:
if the first-level instruction is received, judging whether second voice information of the user is acquired within a first preset time period;
if so, identifying the second voice information to extract second operation information in the second voice information;
judging whether the second operation information is the same as the first operation information or not;
and if the first control instruction is the same as the first control instruction, sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
3. The method of claim 2, wherein after the determining whether the second operation information is the same as the first operation information, the method further comprises:
if not, matching a second control instruction corresponding to the second operation information in the preset control instruction library according to the second operation information, wherein the second control instruction carries a second identifier;
judging whether the second control instruction is a primary instruction or not according to the second identifier;
and if the command is not the primary command, sending the second control command to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the second operation information according to the second control command.
4. The method of claim 3, wherein after said determining whether the second control instruction is a primary instruction according to the second identifier, the method further comprises:
and if the second control instruction is not a primary instruction, outputting instruction error information.
5. The method of claim 2, wherein before the determining whether the second voice information of the user is collected within the first preset time period, the method further comprises:
generating audio prompt information according to first operation information corresponding to the first control instruction;
and outputting the audio prompt information.
6. The method of claim 1, wherein the recognizing the first speech information to extract the first operation information in the first speech information comprises:
converting the first voice information into corresponding first text information;
and extracting operation keywords in the first text message to obtain the first operation message.
7. The method of claim 1, wherein prior to said collecting the first voice information of the user, the method further comprises:
judging whether third voice information is acquired or not after power-on;
if yes, judging whether the third voice message has a preset awakening word;
if yes, outputting a wake-up success prompt message.
8. The utility model provides an unmanned aerial vehicle speech control device which characterized in that includes:
the system comprises an acquisition module, a processing module and a control module, wherein the acquisition module is used for acquiring first voice information of a user, and the first voice information carries first operation information to be executed by the unmanned aerial vehicle;
the recognition extraction module is used for recognizing the first voice information so as to extract the first operation information in the first voice information;
the matching module is used for matching a first control instruction corresponding to the first operation information in a preset control instruction library according to the first operation information, wherein the first control instruction carries a first identifier;
the judging module is used for judging whether the first control instruction is a primary instruction or not according to the first identifier;
and the sending module is used for sending the first control instruction to the unmanned aerial vehicle so that the unmanned aerial vehicle executes the operation corresponding to the first operation information according to the first control instruction.
9. An electronic device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the method of any one of claims 1 to 7 when executing the computer program.
10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011012028.9A CN112151033A (en) | 2020-09-23 | 2020-09-23 | Unmanned aerial vehicle voice control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011012028.9A CN112151033A (en) | 2020-09-23 | 2020-09-23 | Unmanned aerial vehicle voice control method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112151033A true CN112151033A (en) | 2020-12-29 |
Family
ID=73896392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011012028.9A Pending CN112151033A (en) | 2020-09-23 | 2020-09-23 | Unmanned aerial vehicle voice control method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112151033A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6697782B1 (en) * | 1999-01-18 | 2004-02-24 | Nokia Mobile Phones, Ltd. | Method in the recognition of speech and a wireless communication device to be controlled by speech |
| CN102233191A (en) * | 2010-05-07 | 2011-11-09 | 上海九鹰电子科技有限公司 | Aviation model with voice control function |
| CN103369122A (en) * | 2012-03-31 | 2013-10-23 | 盛乐信息技术（上海）有限公司 | Voice input method and system |
| CN106971718A (en) * | 2017-04-06 | 2017-07-21 | 绵阳美菱软件技术有限公司 | A kind of control method of air-conditioning and air-conditioning |
| CN109493851A (en) * | 2018-11-20 | 2019-03-19 | 新视家科技(北京)有限公司 | A kind of sound control method, relevant apparatus and storage medium |
| CN110033764A (en) * | 2019-03-08 | 2019-07-19 | 中国科学院深圳先进技术研究院 | Sound control method, device, system and the readable storage medium storing program for executing of unmanned plane |
| CN110322374A (en) * | 2019-07-31 | 2019-10-11 | 叶昆联 | The tourist service intelligent control method of intelligent tour terminating machine |
| KR102153220B1 (en) * | 2019-05-20 | 2020-09-07 | 주식회사 모두의연구소 | Method for outputting speech recognition results based on determination of sameness and appratus using the same |
-
2020
- 2020-09-23 CN CN202011012028.9A patent/CN112151033A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6697782B1 (en) * | 1999-01-18 | 2004-02-24 | Nokia Mobile Phones, Ltd. | Method in the recognition of speech and a wireless communication device to be controlled by speech |
| CN102233191A (en) * | 2010-05-07 | 2011-11-09 | 上海九鹰电子科技有限公司 | Aviation model with voice control function |
| CN103369122A (en) * | 2012-03-31 | 2013-10-23 | 盛乐信息技术（上海）有限公司 | Voice input method and system |
| CN106971718A (en) * | 2017-04-06 | 2017-07-21 | 绵阳美菱软件技术有限公司 | A kind of control method of air-conditioning and air-conditioning |
| CN109493851A (en) * | 2018-11-20 | 2019-03-19 | 新视家科技(北京)有限公司 | A kind of sound control method, relevant apparatus and storage medium |
| CN110033764A (en) * | 2019-03-08 | 2019-07-19 | 中国科学院深圳先进技术研究院 | Sound control method, device, system and the readable storage medium storing program for executing of unmanned plane |
| KR102153220B1 (en) * | 2019-05-20 | 2020-09-07 | 주식회사 모두의연구소 | Method for outputting speech recognition results based on determination of sameness and appratus using the same |
| CN110322374A (en) * | 2019-07-31 | 2019-10-11 | 叶昆联 | The tourist service intelligent control method of intelligent tour terminating machine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107220142B (en) | Method and device for executing data recovery operation | |
| CN107680589B (en) | Voice information interaction method, device and equipment | |
| CN110287247B (en) | Data storage method, device, equipment and storage medium based on Unionpay system | |
| CN107454657B (en) | Voice network distribution method | |
| CN109359091B (en) | File management method, device, terminal and computer readable storage medium | |
| CN109558199B (en) | Information pushing method, device, equipment and storage medium | |
| CN112925759B (en) | Data file processing method and device, storage medium and electronic device | |
| CN108228664B (en) | Unstructured data processing method and device | |
| CN111309876A (en) | Service request processing method and device, electronic equipment and storage medium | |
| CN105760272A (en) | Monitoring background service customization method based on plug-in and system based on method | |
| CN111930695B (en) | Method and device for storing running logs of microprocessor of vehicle-mounted terminal | |
| US20170185388A1 (en) | Application program uninstallation method and apparatus | |
| CN111628896A (en) | IT operation and maintenance management method, device, equipment and computer storage medium | |
| CN111460124B (en) | Intelligent interaction method, intelligent interaction device and robot | |
| CN111881044A (en) | Automatic matching test case system according to configuration file | |
| CN115600998A (en) | Process management method, system and readable storage medium based on production management platform | |
| CN111091838A (en) | Open voice interaction platform for aircraft control | |
| CN112151033A (en) | Unmanned aerial vehicle voice control method and device, electronic equipment and storage medium | |
| CN112328272B (en) | Algorithm upgrading method, device, equipment and storage medium | |
| CN112506869A (en) | File processing method, device and system | |
| EP4332826A1 (en) | Image recognition method and electronic device | |
| CN105573934A (en) | Method and device for operating multi-system slave device to access master device through USB connection | |
| US11838567B2 (en) | Automated dynamic data extraction, distillation, and enhancement | |
| CN115543755A (en) | Performance monitoring method, device, system, equipment and medium | |
| CN115509850A (en) | Log processing method, device, equipment, storage medium and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |