CN108172221A - The method and apparatus of manipulation aircraft based on intelligent terminal - Google Patents
The method and apparatus of manipulation aircraft based on intelligent terminal Download PDFInfo
- Publication number
- CN108172221A CN108172221A CN201611115955.7A CN201611115955A CN108172221A CN 108172221 A CN108172221 A CN 108172221A CN 201611115955 A CN201611115955 A CN 201611115955A CN 108172221 A CN108172221 A CN 108172221A
- Authority
- CN
- China
- Prior art keywords
- voice
- control
- effective control
- intelligent terminal
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 239000003086 colorant Substances 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 239000004615 ingredient Substances 0.000 claims 1
- 230000000875 corresponding effect Effects 0.000 description 25
- 230000006870 function Effects 0.000 description 13
- 238000001514 detection method Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
- G10L17/20—Pattern transformations or operations aimed at increasing system robustness, e.g. against channel noise or different working conditions
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
- G10L2025/783—Detection of presence or absence of voice signals based on threshold decision
Abstract
The present invention relates to the method and apparatus of the manipulation aircraft based on intelligent terminal.The method includes：User speech is obtained, identifies the effective control voice included in the voice；The control instruction of corresponding aircraft is generated according to effective control voice；The control instruction is sent to aircraft.The present invention further simplifies user and manipulates the mode of aircraft, and is conducive to improve the flexibility ratio of aircraft manipulation.
Description
Technical field
The present invention relates to unmanned air vehicle technique field, more particularly to the method and base of the manipulation aircraft based on intelligent terminal
In the device of the manipulation aircraft of intelligent terminal.
Background technology
Traditional unmanned plane needs to be manipulated by dedicated remote controler, manipulates craftsmenship and complexity is higher, lead to
Often the player of only profession could effectively manipulate；In recent years, with the promotion and popularization of unmanned plane, the control mode of unmanned plane
Larger simplification is able to, even non-professional player can also pass through the prepackage on the daily intelligent terminal such as mobile phone, tablet
Software carries out unmanned plane manipulation.However nonetheless, the multistage manipulation menu on pre-installed software interface is different with several functions
Control option is still a problem for novice play.
In addition, the either mode of traditional remote controller, still intelligent terminal control mode in recent years, player were manipulating
It is both needed to check corresponding menu or control on controlling equipment in journey frequently, to send out corresponding instruction to unmanned plane, this is unfavorable
The flight condition of unmanned plane is observed in real time in player；Particularly player has on the wearable devices such as VR glasses, headgear and carries out immersion
In experience of the process, corresponding menu or control on controlling equipment can just be checked by also needing first to remove wearable device, for player
It is very inconvenient.
Invention content
Based on this, an embodiment of the present invention provides a kind of method and apparatus of the manipulation aircraft based on intelligent terminal, energy
It is enough further simplified user and manipulates the mode of aircraft, and be conducive to improve the flexibility ratio of aircraft manipulation.
The method that one aspect of the present invention provides the manipulation aircraft based on intelligent terminal, including：
User speech is obtained, identifies the effective control voice included in the voice；
The control instruction of corresponding aircraft is generated according to effective control voice；
The control instruction is sent to aircraft.
Another aspect of the present invention provides a kind of device of the manipulation aircraft based on intelligent terminal, including：
Speech monitoring module for obtaining user speech, identifies the effective control voice included in the voice；
Directive generation module, for generating the control instruction of corresponding aircraft according to effective control voice；
Instruction sending module, for sending the control instruction to aircraft.
Above-mentioned technical proposal by obtaining the user speech in ambient enviroment in real time, identifies that is included in the voice has
Control voice is imitated, and the control instruction of corresponding aircraft is generated according to effective control voice, to described in aircraft transmission
Control instruction；For user, without control menu complicated for operation or function choosing-item, by the voice control for following intuition
Pattern can easily control aircraft to realize various flare maneuvers, simplify the mode that user manipulates aircraft, reduce user's
Learning cost, and be conducive to improve the flexibility ratio of aircraft manipulation.
Description of the drawings
Fig. 1 is the hardware environment schematic diagram of the present invention program of an embodiment；
Fig. 2 is the schematic flow chart of the method for the manipulation aircraft based on intelligent terminal of an embodiment；
Fig. 3 is the schematic flow chart of the method for the manipulation aircraft based on intelligent terminal of another embodiment；
Fig. 4 is the schematic flow chart of the method for the manipulation aircraft based on intelligent terminal of another embodiment；
Fig. 5 is the schematic diagram of the device of the manipulation aircraft based on intelligent terminal of an embodiment.
Specific embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, it is right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Fig. 1 to realize the present invention embodiment based on intelligent terminal manipulation aircraft method hardware environment schematic diagram；
The hardware environment for realizing the method for the manipulation aircraft based on intelligent terminal of the embodiment of the present invention is such intelligent terminal：Extremely
Few processor for including connecting by system bus, voice collecting module, speech recognition module, communications module, power interface and
Storage medium.Wherein, voice collecting module is used to monitor the voice signal in ambient enviroment；Speech recognition module is used to simulate
Voice signal be identified as corresponding digital signal, with the corresponding semantic information of recognition of speech signals；The communications module is used for
Establish the communication connection with aircraft；Power interface with external power supply for connecting, and external power supply is by the power interface to intelligence
It can end cell power supply；Operating system, database and a kind of dress for manipulating aircraft are at least stored in the storage medium
It puts, which can be used for realizing the method for the manipulation aircraft based on intelligent terminal of the embodiment of the present invention.The intelligent terminal
Can be mobile phone, tablet computer etc. or other equipment with above structure.
With reference to Fig. 1 and the above-mentioned explanation to hardware environment, below to the method for the manipulation aircraft based on intelligent terminal
Embodiment illustrates.
Fig. 2 is the schematic flow chart of the method for the manipulation aircraft based on intelligent terminal of an embodiment；The present embodiment
In, it is illustrated for applying the method in intelligent terminal, the intelligent terminal includes but not limited to smart mobile phone, tablet
Etc. terminals.As shown in Fig. 2, the method for the manipulation aircraft based on intelligent terminal in the present embodiment includes step：
S11 obtains user speech, identifies the effective control voice included in the voice；
The user speech in ambient enviroment, the voice collecting module can be obtained by the voice collecting module of intelligent terminal
Refer to perceive and acquiring the device of voice signal, including but not limited to microphone, sound transducer etc..
On the one hand, it is not for controlling the voice of aircraft, example entirely since user sends out voice when manipulating aircraft
As only talked with other users at one's side or only talking to onself, it is therefore desirable to which user is sent out when manipulating aircraft
Voice is identified, and be effectively controlled voice.In a preferred embodiment, can institute be identified according to preset voice control library
The effective control voice included in predicate sound；Preset several control keywords, the control key are included in voice control library
Word either the keyword of digital signal form, can also analog signal form voiced keyword；Therefore in this way
Voice control library can recognize that effective control voice whether is contained in the current speech got.
On the other hand, for user when manipulating aircraft, neighbouring other users may send out voice, accidentally grasp in order to prevent
Make, also need to distinguish the voice got, with the voice that is effectively controlled.It in a preferred embodiment, can be according to language
The corresponding timbre information of sound identifies the effective control voice included in the voice.Such as the sound of authorized user is stored in advance
In systems, since the tone color of different people is unique, the invalid voice for excluding to get can be compared by tone color.
In addition, the voice of operation user usually got is generally relatively strong, the voice of neighbouring other users is weaker, therefore
In one preferred embodiment, the effective control voice included in the voice can be also identified according to the sound intensity information of voice.For example,
A sound intensity threshold value is preset, when the sound intensity of the voice only got is more than or equal to the sound intensity threshold value, effectively control could be used as
Voice less than the voice of the sound intensity threshold value, is then considered as invalid voice, and then exclude the interference of invalid voice.That is detection institute predicate
The speech recognition is effective control voice if the sound intensity is more than or equal to preset sound intensity threshold value by the sound intensity of sound.
S12 generates the control instruction of corresponding aircraft according to effective control voice；
In a preferred embodiment, the corresponding semantic information of effective control voice can be first identified, according to the semantic letter
Breath generates the control instruction of corresponding aircraft, if such as effectively control voice is " control aircraft draws left ", generate one
Draw left instruction；Such as if effectively control voice is " 8 o'clock sharps, which performed, draws a left side ", generates the left finger of drawing that a band performs condition
It enables, the particular content of the instruction can be " whether detection current time reaches at 8 points, if so, drawing left "；Or such as, if effectively control
Voice processed is " battery capacity declines when being less than 10% ", then generates the decline instruction of a conditional, and the particular content of instruction is
" detection battery capacity is less than 10%, if so, declining ".
S13 sends the control instruction to aircraft.
The mode that the control instruction is sent to aircraft includes but not limited to send based on preset repeater, to realize
The operation of over the horizon.
In a preferred embodiment, in order to improve the sensitivity of operation, generation control instruction is later immediately to aircraft
Send the control instruction.
In some cases, aircraft possibly can not perform corresponding control instruction, such as：For instruction of taking off, if working as
Preceding aircraft not yet unlocks, then can not perform this instruction.In order to remind user, in a preferred embodiment, aircraft is received
To after control instruction, its executive condition to the control instruction will be returned, it is former including running succeeded, performing failure and failure
Because etc. information, receive aircraft return the execution information to the control instruction after, institute is reported by way of voice
Execution information is stated, realizes the effect of man-machine intercommunication, user is prompted to send out correct control voice.
The method of the manipulation aircraft based on intelligent terminal through this embodiment, for user, without complicated for operation
Control menu or function choosing-item, by the voice control mode for following intuition can easily control aircraft realize it is various fly
Action is made, and simplifies the mode that user manipulates aircraft, reduces the learning cost of user, and is conducive to improve aircraft manipulation
Flexibility ratio.
With reference to Fig. 3, the method for the manipulation aircraft the present invention is based on intelligent terminal is further described.This reality
It applies in example, effective control voice is identified with reference to the sound intensity and voice control library.As shown in figure 3, the present embodiment based on intelligent terminal
Manipulation aircraft method include step：
S301 obtains user speech；
S302 identifies the effective control voice included in the voice according to the sound intensity information of the voice；
In a preferred embodiment, if only there are one the voices of user in the voice, the sound of the voice is detected
It is strong whether to be more than or equal to setting sound intensity threshold value, if so, being effective control voice by the speech recognition, next step is performed,
If it is not, ignore the voice.The sound intensity threshold value can be set according to actual conditions, and the present embodiment does not limit this.
In another preferred embodiment, if including the voice of more than two users in the voice, the sound intensity is extracted most
The voice of big user ignores the voice of other users, performs next step as effective control voice.
In another preferred embodiment, if including the voice of more than two users in the voice, detection is each respectively
Whether the sound intensity of user speech is more than or equal to setting sound intensity threshold value, and the extraction sound intensity is more than or equal to the language of the user of setting sound intensity threshold value
Sound ignores the voice that the sound intensity is less than the user of setting sound intensity threshold value as effective control voice.
S303, the effective control included in the voice obtained according to the further identification step 302 in preset voice control library
Voice.
In a preferred embodiment, the semantic information of the voice obtained by above-mentioned steps can be first identified, described in detection
Semantic information whether at least one of default voice control library control keyword match；If so, by the speech recognition
For effective control voice, next step is performed, otherwise, ignores the voice.
S304 generates the control instruction of corresponding aircraft according to effective control voice；
S305 sends the control instruction to aircraft.
In the present embodiment, after getting the voice in ambient enviroment, first is carried out according to the sound intensity information of voice first
Secondary identification further, carries out second further according to preset voice control library and identifies, thus can accurately and effectively obtain effectively
Control voice avoids maloperation caused by interference voice.It is understood that can also first according to preset voice control library into
Row identifies for the first time, further according to the sound intensity information of voice identify for the second time.
With reference to Fig. 4, the method for the manipulation aircraft the present invention is based on intelligent terminal is further described.This reality
It applies in example, on the basis of a upper embodiment, voice is identified also according to tone color.As shown in figure 4, the present embodiment based on
The method of the manipulation aircraft of intelligent terminal includes step：
S401 obtains user speech；
S402 identifies the effective control voice included in the voice according to the sound intensity information of the voice；
In a preferred embodiment, if only there are one the voices of user in the voice, the sound of the voice is detected
It is strong whether to be more than or equal to setting sound intensity threshold value, if so, being effective control voice by the speech recognition, next step is performed,
If it is not, ignore the voice.The sound intensity threshold value can be set according to actual conditions, and the present embodiment does not limit this.
In another preferred embodiment, if including the voice of more than two users in the voice, institute's predicate is detected
The maximum sound intensity of sound using the voice of the user of sound intensity maximum as effective control voice, is rejected the voice of other users, is performed
Next step.
In another preferred embodiment, if including the voice of more than two users in the voice, detection is each respectively
Whether the sound intensity of user speech is more than or equal to setting sound intensity threshold value, and the sound intensity is more than or equal to the voice of the user of setting sound intensity threshold value
As effective control voice, the voice that the sound intensity is less than the voice user of setting sound intensity threshold value is rejected in vain as invalid voice
Voice.
S403, the effective control included in the voice obtained according to the further identification step S402 of the corresponding timbre information of voice
Voice processed.
In a preferred embodiment, the embodiment of step S403 can be：The tone color of the voice is identified, according to default
The voice tone color of authorized user judge the voice whether from authorized user；If so, it is effectively control by the speech recognition
Voice processed.Which be adapted to only there are one user speech scene.
In another preferred embodiment, the embodiment of step S403 can be：The tone color of the voice is identified, if identification
The phonetic element of two or more tone colors is included into the voice, then judges each phonetic element whether from authorized user respectively；
If comprising the phonetic element from authorized user in the voice, extract in the voice voice from authorized user into
Point, be effectively controlled voice.Which is adapted to the scene there are two more than user speech.
In another preferred embodiment, the embodiment of step S403 can be：The tone color of the voice is identified, if identification
The phonetic element of two or more tone colors is included into the voice, then judges each phonetic element whether from authorized user respectively；
If preset authorized user show that the phonetic element from more than two authorized users, obtains for more than two and judgement
The authorized user of highest priority in the corresponding authorized user of the phonetic element (or the voice sound intensity is maximum) is taken, as first
Authorized user；The phonetic element from the first authorized user in the voice is extracted, be controlled effectively voice.Which is fitted
Ying Yu can further avoid the interference of other users voice there are two the scene of the voice of more than authorized user.
S404, the effective control included in the voice obtained according to the further identification step S403 in preset voice control library
Voice.
In a preferred embodiment, the semantic information of the voice obtained by above-mentioned steps can be first identified, described in detection
Semantic information whether at least one of default voice control library control keyword match；If so, by the speech recognition
For effective control voice, next step is performed, otherwise, ignores the voice.
In a preferred embodiment, the control keyword in the voice control library includes：It takes off, hover, surround, draw
Far, it follows, increase, reducing, advancing, retreating, draw left, the drawing right side, adjustment flight parameter, adjustment camera parameter, take pictures, start to record
Picture stops at least two in video recording.The limited quantity of control keyword in control voice control library, allows for natural language
Identify the technical difficulty realized, and the vocabulary that can be used as user is limited, the speech recognition speed of system faster, accuracy
Also higher.
S405 generates the control instruction of corresponding aircraft according to effective control voice；
In the present embodiment, if after above-mentioned steps, determining that there is no effective control voices in the voice, ignore institute's predicate
Sound will not generate the control instruction of corresponding aircraft.
S406 sends the control instruction to aircraft.
After aircraft receives the control instruction, corresponding action can be performed according to the control instruction, such as draw left
Flight accelerates flight etc..In addition, its executive condition to control instruction can also be returned to intelligent terminal by aircraft, convenient for use
Family know aircraft whether the corresponding control instruction of successful execution.
S407 receives the execution information to the control instruction that aircraft returns, execution information described in voice broadcast.With
For unmanned plane, specific example includes following scene：
1) it takes off
User speech：It takes off
System：Generation, which is taken off, control instruction and is sent to unmanned plane
System feedback：Unmanned plane successfully/the unmanned plane that is ready for taking off/take off is not completed to unlock, and can not take off
2) it hovers
User speech：Hovering
System：Generation Hovering control instructs and is sent to unmanned plane
System feedback：Unmanned plane has hovered
3) it surround
User speech：It opens around pattern
System：Generation opens around mode control instruction and is sent to unmanned plane
System feedback：It is had turned on around pattern
4) it zooms out
User speech：It zooms out
System：Generation zooms out control instruction and is sent to unmanned plane
System feedback：It is zooming out
5) it increases
User speech：Raising
System：Generation raising control instruction is simultaneously sent to unmanned plane
System feedback：It is increasing, and liftoff 50 meters
6) it reduces
User speech：It reduces
System：Generation reduces control instruction and is sent to unmanned plane
System feedback：It is reducing, it is liftoff 15 meters existing
7) advance
User speech：Advance
System：Generation advance control instruction is simultaneously sent to unmanned plane
System feedback：Advancing, aircraft is 800 meters remote from you
8) it retreats
User speech：It retreats
System：Generation retreats control instruction and is sent to unmanned plane
System feedback：It is retreating, aircraft also has 100 meters away from you
9) it draws left
User speech：It draws left
System：Generation draws left control instruction and is sent to unmanned plane
System feedback：A left side is being drawn, aircraft has deviateed 50 meters
10) it draws right
User speech：It draws right
System：Generation draws right control instruction and is sent to unmanned plane
System feedback：The right side is being drawn, aircraft has deviateed 50 meters
11) it takes pictures
User speech：It takes pictures
System：Generation, which is taken pictures, control instruction and is sent to unmanned plane
System feedback：Completion is taken pictures
12) it records a video
User speech：Start to record a video
System：Generation starts video recording control instruction and is sent to unmanned plane
System feedback：It is recording a video
User speech：Stop video recording
System：Generation stops video recording control instruction and is sent to unmanned plane
System feedback：Video recording has terminated
13) aircraft parameter is adjusted
User speech：Speed unit is set
System：Formation speed unit sets control instruction and is sent to unmanned plane
System feedback：It please select speed unit：Meter per second, km/h, mile/when
User speech：Km/h
System：Control instruction that speed unit is set as km/h by generation is simultaneously sent to unmanned plane
System feedback：It sets successfully
User speech：Cruise-in altitude is set
System：The control instruction of generation cruise-in altitude setting is simultaneously sent to unmanned plane
System feedback：Aircraft is not connected with, and can not carry out the setting
It is understood that above-mentioned example is only used for clearly explaining the present invention, it is not construed as the limit to the present invention
It is fixed.
In the present embodiment, after getting the voice in ambient enviroment, first is carried out according to the sound intensity information of voice first
Secondary identification further, carries out second further according to voice tone color and identifies, third time is carried out further according to preset voice control library
Identification, thus can more accurately be effectively controlled voice, avoid maloperation caused by interference voice.It is understood that
Can first time identification first be carried out according to preset voice control library, second of identification is carried out further according to the sound intensity information of voice,
Third time identification is carried out according to voice tone color；Or first time identification is carried out according to the sound intensity information of voice, according to preset language
Sound control library carries out second and identifies, third time identification is carried out according to voice tone color；Or other possible sequences.
Through this embodiment, the control mode in addition to touch-control, gesture, head chase after etc. is provide the user, can be realized more
It is multi-functional, also there are more approach for realizing function；Without control menu or function choosing-item complicated for operation, by following intuition
Voice control mode aircraft can easily be controlled to realize various flare maneuvers, simplify the mode that user manipulates aircraft,
The learning cost of user is reduced, and is conducive to improve the flexibility ratio of aircraft manipulation.
It should be noted that for aforementioned each method embodiment, describe, it is all expressed as a series of for simplicity
Combination of actions, but those skilled in the art should know, the present invention is not limited by described sequence of movement, because according to
According to the present invention, certain steps may be used other sequences or be carried out at the same time.In addition, can also arbitrary group be carried out to above-described embodiment
It closes, obtains other embodiments.
Based on the thought identical with the method for the manipulation aircraft based on intelligent terminal in above-described embodiment, the present invention is also
The device of the manipulation aircraft based on intelligent terminal is provided, which can be used for performing the above-mentioned manipulation flight based on intelligent terminal
The method of device.For convenience of description, in the structure diagram of the device embodiment of the manipulation aircraft based on intelligent terminal, only
Show with the relevant part of the embodiment of the present invention, it will be understood by those skilled in the art that schematic structure not structure twin installation
Restriction, can include that more or fewer components either combine certain components or different components is arranged than illustrating.
Fig. 5 is the schematic diagram of the device of the manipulation aircraft based on intelligent terminal of one embodiment of the invention；Such as
Shown in Fig. 5, the device of the manipulation aircraft based on intelligent terminal of the present embodiment includes：Speech monitoring module 510, instruction generation
Module 520 and instruction sending module 530, details are as follows for each module：
The speech monitoring module 510 for obtaining user speech, identifies the effective control language included in the voice
Sound；
Described instruction generation module 520, the control for generating corresponding aircraft according to effective control voice refer to
It enables；
Described instruction sending module 530, for sending the control instruction to aircraft.
In a preferred embodiment, the speech monitoring module 510 includes：
First recognition unit, for identifying the effective control language included in the voice according to preset voice control library
Sound；
And/or second recognition unit, for identifying what is included in the voice according to the corresponding timbre information of the voice
Effective control voice；
And/or second recognition unit, for identified according to the sound intensity information of the voice included in the voice it is effective
Control voice.
In a preferred embodiment, at least two control keywords are included in the voice control library；Described first knows
Other unit, for identifying the corresponding semantic information of the voice, if institute's semantic information and any control in voice control library
The speech recognition is then effective control voice by keyword match.
In a preferred embodiment, second recognition unit, for identifying the tone color of the voice, according to preset
Whether the voice tone color of authorized user judges the voice from authorized user；If so, it is effectively control by the speech recognition
Voice.
In a preferred embodiment, second recognition unit, for identifying the tone color of the voice, if recognizing institute
The phonetic element of two or more tone colors is included in predicate sound, then judges each phonetic element whether from authorized user respectively；If institute
Comprising the phonetic element from authorized user in predicate sound, then the phonetic element from authorized user in the voice is extracted, is obtained
To effective control voice.
In a preferred embodiment, second recognition unit, for identifying the tone color of the voice, if recognizing institute
The phonetic element of two or more tone colors is included in predicate sound, then judges each phonetic element whether from authorized user respectively；It is if pre-
If authorized user be more than two and judge to show that the phonetic element from more than two authorized users, then obtains institute
The authorized user of highest priority or sound intensity maximum in the corresponding authorized user of phonetic element is stated, as the first authorized user；It carries
The phonetic element from the first authorized user in the voice is taken, be controlled effectively voice.
The device of the manipulation aircraft based on intelligent terminal based on above-described embodiment, it is multiple without operating for user
Miscellaneous control menu or function choosing-item can easily control aircraft to realize various by the voice control mode for following intuition
Flare maneuver simplifies the mode that user manipulates aircraft, reduces the learning cost of user, and is conducive to improve aircraft behaviour
The flexibility ratio of control.
It should be noted that in the embodiment of the device of the manipulation aircraft based on intelligent terminal of above-mentioned example, respectively
The contents such as information exchange, implementation procedure between module, due to being based on same design, band with preceding method embodiment of the present invention
The technique effect come is identical with preceding method embodiment of the present invention, and particular content can be found in chatting in the method for the present invention embodiment
It states, details are not described herein again.
In addition, in the embodiment of the device of the manipulation aircraft based on intelligent terminal of above-mentioned example, each function module
Logical partitioning be merely illustrative of, can be as needed in practical application, for example, for corresponding hardware configuration requirement or
The convenient of the realization of software considers, above-mentioned function distribution is completed by different function modules, i.e., described will be based on intelligent terminal
The internal structure of device of manipulation aircraft be divided into different function modules, it is described above all or part of to complete
Function.The form that hardware had both may be used in wherein each function mould is realized, can also be realized in the form of software function module.
It will appreciated by the skilled person that realizing all or part of flow in above-described embodiment method, being can
It is completed with instructing relevant hardware by computer program, the program can be stored in a computer-readable storage and be situated between
In matter, it is independent product sale or uses.Described program when being executed, can perform the complete of such as embodiment of above-mentioned each method
Portion or part steps.Wherein, the storage medium can be magnetic disc, CD, read-only memory (Read-Only
Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiments.It is appreciated that wherein used term " first ", " second " etc. are at this
It is used to distinguish object, but these objects should not be limited by these terms in text.
Embodiment described above only expresses the several embodiments of the present invention, it is impossible to be interpreted as to the scope of the claims of the present invention
Limitation.It should be pointed out that for those of ordinary skill in the art, without departing from the inventive concept of the premise,
Various modifications and improvements can be made, these belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention
It should be determined by the appended claims.
Claims (18)
- A kind of 1. method of the manipulation aircraft based on intelligent terminal, which is characterized in that including：User speech is obtained, identifies the effective control voice included in the voice；The control instruction of corresponding aircraft is generated according to effective control voice；The control instruction is sent to aircraft.
- 2. the method for the manipulation aircraft according to claim 1 based on intelligent terminal, which is characterized in that identification institute predicate The step of effective control voice included in sound, includes：The effective control voice included in the voice is identified according to preset voice control library；And/or the effective control voice included in the voice is identified according to the corresponding timbre information of the voice；And/or the effective control voice included in the voice is identified according to the sound intensity information of the voice.
- 3. the method for the manipulation aircraft according to claim 2 based on intelligent terminal, which is characterized in that the voice control At least two control keywords are included in library processed；The step of identifying the effective control voice included in the voice according to preset voice control library includes：The corresponding semantic information of the voice is identified, if the control of at least one of institute's semantic information and voice control library is crucial Word matches, then is effective control voice by the speech recognition.
- 4. the method for the manipulation aircraft according to claim 2 based on intelligent terminal, which is characterized in that according to institute's predicate The step of corresponding timbre information of sound identifies the effective control voice included in the voice includes：It identifies the tone color of the voice, judges the voice whether from mandate use according to the voice tone color of preset authorized user Family；If so, it is effective control voice by the speech recognition.
- 5. the method for the manipulation aircraft according to claim 2 based on intelligent terminal, which is characterized in that according to institute's predicate The step of corresponding timbre information of sound identifies the effective control voice included in the voice includes：It identifies the tone color of the voice, if recognizing the phonetic element that two or more tone colors are included in the voice, sentences respectively Whether each phonetic element that breaks comes from authorized user；If the voice from authorized user in the voice is extracted comprising the phonetic element from authorized user in the voice Ingredient, be effectively controlled voice.
- 6. the method for the manipulation aircraft according to claim 2 based on intelligent terminal, which is characterized in that according to institute's predicate The step of corresponding timbre information of sound identifies the effective control voice included in the voice includes：It identifies the tone color of the voice, if recognizing the phonetic element that two or more tone colors are included in the voice, sentences respectively Whether each phonetic element that breaks comes from authorized user；If preset authorized user show that the phonetic element comes from more than two authorized users for more than two and judgement, The authorized user of highest priority or sound intensity maximum in the corresponding authorized user of the phonetic element is then obtained, is authorized as first User；The phonetic element from the first authorized user in the voice is extracted, be controlled effectively voice.
- 7. the method for the manipulation aircraft according to claim 2 based on intelligent terminal, which is characterized in that according to institute's predicate The sound intensity information of sound identifies that the step of effective control voice included in the voice includes：If only there are one the voice of user in the voice, whether the sound intensity for detecting the voice is more than or equal to setting sound intensity threshold Value, if so, being effective control voice by the speech recognition；If including the voice of more than two users in the voice, the voice for the user for extracting sound intensity maximum is as effectively control Voice；Alternatively,If including the voice of more than two users in the voice, whether the sound intensity for detecting each user speech respectively is more than or equal to Sound intensity threshold value is set, the extraction sound intensity is more than or equal to the voice of the user of setting sound intensity threshold value as effective control voice.
- 8. the method for the manipulation aircraft according to claim 3 based on intelligent terminal, which is characterized in that the voice control Control keyword in library processed includes：It takes off, hover, surrounding, zooming out, following, increasing, reducing, advancing, retreating, drawing left, drawing Right, adjustment flight parameter adjustment camera parameter, takes pictures, starts to record a video, stop at least two in video recording.
- 9. the method for the manipulation aircraft according to claim 1 based on intelligent terminal, which is characterized in that identification institute predicate After the step of effective control voice included in sound, further include：If there is no effective control voices in the voice, ignore the voice.
- 10. the method for the manipulation aircraft according to any one of claims 1 to 9 based on intelligent terminal, which is characterized in that After aircraft sends the step of control instruction, further include：Receive the execution information to the control instruction that aircraft returns, execution information described in voice broadcast.
- 11. a kind of device of the manipulation aircraft based on intelligent terminal, which is characterized in that including：Speech monitoring module for obtaining user speech, identifies the effective control voice included in the voice；Directive generation module, for generating the control instruction of corresponding aircraft according to effective control voice；Instruction sending module, for sending the control instruction to aircraft.
- 12. the device of the manipulation aircraft according to claim 11 based on intelligent terminal, which is characterized in that speech monitoring Module includes：First recognition unit, for identifying the effective control voice included in the voice according to preset voice control library；And/or second recognition unit, for identified according to the corresponding timbre information of the voice included in the voice it is effective Control voice；And/or second recognition unit, for identifying the effective control included in the voice according to the sound intensity information of the voice Voice.
- 13. the device of the manipulation aircraft according to claim 12 based on intelligent terminal, which is characterized in that the voice It controls in library comprising at least two control keywords；First recognition unit, for identifying the corresponding semantic information of the voice, if institute's semantic information and voice control The speech recognition is then effective control voice by any control keyword match in library.
- 14. the device of the manipulation aircraft according to claim 12 based on intelligent terminal, which is characterized in that described second Whether recognition unit for identifying the tone color of the voice, judges the voice according to the voice tone color of preset authorized user From authorized user；If so, it is effective control voice by the speech recognition.
- 15. the device of the manipulation aircraft according to claim 12 based on intelligent terminal, which is characterized in that described second Recognition unit, for identifying the tone color of the voice, if recognizing the phonetic element that two or more tone colors are included in the voice, Then judge each phonetic element whether from authorized user respectively；If including the phonetic element from authorized user in the voice, The phonetic element from authorized user in the voice is then extracted, be effectively controlled voice.
- 16. the device of the manipulation aircraft according to claim 12 based on intelligent terminal, which is characterized in that described second Recognition unit, for identifying the tone color of the voice, if recognizing the phonetic element that two or more tone colors are included in the voice, Then judge each phonetic element whether from authorized user respectively；If preset authorized user obtains institute for more than two and judgement Phonetic element is stated from more than two authorized users, then obtains highest priority in the corresponding authorized user of the phonetic element Or the authorized user of sound intensity maximum, as the first authorized user；Extract voice from the first authorized user in the voice into Point, be controlled effectively voice.
- 17. the device of the manipulation aircraft according to claim 12 based on intelligent terminal, which is characterized in that described theThree recognition units, if for, only there are one the voice of user, whether the sound intensity for detecting the voice to be big in the voice In equal to setting sound intensity threshold value, if so, by the speech recognition be effective control voice；If in the voice comprising two with The voice of upper user, then the voice for the user for extracting sound intensity maximum is as effective control voice；If it alternatively, is included in the voice Whether the voice of more than two users, the then sound intensity for detecting each user speech respectively are more than or equal to setting sound intensity threshold value, extraction sound The voice of the strong user for being more than or equal to setting sound intensity threshold value is as effective control voice.
- 18. according to the device of any manipulation aircraft based on intelligent terminal of claim 11 to 17, which is characterized in that It further includes：For receiving the execution information to the control instruction of aircraft return, letter is performed described in voice broadcast for feedback module Breath.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611115955.7A CN108172221A (en) | 2016-12-07 | 2016-12-07 | The method and apparatus of manipulation aircraft based on intelligent terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611115955.7A CN108172221A (en) | 2016-12-07 | 2016-12-07 | The method and apparatus of manipulation aircraft based on intelligent terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108172221A true CN108172221A (en) | 2018-06-15 |
Family
ID=62526167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611115955.7A Pending CN108172221A (en) | 2016-12-07 | 2016-12-07 | The method and apparatus of manipulation aircraft based on intelligent terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108172221A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109979459A (en) * | 2019-02-28 | 2019-07-05 | 西安爱生技术集团公司 | A kind of four-rotor aircraft control system based on signer-independent sign language recognition |
| CN110910876A (en) * | 2019-11-25 | 2020-03-24 | 杭州智芯科微电子科技有限公司 | Article sound searching device and control method, and voice control setting method and system |
| CN111091838A (en) * | 2019-12-24 | 2020-05-01 | 中国航空工业集团公司沈阳飞机设计研究所 | Open voice interaction platform for aircraft control |
| CN111179926A (en) * | 2019-12-10 | 2020-05-19 | 深圳微品致远信息科技有限公司 | Method and device for generating aircraft control command and computer equipment |
| CN111613222A (en) * | 2020-05-25 | 2020-09-01 | 广东电网有限责任公司 | Transformer substation inspection system |
| CN113703331A (en) * | 2021-08-27 | 2021-11-26 | 武汉市惊叹号科技有限公司 | Distributed control system based on integrated platform of Internet of things |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102233191A (en) * | 2010-05-07 | 2011-11-09 | 上海九鹰电子科技有限公司 | Aviation model with voice control function |
| CN103743065A (en) * | 2014-01-20 | 2014-04-23 | 美的集团股份有限公司 | Air conditioner, control method and control system thereof and terminal |
| CN103839547A (en) * | 2012-11-27 | 2014-06-04 | 英业达科技有限公司 | System for loading corresponding instruction elements by comparing voice operation signals and method thereof |
| CN103944983A (en) * | 2014-04-14 | 2014-07-23 | 美的集团股份有限公司 | Error correction method and system for voice control instruction |
| CN104579670A (en) * | 2013-10-28 | 2015-04-29 | 腾讯科技（深圳）有限公司 | Mobile terminal authentication method and mobile terminal |
| CN104808674A (en) * | 2015-03-03 | 2015-07-29 | 广州亿航智能技术有限公司 | Multi-rotor aircraft control system, terminal and airborne flight control system |
| CN104932527A (en) * | 2015-05-29 | 2015-09-23 | 广州亿航智能技术有限公司 | Aircraft control method and device |
| CN105009203A (en) * | 2013-03-12 | 2015-10-28 | 纽昂斯通讯公司 | Methods and apparatus for detecting a voice command |
| CN105206275A (en) * | 2015-08-31 | 2015-12-30 | 小米科技有限责任公司 | Device control method, apparatus and terminal |
| CN105278380A (en) * | 2015-10-30 | 2016-01-27 | 小米科技有限责任公司 | Control method and device of intelligent device |
| CN105355195A (en) * | 2015-09-25 | 2016-02-24 | 小米科技有限责任公司 | Audio frequency recognition method and audio frequency recognition device |
| CN205131667U (en) * | 2015-10-28 | 2016-04-06 | 上海顺砾智能科技有限公司 | Unmanned aerial vehicle's speech recognition remote control device |
| CN105573330A (en) * | 2015-03-03 | 2016-05-11 | 广州亿航智能技术有限公司 | Aircraft control method based on intelligent terminal |
| CN105620737A (en) * | 2016-02-26 | 2016-06-01 | 厦门大学嘉庚学院 | Voice remote control system used for helicopter type aircraft and helicopter type remote control aircraft |
| CN105791931A (en) * | 2016-02-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Smart television and voice control method of the smart television |
| CN105895096A (en) * | 2016-03-30 | 2016-08-24 | 乐视控股（北京）有限公司 | Identity identification and voice interaction operating method and device |
| CN106128456A (en) * | 2016-06-16 | 2016-11-16 | 美的集团股份有限公司 | The sound control method of intelligent appliance, terminal and system |
-
2016
- 2016-12-07 CN CN201611115955.7A patent/CN108172221A/en active Pending
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102233191A (en) * | 2010-05-07 | 2011-11-09 | 上海九鹰电子科技有限公司 | Aviation model with voice control function |
| CN103839547A (en) * | 2012-11-27 | 2014-06-04 | 英业达科技有限公司 | System for loading corresponding instruction elements by comparing voice operation signals and method thereof |
| CN105009203A (en) * | 2013-03-12 | 2015-10-28 | 纽昂斯通讯公司 | Methods and apparatus for detecting a voice command |
| CN104579670A (en) * | 2013-10-28 | 2015-04-29 | 腾讯科技（深圳）有限公司 | Mobile terminal authentication method and mobile terminal |
| CN103743065A (en) * | 2014-01-20 | 2014-04-23 | 美的集团股份有限公司 | Air conditioner, control method and control system thereof and terminal |
| CN103944983A (en) * | 2014-04-14 | 2014-07-23 | 美的集团股份有限公司 | Error correction method and system for voice control instruction |
| CN105573330A (en) * | 2015-03-03 | 2016-05-11 | 广州亿航智能技术有限公司 | Aircraft control method based on intelligent terminal |
| CN104808674A (en) * | 2015-03-03 | 2015-07-29 | 广州亿航智能技术有限公司 | Multi-rotor aircraft control system, terminal and airborne flight control system |
| CN104932527A (en) * | 2015-05-29 | 2015-09-23 | 广州亿航智能技术有限公司 | Aircraft control method and device |
| CN105206275A (en) * | 2015-08-31 | 2015-12-30 | 小米科技有限责任公司 | Device control method, apparatus and terminal |
| CN105355195A (en) * | 2015-09-25 | 2016-02-24 | 小米科技有限责任公司 | Audio frequency recognition method and audio frequency recognition device |
| CN205131667U (en) * | 2015-10-28 | 2016-04-06 | 上海顺砾智能科技有限公司 | Unmanned aerial vehicle's speech recognition remote control device |
| CN105278380A (en) * | 2015-10-30 | 2016-01-27 | 小米科技有限责任公司 | Control method and device of intelligent device |
| CN105620737A (en) * | 2016-02-26 | 2016-06-01 | 厦门大学嘉庚学院 | Voice remote control system used for helicopter type aircraft and helicopter type remote control aircraft |
| CN105791931A (en) * | 2016-02-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Smart television and voice control method of the smart television |
| CN105895096A (en) * | 2016-03-30 | 2016-08-24 | 乐视控股（北京）有限公司 | Identity identification and voice interaction operating method and device |
| CN106128456A (en) * | 2016-06-16 | 2016-11-16 | 美的集团股份有限公司 | The sound control method of intelligent appliance, terminal and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109979459A (en) * | 2019-02-28 | 2019-07-05 | 西安爱生技术集团公司 | A kind of four-rotor aircraft control system based on signer-independent sign language recognition |
| CN110910876A (en) * | 2019-11-25 | 2020-03-24 | 杭州智芯科微电子科技有限公司 | Article sound searching device and control method, and voice control setting method and system |
| CN111179926A (en) * | 2019-12-10 | 2020-05-19 | 深圳微品致远信息科技有限公司 | Method and device for generating aircraft control command and computer equipment |
| CN111091838A (en) * | 2019-12-24 | 2020-05-01 | 中国航空工业集团公司沈阳飞机设计研究所 | Open voice interaction platform for aircraft control |
| CN111613222A (en) * | 2020-05-25 | 2020-09-01 | 广东电网有限责任公司 | Transformer substation inspection system |
| CN113703331A (en) * | 2021-08-27 | 2021-11-26 | 武汉市惊叹号科技有限公司 | Distributed control system based on integrated platform of Internet of things |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108172221A (en) | The method and apparatus of manipulation aircraft based on intelligent terminal | |
| US11289074B2 (en) | Artificial intelligence apparatus for performing speech recognition and method thereof | |
| CN108133707B (en) | Content sharing method and system | |
| CN106782526A (en) | Sound control method and device | |
| CN108520743A (en) | Sound control method, smart machine and the computer-readable medium of smart machine | |
| CN110598576B (en) | Sign language interaction method, device and computer medium | |
| CN110047481A (en) | Method for voice recognition and device | |
| US11830482B2 (en) | Method and apparatus for speech interaction, and computer storage medium | |
| CN108470034A (en) | A kind of smart machine service providing method and system | |
| CN105284099B (en) | For hands-free interaction come adjust automatically user interface | |
| CN109086276B (en) | Data translation method, device, terminal and storage medium | |
| CN107655154A (en) | Terminal control method, air conditioner and computer-readable recording medium | |
| CN108986564A (en) | It is a kind of that control method and electronic equipment are entered for based on intelligent interaction | |
| KR20190096308A (en) | electronic device | |
| CN110462647A (en) | The method of the function of electronic equipment and execution electronic equipment | |
| US20210110815A1 (en) | Method and apparatus for determining semantic meaning of pronoun | |
| CN110310657A (en) | A kind of audio data processing method and device | |
| CN108055617A (en) | A kind of awakening method of microphone, device, terminal device and storage medium | |
| KR102369083B1 (en) | Voice data processing method and electronic device supporting the same | |
| CN109215646A (en) | Voice interaction processing method, device, computer equipment and storage medium | |
| CN108897517B (en) | Information processing method and electronic equipment | |
| CN109377990A (en) | A kind of information processing method and electronic equipment | |
| CN108805035A (en) | Interactive teaching and learning method based on gesture identification and device | |
| CN109074809B (en) | Information processing apparatus, information processing method, and computer-readable storage medium | |
| KR102369309B1 (en) | Electronic device for performing an operation for an user input after parital landing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |