CN108108142A - Voice information processing method, device, terminal device and storage medium - Google Patents
Voice information processing method, device, terminal device and storage medium Download PDFInfo
- Publication number
- CN108108142A CN108108142A CN201711340651.5A CN201711340651A CN108108142A CN 108108142 A CN108108142 A CN 108108142A CN 201711340651 A CN201711340651 A CN 201711340651A CN 108108142 A CN108108142 A CN 108108142A
- Authority
- CN
- China
- Prior art keywords
- interface
- instruction
- control instruction
- control
- voice messaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 30
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 230000000875 corresponding effect Effects 0.000 claims abstract description 129
- 238000000034 method Methods 0.000 claims abstract description 22
- 230000001960 triggered effect Effects 0.000 claims abstract description 10
- 238000013507 mapping Methods 0.000 claims description 25
- 230000006870 function Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 description 25
- 230000002093 peripheral effect Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Acoustics & Sound (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the present application discloses a kind of voice information processing method, device, terminal device and storage medium, and this method includes：Voice messaging is received, the voice messaging is identified the corresponding control instruction of generation；It detects with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it is present determining corresponding control object according to the control instruction；The corresponding action event of the control object is triggered to respond the control instruction.This programme realizes the voice messaging sent according to user and carries out efficient, accurate voice-controlled operations.
Description
Technical field
The invention relates to computer technology more particularly to a kind of voice information processing method, device, terminal devices
And storage medium.
Background technology
With the raising of terminal device popularity, more and more user's using terminal equipment perform various work(
Can be to meet self-demand, such as using terminal equipment reads word, viewing video, listens to music, plays game, in order to be carried to user
For more easily operating, the voice that terminal device can be sent by receiving user carries out voice control to the application program of installation
System.
In the prior art, the voice control scheme existing defects of terminal device, can not be according to the voice messaging that user sends
Realization is efficient, is accurately controlled operation.
The content of the invention
The present invention provides a kind of voice information processing method, device, terminal device and storage mediums, realize according to use
The voice messaging that family is sent carries out efficient, accurate voice-controlled operations.
In a first aspect, the embodiment of the present application provides a kind of voice information processing method, including：
Voice messaging is received, the voice messaging is identified the corresponding control instruction of generation；
It detects with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it is present according to institute
It states control instruction and determines corresponding control object；
The corresponding action event of the control object is triggered to respond the control instruction.
Second aspect, the embodiment of the present application additionally provide a kind of speech information processing apparatus, including：
Sound identification module for receiving voice messaging, is identified the voice messaging the corresponding control of generation and refers to
Order；
Control determining module whether there is the operation interface for realizing preset instructions interface for detecting in current task stack,
If it is present corresponding control object is determined according to the control instruction；
Control processing module rings the control instruction for triggering the corresponding action event of the control object
It should.
The third aspect, the embodiment of the present application additionally provide a kind of terminal device, including：Processor, memory and storage
On a memory and the computer program that can run on a processor, the processor are realized such as when performing the computer program
Voice information processing method described in the embodiment of the present application.
Fourth aspect, the embodiment of the present application additionally provide a kind of storage medium for including terminal device executable instruction, institute
Terminal device executable instruction is stated when being performed as terminal device processor for the voice letter described in performing the embodiment of the present application
Cease processing method.
In the present solution, receiving voice messaging, the voice messaging is identified the corresponding control instruction of generation, detection is worked as
With the presence or absence of the operation interface for realizing preset instructions interface in preceding task stack, if it is present being determined according to the control instruction
Corresponding control object triggers the control object corresponding action event and the control instruction is responded, is achieved in
Efficient, accurate voice-controlled operations are carried out according to voice messaging.
Description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, of the invention is other
Feature, objects and advantages will become more apparent upon：
Fig. 1 is a kind of flow chart of voice information processing method provided by the embodiments of the present application；
Fig. 2 is the flow chart of another voice information processing method provided in an embodiment of the present invention；
Fig. 3 is the flow chart of another voice information processing method provided by the embodiments of the present application；
Fig. 4 is the flow chart of another voice information processing method provided by the embodiments of the present application
Fig. 5 is a kind of structure diagram of speech information processing apparatus provided by the embodiments of the present application；
Fig. 6 is a kind of structure diagram of terminal device provided by the embodiments of the present application.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used to explain the present invention rather than limitation of the invention.It also should be noted that for the ease of retouching
It states, part related to the present invention rather than entire infrastructure is illustrated only in attached drawing.
Fig. 1 is a kind of flow chart of voice information processing method provided by the embodiments of the present application, is applicable to set terminal
Standby to carry out speech control, this method can be performed by terminal device provided by the embodiments of the present application, the voice of the terminal device
Software can be used in information processing unit and/or the mode of hardware is realized, as shown in Figure 1, concrete scheme provided in this embodiment is such as
Under：
Step S101, voice messaging is received, the voice messaging is identified the corresponding control instruction of generation.
Wherein, voice messaging can be the voice content that user sends, and terminal device can pass through integrated microphone apparatus
Reception acquisition is carried out to the voice messaging.In one embodiment, terminal device can or specific sound control manual according to user
Into voice control mode, into after voice control mode, integrated microphone apparatus to the sound around terminal device into
Row acquisition.
Wherein, the sound identification module that terminal device integrates is identified to generate phase to the above-mentioned voice messaging received
The control instruction answered, optionally, sound identification module preliminary identification can be carried out to the voice messaging that receives with determine whether for
The sound of people is then filtered out if inhuman sound (very big may be environmental noise), automatically further, when definite sound
During the voice sent for user, also Application on Voiceprint Recognition mode can further be used to determine whether to send for terminal device owner user
Voice, if it is, carry out speech recognition, if it is not, then abandoning this voice control.
In one embodiment, the corresponding control instruction of generation voice messaging, which is identified, to be included：The voice is believed
Breath carries out semantics recognition, to generate corresponding control instruction, wherein, control instruction is used to indicate the application journey of installing terminal equipment
Sequence performs corresponding action, and if control instruction is " next ", then music player software plays currently playing music accordingly
Next song.
With the presence or absence of the operation interface for realizing preset instructions interface in rapid S102, detection current task stack, if it is present
Step S103 is performed, if it does not exist, then terminating flow.
Terminal device can run multiple processes to perform different tasks simultaneously in the process of running, and task can be foreground
Task, background task, usual foreground task is the corresponding task of terminal device current display interface, and background task, that is, terminal is set
The task of the running background of standby non-present display interface, after opening music player software such as user, switching current display interface is
Browser interface, then music task accordingly in running background, as front stage operation appoint accordingly by browser task
Business.
By taking android operating systems as an example, which can be Activity stacks, and wherein task stack follows first in first out
Principle, illustratively, after application program launching, first Activity (FirstActivity) of operation is pressed into
In Activity stacks, after user clicks on the button of FirstActivity, start second Activity accordingly
(SecondActivity), at this point, SecondActivity is located at Activity stack tops portion, FirstActivity is located at stack bottom
Portion, and so on；Correspondingly, when user clicks on return push-button (Back), the content in Activity stacks performs successively
Pop operations pop up corresponding Activity interfaces.Wherein, different Activity corresponds to different operation interfaces, in step
After generating control instruction in S101, with the presence or absence of the operation for realizing preset instructions interface in the current task stack of detection terminal equipment
Interface, optionally, the preset instructions interface can be the system interfaces defined in ccf layer, be connect so that music controls class software as an example
Mouth is defined as follows：
Preset instructions interface defined above can be accordingly fitted in corresponding Application Program Interface, that is, is configured right
In the realization class (such as Activity classes and corresponding sub- View classes) for the tripartite's application program answered, wherein, the return of each function
Value is the ID of corresponding control.Specifically, by taking android operating systems as an example, pass through ActivityManager#
GetRecentTasks () functional based method passes through Class# to obtain the Activity.class classes in recent task stack
GetInterfaces () method judges whether the activity in stack realizes preset instructions interface.
Step S103, corresponding control object is determined according to the control instruction.
One application program includes multiple operation interfaces, operation interface can according to user operation (as clicked on, sliding) into
Row switching, a usual Activity correspond to a display interface, can be included in display interface one or more can with user into
The control (such as button, check box, drop-down list) of row interaction, wherein each individually control can regard a control object as.
In one embodiment, corresponding control is determined according to control instruction and the instruction interface mapping table of storage
Object, illustratively, the instruction interface mapping relations are expressed as：
map<command,map<interface,method>>；
By taking above-mentioned music controls class software as an example, when the control instruction of generation is " next ", obtained according to the instruction
Instruction interface mapping relations be：
map<" next song ", map<IMusicControl,nextMusic>>；
Correspondingly, by obtaining returning for corresponding long nextMusic () in interface IMusicControl defined above
Value is returned, which is the ID of control, can obtain unique and corresponding control object by control ID, such as passes through acquisition
The ViewRoot of Activity, calling interface ViewRoot.findViewById (id) are to obtain control object.
Step S104, the corresponding action event of the control object is triggered to respond the control instruction.
Wherein, different control types, which correspond to definition, different action events, as button class control can define point accordingly
Action event is hit, sliding class control, definition has slide event accordingly, after definite control instruction corresponding control object,
The corresponding action event of the control object is triggered accordingly.By taking above-mentioned music class software as an example, when control instruction is " next "
When, determine the corresponding control object of the control instruction, the wherein control object can be an icon, and icon can be arrow
Icon further triggers the click event of the icon, specifically, can call what the View was monitored by triggering
OnClickListener monitors the response for realizing that interface carries out control instruction.
As shown in the above, preset instructions interface is realized in the present solution, searching whether to exist in current task stack
Operation interface is, it can be achieved that language to non-foreground application (namely the corresponding application program of non-terminal equipment current display interface)
Sound control system, meanwhile, this programme using control instruction and storage instruction interface mapping relations obtain corresponding control object rather than
The word that control instruction and control are shown is corresponded to, and is improved the practicability of scheme, is expanded use scope.
Fig. 2 is the flow chart of another voice information processing method provided by the embodiments of the present application, optionally, at described
Before determining corresponding control object according to the control instruction, further include：Judging the corresponding application program of the operation interface is
It is no to be in responsive state；Correspondingly, described determine that corresponding control object includes according to the control instruction：If the operation
The corresponding application program in interface is in responsive state, then determines corresponding control object according to the control instruction.Such as Fig. 2 institutes
Show, technical solution is specific as follows：
Step S201, the preset instructions interface of definition is adapted into corresponding Application Program Interface.
Step S202, voice messaging is received, the voice messaging is identified the corresponding control instruction of generation.
Step S203, detect with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it does,
Step S204 is then performed, if it does not exist, then terminating flow.
Step S204, whether the corresponding application program of the operation interface is judged in responsive state, if it is, performing
Step S205, if it is not, then terminating flow.
In one embodiment, after determining to have the operation interface for realizing preset instructions interface in task stack, into one
Whether step judges the corresponding application program of the operation interface in responsive state, specifically, can pass through sorts of systems service acquisition
The application program current state, by taking android operating systems as an example, can by AudioManager, PowerManager,
Whether the state of the definite application program such as WindowManager is in responsive state.Illustratively, by taking music class software as an example,
There is preset instructions interface if determining the operation interface realization of music class software in task stack, pass through AudioManager
The music software is determined whether in playing or in pause, if it is, determining that the music software is in responsive state.
Step S205, corresponding control pair is determined according to the control instruction and the instruction interface mapping table of storage
As.
Step S206, the corresponding action event of the control object is triggered to respond the control instruction.
As shown in the above, it is treated to voice messaging in journey, application program of the control in responsive state
Voice messaging is responded, application program is reasonably avoided and the unhandy of mistake in response to belt of control instruction is asked
Topic.
Fig. 3 is the flow chart of another voice information processing method provided by the embodiments of the present application, optionally, at described
Before determining corresponding control object according to the instruction interface mapping table of the control instruction and storage, further include：Foundation
The function generation instruction interface mapping table of the application program of installing terminal equipment is simultaneously stored；It is described that the voice is believed
The corresponding control instruction of generation, which is identified, in breath includes：Semantics recognition is carried out to the voice messaging, according to the life of preset model storehouse
Into corresponding control instruction.As shown in figure 3, technical solution is specific as follows：
Step S301, the preset instructions interface of definition is adapted into corresponding Application Program Interface.
Step S302, the function according to the application program of installing terminal equipment generates instruction interface mapping table and carries out
Storage.
Illustratively, by taking music software as an example, software is generally configured with song switching after starting, pause is played, commenced play out
Etc. functions, correspondingly, after the preset instructions interface of definition is adapted into Application Program Interface, carry out the matching of control instruction
Mapping relations determine that the function (song switching, pause are played, commenced play out) of realizing Application Program Interface carries out instruction
Processing, i.e., when music software run, next song choices button can corresponding control instruction be " next " (as
Example, can also be defined as " next ", " next song " etc.), i.e., by the pre- of control instruction " next " and music class software definition
If instruction interface is associated.
Step S303, voice messaging is received, semantics recognition is carried out to the voice messaging, according to preset model storehouse generation phase
The control instruction answered.
Common, can the voice messaging received be directly converted into corresponding word, using obtained word as control
Instruction.In this step, semantics recognition is carried out to the voice messaging of reception, corresponding control instruction is generated according to preset model storehouse,
The preset model storehouse trains to obtain by machine learning, and the input of training sample is the voice control for same class application program
Sentence is exported as the corresponding and corresponding control instruction of control, i.e., after user sends voice, by knowing to the voice
Not, predict to obtain corresponding control instruction.
Step S304, detect with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it does,
Step S305 is then performed, if it does not exist, then terminating flow.
Step S305, whether the corresponding application program of the operation interface is judged in responsive state, if it is, performing
Step S306, if it is not, then terminating flow.
Step S306, corresponding control pair is determined according to the control instruction and the instruction interface mapping table of storage
As.
Step S307, the corresponding action event of the control object is triggered to respond the control instruction.
It can be seen from the above, during carrying out processing to voice messaging and realizing corresponding control, preset model storehouse is introduced
The voice messaging received is identified, predicts to determine and the control instruction of control bundle so that the voice of user is believed
It is stronger to cease the flexibility of processing, improves user experience.
Fig. 4 is the flow chart of another voice information processing method provided by the embodiments of the present application, optionally, if currently
It is there is no the operation interface for realizing preset instructions interface in task stack, then judges whether the control instruction is that default start refers to
Order, if it is, starting application program corresponding with the control instruction.As shown in figure 4, technical solution is specific as follows：
Step S401, the preset instructions interface of definition is adapted into corresponding Application Program Interface.
Step S402, the function according to the application program of installing terminal equipment generates instruction interface mapping table and carries out
Storage.
Step S403, semantics recognition is carried out to the voice messaging, corresponding control instruction is generated according to preset model storehouse.
Step S404, detect with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it does,
Step S405 is then performed, if it does not exist, then performing step S406.
Step S405, whether the corresponding application program of the operation interface is judged in responsive state, if it is, performing
Step S407, if it is not, then terminating flow.
Step S406, judge whether the control instruction is default enabled instruction, if so, performing step S409, otherwise
Terminate flow.
Illustratively, during control process is carried out to user speech information, if current task stack does not deposit realization in advance
If during the operation interface of instruction interface, determine whether the control instruction is default enabled instruction, the default enabled instruction
It is used to implement the unlatching of corresponding application program.Optionally, in another embodiment, it can also be and determine to deposit in task stack
It is realizing the operation interface of preset instructions interface, but can not matched with the current control instruction according to voice messaging generation, then sentencing
Whether the control instruction of breaking is default enabled instruction.
Step S407, corresponding control pair is determined according to the control instruction and the instruction interface mapping table of storage
As.
Step S408, the corresponding action event of the control object is triggered to respond the control instruction.
Step S409, startup and the corresponding application program of the control instruction.
It, can be into it can be seen from the above, this programme is while application program responds voice messaging in realizing task stack
The foundation voice messaging of one step opens application program, and perfect speech signal analysis mechanism further improves voice
The treatment effeciency of information.
Fig. 5 is a kind of structure diagram of speech information processing apparatus provided by the embodiments of the present application, which is used to perform
The voice information processing method that above-described embodiment provides, possesses the corresponding function module of execution method and advantageous effect.Such as Fig. 5 institutes
Show, which specifically includes：Sound identification module 101, control determining module 102 and control processing module 103, wherein,
For receiving voice messaging, the voice messaging is identified the corresponding control of generation in sound identification module 101
Instruction.
Wherein, voice messaging can be the voice content that user sends, and terminal device can pass through integrated microphone apparatus
Reception acquisition is carried out to the voice messaging.In one embodiment, terminal device can or specific sound control manual according to user
Into voice control mode, into after voice control mode, integrated microphone apparatus to the sound around terminal device into
Row acquisition.
Wherein, the sound identification module that terminal device integrates is identified to generate phase to the above-mentioned voice messaging received
The control instruction answered, optionally, sound identification module preliminary identification can be carried out to the voice messaging that receives with determine whether for
The sound of people is then filtered out if inhuman sound (very big may be environmental noise), automatically further, when definite sound
During the voice sent for user, also Application on Voiceprint Recognition mode can further be used to determine whether to send for terminal device owner user
Voice, if it is, carry out speech recognition, if it is not, then abandoning this voice control.
In one embodiment, the corresponding control instruction of generation voice messaging, which is identified, to be included：The voice is believed
Breath carries out semantics recognition, to generate corresponding control instruction, wherein, control instruction is used to indicate the application journey of installing terminal equipment
Sequence performs corresponding action, and if control instruction is " next ", then music player software plays currently playing music accordingly
Next song.
Control determining module 102, for detecting in current task stack with the presence or absence of operation circle for realizing preset instructions interface
Face, if it is present determining corresponding control object according to the control instruction.
Terminal device can run multiple processes to perform different tasks simultaneously in the process of running, and task can be foreground
Task, background task, usual foreground task is the corresponding task of terminal device current display interface, and background task, that is, terminal is set
The task of the running background of standby non-present display interface, after opening music player software such as user, switching current display interface is
Browser interface, then music task accordingly in running background, as front stage operation appoint accordingly by browser task
Business.
By taking android operating systems as an example, which can be Activity stacks, and wherein task stack follows first in first out
Principle, illustratively, after application program launching, first Activity (FirstActivity) of operation is pressed into
In Activity stacks, after user clicks on the button of FirstActivity, start second Activity accordingly
(SecondActivity), at this point, SecondActivity is located at Activity stack tops portion, FirstActivity is located at stack bottom
Portion, and so on；Correspondingly, when user clicks on return push-button (Back), the content in Activity stacks performs successively
Pop operations pop up corresponding Activity interfaces.Wherein, different Activity corresponds to different operation interfaces, in step
After generating control instruction in S101, with the presence or absence of the operation for realizing preset instructions interface in the current task stack of detection terminal equipment
Interface, optionally, the preset instructions interface can be the system interfaces defined in ccf layer, be connect so that music controls class software as an example
Mouth is defined as follows：
Preset instructions interface defined above can be accordingly fitted in corresponding Application Program Interface, that is, is configured right
In the realization class (such as Activity classes and corresponding sub- View classes) for the tripartite's application program answered, wherein, the return of each function
Value is the ID of corresponding control.Specifically, by taking android operating systems as an example, pass through ActivityManager#
GetRecentTasks () functional based method passes through Class# to obtain the Activity.class classes in recent task stack
GetInterfaces () method judges whether the activity in stack realizes preset instructions interface.
One application program includes multiple operation interfaces, operation interface can according to user operation (as clicked on, sliding) into
Row switching, a usual Activity correspond to a display interface, can be included in display interface one or more can with user into
The control (such as button, check box, drop-down list) of row interaction, wherein each individually control can regard a control object as.
In one embodiment, corresponding control is determined according to control instruction and the instruction interface mapping table of storage
Object, illustratively, the instruction interface mapping relations are expressed as：
map<command,map<interface,method>>；
By taking above-mentioned music controls class software as an example, when the control instruction of generation is " next ", obtained according to the instruction
Instruction interface mapping relations be：
map<" next song ", map<IMusicControl,nextMusic>>；
Correspondingly, by obtaining returning for corresponding long nextMusic () in interface IMusicControl defined above
Value is returned, which is the ID of control, can obtain unique and corresponding control object by control ID, such as passes through acquisition
The ViewRoot of Activity, calling interface ViewRoot.findViewById (id) are to obtain control object.
Control processing module 103 carries out the control instruction for triggering the corresponding action event of the control object
Response.
Wherein, different control types, which correspond to definition, different action events, as button class control can define point accordingly
Action event is hit, sliding class control, definition has slide event accordingly, after definite control instruction corresponding control object,
The corresponding action event of the control object is triggered accordingly.By taking above-mentioned music class software as an example, when control instruction is " next "
When, determine the corresponding control object of the control instruction, the wherein control object can be an icon, and icon can be arrow
Icon further triggers the click event of the icon, specifically, can call what the View was monitored by triggering
OnClickListener monitors the response for realizing that interface carries out control instruction.
As shown in the above, preset instructions interface is realized in the present solution, searching whether to exist in current task stack
Operation interface is, it can be achieved that language to non-foreground application (namely the corresponding application program of non-terminal equipment current display interface)
Sound control system, meanwhile, this programme using control instruction and storage instruction interface mapping relations obtain corresponding control object rather than
The word that control instruction and control are shown is corresponded to, and is improved the practicability of scheme, is expanded use scope.
In a possible embodiment, further include：
Respond judgment module 104, for it is described corresponding control object is determined according to the control instruction before, judge
Whether the corresponding application program of the operation interface is in responsive state；
The control determining module 102 is specifically used for：
If the corresponding application program of the operation interface is in responsive state, determine to correspond to according to the control instruction
Control object.
In a possible embodiment, the control determining module 102 is specifically used for：
Corresponding control object is determined according to the control instruction and the instruction interface mapping table of storage.
In a possible embodiment, further include：
Configuration module 105, for described true according to the control instruction and the instruction interface mapping table of storage
Before fixed corresponding control object, the function generation instruction interface mapping table of the application program according to installing terminal equipment is simultaneously
It is stored.
In a possible embodiment, the configuration module 105 is additionally operable to：
It is described the voice messaging is identified the corresponding control instruction of generation before, the preset instructions of definition are connect
Mouth adaptation is into corresponding Application Program Interface.
In a possible embodiment, the sound identification module 101 is specifically used for：
Semantics recognition is carried out to the voice messaging, corresponding control instruction is generated according to preset model storehouse.
In a possible embodiment, the control determining module 102 is additionally operable to：
If being there is no the operation interface for realizing preset instructions interface in current task stack, the control instruction is judged
Whether it is default enabled instruction, if it is, starting application program corresponding with the control instruction.
The present embodiment provides a kind of terminal device on the basis of the various embodiments described above, and Fig. 6 is that the embodiment of the present application carries
The structure diagram of a kind of terminal device supplied, as shown in fig. 6, the terminal device 200 includes：Memory 201, processor
(Central Processing Unit, CPU) 202, Peripheral Interface 203, RF (Radio Frequency, radio frequency) circuit 205,
Voicefrequency circuit 206, loud speaker 211, power management chip 208, input/output (I/O) subsystem 209, touch-screen 212, Mike
Wind 213, other input/control devicess 210 and outside port 204, these components pass through one or more communication bus or letter
Number line 207 communicates.
It should be understood that graphic terminal 200 is only an example of terminal device, and terminal device 200
Can have than more or less components shown in figure, two or more components can be combined or can be with
It is configured with different components.Various parts shown in figure can be including one or more signal processings and/or special
Hardware, software including integrated circuit are realized in the combination of hardware and software.
Just the terminal device of the rights management provided in this embodiment for more opening application is described in detail below, should
Terminal device is by taking smart mobile phone as an example.
Memory 201, the memory 201 can be by access such as CPU202, Peripheral Interfaces 203, and the memory 201 can
To include high-speed random access memory, nonvolatile memory can also be included, such as one or more disk memory,
Flush memory device or other volatile solid-state parts.
The peripheral hardware that outputs and inputs of equipment can be connected to CPU202 and deposited by Peripheral Interface 203, the Peripheral Interface 203
Reservoir 201.
Microphone 213, the microphone 213, which can receive voice messaging and be transmitted to CPU202, is identified processing.
I/O subsystems 209, the I/O subsystems 209 can be by the input/output peripherals in equipment, such as touch-screen 212
With other input/control devicess 210, Peripheral Interface 203 is connected to.I/O subsystems 209 can include 2091 He of display controller
For controlling one or more input controllers 2092 of other input/control devicess 210.Wherein, one or more input controls
Device 2092 processed receives electric signal from other input/control devicess 210 or sends electric signal to other input/control devicess 210,
Other input/control devicess 210 can include physical button (pressing button, rocker buttons etc.), dial, slide switch, behaviour
Vertical pole clicks on idler wheel.What deserves to be explained is input controller 2092 can with it is following any one be connected：Keyboard, infrared port,
The instruction equipment of USB interface and such as mouse.
Touch-screen 212, the touch-screen 212 are the input interface and output interface between user terminal and user, can
User is shown to depending on output, visual output can include figure, text, icon, video etc..
Display controller 2091 in I/O subsystems 209 receives electric signal from touch-screen 212 or is sent out to touch-screen 212
Electric signals.Touch-screen 212 detects the contact on touch-screen, and the contact detected is converted to and shown by display controller 2091
The interaction of user interface object on touch-screen 212, that is, realize human-computer interaction, the user interface being shown on touch-screen 212
Icon that object can be the icon of running game, be networked to corresponding network etc..What deserves to be explained is equipment can also include light
Mouse, light mouse are the extensions for not showing the touch sensitive surface visually exported or the touch sensitive surface formed by touch-screen.
RF circuits 205 are mainly used for establishing the communication of mobile phone and wireless network (i.e. network side), realize mobile phone and wireless network
The data receiver of network and transmission.Such as transmitting-receiving short message, Email etc..Specifically, RF circuits 205 receive and send RF letters
Number, RF signals are also referred to as electromagnetic signal, and RF circuits 205 convert electrical signals to electromagnetic signal or electromagnetic signal is converted to telecommunications
Number, and communicated by the electromagnetic signal with communication network and other equipment.RF circuits 205 can include performing
The known circuit of these functions includes but not limited to antenna system, RF transceivers, one or more amplifiers, tuner, one
A or multiple oscillators, digital signal processor, CODEC (COder-DECoder, coder) chipset, user identifier mould
Block (Subscriber Identity Module, SIM) etc..
Voicefrequency circuit 206 is mainly used for receiving voice data from Peripheral Interface 203, which is converted to telecommunications
Number, and the electric signal is sent to loud speaker 211.
Loud speaker 211 for the voice signal for receiving mobile phone from wireless network by RF circuits 205, is reduced to sound
And play the sound to user.
Power management chip 208, the hardware for being connected by CPU202, I/O subsystem and Peripheral Interface are powered
And power management.
The speech information processing apparatus and terminal device of the terminal device provided in above-described embodiment can perform the present invention and appoint
The voice information processing method of terminal device that meaning embodiment is provided possesses and performs the corresponding function module of this method and beneficial
Effect.The not technical detail of detailed description in the above-described embodiments, reference can be made to the terminal that any embodiment of the present invention is provided is set
Standby voice information processing method.
The embodiment of the present application also provides a kind of storage medium for including terminal device executable instruction, and the terminal device can
It executes instruction when being performed by terminal device processor for performing a kind of voice information processing method, this method includes：
Voice messaging is received, the voice messaging is identified the corresponding control instruction of generation；
It detects with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it is present according to institute
It states control instruction and determines corresponding control object；
The corresponding action event of the control object is triggered to respond the control instruction.
In a possible embodiment, it is described corresponding control object is determined according to the control instruction before, also
Including：
Judge the corresponding application program of the operation interface whether in responsive state；
Correspondingly, described determine that corresponding control object includes according to the control instruction：
If the corresponding application program of the operation interface is in responsive state, determine to correspond to according to the control instruction
Control object.
In a possible embodiment, it is described to determine that corresponding control object includes according to the control instruction：
Corresponding control object is determined according to the control instruction and the instruction interface mapping table of storage.
In a possible embodiment, described according to the control instruction and the instruction interface mapping relations of storage
Before table determines corresponding control object, further include：
The function generation instruction interface mapping table of application program according to installing terminal equipment is simultaneously stored.
In a possible embodiment, it is described the voice messaging is identified the corresponding control instruction of generation it
Before, it further includes：
The preset instructions interface of definition is adapted into corresponding Application Program Interface.
In a possible embodiment, it is described the voice messaging to be identified the corresponding control instruction bag of generation
It includes：
Semantics recognition is carried out to the voice messaging, corresponding control instruction is generated according to preset model storehouse.
In a possible embodiment, if being that there is no operations circle for realizing preset instructions interface in current task stack
Face then judges whether the control instruction is default enabled instruction, if it is, starting application corresponding with the control instruction
Program.
Storage medium --- any various types of memory devices or storage device.Term " storage medium " is intended to wrap
It includes：Install medium, such as CD-ROM, floppy disk or magnetic tape equipment；Computer system memory or random access memory, such as
DRAM, DDR RAM, SRAM, EDO RAM, blue Bath (Rambus) RAM etc.；Nonvolatile memory, such as flash memory, magnetic medium
(such as hard disk or optical storage)；Memory component of register or other similar types etc..Storage medium can further include other
The memory of type or its combination.In addition, storage medium can be located at program in the first computer system being wherein performed,
Or can be located in different second computer systems, second computer system is connected to the by network (such as internet)
One computer system.Second computer system can provide program instruction and be used to perform to the first computer." storage is situated between term
Matter " can include may reside in different position two of (such as in different computer systems by network connection) or
More storage mediums.Storage medium can store the program instruction that can be performed by one or more processors and (such as implement
For computer program).
Certainly, a kind of storage medium for including computer executable instructions that the embodiment of the present application is provided, computer
The voice information processing method operation that executable instruction is not limited to the described above, can also carry out any embodiment of the present invention and is carried
Relevant operation in the voice information processing method of confession.
Note that it above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that
The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various apparent variations,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above example to the present invention
It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also
It can include other more equivalent embodiments, and the scope of the present invention is determined by scope of the appended claims.
Claims (10)
1. voice information processing method, which is characterized in that including：
Voice messaging is received, the voice messaging is identified the corresponding control instruction of generation；
It detects with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if it is present according to the control
System instruction determines corresponding control object；
The corresponding action event of the control object is triggered to respond the control instruction.
2. according to the method described in claim 1, it is characterized in that, corresponding control is determined according to the control instruction described
Before object, further include：
Judge the corresponding application program of the operation interface whether in responsive state；
Correspondingly, described determine that corresponding control object includes according to the control instruction：
If the corresponding application program of the operation interface is in responsive state, corresponding control is determined according to the control instruction
Part object.
3. according to the method described in claim 2, it is characterized in that, described determine corresponding control pair according to the control instruction
As including：
Corresponding control object is determined according to the control instruction and the instruction interface mapping table of storage.
4. according to the method described in claim 3, it is characterized in that, described according to the control instruction and the instruction of storage
Before interface mappings relation table determines corresponding control object, further include：
The function generation instruction interface mapping table of application program according to installing terminal equipment is simultaneously stored.
5. according to the described method of any one of claim 1-4, which is characterized in that the voice messaging is known described
Before not generating corresponding control instruction, further include：
The preset instructions interface of definition is adapted into corresponding Application Program Interface.
6. according to the described method of any one of claim 1-4, which is characterized in that described that the voice messaging is identified
Generating corresponding control instruction includes：
Semantics recognition is carried out to the voice messaging, corresponding control instruction is generated according to preset model storehouse.
7. if according to the method described in claim 1, it is characterized in that, it is that there is no realize preset instructions in current task stack
The operation interface of interface then judges whether the control instruction is default enabled instruction, is referred to if it is, starting with the control
Make corresponding application program.
8. speech information processing apparatus, which is characterized in that including：
For receiving voice messaging, the voice messaging is identified the corresponding control instruction of generation in sound identification module；
Control determining module, for detecting with the presence or absence of the operation interface for realizing preset instructions interface in current task stack, if
In the presence of then determining corresponding control object according to the control instruction；
Control processing module responds the control instruction for triggering the corresponding action event of the control object.
9. a kind of terminal device, including：Processor, memory and storage are on a memory and the meter that can run on a processor
Calculation machine program, which is characterized in that the processor is realized when performing the computer program such as any one of claim 1-7 institutes
The voice information processing method stated.
A kind of 10. storage medium for including terminal device executable instruction, which is characterized in that the terminal device executable instruction
Voice information processing method when being performed as terminal device processor for execution as any one of claim 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711340651.5A CN108108142A (en) | 2017-12-14 | 2017-12-14 | Voice information processing method, device, terminal device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711340651.5A CN108108142A (en) | 2017-12-14 | 2017-12-14 | Voice information processing method, device, terminal device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108108142A true CN108108142A (en) | 2018-06-01 |
Family
ID=62216963
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711340651.5A Pending CN108108142A (en) | 2017-12-14 | 2017-12-14 | Voice information processing method, device, terminal device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108108142A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108899025A (en) * | 2018-07-24 | 2018-11-27 | 中国联合网络通信集团有限公司 | Terminal equipment control method, equipment and storage medium |
| CN108958844A (en) * | 2018-07-13 | 2018-12-07 | 京东方科技集团股份有限公司 | A kind of control method and terminal of application program |
| CN109031965A (en) * | 2018-07-19 | 2018-12-18 | 珠海格力电器股份有限公司 | Intelligent device control method, device and computer-storable medium |
| CN109697098A (en) * | 2018-12-24 | 2019-04-30 | 南京国电南自电网自动化有限公司 | A kind of protective relaying device man-machine interface intelligent configuration method |
| CN110060672A (en) * | 2019-03-08 | 2019-07-26 | 华为技术有限公司 | A kind of sound control method and electronic equipment |
| CN111292742A (en) * | 2020-01-14 | 2020-06-16 | 京东数字科技控股有限公司 | Data processing method and device, electronic equipment and computer storage medium |
| CN111475216A (en) * | 2020-04-15 | 2020-07-31 | 湖北亿咖通科技有限公司 | Voice control method of APP, computer storage medium and electronic device |
| CN111966931A (en) * | 2020-08-23 | 2020-11-20 | 云知声智能科技股份有限公司 | Rendering method and device of control |
| CN112201230A (en) * | 2019-07-08 | 2021-01-08 | 安徽华米信息科技有限公司 | Voice response method, device, equipment and storage medium |
| CN112286487A (en) * | 2020-12-30 | 2021-01-29 | 智道网联科技(北京)有限公司 | Voice guidance operation method and device, electronic equipment and storage medium |
| CN112581957A (en) * | 2020-12-04 | 2021-03-30 | 浪潮电子信息产业股份有限公司 | Computer voice control method, system and related device |
| CN112887805A (en) * | 2021-01-12 | 2021-06-01 | 南京创维信息技术研究院有限公司 | Voice function prompting method, device, equipment and medium |
| WO2021204098A1 (en) * | 2020-04-09 | 2021-10-14 | 华为技术有限公司 | Voice interaction method and electronic device |
| CN113643697A (en) * | 2020-04-23 | 2021-11-12 | 百度在线网络技术（北京）有限公司 | Voice control method and device, electronic equipment and storage medium |
| CN113741769A (en) * | 2020-05-29 | 2021-12-03 | 比亚迪股份有限公司 | Control method and system based on image recognition, vehicle and storage medium |
| CN113900621A (en) * | 2021-11-09 | 2022-01-07 | 杭州逗酷软件科技有限公司 | Operation instruction processing method, control method, device and electronic equipment |
| WO2023040692A1 (en) * | 2021-09-14 | 2023-03-23 | 北京车和家信息技术有限公司 | Speech control method, apparatus and device, and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593230A (en) * | 2012-08-13 | 2014-02-19 | 百度在线网络技术（北京）有限公司 | Background task control method of mobile terminal and mobile terminal |
| US20150133109A1 (en) * | 2007-04-03 | 2015-05-14 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN106484270A (en) * | 2016-09-12 | 2017-03-08 | 深圳市金立通信设备有限公司 | A kind of voice operating event adding method and terminal |
-
2017
- 2017-12-14 CN CN201711340651.5A patent/CN108108142A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150133109A1 (en) * | 2007-04-03 | 2015-05-14 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
| CN103593230A (en) * | 2012-08-13 | 2014-02-19 | 百度在线网络技术（北京）有限公司 | Background task control method of mobile terminal and mobile terminal |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN106484270A (en) * | 2016-09-12 | 2017-03-08 | 深圳市金立通信设备有限公司 | A kind of voice operating event adding method and terminal |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108958844B (en) * | 2018-07-13 | 2021-09-03 | 京东方科技集团股份有限公司 | Application program control method and terminal |
| CN108958844A (en) * | 2018-07-13 | 2018-12-07 | 京东方科技集团股份有限公司 | A kind of control method and terminal of application program |
| CN109031965A (en) * | 2018-07-19 | 2018-12-18 | 珠海格力电器股份有限公司 | Intelligent device control method, device and computer-storable medium |
| CN108899025A (en) * | 2018-07-24 | 2018-11-27 | 中国联合网络通信集团有限公司 | Terminal equipment control method, equipment and storage medium |
| CN109697098A (en) * | 2018-12-24 | 2019-04-30 | 南京国电南自电网自动化有限公司 | A kind of protective relaying device man-machine interface intelligent configuration method |
| CN110060672A (en) * | 2019-03-08 | 2019-07-26 | 华为技术有限公司 | A kind of sound control method and electronic equipment |
| WO2020181988A1 (en) * | 2019-03-08 | 2020-09-17 | 华为技术有限公司 | Speech control method and electronic device |
| CN112201230A (en) * | 2019-07-08 | 2021-01-08 | 安徽华米信息科技有限公司 | Voice response method, device, equipment and storage medium |
| CN111292742A (en) * | 2020-01-14 | 2020-06-16 | 京东数字科技控股有限公司 | Data processing method and device, electronic equipment and computer storage medium |
| WO2021204098A1 (en) * | 2020-04-09 | 2021-10-14 | 华为技术有限公司 | Voice interaction method and electronic device |
| CN111475216A (en) * | 2020-04-15 | 2020-07-31 | 湖北亿咖通科技有限公司 | Voice control method of APP, computer storage medium and electronic device |
| CN111475216B (en) * | 2020-04-15 | 2024-03-08 | 亿咖通(湖北)技术有限公司 | APP voice control method, computer storage medium and electronic equipment |
| CN113643697A (en) * | 2020-04-23 | 2021-11-12 | 百度在线网络技术（北京）有限公司 | Voice control method and device, electronic equipment and storage medium |
| CN113741769A (en) * | 2020-05-29 | 2021-12-03 | 比亚迪股份有限公司 | Control method and system based on image recognition, vehicle and storage medium |
| CN111966931A (en) * | 2020-08-23 | 2020-11-20 | 云知声智能科技股份有限公司 | Rendering method and device of control |
| CN112581957A (en) * | 2020-12-04 | 2021-03-30 | 浪潮电子信息产业股份有限公司 | Computer voice control method, system and related device |
| CN112286487A (en) * | 2020-12-30 | 2021-01-29 | 智道网联科技(北京)有限公司 | Voice guidance operation method and device, electronic equipment and storage medium |
| CN112887805A (en) * | 2021-01-12 | 2021-06-01 | 南京创维信息技术研究院有限公司 | Voice function prompting method, device, equipment and medium |
| CN112887805B (en) * | 2021-01-12 | 2023-01-20 | 南京创维信息技术研究院有限公司 | Voice function prompting method, device, equipment and medium |
| WO2023040692A1 (en) * | 2021-09-14 | 2023-03-23 | 北京车和家信息技术有限公司 | Speech control method, apparatus and device, and medium |
| CN113900621A (en) * | 2021-11-09 | 2022-01-07 | 杭州逗酷软件科技有限公司 | Operation instruction processing method, control method, device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108108142A (en) | Voice information processing method, device, terminal device and storage medium | |
| US11443744B2 (en) | Electronic device and voice recognition control method of electronic device | |
| CN109656512A (en) | Exchange method, device, storage medium and terminal based on voice assistant | |
| EP3751503A1 (en) | Method for providing service by using chatbot and device therefor | |
| CN112201246B (en) | Intelligent control method and device based on voice, electronic equipment and storage medium | |
| US20060074658A1 (en) | Systems and methods for hands-free voice-activated devices | |
| EP3779968A1 (en) | Audio processing | |
| CN107370772A (en) | Account login method, device and computer-readable recording medium | |
| CN108320744A (en) | Method of speech processing and device, electronic equipment, computer readable storage medium | |
| CN107608853A (en) | Control method, device, storage medium and the intelligent terminal of terminal usage time | |
| CN109903758B (en) | Audio processing method and device and terminal equipment | |
| CN111696553B (en) | Voice processing method, device and readable medium | |
| CN108766438A (en) | Man-machine interaction method, device, storage medium and intelligent terminal | |
| KR20190009488A (en) | An electronic device and system for deciding a duration of receiving voice input based on context information | |
| CN108600559B (en) | Control method and device of mute mode, storage medium and electronic equipment | |
| CN112230877A (en) | Voice operation method and device, storage medium and electronic equipment | |
| KR102594838B1 (en) | Electronic device for performing task including call in response to user utterance and method for operation thereof | |
| CN111580773B (en) | Information processing method, device and storage medium | |
| CN109032554A (en) | A kind of audio-frequency processing method and electronic equipment | |
| CN108494970A (en) | Processing method, device, storage medium and the terminal of terminal's status information | |
| CN103677582A (en) | Method for controlling electronic device, and electronic device | |
| CN107707721A (en) | The way of recording, device, storage medium and the mobile terminal of mobile terminal | |
| CN111968680A (en) | Voice processing method, device and storage medium | |
| CN108089897A (en) | Startup management method, device, storage medium and the mobile terminal of application program | |
| CN111897916A (en) | Voice instruction recognition method and device, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180601 |
|
| RJ01 | Rejection of invention patent application after publication |