CN107240400A - Terminal operation method and device - Google Patents
Terminal operation method and device Download PDFInfo
- Publication number
- CN107240400A CN107240400A CN201710531194.1A CN201710531194A CN107240400A CN 107240400 A CN107240400 A CN 107240400A CN 201710531194 A CN201710531194 A CN 201710531194A CN 107240400 A CN107240400 A CN 107240400A
- Authority
- CN
- China
- Prior art keywords
- voice messaging
- terminal
- key message
- operational order
- application program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 239000000284 extract Substances 0.000 claims abstract description 14
- 230000006870 function Effects 0.000 claims description 63
- 238000001514 detection method Methods 0.000 claims description 32
- 238000000605 extraction Methods 0.000 claims description 21
- 230000006399 behavior Effects 0.000 claims description 2
- 238000013461 design Methods 0.000 abstract description 3
- 235000013305 food Nutrition 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 235000013410 fast food Nutrition 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012905 input function Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011022 operating instruction Methods 0.000 description 2
- 238000011017 operating method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004549 pulsed laser deposition Methods 0.000 description 1
- 235000011888 snacks Nutrition 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of terminal operation method and device, and terminal storage has the instruction set of at least one application program, and instruction set includes the relation of key message and operational order.Method includes：Detect the interface model residing for terminal；The first voice messaging of input is received when the interface model is without interface model, and extracts from the first voice messaging the first key message；According to preset rules destination application is determined from least one application program；Operational order corresponding with the first key message is searched from the instruction set of destination application, and the operation indicated by operational order is performed to destination application.By above-mentioned design, user can pass through voice operating terminal completely, it is not necessary to check terminal display interface, use extremely convenient.
Description
Technical field
The present invention relates to voice control technology field, in particular to a kind of terminal operation method and device.
Background technology
At present, voice technology is more and more ripe, and user can for example be called by voice operating application program, starts
Application program etc..However, existing voice operating method, needs user to check application interface frequently to determine in operation
The application program to be operated, the user for blind person or driven, is used very inconvenient.
The content of the invention
In view of this, it is an object of the invention to provide a kind of terminal operation method and device, to improve above mentioned problem.
In order to achieve the above object, the embodiment of the present invention provides a kind of terminal operation method, and the terminal storage has at least
The instruction set of one application program, the instruction set includes the relation of key message and operational order, and methods described includes：
Detect the interface model residing for the terminal；
In the case where the interface model is without interface model, the first voice messaging of input is received, and from described the
The first key message is extracted in one voice messaging；
According to preset rules destination application is determined from least one described application program；
Operational order corresponding with first key message is searched from the instruction set of the destination application, and it is right
The destination application performs the operation indicated by the operational order.
The embodiment of the present invention also provides a kind of terminal operation device, and the terminal storage has the finger of at least one application program
Order collection, the instruction set includes the relation of key message and operational order, and the terminal operation device includes：
First detection module, for detecting the interface model residing for the terminal；
First extraction module, in the case where the interface model is without interface model, receiving the first language of input
Message ceases, and extracts the first key message from first voice messaging；
Determining module, for determining destination application from least one described application program according to preset rules；
First operation module, for being searched and first key message pair from the instruction set of the destination application
The operational order answered, and the operation indicated by the operational order is performed to the destination application.
Terminal operation method provided in an embodiment of the present invention and device, terminal storage have the instruction of at least one application program
Collection, instruction set includes the relation of key message and operational order.Terminal is receiving input in the case of without interface model
First voice messaging, and extract from the first voice messaging the first key message.Terminal according to preset rules this at least one
Destination application is determined in individual application program, is searched from the instruction set of destination application corresponding with the first key message
Operational order, and the operation indicated by the operational order is performed to destination application.By above-mentioned design, user is when needed
Interface can need not be checked, extremely convenient can be used directly by voice operating application program.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be attached to what is used required in embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore is not construed as pair
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 is a kind of block diagram of terminal provided in an embodiment of the present invention.
Fig. 2 is a kind of schematic flow sheet of terminal operation method provided in an embodiment of the present invention.
Fig. 3 is the another schematic flow sheet of terminal operation method provided in an embodiment of the present invention.
Fig. 4 is a kind of functional block diagram of terminal operation device provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.The present invention implementation being generally described and illustrated herein in the accompanying drawings
The component of example can be arranged and designed with a variety of configurations.
Therefore, the detailed description of embodiments of the invention below to providing in the accompanying drawings is not intended to limit claimed
The scope of the present invention, but be merely representative of the present invention selected embodiment.Based on the embodiment in the present invention, this area is common
The every other embodiment that technical staff is obtained under the premise of creative work is not made, belongs to the model that the present invention is protected
Enclose.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it further need not be defined and explained in subsequent accompanying drawing.
As shown in figure 1, being a kind of block diagram of terminal 100 provided in an embodiment of the present invention, the embodiment of the present invention is carried
The terminal operation method and device of confession can be used for operation terminal 100.Terminal 100 can be intelligent terminal (e.g., mobile phone, notebook
Computer etc.), or server, the present embodiment is not restricted to this.Terminal 100 includes terminal operation device 110, memory
120th, processor 130 and detection unit 140.
Memory 120, processor 130 and each element of detection unit 140 connect or are electrically connected with indirectly each other, with
Realize the transmission or interaction of data.For example, these elements each other can be real by one or more communication bus or signal wire
Now it is electrically connected with.Terminal operation device 110, which includes at least one, to be stored in storage with software or firmware (firmware) form
In device 120 or the software function module that is solidificated in the operating system of terminal 100 (operating system, OS).Memory
In 120, in addition to the corresponding software function module of terminal operation device 110, be also stored with least one application program (App),
And the instruction set of at least one application program, relation of the instruction set including operational order and operational order and key message.
Wherein, memory 120 may be, but not limited to, random access memory (Random Access Memory,
RAM), read-only storage (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only
Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM),
Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc..
Processor 130 can be a kind of IC chip, the disposal ability with signal.Above-mentioned processor can be general procedure
Device, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor,
NP) etc.；Can also be digital signal processor (DSP)), application specific integrated circuit (ASIC), field programmable gate array (FPGA)
Or other PLDs, discrete gate or transistor logic, discrete hardware components.It can realize or perform
Disclosed each method, step and logic diagram in the embodiment of the present invention.General processor can be microprocessor or this at
It can also be any conventional processor etc. to manage device.
Detection unit 140 can be audio sensor, for detect terminal 100 voice signal in the environment.
It should be appreciated that structure shown in Fig. 1 is only signal, terminal 100 can also include more more than shown in Fig. 1 or less
Component, or, with the configuration different from shown in Fig. 1.In addition, each component that includes of terminal 100 can with hardware, software or its
Combination is realized.
As shown in Fig. 2 being a kind of schematic flow sheet of terminal operation method provided in an embodiment of the present invention, the terminal operation
Method can be applied to be stored with the terminal 100 shown in Fig. 1, terminal 100 instruction set of at least one application program, the instruction set
Relation including key message and operational order.The idiographic flow shown in Fig. 2 will be elaborated below.
S101, the interface model residing for detection terminal 100.
In the present embodiment, the interface model of terminal 100 is included without interface model and other interface models, wherein, it is unbounded
Surface model refers to that user need not check and operate the pattern of display interface.During implementation, the interface mould residing for the detection of terminal 100 oneself
Formula.
S102, interface model be without interface model in the case of, receive input the first voice messaging, and from this first
The first key message is extracted in voice messaging.
In the present embodiment, terminal 100 is in the case where detecting the interface model residing for oneself for without interface model,
Start to receive the first voice messaging that user inputs.If that is, terminal 100 is not at no interface model, even if user inputs language
Sound, terminal 100 will not also be received.In this way, the electricity of terminal 100 can be saved.
It should be noted that " interface model is without interface model " can include switching to no interface from other interface models
The situation of pattern.Such as, it is assumed that user just in terminal 100 it is a certain take out application program application interface operated, if with
Terminal 100 is switched to no interface model by family, then terminal 100 starts to receive the voice of user's input, that is, first in S101
Voice messaging.
Alternatively, in the present embodiment, the mode for the interface model of terminal 100 being switched into no interface model can have many
Kind, for example, a function button can be set in terminal 100, when user clicks on the function button, terminal 100 is automatically switched to
Without interface model.Wherein, the function button can be software button or hardware button.
And for example, a monitoring modular can be pre-set in terminal 100, for monitoring display interface of the user in terminal 100
Slide, when user carries out default slide (e.g., being slided according to " L " shape printed words) in display interface, terminal 100 is cut
Shift to no interface model.
And for example, in the voice operating instruction that terminal 100 is carried one can be set to open the operational order without interface model,
The operational order is corresponding with default voice messaging.During implementation, user can be entered with the voice input function of manually opened terminal 100
Row voice typing.When the voice that terminal 100 detects user's typing is default voice messaging, unlatching is called without interface model
Operational order is opened without interface model.
Alternatively, after the first voice messaging is received, terminal 100 extracts the first key message from the first voice messaging
Mode can have a variety of.
For example, multiple default key messages can be prestored in terminal 100.After the first voice messaging is received, eventually
End 100 can directly search at least one the default key whether included in first voice messaging in the plurality of default key message
Information, if including extracting at least one default key message as the first key message in first voice messaging.
And for example, terminal 100 can be torn open first voice messaging using participle technique after the first voice messaging is received
It is divided into multiple phonic signal characters, and calculates what is prestored in each phonic signal character and terminal 100 respectively based on external data base
Numerical value maximum is semantic similar in semantic similarity between multiple default key messages, and the semantic similarity that calculating is obtained
Corresponding default key message is spent as the first key message of first voice messaging.
In the present embodiment, the first key message extracted in the first voice messaging can also pass through many other existing sides
Method realizes that the present embodiment is without limitation.
Study and find through inventor, existing voice operating method needs user checks in terminal 100 which is provided with advance
A little application programs, and determine that voice operating could be carried out after the application program oneself to be operated.That is, existing voice operating side
Method can not completely disengage from display screen realization.For this people driven to blind person or, many inconvenience have been used.
Thus, after the first key message is extracted from the first voice messaging, terminal 100 understands at least one in storage
Destination application is determined in application program, that is, the first voice messaging application program to be operated.
S103, destination application is determined according to preset rules from least one application program.
Study and find through inventor, it is generally the case that when user is operating a certain application program of terminal 100, eventually
The display interface at end 100 can rest on a certain application interface of the application program.When user passes through voice messaging operation terminal 100
In application program when, although user may not necessarily check the display interface of terminal 100, but in fact, display circle of terminal 100
Face can be also rested on the application interface for the application program that user is operated by voice messaging.
In actual applications, if user is operating a certain application program in the case where there is interface model, switching is worked as
To without interface model, and input voice information is when being operated, and there is a strong possibility is exactly the user for the application program operated
The voice messaging of the input destination application to be operated.
Thus, as shown in figure 3, after terminal 100 extracts the first key message from the first voice messaging, the present invention is real
Step S105 can also be included by applying the terminal operation method of example offer.
S105, the interface that detection terminal 100 is presently in, and judge whether the interface being presently in is application program
Application interface.
In this situation, S103 may include S1031 and the sub-steps of S1032 two.
In this prior in the case of application interface of the residing interface for application program, S1031 can be performed.In this prior
In the case that residing interface is not the application interface of application program, S1032 can be performed.
S1031, it is destination application to determine the application program.
Wherein, in this prior in the case of the application interface of residing interface for application program, terminal 100 can search this
Whether include operational order corresponding with the first key message in the instruction set of application program, if including, it is determined that this applies journey
Sequence is destination application.
S1032, corresponding instruction set is searched based on the first key message, and by the corresponding application journey of the instruction set found
Sequence is used as destination application.
In the case that residing interface is not the application interface of application program in this prior, searched based on the first key message
Corresponding instruction set, can specifically be realized in the following way：
Terminal 100 is searched in the instruction set of storage includes the instruction set of operational order corresponding with the first key message.
If not finding, user's input error or prompting user is pointed out to re-enter voice messaging；If finding, judgement is found
Instruction set quantity；If finding an instruction set, the corresponding application program of the instruction set is regard as destination application；
If the quantity for the instruction set searched is more than 1, the title for the corresponding application program of each instruction set that speech play is found, user
Determine that an application program is used as destination application in the application program of speech play.
In actual applications, multiple application programs with similar functions may be installed so that the plurality of in terminal 100
There is corresponding key message identical operational order in the instruction set of application program.
For example, it is assumed that application program app1 and application program app2 is installed in terminal 100, also, application program
App1 and the corresponding instruction set of application program app2 include operational order corresponding with key message " take-away ".Thus, it is real
Shi Shi, the instruction set that terminal 100 is found according to key message " take-away " is 2.Now, terminal 100 can speech play find
Application program app1 and application program app2 title.User can determine that oneself wants operation according to the title of speech play
Application program, and in the title of default time span (e.g., 1 minute or 30 seconds) the interior phonetic entry application program.When with
Family inputs any of application program app1 and application program app2 title application program in the default time span
Title when, terminal 100 regard the application program corresponding to the title that user inputs as destination application.
S104, searches operational order corresponding with the first key message from the instruction set of destination application, and to mesh
Mark application program performs the operation indicated by the operational order.
In actual applications, it is understood that there may be can not be found from the instruction set of destination application and the first key message
The situation of corresponding operational order.For this situation, terminal 100 can voice message user input error or voice message user
Re-enter voice messaging.
Alternatively, in the present embodiment, when terminal 100 is in the case where interface model is without interface model, input is received
The first voice messaging, and after extracting from first voice messaging the first key message, user can be allowed to confirm extraction
Whether the first key message gone out is correct, in this way, the accuracy of Voice command can be improved.
Alternatively, after terminal 100 performs S102, terminal operation method provided in an embodiment of the present invention can also include
Tri- steps of S106, S107 and S108.
S106, generates voice messaging to be played, and play the voice messaging to be played based on the first key message.
In the present embodiment, it can also can be closed by the first key message directly as voice messaging to be played first
Presupposed information is added on the basis of key information and generates voice messaging to be played, for example, it is assumed that extracting " take-away " this first pass
Key information, terminal 100 can generate " you take out at main points " this voice messaging to be played and play out.
S107, detection plays whether receive the second voice messaging in first preset duration after the voice messaging to be played.
If not receiving the second voice messaging, S103 is performed.If receiving the second voice messaging, S108 is performed.
S108, extracts key message from the second voice messaging, and the key message based on extraction regenerate it is to be played
Voice messaging.
When implementing, if user determines that the voice messaging to be played is corresponding with the first voice messaging that oneself is inputted,
Any operation need not be performed.Thus, do not received in first preset duration after terminal 100 is playing the voice messaging to be played
During the second voice messaging, show that key message extracts correct, can further perform subsequent operation.
If user has found that the voice messaging to be played and the first voice messaging that oneself is inputted be not corresponding, it can re-enter
Voice messaging, that is, the second voice messaging.Terminal 100 can extract key message from the second voice messaging, and based on extraction
Key message regenerates voice messaging to be played, so that user is confirmed again.
It should be noted that the second voice messaging in the present embodiment is really that wrong feelings are extracted in the first key message
The first voice messaging re-entered under condition.
In the present embodiment, key message is extracted from the second voice messaging, it is crucial equivalent in step s 102 first
In the case that information extraction is wrong, after the first voice messaging in the second voice messaging replacement step S102 of input, again
Perform the step of extracting the first key message in step S102.
Alternatively, in the present embodiment, instruction set can also include the function choosing-item that each operational order is associated.In terminal
After 100 execution step S104, that is, after the operation that terminal 100 performs indicated by operational order to destination application,
Terminal operation method provided in an embodiment of the present invention can also include tri- steps of S109, S110 and S111.
S109, based on the operation indicated by the operational order, searches the function associated by the operational order in instruction set
Option, and the speech play function choosing-item that finds.
In the present embodiment, the operation indicated by each operational order performed for terminal 100, if the operational order is closed
Function choosing-item is associated with, then terminal 100 can be provided associated by the operational order after the operation indicated by the operational order is performed
Function choosing-item selects for user.Thus, terminal 100 can perform the behaviour indicated by the operational order to destination application
After work, the function choosing-item associated by the operational order is searched in instruction set.If not finding, show that terminal 100 is not provided
The function choosing-item for being available for user to select, it is not necessary to carry out speech play.If finding, the function choosing-item that speech play is found,
So that user selects.
The 3rd voice messaging whether is received in the second preset duration after S110, detection speech play, if receiving the 3rd
Voice messaging, then extract the second key message from the 3rd voice messaging.
In the present embodiment, the 3rd voice messaging refers to that user selects mesh in the function choosing-item of the speech play of terminal 100
Mark the voice messaging of function choosing-item.During implementation, for the function choosing-item of the speech play of terminal 100, if user is not default second
Made a choice in duration, that is, terminal 100 does not receive the 3rd voice messaging after speech play in the second preset duration, eventually
End 100 can select a default option to be used as objective function option in the function choosing-item found.
If user inputs the 3rd voice messaging in the second preset duration, terminal 100 receives the 3rd voice messaging, and
The objective function option selected by user is determined based on the 3rd voice messaging.
S111, objective function option is determined based on second key message in the function choosing-item found, and to really
Fixed objective function option performs the indicated operation of the second key message respective operations instruction.
In the present embodiment, the second key message and the function choosing-item associated by each operational order stored in terminal 100
Between exist in corresponding relation, terminal 100 and can record the corresponding relation.Wherein, operation corresponding with the second key message
Instruction can be the operation for choosing the function choosing-item corresponding to second key message.That is, when terminal 100 is based on the second key
Information determines after an objective function option that terminal 100 can call the operational order corresponding to second key message automatically, performs
Choose the operation of the objective function option.
For example, it is assumed that the shopping application program that is stored with terminal 100, is performed in 100 pairs of shopping application programs of terminal
In the case of operation indicated by operational order A1, shopping application program can provide following options for user selection：1st, footwear；2、
Clothes；3rd, food.That is, operational order A1 is with footwear, clothes and food, these three function choosing-items are associated.
If user inputs corresponding voice messaging 100 pairs of the terminal shopping application program is performed indicated by operational order A1
Operation, then, the operation execution after, terminal 100 based on operational order A1 found in instruction set footwear, clothes and
Three function choosing-items of food, and speech play three function choosing-items.Terminal 100 is after complete three function choosing-items of speech play
Whether detection user inputs the 3rd voice messaging in second preset duration, so that the second preset duration is 30 seconds as an example, if user 30
The 3rd voice messaging is not inputted in second, then a default option (e.g., clothes) can be selected in three function choosing-items as mesh
Mark function choosing-item.If user inputs the 3rd voice messaging for including " food " in 30 seconds, based on the 3rd voice messaging at this
Three function choosing-items determine the objective function option of " 2, food " selected by user.
It is determined that after the objective function option of " 2, food " selected by user, terminal 100 can call selections " 2, eat
The operational order of this option of thing ", performs the operation of selection " 2, food " this option.
In actual applications, some application programs may need user to input information in use, for example, loan should
User is needed to input credit information with program.
Alternatively, in this situation, when terminal 100 is based on the operation indicated by the operational order, looked into instruction set
Look for after the function choosing-item associated by the operational order, terminal operation method provided in an embodiment of the present invention can also include S112
And two steps of S113.
S112, if the function choosing-item is used to indicate typing credit information, the name of speech play each information to be logged
Claim, and after the title of each information is played, the voice messaging of typing input.
During implementation, terminal 100 often plays the title of an information, can open voice input function the 3rd it is default when
Long, user can input corresponding voice messaging in the 3rd preset duration.
S113, by the names associate of the voice messaging of the input of typing and speech play and storage.
Wherein, the names associate played before the voice messaging of the input of the typing of terminal 100 and typing and storage.
Terminal operation method provided in an embodiment of the present invention can be applied to multiple scenes, for example, it is assumed that being installed in terminal 100
There is a take-away application program.When user inputs the first voice messaging including " take-away ", terminal 100 can be from first voice
" take-away " this first key message is extracted in information, and the take-away application program is found according to first key message.
Terminal 100 controls the take-away application program to open, and opens based on first key message take-away circle of the take-away application program
Face, speech play takes out the take-away option that interface is provided, e.g., " type that you please be selected to order：1st, fast food；2nd, wheaten food；3rd, it is small
Eat ".
Whether the second preset duration (e.g., 3 seconds) interior user inputs the 3rd language after the completion of terminal 100 can detect speech play
Message ceases (that is, voice for choosing function choosing-item), if being not detected by, and can select the type of ordering of acquiescence.If detection
Arrive, then the type of ordering selected by user is determined based on the 3rd voice messaging detected.For example, it is assumed that user input " 1 " and/or
Snack food, terminal 100 can determine this objective function option of fast food, and call corresponding operating instruction perform choose fast food this
The operation of option.Terminal 100 can further provide for the function choosing-item included by fast food type based on the selection operation, with such
Push away, until user completes to order.
In another example, it is assumed that multiple loan application programs are installed, when user's input includes the first of " loan " in terminal 100
During voice messaging, terminal 100 extracts " loan " this first key message from first voice messaging, and in the instruction of storage
Concentrate to search and include the instruction set of operational order corresponding with " loan ".Journey is applied due to being provided with multiple loans in terminal 100
Sequence, that is, the instruction that terminal 100 is stored, which is concentrated with multiple instruction collection, includes operational order corresponding with " loan ", thus, terminal
100 can find multiple instruction collection.
Terminal 100, can be with the application journey corresponding to the plurality of instruction set of speech play after the plurality of instruction set is found
The title of sequence, and the one of application program of voice selecting inputted after speech play is complete based on user is used as intended application journey
Sequence is opened, and performs the operation indicated by operational order corresponding with " loan " to the destination application, should into the target
With the loan interface of program.
Terminal 100 can detect the loan interface whether instruction user typing information, if so, can then be indicated with speech play
The title of each information of typing, and the voice messaging that typing is inputted after the title of each information is played.In Input Process,
Terminal 100 is by the names associate played before the voice messaging of the input of typing and typing and storage.After the completion of typing, eventually
End 100 can control the destination application and carry out loan valuation etc. according to the voice messaging of typing.
As shown in figure 4, being a kind of terminal operation device 110 provided in an embodiment of the present invention, terminal operation device 110 is applied
In terminal 100 provided in an embodiment of the present invention.Alternatively, terminal operation device 100 can be the third-party application in terminal 100
Program, that is, the application program that can be downloaded and be arranged in terminal 100 from some specific servers.Terminal operation device
100 can also be the native applications program being solidificated in the operating system of terminal 100, can also be based on existing in terminal 100
Application program operation small routine.
In the present embodiment, terminal 100 is stored with the instruction set of at least one application program, and instruction set includes key message
With the relation of operational order.Terminal operation device 110 includes first detection module 111, the first extraction module 112, determining module
113 and first operation module 114.
Wherein, first detection module 111 is used to detect the interface model residing for terminal 100.
In the present embodiment, the description as described in first detection module 111 is specifically referred to the detailed of step S101 shown in Fig. 2
Thin description, that is, step S101 can be performed by first detection module 111.
First extraction module 112 is used to, in the case where the interface model of terminal 100 is without interface model, receive input
First voice messaging, and extract the first key message from first voice messaging.
In the present embodiment, the description as described in the first extraction module 112 is specifically referred to the detailed of step S102 shown in Fig. 2
Thin description, that is, step S102 can be performed by the first extraction module 112.
Determining module 113 is used to determine that target should from least one application program in terminal 100 according to preset rules
Use program.
In the present embodiment, the description as described in determining module 113 is specifically referred to the detailed of step S103 as shown in Fig. 2
Description, that is, step S103 can be performed by determining module 113.
First operation module 114 is used to search the first key message pair with extracting from the instruction set of destination application
The operational order answered, and the operation indicated by the operational order is performed to destination application.
In the present embodiment, the description as described in the first operation module 114 is specifically referred to step S104 as shown in Fig. 2
It is described in detail.That is, step S104 can be performed by the first operation module 114.
Alternatively, terminal operation device 110 can also include production module, the second detection module, the first trigger module with
And second trigger module.
Wherein, it is the situation without interface model in the interface model of terminal 100 that generation module, which is used in the first extraction module,
Under, receive the first voice messaging of input, and after extracting from first voice messaging the first key message, based on this first
Key message generates voice messaging to be played, and plays the voice messaging to be played.
In the present embodiment, the description as described in generation module specifically refers to the description to correlation step in the above.
Second detection module is used to detect to play whether connect in first preset duration after the voice messaging to be played to be played
Receive the second voice messaging.
In the present embodiment, the description as described in the second detection module specifically refers in the above and correlation step is retouched
State.
First trigger module is used in the case where not receiving the second voice messaging, and triggering determining module 113, which is performed, presses
The operation of destination application is determined from least one application program of terminal 100 according to preset rules.
In the present embodiment, correlation step is retouched during the description as described in the first trigger module is specifically referred to the above
State.
Second trigger module is used in the case where receiving the second voice messaging, extracts and closes from second voice messaging
Key information, and the key message based on extraction regenerates voice messaging to be played.
In the present embodiment, correlation step is retouched during the description as described in the second trigger module is specifically referred to the above
State.
Alternatively, the instruction set stored in terminal 100 also includes the function choosing-item that each operational order is associated.Terminal operation is filled
Searching modul, the 3rd detection module, the second extraction module and the second operation module can also be included by putting 110.
Wherein, searching modul is used to perform indicated by operational order the destination application in the first operation module
After operation, based on the operation indicated by the operational order, the operational order institute is searched in the instruction set of destination application
The function choosing-item of association, and the function choosing-item that speech play is found.
In the present embodiment, the description as described in searching modul specifically refers to retouching in detail to correlation step in the above
State.
3rd detection module is used to detect whether receive the 3rd voice messaging after speech play in the second preset duration.
In the present embodiment, correlation step is detailed during the description as described in the 3rd detection module is specifically referred to the above
Thin description.
Second extraction module is used in the case where receiving the 3rd voice messaging, and the is extracted from the 3rd voice messaging
Two key messages.
In the present embodiment, correlation step is detailed during the description as described in the second extraction module is specifically referred to the above
Thin description.
Second operation module is used to determine that objective function is selected in the function choosing-item found based on second key message
, and the indicated operation of the second key message respective operations instruction is performed to objective function option.
Alternatively, terminal operation device 110 can also include typing module and memory module.
Wherein, the function choosing-item that typing module is used to find in searching modul is used for the situation for indicating typing credit information
Under, the title of speech play each information to be logged, and after the title of each information is played, the voice letter of typing input
Breath.
In the present embodiment, correlation step retouches in detail during the description as described in typing module is specifically referred to the above
State.
Memory module is used for the names associate of the voice messaging of the input of typing and speech play and storage.
In the present embodiment, the description as described in memory module is specifically referred to retouches to the detailed of correlation step in the above
State.
Alternatively, terminal operation device 110 can also include the 4th detection module, and the 4th detection module is used to carry first
Modulus block receives the first voice messaging of input in the case where the interface model of terminal 100 is without interface model, and from this
Extracted in one voice messaging after the first key message, detect the interface that terminal 100 is presently in.
In the present embodiment, the description as described in the 4th detection module is specifically referred to the detailed of step S105 shown in Fig. 3
Description.That is, step S105 can be performed by the 4th detection module.
In the case where terminal operation device 100 includes the 4th detection module, determining module 113 can include first and determine
Submodule and the second determination sub-module.
Wherein, the first determination sub-module is used for situation of the interface residing in this prior for the application interface of application program
Under, it is destination application to determine the application program.
In the present embodiment, the description as described in the first determination sub-module is specifically referred to the detailed of step S1031 shown in Fig. 3
Thin description, that is, step S1031 can be performed by the first determination sub-module.
In the case that second determination sub-module is used for the application interface that interface residing in this prior is not application program, base
Corresponding instruction set is searched in the first key message of extraction, and the corresponding application program of the instruction set found is defined as mesh
Mark application program.
In the present embodiment, the description as described in the second determination sub-module is specifically referred to the detailed of step S1032 shown in Fig. 3
Thin description, that is, step S1032 can be performed by the second determination sub-module.
In summary, terminal operation method provided in an embodiment of the present invention and device, terminal 100 is stored with least one should
With the instruction set of program, instruction set includes the relation of key message and operational order.Terminal 100 is in the feelings without interface model
The first voice messaging of input is received under condition, and extracts from the first voice messaging the first key message.Terminal 100 is according to pre-
If rule determines destination application at least one application program, searched and the from the instruction set of destination application
The corresponding operational order of one key message, and the operation indicated by the operational order is performed to destination application.By above-mentioned
Design, user can need not check interface when needed, can be directly by voice operating application program, to blind person, driver etc. no
Just for the people for checking display interface, extremely convenient is used.
Embodiments of the invention are the foregoing is only, are not intended to limit the invention, for those skilled in the art
For member, the present invention can have various modifications and variations.Any modification within the spirit and principles of the invention, being made,
Equivalent substitution, improvement etc., should be included in the scope of the protection.
Claims (10)
1. a kind of terminal operation method, it is characterised in that the terminal storage has the instruction set of at least one application program, described
Instruction set includes the relation of key message and operational order, and methods described includes：
Detect the interface model residing for the terminal；
In the case where the interface model is without interface model, the first voice messaging of input is received, and from first language
The first key message is extracted in message breath；
According to preset rules destination application is determined from least one described application program；
Operational order corresponding with first key message is searched from the instruction set of the destination application, and to described
Destination application performs the operation indicated by the operational order.
2. according to the method described in claim 1, it is characterised in that described is the situation without interface model in the interface model
Under, the first voice messaging of input is received, and after extracting from first voice messaging the first key message, methods described
Also include：
Voice messaging to be played is generated based on first key message, and plays the voice messaging to be played；
Detection plays whether receive the second voice messaging in first preset duration after the voice messaging to be played；
If not receiving the second voice messaging, determined described in execution according to preset rules from least one described application program
The operation of destination application；
If receiving the second voice messaging, key message, and the key based on extraction are extracted from second voice messaging
Information regenerates voice messaging to be played.
3. method according to claim 1 or 2, it is characterised in that the instruction set also includes what each operational order was associated
Function choosing-item, after the operation performed to the destination application indicated by the operational order, methods described is also wrapped
Include：
Based on the operation indicated by the operational order, the function choosing associated by the operational order is searched in the instruction set
, and function choosing-item described in speech play；
After detection speech play the 3rd voice messaging whether is received in the second preset duration；
If receiving the 3rd voice messaging, the second key message is extracted from the 3rd voice messaging；
Objective function option is determined in the function choosing-item based on second key message, and to the objective function option
Perform the indicated operation of the second key message respective operations instruction.
4. method according to claim 3, it is characterised in that the behaviour based on indicated by the operation operational order
Make, searched in the instruction set after the function choosing-item associated by the operational order, methods described also includes：
If the function choosing-item is used to indicate typing credit information, the title of speech play each information to be logged, and
After the title for playing each information, the voice messaging of typing input；
By the voice messaging of the input of typing and the names associate of speech play and storage.
5. method according to claim 1 or 2, it is characterised in that described is without interface model in the interface model
In the case of, the first voice messaging of input is received, and after extracting from first voice messaging the first key message, it is described
Method also includes：
Detect the interface that the terminal is presently in；
It is described to determine destination application from least one described application program according to preset rules, including：
In the case of application interface of the interface being presently in for application program, determine that the application program should for target
Use program；
In the case of not being the application interface of application program at the interface being presently in, looked into based on first key message
Corresponding instruction set is looked for, and the corresponding application program of the instruction set is defined as destination application.
6. a kind of terminal operation device, it is characterised in that the terminal storage has the instruction set of at least one application program, described
Instruction set includes the relation of key message and operational order, and the terminal operation device includes：
First detection module, for detecting the interface model residing for the terminal；
First extraction module, the first voice letter in the case where the interface model is without interface model, receiving input
Breath, and extract the first key message from first voice messaging；
Determining module, for determining destination application from least one described application program according to preset rules；
First operation module, it is corresponding with first key message for being searched from the instruction set of the destination application
Operational order, and the operation indicated by the operational order is performed to the destination application.
7. device according to claim 6, it is characterised in that the terminal operation device also includes：
Generation module, for, in the case where the interface model is without interface model, being received defeated in first extraction module
The first voice messaging entered, and after extracting from first voice messaging the first key message, it is crucial based on described first
Information generates voice messaging to be played, and plays the voice messaging to be played；
Second detection module, for detecting play whether receive second in first preset duration after the voice messaging to be played
Voice messaging；
First trigger module, it is described in the case where not receiving the second voice messaging, triggering the determining module execution
The operation of destination application is determined from least one described application program according to preset rules；
Second trigger module, in the case where receiving the second voice messaging, extracting and closing from second voice messaging
Key information, and the key message based on extraction regenerates voice messaging to be played.
8. the device according to claim 6 or 7, it is characterised in that the instruction set also includes what each operational order was associated
Function choosing-item, the terminal operation device also includes：
Searching modul, for being performed in first operation module to the destination application indicated by the operational order
After operation, based on the operation indicated by the operational order, searched in the instruction set associated by the operational order
Function choosing-item, and function choosing-item described in speech play；
3rd detection module, for detecting whether receive the 3rd voice messaging after speech play in the second preset duration；
Second extraction module, in the case where receiving the 3rd voice messaging, extracting from the 3rd voice messaging
Two key messages；
Second operation module, for determining objective function option in the function choosing-item based on second key message, and
The indicated operation of the second key message respective operations instruction is performed to the objective function option.
9. device according to claim 8, it is characterised in that the terminal operation device also includes：
Typing module, in the case of being used to indicate typing credit information in the function choosing-item that the searching modul is found,
The title of speech play each information to be logged, and after the title of each information is played, the voice messaging of typing input；
Memory module, for by the voice messaging of the input of typing and the names associate of speech play and storage.
10. the device according to claim 6 or 7, it is characterised in that the terminal operation device also includes：
4th detection module, for, in the case where the interface model is without interface model, being connect in first extraction module
The first voice messaging of input is received, and after extracting from first voice messaging the first key message, detects the terminal
The interface being presently in；
The determining module includes：
First determination sub-module, in the case of being the application interface of application program at the interface being presently in, it is determined that
The application program is destination application；
Second determination sub-module, in the case of not being the application interface of application program at the interface being presently in, base
Corresponding instruction set is searched in first key message, and the corresponding application program of the instruction set is defined as intended application
Program.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710531194.1A CN107240400B (en) | 2017-07-03 | 2017-07-03 | Terminal operation method and device |
| PCT/CN2018/089395 WO2019007169A1 (en) | 2017-07-03 | 2018-05-31 | Method and apparatus for operating terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710531194.1A CN107240400B (en) | 2017-07-03 | 2017-07-03 | Terminal operation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107240400A true CN107240400A (en) | 2017-10-10 |
| CN107240400B CN107240400B (en) | 2020-08-11 |
Family
ID=59990260
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710531194.1A Active CN107240400B (en) | 2017-07-03 | 2017-07-03 | Terminal operation method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107240400B (en) |
| WO (1) | WO2019007169A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107783705A (en) * | 2017-10-20 | 2018-03-09 | 珠海市魅族科技有限公司 | Show method, apparatus, computer installation and the storage medium of application program |
| CN108364645A (en) * | 2018-02-08 | 2018-08-03 | 北京奇安信科技有限公司 | A kind of method and device for realizing page interaction based on phonetic order |
| CN109086028A (en) * | 2018-07-27 | 2018-12-25 | 重庆柚瓣家科技有限公司 | Voice UI and its implementation |
| WO2019007169A1 (en) * | 2017-07-03 | 2019-01-10 | 重庆小雨点小额贷款有限公司 | Method and apparatus for operating terminal |
| CN109346072A (en) * | 2018-09-27 | 2019-02-15 | 珠海格力电器股份有限公司 | Voice interaction method, electronic equipment and computer storage medium |
| CN109725961A (en) * | 2017-10-31 | 2019-05-07 | 百度（美国）有限责任公司 | The system and method that execution task is inputted based on user using natural language processing |
| CN109840119A (en) * | 2018-12-28 | 2019-06-04 | 努比亚技术有限公司 | A kind of terminal applies starting method, terminal and computer readable storage medium |
| CN110580904A (en) * | 2019-09-29 | 2019-12-17 | 百度在线网络技术（北京）有限公司 | Method and device for controlling small program through voice, electronic equipment and storage medium |
| CN110851108A (en) * | 2019-11-18 | 2020-02-28 | 北京小米移动软件有限公司 | Electronic equipment operation method and device, electronic equipment and storage medium |
| CN112519639A (en) * | 2020-12-10 | 2021-03-19 | 广州橙行智动汽车科技有限公司 | Vehicle control method, system, device, vehicle and storage medium |
| CN113190323A (en) * | 2021-06-02 | 2021-07-30 | 口碑(上海)信息技术有限公司 | Information playing method and device, electronic equipment and storage medium |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110162776A (en) * | 2019-03-26 | 2019-08-23 | 腾讯科技（深圳）有限公司 | Interaction message processing method, device, computer equipment and storage medium |
| CN111026355A (en) * | 2019-12-09 | 2020-04-17 | 珠海市魅族科技有限公司 | Information interaction method and device, computer equipment and computer readable storage medium |
| CN113190697A (en) * | 2021-06-02 | 2021-07-30 | 口碑(上海)信息技术有限公司 | Image information playing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1897108A (en) * | 2005-07-15 | 2007-01-17 | 环隆电气股份有限公司 | Motor acoustic-controlled method with limited condition as assistant discrimination and system thereof |
| CN102520788A (en) * | 2011-11-16 | 2012-06-27 | 歌尔声学股份有限公司 | Voice identification control method |
| CN103533391A (en) * | 2013-10-12 | 2014-01-22 | 青岛旲天下智能科技有限公司 | Two-way interaction digital television box system with acoustic control type interaction and implementation method |
| CN105551487A (en) * | 2015-12-07 | 2016-05-04 | 北京云知声信息技术有限公司 | Voice control method and apparatus |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002077790A2 (en) * | 2001-03-22 | 2002-10-03 | Canon Kabushiki Kaisha | Information processing apparatus and method, and program |
| KR101502003B1 (en) * | 2008-07-08 | 2015-03-12 | 엘지전자 주식회사 | Mobile terminal and method for inputting a text thereof |
| CN107240400B (en) * | 2017-07-03 | 2020-08-11 | 重庆小雨点小额贷款有限公司 | Terminal operation method and device |
-
2017
- 2017-07-03 CN CN201710531194.1A patent/CN107240400B/en active Active
-
2018
- 2018-05-31 WO PCT/CN2018/089395 patent/WO2019007169A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1897108A (en) * | 2005-07-15 | 2007-01-17 | 环隆电气股份有限公司 | Motor acoustic-controlled method with limited condition as assistant discrimination and system thereof |
| CN102520788A (en) * | 2011-11-16 | 2012-06-27 | 歌尔声学股份有限公司 | Voice identification control method |
| CN103533391A (en) * | 2013-10-12 | 2014-01-22 | 青岛旲天下智能科技有限公司 | Two-way interaction digital television box system with acoustic control type interaction and implementation method |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN105551487A (en) * | 2015-12-07 | 2016-05-04 | 北京云知声信息技术有限公司 | Voice control method and apparatus |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019007169A1 (en) * | 2017-07-03 | 2019-01-10 | 重庆小雨点小额贷款有限公司 | Method and apparatus for operating terminal |
| CN107783705A (en) * | 2017-10-20 | 2018-03-09 | 珠海市魅族科技有限公司 | Show method, apparatus, computer installation and the storage medium of application program |
| CN109725961A (en) * | 2017-10-31 | 2019-05-07 | 百度（美国）有限责任公司 | The system and method that execution task is inputted based on user using natural language processing |
| CN108364645A (en) * | 2018-02-08 | 2018-08-03 | 北京奇安信科技有限公司 | A kind of method and device for realizing page interaction based on phonetic order |
| CN109086028A (en) * | 2018-07-27 | 2018-12-25 | 重庆柚瓣家科技有限公司 | Voice UI and its implementation |
| CN109346072A (en) * | 2018-09-27 | 2019-02-15 | 珠海格力电器股份有限公司 | Voice interaction method, electronic equipment and computer storage medium |
| CN109840119A (en) * | 2018-12-28 | 2019-06-04 | 努比亚技术有限公司 | A kind of terminal applies starting method, terminal and computer readable storage medium |
| CN110580904A (en) * | 2019-09-29 | 2019-12-17 | 百度在线网络技术（北京）有限公司 | Method and device for controlling small program through voice, electronic equipment and storage medium |
| CN110851108A (en) * | 2019-11-18 | 2020-02-28 | 北京小米移动软件有限公司 | Electronic equipment operation method and device, electronic equipment and storage medium |
| CN112519639A (en) * | 2020-12-10 | 2021-03-19 | 广州橙行智动汽车科技有限公司 | Vehicle control method, system, device, vehicle and storage medium |
| CN113190323A (en) * | 2021-06-02 | 2021-07-30 | 口碑(上海)信息技术有限公司 | Information playing method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019007169A1 (en) | 2019-01-10 |
| CN107240400B (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107240400A (en) | Terminal operation method and device | |
| CN107357580B (en) | Method for guiding terminal user to open auxiliary function permission of application | |
| CN108108142A (en) | Voice information processing method, device, terminal device and storage medium | |
| US8995625B2 (en) | Unified interface and routing module for handling audio input | |
| CN108604152B (en) | Unread message prompting method and terminal | |
| CN111866270B (en) | Application program control method and device and electronic equipment | |
| EP1562179A1 (en) | Methods and apparatus for context and experience sensitive prompting in voice applications | |
| CN107608853A (en) | Control method, device, storage medium and the intelligent terminal of terminal usage time | |
| EP3352066B1 (en) | Method and apparatus for displaying function interface | |
| CN107370772A (en) | Account login method, device and computer-readable recording medium | |
| CN108604265A (en) | The method and terminal device of outline management application program usage time | |
| CN110152307A (en) | Virtual objects distribution method, device and storage medium | |
| US20080153546A1 (en) | Methods and apparatuses for sim application toolkit (sat) management | |
| CN104007890B (en) | The method and electronic equipment of information processing | |
| CN113826089A (en) | Contextual feedback with expiration indicators for natural understanding systems in chat robots | |
| EP3422228A1 (en) | Icon processing method and device for applications | |
| CN106940674A (en) | The triggering method and device of object event in a kind of mobile terminal | |
| CN108664392B (en) | A kind of application testing method, device, terminal and storage medium | |
| CN113010248A (en) | Operation guiding method and device and electronic equipment | |
| CN106462698A (en) | Authority control method and authority control device | |
| CN105955507B (en) | A kind of display methods and terminal of soft keyboard | |
| CN109274825B (en) | Message reminding method and device | |
| EP2728472B1 (en) | User terminal, reliability management server, and method and program for preventing unauthorized remote operation | |
| CN107341000A (en) | A kind of method and device, terminal for showing fingerprint typing image | |
| CN108920214A (en) | A kind of application program operation method, application program running gear and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |