CN108845788A - Analog manipulation method and portable terminal - Google Patents
Analog manipulation method and portable terminal Download PDFInfo
- Publication number
- CN108845788A CN108845788A CN201810596582.2A CN201810596582A CN108845788A CN 108845788 A CN108845788 A CN 108845788A CN 201810596582 A CN201810596582 A CN 201810596582A CN 108845788 A CN108845788 A CN 108845788A
- Authority
- CN
- China
- Prior art keywords
- input
- user
- cover page
- target application
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Abstract
Disclose analog manipulation method and portable terminal.The analog manipulation method, including：Receive voice input from the user；It identifies the voice input, and obtains corresponding simulated operation class instruction；Based on described instruction, start target application；A cover page is generated, to cover at least partly display interface of the target application；And automatically carry out sequence of operations to realize described instruction.
Description
Technical field
The present invention relates to the technical fields of information processing, more specifically to the technology of virtual assistant and analog manipulation
Field.
Background technique
The mobile virtual assistant (Virtual assistants VAs) of acoustic control applies across technical crack and enters public city
, help user that the various functions such as short message are scanned for, made a phone call and sent by voice command.Analog manipulation is as virtual
A new class of operation mode of assistant, starts to show on recent intelligent mobile terminal.Its realization principle is based on Android
The accessible function that operating system provides, simulates the contact action of the page jumped with user, final form shows as user's
Operating process indicated by phonetic order.For example, if user desires to Xiao Ming and sends out five yuan of wechat red packet, it is general and
Speech, user need to be implemented click wechat icon with open wechat application, entry communication record find Xiao Ming, click Xiao Ming's head portrait enter
Then dialog box clicks red packet and inputs the sequence of operations such as the amount of money.However, user is only in the case where application simulation manipulation
Need to input the phonetic order of " sending out five yuan of wechat red packet to Xiao Ming ", so that it may automatically carry out above-mentioned sequence of operations and
It is participated in without user.That is, carrying out analog subscriber by analog manipulation with the instruction executed automatically and touching the behaviour for clicking and carrying out
Make.
However, the problem of Current implementations, is, in response to user phonetic order and a series of behaviour for executing automatically
The process of work can not be completed in VA application interaction, and generally there are jumping for the multiple page, such as jump to wechat from main interface and open
Arena face jumps to address list interface from wechat startup interface, and jumps to contact person's dialog box etc. from address list interface.Frequently
Numerous, quick but visual interactive interface variation, be easy to cause giddy feeling, seriously affects the interaction body of user
It tests.In addition, during analog manipulation, it is also possible to which exist causes to handle the case where terminating since user misses touch screen curtain.
Summary of the invention
In view of above situation, it is intended to provide a kind of new analog manipulation mode UI (User Interface) suitable for VA
Interactive mode optimizes the interactive experience of user to solve the complex process of multiple page jump.
According to an aspect of the invention, there is provided a kind of analog manipulation method, including：It is defeated to receive voice from the user
Enter；It identifies the voice input, and obtains corresponding simulated operation class instruction；Based on described instruction, start target application；It generates
One cover page, to cover at least partly display interface of the target application；And it automatically carries out to realize the finger
The sequence of operations of order.
According to another aspect of the present invention, a kind of portable terminal is provided, including：Speech input device, for receiving
Voice input from the user；Identification device, the voice input for identification, and obtain corresponding simulated operation class instruction；
Executive device, for being based on described instruction, starting target application and automatically carrying out a series of behaviour to realize described instruction
Make；And cover page generating means at least partly show boundary for generating a cover page with cover the target application
Face.
In analog manipulation method according to the present invention and portable terminal, answered by the way that cover page is covered the target
At least partly display interface can standardize, the interface UI of unitized simulated operation, when avoiding the occurrence of manipulation different application
The chaotic different situation of UI.In addition, showing interface by friendly stable UI, the process of analog manipulation is completed, can be avoided
Giddy sense of discomfort provides the user with more attractive visual experience.Further, it is possible to avoid user in simulated operating procedure
Accidentally processing caused by touch screen curtain terminates.In addition, by setting partially transparent for cover page or being shown on cover page
Show progress status and as a result, it is possible to make user during analog manipulation, recognize in real time the progress status actually executed and
As a result, avoiding whether user successfully blindly feels to the blindness sense of real-time status and to implementing result.
Detailed description of the invention
Fig. 1 is the flow chart for illustrating the process of analog manipulation method of first embodiment according to the present invention；
Fig. 2 is the flow chart for illustrating the process of analog manipulation method of second embodiment according to the present invention；
Fig. 3 is the flow chart for illustrating the process of analog manipulation method of third embodiment according to the present invention；
Fig. 4 is the functional block diagram for illustrating the configuration of portable terminal of first embodiment according to the present invention；
Fig. 5 is the functional block diagram for illustrating the configuration of portable terminal of second embodiment according to the present invention；And
Fig. 6 is the functional block diagram for illustrating the configuration of portable terminal of third embodiment according to the present invention.
Specific embodiment
Each preferred embodiment of the invention is described below with reference to accompanying drawings.It provides referring to the drawings
Description, to help the understanding to example embodiment of the invention as defined by appended claims and their equivalents.It includes side
The various details of assistant's solution, but they can only be counted as illustratively.Therefore, it would be recognized by those skilled in the art that
Embodiment described herein can be made various changes and modifications, without departing from scope and spirit of the present invention.Moreover, in order to
Keep specification more clear succinct, by omission pair it is well known that the detailed description of function and construction.
Firstly, the analog manipulation method that first embodiment according to the present invention will be described referring to Fig.1.As shown in Figure 1, simulation
Control method includes the following steps.
Firstly, receiving voice input from the user in step S101.
Then, it in step S102, identifies the voice input, and obtains corresponding simulated operation class instruction, for example, to small
The wechat red packet of bright five yuan of hair.
Next, being based on described instruction in step S103, start target application, such as wechat application.Certainly, user
The case where corresponding target application of voice input is also likely to be present more than one.
Then, in step S104, a cover page is generated, to cover at least partly display interface of the target application.
The cover page is the interface UI being covered on other application and interface, which becomes the visible interface of user.
During analog manipulation, it is shown in the cover page all-the-time stable top of other jump page.To,
By the analog manipulation method of first embodiment according to the present invention, the cover page of normalizable, unitized analog manipulation is kept away
The chaotic different situation in the interface UI when exempting to occur manipulation different application.By friendly stable cover page, simulation behaviour is completed
The process of control avoids giddy sense of discomfort, provides the user with more attractive visual experience.In addition, since user cannot lead to
It crosses and clicks cover page to operate covered other application and interface, therefore by the cover page, also can avoid user and exist
Processing caused by touch screen curtain is missed during analog manipulation to terminate.
Here, the cover page can be opaque, so as to by user with it is frequent, quick but visual
UI variation completely isolation open, avoid sense of discomfort.
Alternatively, alternatively, the cover page is also possible to partially transparent.This partially transparent cover page energy
It is enough greatly to alleviate giddy sense of discomfort, while user can also be intuitive to see the process of page jump, to understand
To the execution state and progress of analog manipulation process.
For example, cover page can be the screenshotss image at current operation interface.The purpose done so is, is avoiding vision
While sense of discomfort and user miss processing caused by touch screen curtain and terminate, additionally it is possible to allow a user knowledge of present day analog manipulate into
Journey.Certainly, if screenshotss frequency is higher, the visual discomfort sense of user be will increase, and can only realize the technology effect for avoiding accidentally touching
Fruit.Therefore, it is highly preferred that screenshotss set of frequency can be obtained it is lower, it is dazzled so as to avoid to a certain extent, simultaneously
Achieve the effect that user understands treatment progress and avoids maloperation.
For another example, cover page can only cover the input area on application interface, to avoid maloperation.
For another example, the different cover page of automatic adaptation can also be come based on currently performed different application.Also, works as and hold
Row is different in application, the also transparency of adjustable cover page.Alternatively, can also be shown on covering interface different
Image or text information or acoustic information.
Then, in step S105, the sequence of operations to realize described instruction is automatically carried out.
For example, in the case where analog manipulation corresponding with the phonetic order of user is related to the input of average information, it is described
Analog manipulation method will be it needs to be determined that intermediate input information.Therefore, a series of behaviour to realize described instruction are automatically carried out
The step S105 of work can further include：Obtain the input area in the target application；The language received described in analysis
Sound input, and whether judge wherein comprising input information.
When the input information in voice input comprising being input to corresponding input area, i.e., when user's input is " to small
When the instruction of the voice of the wechat red packet of bright five yuan of hair ", input information (five yuan) wherein included is extracted, and will extract
Input information input to corresponding input area, and execute subsequent operation.
On the other hand, when not including the input information for being input to corresponding input area in voice input, for example, working as
When the phonetic order of user's input " send out Xiao Ming wechat red packet ", export voice messaging, with prompt user's current process need into
Row intermediate input.For example, VA can prompt user to work as by TTS (Text To Speech) mode in cover page state
Preceding requirements of process intermediate input (please say the red packet amount of money).After TTS prompts user, start ASR (Automatic Speech automatically
Recognition it) to identify the intermediate input information (the red packet amount of money) of user's input, and is suitably shown on cover page
ASR state (recording state, real-time volume, speech detection state etc.).Then, after being executed based on the intermediate input information identified
Continuous operation.
After the completion of the sequence of operations, analog manipulation process terminates.Processing proceeds to step S106.In step
S106, the implementing result (success or failure) of analysis mode manipulation, and result information is showed into user in the right way.Example
Such as, the text information for indicating success or failure can be shown on cover page.Alternatively, can also be in a manner of audio-frequency information
Notify the implementing result of user's analog manipulation.Finally, after the delay of a predetermined amount of time, closing is covered in step S107
The lid page is restored to the normal interface UI.
Next, the analog manipulation method that second embodiment according to the present invention will be described referring to Fig. 2.As shown in Fig. 2, root
Include the following steps according to the analog manipulation method of second embodiment.
Similarly with first embodiment, firstly, in step S201, voice input from the user is received.
Then, it in step S202, identifies the voice input, and obtains corresponding simulated operation class instruction, for example, to small
The wechat red packet of bright five yuan of hair.
Next, being based on described instruction in step S203, start target application, such as wechat application.
Then, in step S204, a cover page is generated, to cover at least partly display interface of the target application.
Next, being different from the first embodiment ground, in step S205, the system to realize described instruction is automatically carried out
Column operation, while determining the real-time status of the sequence of operations, and by the real-time condition display on the cover page.
Therefore, in a second embodiment, other than it can reach the technical effect in first embodiment, additionally it is possible to more preferable
It is presented to the user when ground is by the progress status and fructufy that analog manipulation executes, so that user is during analog manipulation, it can
The progress status actually executed is recognized in real time and as a result, avoiding user to the blindness sense of real-time status and to implementing result
Whether successfully blindly feel.
Wherein, the real-time status includes at least following one：The target application information of current operation, current real-time operation
Progress, more wheel interaction intermediate input flow states and final operating result.
For example, the target application information of current operation can include but is not limited to application name, icon etc..Current real-time operation
Progress can include but is not limited to total operating procedure number, current operation step number, current operation step title or simple
Description, operation progress percentage etc..Interaction intermediate input flow states of taking turns can include but is not limited to required intermediate input more
Simple declaration and prompt (e.g., please say the red packet amount of money), automatic speech recognition (Automatic Speech Recognition,
ASR) state (e.g., recording state, real-time volume, speech detection state etc.), ASR result etc..Final operating result can be into
Function or failure.
After the completion of the sequence of operations, analog manipulation process terminates.Processing proceeds to step S106.In step
S106, the implementing result (success or failure) of analysis mode manipulation, and result information is showed into user in the right way.Example
Such as, the text information for indicating success or failure can be shown on cover page.Alternatively, can also be in a manner of audio-frequency information
Notify the implementing result of user's analog manipulation.Finally, after the delay of a predetermined amount of time, closing is covered in step S107
The lid page is restored to the normal interface UI.
The analog manipulation method of third embodiment according to the present invention is described next, with reference to Fig. 3.As shown in figure 3, described
Analog manipulation method includes the following steps.
Similarly with first embodiment, firstly, in step S301, voice input from the user is received.
Then, it in step S302, identifies the voice input, and obtains corresponding simulated operation class instruction, for example, to small
The wechat red packet of bright five yuan of hair.
Next, being based on described instruction in step S303, start target application, such as wechat application.Certainly, user
The case where corresponding target application of voice input is also likely to be present more than one.
Then, in step S304, a cover page is generated, to cover at least partly display interface of the target application.
The cover page is the interface UI being covered on other application and interface, which becomes the visible interface of user.
Different from the first embodiment next, judging whether to need being manually entered for user in step S305.Such as
Fruit is judged as YES in step S305, then processing proceeds to step S306.In step S306, the cover page is adjusted, so that
In the cover page, at least one input area at the exposure target application interface.Then, processing proceeds to step
S307.In step S307, the sequence of operations to realize described instruction is automatically carried out.If be judged as in step S306
It is no, then cover page is not adjusted, and processing is directly to step S307.
That is, in the third embodiment, can dig a hole on cover page to expose the application circle that it is covered down
The region that can be inputted in face, so as to when needing user to carry out conventional touch input during analog manipulation, energy
Enough inputted by the exposed region.
It is to be herein pointed out in Fig. 3, judge whether to need user the step of being manually entered as a single
The step of execution, shows before step S307.It alternatively, however, can also be during step S307 be executed, i.e.,：Automatic
During ground executes the sequence of operations, every prescribed time period executes the judgement being manually entered for whether needing user.
It is manually entered if necessary, then adjusts cover page, otherwise continue to execute the sequence of operations.
After the completion of the sequence of operations, analog manipulation process terminates.Processing proceeds to step S308.In step
S308, the implementing result (success or failure) of analysis mode manipulation, and result information is showed into user in the right way.Most
Afterwards, cover page is closed, the normal interface UI is restored to after the delay of a predetermined amount of time in step S309.
The portable terminal of first embodiment according to the present invention is described next, with reference to Fig. 4.As shown in figure 4, it is described just
Taking formula terminal 400 includes：Speech input device 401, identification device 402, executive device 403 and cover page generating means
404。
Speech input device 401 receives voice input from the user.For example, speech input device 401 is a microphone.
The voice input for identification of identification device 402, and corresponding simulated operation class instruction is obtained, for example, to small
The wechat red packet of bright five yuan of hair.
Executive device 403 is used to be based on described instruction, starts target application, such as wechat application.Certainly, the voice of user
The case where corresponding target application of input is also likely to be present more than one.Also, executive device 403 is also used to automatically carry out
To realize the sequence of operations of described instruction.
Cover page generating means 404 are for generating a cover page, to cover at least partly aobvious of the target application
Show interface.The cover page is the interface UI being covered on other application and interface, which becomes the visible of user
Interface.
During analog manipulation, it is shown in the cover page all-the-time stable top of other jump page.To,
By the portable terminal of first embodiment according to the present invention, the cover page of normalizable, unitized analog manipulation is avoided
The chaotic different situation in the interface UI when there is manipulation different application.By friendly stable cover page, analog manipulation is completed
Process, avoid giddy sense of discomfort, provide the user with more attractive visual experience.In addition, since user cannot pass through
Cover page is clicked to operate covered other application and interface, therefore by the cover page, also can avoid user in mould
Processing caused by touch screen curtain is missed during quasi- manipulation to terminate.
Here, the cover page can be opaque, so as to by user with it is frequent, quick but visual
UI variation completely isolation open, avoid sense of discomfort.
Alternatively, alternatively, the cover page is also possible to partially transparent.This partially transparent cover page energy
It is enough greatly to alleviate giddy sense of discomfort, while user can also be intuitive to see the process of page jump, to understand
To the execution state and progress of analog manipulation process.
For example, cover page can be the screenshotss image at current operation interface.The purpose done so is, is avoiding vision
While sense of discomfort and user miss processing caused by touch screen curtain and terminate, additionally it is possible to allow a user knowledge of present day analog manipulate into
Journey.Certainly, if screenshotss frequency is higher, the visual discomfort sense of user be will increase, and can only realize the technology effect for avoiding accidentally touching
Fruit.Therefore, it is highly preferred that screenshotss set of frequency can be obtained it is lower, it is dazzled so as to avoid to a certain extent, simultaneously
Achieve the effect that user understands treatment progress and avoids maloperation.
For another example, cover page can only cover the input area on application interface, to avoid maloperation.
For another example, the different cover page of automatic adaptation can also be come based on currently performed different application.Also, works as and hold
Row is different in application, the also transparency of adjustable cover page.Alternatively, can also be shown on covering interface different
Image or text information or acoustic information.
For example, in the case where analog manipulation corresponding with the phonetic order of user is related to the input of average information, it is described
Analog manipulation method will be it needs to be determined that intermediate input information.Therefore, executive device 403 can further include：Acquiring unit
4031, for obtaining the input area in the target application；Analytical unit 4032, it is defeated for analyzing the voice received
Enter, and whether judges wherein comprising input information.
When the input information in voice input comprising being input to corresponding input area, i.e., when user's input is " to small
When the instruction of the voice of the wechat red packet of bright five yuan of hair ", analytical unit 4032 extracts (five pieces of input information wherein included
Money).And the executive device 403 further comprises execution unit 4033, the input information input for will extract to pair
The input area answered, and execute subsequent operation.
On the other hand, when not including the input information for being input to corresponding input area in voice input, for example, working as
When the phonetic order of user's input " sending out wechat red packet to Xiao Ming ", the executive device further comprises：Prompt unit, for defeated
Voice messaging out, to prompt user's current process to need to carry out intermediate input.For example, VA can lead in cover page state
Crossing TTS (Text To Speech) mode prompts user's current process to need intermediate input (please say the red packet amount of money).It is prompted in TTS
After user, start ASR (Automatic Speech Recognition) automatically to identify the intermediate input information of user's input
(the red packet amount of money), and suitably ASR state (recording state, real-time volume, speech detection state etc.) is shown on cover page.
Then, subsequent operation is executed based on the intermediate input information identified.
After the completion of the sequence of operations, analog manipulation process terminates.Executive device 403 is configured to analyze
The implementing result (success or failure) of analog manipulation, and result information is showed into user in the right way.For example, can incite somebody to action
Indicate that the text information of success or failure is shown on cover page.Alternatively, can also notify user in a manner of audio-frequency information
The implementing result of analog manipulation.Also, executive device 403 is configured to after the delay of a predetermined amount of time,
Cover page is closed, the normal interface UI is restored to.
The portable terminal of second embodiment according to the present invention is described next, with reference to Fig. 5.As shown in figure 5, it is described just
Taking formula terminal 500 includes：Speech input device 501, identification device 502, executive device 503 and cover page generating means
504.Different from the first embodiment the portable terminal 500 further comprises：Monitoring device 505 and control device
505。
Speech input device 501 receives voice input from the user.For example, speech input device 501 is a microphone.
The voice input for identification of identification device 502, and corresponding simulated operation class instruction is obtained, for example, to small
The wechat red packet of bright five yuan of hair.
Executive device 503 is used to be based on described instruction, starts target application, such as wechat application.Certainly, the voice of user
The case where corresponding target application of input is also likely to be present more than one.Also, executive device 503 is also used to automatically carry out
To realize the sequence of operations of described instruction.
Cover page generating means 504 are for generating a cover page, to cover at least partly aobvious of the target application
Show interface.The cover page is the interface UI being covered on other application and interface, which becomes the visible of user
Interface.
Monitoring device 505 is used to determine the real-time status of the sequence of operations.
Control device 506 is used for the real-time condition display in the cover page.
Therefore, in a second embodiment, other than it can reach the technical effect in first embodiment, additionally it is possible to more preferable
It is presented to the user when ground is by the progress status and fructufy that analog manipulation executes, so that user is during analog manipulation, it can
The progress status actually executed is recognized in real time and as a result, avoiding user to the blindness sense of real-time status and to implementing result
Whether successfully blindly feel.
Wherein, the real-time status includes at least following one：The target application information of current operation, current real-time operation
Progress, more wheel interaction intermediate input flow states and final operating result.
For example, the target application information of current operation can include but is not limited to application name, icon etc..Current real-time operation
Progress can include but is not limited to total operating procedure number, current operation step number, current operation step title or simple
Description, operation progress percentage etc..Interaction intermediate input flow states of taking turns can include but is not limited to required intermediate input more
Simple declaration and prompt (e.g., please say the red packet amount of money), automatic speech recognition (Automatic Speech Recognition,
ASR) state (e.g., recording state, real-time volume, speech detection state etc.), ASR result etc..Final operating result can be into
Function or failure.
After the completion of the sequence of operations, analog manipulation process terminates.Executive device 503 is configured to analyze
The implementing result (success or failure) of analog manipulation, and result information is showed into user in the right way.For example, can incite somebody to action
Indicate that the text information of success or failure is shown on cover page.Alternatively, can also notify user in a manner of audio-frequency information
The implementing result of analog manipulation.Also, executive device 503 is configured to after the delay of a predetermined amount of time,
Cover page is closed, the normal interface UI is restored to.
Finally, the portable terminal that third embodiment according to the present invention will be described referring to Fig. 6.As shown in fig. 6, it is described just
Taking formula terminal 600 includes：Speech input device 601, identification device 602, executive device 603 and cover page generating means
604。
Speech input device 601 receives voice input from the user.For example, speech input device 601 is a microphone.
The voice input for identification of identification device 602, and corresponding simulated operation class instruction is obtained, for example, to small
The wechat red packet of bright five yuan of hair.
Executive device 603 is used to be based on described instruction, starts target application, such as wechat application.Certainly, the voice of user
The case where corresponding target application of input is also likely to be present more than one.Also, executive device 603 is also used to automatically carry out
To realize the sequence of operations of described instruction.
Cover page generating means 604 are for generating a cover page, to cover at least partly aobvious of the target application
Show interface.The cover page is the interface UI being covered on other application and interface, which becomes the visible of user
Interface.
In the third embodiment, cover page generating means 604 further comprise：Judging unit 6041, for judge be
It is no to need being manually entered for user；And adjustment unit 6042, for adjusting the covering when needing when being manually entered of user
The page, so that in the cover page, at least one input area at the exposure target application interface.
After the completion of the sequence of operations, analog manipulation process terminates.Executive device 603 is configured to analyze
The implementing result (success or failure) of analog manipulation, and result information is showed into user in the right way.For example, can incite somebody to action
Indicate that the text information of success or failure is shown on cover page.Alternatively, can also notify user in a manner of audio-frequency information
The implementing result of analog manipulation.Also, executive device 603 is configured to after the delay of a predetermined amount of time,
Cover page is closed, the normal interface UI is restored to.
Hereinbefore, it respectively refers to Fig. 1 to 6 and first embodiment according to the present invention is described in detail to 3rd embodiment
Analog manipulation method and portable terminal.It is pointed out here that although individually describing each embodiment above,
It will be understood to those skilled in the art that in practice, three above embodiment can be combined with each other.For example, implementing in third
In example, the sequence of operations can also be determined while automatically carrying out the sequence of operations to realize described instruction
Real-time status, and by the real-time condition display on the cover page.For another example, page is covered described in first embodiment
The various embodiments in face can also be equally applicable to second embodiment and 3rd embodiment.Certainly, those skilled in the art
Member it is conceivable that any other combinations of above embodiments should also be included within the scope of the invention.
In analog manipulation method according to the present invention and portable terminal, answered by the way that cover page is covered the target
At least partly display interface can standardize, the interface UI of unitized simulated operation, when avoiding the occurrence of manipulation different application
The chaotic different situation of UI.In addition, showing interface by friendly stable UI, the process of analog manipulation is completed, can be avoided
Giddy sense of discomfort provides the user with more attractive visual experience.Further, it is possible to avoid user in simulated operating procedure
Accidentally processing caused by touch screen curtain terminates.In addition, by setting partially transparent for cover page or being shown on cover page
Show progress status and as a result, it is possible to make user during analog manipulation, recognize in real time the progress status actually executed and
As a result, avoiding whether user successfully blindly feels to the blindness sense of real-time status and to implementing result.
It should be noted that in the present specification, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence " including ... ", it is not excluded that including
There is also other identical elements in the process, method, article or equipment of the element.
Finally, it is to be noted that, it is above-mentioned it is a series of processing not only include with sequence described here in temporal sequence
The processing of execution, and the processing including executing parallel or respectively rather than in chronological order.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can be by
Software adds the mode of required hardware platform to realize, naturally it is also possible to all be implemented by software.Based on this understanding,
Technical solution of the present invention can be embodied in the form of software products in whole or in part to what background technique contributed,
The computer software product can store in storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are to make
It obtains a computer equipment (can be personal computer, server or the network equipment etc.) and executes each embodiment of the present invention
Or method described in certain parts of embodiment.
The present invention is described in detail above, specific case used herein is to the principle of the present invention and embodiment party
Formula is expounded, and the above description of the embodiment is only used to help understand the method for the present invention and its core ideas；Meanwhile it is right
In those of ordinary skill in the art, according to the thought of the present invention, change is had in specific embodiments and applications
Place, in conclusion the contents of this specification are not to be construed as limiting the invention.
Claims (10)
1. a kind of analog manipulation method, including：
Receive voice input from the user；
It identifies the voice input, and obtains corresponding simulated operation class instruction；
Based on described instruction, start target application；
A cover page is generated, to cover at least partly display interface of the target application；And
Automatically carry out the sequence of operations to realize described instruction.
2. analog manipulation method according to claim 1, further comprises：
Determine the real-time status of the sequence of operations；And
By the real-time condition display on the cover page.
3. analog manipulation method according to claim 2, wherein the real-time status includes at least following one：
The target application information of current operation, current real-time operation progress, more wheel interaction intermediate input flow states and final behaviour
Make result.
4. a series of analog manipulation method according to claim 1, wherein automatically carrying out to realize the of described instruction
The step of operation further comprises：
Obtain the input area in the target application；
The voice input received described in analysis, and extract input information wherein included；And
By the input information input extracted to corresponding input area, and execute subsequent operation.
5. a series of analog manipulation method according to claim 4, wherein automatically carrying out to realize the of described instruction
The step of operation further comprises：
When not including the input information for being input to corresponding input area in voice input, voice messaging is exported, with prompt
User's current process needs to carry out intermediate input.
6. a kind of portable terminal, including：
Speech input device, for receiving voice input from the user；
Identification device, the voice input for identification, and obtain corresponding simulated operation class instruction；
Executive device, for being based on described instruction, starting target application and automatically carrying out the system to realize described instruction
Column operation；And
Cover page generating means, for generating a cover page, to cover at least partly display interface of the target application.
7. portable terminal according to claim 6, further comprises：
Monitoring device, for determining the real-time status of the sequence of operations；And
Control device is used for the real-time condition display in the cover page.
8. portable terminal according to claim 7, wherein the real-time status includes at least following one：
The target application information of current operation, current real-time operation progress, more wheel interaction intermediate input flow states and final behaviour
Make result.
9. portable terminal according to claim 6, wherein the executive device further comprises：
Acquiring unit, for obtaining the input area in the target application；
Analytical unit for analyzing the voice input received, and extracts input information wherein included；And
Execution unit, the input information input for will extract execute subsequent operation to corresponding input area.
10. portable terminal according to claim 9, wherein the executive device further comprises：
Prompt unit, for exporting language when not including the input information for being input to corresponding input area in voice input
Message breath, to prompt user's current process to need to carry out intermediate input.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810596582.2A CN108845788B (en) | 2018-06-11 | 2018-06-11 | Analog manipulation method and portable terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810596582.2A CN108845788B (en) | 2018-06-11 | 2018-06-11 | Analog manipulation method and portable terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108845788A true CN108845788A (en) | 2018-11-20 |
| CN108845788B CN108845788B (en) | 2021-09-14 |
Family
ID=64211561
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810596582.2A Active CN108845788B (en) | 2018-06-11 | 2018-06-11 | Analog manipulation method and portable terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108845788B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110837334A (en) * | 2019-11-04 | 2020-02-25 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for interactive control |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447041A (en) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Webpage processing method and device |
| CN105786395A (en) * | 2016-04-07 | 2016-07-20 | 广州华多网络科技有限公司 | Method, device and system for direct broadcasting room switching based on mobile terminal |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN106372251A (en) * | 2016-09-28 | 2017-02-01 | 北京京东尚科信息技术有限公司 | Method and device for returning to page display position |
| CN106777184A (en) * | 2016-12-22 | 2017-05-31 | 北京猎豹移动科技有限公司 | A kind of page loading method, device and electronic equipment |
| CN107102796A (en) * | 2017-04-20 | 2017-08-29 | 三星电子（中国）研发中心 | A kind of message treatment method and device |
| US20170316363A1 (en) * | 2016-04-28 | 2017-11-02 | Microsoft Technology Licensing, Llc | Tailored recommendations for a workflow development system |
| CN107657159A (en) * | 2017-08-31 | 2018-02-02 | 珠海市魅族科技有限公司 | A kind of method for secret protection and device, terminal and readable storage medium storing program for executing |
| CN107704233A (en) * | 2017-09-29 | 2018-02-16 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN107861857A (en) * | 2017-11-09 | 2018-03-30 | 上海触乐信息科技有限公司 | Screen virtual shade control method, device and terminal device in a kind of terminal device |
| US9965133B1 (en) * | 2011-07-22 | 2018-05-08 | Ntrepid Corporation | Application for assisting in conducting covert cyber operations |
| CN108022586A (en) * | 2017-11-30 | 2018-05-11 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling the page |
| CN108038150A (en) * | 2017-11-30 | 2018-05-15 | 广州市动景计算机科技有限公司 | Webpage deployment method, device and terminal device |
-
2018
- 2018-06-11 CN CN201810596582.2A patent/CN108845788B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9965133B1 (en) * | 2011-07-22 | 2018-05-08 | Ntrepid Corporation | Application for assisting in conducting covert cyber operations |
| CN105447041A (en) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Webpage processing method and device |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN105786395A (en) * | 2016-04-07 | 2016-07-20 | 广州华多网络科技有限公司 | Method, device and system for direct broadcasting room switching based on mobile terminal |
| US20170316363A1 (en) * | 2016-04-28 | 2017-11-02 | Microsoft Technology Licensing, Llc | Tailored recommendations for a workflow development system |
| CN106372251A (en) * | 2016-09-28 | 2017-02-01 | 北京京东尚科信息技术有限公司 | Method and device for returning to page display position |
| CN106777184A (en) * | 2016-12-22 | 2017-05-31 | 北京猎豹移动科技有限公司 | A kind of page loading method, device and electronic equipment |
| CN107102796A (en) * | 2017-04-20 | 2017-08-29 | 三星电子（中国）研发中心 | A kind of message treatment method and device |
| CN107657159A (en) * | 2017-08-31 | 2018-02-02 | 珠海市魅族科技有限公司 | A kind of method for secret protection and device, terminal and readable storage medium storing program for executing |
| CN107704233A (en) * | 2017-09-29 | 2018-02-16 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN107861857A (en) * | 2017-11-09 | 2018-03-30 | 上海触乐信息科技有限公司 | Screen virtual shade control method, device and terminal device in a kind of terminal device |
| CN108022586A (en) * | 2017-11-30 | 2018-05-11 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling the page |
| CN108038150A (en) * | 2017-11-30 | 2018-05-15 | 广州市动景计算机科技有限公司 | Webpage deployment method, device and terminal device |
Non-Patent Citations (2)
| Title |
|---|
| YUN MA等: "A Tale of Two Fashions: An Empirical Study on the Performance of Native Apps and Web Apps on Android", 《 IEEE TRANSACTIONS ON MOBILE COMPUTING》 * |
| 李岚: "关于图形用户界面自动化测试探讨", 《电子测试》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110837334A (en) * | 2019-11-04 | 2020-02-25 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for interactive control |
| CN110837334B (en) * | 2019-11-04 | 2022-03-22 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for interactive control |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108845788B (en) | 2021-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230386462A1 (en) | Reducing the need for manual start/end-pointing and trigger phrases | |
| CN100367185C (en) | Method and apparatus for providing permission voice input in electronic equipment with user interface | |
| CN108829235A (en) | Voice data processing method and the electronic equipment for supporting this method | |
| CA2441195C (en) | Voice response system | |
| KR20200012933A (en) | Shortened voice user interface for assistant applications | |
| JP2020535452A (en) | User programmable automatic assistant | |
| CN108735210A (en) | A kind of sound control method and terminal | |
| WO2001067228A1 (en) | Method of interacting with a consumer electronics system | |
| CN110476150A (en) | For operating the method for speech recognition service and supporting its electronic device | |
| CN110148399A (en) | A kind of control method of smart machine, device, equipment and medium | |
| CN107463247A (en) | A kind of method, apparatus and terminal of text reading processing | |
| US8005202B2 (en) | Automatic generation of a callflow statistics application for speech systems | |
| CN107168610B (en) | Popup window processing method and device, storage medium and electronic equipment | |
| CN109803050A (en) | A kind of full frame guidance click method suitable for operation by blind mobile phone | |
| CN108647002A (en) | Information processing method and electronic equipment | |
| CN106126161A (en) | Speech play control method, device and the mobile terminal of a kind of mobile terminal | |
| WO2020057255A1 (en) | Terminal interface recognition-based voice control method and system, and intelligent terminal | |
| CN108845788A (en) | Analog manipulation method and portable terminal | |
| CN108597499B (en) | Voice processing method and voice processing device | |
| CN107632813A (en) | A kind of method and device for closing alarm clock function | |
| CN109254821A (en) | Window Zoom method, device, terminal and computer readable storage medium | |
| CN108986796A (en) | A kind of voice search method and device | |
| CN108231074A (en) | A kind of data processing method, voice assistant equipment and computer readable storage medium | |
| CN107888776A (en) | Voice broadcast method and device, computer installation and computer-readable recording medium | |
| Longoria | Designing software for the mobile context: a practitioner’s guide |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |