CN108829371A - interface control method, device, storage medium and electronic equipment - Google Patents
interface control method, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN108829371A CN108829371A CN201810629387.5A CN201810629387A CN108829371A CN 108829371 A CN108829371 A CN 108829371A CN 201810629387 A CN201810629387 A CN 201810629387A CN 108829371 A CN108829371 A CN 108829371A
- Authority
- CN
- China
- Prior art keywords
- interface
- coordinate
- object element
- contact surface
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Abstract
This application discloses a kind of interface control method, device, storage medium and electronic equipments.This method includes：When being in the first interface, phonetic order is obtained from user；Determine that the operation to be completed of the phonetic order, the operation are the second contact surface for the object element for including into first interface；Obtain target position of the object element in first interface；Simulation click is carried out to the target position, to enter the second contact surface of the object element.The present embodiment can further improve the voice control function of terminal.
Description
Technical field
The application belongs to field of terminal technology more particularly to a kind of interface control method, device, storage medium and electronics are set
It is standby.
Background technique
With the continuous development of technology, the man-machine interaction mode between user and terminal is more and more abundant.For example, many whole
The application of voice assistant class is fitted on end.User can carry out interactive voice with terminal by the application of voice assistant class,
To which controlling terminal executes certain operation.However, in the related technology, in terminal achieved voice control function still compared with
It is limited.
Summary of the invention
The embodiment of the present application provides a kind of interface control method, device, storage medium and electronic equipment, can be further complete
Die a natural death the voice control function at end.
The embodiment of the present application provides a kind of interface control method, including：
When being in the first interface, phonetic order is obtained from user；
The operation to be completed of the phonetic order is determined, wherein including in operation entrance first interface
The second contact surface of object element；
Obtain target position of the object element in first interface；
Simulation click is carried out to the target position, to enter the second contact surface of the object element.
The embodiment of the present application provides a kind of interface control device, including：
First obtains module, for obtaining phonetic order from user when being in the first interface；
Determining module, the operation to be completed for determining the phonetic order, wherein the operation is enters described the
The second contact surface for the object element for including in one interface；
Second obtains module, for obtaining target position of the object element in first interface；
Operation module, for carrying out simulation click to the target position, to enter the second contact surface of the object element.
The embodiment of the present application provides a kind of storage medium, is stored thereon with computer program, when the computer program exists
When being executed on computer, so that the computer executes the step in interface control method provided by the embodiments of the present application.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute
The computer program stored in memory is stated, for executing the step in interface control method provided by the embodiments of the present application.
In the present embodiment, when being in the first interface, terminal that the available user of terminal issued be used to indicate enters the
The instruction at the interface of a certain object element in one interface.Then, terminal can determine the object element institute in the first interface
Target position, and simulation click is carried out to the target position, hence into the second contact surface for arriving the object element.Due to this
Embodiment can click the interface for entering a certain element for including in a certain interface come controlling terminal by phonetic order and simulation,
Therefore the present embodiment can further improve the voice control function of terminal.
Detailed description of the invention
With reference to the accompanying drawing, by the way that detailed description of specific embodiments of the present invention, technical solution of the present invention will be made
And its advantages are apparent.
Fig. 1 is the flow diagram of interface control method provided by the embodiments of the present application.
Fig. 2 is another flow diagram of interface control method provided by the embodiments of the present application.
Fig. 3 to Fig. 6 is the schematic diagram of a scenario of interface control method provided by the embodiments of the present application.
Fig. 7 is the structural schematic diagram of interface control device provided by the embodiments of the present application.
Fig. 8 is another structural schematic diagram of interface control device provided by the embodiments of the present application.
Fig. 9 is the structural schematic diagram of mobile terminal provided by the embodiments of the present application.
Figure 10 is another structural schematic diagram of mobile terminal provided by the embodiments of the present application.
Specific embodiment
Diagram is please referred to, wherein identical component symbol represents identical component, the principle of the present invention is to implement one
It is illustrated in computing environment appropriate.The following description be based on illustrated by the specific embodiment of the invention, should not be by
It is considered as the limitation present invention other specific embodiments not detailed herein.
It is understood that the executing subject of the embodiment of the present application can be the end of smart phone or tablet computer etc.
End equipment.
Referring to Fig. 1, Fig. 1 is the flow diagram of interface control method provided by the embodiments of the present application, process be can wrap
It includes：
In 101, when being in the first interface, phonetic order is obtained from user.
With the continuous development of technology, the man-machine interaction mode between user and terminal is more and more abundant.For example, many whole
The application of voice assistant class is fitted on end.User can carry out interactive voice with terminal by the application of voice assistant class,
To which controlling terminal executes certain operation.However, in the related technology, in terminal achieved voice control function still compared with
It is limited.For example, in the related technology, the application of voice assistant class is generally only user and opens a certain application, and cannot be introduced into
The interface of some functional modules inside to the application.To enter the interface of some functional modules inside the application, then
There is still a need for click the functional module manually just to can enter the interface of the functional module by user.
In the present embodiment, for example, when the first interface in application, user needs a certain function into the application
The interface of module, user can issue phonetic order at this time, then terminal can obtain the phonetic order from user.
In 102, the operation to be completed of phonetic order is determined, wherein the operation is the mesh for including into the first interface
Mark the second contact surface of element.
For example, terminal can determine the phonetic order behaviour to be completed after getting phonetic order at user
Make, wherein the operation is the interface (i.e. second contact surface) for a certain element (i.e. object element) for including into the first interface.
It should be noted that the element for including in interface refers to the functional module for allowing user to click in interface or functional areas
Domain.If user clicks a certain functional module or functional area manually, then terminal can enter the functional module or functional area
Interface.
For example, the home interface of instant messaging application A can be entered when opening instant messaging application A.For example,
It may include the functional module that " information ", " address list ", " I " etc. allow user to click in the bottom of the home interface.It is each
Functional module belongs to the element for including in home interface.In addition, such as current default it is selected be " information " functional module,
It is somebody's turn to do the chat window that may include user and good friend on the interface of " information " functional module.If user clicks the chat with certain good friend
Window, then terminal can enter the chat interface with the good friend.That is, can wrap in " information " functional module containing multiple chat windows
Mouthful, each chat window also belongs to the element for including in home interface.
In 103, target position of the object element in the first interface is obtained.
For example, being the second boundary that enter the object element for including in the first interface in the phonetic order for determining user
Behind face, position of the available object element of terminal in the first interface, i.e. target position.
In 104, simulation click is carried out to target position, to enter the second contact surface of object element.
For example, terminal can carry out simulation click to the target position after getting the target position of object element, from
And enter the second contact surface of object element.
It should be noted that simulation clicks the click action for referring to terminal simulation user to which triggering terminal completes the click
The corresponding operation of movement.For example, when user clicks " I " function mould of the home interface bottom of instant messaging application A manually
When block, terminal can enter the interface of " I " this functional module.So, it is exactly that user can be not required to manual point that simulation, which is clicked,
Hit " I " functional module, but determined by terminal " I " target position of this functional module on home interface, so
Triggering effect when user clicks the target position manually is gone out by terminal simulation afterwards, makes terminal automatically into " I " function mould
The interface of block.
It is understood that, when being in the first interface, what the available user of terminal issued is used to refer in the present embodiment
Show that terminal enters the instruction at the interface of a certain object element in the first interface.Then, terminal can be determined in the first interface
Target position where the object element, and simulation click is carried out to the target position, hence into the of the object element
Second interface.Enter certain for including in a certain interface since the present embodiment can be clicked by phonetic order and simulation come controlling terminal
The interface of one element, therefore the present embodiment can further improve the voice control function of terminal.
Referring to Fig. 2, Fig. 2 is another flow diagram of interface control method provided by the embodiments of the present application, process can
To include：
In 201, when being in the first interface, terminal obtains phonetic order from user.
For example, terminal passes through as shown in figure 3, user issues the phonetic order of " please open instant messaging application A " to terminal
After voice assistant receives the phonetic order, vocal print feature first can be extracted from the voice.Then, terminal can will be extracted
Vocal print feature be compared with the vocal print feature of preset owner.After determining that active user is owner, terminal can be opened
Open instant messaging application A.
After opening instant messaging application A, the interface of instant messaging application A can be entered.For example, as shown in figure 4, for eventually
Open the first interface after instant messaging application A in end.Later, such as since voice assistant can not obtain in instant messaging application A
Functional module application interface, cause user that can not enter back into a certain function mould of instant messaging application A by voice assistant
The corresponding interface of block.
In the present embodiment, it when user needs interface corresponding into a certain functional module of instant messaging application A, uses
Family can issue phonetic order to terminal, then terminal can obtain phonetic order from user.
For example, as shown in figure 4, user issues " please click ' I ' " this phonetic order to terminal.
In 202, terminal determines the operation to be completed of phonetic order, and wherein the operation is into including in the first interface
Object element second contact surface.
For example, terminal can carry out speech recognition to the phonetic order after getting phonetic order at user.Pass through
Speech recognition can be parsed out the operation to be completed of the phonetic order.For example, by speech recognition, terminal determines the voice
The operation to be completed of instruction is the interface for a certain object element for including, i.e. second contact surface into the first interface.
For example, by speech recognition, phonetic order that terminal is determined to get from user " please click ' I ' " institute
The operation to be completed is into the interface of " I " this functional module.
In 203, the element for including in the first interface of terminal recognition, and be each Elemental partition coordinate.
For example, determining from the operation to be completed of phonetic order obtained at user as into including in the first interface
Object element second contact surface after, terminal can identify the element for including in the first interface, and be each Elemental partition coordinate.
In one embodiment, it is straight as coordinate origin can to establish plane to show the vertex in the lower left corner of screen for terminal
Angular coordinate system, and be each Elemental partition coordinate for including in the first interface according to the plane right-angle coordinate.
It should be noted that the element for including in interface refers to the functional module for allowing user to click in interface or functional areas
Domain.If user clicks a certain functional module or functional area manually, then terminal can enter the functional module or functional area
Interface.
For example, terminal can identify that element wherein included may include in the first interface as shown in Figure 4：Disappear
Breath, address list, I, the vocabulary such as first message, second message and third message.These elements are all to allow user manual
The functional module or functional area of click.For example, " communication can be entered when user clicks " address list " this element manually
Record " functional module checks contact information.Alternatively, can check when user clicks " first message " this element manually
The details of one message.In addition, terminal can not be true by the information on status bar since the status bar on screen can not be clicked
It is set to corresponding element.
After the element for including in identifying the first interface, terminal can be the corresponding coordinate of each Elemental partition one.Example
Such as, it be (1,1) that terminal, which is the coordinate of " message " distribution, be the coordinate of " address list " distribution is (3,1), is the seat that " I " distributes
(5,1) are designated as, be the coordinate of " first message " distribution be (3,3), be the coordinate that " second message " is distributed are (3,5), for " third
The coordinate of message " distribution is (3,7).
In one embodiment, terminal can identify the member for including in the first interface by way of picture recognition
Element.That is, terminal identified in the way of picture recognition using the first interface as a picture, then text wherein included or
Vocabulary, then will identify that the text come or vocabulary are determined as an element.
For example, in one embodiment, after entering the first interface, terminal can carry out screenshot to the first interface, from
And obtain a picture.Then, terminal can carry out picture recognition, and the text that will be identified from the picture to the picture
Or vocabulary is determined as element.
In 204, terminal generates the corresponding relationship of each element and its coordinate being assigned to.
For example, after each Elemental partition coordinate for including in for the first interface, terminal can be generated each element and its
The corresponding relationship for the coordinate being assigned to, and the corresponding relationship is saved.
In 205, terminal obtains the coordinate of object element from the coordinate of distribution, and the coordinate of the object element is determined
For target position of the object element in the first interface.
For example, terminal can be from the coordinate of distribution after for the corresponding coordinate of each Elemental partition in the first interface
The coordinate of object element is obtained, and the coordinate of the object element is determined as target position of the object element in the first interface
It sets.
For example, object element is " I ", terminal is that the coordinate of object element distribution is (5,1), then terminal can be with
The coordinate (5,1) is determined as target position of the object element " I " in the first interface.
In 206, terminal carries out simulation click to target position, to enter the second contact surface of object element.
For example, determine object element behind the target position in the first interface, terminal can to the target position into
Row simulation is clicked, hence into the interface of the object element, i.e. second contact surface.
For example, behind the target position for determining object element " I ", terminal can to the position that coordinate is (5,1) into
Row simulation is clicked, hence into the interface of " I ".For example, " I " interface can with as shown in figure 5, wherein comprising " I
The functional modules such as wallet ", " my collection ", " my photograph album ", " my setting ".
It should be noted that simulation clicks the manual click action for referring to terminal simulation user to which triggering terminal is completed to be somebody's turn to do
Operation corresponding to click action.For example, Fig. 5 can be entered after user clicks in Fig. 4 " I " this functional module manually
Shown in interface.So, after determining " I the " coordinate (5,1) of this object element in Fig. 4, terminal passes through simulation point
The position of (5,1) is hit, interface shown in fig. 5 can also be entered.
For example, terminal again may be by picture knowledge after entering " I " shown in fig. 5 interface (i.e. second contact surface)
Not Chu the second contact surface element that includes, and be the corresponding coordinate of each Elemental partition.For example, the element for including in second contact surface
It may include " message ", " address list ", " I ", " my wallet ", " my collection ", " my photograph album ", " my setting " etc..
Later, terminal can distribute coordinate (1,1) for " message ", distribute coordinate (3,1) for " address list ", for " I " point
With coordinate (5,1), coordinate (3,3) are distributed for " my setting ", coordinate (3,5) is distributed for " my photograph album ", is " my collection "
It distributes coordinate (3,7), distributes coordinate (3,9) for " my wallet ".
Later, when user issues the phonetic order of " wallet for clicking me ", " my wallet " can be determined as by terminal
Object element, and obtain the coordinate that terminal is the distribution of " my wallet " this object element.It is " my money getting terminal
Packet " distribution coordinate (3,9) after, terminal can to coordinate be (3,9) position carry out simulation click, hence into " I
The interface of wallet ".For example, the interface of " my wallet " can be as shown in Figure 6.
207, when being again at the first interface and needing to enter the second contact surface of object element, terminal detection is current aobvious
Whether display screen is in split screen display available state.
For example, user has exited instant messaging application A behind the interface for entering " my wallet " as shown in Figure 6.Later
For a period of time, user opens instant messaging application A again, and terminal is again at the first interface as shown in Figure 4 at this time, and uses
Family has issued the phonetic order of " clicking mine " to terminal.At this point, terminal can determine to need to enter object element " I "
Interface (i.e. second contact surface), then terminal can first detect whether current display screen is in split screen display available state.
If detecting, current display screen is in split screen display available state, then terminal can choose the place instant messaging application A
Target display screen area, and by the target display screen area carry out picture recognition, to identify the target display screen
The element for including in region.Later, terminal can be the corresponding coordinate of each Elemental partition in target display screen area.So
Afterwards, the coordinate that the available object element of terminal " I " is assigned to, and the coordinate is determined as target position.Finally, terminal
Can be clicked to enter by the simulation to the target position " I " interface.
If detecting, current display screen is not in split screen display available state, then entering 208.
In 208, if current display screen is not in split screen display available state, terminal obtains object element according to corresponding relationship
Coordinate, and simulation click is carried out to the corresponding position of the coordinate of object element.
For example, terminal detects that current display screen is not in split screen display available state, then terminal can be generated according in 204
The first interface in each element and its coordinate being assigned to corresponding relationship, obtain the coordinate of object element " I ", and
Simulation click is carried out to the corresponding position of the coordinate, hence into the interface of " I ".
It is understood that when current display screen is not in split screen display available state, terminal can be according to generating in 204
The corresponding relationship of element and coordinate obtains the coordinate of object element, without the element that is included to the first interface again into
Row identification, the Elemental partition coordinate not identified.The processing speed of terminal can be improved in this way.If but at current display screen
In split screen display available state, then the distributing position of the element in the first interface may be sent out relative to the first interface shown in Fig. 4
Changing, therefore terminal needs to re-recognize the element for including in target display screen area, and redistributes seat for each element
Mark.Then terminal obtains the coordinate of object element again, and carries out simulation click to the position where the coordinate of object element, from
And enter the interface of object element.
In one embodiment, terminal generates the corresponding relationship of each element and its coordinate being assigned in 204
After step, it can also include the following steps：Record the first version number of application.
So, when being again at the first interface and needing to enter the second contact surface of object element, terminal is according to raw in 204
At corresponding relationship obtain object element coordinate, and to the corresponding position of the coordinate of object element carry out simulation click step
Suddenly, may include：
When being again at the first interface and needing to enter the second contact surface of object element, terminal obtains the second edition of application
This number；
If the second edition number and first version number are consistent, terminal obtains the coordinate of object element according to corresponding relationship, and
Simulation click is carried out to the corresponding position of the coordinate of object element.
For example, the distributing position of element and/or element that each interface of application is included can after being updated due to application version
It can change.Therefore, the corresponding relationship of each element in the first interface and its coordinate being assigned to that generate in 204 may
First interface of the application after being no longer desirable for version updating.
Therefore, in the present embodiment, terminal generates the corresponding relationship of each element and its coordinate being assigned in 204
After step, terminal can recorde the first version number of application.When being again at the first interface and need into object element
When second contact surface, however, it is determined that version updating do not occur for application out, i.e., the second edition number for the application that terminal is got at this time and the
One version number is consistent, then terminal can obtain the coordinate of object element according to the corresponding relationship generated in 204, and to the target element
The corresponding position of coordinate of element carries out simulation click, to be linked into the interface of the object element.
Referring to Fig. 7, Fig. 7 is the structural schematic diagram of interface control device provided by the embodiments of the present application.Interface Control dress
Setting 300 may include：First obtains module 301, and determining module 302, second obtains module 303 and operation module 304.
First obtains module 301, for obtaining phonetic order from user when being in the first interface.
Determining module 302, the operation to be completed for determining the phonetic order, the operation are to enter described first
The second contact surface for the object element for including in interface.
Second obtains module 303, for obtaining target position of the object element in first interface.
Operation module 304, for carrying out simulation click to the target position, to enter the second boundary of the object element
Face.
In one embodiment, the second acquisition module 303 can be used for：
It identifies the element for including in first interface, and is each Elemental partition coordinate；
It obtains the coordinate of the object element from the coordinate of distribution, and the coordinate of the object element is determined as described
Target position of the object element in first interface.
Also referring to Fig. 8, Fig. 8 is another structural schematic diagram of interface control device provided by the embodiments of the present application.?
In one embodiment, interface control device 300 can also include：Generation module 305 and logging modle 306.
Generation module 305, for generating the corresponding relationship of each element and its coordinate being assigned to.
So, the operation module 304 can be used for：When be again at first interface and need enter the target
When the second contact surface of element, the coordinate of the object element is obtained according to the corresponding relationship, and to the seat of the object element
It marks corresponding position and carries out simulation click.
In one embodiment, the operation module 304 can be also used for：
When being again at first interface and needing to enter the second contact surface of the object element, current display is detected
Whether screen is in split screen display available state；
If current display screen is not in split screen display available state, the seat of the object element is obtained according to the corresponding relationship
Mark, and simulation click is carried out to the corresponding position of the coordinate of the object element.
Logging modle 306, for recording the first version number of application.
So, the operation module 304 can be used for：
When being again at first interface and needing to enter the second contact surface of the object element, the application is obtained
The second edition number；If the second edition number and the first version number are consistent, according to corresponding relationship acquisition
The coordinate of object element, and simulation click is carried out to the corresponding position of the coordinate of the object element.
The embodiment of the present application provides a kind of computer-readable storage medium, computer program is stored thereon with, when described
When computer program executes on computers, so that the computer is executed as in interface control method provided in this embodiment
Step.
The embodiment of the present application also provides a kind of electronic equipment, including memory, and processor, the processor is by calling institute
The computer program stored in memory is stated, for executing the step in interface control method provided in this embodiment.
For example, above-mentioned electronic equipment can be the mobile terminals such as tablet computer or smart phone.Referring to Fig. 9,
Fig. 9 is the structural schematic diagram of mobile terminal provided by the embodiments of the present application.
The mobile terminal 400 may include the components such as display screen 401, memory 402, processor 403.Those skilled in the art
Member is appreciated that mobile terminal structure shown in Fig. 9 does not constitute the restriction to mobile terminal, may include more than illustrating
Or less component, perhaps combine certain components or different component layouts.
Display screen 401 is displayed for the information such as image and text.
Memory 402 can be used for storing application program and data.It include that can hold in the application program that memory 402 stores
Line code.Application program can form various functional modules.Processor 403 is stored in the application journey of memory 402 by operation
Sequence, thereby executing various function application and data processing.
Processor 403 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part by running or execute the application program being stored in memory 402, and is called and is stored in memory 402
Data execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.
In the present embodiment, the processor 403 in mobile terminal can be according to following instruction, will be one or more
The corresponding executable code of the process of application program is loaded into memory 402, and is run by processor 403 and be stored in storage
Application program in device 402, to realize step：
When being in the first interface, phonetic order is obtained from user；
Determine that the operation to be completed of the phonetic order, the operation are to enter the target for including in first interface
The second contact surface of element；
Obtain target position of the object element in first interface；
Simulation click is carried out to the target position, to enter the second contact surface of the object element.
Referring to Fig. 10, mobile terminal 500 may include display screen 501, memory 502, processor 503, input unit
504, the components such as output unit 505.
Display screen 501 is displayed for image and text etc..
Memory 502 can be used for storing application program and data.It include that can hold in the application program that memory 502 stores
Line code.Application program can form various functional modules.Processor 503 is stored in the application journey of memory 502 by operation
Sequence, thereby executing various function application and data processing.
Processor 503 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part by running or execute the application program being stored in memory 502, and is called and is stored in memory 502
Data execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.
Input unit 504 can be used for receiving number, character information or the user's characteristic information (such as fingerprint) of input, and
Generate keyboard related with user setting and function control, mouse, operating stick, optics or trackball signal input.
Output unit 505 can be used for showing information input by user or the information and mobile terminal that are supplied to user
Various graphical user interface, these graphical user interface can be made of figure, text, icon, video and any combination thereof.
Output unit may include display panel.
In the present embodiment, the processor 503 in mobile terminal can be according to following instruction, will be one or more
The corresponding executable code of the process of application program is loaded into memory 502, and is run by processor 503 and be stored in storage
Application program in device 502, to realize step：
When being in the first interface, phonetic order is obtained from user；
Determine that the operation to be completed of the phonetic order, the operation are to enter the target for including in first interface
The second contact surface of element；
Obtain target position of the object element in first interface；
Simulation click is carried out to the target position, to enter the second contact surface of the object element.
In one embodiment, processor 503 executes the acquisition object element in first interface
When the step of target position, it can execute：It identifies the element for including in first interface, and is sat for each Elemental partition
Mark；The coordinate of the object element is obtained from the coordinate of distribution, and the coordinate of the object element is determined as the target
Target position of the element in first interface.
In one embodiment, after for each Elemental partition coordinate the step of, processor 503 can also be held
Row：Generate the corresponding relationship of each element and its coordinate being assigned to.
So, after the step of entering the second contact surface of the object element, processor 503 be can also be performed：When again
When the secondary second contact surface for being in first interface and needing to enter the object element, according to corresponding relationship acquisition
The coordinate of object element, and simulation click is carried out to the corresponding position of the coordinate of the object element.
In one embodiment, processor 503 executes described when being again at first interface and need to enter institute
When stating the second contact surface of object element, the coordinate of the object element is obtained according to the corresponding relationship, and to the target element
When the corresponding position of coordinate of element carries out the step of simulation click, it can execute：When being again at first interface and need
Into the object element second contact surface when, detect whether current display screen is in split screen display available state；If current display screen
It is not in split screen display available state, then obtains the coordinate of the object element according to the corresponding relationship, and to the object element
The corresponding position of coordinate carry out simulation click.
In one embodiment, the step of generating the corresponding relationship of each element and its coordinate being assigned to it
Afterwards, processor 503 can also be performed：Record the first version number of application.
So, processor 503 executes described when being again at first interface and need into the object element
When second contact surface, the coordinate of the object element is obtained according to the corresponding relationship, and answer the coordinate pair of the object element
Position carry out simulation click step when, can execute：When be again at first interface and need enter the target
When the second contact surface of element, the second edition number of the application is obtained；If the second edition number and the first version number one
It causes, then obtains the coordinate of the object element according to the corresponding relationship, and to the corresponding position of the coordinate of the object element
Carry out simulation click.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the detailed description above with respect to interface control method, details are not described herein again.
Interface control method in the interface control device provided by the embodiments of the present application and foregoing embodiments belongs to together
One design can run either offer method in the interface control method embodiment on the interface control device,
Specific implementation process is detailed in the interface control method embodiment, and details are not described herein again.
It should be noted that those of ordinary skill in the art can for the interface control method described in the embodiment of the present application
With understand realize the embodiment of the present application described in interface control method all or part of the process, be can by computer program come
Relevant hardware is controlled to complete, the computer program can be stored in a computer-readable storage medium, such as be stored in
It in memory, and is executed by least one processor, in the process of implementation may include the embodiment such as the interface control method
Process.Wherein, the storage medium can be magnetic disk, CD, read-only memory (ROM, Read Only Memory), random
Access/memory body (RAM, Random Access Memory) etc..
For the interface control device of the embodiment of the present application, each functional module be can integrate in a processing core
In piece, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module.On
It states integrated module both and can take the form of hardware realization, can also be realized in the form of software function module.The collection
If at module realized in the form of software function module and when sold or used as an independent product, also can store
In one computer-readable storage medium, the storage medium is for example read-only memory, disk or CD etc..
Above to a kind of interface control method, device, storage medium and electronic equipment provided by the embodiment of the present application
It is described in detail, used herein a specific example illustrates the principle and implementation of the invention, the above reality
The explanation for applying example is merely used to help understand method and its core concept of the invention；Meanwhile for those skilled in the art,
According to the thought of the present invention, there will be changes in the specific implementation manner and application range, in conclusion in this specification
Appearance should not be construed as limiting the invention.
Claims (10)
1. a kind of interface control method, which is characterized in that including：
When being in the first interface, phonetic order is obtained from user；
The operation to be completed of the phonetic order is determined, wherein the operation is to enter the target for including in first interface
The second contact surface of element；
Obtain target position of the object element in first interface；
Simulation click is carried out to the target position, to enter the second contact surface of the object element.
2. interface control method according to claim 1, which is characterized in that obtain the object element on first boundary
Target position in face, including：
It identifies the element for including in first interface, and is each Elemental partition coordinate；
The coordinate of the object element is obtained from the coordinate of distribution, and the coordinate of the object element is determined as the target
Target position of the element in first interface.
3. interface control method according to claim 2, which is characterized in that in the step for each Elemental partition coordinate
After rapid, further include：
Generate the corresponding relationship of each element and its coordinate being assigned to；
After the step of entering the second contact surface of the object element, further include：When be again at first interface and need
When entering the second contact surface of the object element, the coordinate of the object element is obtained according to the corresponding relationship, and to institute
The corresponding position of coordinate for stating object element carries out simulation click.
4. interface control method according to claim 3, which is characterized in that when being again at first interface and need
Into the object element second contact surface when, the coordinate of the object element is obtained according to the corresponding relationship, and to described
The corresponding position of the coordinate of object element carries out simulation click, including：
When being again at first interface and needing to enter the second contact surface of the object element, detecting current display screen is
It is no to be in split screen display available state；
If current display screen is not in split screen display available state, the coordinate of the object element is obtained according to the corresponding relationship,
And simulation click is carried out to the corresponding position of the coordinate of the object element.
5. interface control method according to claim 3, which is characterized in that generating each element and its be assigned to
Coordinate corresponding relationship the step of after, further include：
Record the first version number of application；
It is described when being again at first interface and needing the second contact surface into the object element, according to the correspondence
The coordinate of object element described in Relation acquisition, and simulation click is carried out to the corresponding position of the coordinate of the object element, including：
When being again at first interface and needing the second contact surface into the object element, the of the application is obtained
Two version numbers；
If the second edition number and the first version number are consistent, the object element is obtained according to the corresponding relationship
Coordinate, and simulation click is carried out to the corresponding position of the coordinate of the object element.
6. a kind of interface control device, which is characterized in that including：
First obtains module, for obtaining phonetic order from user when being in the first interface；
Determining module, the operation to be completed for determining the phonetic order, wherein the operation is to enter first boundary
The second contact surface for the object element for including in face；
Second obtains module, for obtaining target position of the object element in first interface；
Operation module, for carrying out simulation click to the target position, to enter the second contact surface of the object element.
7. interface control device according to claim 6, which is characterized in that the second acquisition module is used for：
It identifies the element for including in first interface, and is each Elemental partition coordinate；
The coordinate of the object element is obtained from the coordinate of distribution, and the coordinate of the object element is determined as the target
Target position of the element in first interface.
8. interface control device according to claim 7, which is characterized in that described device further includes：
Generation module, for generating the corresponding relationship of each element and its coordinate being assigned to；
The operation module, for working as the second contact surface for being again at first interface and needing into the object element
When, obtain the coordinate of the object element according to the corresponding relationship, and to the corresponding position of the coordinate of the object element into
Row simulation is clicked.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that when the computer program on computers
When execution, so that the computer executes the method as described in any one of claims 1 to 5.
10. a kind of electronic equipment, including memory, processor, which is characterized in that the processor is by calling the memory
The computer program of middle storage, for executing the method as described in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810629387.5A CN108829371B (en) | 2018-06-19 | 2018-06-19 | Interface control method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810629387.5A CN108829371B (en) | 2018-06-19 | 2018-06-19 | Interface control method and device, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108829371A true CN108829371A (en) | 2018-11-16 |
| CN108829371B CN108829371B (en) | 2022-02-22 |
Family
ID=64142544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810629387.5A Active CN108829371B (en) | 2018-06-19 | 2018-06-19 | Interface control method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829371B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111681658A (en) * | 2020-06-05 | 2020-09-18 | 苏州思必驰信息科技有限公司 | Voice control method and device for vehicle-mounted APP |
| CN112286486A (en) * | 2020-12-30 | 2021-01-29 | 智道网联科技(北京)有限公司 | Operation method of application program on intelligent terminal, intelligent terminal and storage medium |
| CN112304325A (en) * | 2020-10-23 | 2021-02-02 | 上海博泰悦臻网络技术服务有限公司 | Automatic navigation method, terminal, system and storage medium based on social software |
| CN112634896A (en) * | 2020-12-30 | 2021-04-09 | 智道网联科技(北京)有限公司 | Operation method of application program on intelligent terminal and intelligent terminal |
| CN112732379A (en) * | 2020-12-30 | 2021-04-30 | 智道网联科技(北京)有限公司 | Operation method of application program on intelligent terminal, terminal and storage medium |
| CN113900620A (en) * | 2021-11-09 | 2022-01-07 | 杭州逗酷软件科技有限公司 | Interaction method, interaction device, electronic equipment and storage medium |
| US11450322B2 (en) | 2018-11-23 | 2022-09-20 | Huawei Technologies Co., Ltd. | Speech control method and electronic device |
| CN113900620B (en) * | 2021-11-09 | 2024-05-03 | 杭州逗酷软件科技有限公司 | Interaction method, device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217152A (en) * | 2014-09-23 | 2014-12-17 | 陈包容 | Implementation method and device for mobile terminal to enter application program under stand-by state |
| CN105302619A (en) * | 2015-12-03 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Information processing method and device and electronic equipment |
| CN106201177A (en) * | 2016-06-24 | 2016-12-07 | 维沃移动通信有限公司 | A kind of operation execution method and mobile terminal |
| CN106373570A (en) * | 2016-09-12 | 2017-02-01 | 深圳市金立通信设备有限公司 | Voice control method and terminal |
| CN107608652A (en) * | 2017-08-28 | 2018-01-19 | 三星电子（中国）研发中心 | A kind of method and apparatus of Voice command graphical interfaces |
| CN107919129A (en) * | 2017-11-15 | 2018-04-17 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling the page |
-
2018
- 2018-06-19 CN CN201810629387.5A patent/CN108829371B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217152A (en) * | 2014-09-23 | 2014-12-17 | 陈包容 | Implementation method and device for mobile terminal to enter application program under stand-by state |
| CN105302619A (en) * | 2015-12-03 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Information processing method and device and electronic equipment |
| CN106201177A (en) * | 2016-06-24 | 2016-12-07 | 维沃移动通信有限公司 | A kind of operation execution method and mobile terminal |
| CN106373570A (en) * | 2016-09-12 | 2017-02-01 | 深圳市金立通信设备有限公司 | Voice control method and terminal |
| CN107608652A (en) * | 2017-08-28 | 2018-01-19 | 三星电子（中国）研发中心 | A kind of method and apparatus of Voice command graphical interfaces |
| CN107919129A (en) * | 2017-11-15 | 2018-04-17 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling the page |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11450322B2 (en) | 2018-11-23 | 2022-09-20 | Huawei Technologies Co., Ltd. | Speech control method and electronic device |
| EP3872807B1 (en) * | 2018-11-23 | 2023-10-18 | Huawei Technologies Co., Ltd. | Voice control method and electronic device |
| CN111681658A (en) * | 2020-06-05 | 2020-09-18 | 苏州思必驰信息科技有限公司 | Voice control method and device for vehicle-mounted APP |
| CN112304325A (en) * | 2020-10-23 | 2021-02-02 | 上海博泰悦臻网络技术服务有限公司 | Automatic navigation method, terminal, system and storage medium based on social software |
| CN112286486A (en) * | 2020-12-30 | 2021-01-29 | 智道网联科技(北京)有限公司 | Operation method of application program on intelligent terminal, intelligent terminal and storage medium |
| CN112634896A (en) * | 2020-12-30 | 2021-04-09 | 智道网联科技(北京)有限公司 | Operation method of application program on intelligent terminal and intelligent terminal |
| CN112732379A (en) * | 2020-12-30 | 2021-04-30 | 智道网联科技(北京)有限公司 | Operation method of application program on intelligent terminal, terminal and storage medium |
| CN112732379B (en) * | 2020-12-30 | 2023-12-15 | 智道网联科技(北京)有限公司 | Method for running application program on intelligent terminal, terminal and storage medium |
| CN113900620A (en) * | 2021-11-09 | 2022-01-07 | 杭州逗酷软件科技有限公司 | Interaction method, interaction device, electronic equipment and storage medium |
| CN113900620B (en) * | 2021-11-09 | 2024-05-03 | 杭州逗酷软件科技有限公司 | Interaction method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108829371B (en) | 2022-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829371A (en) | interface control method, device, storage medium and electronic equipment | |
| EP3129871B1 (en) | Generating a screenshot | |
| CN108293079A (en) | For the striding equipment buddy application of phone | |
| US20180123815A1 (en) | Managing notifications related to collaboratively edited electronic documents based on user roles | |
| EP2891041B1 (en) | User interface apparatus in a user terminal and method for supporting the same | |
| CN106373570A (en) | Voice control method and terminal | |
| US20190369844A9 (en) | Graphical user interface facilitating uploading of electronic documents to shared storage | |
| US20190065012A1 (en) | Method, apparatus, and computer-readable medium for propagating enriched note data objects over a web socket connection in a networked collaboration workspace | |
| CN105359135B (en) | Demonstration is created with ink | |
| CN104820683A (en) | Terminal | |
| CN108958731B (en) | Application program interface generation method, device, equipment and storage medium | |
| DE102014101042A1 (en) | Modifying a stylus input or response using an inferred motion | |
| CN109828820A (en) | A kind of focus method for refreshing, device, storage medium and the terminal of application widget | |
| CN104834687A (en) | Picture display method | |
| CN114205447B (en) | Shortcut setting method and device of electronic equipment, storage medium and electronic equipment | |
| CN108984089A (en) | touch operation method, device, storage medium and electronic equipment | |
| US20140215433A1 (en) | Class oriented file format for modeling and persisting bpmn scripting code | |
| CN110471700A (en) | Graphic processing method, device, storage medium and electronic equipment | |
| CN112199135A (en) | Information guiding method, device, electronic equipment and storage medium | |
| CN107770253A (en) | Long-range control method and system | |
| KR20180049791A (en) | Method of filtering a plurality of messages and apparatus thereof | |
| CN109491570B (en) | Shorthand method, mobile terminal and storage medium | |
| CN107193562A (en) | A kind of image processing method and device | |
| CN106197394A (en) | Air navigation aid and device | |
| US20220222955A1 (en) | Context-based shape extraction and interpretation from hand-drawn ink input |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |