CN108153574B - Application processing method and device and electronic equipment - Google Patents
Application processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN108153574B CN108153574B CN201711463987.0A CN201711463987A CN108153574B CN 108153574 B CN108153574 B CN 108153574B CN 201711463987 A CN201711463987 A CN 201711463987A CN 108153574 B CN108153574 B CN 108153574B
- Authority
- CN
- China
- Prior art keywords
- operation control
- control node
- application program
- page
- traversal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides an application program processing method, an application program processing device and electronic equipment, wherein the method comprises the following steps: the plug-in receives the voice input by the first user and recognizes the input voice to obtain the meaning of the voice. And determining a target operation path matched with the voice meaning from a plurality of generated operation paths corresponding to the application program according to the voice meaning, wherein the generated operation path is composed of an operation control node sequence. And the plug-in sends an execution instruction to the application program, and the application program responds to the execution instruction to sequentially execute each operation control node in the target operation path, so that the function corresponding to the voice input by the first user is realized. The corresponding function of the application program can be realized through voice control, namely a brand new voice operation mode is provided for the application program, multiple click operations required in the process of realizing the function are omitted, the operation is simple and convenient, and the use viscosity of a user is improved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to an application processing method and apparatus, and an electronic device.
Background
The smart phone can expand the functions of the mobile phone by downloading the application program. In recent years, with the development of smart phones, large software companies strive to develop applications for satisfying different requirements of users, and the functions provided in the applications are more and more abundant.
However, when a user actually uses an application program, in order to implement a certain function, the user often needs to click a corresponding function button many times, and finally can enter a page corresponding to the function through a layer-by-layer interface. This complicates the operation process for the user. Meanwhile, for users who are not skilled in smartphone usage, the complicated operation process can greatly reduce the use stickiness of the applications.
Disclosure of Invention
In view of this, embodiments of the present invention provide an application processing method, an application processing apparatus, and an electronic device, so as to simplify operations of a user and improve use stickiness of the user.
The embodiment of the invention provides an application program processing method, which comprises the following steps:
receiving input voice of a first user;
determining a target operation path corresponding to the input voice from generated operation paths corresponding to an application program according to the matching of function labels corresponding to the operation paths and the input voice, wherein the target operation path consists of an operation control node sequence;
and sending an execution instruction to the application program so that the application program sequentially executes each operation control node in the target operation path.
Optionally, the sending an execution instruction to the application program to enable the application program to sequentially execute each operation control node in the target operation path includes:
identifying page structure elements contained in the current page of the application program by combining a preset page structure element database corresponding to the application program;
determining an initial operation control node from each operation control node according to a page structure element corresponding to each operation control node in the target operation path, wherein the page structure element corresponding to the initial operation control node is the same as the page structure element contained in the current page;
and sending an execution instruction to the application program so that the application program sequentially executes the rest operation control nodes in the target operation path from the starting operation control node.
Optionally, the method further comprises:
acquiring an operation control node tree corresponding to the application program;
successively traversing the operation control node tree from the root node of the operation control node tree to generate an operation path corresponding to the traversal when the currently traversed operation control node meets a cut-off condition;
wherein the cutoff condition comprises: the currently traversed operation control node is a leaf node, or the page structure element corresponding to the currently traversed operation control node is the same as the page structure element corresponding to the operation control node traversed before the traversal.
Optionally, the method further comprises:
in the process of the traversal, for any traversed operation control node, acquiring an intersection between a page element contained in a page displayed after the operation of the operation control node and a page structure element contained in the preset page structure element database as a page structure element corresponding to the operation control node.
Optionally, after generating the operation path corresponding to the traversal, the method further includes:
displaying the page corresponding to each operation control node according to the traversal sequence of each operation control node in the operation path corresponding to the traversal;
receiving a function label corresponding to the operation path corresponding to the traversal according to the displayed page input by the second user;
and associating and storing the operation path corresponding to the traversal and the function label.
An embodiment of the present invention provides an application processing apparatus, including:
the receiving module is used for receiving input voice of a first user;
the path determining module is used for determining a target operation path corresponding to the input voice from generated operation paths corresponding to the application program according to the matching between the function labels respectively corresponding to the operation paths and the input voice, wherein the target operation path consists of an operation control node sequence;
and the sending module is used for sending an execution instruction to the application program so that the application program sequentially executes each operation control node in the target operation path.
Optionally, the sending module specifically includes:
the identification unit is used for identifying page structure elements contained in the current page of the application program by combining a preset page structure element database corresponding to the application program;
a node determining unit, configured to determine, according to page structure elements corresponding to each operation control node in the target operation path, an initial operation control node from the operation control nodes, where a page structure element corresponding to the initial operation control node is the same as a page structure element included in the current page;
and the sending unit is used for sending an execution instruction to the application program so that the application program sequentially executes the rest operation control nodes in the target operation path from the starting operation control node.
Optionally, the apparatus further comprises:
the node acquisition module is used for acquiring an operation control node tree corresponding to the application program;
the generating module is used for traversing the operation control node tree from the root node of the operation control node tree successively so as to generate an operation path corresponding to the traversal when the currently traversed operation control node meets a cut-off condition;
wherein the cutoff condition comprises: the currently traversed operation control node is a leaf node, or the page structure element corresponding to the currently traversed operation control node is the same as the page structure element corresponding to the operation control node traversed before the traversal.
Optionally, the apparatus further comprises:
the display module is used for displaying the page corresponding to each operation control node according to the traversal sequence of each operation control node in the operation path corresponding to the traversal;
the receiving module is used for receiving a function tag which is input by a second user according to the displayed page and corresponds to the operation path corresponding to the traversal;
and the storage module is used for associating and storing the operation path corresponding to the traversal and the function label.
An embodiment of the present invention provides an electronic device, including: a processor, and a memory coupled to the processor;
the memory to store one or more computer instructions, wherein the one or more computer instructions are for the processor to invoke for execution;
the processor is configured to execute the one or more computer instructions in any one of the above application processing methods.
According to the application processing method and device and the electronic device provided by the embodiment of the invention, the plug-in and the application are simultaneously installed on the terminal device. First, the plug-in receives the voice input by the first user and recognizes the input voice to obtain the meaning of the voice. Then, according to the voice meaning, a target operation path matched with the voice meaning is determined from a plurality of generated operation paths corresponding to the application program, and the matching can be expressed as: the function label of the target operation path is the same as or similar to the meaning of the voice, wherein the generated operation path is composed of the operation control node sequence. And the plug-in sends an execution instruction to the application program, and the application program responds to the execution instruction to sequentially execute each operation control node in the target operation path, so that the function corresponding to the voice input by the first user is realized. The corresponding function of the application program can be realized through voice control, namely a brand new voice operation mode is provided for the application program, multiple click operations required in the process of realizing the function are omitted, the operation is simple and convenient, and the use viscosity of a user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a flowchart of a first embodiment of an application processing method according to the present invention;
fig. 2 is a flowchart of a second embodiment of an application processing method according to the present invention;
fig. 3 is a flowchart of a third embodiment of an application processing method according to the present invention;
fig. 4 is a schematic structural diagram of a first embodiment of an application processing apparatus according to the present invention;
fig. 5 is a schematic structural diagram of a second application processing apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a third embodiment of an application processing apparatus according to the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to a first embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, and "a" and "an" generally include at least two, but do not exclude at least one, unless the context clearly dictates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
It should be understood that although the terms first, second, third, etc. may be used to describe XXX in embodiments of the present invention, these XXX should not be limited to these terms. These terms are only used to distinguish XXX from each other. For example, a first XXX may also be referred to as a second XXX, and similarly, a second XXX may also be referred to as a first XXX, without departing from the scope of embodiments of the present invention.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
Fig. 1 is a flowchart of a first embodiment of an application processing method according to an embodiment of the present invention, where an execution main body of the application processing method according to this embodiment may be a plug-in installed on a terminal device, as shown in fig. 1, the method includes the following steps:
s101, receiving input voice of a first user.
And S102, determining a target operation path corresponding to the input voice from the generated operation paths corresponding to the application program according to the matching of the function labels corresponding to the operation paths and the input voice, wherein the target operation path is composed of an operation control node sequence.
After the first user opens a certain application installed on the terminal device, if the first user wants to implement a certain function provided in the application, such as payment, chat, and the like, at this time, the first user may input voice to the terminal device. The plug-in unit also installed on the terminal equipment can receive the input voice of the user and recognize the meaning of the input voice through a built-in voice recognition algorithm. Optionally, the first user may be a user of the terminal device, and in practical applications, the user may be a general user or a developer of a plug-in installed on the terminal device. Alternatively, the built-in speech recognition algorithm may be a deep learning algorithm based on a neural network Model, a speech recognition algorithm based on a Hidden Markov Model (HMM), or the like.
And the plug-in determines a target operation path from the generated operation paths corresponding to the application program according to the recognized voice meaning, wherein the function label of the target operation path has matching with the recognized voice meaning, and the matching can be expressed that the function label of the target operation path has the same or similar meaning with the recognized voice meaning. Determining the match between the functional label and the meaning of the speech may also be understood as determining the similarity between the two, optionally the similarity may be calculated based on a corpus or a semantic dictionary. And when the similarity of the two is greater than a preset value, the matching between the function label and the voice meaning is represented. And whether the determined target operation path or other paths in the generated operation path are composed of the operation control node sequence. Alternatively, the sequence of operation control nodes that make up the operation path may understand the order of controls triggered in the process of implementing a function in an application. The control can be an interactive button provided in the page, and the first user can realize a certain function by clicking the interactive button. In practical applications, the interactive buttons may be, for example, buttons of "home page", "word of mouth", "friend", "me", etc. located at the lower part of the page, with the payment application.
Optionally, the specific generation process of the "generated operation path" and the specific setting process of the "function label corresponding to the operation path" referred to in the above description may be referred to the related description in the following third embodiment, and are not expanded in detail here.
S103, sending an execution instruction to the application program so that the application program sequentially executes each operation control node in the target operation path.
After the target operation path is determined, the plug-in sends an execution instruction to the application program, and optionally, the execution instruction includes an operation control node sequence forming the target operation path. And the application program sequentially executes each operation control node according to the received control instruction. Each execution of an operation control node corresponds to the first user clicking on a control in the page. And after all the operation control nodes in the target operation path are completely executed, the page of the application program currently displayed by the terminal equipment is the page corresponding to the voice meaning of the voice input by the first user, so that the voice control of the application program by using the plug-in is realized.
It should be noted that the above and the following embodiments can be understood as follows: a method for voice control of an application program installed on a terminal device by using a plug-in is provided. Optionally, the plug-in may perform voice control on all applications on the terminal device, or may perform voice control on only a part of applications on the terminal device. When the plug-in performs voice control on part of the application programs, the first user may manually select the part of the application programs that needs to be voice controlled by using the plug-in according to related functions, such as auxiliary functions, provided in the terminal device system. Specifically, the terminal device needs to start the related functions provided in the system, and then the first user can select an application program that wants to implement voice control from the application program list of the terminal device according to the requirement of the first user.
In this embodiment, a plug-in installed on a terminal device receives a voice input by a first user, and recognizes the input voice to obtain the meaning of the voice. Then, according to the voice meaning, a target operation path matched with the voice meaning is determined from a plurality of generated operation paths corresponding to the application program, and the matching can be expressed as: the function label of the target operation path is the same as or similar to the meaning of the voice, wherein the generated operation path is composed of the operation control node sequence. And the plug-in sends an execution instruction to the application program, and the application program responds to the execution instruction to sequentially execute each operation control node in the target operation path, so that the function corresponding to the voice input by the first user is realized. The corresponding function of the application program can be realized through voice control, namely a brand new voice operation mode is provided for the application program, multiple click operations required in the process of realizing the function are omitted, the operation is simple and convenient, and the use viscosity of a user is improved.
The starting points of all the generated operation paths correspond to the home page of the application program, and in the first embodiment, it is not limited to whether the current page of the application program is the home page or the non-home page when the first user inputs the voice. In practical applications, however, it is very likely that: a situation where the first user inputs speech when the current page of the application is a non-home page. At this time, if the application program still executes the operation control nodes in the target operation path in sequence, the application program needs to first return to the home page from the current non-home page, and then enter from the home page layer by layer according to the target operation path to reach the final target page. This may cause some page recurrence, reducing the speed of reaching the target page.
To avoid the above problem, fig. 2 is a flowchart of a second embodiment of an application processing method according to an embodiment of the present invention, and as shown in fig. 2, the method includes the following steps:
s201, receiving input voice of a first user.
S202, determining a target operation path corresponding to the input voice from the generated operation paths corresponding to the application program according to the matching of the function labels corresponding to the operation paths and the input voice, wherein the target operation path is composed of an operation control node sequence.
The execution process of the above steps S201-S202 is similar to the corresponding steps of the foregoing embodiment, and reference may be made to the relevant description in the embodiment shown in fig. 1, which is not repeated herein.
And S203, identifying the page structure elements contained in the current page of the application program by combining the preset page structure element database corresponding to the application program.
The plug-in may obtain the page elements contained in the current page of the application program in real time through corresponding functions provided by the terminal device, for example, the auxiliary functions referred to in the first embodiment. The acquired page elements may include both page data elements and page structure elements. The page structure elements are original elements existing in the application program after the application program is developed, and the page data elements are elements which are continuously added along with the use of the first user.
After the plug-in obtains the page elements included in the current page through the corresponding functions provided by the terminal device, optionally, since the obtained page structure elements and page data elements may be stored in one data packet, optionally, the plug-in may identify the page structure elements from the page elements in the following manner:
and taking an intersection of the preset page structure element database corresponding to the application program and the acquired page elements of the current page, wherein the elements contained in the intersection are the page structure elements contained in the current page of the application program.
Taking the home page of the chat application as an example, when the first user logs in the chat application for the first time, fixed controls with an interaction function exist in the home page, for example, fixed controls such as "home page", "address book", "find", and "me" provided below the home page, and other text fields without an interaction function, which appear in the home page, for example, a "home page" field located at the top center position of the home page, and these original elements can all be regarded as page structure elements.
As the chat application is used by the first user, a chat frame and chat content of a contact in the address book and push content automatically pushed by the application according to the preference of the first user are gradually added to the home page of the chat application, and the added elements which do not exist in the home page originally can be regarded as page data elements.
The preset page structure element database corresponding to the application program referred to in the description may be directly obtained by the plug-in after the application program is installed. Optionally, the preset page structure element database may be a source file corresponding to the application, and the source file may be a file that can be generated after the application is developed. Optionally, the preset page structure element database includes page structure elements included in all pages of the application, and the page structure element of each page may specifically be a control having an interaction function and included in the page, a position where the control is located, various text fields in the page without the interaction function and positions where the text fields are located, and the like.
S204, determining a starting operation control node from each operation control node according to the page structure element corresponding to each operation control node in the target operation path, wherein the page structure element corresponding to the starting operation control node is the same as the page structure element contained in the current page.
And S205, sending an execution instruction to the application program, so that the application program sequentially executes the rest operation control nodes in the target operation path from the initial operation control node.
After determining the page structure element included in the current page, optionally, the plug-in may determine, by using a pre-established association relationship between the page structure element and the operation control node, that the page structure element included in the current page corresponds to the operation control node in the target operation path, and use the determined operation control node as the initial operation control node. Optionally, the process of establishing the association relationship between the page structure element and the operation control node may be as described in the third embodiment below.
The plug-in may then send an execution instruction to the application, where the execution instruction includes the start operation control node. At this time, after receiving the execution instruction, the application program sequentially executes the remaining operation control nodes in the target operation path from the starting operation control node.
It should be noted that the application programs referred to in the above and following embodiments are application programs that allow a plug-in to perform voice control on them. Which applications in the terminal device are allowed to be controlled by the plug-in, reference may be made to the related description of the last part in the first embodiment, and details are not described here again.
In this embodiment, after the plug-in determines the target operation path according to the received input voice of the first user, the plug-in may obtain the page element of the current page through the related function provided in the terminal device, and identify the page structure element included in the current page by combining the preset page structure element database corresponding to the application program and the page element of the current page. And determining an operation control node associated with the page structure element of the current page, namely an initial operation control node according to a preset association relationship between the page structure element and the operation control node. And finally, the plug-in sends the execution instruction containing the initial operation control node to the application program, and the application program can execute the rest operation control nodes in the target operation path in sequence from the initial operation control node. When the current page of the application program is a non-top page, the application program can start to execute the execution instruction from the operation control node corresponding to the page structural element of the current page, the situation of page rollback reentry cannot occur in the process of reaching the final target page, and the speed of reaching the target page is improved.
Based on that, each of the above embodiments is performed on the basis that an operation path has been generated and each operation control node in the operation path has a corresponding page structure element, fig. 3 is a flowchart of a third embodiment of an application processing method provided in an embodiment of the present invention, and as shown in fig. 3, the method includes the following steps:
s301, obtaining an operation control node tree corresponding to the application program.
And S302, traversing the operation control node tree from the root node of the operation control node tree successively to generate an operation path corresponding to the traversal when the currently traversed operation control node meets a cut-off condition.
According to the related description in the above embodiments, the plug-in may obtain the controls existing in each page in the application program through the corresponding functions provided by the terminal device, for example, the auxiliary functions. Meanwhile, after the controls existing in each page are obtained, the plug-in can further obtain an operation control node tree which corresponds to the application program and is formed by the controls according to the obtained controls.
And the plug-in starts to traverse each operation control node in the operation control node tree from the root node of the operation control node tree, and then generates an operation path by combining a traversal cut-off condition.
Specifically, the currently traversed operation control node is a leaf node, that is, the previously traversed operation control node does not have a corresponding next-level operation control node. At this time, the plug-in may stop the traversal of the operation control node, and may form an operation path corresponding to the traversal according to the traversal sequence by using the leaf node and the operation control node traversed before.
The page structure element corresponding to the currently traversed operation control node is the same as the page structure element corresponding to the operation control node traversed before the traversal, which indicates that the page structure element has repeatedly appeared in the previous traversal process, and a continuous circulating state can appear if the traversal is continued. At this time, the plug-in may stop the traversal of the operation control node this time, and form an operation path corresponding to the traversal of this time by the currently traversed operation control node and the previously traversed operation control node according to the sequence of the traversal.
After all the operation control nodes in the operation control node tree are traversed, an operation path corresponding to the application program can be generated.
After the operation path is generated, optionally, the plug-in may further establish an association relationship between the operation control node and the page element in the following manner.
In each traversal process, after any traversed operation control node, the plug-in may obtain a page element included in a page displayed after a certain operation control node a is operated, where the page element includes a page structure element and a page data element, which is similar to the page structure element included in the "identification of the current page of the application" in the second embodiment, the plug-in may intersect the page element included in the displayed page and the page structure element included in the preset page structure element database, and use an element included in the intersection as the page structure element corresponding to the operation control node a, and at this time, the plug-in also establishes an association relationship between the operation control node a and the page structure element.
In addition, according to the application processing method provided in the above embodiment, in the process of confirming the target operation path according to the input voice of the user, it is necessary to use the function tag corresponding to the operation path, and therefore, optionally, the application processing method may further include the following steps:
and S303, displaying the page corresponding to each operation control node according to the traversal sequence of each operation control node in the corresponding operation path traversed this time.
S304, receiving a function label corresponding to the operation path corresponding to the traversal according to the displayed page input by the second user.
S305, the operation path and the function label corresponding to the traversal are stored in an associated mode.
After each operation path is generated, the plug-in may obtain, by using a related function provided by the terminal device, for example, an auxiliary function, a page element corresponding to each operation control node in the operation path, and generate, according to the page element, a page corresponding to each operation control node. And the plug-in sequentially displays the pages corresponding to the operation control nodes according to the sequence of the operation control nodes in the operation path through a screen of the terminal equipment. The second user can know the functions realized by the operation path through the sequential display of the pages. Optionally, the second user is typically a developer of the plug-in. The second user can input a function label corresponding to the operation path to the screen of the terminal device according to the function realized by the operation path. Finally, the plug-in stores the association between the operation path and the function label.
In this embodiment, the plug-in may obtain the operation control node tree corresponding to the application program according to the corresponding function provided by the terminal device. And generating an operation path corresponding to the application program by combining the traversal cut-off condition in a sequential traversal mode. Meanwhile, the plug-in can establish the incidence relation between each operation control node and the page structural element in the operation path. Further, the plug-in sequentially displays the pages corresponding to the operation control nodes in the operation path, so that the second user sets corresponding function labels for the operation path, and stores the association relationship between the operation path and the function labels. Therefore, the plug-in can determine a target operation path according to the input voice of the first user and the function label of the operation path set by the second user. When the first user inputs voice, the plug-in can realize the voice control of the application program according to the target operation path, thereby simplifying the operation of the user.
Fig. 4 is a schematic structural diagram of a first embodiment of an application processing apparatus according to the present invention, and as shown in fig. 4, the application processing apparatus includes: a receiving module 11, a path determining module 12 and a transmitting module 13.
The receiving module 11 is configured to receive an input voice of a first user.
And a path determining module 12, configured to determine, from the generated operation paths corresponding to the application program, a target operation path corresponding to the input voice according to matching between the function tag corresponding to each operation path and the input voice, where the target operation path is composed of an operation control node sequence.
And a sending module 13, configured to send an execution instruction to the application program, so that the application program sequentially executes each operation control node in the target operation path.
The apparatus shown in fig. 4 can perform the method of the embodiment shown in fig. 1, and reference may be made to the related description of the embodiment shown in fig. 1 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 1, and are not described herein again.
Fig. 5 is a schematic structural diagram of a second embodiment of an application processing apparatus according to an embodiment of the present invention, and as shown in fig. 5, based on the embodiment shown in fig. 4, a sending module 13 in the application processing apparatus specifically includes:
the identifying unit 131 is configured to identify a page structure element included in a current page of the application program in combination with a preset page structure element database corresponding to the application program.
The node determining unit 132 is configured to determine, according to page structure elements respectively corresponding to each operation control node in the target operation path, an initial operation control node from each operation control node, where the page structure element corresponding to the initial operation control node is the same as a page structure element included in the current page.
The sending unit 133 is configured to send an execution instruction to the application program, so that the application program sequentially executes the remaining operation control nodes in the target operation path from the start operation control node.
The apparatus shown in fig. 5 can perform the method of the embodiment shown in fig. 2, and reference may be made to the related description of the embodiment shown in fig. 2 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 2, and are not described herein again.
Fig. 6 is a schematic structural diagram of a third embodiment of an application processing apparatus according to an embodiment of the present invention, as shown in fig. 6, based on the embodiment shown in fig. 5, the application processing apparatus further includes: a first obtaining module 21 and a generating module 22.
The node obtaining module 21 is configured to obtain an operation control node tree corresponding to the application program.
A generating module 22, configured to traverse the operation control node tree successively from a root node of the operation control node tree, so as to generate an operation path corresponding to the current traversal when the currently traversed operation control node satisfies a cut-off condition, where the cut-off condition includes: the currently traversed operation control node is a leaf node, or the page structure element corresponding to the currently traversed operation control node is the same as the page structure element corresponding to the operation control node traversed before the traversal.
Optionally, the application processing apparatus further includes: a second acquisition module 23.
The element obtaining module 23 is configured to, in the process of this traversal, obtain, for any traversed operation control node, an intersection between a page element included in a page displayed after the operation of the operation control node and a page structure element included in a preset page structure element database as a page structure element corresponding to the operation control node.
Optionally, the application processing apparatus further includes: a display module 24, a receiving module 25 and a storage module 26.
And the display module 24 is configured to display a page corresponding to each operation control node according to the traversal order of each operation control node in the operation path corresponding to this traversal.
And the receiving module 25 is configured to receive a function tag corresponding to the operation path corresponding to the traversal according to the displayed page input by the second user.
And the storage module 26 is used for storing the operation path and the function label corresponding to the traversal in an associated manner.
The apparatus shown in fig. 6 can perform the method of the embodiment shown in fig. 3, and reference may be made to the related description of the embodiment shown in fig. 3 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 3, and are not described herein again.
The internal functions and structures of the application processing apparatus are described above, and in one possible design, the structures of the application processing apparatus may be implemented as an electronic device. Fig. 7 is a schematic structural diagram of an electronic device according to a first embodiment of the present invention, and as shown in fig. 7, the electronic device includes: a processor 31, and a memory 32 connected to the processor. The memory 32 is used for storing a program of the electronic device for executing the application processing method provided in any of the above embodiments. The processor 31 is configured to execute a program stored in the memory 32, the program comprising one or more computer instructions, wherein the one or more computer instructions, when executed by the processor 31, enable the following steps to be performed:
receiving input voice of a first user;
determining a target operation path corresponding to the input voice from the generated operation paths corresponding to the application program according to the matching of the function labels corresponding to the operation paths and the input voice, wherein the target operation path consists of an operation control node sequence;
and sending an execution instruction to the application program so that the application program sequentially executes each operation control node in the target operation path.
Optionally, the processor 31 is further configured to perform all or part of the aforementioned method steps.
The electronic device may further include a communication interface 33 for communicating with other devices or a communication network.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above technical solutions may be embodied in the form of a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., which includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the various embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (8)
1. An application processing method, comprising:
receiving input voice of a first user;
determining a target operation path corresponding to the input voice from generated operation paths corresponding to an application program according to the matching of function labels corresponding to the operation paths and the input voice, wherein the target operation path consists of an operation control node sequence;
sending an execution instruction to the application program so that the application program sequentially executes each operation control node in the target operation path;
the sending an execution instruction to the application program to enable the application program to sequentially execute each operation control node in the target operation path includes:
identifying page structure elements contained in the current page of the application program by combining a preset page structure element database corresponding to the application program;
determining an initial operation control node from each operation control node according to a page structure element corresponding to each operation control node in the target operation path, wherein the page structure element corresponding to the initial operation control node is the same as the page structure element contained in the current page;
and sending an execution instruction to the application program so that the application program sequentially executes the rest operation control nodes in the target operation path from the starting operation control node.
2. The method of claim 1, further comprising:
acquiring an operation control node tree corresponding to the application program;
successively traversing the operation control node tree from the root node of the operation control node tree to generate an operation path corresponding to the traversal when the currently traversed operation control node meets a cut-off condition;
wherein the cutoff condition comprises: the currently traversed operation control node is a leaf node, or the page structure element corresponding to the currently traversed operation control node is the same as the page structure element corresponding to the operation control node traversed before the traversal.
3. The method of claim 2, further comprising:
in the process of the traversal, for any traversed operation control node, acquiring an intersection between a page element contained in a page displayed after the operation of the operation control node and a page structure element contained in the preset page structure element database as a page structure element corresponding to the operation control node.
4. The method of claim 2, wherein after generating the operation path corresponding to the traversal, further comprising:
displaying the page corresponding to each operation control node according to the traversal sequence of each operation control node in the operation path corresponding to the traversal;
receiving a function label corresponding to the operation path corresponding to the traversal according to the displayed page input by the second user;
and associating and storing the operation path corresponding to the traversal and the function label.
5. An application processing apparatus, comprising:
the receiving module is used for receiving input voice of a first user;
the path determining module is used for determining a target operation path corresponding to the input voice from generated operation paths corresponding to the application program according to the matching between the function labels respectively corresponding to the operation paths and the input voice, wherein the target operation path consists of an operation control node sequence;
a sending module, configured to send an execution instruction to the application program, so that the application program sequentially executes each operation control node in the target operation path;
the sending module specifically includes:
the identification unit is used for identifying page structure elements contained in the current page of the application program by combining a preset page structure element database corresponding to the application program;
a node determining unit, configured to determine, according to page structure elements corresponding to each operation control node in the target operation path, an initial operation control node from the operation control nodes, where a page structure element corresponding to the initial operation control node is the same as a page structure element included in the current page;
and the sending unit is used for sending an execution instruction to the application program so that the application program sequentially executes the rest operation control nodes in the target operation path from the starting operation control node.
6. The apparatus of claim 5, further comprising:
the node acquisition module is used for acquiring an operation control node tree corresponding to the application program;
the generating module is used for traversing the operation control node tree from the root node of the operation control node tree successively so as to generate an operation path corresponding to the traversal when the currently traversed operation control node meets a cut-off condition;
wherein the cutoff condition comprises: the currently traversed operation control node is a leaf node, or the page structure element corresponding to the currently traversed operation control node is the same as the page structure element corresponding to the operation control node traversed before the traversal.
7. The apparatus of claim 6, further comprising:
the display module is used for displaying the page corresponding to each operation control node according to the traversal sequence of each operation control node in the operation path corresponding to the traversal;
the receiving module is used for receiving a function tag which is input by a second user according to the displayed page and corresponds to the operation path corresponding to the traversal;
and the storage module is used for associating and storing the operation path corresponding to the traversal and the function label.
8. An electronic device, comprising: a processor, and a memory coupled to the processor;
the memory to store one or more computer instructions, wherein the one or more computer instructions are for the processor to invoke for execution;
the processor to execute the one or more computer instructions to implement the method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711463987.0A CN108153574B (en) | 2017-12-28 | 2017-12-28 | Application processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711463987.0A CN108153574B (en) | 2017-12-28 | 2017-12-28 | Application processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108153574A CN108153574A (en) | 2018-06-12 |
| CN108153574B true CN108153574B (en) | 2021-05-28 |
Family
ID=62462541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711463987.0A Active CN108153574B (en) | 2017-12-28 | 2017-12-28 | Application processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108153574B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113641280A (en) * | 2021-07-14 | 2021-11-12 | 阿里巴巴（中国）有限公司 | Equipment control method, control method and equipment in barrier-free mode |
| CN114463730B (en) * | 2021-07-15 | 2023-07-14 | 荣耀终端有限公司 | Page identification method and terminal equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9583097B2 (en) * | 2015-01-30 | 2017-02-28 | Google Inc. | Dynamic inference of voice command for software operation from help information |
| US9934782B2 (en) * | 2015-09-22 | 2018-04-03 | Meshrose Ltd. | Automatic performance of user interaction operations on a computing device |
| CN105551492A (en) * | 2015-12-04 | 2016-05-04 | 青岛海信传媒网络技术有限公司 | Speech control method, speech control device and terminal |
| CN107025046A (en) * | 2016-01-29 | 2017-08-08 | 阿里巴巴集团控股有限公司 | Terminal applies voice operating method and system |
| CN106325889A (en) * | 2016-09-30 | 2017-01-11 | 北京奇点机智信息技术有限公司 | Data processing method and device |
| CN107045873A (en) * | 2016-12-06 | 2017-08-15 | 深圳市全智达科技有限公司 | A kind of voice operating method and device |
| CN106898349A (en) * | 2017-01-11 | 2017-06-27 | 梅其珍 | A kind of Voice command computer method and intelligent sound assistant system |
-
2017
- 2017-12-28 CN CN201711463987.0A patent/CN108153574B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108153574A (en) | 2018-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11735182B2 (en) | Multi-modal interaction between users, automated assistants, and other computing services | |
| US20190068527A1 (en) | Method and system for conducting an automated conversation with a virtual agent system | |
| US10860289B2 (en) | Flexible voice-based information retrieval system for virtual assistant | |
| US10693827B2 (en) | Determining intended electronic message recipients via linguistic profiles | |
| CN110797022B (en) | Application control method, device, terminal and server | |
| CN108768824B (en) | Information processing method and device | |
| US10042840B2 (en) | Hybrid grammatical and ungrammatical parsing | |
| CN102945120B (en) | A kind of based on the human-computer interaction auxiliary system in children's application and exchange method | |
| CN108108094A (en) | A kind of information processing method, terminal and computer-readable medium | |
| JP6434640B2 (en) | Message display method, message display device, and message display device | |
| JP2020004382A (en) | Method and device for voice interaction | |
| EP4113357A1 (en) | Method and apparatus for recognizing entity, electronic device and storage medium | |
| CN112286485B (en) | Method and device for controlling application through voice, electronic equipment and storage medium | |
| CN110188185A (en) | Processing method, device, equipment and the storage medium of more wheel dialogues | |
| CA3166742A1 (en) | Method of generating text plan based on deep learning, device and electronic equipment | |
| CN116303962B (en) | Dialogue generation method, training method, device and equipment for deep learning model | |
| CN108153574B (en) | Application processing method and device and electronic equipment | |
| CN107622769B (en) | Number modification method and device, storage medium and electronic equipment | |
| CN108306813B (en) | Session message processing method, server and client | |
| CN114974253A (en) | Natural language interpretation method and device based on character image and storage medium | |
| CN106599179B (en) | Man-machine conversation control method and device integrating knowledge graph and memory graph | |
| CN107623620B (en) | Processing method of random interaction data, network server and intelligent dialogue system | |
| CN117112065A (en) | Large model plug-in calling method, device, equipment and medium | |
| CN110874176B (en) | Interaction method, storage medium, operating system and device | |
| CN112817463A (en) | Method, equipment and storage medium for acquiring audio data by input method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |