Disclosure of Invention
Aiming at the problems in the prior art, the invention provides an application management method, device and system based on voice control.
The invention provides an application management method based on voice control, which is characterized by comprising the following steps:
s101, receiving a first voice instruction;
s102, analyzing the first voice command and determining the service required by the user;
s103, generating a first control instruction according to the service;
s104, acquiring a first application matched with the corresponding service according to the first control instruction;
and S105, judging the use state of the user terminal, and starting the first application according to the use state of the user terminal.
Preferably, the analyzing the first voice command in step S102 further includes sending an automatic voice recognition request to a cloud server, and receiving an automatic voice recognition text returned by the cloud server; and sending a semantic analysis request to the cloud server, and receiving an analysis result returned by the cloud server.
Preferably, the first control instruction comprises an application tag, an application category, and/or an application attribute.
Preferably, the step S104 further includes:
according to the first control instruction, inquiring the installed application of the user terminal, and/or inquiring the application available for downloading in the associated application platform;
and acquiring a first application matched and corresponding to the service.
Preferably, the step S105 further includes:
judging whether a current operation interface of a user terminal is in a home screen interface or a second application operation interface, displaying one or more first application icons on the current operation interface of the user terminal in a floating manner, and receiving a second control instruction of a user, wherein the second control instruction indicates a first application to be loaded selected by the user; or setting the first application with the highest priority level as the first application to be loaded;
when the user is in a main screen interface, starting the first application to be loaded;
when the first application operation interface is in the second application operation interface, the correlation degree between the first application to be loaded and the first application is further judged, if the correlation degree is larger than or equal to a first threshold value, the first application operation interface to be loaded is displayed on the second application operation interface, wherein a first area of the first application operation interface is smaller than a second area of the second application operation interface; and if the correlation degree is smaller than a first threshold value, starting the first application to be loaded, and displaying the first application operation interface in a full screen mode.
The present invention also provides an application management device based on voice control, which is characterized in that the device comprises:
the input module receives a first voice instruction;
the analysis module is used for analyzing the first voice command and determining the service required by the user;
the conversion module generates a first control instruction according to the service;
the application acquisition module is used for acquiring a first application matched with the corresponding service according to the first control instruction;
and the control module is used for judging the use state of the user terminal and starting the first application according to the use state of the user terminal.
Preferably, the parsing module is further configured to send an automatic speech recognition request to the cloud server, and receive an automatic speech recognition text returned by the cloud server; and sending a semantic analysis request to the cloud server, and receiving an analysis result returned by the cloud server.
Preferably, the first control instruction comprises an application tag, an application category, and/or an application attribute.
Preferably, the application acquisition module is further configured to:
according to the first control instruction, inquiring the installed application of the user terminal, and/or inquiring the application available for downloading in the associated application platform;
and acquiring a first application matched and corresponding to the service.
Preferably, the control module is further configured to:
judging whether the current operation interface of the user terminal is in a home screen interface or a second application operation interface, displaying the at least one or more first application icons on the current operation interface of the user terminal in a floating manner, and receiving a second control instruction of a user, wherein the second control instruction indicates a first application to be loaded selected by the user; or setting the first application with the highest priority level as the first application to be loaded;
when the user is in a main screen interface, starting the first application to be loaded;
when the first application operation interface is in the second application operation interface, the relevance between the first application to be loaded and the second application is judged, if the relevance is larger than or equal to a first threshold value, the first application operation interface to be loaded is displayed on the second application operation interface, wherein a first area of the first application operation interface is smaller than a second area of the second application operation interface; and if the correlation degree is smaller than a first threshold value, starting the first application to be loaded, and displaying the first application operation interface in a full screen mode.
The invention also provides a terminal device, characterized in that it comprises a processor and a memory, in which a computer program is stored that is executable on the processor, said computer program implementing the method as described above when executed by the processor.
The invention also provides a computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program is executable on a processor, and when executed implements the method as described above.
By the method, the application programs (APP) installed or needing to be installed in the current terminal can be searched and displayed through voice, combination of VUI control and GUI display is achieved, requirements of users are met better, and user experience is improved.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The embodiments and specific features of the embodiments of the present invention are detailed descriptions of technical solutions of the embodiments of the present invention, and are not limited to technical solutions of the present invention, and the technical features of the embodiments and the embodiments of the present invention may be combined with each other without conflict.
The method of the present invention can be applied to any device or equipment with voice assistant, such as computers, mobile terminals, car machines, etc.
Example one
Referring to fig. 1, an embodiment of the present invention provides a method for managing an application based on voice control, where the method includes:
s101, receiving a first voice instruction;
s102, analyzing the first voice command and determining the service required by the user;
s103, generating a first control instruction according to the service;
s104, acquiring a first application matched with the corresponding service according to the first control instruction;
and S105, judging the use state of the user terminal, and starting the first application according to the use state of the user terminal.
Preferably, the step S101 further includes receiving an instruction of the user through a voice assistant. For example, user speech input: "what good restaurant is hungry".
Preferably, the analyzing of the first voice command in step S102 may be performed locally or at a cloud server, and if the analyzing is performed at the cloud server, the analyzing may further include sending an automatic voice recognition request to the cloud server, and receiving an automatic voice recognition text returned by the cloud server; and sending a semantic analysis request to the cloud server, and receiving an analysis result returned by the cloud server.
For example, for the voice input of the user, that the user has a good restaurant and is hungry, the service required by the user is determined to be searching for food recommendation by analyzing the voice instruction of the user.
Preferably, the first control instruction comprises an application tag, an application category, and/or an application attribute.
The step S103 may further include: according to the determined service required by the user, for example, the user needs food recommendation, at this time, a food map or APP of a food application needs to be started, and based on the requirement, a first control instruction is generated, wherein the instruction comprises an application label, an application category and/or an application attribute.
In particular, an application tag, an application category, and/or an application attribute may be carried in a data field of the first control instruction.
Preferably, the step S104 further includes:
according to the first control instruction, inquiring the installed application of the user terminal, and/or inquiring the application available for downloading in the associated application platform; and acquiring a first application matched and corresponding to the service.
Specifically, the APP may be matched in the locally installed application program according to the application tag, the application category, and/or the application attribute carried in the first control instruction, for example, APPs such as public comment, delicious food, and food color that have been installed by the user are obtained, and if it is found that the user does not install the matched APP after the query, the APP may be obtained through a related application platform, and if the platform provides the download of APPs such as public comment and food, the download path of the APPs may be obtained.
Preferably, referring to fig. 2, the step S105 further includes:
judging whether the current operation interface of the user terminal is in a home screen interface or a second application operation interface, displaying the one or more first application icons in a floating mode on the home screen interface or the second application operation interface, and receiving a second control instruction of a user, wherein the second control instruction indicates a first application to be loaded selected by the user; or setting the first application with the highest priority level as the first application to be loaded;
when the user is in a main screen interface, starting the first application to be loaded;
when the first application operation interface is in the second application operation interface, the relevance between the first application to be loaded and the second application is judged, if the relevance is larger than or equal to a first threshold value, the first application operation interface to be loaded is displayed on the second application operation interface, wherein a first area of the first application operation interface is smaller than a second area of the second application operation interface; and if the correlation degree is smaller than a first threshold value, starting the first application to be loaded, and displaying the first application operation interface in a full screen mode.
Specifically, whether the user terminal is in a home screen interface or in an operation interface of other applications is judged; for example, whether in a home screen interface or an operation interface of another application, for example, when the user is opening a navigation APP or a movie playing APP.
If the mobile terminal is in the home screen interface, the at least one or more first application icons are displayed in a suspended mode in the home screen, if the number of the obtained currently available applications is larger than or equal to 2, if the number of the obtained currently available applications is 3, for example, a popular comment APP, a meal APP, a food color APP and the like are displayed in a suspended mode, and the display mode can adopt a plurality of modes such as a roulette mode, a tiled mode, a listing mode or a rolling mode. Further, the multiple APPs may be prioritized, the priorities of the APPs are calculated by using parameters such as a use frequency, a user evaluation value, a friend use frequency, or a friend recommendation value, the APP with the highest priority is determined, the APP is highlighted, the APP with the highest priority is displayed by using a larger icon, or the APP icon with the highest priority is displayed in the first item of a tile or a list, or the APP icon is displayed with a frame. And if the number of the obtained currently available applications is 1, for example, only the matched application is obtained to be the popular comment APP, directly displaying a popular comment APP icon on the current interface. Those skilled in the art will appreciate that when the general public reviews APP at this point as the only first application acquired, it is equivalent to having the highest priority.
If the second application operation interface, such as the navigation APP navigation interface in the front or the movie playing APP playing interface, is in the same manner as the home screen interface, the at least one or more first application icons are displayed in a floating manner on the interface, and the specific display manner may be the same as the foregoing display manner.
The user can select a certain application according to the displayed application and further load the selected first application, and a second control instruction of the user can be received, wherein the second control instruction indicates the first application to be loaded selected by the user; or preferably or setting the first application with the highest priority level as the first application to be loaded, so as to directly load the first application with the highest priority level.
Specifically, the current operation interface is a home screen interface or a second application operation interface, and there is a difference in how to start the first application to be loaded:
under the condition of being in the home screen interface, for example, the first application to be loaded is the public commenting APP, the public commenting APP is directly opened to enter the operation of the APP.
In the case of an operation interface of another application, for example, when the user is using navigation, the relevance of the current application and the application to be opened is further determined. The degree of correlation may be calculated according to parameters such as the type of application, the frequency of use of successive switching, etc., for example, the higher the frequency of switching back and forth between using the first application and the second application, the higher the degree of correlation between the two. When the relevance exceeds a certain threshold, the first application and the second application which need to be loaded can be considered to have the probability of foreground and background switching, the first application can be loaded at the moment, the first application operation interface is displayed on the second application operation interface, the display area of the first application operation interface is smaller than that of the second application operation interface, for example, for the previous example, when a user is in a navigation interface, the relevance of the public comment which needs to be opened and the navigation is higher, the navigation is not directly converted into the background and the public comment is opened, and the public comment is displayed in the first area smaller than the display area of the navigation interface. The two applications can be selected by the user to switch the display area, for example, the user sends a voice command, or a control command to switch the currently operating focus area. Thereby facilitating visibility of interaction between subsequent programs. For example, the user may select a destination on the navigation page, which is defined as an area range defined by the popular comment food search.
In addition, before step S105, the obtained matched applications may be sorted or stored directly according to the user voice instruction, for example, a plurality of applications that meet the food recommendation, such as popular comment, delicious food, food color, meal, etc., may be found. The classification instruction of the user can be automatically classified and moved to the same folder, so that subsequent searching and calling are facilitated.
Example two
Referring to fig. 3, the present invention further provides an application management apparatus based on voice control, wherein the apparatus includes:
the input module receives a first voice instruction;
the analysis module is used for analyzing the first voice command and determining the service required by the user;
the conversion module generates a first control instruction according to the service;
the application acquisition module is used for acquiring a first application matched with the corresponding service according to the first control instruction;
and the control module is used for judging the use state of the user terminal and starting the first application according to the use state of the user terminal.
Preferably, the parsing module is further configured to send an automatic speech recognition request to the cloud server, and receive an automatic speech recognition text returned by the cloud server; and sending a semantic analysis request to the cloud server, and receiving an analysis result returned by the cloud server.
Preferably, the first control instruction comprises an application tag, an application category, and/or an application attribute.
Preferably, the application acquisition module is further configured to:
according to the first control instruction, inquiring the installed application of the user terminal, and/or inquiring the application available for downloading in the associated application platform;
and acquiring a first application matched and corresponding to the service.
Preferably, the control module is further configured to:
judging whether the current operation interface of the user terminal is in a home screen interface or a second application operation interface, displaying the at least one or more first application icons in a floating manner on the home screen interface or the second application operation interface, and receiving a second control instruction of a user, wherein the second control instruction indicates a first application to be loaded selected by the user; or setting the first application with the highest priority level as the first application to be loaded;
when the user is in a main screen interface, starting the first application to be loaded;
when the first application operation interface is in the second application operation interface, the relevance between the first application to be loaded and the second application is judged, if the relevance is larger than or equal to a first threshold value, the first application operation interface to be loaded is displayed on the second application operation interface, wherein a first area of the first application operation interface is smaller than a second area of the second application operation interface; and if the correlation degree is smaller than a first threshold value, starting the first application to be loaded, and displaying the first application operation interface in a full screen mode.
The invention provides a terminal device, characterized in that the terminal device comprises a processor and a memory, in which a computer program is stored that is executable on the processor, which computer program, when executed by the processor, implements the method as described above.
The invention provides a computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program is executable on a processor, and when executed implements a method as described above.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. The computer-readable storage medium may include: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, or a combination thereof.
The above description is only an example for the convenience of understanding the present invention, and is not intended to limit the scope of the present invention. In the specific implementation, a person skilled in the art may change, add, or reduce the components of the apparatus according to the actual situation, and may change, add, reduce, or change the order of the steps of the method according to the actual situation without affecting the functions implemented by the method.
While embodiments of the invention have been shown and described, it will be understood by those skilled in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents, and all changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.