CN110908629A

CN110908629A - Electronic equipment operation method and device, electronic equipment and storage medium

Info

Publication number: CN110908629A
Application number: CN201911130231.3A
Authority: CN
Inventors: 陈胤立; 吴华; 范宏伟
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2019-11-18
Filing date: 2019-11-18
Publication date: 2020-03-24

Abstract

The disclosure relates to an electronic device operation method, an electronic device operation device, an electronic device and a storage medium, and belongs to the technical field of electronic devices. The method comprises the following steps: receiving a first voice signal; determining a first operation instruction of the first voice signal and a target application category for executing the first operation instruction; calling a first target application program with an application type being the target application type according to the target application type; and executing the operation corresponding to the first operation instruction through the first target application program. The electronic equipment can determine the first operation instruction and the target application category through the received first voice signal, call the first target application program belonging to the target application category, and execute the operation corresponding to the first operation instruction through the first target application program, so that a user can realize the operation on the application program without complex operation, and the operation efficiency and the interaction experience are improved.

Description

Electronic equipment operation method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of electronic devices, and in particular, to an electronic device operating method and apparatus, an electronic device, and a storage medium.

Background

Along with the development of electronic equipment technology, the application on the electronic equipment becomes more and more, and great convenience is brought to the life of users. For example, the electronic device has a take-away application, a navigation application, or a taxi-taking application.

When the user needs to take out, the user can click the take-out application on the electronic equipment and then select an order form on the take-out application for payment; when a user needs to navigate, a navigation application on the electronic equipment can be clicked, and a destination is input on the navigation application for navigation; when a user needs to take a taxi, the taxi taking application on the electronic equipment can be clicked, and the driver can be selectively called on the taxi taking application.

Disclosure of Invention

In order to solve the problem that an interaction process between a user and an electronic device is complex in the related art, the present disclosure provides an electronic device operation method, an apparatus, an electronic device, and a storage medium. The technical scheme is as follows:

according to an aspect of the embodiments of the present disclosure, there is provided an electronic device operating method, the method including:

receiving a first voice signal;

determining a first operation instruction of the first voice signal and a target application category for executing the first operation instruction;

calling a first target application program with an application type being the target application type according to the target application type;

and executing the operation corresponding to the first operation instruction through the first target application program.

In a possible implementation manner, the invoking a first target application program of which an application class is the target application class according to the target application class includes:

acquiring at least one application program corresponding to the target application type according to the target application type;

selecting the first target application from the at least one application;

and calling the first target application program.

In another possible implementation manner, the selecting the first target application from the at least one application includes:

determining a target object according to the first operation instruction, wherein the target object is an object operated by the first operation instruction; and when an interface element in the program interface of any application program contains the target object, taking the application program as the first target application program.

acquiring a historical operation record, wherein the historical operation record comprises at least one second operation instruction and an application program for executing each second operation instruction;

selecting a second operation instruction comprising the same instruction action as the first operation instruction from the at least one second operation instruction;

and selecting an application program for executing the second operation instruction from the at least one application program, and taking the selected application program as the first target application program.

outputting a prompt signal for prompting a user to select the first target application from the at least one application;

receiving a second voice signal;

selecting the first target application indicated by the second voice signal from the plurality of applications.

In another possible implementation manner, the invoking the first target application includes:

calling a second target application program which is installed locally, wherein the second target application program comprises an application interface of the first target application program which is not installed locally;

and locally running the first target application program through the application interface of the first target application program.

In another possible implementation manner, the first operation instruction includes an operation event and event information; the executing, by the first target application program, the operation corresponding to the first operation instruction includes:

when the operation event is a purchase event, searching an interface element matched with the event information from an application interface of the first target application program according to the event information, and executing the purchase event according to the interface element; alternatively, the first and second electrodes may be,

when the operation event is a navigation event, acquiring the current position, and determining a target position matched with the event information according to the event information; and displaying a navigation interface of the first target application program, wherein the starting position in the navigation interface is set as the current position, and the end position is set as the target position.

In another possible implementation manner, the determining a first operation instruction of the first voice signal and a target application class for executing the first operation instruction includes:

sending the first voice signal to a server, wherein the server is used for identifying the first voice signal to obtain the first operation instruction and the target application category;

and receiving the first operation instruction and the target application category returned by the server.

According to another aspect of the embodiments of the present disclosure, there is provided an apparatus operated by an electronic device, the apparatus including:

the receiving module is used for receiving a first voice signal;

a determining module, configured to determine a first operation instruction of the first voice signal and a target application category for executing the first operation instruction;

the calling module is used for calling a first target application program with an application type being the target application type according to the target application type;

and the execution module is used for executing the operation corresponding to the first operation instruction through the first target application program.

In a possible implementation manner, the calling module is further configured to obtain, according to the target application category, at least one application program corresponding to the target application category; selecting the first target application from the at least one application; and calling the first target application program.

In another possible implementation manner, the calling module is further configured to determine a target object according to the first operation instruction, where the target object is an object operated by the first operation instruction; and when an interface element in the program interface of any application program contains the target object, taking the application program as the first target application program.

In another possible implementation manner, the calling module is further configured to obtain a historical operation record, where the historical operation record includes at least one second operation instruction and an application program that executes each second operation instruction; selecting a second operation instruction comprising the same instruction action as the first operation instruction from the at least one second operation instruction; and selecting an application program for executing the second operation instruction from the at least one application program, and taking the selected application program as the first target application program.

In another possible implementation manner, the invoking module is further configured to output a prompt signal, where the prompt signal is used to prompt a user to select the first target application program from the at least one application program; receiving a second voice signal; selecting the first target application indicated by the second voice signal from the plurality of applications.

In another possible implementation manner, the calling module is further configured to call a second target application installed locally, where the second target application includes an application interface of the first target application that is not installed locally; and locally running the first target application program through the application interface of the first target application program.

In another possible implementation manner, the first operation instruction includes an operation event and event information; the execution module is further configured to, when the operation event is a purchase event, search an interface element matched with the event information from an application interface of the first target application program according to the event information, and execute the purchase event according to the interface element; or when the operation event is a navigation event, acquiring the current position, and determining a target position matched with the event information according to the event information; and displaying a navigation interface of the first target application program, wherein the starting position in the navigation interface is set as the current position, and the end position is set as the target position.

In another possible implementation manner, the determining module is further configured to send the first voice signal to a server, where the server is configured to identify the first voice signal to obtain the first operation instruction and the target application category; and receiving the first operation instruction and the target application category returned by the server.

According to another aspect of the embodiments of the present disclosure, there is provided an electronic device, wherein the mobile electronic device includes:

one or more processors;

volatile or non-volatile memory for storing the one or more processor-executable instructions;

wherein the one or more processors are configured to:

receiving a first voice signal;

According to another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, in which at least one instruction is stored, and the at least one instruction is loaded and executed by a processor to implement the operation executed in the above-mentioned electronic device operation method.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

The beneficial effects brought by the technical scheme provided by the embodiment of the disclosure at least comprise:

in the embodiment of the disclosure, the electronic device may determine the target application category of the first voice signal through the first voice signal, and determine the first target application from the first target category. Therefore, the first operation instruction can be executed in the first target application according to the first voice signal, so that the user does not need to perform multiple clicking operations, and the interaction experience of the user is improved.

In addition, the electronic equipment selects the first target application program of which the interface element contains the event information from the at least one application program according to the event information, so that the electronic equipment can determine the first target application program according to the event information, and the interaction experience of the user is improved;

in addition, as the electronic equipment selects the second operation instruction with the same operation event as the first operation instruction and the application program executing each second operation instruction from the historical operation record through the first operation instruction of the first voice signal, the second operation instruction and the application program are used as the first target application program, the first target application program is determined more conveniently, and the interaction experience of the user is improved;

in addition, the electronic equipment outputs a prompt signal to prompt the user to select the first target application program from the at least one application program and determines the first target application program according to the second voice signal, so that the determined application program is more appropriate for the requirements of the user, and the interactive experience of the user is improved

In addition, the electronic equipment achieves the purpose of calling the first target application program by calling the application interface of the first target application program which is not installed locally in the second target application program, so that the occupied space of the electronic equipment is reduced, and the user experience is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a schematic diagram of an implementation environment shown in accordance with an exemplary embodiment;

FIG. 2 is a flow chart illustrating a method of operation of an electronic device in accordance with an exemplary embodiment;

FIG. 3 is a flow chart illustrating a method of operation of an electronic device in accordance with an exemplary embodiment;

FIG. 4 is a block diagram illustrating a fast application framework in accordance with an exemplary embodiment;

FIG. 5 is a flowchart illustrating the launching of a fast application, according to an exemplary embodiment;

FIG. 6 is a flow chart illustrating an apparatus for electronic device operation in accordance with an exemplary embodiment;

fig. 7 is a block diagram illustrating a structure of an electronic device according to an example embodiment.

Detailed Description

In order to make the technical solutions and advantages of the present disclosure clearer, the following describes embodiments of the present disclosure in further detail.

The embodiment of the disclosure provides an electronic device operation method, an electronic device operation device, an electronic device and a storage medium, and the disclosure is described in detail below with reference to the accompanying drawings.

Quick application: the application program is a novel application program and can run based on a native API (application programming Interface) provided by an operating system. The fast application is developed by adopting a unified standard, is rendered as native, and has the double advantages of an HTML5(Hyper Text Markup Language, 5 th generation) interface and native application. The framework of the fast application can be deeply integrated in an operating system, can operate at the level of the operating system, and realizes seamless connection with other application services. The developer can operate on different types of equipment by one-time development, and can use the equipment without downloading and installation by a user, namely, the equipment is used on point.

Due to the specificity of fast applications, fast applications are expected to perform more tasks and perform more functions. At present, in the process of gradually improving the functions of the fast application, the embodiment of the present disclosure provides a new function of the fast application, and the new function is utilized to implement automatic recognition of an operation instruction corresponding to a voice signal of a user and execute an operation corresponding to the operation instruction, thereby expanding the functions of the fast application and improving the processing capability and the practicability of the fast application.

FIG. 1 is a schematic diagram illustrating one implementation environment in accordance with an example embodiment. Referring to fig. 1, the implementation environment includes an electronic device 101 and a server 102, and the electronic device 101 and the server 102 may be connected through a wireless or wired network.

The electronic device 101 may be a television, a computer, a mobile phone, a tablet computer, or other electronic device. A second target application may be installed on the electronic device 101, and the server 102 may provide a background service for the second target application, that is, the server 102 is a background server corresponding to the second target application. The server 102 may be a server, a server cluster formed by several servers, or a cloud computing center.

The second target application may be an application preset in an operating system of the electronic device 101, or may be an application provided by a third party. For example, the second target application may be an application such as an application download center or a fast application center. The second target application may have an application interface of the first target application provided therein. The electronic device 101 may quickly start the first target application through the application interface of the first target application. The first target application may be any application that is not installed on the electronic device 101. The first target application may be a fast application. For example, the first target application program may be a shopping block application, a music block application, a take-away block application, a video block application, a social block application, a browser block application, or the like, which provides an arbitrary service to the user.

FIG. 2 is a flow chart illustrating a method of operation of an electronic device according to an exemplary embodiment, as shown in FIG. 2, including the steps of:

in step S201, the electronic device receives a first voice signal.

In step S202, the electronic device determines a first operation instruction of the first voice signal and a target application class for executing the first operation instruction.

In step S203, the electronic device invokes a first target application program with an application category being a target application category according to the target application category.

In step S204, the electronic device executes an operation corresponding to the first operation instruction through the first target application.

In the embodiment of the disclosure, the electronic device may determine the first operation instruction and the target application category through the received first voice signal, call the first target application program belonging to the target application category, and execute the operation corresponding to the first operation instruction through the first target application program, so that the user may implement the operation on the application program without complicated operations, thereby improving the operation efficiency and the interaction experience.

In one possible implementation manner, according to the target application category, invoking a first target application program of which the application category is the target application category includes:

selecting a first target application program from at least one application program;

the first target application is invoked.

In another possible implementation, selecting a first target application from at least one application includes:

determining a target object according to the first operation instruction, wherein the target object is an object operated by the first operation instruction;

and when the interface element in the program interface of any application program contains the target object, taking the application program as a first target application program.

selecting a second operation instruction comprising the same instruction action as the first operation instruction from at least one second operation instruction;

outputting a prompt signal for prompting a user to select a first target application program from at least one application program;

receiving a second voice signal;

the first target application indicated by the second voice signal is selected from the plurality of applications.

In another possible implementation, invoking the first target application includes:

the first target application is run locally through an application interface of the first target application.

In another possible implementation manner, the first operation instruction includes an operation event and event information; executing the operation corresponding to the first operation instruction through the first target application program, wherein the operation comprises the following steps:

when the operation event is a navigation event, acquiring the current position, and determining a target position matched with the event information according to the event information; and displaying a navigation interface of the first target application program, setting a starting position in the navigation interface as a current position, and setting an end position as a target position.

In another possible implementation manner, determining a first operation instruction of the first voice signal and a target application class for executing the first operation instruction includes:

sending a first voice signal to a server, wherein the server is used for identifying the first voice signal to obtain a first operation instruction and a target application type;

FIG. 3 is a flow chart illustrating a method of operation of an electronic device according to an exemplary embodiment, as shown in FIG. 3, including the steps of:

in step S301, the electronic device receives a first voice signal.

The first voice signal is a voice signal sent by a user, and the electronic equipment can receive the voice signal sent by the user through the voice receiving component. For example, when the user wants to take a sale, a voice signal "i want to buy" may be emitted, and the electronic device may receive the voice signal through a microphone. When a user wants to navigate using a map, a voice signal "i want to go" may be emitted, and the electronic device may receive the voice signal. When the user wants to chat in video, a voice signal of 'i want and video' can be sent out, and the electronic equipment can receive the voice signal.

The first voice signal may also be a voice signal input by a user through other electronic devices, and the electronic device may obtain the voice signal forwarded by the other electronic devices through a communication protocol between the devices. The other electronic equipment can be an intelligent sound box, an external microphone and the like.

In addition, when the electronic device receives the first voice signal sent by the user, the electronic device may display a main interface of the electronic device, and may also display a program interface of any application program. The application program may be a fast application program, or may include application interfaces of a plurality of fast applications.

In step S302, the electronic device determines a first operation instruction of the first voice signal and a target application class for executing the first operation instruction.

In the embodiment of the disclosure, the electronic device may perform speech recognition on the first speech signal, and determine, according to the recognized text content, a first operation instruction and a corresponding application scenario included in the first speech signal. The application scene can be a shopping scene, a navigation scene and the like.

In a possible implementation manner, the electronic device may perform speech recognition on the first speech signal, and determine, according to a keyword in the recognized text content, a first operation instruction and a corresponding application scenario included in the first speech signal. Wherein the keyword may be a verb corresponding to the application scenario. For example: the verb "buy" corresponds to the first operation instruction "buy x merchandise", and the corresponding application scenario is a shopping scenario; the verb "go" corresponds to the first operation instruction being "go place", and the corresponding application scenario is a navigation scenario.

It should be noted that the electronic device may determine, according to the application scenario, a target application category corresponding to the application scenario; the target application category may be a shopping application, a navigation application, and the like.

In a possible implementation manner, a plurality of application scenarios are stored in the electronic device, and a target application category for executing the first operation instruction included in the first voice signal may be determined according to the application scenario corresponding to the first voice signal. The application programs in the electronic equipment can be divided into different target application categories according to application scenes. For example, "a map", "B navigation", and the like are applied to an application program of a navigation scene, and the application category thereof is a navigation application; the application program of the shopping scene such as 'A east', 'B treasure' and the like has the application category of shopping application.

Correspondingly, when the text information obtained after the electronic device performs voice recognition on the first voice signal is 'buy', the electronic device can determine that the scene corresponding to the first voice signal is a shopping scene, and determine that the target application type is shopping application according to the shopping scene.

In another possible implementation manner, after determining the first operation instruction, the electronic device may further determine a preamble instruction of the first operation instruction. For example, the first operation command is "buy × merchandise", and the preamble command of the first operation command is "open XX application", "search × merchandise", "select × merchandise", "submit × merchandise", and the like. For another example, the first operation instruction is "go place", and the preamble of the first operation instruction is "open YY application", "search place", "select place", "navigate place", and the like.

In a possible implementation manner, a second target application is installed in the electronic device, and an application interface of the first target application may be provided in the second target application. A plurality of application scenes and a target application category corresponding to each scene are stored in a second target application program. Correspondingly, the electronic equipment receives the first voice signal, performs voice recognition on the first voice signal, determines a first operation instruction and a corresponding application scene included in the first voice signal, and determines a target application category in the second target application program according to the application scene. Wherein the second target application may be a "fast application center". The "fast application center" contains application interfaces for a plurality of locally uninstalled applications.

In another possible implementation manner, the electronic device may further send the received first voice signal to a server, the server identifies the first voice signal to obtain a first operation instruction and a target application category, the first operation instruction and the target application category are carried by communication information, the electronic device receives the communication information, and the communication information is analyzed to obtain the first operation instruction and the target application category.

In step S303, the electronic device obtains at least one application program corresponding to the target application type according to the target application type.

In an example of the present disclosure, a plurality of application programs that may be included in an electronic device may belong to a plurality of application categories, and each application category may include at least one application program. Correspondingly, the target application category also includes at least one application program.

For example, when the target application class is a compute class application, the compute class application includes one application program, i.e., a calculator. When the target application category is a navigation category application, the navigation category application includes a plurality of application programs such as "a map", "B map", and "C navigation", and the like.

In step S304, the electronic device selects a first target application from at least one application.

In the embodiment of the disclosure, when the target application category corresponds to only one application program, the electronic device may directly use the application program as the first target application program; when the target application category corresponds to two or more application programs, the electronic device may select one application program from the two or more application programs as the first target application program.

In one possible implementation, the first target application may be selected according to a target object included in the first operation instruction. Correspondingly, the steps can be as follows: the electronic equipment can determine a target object according to the first operation instruction, wherein the target object is an object operated by the first operation instruction. When the interface element in the program interface of any application program contains the target object, the electronic equipment can take the application program as a first target application program.

The target object is an object indicated by an entity vocabulary in the text content corresponding to the first operation instruction. For example, when the text content corresponding to the first operation instruction is "buy a commodity", the commodity a is a target object, the electronic device searches an interface element in a program interface of at least one application program, and the application program containing the commodity a in the interface element is used as the first target application program. For another example, when the text content corresponding to the first operation instruction is "call to the sheetlet", the sheetlet is the target object, the electronic device searches the interface element in the program interface of the at least one application program, and the application program containing the sheetlet in the interface element is the first target application program.

In the embodiment of the disclosure, the terminal selects the interface element from the at least one application program according to the target object, wherein the interface element comprises the first target application program of the target object, so that the electronic device can accurately determine the first target application program, and the interaction experience of the user is improved.

In one possible implementation, the electronic device may record historical operations of the user to select the first target application. Correspondingly, the steps can be as follows: the electronic device may obtain a historical operation record including at least one second operation instruction and an application program executing each second operation instruction. The electronic device may select a second operation instruction including the same instruction action as the first operation instruction from the at least one second operation instruction. And the electronic equipment selects the first target application program from at least one application program corresponding to the second operation instruction.

The second operation instruction is an operation instruction executed by the electronic device in historical time, and the historical operation record comprises a corresponding relation between the second operation instruction and the application program. The command action is an action corresponding to the target object. Such as "buy", "go", and "make a call", etc.

It should be noted that, in the history operation record, only the application program selected by the user when the user executed the second operation instruction last time may be saved, so that the electronic device may directly obtain the first target application program after determining the second operation instruction including the same instruction action as the first operation instruction.

For example, if the instruction action included in the second operation instruction is "go", and the application program corresponding to the second operation instruction is "a map", the electronic device stores the correspondence between the second operation instruction and the "a map" in the history operation record, and if the first operation instruction is "go", determines the instruction action as the "go" second operation instruction, and obtains the "a map" corresponding to the second operation instruction.

It should be noted that the historical operation record may also store the application program selected by the user when the second operation instruction is executed in the history. The electronic device may determine the first target application based on a number of times each application was selected.

For example, when the second operation instruction is executed historically, the number of times the user selects the application of "a map" is M times, and the number of times the user selects the application of "B navigation" is N times. Wherein M, N is a positive integer. When M > N, the electronic device selects "A map" as the first target application.

In the embodiment of the disclosure, the terminal selects the second operation instruction having the same instruction action as the first operation instruction from the historical operation record through the first operation instruction of the first voice signal, so as to determine the first target application program, determine the first target application program more conveniently and quickly, and improve the interaction experience of the user.

In one possible implementation, the electronic device may determine the first target application according to a selection operation of a user. Correspondingly, the steps can be as follows: the electronic equipment outputs a prompt signal for prompting a user to select a first target application program from at least one application program. The electronic equipment receives the second voice signal and selects the first target application program indicated by the second voice signal from the plurality of application programs.

The prompt signal can be voice information sent by the electronic equipment, and the user can select according to the voice information. For example, when the first voice signal is "go to a location", the application programs acquired by the electronic device are "a map" and "B navigation", the electronic device outputs "whether to use a map? "is used to indicate the voice information. The prompt signal can also be a text message sent by the electronic equipment, and the user can select according to the text message. For example, when the first voice signal is "go to a location", the application programs acquired by the electronic device are "a map" and "B navigation", the electronic device outputs "whether to use a map? "is used for the text message. In the embodiment of the present invention, the content of the cue signal is not limited.

The second voice signal may be a response to the prompt signal or other indicative voice. For example, the second voice information may also be "navigate using B". In the embodiment of the present invention, the content of the second speech signal is not limited.

Additionally, the second speech signal may be recognized by the electronic device. Accordingly, the electronic device selects the first target application indicated by the second voice signal from the plurality of applications, and comprises: the electronic equipment identifies the second voice signal to obtain a third operation instruction; and according to the third operation instruction, selecting the first target application program indicated by the second voice signal from the plurality of application programs.

Of course, the electronic device may also send the second voice signal to the server, and the server recognizes the second voice signal. And the electronic equipment receives the third operation instruction and the target application category returned by the server.

In step S305, the electronic device calls a first target application.

In an embodiment of the present disclosure, the electronic device may invoke the first target application in a locally installed application. For example, when the first target application called by the electronic device is "a map", the electronic device has an application calling "a map" among locally installed applications.

In one possible implementation manner, the electronic device may call a second target application installed locally, where the second target application includes an application interface of the first target application that is not installed locally. The electronic device may run the first target application through an application interface of the first target application.

Wherein the second target application may be a "fast application center". The 'fast application center' comprises application interfaces of a plurality of local uninstalled application programs; when the application interface of the first target application program is contained in the 'fast application center', the electronic equipment calls the 'fast application center', and the first target application program is started through the application interface of the first target application program in the 'fast application center'.

In the embodiment of the disclosure, the terminal outputs the prompt signal to prompt the user to select the first target application program from the at least one application program, and the first target application program is determined through the second voice signal, so that the requirements of the user are met, and the interaction experience of the user is improved.

In step S306, the electronic device executes an operation corresponding to the first operation instruction through the first target application.

After determining the first target application program, the electronic device may execute an operation corresponding to the first operation instruction in the first target application program, for example, when the first operation instruction is "buy × merchandise", the first target application program may add "buy × merchandise" to the shopping cart.

In one possible implementation, the first operation instruction further includes an operation event and event information. The operation event may be an event corresponding to the first operation instruction, such as an event corresponding to "buy" is a purchase event, an event corresponding to "go" is a navigation event, a social event corresponding to "chat" and the like; the event information refers to information of an object corresponding to the operation event, for example, an interface element corresponding to the object in the purchase event, a target position of the object in the navigation event, and the like.

In a possible implementation manner, when the operation event is a purchase event, correspondingly, the electronic device executes an operation corresponding to the first operation instruction through the first target application program, and the following steps are performed: and the electronic equipment searches the interface elements matched with the event information from the application interface of the first target application program according to the event information. The electronic device executes the purchase event according to the interface element.

For example, when the electronic device selects a first target application program, the first target application program is run; the interface element may be a specific commodity name and commodity information. Correspondingly, the electronic equipment opens an interface matched with the event information in the first target application program, and the interface comprises various interface elements, namely various commodities. The electronic device searches the interface elements matched with the event information from the multiple interface elements, namely searches the commodities in the event information from the multiple commodities. For example, when the event information is information of "article a", the electronic device opens an interface containing "article a" in the first target application, searches for "article a" from various articles in the interface, and adds the article to the shopping cart.

In another possible implementation manner, when the operation event is a navigation event, correspondingly, the electronic device executes an operation corresponding to the first operation instruction through the first target application program, and the method may be implemented by the following steps: the electronic equipment acquires the current position and determines the target position matched with the event information according to the event information. The electronic equipment displays a navigation interface of the first target application program, wherein the starting position in the navigation interface is set as the current position, and the end position is set as the target position.

For example, when the operation event is a navigation event, the electronic device acquires the current position and determines the target position of the destination object according to the event information. The electronic device displays a navigation interface on a navigation interface of the first target application. Wherein, the starting position is set as the current position, and the end position is the target position.

All the above possible technical solutions can be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.

The fast Application related in the embodiments of the present disclosure is a novel Application form based on a hardware platform of an electronic device, and can run based on a native API (Application Programming Interface) provided by an operating system.

The fast application is developed by adopting a unified standard, and is rendered as native without installation, namely, the fast application is used as point, and has native application experience (performance, system integration, interaction and the like). The framework of the fast application can be deeply integrated in an operating system, can operate at the level of the operating system, and realizes seamless connection with other application services. Developers can operate on different types of electronic equipment through one-time development. The method is applied to the electronic equipment manufacturers at the beginning of birth, realizes standardization unification among the electronic equipment manufacturers on the aspects of development specifications, capability access, developer service and the like, and greatly reduces the adaptation cost of developers.

Compared with the traditional application, the quick application has the following characteristics:

instant: the user can use the method point by point, and the user does not need to wait;

everywhere (Everywhere visible): deeply integrated with the use scene of the electronic equipment, and everywhere has an entrance, such as a search engine, an intelligent assistant, intelligent recommendation, an application market, a browser and the like;

efficiency: the quasi-front-end development mode is high in efficiency.

FIG. 4 illustrates a block diagram of a fast application framework 400, according to an example embodiment, that includes: scenario portal 420, fast application engine 440, and Operating System (OS) infrastructure and hardware 460.

The scene portal 420 includes at least one of a negative one-screen, a global search, a lock screen, a desktop, an application marketplace, a browser, and a two-dimensional code. The appearance of the scene portal 420 may be in the form of a page and a card.

The fast application engine 440 includes a front end framework 441, a generic scenario 442, a lightweight scenario 443, an embedded SDK (Software Development Kit) 444, and business access 445.

The front-end framework 441 includes an MVVM (Model-View-Model ), a V-DOM (Virtual-Document Object Model), a route, an Application Programming Interface (API), a service API, a User Interface (UI) component, a route, and the like;

the general scene 442 and the lightweight scene 443 include a JavaScript (a programming language) engine, a standard rendering engine, an extreme speed rendering engine, end-cloud-core acceleration, a security mechanism, emerging scenes such as AI (Artificial Intelligence), AR (Augmented Reality), and the like, system integration (application management, rights management, and the like);

service access 445 includes push, account/payment, etc.

OS infrastructure and hardware 460 includes: a graphics library, a native control, a system service, and a GPU (graphics Processing Unit)/NPU (embedded Neural network processor), etc.

From the execution path level, there are a standard HTML (Hyper Text Markup Language) 5 mode to support a general Web scene, and a JS (JavaScript, a programming Language) and Native (Native) mode to support a lighter and faster experience.

The architecture of the fast application engine will be briefly described in 3 aspects below.

1) Application development:

the design of the front end of the fast application refers to and integrates the design thought of the mainstream front end framework: the application is built in a componentized mode, an MVVM design mode taking data binding as a core is adopted, the performance is improved in a V-DOM mode, and meanwhile, a simple and clear template of a class Vue (a virtual machine shelling engine) is selected. Meanwhile, the layout aspect is correspondingly simplified. From the perspective of new application form, native UI mapping and capability opening, a set of components and API specifications need to be defined, and the rapid development application is convenient to develop.

2) System integration:

fast applications, as a complete application modality, can be deeply integrated with the system, run as native applications, and interact with the system. There are currently two forms of rapid application: a full screen mode independent application mode and an embedded mode card mode. Under the independent application form, the experience of the user is similar to a native application program, and the method has complete life cycle management, page management, routing and the like. The fast application can be hosted in the Activity of android, the page is hosted in Fragment, and the instance is managed and controlled through independent background Service. The card form is another form, and dynamic content is displayed in a light weight manner by embedding the embedded SDK (Software Development Kit) as an independent local control into each corner of the system. In the aspect of security isolation, better security guarantee can be achieved through a sandbox mechanism, process isolation and authority control in combination with the support of an operating system layer.

3) Performance experience and emerging scenes, such as JavaScript engines, rendering engines, end-cloud-core acceleration, emerging scenes, and the like:

in the aspects of interactive experience, resource overhead, stability and the like, the fast application realizes effective combination of a front-end development mode, native rendering and platform capability by introducing a native rendering path.

Different from cross-platform frameworks of other application layers, the application is planted in an operating system of the electronic equipment, and deep integration of a slave chip, the operating system and the cloud can be realized. By taking the acceleration of the starting performance as an example by combining the end and the cloud, the optimization of the network link layer can greatly accelerate the starting speed of the application through the cooperative rendering of the cloud and the end. Meanwhile, the special capability of the hardware platform can be integrated, and the experience is further improved. For example, the computing power of an NPU (Neural-network processing Unit, network processor) may be integrated into a fast application engine in combination with an AI chip of an electronic device, so that an AI scene (face recognition, image super-resolution, and the like) may be executed at a low latency and high performance on an end side, and meanwhile, the privacy of a user is effectively protected, and a bandwidth is saved.

FIG. 5 is a flowchart illustrating the launching of a fast application, according to an example embodiment, including:

1) when the system is started for the first time, a user clicks a program package for triggering downloading of the fast application, and meanwhile, initialization related work of the fast application engine is carried out. After the whole fast application program package is downloaded and verified, the JavaScript file of the first page to be displayed is loaded and rendered.

2) The page rendering comprises JavaScript loading, execution of page and JavaScript frame logic, layout operation and drawing of the native UI control. When the logic in the page is executed, one or more network requests are generated, and the data returned by the network requests drive the page to be rendered again until the content of the page on the first screen is completely displayed.

The network request, JavaScript execution, typesetting and drawing are not in simple serial relation, but are parallelly interwoven, thereby affecting the rendering performance of the whole page and being strongly related to the logic and network conditions of page design and the running state of equipment.

FIG. 6 is a flow chart illustrating an apparatus for electronic device operation according to an example embodiment, the apparatus comprising: a receiving module S601, a determining module S602, a calling module S603, and an executing module S604.

A receiving module S601 configured to receive a first voice signal;

a determining module S602 configured to determine a first operation instruction of the first voice signal and a target application category for executing the first operation instruction;

a calling module S603 configured to call a first target application program of which the application category is the target application category, according to the target application category;

the execution module S604 is configured to execute, by the first target application, an operation corresponding to the first operation instruction.

In a possible implementation manner, the calling module S603 is further configured to obtain at least one application program corresponding to the target application category according to the target application category; selecting a first target application program from at least one application program; the first target application is invoked.

In another possible implementation manner, the calling module S603 is configured to determine a target object according to the first operation instruction, where the target object is an object operated by the first operation instruction, and when an interface element in a program interface of any application program includes the target object, the application program is used as the first target application program.

In another possible implementation manner, the calling module S603 is further configured to obtain a historical operation record, where the historical operation record includes at least one second operation instruction and an application program that executes each second operation instruction; selecting a second operation instruction comprising the same instruction action as the first operation instruction from at least one second operation instruction; and selecting an application program for executing the second operation instruction from the at least one application program, and taking the selected application program as the first target application program.

In another possible implementation manner, the invoking module S603 is further configured to output a prompt signal, where the prompt signal is used to prompt a user to select a first target application program from the at least one application program; receiving a second voice signal; the first target application indicated by the second voice signal is selected from the plurality of applications.

In another possible implementation manner, the calling module S603 is further configured to call a second target application installed locally, where the second target application includes an application interface of a first target application that is not installed locally; the first target application is run locally through an application interface of the first target application.

In another possible implementation manner, the first operation instruction includes an operation event and event information; the execution module S604 is further configured to, when the operation event is a purchase event, search, according to the event information, an interface element that matches the event information from an application interface of the first target application program, and execute the purchase event according to the interface element; alternatively, the first and second electrodes may be,

In another possible implementation manner, the determining module S602 is further configured to send a first voice signal to a server, where the server is configured to identify the first voice signal, and obtain a first operation instruction and a target application category; and receiving the first operation instruction and the target application category returned by the server.

It should be noted that: in the electronic device operating apparatus provided in the above embodiment, when operating the electronic device, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the electronic device may be divided into different functional modules to complete all or part of the functions described above. In addition, the electronic device operating apparatus provided in the above embodiments and the electronic device operating method embodiments belong to the same concept, and details of an implementation process thereof are referred to as method embodiments and are not described herein again.

Fig. 7 is a block diagram illustrating an electronic device 700 in accordance with an example embodiment. For example, the electronic device 700 may be a mobile phone, a computer, a digital broadcast electronic device, a messaging device, a gaming console, a tablet device, a medical device, an exercise device, a personal digital assistant, and so forth.

Referring to fig. 7, electronic device 700 may include one or more of the following components: a processing component 702, a memory 706, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 716, and a communication component 716.

The processing component 702 generally controls overall operation of the electronic device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the above-described method of electronic device operation. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

The memory 706 is configured to store various types of data to support operations at the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 706 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 706 provides power to the various components of the electronic device 700. The power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 700.

The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 706 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 716 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 716 may detect an open/closed state of the electronic device 700, the relative positioning of components, such as a display and keypad of the electronic device 700, the sensor assembly 716 may also detect a change in the position of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, orientation or acceleration/deceleration of the electronic device 700, and a change in the temperature of the electronic device 700. The sensor assembly 716 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 716 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 716 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications.

In an exemplary embodiment, the electronic device 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described electronic device operation methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 706 comprising instructions, executable by the processor 720 of the electronic device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The present disclosure also provides a computer program product comprising one or more computer programs for implementing the method of operation of the electronic device provided by the above-mentioned method embodiments when executed by a processor.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is intended to be exemplary only and not to limit the present disclosure, and any modification, equivalent replacement, or improvement made without departing from the spirit and scope of the present disclosure is to be considered as the same as the present disclosure.

Claims

1. A method of electronic device operation, the method comprising:

receiving a first voice signal;

2. The method of claim 1, wherein invoking the first target application program having the application category of the target application category according to the target application category comprises:

selecting the first target application from the at least one application;

and calling the first target application program.

3. The method of claim 2, wherein selecting the first target application from the at least one application comprises:

and when an interface element in the program interface of any application program contains the target object, taking the application program as the first target application program.

4. The method of claim 2, wherein selecting the first target application from the at least one application comprises:

and selecting the first target application program from at least one application program corresponding to the second operation instruction.

5. The method of claim 2, wherein selecting the first target application from the at least one application comprises:

receiving a second voice signal;

6. The method of claim 2, wherein said invoking said first target application comprises:

7. The method of claim 1, wherein the first operation instruction comprises an operation event and event information; the executing, by the first target application program, the operation corresponding to the first operation instruction includes:

8. The method of claim 1, wherein the determining a first operation instruction of the first speech signal and a target application class for executing the first operation instruction comprises:

9. An electronic device operating apparatus, characterized in that the apparatus comprises:

the receiving module is used for receiving a first voice signal;

10. The apparatus according to claim 9, wherein the invoking module is further configured to obtain at least one application program corresponding to the target application category according to the target application category; selecting the first target application from the at least one application; and calling the first target application program.

11. The apparatus according to claim 10, wherein the first operation instruction includes an operation event and event information; the calling module is further configured to select, according to the event information, a first target application program whose interface element includes the event information from the at least one application program.

12. The apparatus according to claim 10, wherein the invoking module is further configured to obtain a historical operation record, where the historical operation record includes at least one second operation instruction and an application program that executes each second operation instruction; selecting a second operation instruction comprising the same operation event as the first operation instruction from the at least one second operation instruction; and selecting an application program for executing the second operation instruction from the at least one application program, and taking the selected application program as the first target application program.

13. The apparatus of claim 10, wherein the invoking module is further configured to output a prompt signal, and wherein the prompt signal is configured to prompt a user to select the first target application from the at least one application; receiving a second voice signal; selecting the first target application indicated by the second voice signal from the plurality of applications.

14. The apparatus according to claim 10, wherein the calling module is further configured to call a second target application installed locally, and the second target application includes an application interface of the first target application not installed locally; and locally running the first target application program through the application interface of the first target application program.

15. The apparatus of claim 9, wherein the first operation instruction comprises an operation event and event information; the execution module is further configured to, when the operation event is a purchase event, search an interface element matched with the event information from an application interface of the first target application program according to the event information, and execute the purchase event according to the interface element; or when the operation event is a navigation event, acquiring the current position, and determining a target position matched with the event information according to the event information; and displaying a navigation interface of the first target application program, wherein the starting position in the navigation interface is set as the current position, and the end position is set as the target position.

16. The apparatus according to claim 9, wherein the determining module is further configured to send the first voice signal to a server, and the server is configured to recognize the first voice signal, so as to obtain the first operation instruction and the target application category; and receiving the first operation instruction and the target application category returned by the server.

17. An electronic device, characterized in that the electronic device comprises:

one or more processors;

wherein the one or more processors are configured to:

receiving a first voice signal;

18. A computer-readable storage medium having stored thereon at least one instruction which is loaded and executed by a processor to perform an operation performed in the method of operating an electronic device according to any of claims 1 to 8.