JP2021121969A - Application program operation guidance method, device, apparatus, and readable storage medium - Google Patents

Abstract

To provide an effective and convenient operation guidance method, a device, an apparatus, and a readable storage medium to a user.SOLUTION: The operation guidance method of an application program includes receiving operation guidance data transmitted from a first application program, providing the operation guidance data to a user, receiving voice information input from the user, determining target operation guidance data matching the voice information, and transmitting the target operation guidance data to the first application program so that the first application program performs a next operation according to the target operation guidance data. As a result, efficient and convenient active multi-round operation guidance can be realized, the user does not need to remember it, and the first application program can easily acquire a user's specific operation behavior, and is useful for the analysis of user behaviors.SELECTED DRAWING: Figure 1

Description

The present application relates to computer technology, particularly to the field of speech recognition technology.

With the rapid development of smart devices and Internet technology, a large number of application programs such as shopping application programs, music application programs, and social application programs are appearing.

In order to meet the various possible needs of users, the functions supported by application programs are increasing, and page operations are becoming more complicated. In order to provide operation guidance to users, it is now common to load several pages of operation guidance pages that display new function icons, operation instructions for new function icons, etc. after entering the application program. Is.

However, in the actual usage process, the content of the operation guidance page is abundant and messy, and the user has to remember this, so most users do not have the patience to read the operation guidance page carefully and the guidance fails. Connect. How to provide users with effective and convenient operation guidance is a technical issue that needs to be resolved immediately.

The embodiments of the present application provide operation guidance methods, devices, devices and readable storage media for application programs that can provide users with effective and convenient operation guidance.

In the first aspect, the embodiments of the present application are
It is a step of receiving the operation guidance data transmitted from the first application program, and the operation guidance data is the guidance data of the next operation obtained by the first application program based on the current operation of the user. Steps that are
A step of providing the operation guidance data to the user,
A step of receiving the voice information input from the user and determining the target operation guidance data to be matched with the voice information.
Provided is an operation guidance method of an application program including a step of transmitting the target operation guidance data to the first application program so that the first application program performs the next operation according to the target operation guidance data. ..

In the embodiment of the present application, the operation guidance data of the next operation of the user transmitted from the first application program is received, and the operation guidance data is provided to the user so that the user knows the next operation. After inputting the voice information of the next operation, the target operation data to be matched with the voice information is determined, and the voice input method makes the user's operation convenient and provides an interaction experience between the user and the voice service application program. improves. Next, the target operation guidance data is transmitted to the first application program, and the first application program can perform the next operation according to the target operation guidance data. It is not necessary to integrate the voice recognition function into the first application program according to the present embodiment, that is, it is not necessary to change the internal realization logic of the first application program, and only the operation guidance data is provided. The user can be actively instructed to perform the following operations, and when the first application program provides multi-round operation guidance data, the user is actively instructed to perform sequential operations in step order. It is possible to realize efficient and convenient active multi-round operation guidance, it is not necessary for the user to remember, and it becomes easier for the first application program to acquire the specific operation behavior of the user. Useful for behavioral analysis.

Selectably, the number of operation guidance data is at least one, and before the step of determining the target operation guidance data to be matched with the voice information,
The step of receiving the keyword of each operation guidance data transmitted from the first application program is included.
The step of determining the target operation guidance data to be matched with the voice information is
The step of recognizing the keyword of the voice information and acquiring the keyword of the voice information,
The step of comparing the keyword of each operation guidance data with the keyword of the voice information and acquiring the target operation guidance data whose comparison result matches is further included.

As one selectable embodiment of the above application, the operation guidance data to be matched with the voice information is determined by the method of comparing the keywords, the target operation guidance data is accurately acquired, and the keywords are compared. The method of determining the operation guidance data by means is faster and more efficient.

Selectably, the step of receiving the operation guidance data transmitted from the first application program is
When the first application program is monitored to call the cross-process access interface, the operation guidance data is read from the cross-process access interface, and here, the first application program calls the cross-process access interface. Includes the step of storing the operational guidance data in the cross-process access interface.
The step of transmitting the target operation guidance data to the first application program is
Just as the first application program acquires the target operation guidance data by calling the cross-process access interface, the target operation guidance data is stored in the cross-process access interface by calling the cross-process access interface. Including steps.

As one selectable embodiment of the above application, data transmission between the first application program and the voice service application program via a cross-process access interface is realized, and the reliability, stability and high data transmission. Ensure efficiency.

Selectably, before the step of determining the target operation guidance data to match the voice information,
Further including a step of receiving an initial user intent corresponding to each of the operation guidance data and the next operation data corresponding to each of the operation guidance data transmitted from the first application program.
After the step of determining the target operation guidance data to match the voice information,
From the set of application programs, a step of determining a second application program that satisfies the initial user intent corresponding to the target operation guidance data, and
It further includes a step of transmitting the next operation data corresponding to the target operation guidance data to the second application program and triggering the second application program to operate the next operation data.

As one selectable embodiment of the above application, the first application program provides an initial user intent of operation guidance data, i.e., the user performs the next operation as the first application program thought. If the second application program satisfies the initial user intent, the next operation data is sent to the second application program, and the second application program receives the next operation data. Automatically triggers to operate and realizes user intent. In this embodiment, not only the operation guidance is given by the first application program, but also the user intent can be realized by automatically triggering the second application program.

Selectably, the step of determining from a set of application programs a second application program that satisfies the initial user intent corresponding to the target operation guidance data is
The step of recognizing the intent of the voice information and acquiring a clear user intent,
When the clear user intent matches the initial user intent corresponding to the target operation guidance data, a step of determining a second application program satisfying the initial user intent from the set of application programs. include.

As one selectable embodiment of the above application, since the accuracy of the clear user intent is high, the intent of the voice information is recognized to obtain the clear user intent again, and the clear user intent of the voice information is obtained. If the tent matches the initial user intent corresponding to the target operation guidance data, it means that the user does have that intent, thereby determining the initial user intense and the second application program. The accuracy of is improved.

The step of providing the operation guidance data to the user, which can be selected, is
The step of displaying the operation guidance data and / or the step of reproducing the voice information of the operation guidance data is included.

As one selectable embodiment of the above application, the operation guidance data is provided to the user by at least one of display and voice reproduction, and the provision method is various, and the operation guidance page is compared with several pages of the prior art. Therefore, in the present embodiment, by displaying or playing back only the guidance data of the next operation, the provided content is simplified and the user can easily accept it.

The step of displaying the operation guidance data so as to be selectable is
Including the step of displaying the operation guidance data by paging.
The step of receiving the voice information input from the user and determining the target operation guidance data to be matched with the voice information is
A step of receiving at least one round of voice information input from the user and recognizing the voice information of each round,
When the page number information is recognized, the step of displaying the operation guidance data corresponding to the page number information and
When the page number information is not recognized, the step of determining the target operation guidance data matching with the voice information from the operation guidance data displayed on the current page is included.

One selectable embodiment of the above application supports paging display of operation guidance data, which can increase the amount of operation guidance data data and ensure page conciseness by paging. The page feed can be controlled by voice, and the one-round operation can also serve as a multi-step voice input operation.

Selectably, before the step of receiving the operation guidance data sent from the first application program,
The step of receiving the signature of the first application program,
It further comprises the step of verifying the signature and obtaining the result of passing the verification.
The step of transmitting the target operation guidance data to the first application program is
The step includes encrypting the target operation guidance data and transmitting it to the first application program.

In one selectable embodiment of the above application, the signature of the first application program is verified and the target operation guidance data is encrypted and transmitted to ensure the security of data transmission.

In the second aspect, the embodiments of the present application are
A receiving module configured to receive operation guidance data transmitted from the first application program, wherein the operation guidance data is the next obtained by the first application program based on the user's current operation. The receiving module, which is the guidance data for the operation of
A providing module configured to provide the operation guidance data to the user,
A determination module configured to receive voice information input from the user and determine target operation guidance data to be matched with the voice information.
An application program comprising a transmission module configured to transmit the target operation guidance data to the first application program so that the first application program performs the next operation according to the target operation guidance data. An operation guidance device is further provided.

In the third aspect, the embodiment of the present application is
With at least one processor
An electronic device including a memory that is communicatively connected to the at least one processor.
An instruction that can be executed by the at least one processor is stored in the memory, and when the instruction is executed by the at least one processor, the at least one processor is the application program according to any one of the above embodiments. Further provide an electronic device capable of executing the operation guidance method.

In a fourth aspect, an embodiment of the present application is a non-temporary computer-readable storage medium in which computer instructions are stored, the computer instructions being described in the computer in any of the above embodiments. It also provides a non-temporary computer-readable storage medium that executes the operation guidance method of the application program.

In a fifth aspect, the embodiments of the present application further provide a computer program that causes a computer to execute the operation guidance method of the application program described in any of the above embodiments.

Other effects of the above selectable embodiments are described below, along with specific examples.

The drawings are used to better understand the proposed technology and are not intended to limit the present application.
It is a flowchart of the operation guidance method of the application program which concerns on Example 1 of this application. It is a flowchart of the operation guidance method of the application program which concerns on Example 2 of this application. It is a flowchart of the operation guidance method of the application program which concerns on Example 3 of this application. It is a flowchart of the operation guidance method of the application program which concerns on Example 4 of this application. It is a block diagram of the operation guidance apparatus of the application program which concerns on Example 5 of this application. It is a block diagram of the electronic device for realizing the operation guidance method of the application program which concerns on embodiment of this application.

Hereinafter, exemplary embodiments of the present application will be described in combination with the drawings, which may include various details of the embodiments of the present application for ease of understanding, which are merely exemplary. Should be considered. Accordingly, one of ordinary skill in the art can make various changes and modifications to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and brevity, the following description omits the description of well-known functions and configurations.

[Example 1]
FIG. 1 is a flowchart of an operation guidance method of the application program according to the first embodiment of the present application. The embodiments of the present application are suitable for instructing the user to operate the application program sequentially. The method is performed by an operation guidance device of an application program, which is implemented in software and / or hardware, specifically placed in an electronic device having certain data computing capabilities. Selectably, the electronic device is the smartphone or the in-vehicle device side, the first application program and the voice service application program are installed on the in-vehicle device side, and the first application program is the voice service application program. Provide operation guidance to the user with assistance.

Specifically, the operation guidance method of the application program shown in FIG. 1 is executed by the voice service application program in the electronic device, and the method includes the following steps S110 to S140.

In S110, the operation guidance data transmitted from the first application program is received, and the operation guidance data is the guidance data for the next operation obtained by the first application program based on the current operation of the user.

The first application program is an application program that has an operation guidance demand such as a newly started application program or an application program that adds a new function. For convenience of explanation and distinction, the application program that has the operation guidance demand is the first application program. It is called an application program.

The user either triggers the icon of the first application program to open the first application program, or triggers the function icon of the first application program to control the first application program and execute the corresponding function. It is possible to directly operate the first application program. Further, the user can also input voice information to acquire the next operation data and transmit the next operation data to the first application program to realize an indirect operation on the first application program. The user's current operation here may be a direct operation or an indirect operation, but the current operation needs to be a single step operation.

The first application program responds according to the user's current operation according to the internal realization logic, and acquires guidance data for the next operation of the current operation. Here, the guidance data for the next operation is data that guides the user to perform the next operation, and the number of the next operation and the number of the operation guidance data are both at least one, and the next operation And the operation guidance data have a one-to-one correspondence. As an example, the current operation is the operation of clicking the food and drink order icon, and the next operation includes the operation of selecting the Hunan food icon, the operation of selecting the Cantonese food icon, and the operation of selecting the Western food icon. The guidance data for each of the following operations is the text "whether to choose Hunan cuisine, whether to choose Cantonese cuisine, and whether to choose Western cuisine", respectively. Next, the first application program transmits the operation guidance data to the voice service application program.

In S120, operation guidance data is provided to the user.

After receiving the operation guidance data transmitted from the first application program, the voice service application program provides the operation guidance data to the user so that the user knows the guidance data for the next operation.

In addition to the operation guidance, the voice service application program also has a normal voice interaction function, that is, it recognizes the voice information input by the user, matches and plays the appropriate content, and performs the voice interaction with the user. Realize. Based on this, label the operation guidance data when or before providing the operation guidance data to the user.

In S130, the voice information input from the user is received, and the target operation guidance data to be matched with the voice information is determined.

After knowing the guidance data for the next operation, the user decides the next operation to be executed from the guidance data, and actively transmits the voice corresponding to the next operation. Following the above example, the user inputs the voice information "Select Hunan cuisine".

When the operation guidance data is labeled, it means that it is necessary to perform the operations of S130 and S140 on the received voice information instead of the above-mentioned normal operation after S120. On the contrary, when a certain data is not labeled, a normal operation is performed on the received voice information, that is, the voice information is recognized, and appropriate contents are matched and played back.

Selectably, when the number of operation guidance data is one, it is determined whether or not the voice information matches the operation guidance data, and when matching, the operation guidance data is determined as the target operation guidance data. If there is no match, the operation guidance data is not target operation guidance data. When the number of operation guidance data is two or more, the operation guidance data matching with the voice information is determined as the target operation guidance data from the two or more operation guidance data. Specifically, the voice service application program recognizes voice information, matches the recognition result with the operation guidance data, and determines the target operation guidance data to be matched.

In S140, the target operation guidance data is transmitted to the first application program so that the first application program performs the next operation according to the target operation guidance data.

The operation guidance data has a one-to-one correspondence with the following operation data. The next operation data includes operation commands and parameters, for example, the next operation data corresponding to "whether or not to select Hunan cuisine" includes selection operation instructions and Hunan cuisine parameters. After obtaining the target operation guidance data, the first application program determines the next operation data according to the target operation guidance data, and also performs the next operation according to the operation command and parameters, for example, selecting the Hunan cuisine icon. Enter the Hunan restaurant page by performing the operation.

Selectably, when the first application program transmits the operation guidance data to the voice service application program, it also transmits the next operation data corresponding to the operation guidance data. Correspondingly, the step of receiving the next operation data corresponding to the operation guidance data transmitted from the first application program is further included before S130. Further, after S130, a step of determining the next operation data according to the target operation guidance data is further included. Based on this, the voice service application program can know the next operation data of the user, can easily acquire the specific operation behavior of the user, and is useful for the analysis of the user's behavior.

In the embodiment of the present application, the operation guidance data of the next operation of the user transmitted from the first application program is received, and the operation guidance data is provided to the user so that the user knows the next operation. Input the voice information of the next operation and determine the target operation data to match with the voice information. The voice input method facilitates the user's operation and improves the interaction experience between the user and the voice service application program. Next, the target operation guidance data is transmitted to the first application program, and the first application program can perform the next operation according to the target operation guidance data. It is not necessary to integrate the voice recognition function into the first application program according to the present embodiment, that is, it is not necessary to change the internal realization logic of the first application program, and only the operation guidance data is provided. The user can be actively instructed to perform the following operations, and when the first application program provides multi-round operation guidance data, the user is actively instructed to perform sequential operations in step order. It is possible to realize efficient and convenient active multi-round operation guidance, it is not necessary for the user to remember, and it becomes easier for the first application program to acquire the specific operation behavior of the user. Useful for behavioral analysis.

[Example 2]
FIG. 2 is a flowchart of an operation guidance method of the application program according to the second embodiment of the present application. The embodiments of the present application are optimized based on the technical proposals of the above-mentioned embodiments.

Selectably, the number of operation guidance data is at least one, and before the step of "determining the target operation guidance data to match with the voice information", "each operation guidance data transmitted from the first application program". "Receive keywords of voice information" is added, and correspondingly, the operation of "determine target operation guidance data to match with voice information" is performed by "keyword recognition of voice information, acquisition of keywords of voice information, and each By comparing the keyword of the operation guidance data with the keyword of the voice information and subdividing it into the step of "acquiring the target operation guidance data for which the comparison result matches", the accuracy and efficiency of matching can be improved.

The operation guidance method of the application program shown in FIG. 2 includes the following steps S210 to S250.

In S210, the operation guidance data and the keywords of each operation guidance data transmitted from the first application program are received.

The first application program can transmit the operation guidance data together with the keywords, and can also transmit each as shown in this step. Specifically, the keyword of each operation guidance data is transmitted before determining the target operation guidance data to be matched with the voice information. By doing so, the voice service application program can receive the keyword before determining the target operation guidance data to be matched with the voice information.

The keyword of each operation guidance data is at least one. For example, the keyword of "whether or not to select Hunan cuisine" is Hunan cuisine, and the keyword of "go to the parking lot of People's Park" is people's park. Including the parking lot.

In S220, operation guidance data is provided to the user.

In S230, the voice information input from the user is received, the keyword of the voice information is recognized, and the keyword of the voice information is acquired.

The voice information is converted into text so as to be selectable, and any one of the following operations is performed on the text. Operation 1) Match the text to the regular expression, specify the position of the keyword, and recognize the keyword. Operation 2) Remove the text prefix and suffix and retain the keyword.

The voice service application program intercepts the voice information locally and recognizes the voice information locally to acquire the keyword of the voice information, so that the recognition by the server is not required, the speed is faster, and the efficiency is higher. Will be higher. Of course, it is also possible to send voice information to the server and recognize the keyword by the method provided by the server.

In S240, the keywords of each operation guidance data and the keywords of voice information are compared, and the target operation guidance data whose comparison results match is acquired.

When there are two or more keywords of the operation guidance data and the comparison result of any of the keywords of the operation guidance data matches with the keyword of the voice information, the operation guidance data is the target operation guidance data.

In S250, the target operation guidance data is transmitted to the first application program so that the first application program performs the next operation according to the target operation guidance data.

In this embodiment, the operation guidance data that matches the voice information is determined by the keyword comparison method, and the target operation guidance data is accurately acquired. Also, the method of determining operation guidance data by comparing keywords is faster and more efficient.

[Example 3]
FIG. 3 is a flowchart of an operation guidance method of the application program according to the third embodiment of the present application. The embodiments of the present application are optimized based on the technical proposals of the above-mentioned embodiments.

Selectably, the "Receive operational guidance data sent from the first application program" step is followed by "If you monitor the first application program to call the cross-process access interface, the operational guidance from the cross-process access interface. The data is read, and here, the first application program is subdivided into the steps of "storing the operation guidance data in the cross-process access interface by calling the cross-process access interface", and correspondingly, "target operation guidance data". To the first application program, the target operation guidance data by calling the cross-process access interface, just as the first application program obtains the target operation guidance data by calling the cross-process access interface. Is subdivided into "store in cross-process access interface" steps.

Selectably, before the step "Receive the operation guidance data sent from the first application program", "Receive the signature of the first application program, verify the signature, and obtain the result of passing the verification." Add a step.

The step of "transmitting the target operation guidance data to the first application program" is subdivided into a step of "encrypting the target operation guidance data and transmitting it to the first application program" so as to be selectable.

The operation guidance method of the application program shown in FIG. 3 includes the following steps S300 to S350.

In S300, the signature of the first application program is received.

In S310, the signature is verified and the result of passing the verification is acquired.

Specifically, the first application program encrypts the data packet using its own private key to obtain a signature, and attaches the signature to the data packet. The first application program sends the signature and the data packet to the voice service application program. The voice service application program successfully decrypts the signature using the public key to retrieve the data packet and passes the validation if the data packet name is on the white list.

After passing the verification, the voice service application program can always receive the data transmitted from the first application program without repeating the verification.

In S320, when the first application program is monitored to call the cross-process access interface, the operation guidance data is read from the cross-process access interface, and here, the first application program calls the cross-process access interface. , The operation guidance data is stored in the cross-process access interface.

In this embodiment, a cross-process access interface has been developed for the first application program to call. The cross-process access interface is developed using the Android interface definition language (AIDL). This allows interaction between the first application program and the voice interactive system. The data storage method and reading method are encapsulated in the cross-process access interface, and the first application program cross-process access the operation guidance data by calling the cross-process access interface so that the voice service application program reads. Store in the interface.

In one application scenario, both the first application program and the voice service application program access a mobile development platform, a software development kit (SDK) that integrates the mobile development platform. By developing a cross-process access interface on the mobile development platform, calling and monitoring of the first application program and voice service application program becomes convenient.

Selectably, in order to ensure the security of data transmission, the first application program encrypts the operation guidance data and then calls the cross-process access interface to store the data. Correspondingly, the voice service application program needs to decrypt the encrypted operation guidance data before performing the subsequent operation.

Selectably, the format of the operation guidance data is set to JSON in order to reduce the occupied bandwidth.

In S330, the operation guidance data is provided to the user.

In S340, the voice information input from the user is received, and the target operation guidance data to be matched with the voice information is determined.

In S350, the target operation guidance data is acquired by calling the cross-process access interface, and the target operation guidance data is obtained by calling the cross-process access interface so that the first application program performs the next operation according to the target operation guidance data. Is stored in the cross-process access interface.

Specifically, the voice service application program stores the target operation guidance data in the cross-process access interface by calling the cross-process access interface. When the first application program monitors the voice service application program to call the cross-process access interface, the target operation guidance data is acquired by calling the cross-process access interface as well.

Selectably, the voice service application program encrypts the target operation guidance data and stores it in the cross-process access interface, and the first application program calls the cross-process access interface to encrypt the target operation guidance data. Is acquired, the target operation data is decrypted, and the following operation is performed according to the decoded target operation guidance data.

In this embodiment, the signature of the first application program is verified, and the target operation guidance data is encrypted and transmitted to ensure the security of data transmission. Data transmission between the first application program and the voice service application program is realized via the cross-process access interface, and the reliability, stability and high efficiency of the data transmission are ensured. In this embodiment, the operation guidance data is transmitted / received by calling the cross-process access interface, and the keywords, initial user intents, and the following in the above and subsequent examples are called by calling the cross-process access interface. By sending and receiving operation data, and by encrypting and transmitting keywords, initial user interfaces, and the next operation data, the security, reliability, stability, and high efficiency of all data are ensured.

[Example 4]
FIG. 4 is a flowchart of the operation guidance method of the application program according to the fourth embodiment of the present application, and the embodiment of the present application is optimized based on the technical proposal of each of the above-described embodiments.

Selectably, before the step of "determining the target operation guidance data to match with the voice information", "the initial user intent corresponding to each operation guidance data sent from the first application program, and each operation guidance". Add the "Receive the next operation data corresponding to the data" step, and correspondingly, after the "Determine the target operation guidance data to match with the voice information" step, "From the set of application programs, the target operation guidance" A second application program that satisfies the initial user intent corresponding to the data is determined, the next operation data corresponding to the target operation guidance data is transmitted to the second application program, and the second application program performs the next operation data. Add a "Trigger to operate" step.

The content provided by subdividing the step of "providing the operation guidance data to the user" into "the step of displaying the operation guidance data and / or the step of reproducing the voice information of the operation guidance data" so as to be selectable. Is simplified and more acceptable to users.

The operation guidance method of the application program shown in FIG. 4 includes the following steps S410 to S460.

In S410, the operation guidance data, the initial user intent corresponding to each operation guidance data, and the next operation data corresponding to each operation guidance data, which are transmitted from the first application program, are received.

The first application program can transmit the operation guidance data together with the initial user intent and the next operation data, and can also transmit each as shown in this step. Specifically, by transmitting the initial user intent corresponding to each operation guidance data and the next operation data before determining the target operation guidance data to be matched with the voice information, the voice service application program can perform the voice information. The initial user intent and the next operation data can be received before determining the target operation guidance data to match with.

The initial user intent corresponding to each operation guidance data is obtained by the first application program performing intent analysis on the operation guidance data, and the user thinks that the first application program This is a possible user intent when performing the next operation corresponding to the operation guidance data. For example, if the operational guidance data is to go to a parking lot in People's Park, the corresponding initial user intent is navigation. Further, for example, when the operation guidance data is the song of the singer A, the initial user intent corresponding to the song is listening to music.

If the first application program cannot satisfy the initial user intent, for example, if it does not have the navigation and music playback functions, the initial user intent is transmitted to the voice service application program. If the first application program can satisfy the initial user intent, it is not necessary to send it to the first application program, and after receiving the target operation guidance data, the initial user intent is set by the related function of this application program. Can be met. As can be seen, when the initial user intent sent from the first application program is received, it means that it is necessary to provide functional support that can satisfy the initial user intent from the outside.

In S420, the operation guidance data is displayed and / or the voice information of the operation guidance data is reproduced.

The operation guidance data is displayed in a list format on an electronic device such as a smartphone or the screen of an in-vehicle device so that it can be selected, and / or the operation guidance data is voice-synthesized to acquire voice information and played on the player of the electronic device. .. The operation guidance data is provided to the user by at least one of display and voice reproduction, and the method of providing the operation guidance data is various. Displaying or playing back only the data simplifies the content provided and makes it more acceptable to the user.

Selectable, when there is a lot of operation guidance data, the operation guidance data is displayed by paging, and the paging display mode helps to increase the data amount of the operation guidance data, the data amount of one page is limited by the paging method, and the page Conciseness is ensured.

In S430, the voice information input from the user is received, and the target operation guidance data to be matched with the voice information is determined.

Selectably, when displaying the operation guidance data by paging, it receives at least one round of voice information input from the user, recognizes the voice information of each round, and if the page number information is recognized, the page number information. If the page number information is not recognized, the target operation guidance data that matches the voice information is determined from the operation guidance data displayed on the current page.

Here, the page number information includes a "previous page", a "next page", and an "Xth page". The user can input at least one round of voice information, for example, inputting "next page" for three consecutive rounds. When the page number information is recognized, the operation guidance data corresponding to the page number information is displayed on the screen of the electronic device. If the page number information is not recognized, the voice information keyword is recognized, the voice information keyword is acquired, the operation guidance data keyword displayed on the current page is compared with the voice information keyword, and the comparison result is obtained. Gets the target operation guidance data that matches. In this embodiment, the user can control the page feed by voice, and the one-round operation can also serve as a multi-step voice input operation.

Selectably, if the set time after S420, for example, the voice information input by the user is not received within 2 minutes, one of the operation guidance data is used as the target operation guidance data, or the current operation is terminated. You may.

In S440, a second application program that satisfies the initial user intent corresponding to the target operation guidance data is determined from the set of application programs.

A plurality of application programs other than the first application program and the voice service application program are also installed in the electronic device to form a set of application programs. The application programs in the application program set can satisfy the initial user intent.

Selectably, the correspondence between the initial user intent and the application program that can satisfy the initial user intent is established in advance, for example, the correspondence between the navigation and the map application program is established in advance, and listening music. And establish the correspondence between the music application program and the music application program in advance. After determining the initial user intent corresponding to the target operation guidance data, the application program corresponding to the determined initial user intent is selected based on the correspondence, and the second application program is distinguished from the first application program. It is called an application program.

In S450, the next operation data corresponding to the target operation guidance data is transmitted to the second application program, and the second application program triggers to operate the next operation data.

Optionally, the application program can also access the mobile development platform and be controlled by the voice service application program. Specifically, the voice service application program sends operation instructions and parameters corresponding to the target operation guidance data to the second application program, for example, the operation instruction of "going to the parking lot of the People's Park" is navigation. , Parameters are the current location, and the parking lot of the People's Park, which is the destination. In addition, the voice service application program triggers the second application program to manipulate the operating instructions and parameters, for example, the second application program automatically navigates to the parking lot of the People's Park.

Considering that priority is given to the accuracy of the initial user intent, intent recognition of voice information is performed, a clear user intent is acquired, and the clear user intent corresponds to the target operation guidance data. When matching with the initial user intent, a second application program that satisfies the initial user intent is determined. Specifically, the text of the voice information is input to the intent recognition model, the user intent output by the intent recognition model is acquired, and a clear user intent is used to distinguish it from the initial user intent naming. To tell. Since the accuracy of the clear user intent is high, the intent of the voice information is recognized and the clear user intent is acquired again, and the user intent with the clear voice information corresponds to the target operation guidance data. When matching with a tent, it means that the user does have the intent, which improves the determination accuracy of the initial user intent and the second application program.

In S460, the target operation guidance data is transmitted to the first application program so that the first application program performs the next operation according to the target operation guidance data.

In addition, S440 to S450 may be executed in parallel with S460, or S460 may be executed first, and then S440 to S450 may be executed.

In this embodiment, the first application program provides the initial user intent of the operation guidance data and the next operation data, and by determining the second application program that satisfies the initial user intent, the next operation data. Is sent to the second application program, and the second application program automatically triggers to operate the next operation data to realize the user intent. In this embodiment, not only the operation guidance is given by the first application program, but also the user intent can be realized by automatically triggering the second application program.

[Example 5]
FIG. 5 is a configuration diagram of an operation guidance device for the application program according to the fifth embodiment of the present application. The embodiments of the present application are suitable for instructing the user to operate the application program sequentially. The device is implemented in software and / or hardware and is specifically located in an electronic device with certain data computing capabilities.

The application program operation guidance device 500 shown in FIG. 5 includes a receiving module 501, a providing module 502, a determination module 503, and a transmitting module 504.

The receiving module 501 is configured to receive the operation guidance data transmitted from the first application program, and the operation guidance data is the next operation obtained by the first application program based on the user's current operation. Guidance data.

The provision module 502 is configured to provide operation guidance data to the user.

The determination module 503 is configured to receive the voice information input from the user and determine the target operation guidance data to be matched with the voice information.

The transmission module 504 is configured to transmit the target operation guidance data to the first application program so that the first application program performs the next operation according to the target operation guidance data.

In the embodiment of the present application, the operation guidance data of the next operation of the user transmitted from the first application program is received, and the operation guidance data is provided to the user so that the user knows the next operation. Input the voice information of the next operation, determine the target operation data to match with the voice information, and the voice input method makes the user's operation convenient and improves the interaction experience between the user and the voice service application program. do. Next, the target operation guidance data is transmitted to the first application program, and the first application program can perform the next operation according to the target operation guidance data. It is not necessary to integrate the voice recognition function into the first application program according to the present embodiment, that is, it is not necessary to change the internal realization logic of the first application program, and only the operation guidance data is provided. , Can actively guide the user to perform the next operation, and when the first application program provides multi-round operation guidance data, actively guide the user to perform sequential operations in step order. It is possible to realize efficient and convenient active multi-round operation guidance, it is not necessary for the user to remember, and it becomes easier for the first application program to acquire the specific operation behavior of the user, and the user's behavior. Useful for analysis.

Further, the number of operation guidance data is at least one, and the device further includes a keyword receiving module configured to receive keywords of each operation guidance data transmitted from the first application program. When the determination module 503 determines the target operation guidance data to be matched with the voice information, specifically, the determination module 503 recognizes the keyword of the voice information, acquires the keyword of the voice information, and sets the keyword of each operation guidance data and the voice information. It is configured to compare with keywords and acquire target operation guidance data that matches the comparison results.

Further, the receiving module 501 is specifically configured to read operation guidance data from the cross-process access interface when it monitors the first application program to call the cross-process access interface. The application program of the above stores the operation guidance data in the cross-process access interface by calling the cross-process access interface. Specifically, the transmission module 504 cross-process access the target operation guidance data by calling the cross-process access interface, just as the first application program obtains the target operation guidance data by calling the cross-process access interface. It is configured to be stored in the interface.

Further, the device is configured to receive an initial user intent corresponding to each operation guidance data and the next operation data corresponding to each operation guidance data transmitted from the first application program. It further includes an intent and the following operation data receiving module. The device further includes an application program determination module and a trigger module. The application program determination module is configured to determine from a set of application programs a second application program that satisfies the initial user intent corresponding to the target operation guidance data. The trigger module is configured to send the next operation data corresponding to the target operation guidance data to the second application program and trigger the second application program to operate the next operation data.

Furthermore, the application program determination module specifically recognizes the intent of voice information, acquires a clear user intent, and the clear user intent is the initial user intent corresponding to the target operation guidance data. When matching, it is configured to determine a second application program that satisfies the initial user intent from a set of application programs.

Further, the providing module 502 is specifically configured to display the operation guidance data and / or to reproduce the voice information of the operation guidance data. When displaying the operation guidance data, the providing module 502 is specifically configured to display the operation guidance data by paging. Specifically, the determination module 503 receives at least one round of voice information input from the user, recognizes the voice information of each round, and when the page number information is recognized, the operation guidance corresponding to the page number information. When the data is displayed and the page number information is not recognized, the target operation guidance data to be matched with the voice information is determined from the operation guidance data displayed on the current page.

Further, the device further includes a verification module configured to receive the signature of the first application program, verify the signature, and obtain the result of passing verification. Specifically, the transmission module 504 is configured to encrypt the target operation guidance data and transmit it to the first application program.

The above-mentioned application program operation guidance device can execute the application program operation guidance method according to any embodiment of the present application, and is useful as a functional module corresponding to executing the application program operation guidance method. Has an effect.

[Example 6]
According to the embodiments of the present application, the present application further provides electronic devices and readable storage media.

FIG. 6 is a block diagram of an electronic device that realizes an operation guidance method for an application program according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices can also represent various forms of mobile devices such as personal digital processors, mobile phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the description and / or the required realization of the present application.

As shown in FIG. 6, the electronic device includes one or more processors 601 and memory 602, and an interface for connecting each component including a high-speed interface and a low-speed interface. The components are interconnected by different buses and can be mounted on a common motherboard or otherwise mounted as needed. The processor can process instructions executed within the electronic device, and the instructions are stored in memory to display GUI graphic information on an external input / output device (eg, a display device coupled to an interface). Contains instructions stored in or in memory. In other embodiments, a plurality of processors and / or a plurality of buses can be used together with a plurality of memories, if desired. Similarly, a plurality of electronic devices can be connected, and each electronic device can provide some necessary operations (for example, a server array, a group of blade servers, or a multiprocessor system). .. In FIG. 6, one processor 601 is taken as an example.

The memory 602 is a non-temporary computer-readable storage medium according to the present application. Here, the memory stores instructions that can be executed by at least one processor, so that the at least one processor executes the operation guidance method of the application program according to the present application. The non-temporary computer-readable storage medium of the present application stores computer instructions for causing the computer to execute the operation guidance method of the application program according to the present application.

As a non-temporary computer-readable storage medium, the memory 602 is determined by a program instruction / module (for example, the receiving module 501 and the providing module 502 shown in FIG. 5) corresponding to the operation guidance method of the application program in the embodiment of the present application. Stores non-temporary software programs, non-temporary computer-executable programs and modules, such as module 503 and transmit module 504). The processor 601 executes various functional applications and data processing of the server by executing non-temporary software programs, instructions and modules stored in the memory 602, that is, the application program in the embodiment of the above method. Realize the operation guidance method of.

The memory 602 can include a program storage area and a data storage area, where the program storage area can store an operating system, an application program required for at least one function, and the data storage area is a data storage area. It is possible to store data created by using an electronic device that realizes an operation guidance method for an application program. The memory 602 can also include fast random access memory and can further include non-temporary memory, eg, at least one magnetic disk storage device, flash memory device, or other non-temporary solid state. It is a state storage device. In some embodiments, the memory 602 can selectively include memory configured remotely with respect to the processor 601 and these remote memories perform operational guidance methods of the application program over the network. Can be connected to electronic devices. Examples of the above networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic device that executes the operation guidance method of the application program can further include an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603, and the output device 604 can be connected via a bus or other method, and in FIG. 6, the connection via the bus is taken as an example.

The input device 603 can receive the input numerical or character information and generate a key signal input relating to user setting and function control of an electronic device that executes an operation guidance method of an application program, for example, a touch screen, a key. Input devices such as pads, mice, trackpads, touchpads, pointing sticks, one or more mouse buttons, trackballs, joysticks, and the like. The output device 604 can include a display device, an auxiliary lighting device (eg, LED), a tactile feedback device (eg, a vibration motor), and the like. The display device can include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

Various embodiments of the systems and techniques described herein include digital electronic circuit systems, integrated circuit systems, application specific ASICs (ASICs), computer hardware, firmware, software, and / or them. It can be realized by the combination of. These various embodiments may be implemented in one or more computer programs, the one or more computer programs being executed and / or interpreted in a programmable system including at least one programmable processor. The programmable processor may be a dedicated or general purpose programmable processor, receiving data and instructions from a storage system, at least one input device, and at least one output device, and delivering the data and instructions to the storage system. It can be transmitted to the at least one input device and the at least one output device.

These computer programs (also called programs, software, software applications, or code) include programmable processor machine instructions in high-level process and / or object-oriented programming languages and / or assembly / machine languages. These computer programs can be implemented. As used herein, the terms "machine readable medium" and "computer readable medium" are any computer program products, devices for providing machine instructions and / or data to programmable processors. And / or devices (eg, magnetic disks, optical disks, memory, programmable logic equipment (PLD)), including machine-readable media for receiving machine instructions, which are machine-readable signals. The term "machine readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

In order to provide interaction with the user, the systems and techniques described herein can be implemented on the computer, which computer is a display device for displaying information to the user (eg, CRT). It has a tube) or LCD (liquid crystal display) monitor) and a keyboard and pointing device (eg, mouse or trackball), and the user can provide input to the computer by the keyboard and the pointing device. Other types of devices can also provide interaction with the user, eg, the feedback provided to the user is any form of sensing feedback (eg, visual feedback, auditory feedback, or tactile feedback). It is also possible to receive input from the user in any form (including acoustic input, voice input, and tactile input).

The systems and techniques described herein are computing systems that include back-end components (eg, data servers), or computing systems that include middleware components (eg, application servers), or computing that includes front-end components. A system (eg, a user computer having a graphical user interface or web browser, in which the user interacts with embodiments of the system and technology described herein by the graphical user interface or web browser), or such back. It can be implemented in computing systems that include any combination of end components, middleware components, and front end components. The components of the system can be interconnected by digital data communication of any form or medium (eg, a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), the Internet, and blockchain networks.

A computer system can include a client and a server. Clients and servers are generally separated from each other and typically interact over a communication network. A client-server relationship is created by a computer program that runs on the corresponding computer and has a client-server relationship with each other.

Steps can be rearranged, added, or deleted using the various forms of flow shown above. For example, each step described in the present application may be performed in parallel, sequentially, or in a different order, although the technical proposal disclosed in the present application is available. The present specification is not limited as long as the desired result can be achieved.

The specific embodiments described above do not limit the scope of protection of the present application. One of ordinary skill in the art can make various modifications, combinations, subcombinations, and replacements based on design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present application should all be within the scope of protection of the present application.

Claims (12)

The operation guidance data transmitted from the first application program is received, and the operation guidance data is a step that is guidance data for the next operation obtained by the first application program based on the current operation of the user. ,
A step of providing the operation guidance data to the user,
A step of receiving the voice information input from the user and determining the target operation guidance data to be matched with the voice information.
The first application program includes a step of transmitting the target operation guidance data to the first application program so that the first application program performs the next operation according to the target operation guidance data.
An operation guidance method for an application program. The number of the operation guidance data is at least one.
Before the step of determining the target operation guidance data to be matched with the voice information,
The step of receiving the keyword of each operation guidance data transmitted from the first application program is further included.
The step of determining the target operation guidance data to be matched with the voice information is
The step of recognizing the keyword of the voice information and acquiring the keyword of the voice information,
Includes a step of comparing each keyword of the operation guidance data with the keyword of the voice information and acquiring target operation guidance data whose comparison results match.
The method according to claim 1. The step of receiving the operation guidance data transmitted from the first application program is
When the first application program is monitored to call the cross-process access interface, the operation guidance data is read from the cross-process access interface, and here, the first application program calls the cross-process access interface. Including the step of storing the operation guidance data in the cross-process access interface by
The step of transmitting the target operation guidance data to the first application program is
Just as the first application program acquires the target operation guidance data by calling the cross-process access interface, the target operation guidance data is stored in the cross-process access interface by calling the cross-process access interface. Including steps,
The method according to claim 1. Before the step of determining the target operation guidance data to be matched with the voice information,
Further including a step of receiving an initial user intent corresponding to each of the operation guidance data and the next operation data corresponding to each of the operation guidance data transmitted from the first application program.
After the step of determining the target operation guidance data to match the voice information,
From the set of application programs, a step of determining a second application program that satisfies the initial user intent corresponding to the target operation guidance data, and
Further including a step of transmitting the next operation data corresponding to the target operation guidance data to the second application program and triggering the second application program to operate the next operation data.
The method according to claim 1. From the set of application programs, the step of determining a second application program that satisfies the initial user intent corresponding to the target operation guidance data is
The step of recognizing the intent of the voice information and acquiring a clear user intent,
When the clear user intent matches the initial user intent corresponding to the target operation guidance data, a step of determining a second application program satisfying the initial user intent from the set of application programs. include,
The method according to claim 4, wherein the method is characterized by the above. The step of providing the operation guidance data to the user is
Steps to display the operation guidance data and / or
Including the step of reproducing the voice information of the operation guidance data.
The method according to claim 1. The step of displaying the operation guidance data is
Including the step of displaying the operation guidance data by paging.
The step of receiving the voice information input from the user and determining the target operation guidance data to be matched with the voice information is
A step of receiving at least one round of voice information input from the user and recognizing the voice information of each round,
When the page number information is recognized, the step of displaying the operation guidance data corresponding to the page number information and
When the page number information is not recognized, the step of determining the target operation guidance data matching with the voice information from the operation guidance data displayed on the current page is included.
The method according to claim 6, wherein the method is characterized by the above. Before the step of receiving the operation guidance data sent from the first application program,
The step of receiving the signature of the first application program,
Further including the step of verifying the signature and obtaining the result of passing the verification.
The step of transmitting the target operation guidance data to the first application program is
Including the step of encrypting the target operation guidance data and transmitting it to the first application program.
The method according to any one of claims 1 to 7, wherein the method is characterized by the above. A receiving module configured to receive operation guidance data transmitted from the first application program, wherein the operation guidance data is obtained by the first application program based on the user's current operation. The receiving module, which is the guidance data for the next operation,
A providing module configured to provide the operation guidance data to the user,
A determination module configured to receive voice information input from the user and determine target operation guidance data to be matched with the voice information.
A transmission module configured to transmit the target operation guidance data to the first application program so that the first application program performs the next operation according to the target operation guidance data.
An operation guidance device for application programs. With at least one processor
Includes a memory communicatively connected to the at least one processor.
The memory stores an instruction that can be executed by the at least one processor, and when the instruction is executed by the at least one processor, the at least one processor is described in any one of claims 1 to 8. Can execute the operation guidance method of the application program of
An electronic device characterized by that. A non-temporary computer-readable storage medium that stores computer instructions.
The computer instruction causes the computer to execute the operation guidance method of the application program according to any one of claims 1 to 8.
A non-temporary computer-readable storage medium characterized by that. Cause the computer to execute the operation guidance method of the application program according to any one of claims 1 to 8.
A computer program characterized by that.

Images