CN113377322A

CN113377322A - Page direct processing method and device and electronic equipment

Info

Publication number: CN113377322A
Application number: CN202010158654.2A
Authority: CN
Inventors: 韩坤芳
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-03-09
Filing date: 2020-03-09
Publication date: 2021-09-10

Abstract

The embodiment of the application discloses a page through processing method and device and electronic equipment. The method comprises the following steps: a first client obtains an access path associated with a service provided by a first application program, wherein the first application program is installed in terminal equipment; obtaining operation instruction information extracted from voice data collected by a microphone of the terminal equipment, wherein the operation instruction information comprises identification information of a target service to be accessed; and determining a target access path associated with the target service from the access paths associated with the services provided by the first application program, and controlling the target application program to which the target service belongs to provide an access page associated with the target service according to the target access path. According to the scheme, the page can be directly reached through a voice interaction mode, and the user experience is improved.

Description

Page direct processing method and device and electronic equipment

Technical Field

The present application relates to the field of information processing technologies, and in particular, to a method and an apparatus for page through processing, an electronic device, a method and an apparatus for information collection, an electronic device, a method and an apparatus for device control, and an electronic device.

Background

Generally, an application program (App) installed in a terminal device may provide multiple pages in order to provide more comprehensive services for a user, each page may further include an access entry with multiple functions, and the user may click an operation button corresponding to the access entry to view a next page. That is, when a user wants to use a certain function, the user may need to perform multiple page operations, and reach a page corresponding to the function in a step-by-step access manner.

Taking the interface diagram shown in fig. 1 as an example, after the application program is started, the access interface diagram shown in the interface 1 can be provided for the user, the interface includes 4 page operation keys and 4 function entry operation keys, and if the page that the user wants to access belongs to a lower page associated with the function entry 4, the operation key corresponding to the function entry 4 can be clicked. Correspondingly, the application program may provide an access interface diagram shown in the interface 2, where the interface includes 4 page operation keys, and if the page that the user wants to access belongs to a lower page associated with the page 43, the user may continue to click the operation key corresponding to the page 43. Thus, the application program can provide the access interface diagram shown in the interface 3, the interface includes 3 function entrance operation keys, if the service required by the user is provided by the function entrance 41, the operation key corresponding to the function entrance 41 can be clicked, and the application program provides the access interface diagram shown in the interface 4 for the user. That is, when the user wants to use a certain service provided by the function portal 41, at least 3 manual operations are required to reach the corresponding page.

In this way, the user needs to be familiar with the access paths corresponding to the services provided by the application program, otherwise, the access complexity may be increased, and even the access failure may occur, which affects the user experience. For example, under the condition that a user is unfamiliar, after entering the access interface diagram shown in the interface 2, 4 page operation keys provided by the interface may need to be clicked in sequence to search a function entry; furthermore, if the function entry is not marked explicitly in the interface, it may not be found even if the page 43 is entered; in addition, after the user is familiar with the access path of the service, the problem that the user cannot find the required service because the access path of the service is changed after the application program is updated may also occur.

Disclosure of Invention

The application provides a page through processing method and device and electronic equipment, and the page through processing method and device can be realized in a voice interaction mode, so that the user experience is improved.

The application provides the following scheme:

a page through processing method comprises the following steps:

a first client obtains an access path associated with a service provided by a first application program, wherein the first application program is installed in terminal equipment;

obtaining operation instruction information extracted from voice data collected by a microphone of the terminal equipment, wherein the operation instruction information comprises identification information of a target service to be accessed;

and determining a target access path associated with the target service from the access paths associated with the services provided by the first application program, and controlling the target application program to which the target service belongs to provide an access page associated with the target service according to the target access path.

An application program, comprising:

the first interface, the second interface and the page direct processing program module;

the first interface is used for obtaining operation instruction information extracted from voice data, the operation instruction information comprises identification information of a target service to be accessed, and the voice data is collected by a microphone of the terminal equipment;

the page direct processing program module is used for determining a target application program to which the target service belongs and a target access path associated with the target service;

and the second interface is used for calling the target application program and controlling the target application program to provide the access page associated with the target service according to the target access path.

A page through processing method comprises the following steps:

the terminal equipment loads an installation package corresponding to the application program;

and starting the application program so as to obtain the identification information of the target service extracted from the voice data, determining the target application program to which the target service belongs and a target access path associated with the target service, and controlling the target application program to provide an access page associated with the target service according to the target access path, wherein the voice data is acquired by a microphone of the terminal equipment.

A page through processing method comprises the following steps:

adding a code line corresponding to a first application program in a source code of the first application program, wherein the first application program is installed in terminal equipment;

and starting the first application program so as to obtain identification information of a target service extracted from voice data when the code line runs, determining a target access path associated with the target service, and controlling the first application program to provide an access page associated with the target service according to the target access path, wherein the voice data is acquired by a microphone of the terminal equipment.

A page through processing method comprises the following steps:

a second client associated with the intelligent sound box obtains user voice data, and extracts operation instruction information of a user from the user voice data, wherein the operation instruction information comprises identification information of a target service to be accessed, and the voice data is collected by a microphone of the intelligent sound box;

and controlling a target application program to which the target service belongs to provide an access page associated with the target service through a third client associated with the terminal equipment, wherein the target application program belongs to a first application program installed on the terminal equipment.

An application program, comprising:

the first interface is used for receiving the calling of the intelligent sound box and obtaining user voice data collected by a microphone of the intelligent sound box;

the page direct processing program module is used for extracting operation instruction information of a user from the voice data, wherein the operation instruction information comprises identification information of a target service to be accessed;

the second interface is used for calling the communication interface of the intelligent sound box, interacting with a third client associated with the terminal device through the communication interface, and controlling a target application program to which the target service belongs to provide an access page associated with the target service through the third client, wherein the target application program belongs to the first application program installed on the terminal device.

A page through processing method comprises the following steps:

loading an installation package corresponding to the application program by the intelligent sound box;

and starting the application program so as to control a target application program to which the target service belongs to provide an access page associated with the target service through a third client associated with the terminal equipment after acquiring user voice data acquired by a microphone of the intelligent sound box and extracting identification information of the target service from the user voice data, wherein the target application program belongs to a first application program installed on the terminal equipment.

An information collection method, comprising:

the fourth client extracts target operation behavior information from the first voice data and target operation object information from the second voice data;

and establishing an incidence relation between the target operation behavior information and the target operation object information.

An apparatus control method comprising:

the fifth client obtains identification information of intelligent equipment associated with different operation behavior information, wherein the intelligent equipment belongs to a target organization;

acquiring user voice data, and extracting operation instruction information of a user from the user voice data, wherein the operation instruction information comprises target operation behavior information;

and determining target intelligent equipment associated with the target operation behavior information, and controlling the target intelligent equipment to execute actions related to the target operation behavior.

A page through processing device is applied to a first client and comprises:

an access path associated information obtaining unit, configured to obtain an access path associated with a service provided by a first application, where the first application is installed in a terminal device;

an operation instruction information obtaining unit, configured to obtain operation instruction information extracted from voice data acquired by a microphone of the terminal device, where the operation instruction information includes identification information of a target service to be accessed;

a target access path determining unit, configured to determine a target access path associated with the target service from access paths associated with services provided by the first application;

and the access page providing unit is used for controlling a target application program to which the target service belongs to provide the access page related to the target service according to the target access path.

A page through processing device is applied to terminal equipment and comprises:

the installation package loading unit is used for loading an installation package corresponding to an application program for performing page through processing;

and the application program starting unit is used for starting the application program so as to obtain the identification information of the target service extracted from the voice data, determining the target application program to which the target service belongs and a target access path associated with the target service, and controlling the target application program to provide an access page associated with the target service according to the target access path, wherein the voice data is acquired by a microphone of the terminal equipment.

A page through processing device is applied to a first application program and comprises:

a code line adding unit, configured to add a code line corresponding to an application program for performing page direct processing in a source code of the first application program, where the first application program is installed in a terminal device;

and the application program starting unit is used for starting the first application program so as to obtain the identification information of the target service extracted from the voice data when the code line runs, determining a target access path associated with the target service, and controlling the first application program to provide an access page associated with the target service according to the target access path, wherein the voice data is acquired by a microphone of the terminal equipment.

A page direct processing device is applied to a second client associated with a smart sound box and comprises:

the operation instruction information extraction unit is used for acquiring user voice data and extracting operation instruction information of a user from the user voice data, wherein the operation instruction information comprises identification information of a target service to be accessed, and the voice data is acquired by a microphone of the intelligent sound box;

and the access page providing unit is used for controlling a target application program to which the target service belongs to provide the access page associated with the target service through a third client associated with the terminal equipment, wherein the target application program belongs to a first application program installed on the terminal equipment.

The utility model provides a page is processing apparatus through, is applied to intelligent audio amplifier, includes:

and the application program starting unit is used for starting the application program so as to control a target application program to which the target service belongs to provide an access page related to the target service through a third client associated with the terminal equipment after acquiring the user voice data acquired by the microphone of the intelligent sound box and extracting the identification information of the target service from the user voice data, wherein the target application program belongs to the first application program installed on the terminal equipment.

An information collection device applied to a fourth client comprises:

an operation information extraction unit for extracting target operation behavior information from the first voice data and target operation object information from the second voice data;

and the incidence relation establishing unit is used for establishing the incidence relation between the target operation behavior information and the target operation object information.

A device control apparatus is applied to a fifth client, and comprises:

the system comprises a correlation information obtaining unit, a correlation information obtaining unit and a correlation information obtaining unit, wherein the correlation information obtaining unit is used for obtaining identification information of intelligent equipment which is respectively correlated with different operation behavior information, and the intelligent equipment belongs to a target organization;

the operation instruction information extraction unit is used for acquiring user voice data and extracting operation instruction information of a user from the user voice data, wherein the operation instruction information comprises target operation behavior information;

and the device control unit is used for determining a target intelligent device associated with the target operation behavior information and controlling the target intelligent device to execute an action related to the target operation behavior.

An electronic device, comprising:

one or more processors; and

a memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform operations comprising:

obtaining an access path associated with a service provided by a first application program, wherein the first application program is installed in a terminal device;

An electronic device, comprising:

one or more processors; and

loading an installation package corresponding to an application program for performing page through processing;

An electronic device, comprising:

one or more processors; and

adding a code line corresponding to an application program for performing page direct processing in a source code of a first application program, wherein the first application program is installed in terminal equipment;

An electronic device, comprising:

one or more processors; and

acquiring user voice data, and extracting operation instruction information of a user from the user voice data, wherein the operation instruction information comprises identification information of a target service to be accessed, and the voice data is acquired by a microphone of the intelligent sound box;

An electronic device, comprising:

one or more processors; and

An electronic device, comprising:

one or more processors; and

extracting target operation behavior information from the first voice data and extracting target operation object information from the second voice data;

An electronic device, comprising:

one or more processors; and

acquiring identification information of intelligent equipment associated with different operation behavior information, wherein the intelligent equipment belongs to a target organization;

According to the specific embodiments provided herein, the present application discloses the following technical effects:

according to the embodiment of the application, the first application program capable of performing page through processing can be determined from the application programs installed in the terminal equipment, and the association relationship between the page through operation behavior and the first application program is established. Meanwhile, the first client can obtain the access path associated with the service provided by the first application program under the condition of obtaining the authorization, so that after the identification information of the target service to be accessed is extracted from the voice data input by the user, the target application program to which the target service belongs can be determined from the first application program, the target access path associated with the target service under the target application program is obtained, the target application program is controlled to provide the access page associated with the target service according to the target access path, and the page is enabled to directly reach the target application program. By the scheme, the user operation is facilitated to be simplified, and the user experience is improved.

Of course, it is not necessary for any product to achieve all of the above-described advantages at the same time for the practice of the present application.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a schematic diagram of an access interface of an application provided by an embodiment of the present application;

FIGS. 2-12 are flow charts of methods provided by embodiments of the present application;

FIGS. 13-19 are schematic views of an apparatus provided by an embodiment of the present application;

fig. 20 is a schematic diagram of an architecture of an electronic device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments that can be derived from the embodiments given herein by a person of ordinary skill in the art are intended to be within the scope of the present disclosure.

In order to solve the problem existing when the page is searched in the application program, the embodiment of the present application may provide the following two implementation manners. In one mode, a user can control the application program to be directly positioned to a page corresponding to a service required by the user in a mode of controlling terminal equipment (such as a mobile phone, a computer and the like) for installing the application program through voice; or, in another mode, the user can interact with the terminal device installed with the application program through a mode of controlling the intelligent sound box through voice, and the application program is controlled to be directly positioned to the page corresponding to the service required by the user. The following describes two implementation processes of the two modes with reference to specific examples.

Example 1

The following explains a process of implementing page through by a terminal device according to the embodiment of the present application, with reference to a flowchart shown in fig. 2.

S101: the first client obtains an access path associated with a service provided by a first application program, and the first application program is installed in the terminal equipment.

In the embodiment of the application, the first client can be deployed in the terminal equipment and provides page through service to the user after being triggered. In the actual application process, the first client can be embodied as an independent application program, and after being started, the first client can provide page through service for the user aiming at the first application program installed on the terminal equipment. For example, the independent application is App1, the first application is App2, App3, and App4, and after the user starts App1, the user can input "open page 21 of App 2" by voice, so that the first client can perform page through processing on App2 according to the scheme provided in the embodiment of the present application.

In this implementation, the first client may obtain the association relationship shown in table 1 below.

TABLE 1

In the actual application process, the user can determine at least one first application program from the application programs installed on the terminal equipment associated with the user according to the use requirement. Correspondingly, the first client can obtain the services which can be provided by the first application program and the access paths associated with the services under the condition of obtaining the authorization of the first application program, and accordingly, the page through service of the first application program can be provided for the user.

In this embodiment of the application, the first client may determine the first application program in a variety of ways, which is described as an example below.

In a first manner, the first client may obtain identification information of a specified service required by the user, determine, from application programs installed on the terminal device associated with the first client, an optional application program that can provide the specified service, and display the identification information of the optional application program (for example, identification information such as an icon and a name of the optional application program) for the user to select the first application program from.

In this manner, the first client may provide an operation option for obtaining the identification information of the specified service, and obtain the identification information of the specified service through the operation option. Specifically, the operation option may be embodied as a text input box, and the user may manually input the identification information of the specified service after clicking the input box; or, the operation option may be embodied as a voice acquisition key, and the user may input the identification information of the specified service by voice after clicking the key.

In a second mode, the first client may determine the first application program according to the historical behavior information of the user. For example, the first client may determine at least two second applications (in this embodiment, the second applications may be common applications, for example, the second applications may be embodied as applications that are used by most users, or applications that are downloaded more than a preset number of times, and the like, which may be determined in accordance with practical situations), and provide operation options for starting the second applications respectively, and if a user accesses a certain second application(s) through the operation options, the certain second application(s) may be determined as the first application. For example, if the user skips to start App4 through the operation option corresponding to App4 provided by the first client, App4 may be determined as the first application program.

Preferably, the first client may also count information on the number of times of access of the user to the second application, and determine the second application with the highest access frequency as the first application. The high access frequency can be embodied as that the total access frequency exceeds a preset value; or, the access frequency in a specified time length may be higher than a preset frequency, and the like, which may be determined according to actual application requirements.

It is understood that the second application may be an installed application on the terminal device, or may be an uninstalled application on the terminal device, and for the second application accessed by the user, the second application is usually installed on the terminal device.

In a third mode, the first client may extract the identification information of the first application program from the voice data input by the user. For example, the voice data input by the user may be "configure App 3", from which the first client may determine App3 as the first application. As an example, when the first application configuration is required, the first client may provide a first operation option for obtaining voice data related to the first application, and when information that the user wants to perform voice input is collected through the first operation option (for example, the user clicks the first operation option, or the user presses the first operation option for a long time), a microphone of the terminal device may be invoked to collect the voice data, and the identification information of the first application is extracted from the voice data.

In a fourth mode, if the terminal device associated with the first client establishes communication with the smart speaker, the first client may determine the first application program according to the operation instruction information sent by the smart speaker. Specifically, the smart sound box may obtain user voice data collected by the microphone, extract operation instruction information of the user from the user voice data, and may send the operation instruction information to the first client if the operation instruction information includes identification information of the first application program. For example, the user may input "i want to go to App2 to sign in" by voice, and after extracting the operation instruction information of the user from the voice data, the smart speaker determines that the operation instruction information is related to the first application program, so that the operation instruction information including the identification information (App 2) of the first application program and the identification information (sign in) of the target service may be sent to the first client. Or, the voice data input by the user may be "direct page configuration on App 3", and the smart sound box may also determine App3 as the first application program and send its identification information to the first client.

Alternatively, the first client in the embodiment of the present application may be embodied as a function, and integrated in the first application. For example, the implementation code corresponding to the first client is integrated in the first application App5, and after the user starts App5 and further starts the page direct function provided by the first client, the user can input "open page 51" by voice, so that the first client can perform page direct processing on App5 according to the scheme provided by the embodiment of the present application.

In this implementation, the first client may obtain the association relationship shown in table 2 below.

TABLE 2

S102: and obtaining operation instruction information extracted from voice data collected by a microphone of the terminal equipment, wherein the operation instruction information comprises identification information of a target service to be accessed.

For the scenario where the first client is embodied as a standalone application, the user may proceed directly with the client launch. For the solution that the first client is embodied as a function integrated in the first application, the first client may be activated in various ways to obtain the user voice data. For example, in one mode, if the first application program has a function of voice acquisition, that is, the first application program is provided with a second operation option for acquiring voice data, the voice data input by the user is obtained through the second operation option, and if operation instruction information related to page through is extracted from the voice data, the operation instruction information is sent to the first client, so that the first client is triggered to start, and page through processing is performed.

Or, in another mode, the first client may be started by a third operation option set on the first target interface of the first application program.

Specifically, the first application program may provide, to the user, a third operation option for triggering the first client through the first target interface, and after information for triggering the first client is obtained through the third operation option, the first client may be controlled to start up, and the first client provides a fourth operation option for acquiring user voice data. When the information that the user wants to perform voice input is acquired through the fourth operation option (for example, the user clicks the fourth operation option, or the user presses the fourth operation option for a long time), the microphone of the terminal device may be called to acquire voice data, and further, the operation instruction information is extracted from the voice data.

Preferably, for convenience of user operation, the third operation option may be set in a home page of the first application program, that is, the first target interface is a home page, for example, set at a position easy to be viewed by a user, such as the top of the home page; or the first target interface may be a popup page when the first application is started, the third operation option is displayed on the popup page, and the user may trigger a page through function when the first application is started.

For a scheme that the first client extracts the operation instruction information from the voice data, the embodiment of the present application may provide the following implementation manners:

in the first implementation mode, local speech recognition is performed. That is, after the first client obtains the voice data, voice recognition is performed, and the operation instruction information of the user is extracted from the voice data.

And in the second implementation mode, cloud voice recognition is carried out. The first client obtains the voice data, submits the voice data to the voice recognition server deployed on the cloud server, extracts the operation instruction information of the user from the voice data by the voice recognition server, and sends the operation instruction information to the first client.

And in the third implementation mode, the local and the cloud terminals carry out voice recognition together. That is, after the first client obtains the voice data, the first client can perform voice recognition to obtain a first voice recognition result, and submit the voice data to the voice recognition server, and the voice recognition server performs voice recognition to obtain a second voice recognition result and sends the second voice recognition result to the first client. The first speech recognition result may include first operation instruction information and associated first confidence information, and the second speech recognition result may include second operation instruction information and associated second confidence information. The implementation process of performing speech recognition to obtain operation instruction information and associated confidence level information can be referred to in the related art, and is not described in detail here.

In this implementation manner, the first client may determine that, of the first confidence information and the second confidence information, the confidence that is higher is the target confidence information, further determine the operation instruction information associated with the target confidence information as the target operation instruction information, and perform page through processing according to the target operation instruction information.

In addition, in order to improve the efficiency of page through processing, the embodiment of the present application further provides the following preferred scheme:

generally, the local speech recognition speed is fast, so when the first speech recognition result is obtained and the second speech recognition result is not obtained, if it is determined that the first confidence information is not lower than the confidence threshold information (specifically, the value of the confidence threshold information may be determined according to the actual application requirements, for example, the confidence threshold information may be 80%), the first operation instruction information may be determined as the target operation instruction information.

In addition, if the first confidence information is lower than the confidence threshold information and a second speech recognition result issued by the speech recognition server is obtained within a preset time length (specifically, a value of the preset time length may be determined according to an actual application requirement, for example, the preset time length may be 1s), the first confidence information and the second confidence information may be compared, and operation instruction information associated with the speech recognition result with the high confidence may be determined as target operation instruction information. And if the first confidence information is lower than the confidence threshold information and a second voice recognition result issued by the voice recognition server is not obtained within a preset time length, determining the first operation instruction information as target operation instruction information. That is, after the first client submits the voice data to the voice recognition server, timing may be started, and the target operation instruction information may be determined according to the confidence threshold information and the preset time duration.

In addition, for the case that the local voice is recognized and the first operation instruction information recognized locally is finally determined as the target operation instruction information, the target operation instruction information can be stored locally, so that when the first client collects and recognizes the target operation instruction information again, the result of the local voice recognition can be directly used. For example, for the voice data of "open page 21 of App 2", if after performing voice recognition according to the implementation mode three, the locally recognized first operation instruction information is determined as the target operation instruction information (it may be that the first confidence degree information is higher than the second confidence degree information, or it may be that the second recognition result is not obtained within the preset time length), the target operation instruction information may be locally stored. Thus, when the first client acquires new voice data, local voice recognition can be performed firstly, new operation instruction information extracted from the new voice data is matched with locally stored target operation instruction information, and if matching is successful, the new operation instruction information can be directly used for page direct processing; if the matching fails, the new voice data can be submitted to the voice recognition server, and the voice recognition is carried out according to the scheme provided by the third implementation mode. According to the scheme, quick response to the operation instruction frequently used by the user is facilitated.

In the practical application process, a user can determine one of the three implementation modes for performing voice recognition according to the use requirement. For example, when the user selects the response speed to be prioritized, the first implementation mode may be determined as the target speech recognition mode; when the recognition accuracy rate is selected to be prior, the implementation mode II can be determined as a target voice recognition mode; if the response speed and the recognition accuracy are considered at the same time, the third implementation mode can be determined as the target voice recognition mode. Correspondingly, the first client can obtain the information of the selectable speech recognition modes for displaying, so that the user can select the target speech recognition mode from the information.

S103: and determining a target access path associated with the target service from the access paths associated with the services provided by the first application program, and controlling the target application program to which the target service belongs to provide an access page associated with the target service according to the target access path.

For the scheme that the first client is embodied as a function integrated in the first application, after the first client obtains the target access path, the first client can control the first application (i.e., the target application to which the target service belongs) to be directly positioned to the access page corresponding to the target access path, so that the user can view the access page associated with the target service.

For the scheme that the first client is embodied as an independent application program, after the first client obtains the target access path, the first client can determine the target application program to which the target service belongs, control the target application program to start, and provide the access page associated with the target service according to the target access path. Under the scheme, page display can be performed to the user in various ways, which is exemplified below.

In a first mode, the first client can control the target application program to start, jump to the target application program, and display the access page associated with the target service to the user by the target application program.

In a second mode, the first client can provide a second target interface for page display, so that after the target application program is controlled to be started and the access page associated with the target service is provided, the first client can capture the page and integrate the access page in the second target interface for display. That is, the page display may not be performed by jumping to the target application, the target application may perform background running, provide the access page associated with the target service to the first client, and perform the page display to the user by the first client.

In this embodiment of the application, the identification information of the target service may be embodied as a name of the service, or a name of a page where the service is located. Taking a target application program as 'Tianmao eidolon App' as an example, if a user wants to check in the App, the user can input 'go Tianmao eidolon App' by voice, and thus, the first client can directly position a check-in page; in addition, because the check-in service is on the "eidolon" page, the user may also voice-input "open eidolon page," and likewise, the first client may direct a location to the check-in page.

In addition, the identification information of the target service can also be embodied as user-defined identification information. For example, for a check-in service, a user may customize to "punch a card". When the identification information configuration is required, the first client may provide a fifth operation option for configuring the identification information of the service, and obtain new identification information of the user for the service configuration through the fifth operation option. Specifically, the fifth operation option may be embodied as a text input box, and the user may manually input new identification information of the service after clicking the input box; or, the operation option may be embodied as a voice collection key, and the user may input new identification information of the service by voice after clicking the key.

Still taking the sign-in service in the tianmao eidolon App as an example, if the identification information of the sign-in service acquired by the first client is eidolon, if the identification information is customized as 'card punching', a fifth operation option can be triggered to perform voice input to 'i want to set a shortcut instruction and i want to punch a card', the first client can respond to 'jump to what page' of the following voice after performing voice recognition, and the user can continue to perform voice input to the page of the eidolon, so that the first client can perform voice recognition, establish the association relationship between 'card punching' and 'eidolon', namely, establish the association relationship between the original identification information and the new identification information of the service, and thus when the first client acquires the voice data of 'i want to punch a card' input by the user, the eidolon page can be opened, and the sign-in service is provided for the user.

The self-defined configuration scheme not only can conveniently carry out page through operation through instructions familiar to the user, but also is beneficial to realizing the page through operation on a plurality of target application programs at a time. That is, for the solution that the first client is embodied as a stand-alone application, if the first client has associated with it at least two first applications, and some of them can provide the same service, for the same service, it is possible to have the same identification information in different first applications or different identification information for which, by custom configuration, the same service, provided by at least two first applications, may be configured to have the same identification information, thus, when the first client extracts the identification information of the target service from the user voice data and determines that at least two target application programs are associated with the target service, the target access path associated with the target service under each target application can be determined separately, and controlling each target application program to provide the access page associated with the target service for the user.

As an example, the first client may control the target applications to start sequentially, and provide the access pages associated with the target services to the user sequentially. Taking the example of the user getting to App2 and the App3 signing in, the first client may control App2 to start, jump to App2, show a sign-in page to the user by App2, and send the information to the first client after acquiring the information that the user successfully signs in, so that the first client may control App3 to start, jump to App3, show the sign-in page to the user by App3, and provide a sign-in service.

Or, as another example, the first client may obtain access pages associated with the target services provided by the target applications, and integrate the access pages into the second target interface for presentation. In the above example, the check-in page associated with App2 and the check-in page associated with App3 may be displayed side by side in the second target interface for the user to check in the second target interface.

That is to say, with the solution provided by the embodiment of the present application, a user may open a service under a target application program through a single operation, for example, after the user inputs a voice, a check-in page of App2 may be opened; alternatively, a single operation may open services under at least two target applications, e.g., after a user inputs speech, a check-in page for App2 and a check-in page for App3 may be opened. The setting can be specifically performed in combination with the actual use requirement, and the embodiment of the present application may not be specifically limited thereto.

S104: when determining that the access path associated with the service changes, the access path may be updated.

In the actual application process, if the access path associated with the service changes, the first client may further perform update processing on the access path associated with the service. The access path associated with the service is changed, which may be embodied as an adjusted access path of the service, for example, for the service 51 provided by App5, the associated access path is adjusted from the path 51 to the path 511; alternatively, a new service and its associated access path may be added, for example, App5 adds service 5M, and the access path associated with the new service is path 5M; or, the original service and the access path associated with the original service may be deleted, for example, if the App5 cancels the service 52, the service and the access path associated with the service 52 may be deleted at the same time. Through the above updating process, the association shown in table 2 can be updated as shown in table 3 below.

TABLE 3

As an example, the change information of the access path associated with the service may be configured by the developer, submitted to the application server through the associated terminal, and then sent to the first client by the application server.

Example 2

The following explains a process of implementing page through by the smart speaker in the embodiment of the present application, with reference to the flowchart shown in fig. 3.

S201: and the second client acquires the user voice data and extracts the operation instruction information of the user from the user voice data, wherein the operation instruction information comprises the identification information of the target service to be accessed.

S202: and controlling a target application program to which the target service belongs to provide an access page associated with the target service through a third client associated with the terminal equipment.

In this embodiment, a user may control the smart sound box by voice, and the smart sound box acquires user voice data and extracts operation instruction information from the user voice data to determine a target service required by the user, and then interacts with a terminal device installed with a target application program to which the target service belongs to control the target application program to be directly located on an access page corresponding to the target service.

In the embodiment of the present application, the second client and the third client may interact in multiple ways to provide a page through service to a user, which is described in the following.

In a first manner, the third client may obtain an access path associated with a service provided by the first application installed on the terminal device.

In this way, after the second client obtains the identification information of the target service, the second client can directly send the identification information of the target service to the third client, and the third client determines the target application program to which the target service belongs and the target access path associated with the target service under the target application program, so as to control the target application program to provide the access page associated with the target service according to the target access path.

In a second manner, the second client may obtain identification information of a service associated with the first application installed on the terminal device, and the third client may obtain an access path associated with the service provided by the first application.

In this way, after the second client obtains the identification information of the target service, the second client can determine the target application program to which the target service belongs, send the identification information of the target service and the identification information of the target application program to the third client, determine the target access path associated with the target service from the access paths associated with the service provided by the target application program by the third client, and control the target application program to provide the access page associated with the target service according to the target access path.

In a third way, the second client may obtain an access path associated with the service provided by the first application.

In this way, after obtaining the identification information of the target service, the second client may determine the target application program to which the target service belongs and a target access path associated with the target service under the target application program, and send the target access path to the third client, so that the third client controls the target application program to provide an access page associated with the target service according to the target access path.

In addition, it should be noted that, if the third client is embodied as a function integrated in the target application program, if the target application program is already started and communication is established between the terminal device and the smart sound box, the second client may directly send the information to the third client through a communication channel between the terminal device and the smart sound box, so that the third client performs page direct processing. If the target application program is not started, or no communication is established between the terminal device and the intelligent sound box, or the communication between the terminal device and the intelligent sound box is interrupted, the second client side can submit the information to the target application program server side, and the target application program server side sends a notification message to the terminal device to prompt a user to start the target application program. Correspondingly, after clicking the notification message displayed on the terminal equipment, the user can trigger the target application program to start, and the third client can obtain the information to directly process the page.

In addition, the concrete expression form of the third client, the implementation manner of the third client controlling the target application program to perform page direct, the presentation manner of the access page, and the like may refer to the description related to the first client in the above embodiment, and are not illustrated here.

Example 3

Corresponding to the first client in embodiment 1, the embodiment of the present application may provide an application program, which is used to implement page through processing on a target service provided by a target application program. Specifically, the application programs may include: the first interface, the second interface and the page direct processing program module.

The first interface is used for obtaining operation instruction information extracted from voice data, the operation instruction information comprises identification information of a target service to be accessed, and the voice data is collected by a microphone of the terminal equipment. And the page direct processing program module is used for determining a target application program to which the target service belongs and a target access path associated with the target service. And the second interface is used for calling the target application program and controlling the target application program to provide the access page associated with the target service according to the target access path.

Based on the application program, software upgrading can be performed on the traditional terminal device, so that the traditional terminal device has the capability of performing page through processing on the first application program installed on the terminal device, that is, the application program provided by the embodiment of the application can be installed on the terminal device, so that page through service can be provided for the first application program installed on the terminal device. The specific implementation process can be seen in the flowchart shown in fig. 4.

S301: the method comprises the steps that terminal equipment loads an installation package corresponding to an application program for page through processing;

s302: and starting the application program so as to obtain the identification information of the target service extracted from the voice data, determining the target application program to which the target service belongs and a target access path associated with the target service, and controlling the target application program to provide an access page associated with the target service according to the target access path, wherein the voice data is acquired by a microphone of the terminal equipment.

Or, under the condition of obtaining authorization, the provider of the first application program may upgrade the function of the first application program based on the application program provided in the embodiment of the present application, so that the first application program has a page direct processing capability. The specific implementation process can be seen in the flowchart shown in fig. 5.

S401: adding a code line corresponding to an application program for performing page through processing in a source code of a first application program, wherein the first application program is installed in terminal equipment;

s402: and starting the first application program so as to obtain identification information of a target service extracted from voice data when the code line of the application program for performing page direct processing runs, determining a target access path associated with the target service, and controlling the first application program to provide an access page associated with the target service according to the target access path, wherein the voice data is acquired by a microphone of the terminal equipment.

Example 4

Corresponding to the second client in embodiment 2, the embodiment of the present application may provide an application program, which is used to implement page through processing on a target service provided by a target application program. Specifically, the application programs may include: the first interface, the second interface and the page direct processing program module.

The first interface is used for receiving calling of the intelligent sound box and obtaining user voice data collected by a microphone of the intelligent sound box. And the page direct processing program module is used for extracting operation instruction information of the user from the voice data, wherein the operation instruction information comprises identification information of the target service to be accessed. And the second interface is used for calling the communication interface of the intelligent sound box, interacting with a third client associated with the terminal equipment through the communication interface so as to control a target application program to which the target service belongs to provide an access page associated with the target service through the third client, wherein the target application program belongs to the first application program installed on the terminal equipment.

Based on the application program, software upgrading can be carried out on the traditional intelligent sound box, so that the intelligent sound box has the capability of directly processing the page of the first application program installed on the terminal equipment. The specific implementation process can be seen in the flowchart shown in fig. 6.

S501: loading an installation package corresponding to an application program for page direct processing by the intelligent sound box;

s502: and starting the application program so as to control a target application program to which the target service belongs to provide an access page associated with the target service through a third client associated with the terminal equipment after acquiring user voice data acquired by a microphone of the intelligent sound box and extracting identification information of the target service from the user voice data, wherein the target application program belongs to a first application program installed on the terminal equipment.

Example 5

The embodiment of the application can provide an information collection method, which obtains the target operation behavior information and the incidence relation between the target operation object information, and controls the target operation object to execute the action related to the target operation behavior based on the incidence relation when needed. The following describes, with reference to a flowchart shown in fig. 7, an implementation process of information collection according to an embodiment of the present application.

S601: the fourth client extracts target operation behavior information from the first voice data and target operation object information from the second voice data;

s602: and establishing an incidence relation between the target operation behavior information and the target operation object information.

The extracting of the target operation object information from the second voice data may include: obtaining information of selectable operation objects, and pushing the information of the selectable operation objects in a voice broadcasting mode; and acquiring the second voice data, wherein the second voice data comprises target operation object information determined by the user from the selectable operation object information.

In the embodiment of the application, the fourth client can be deployed on the terminal device, and the voice data of the user is collected through a microphone of the terminal device and voice broadcast is carried out through a loudspeaker of the terminal device. Therefore, the target operation behavior information and the corresponding target operation object information can be collected in a voice interaction mode.

Or, the fourth client may be deployed on the smart speaker, collect user voice data through a microphone of the smart speaker, and perform voice broadcast through a speaker of the smart speaker, thereby completing the information collection processing process.

As an example, the target operation behavior may be a page through operation, and the corresponding target operation object may be a first application program capable of performing page through. Taking the fourth client deployed on the terminal device as an example, the voice interaction process may be embodied as: the user can input 'I want to configure page through' by voice, the fourth client can respond to 'what application program is configured' by voice after voice recognition, the user can continue to input 'App 6 and App 7' by voice, therefore, the fourth client can perform voice recognition, determine App6 and App7 as the first application program, and establish the association relation between page through operation behaviors and App6 and App 7.

Or, after the user inputs "i want to configure page through", the fourth client may determine an optional application from applications installed on the terminal device (for example, the fourth client may determine, as the optional application, an application that authorizes the fourth client, allows the fourth client to obtain an access path associated with a service provided by the application), and respond to the following voice "the following applications may support page through: app6, App7, and App8 ″, correspondingly, after the user hears the prompt information, the user may input "App 6 and App 7" by voice, and thus, the fourth client may also determine App6 and App7 as the first application program, and establish an association relationship between the page through operation behavior and App6 and App 7.

Or, as another example, the target operation behavior may be device control, for example, operation behaviors of turning on a device, turning off the device, watching a movie, and the like, and the corresponding target operation object may be a smart device accessing to the terminal device or a smart device accessing to the smart speaker. Taking a target organization as a family as an example, the intelligent device can be a television, an air conditioner, a refrigerator, a projector, an electric lamp and other internet of things devices.

Taking the fourth client deployed on the smart speaker as an example, the voice interaction process may be embodied as: the user can input 'turn on the device' by voice, and the fourth client can determine the optional device and perform voice broadcast on the optional device information. For example, the fourth client may determine an air conditioner and a projector accessing the smart sound box as optional devices. Preferably, the smart sound box may further communicate with the terminal device, obtain a smart device of the access terminal device, and determine an optional device therefrom, for example, a television, a refrigerator, and an electric lamp of the access terminal device may be determined as the optional device. As such, the fourth client may respond to the following speech "what device is turned on? You can tell me to turn on the air conditioner, the projector, the television, the refrigerator and the electric lamp, and the user can continue to input the voice to turn on the television, so that the fourth client can establish the association between the turning-on device and the television.

Taking the fourth client deployed on the terminal device as an example, the voice interaction process may be embodied as: the user can input 'watch a movie' by voice, the fourth client can determine the intelligent device related to watching the movie as an optional device, for example, determine the television and the lamp connected to the terminal device as optional devices, and determine the projector connected to the intelligent loudspeaker as an optional device, and report the following voice to the user, "you can tell me to turn on the projector, turn on the television and turn off the lamp", the user can continue to input 'turn on the projector and turn off the lamp ", and thus, the fourth client can establish the association relationship between' watch the movie 'and' turn on the projector and turn off the lamp".

The following describes an implementation process of device control according to an embodiment of the present application with reference to a flowchart shown in fig. 8.

S701: and the fifth client acquires identification information of intelligent equipment associated with different operation behavior information, wherein the intelligent equipment belongs to a target organization.

S702: and acquiring user voice data, and extracting operation instruction information of a user from the user voice data, wherein the operation instruction information comprises target operation behavior information.

S703: and determining target intelligent equipment associated with the target operation behavior information, and controlling the target intelligent equipment to execute actions related to the target operation behavior.

In an actual application process, the fifth client may be deployed in the terminal device or may be deployed in the smart speaker.

Taking the example that the fifth client is deployed in the smart sound box, when the target operation behavior of turning on the device is extracted from the user voice data, the television can be determined as the target smart device according to the association relationship obtained by information acquisition, and the television is controlled to be turned on.

Taking the example that the fifth client is deployed on the terminal device, when a target operation behavior of 'watching a movie' is extracted from the user voice data, the projector and the electric lamp can be determined as target intelligent devices according to the association relationship obtained by information acquisition, and the projector is controlled to be turned on and the electric lamp is controlled to be turned off.

It should be noted that in this example, communication is established between the projector and the smart sound box, that is, when the fifth client determines that the smart device accessing the smart sound box exists in the target smart device, the identification information of the smart device and the executed action information may be sent to the smart sound box, and the smart sound box controls the smart device to execute the relevant action. In this example, the fifth client may send the information of "turning on the projector" to the smart speaker, so that the smart speaker may control the projector to turn on, and the terminal device may control the electric lamp to turn off. Similarly, if the fifth client is deployed on the smart sound box, when it is determined that the smart device accessing the terminal device exists in the target smart device, the related information may also be sent to the terminal device, and the terminal device cooperates with the smart sound box to perform device control.

Preferably, for the scheme that the fifth client is deployed in the terminal device, in order to control the smart device accessing the terminal device to execute the relevant action when performing device control, the terminal device needs to establish a long connection with the smart device, which may increase power consumption of the terminal device, cause serious power failure of the terminal device, and may affect user use. Accordingly, the smart speakers are usually powered on by plug-in power, so that all the smart devices associated with the target organization can be connected to the smart speakers for a long time. Under the preferred scheme, a user can operate the terminal device through voice, the fifth client deployed on the terminal device performs voice recognition, target operation behavior information and the associated target intelligent device are determined and sent to the intelligent sound box, and the intelligent sound box controls the target intelligent device to execute actions related to the target operation behavior.

Example 6

Embodiment 6 is a method corresponding to embodiment 1, and provides a page through processing method from the perspective of a first client, and with reference to fig. 9, the method may specifically include:

s801: a first client obtains an access path associated with a service provided by a first application program, wherein the first application program is installed in terminal equipment;

s802: obtaining operation instruction information extracted from voice data collected by a microphone of the terminal equipment, wherein the operation instruction information comprises identification information of a target service to be accessed;

s803: and determining a target access path associated with the target service from the access paths associated with the services provided by the first application program, and controlling the target application program to which the target service belongs to provide an access page associated with the target service according to the target access path.

Example 7

Embodiment 7 is a method corresponding to embodiment 2, and provides a page through processing method from the perspective of the second client, and referring to fig. 10, the method may specifically include:

s901: a second client associated with the intelligent sound box obtains user voice data, and extracts operation instruction information of a user from the user voice data, wherein the operation instruction information comprises identification information of a target service to be accessed, and the voice data is collected by a microphone of the intelligent sound box;

s902: and controlling a target application program to which the target service belongs to provide an access page associated with the target service through a third client associated with the terminal equipment, wherein the target application program belongs to a first application program installed on the terminal equipment.

Example 8

Embodiment 8 is a method corresponding to embodiment 5, and from the perspective of a fourth client, an information collection method is provided, and referring to fig. 11, the method may specifically include:

s1001: the fourth client extracts target operation behavior information from the first voice data and target operation object information from the second voice data;

s1002: and establishing an incidence relation between the target operation behavior information and the target operation object information.

Example 9

Embodiment 9 is a method corresponding to embodiment 5, and from the perspective of a fifth client, there is provided a device control method, referring to fig. 12, where the method may specifically include:

s1101: the fifth client obtains identification information of intelligent equipment associated with different operation behavior information, wherein the intelligent equipment belongs to a target organization;

s1102: acquiring user voice data, and extracting operation instruction information of a user from the user voice data, wherein the operation instruction information comprises target operation behavior information;

s1103: and determining target intelligent equipment associated with the target operation behavior information, and controlling the target intelligent equipment to execute actions related to the target operation behavior.

For the parts not described in detail in embodiment 6 and embodiment 9, reference may be made to the descriptions in the foregoing embodiments, which are not repeated herein.

Corresponding to embodiment 1, an embodiment of the present application further provides a page through processing apparatus, referring to fig. 13, where the apparatus is applied to a first client, and includes:

an access path associated information obtaining unit 1201, configured to obtain an access path associated with a service provided by a first application, where the first application is installed in a terminal device;

an operation instruction information obtaining unit 1202, configured to obtain operation instruction information extracted from voice data acquired by a microphone of the terminal device, where the operation instruction information includes identification information of a target service to be accessed;

a target access path determining unit 1203, configured to determine a target access path associated with the target service from access paths associated with services provided by the first application;

an access page providing unit 1204, configured to control a target application to which the target service belongs to provide an access page associated with the target service according to the target access path.

Wherein the apparatus further comprises:

and the updating processing unit is used for updating the access path when determining that the access path associated with the service changes.

Wherein the first client is deployed in the first application.

The first client is an independent application program associated with the first application program.

Wherein the apparatus further comprises:

a first application program determining unit, configured to obtain identification information of a specified service, and determine, from applications installed in the terminal device, an optional application program that can provide the specified service; and displaying the identification information of the selectable application program to obtain the first application program selected by the user.

Wherein the apparatus further comprises:

the first application program determining unit is used for determining at least two second application programs and respectively providing operation options for starting the second application programs; and determining the second application program started by the user through the corresponding operation option as the first application program.

Wherein the apparatus further comprises:

a first application program determining unit for providing a first operation option for obtaining voice data related to the first application program; extracting identification information of the first application program from the voice data obtained through the first operation option.

Wherein, if communication is established between the terminal equipment and the intelligent sound box, the device further comprises:

the first application program determining unit is used for obtaining identification information of the first application program extracted from voice data by the intelligent sound box, wherein the voice data is acquired by a microphone of the intelligent sound box.

Wherein, if the first application program is provided with a second operation option for acquiring voice data and the voice data is obtained through the second operation option and the operation instruction information is extracted from the voice data,

the operation instruction information obtaining unit is specifically configured to: and receiving the call of the first application program for starting, and obtaining the operation instruction information sent by the first application program.

Wherein, if the first application program is provided with a third operation option for triggering the first client through a first target interface, the operation instruction information obtaining unit includes:

the voice data acquisition unit is used for providing a fourth operation option for acquiring the voice data after being triggered and started by the third operation option; if the information needing voice input is acquired through the fourth operation option, calling a microphone of the terminal equipment to acquire the voice data;

an operation instruction information extracting unit configured to extract the operation instruction information from the voice data.

The operation instruction information extraction unit is specifically configured to: performing voice recognition on the voice data to obtain a first voice recognition result, wherein the first voice recognition result comprises first operation instruction information and associated first confidence information; submitting the voice data to a voice recognition service end so that the voice recognition service end can perform voice recognition to obtain a second voice recognition result, wherein the second voice recognition result comprises second operation instruction information and associated second confidence information; obtaining a second voice recognition result issued by the voice recognition server, and determining the first confidence information and the second confidence information with high confidence as target confidence information; and determining the operation instruction information associated with the target confidence information as target operation instruction information, and performing page through processing according to the target operation instruction information.

Wherein the operation instruction information extraction unit is further configured to: obtaining confidence threshold information; and if the first confidence degree information is lower than the confidence degree threshold information, waiting for obtaining the second speech recognition result, and determining the target confidence degree information from the first confidence degree information and the second confidence degree information.

Wherein the operation instruction information extraction unit is further configured to: acquiring preset time length information; and if the first confidence degree information is lower than the confidence degree threshold information and the second speech recognition result is obtained within the preset time length, determining the target confidence degree information from the first confidence degree information and the second confidence degree information.

Wherein the operation instruction information extraction unit is further configured to: and if the first confidence degree information is lower than the confidence degree threshold information and the second voice recognition result is not obtained within the preset time length, determining the first confidence degree information as the target confidence degree information.

Wherein, if the target operation instruction information is the first operation instruction information, the apparatus further includes:

the instruction information storage unit is used for locally storing the target operation instruction information;

the instruction information matching unit is used for matching the new operation instruction information with the locally stored target operation instruction information when new voice data is obtained and new operation instruction information is extracted from the new voice data; and if the matching fails, submitting the new voice data to the voice recognition server side for voice recognition.

Wherein, the access page providing unit is specifically configured to: and controlling the target application program to start, jumping to the target application program, and displaying the access page associated with the target service by the target application program.

Wherein, the access page providing unit is specifically configured to: providing a second target interface for page display; controlling the target application program to start and provide an access page associated with the target service, and then performing page capture; and integrating the access page in the second target interface for displaying.

Wherein the apparatus further comprises:

the identification information configuration unit is used for providing a fifth operation option for configuring the identification information of the service; obtaining new identification information of the user for service configuration through the fifth operation option; and acquiring original identification information of the service, and establishing an association relation between the original identification information and the new identification information.

Corresponding to embodiment 3, an embodiment of the present application further provides a page through processing apparatus, referring to fig. 14, where the apparatus is applied to a terminal device, and includes:

the installation package loading unit 1301 is used for loading an installation package corresponding to an application program for performing page through processing;

an application starting unit 1302, configured to start the application, so as to obtain identification information of a target service extracted from voice data, determine a target application to which the target service belongs and a target access path associated with the target service, and control the target application to provide an access page associated with the target service according to the target access path, where the voice data is collected by a microphone of the terminal device.

Corresponding to embodiment 3, an embodiment of the present application further provides a page through processing apparatus, referring to fig. 15, where the apparatus is applied to a first application program, and includes:

a code line adding unit 1401, configured to add a code line corresponding to an application program for performing page through processing in a source code of the first application program, where the first application program is installed in a terminal device;

an application program starting unit 1402, configured to start the first application program, so that when the code line runs, the identification information of the target service extracted from the voice data is obtained, a target access path associated with the target service is determined, the first application program is controlled to provide an access page associated with the target service according to the target access path, and the voice data is collected by a microphone of the terminal device.

Corresponding to embodiment 2, an embodiment of the present application further provides a page through processing apparatus, referring to fig. 16, where the apparatus is applied to a second client associated with a smart speaker, and includes:

an operation instruction information extraction unit 1501, configured to obtain user voice data, and extract operation instruction information of a user from the user voice data, where the operation instruction information includes identification information of a target service to be accessed, and the voice data is collected by a microphone of the smart sound box;

an access page providing unit 1502, configured to control, through a third client associated with a terminal device, a target application program to which the target service belongs to provide an access page associated with the target service, where the target application program belongs to a first application program installed on the terminal device.

Wherein, the access page providing unit is specifically configured to: and sending the identification information of the target service to the third client, so that the third client determines a target application program to which the target service belongs and a target access path associated with the target service under the target application program, and further controls the target application program to provide an access page associated with the target service according to the target access path.

Wherein the apparatus further comprises:

an identification information obtaining unit, configured to obtain identification information of a service associated with the first application;

the access page providing unit is specifically configured to: determining a target application program to which the target service belongs from the first application program according to the identification information of the target service; and sending the identification information of the target service and the identification information of the target application program to the third client, so that the third client determines a target access path associated with the target service from the access paths associated with the service provided by the target application program, and controls the target application program to provide an access page associated with the target service according to the target access path.

Wherein the apparatus further comprises:

an access path associated information obtaining unit, configured to obtain an access path associated with a service provided by the first application;

the access page providing unit is specifically configured to: determining a target application program to which the target service belongs and a target access path associated with the target service under the target application program according to the identification information of the target service; and sending the target access path to the third client so that the third client can control the target application program to provide an access page associated with the target service according to the target access path.

Corresponding to embodiment 4, an embodiment of the present application further provides a device for processing page through, referring to fig. 17, where the device is applied to a smart speaker, and includes:

an installation package loading unit 1601, configured to load an installation package corresponding to an application program for performing page through processing;

an application program starting unit 1602, configured to start the application program, so that after obtaining user voice data acquired by a microphone of the smart speaker and extracting identification information of a target service from the user voice data, a target application program to which the target service belongs is controlled to provide an access page associated with the target service through a third client associated with a terminal device, where the target application program belongs to a first application program installed on the terminal device.

Corresponding to embodiment 5, an embodiment of the present application further provides an information collecting apparatus, referring to fig. 18, which is applied to a fourth client, and includes:

an operation information extraction unit 1701 for extracting target operation behavior information from the first voice data and target operation object information from the second voice data;

an association relationship establishing unit 1702, configured to establish an association relationship between the target operation behavior information and the target operation object information.

The operation information extraction unit is specifically configured to: obtaining information of selectable operation objects, and pushing the information of the selectable operation objects in a voice broadcasting mode; and acquiring the second voice data, wherein the second voice data comprises target operation object information determined by the user from the selectable operation object information.

The target operation behavior is page through operation, and the target operation object is an application program installed on the terminal equipment.

The target operation behavior is equipment control, and the target operation object is intelligent equipment associated with a target organization.

Corresponding to embodiment 5, an embodiment of the present application further provides an apparatus for controlling devices, referring to fig. 19, where the apparatus is applied to a fifth client, and includes:

an associated information obtaining unit 1801, configured to obtain identification information of an intelligent device associated with each of different pieces of operation behavior information, where the intelligent device belongs to a target organization;

an operation instruction information extraction unit 1802, configured to obtain user voice data and extract operation instruction information of a user from the user voice data, where the operation instruction information includes target operation behavior information;

a device control unit 1803, configured to determine a target intelligent device associated with the target operation behavior information, and control the target intelligent device to execute an action related to the target operation behavior.

Wherein the fifth client is deployed on the terminal device, and the target intelligent device establishes long connection with the intelligent sound box,

the device control unit is specifically configured to: and sending the identification information of the target intelligent equipment and the executed action information to the intelligent sound box so that the intelligent sound box controls the target intelligent equipment to execute the action.

In addition, an embodiment of the present application further provides an electronic device, including:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

And an electronic device comprising:

one or more processors; and

Where fig. 20 illustratively shows the architecture of an electronic device, device 1900 may be, for example, a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, an aircraft, or the like.

Referring to fig. 20, device 1900 may include one or more of the following components: a processing component 1902, a memory 1904, a power component 1906, a multimedia component 1908, an audio component 1910, an input/output (I/O) interface 1912, a sensor component 1914, and a communications component 1916.

The processing component 1902 generally controls overall operation of the device 1900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 1902 may include one or more processors 1920 that execute instructions to perform all or a portion of the steps of the methods provided by the disclosed subject matter. Further, the process component 1902 can include one or more modules that facilitate interaction between the process component 1902 and other components. For example, the processing component 1902 can include a multimedia module to facilitate interaction between the multimedia component 1908 and the processing component 1902.

The memory 1904 is configured to store various types of data to support operations at the device 1900. Examples of such data include instructions for any application or method operating on device 1900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1904 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A power supply component 1906 provides power to the various components of the device 1900. The power components 1906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1900.

The multimedia component 1908 includes a screen that provides an output interface between the device 1900 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1908 includes a front-facing camera and/or a rear-facing camera. The front-facing camera and/or the back-facing camera may receive external multimedia data when the device 1900 is in an operating mode, such as a capture mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

Audio component 1910 is configured to output and/or input audio signals. For example, audio component 1910 includes a Microphone (MIC) configured to receive external audio signals when device 1900 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 1904 or transmitted via the communication component 1916. In some embodiments, audio component 1910 further includes a speaker for outputting audio signals.

The I/O interface 1912 provides an interface between the processing component 1902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 1914 includes one or more sensors to provide various aspects of state assessment for the device 1900. For example, the sensor component 1914 may detect an open/closed state of the device 1900, the relative positioning of components such as a display and keypad of the device 1900, the sensor component 1914 may also detect a change in position of the device 1900 or a component of the device 1900, the presence or absence of user contact with the device 1900, orientation or acceleration/deceleration of the device 1900, and a change in temperature of the device 1900. The sensor component 1914 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor component 1914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 1914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1916 is configured to facilitate wired or wireless communication between the device 1900 and other devices. The device 1900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the device 1900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 1904 comprising instructions, executable by the processor 1920 of the device 1900, to perform the methods provided by the present disclosure, is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

The page through processing method, device and electronic equipment, the information collection method, device and electronic equipment, the equipment control method, device and electronic equipment provided by the application are described in detail above, specific examples are applied in the text to explain the principle and implementation mode of the application, and the description of the above embodiments is only used to help understanding the method and core ideas of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific embodiments and the application range may be changed. In view of the above, the description should not be taken as limiting the application.

Claims

1. A page through processing method is characterized by comprising the following steps:

2. The method of claim 1, further comprising:

and when determining that the access path associated with the service is changed, updating the access path.

3. The method of claim 1, wherein the first client is deployed in the first application.

4. The method of claim 1, wherein the first client is a standalone application associated with the first application.

5. The method of claim 4,

determining the first application program in the following manner:

obtaining identification information of a specified service, and determining optional application programs capable of providing the specified service from application programs installed in the terminal equipment;

and displaying the identification information of the selectable application program to obtain the first application program selected by the user.

6. The method of claim 4,

determining the first application program in the following manner:

determining at least two second application programs and respectively providing operation options for starting the second application programs;

and determining the second application program started by the user through the corresponding operation option as the first application program.

7. The method of claim 4,

determining the first application program in the following manner:

providing a first operational option for obtaining voice data associated with the first application;

extracting identification information of the first application program from the voice data obtained through the first operation option.

8. The method of claim 4, wherein if communication is established between the terminal device and a smart sound box, then

Determining the first application program in the following manner:

and obtaining identification information of a first application program extracted from voice data by the intelligent sound box, wherein the voice data is acquired by a microphone of the intelligent sound box.

9. The method according to claim 1, wherein if the first application program is provided with a second operation option for voice data collection, and the voice data is obtained through the second operation option and the operation instruction information is extracted from the voice data, the method further comprises the step of obtaining the voice data through the second operation option and extracting the operation instruction information from the voice data

The obtaining of the operation instruction information extracted from the voice data collected by the microphone of the terminal device includes:

and receiving the call of the first application program for starting, and obtaining the operation instruction information sent by the first application program.

10. The method of claim 1, wherein if the first application is provided with a third operational option for triggering the first client via a first target interface,

after being triggered and started by the third operation option, providing a fourth operation option for acquiring the voice data;

and if the information needing voice input is acquired through the fourth operation option, calling a microphone of the terminal equipment to acquire the voice data, and extracting the operation instruction information from the voice data.

11. The method of claim 10,

the extracting the operation instruction information from the voice data includes:

performing voice recognition on the voice data to obtain a first voice recognition result, wherein the first voice recognition result comprises first operation instruction information and associated first confidence information;

submitting the voice data to a voice recognition service end so that the voice recognition service end can perform voice recognition to obtain a second voice recognition result, wherein the second voice recognition result comprises second operation instruction information and associated second confidence information;

obtaining a second voice recognition result issued by the voice recognition server, and determining the first confidence information and the second confidence information with high confidence as target confidence information;

and determining the operation instruction information associated with the target confidence information as target operation instruction information, and performing page through processing according to the target operation instruction information.

12. The method of claim 11, further comprising:

obtaining confidence threshold information;

and if the first confidence degree information is lower than the confidence degree threshold information, waiting for obtaining the second speech recognition result, and determining the target confidence degree information from the first confidence degree information and the second confidence degree information.

13. The method of claim 12, further comprising:

acquiring preset time length information;

and if the first confidence degree information is lower than the confidence degree threshold information and the second speech recognition result is obtained within the preset time length, determining the target confidence degree information from the first confidence degree information and the second confidence degree information.

14. The method of claim 13, further comprising:

and if the first confidence degree information is lower than the confidence degree threshold information and the second voice recognition result is not obtained within the preset time length, determining the first confidence degree information as the target confidence degree information.

15. The method according to claim 11, wherein if the target operation instruction information is the first operation instruction information, the method further comprises:

locally storing the target operation instruction information;

if new voice data is obtained and new operation instruction information is extracted from the new voice data, matching the new operation instruction information with the locally stored target operation instruction information;

and if the matching fails, submitting the new voice data to the voice recognition server side for voice recognition.

16. The method of claim 3,

the target application program controlling the target service to belong to provides an access page related to the target service according to the target access path:

and controlling the target application program to start, jumping to the target application program, and displaying the access page associated with the target service by the target application program.

17. The method of claim 3,

providing a second target interface for page display;

controlling the target application program to start and provide an access page associated with the target service, and then performing page capture;

and integrating the access page in the second target interface for displaying.

18. The method of claim 1, further comprising:

providing a fifth operational option for configuring identification information of the service;

obtaining new identification information of the user for service configuration through the fifth operation option;

and acquiring original identification information of the service, and establishing an association relation between the original identification information and the new identification information.

19. An application program, comprising:

20. A page through processing method is characterized by comprising the following steps:

the terminal equipment loads an installation package corresponding to the application program of claim 19;

21. A page through processing method is characterized by comprising the following steps:

adding a code line corresponding to the application program according to claim 19 in a source code of a first application program, wherein the first application program is installed in a terminal device;

22. A page through processing method is characterized by comprising the following steps:

23. The method of claim 22,

the controlling, by the third client associated with the terminal device, the target application to which the target service belongs to provide the access page associated with the target service includes:

and sending the identification information of the target service to the third client, so that the third client determines a target application program to which the target service belongs and a target access path associated with the target service under the target application program, and further controls the target application program to provide an access page associated with the target service according to the target access path.

24. The method of claim 22, further comprising:

obtaining identification information of a service associated with the first application;

determining a target application program to which the target service belongs from the first application program according to the identification information of the target service;

and sending the identification information of the target service and the identification information of the target application program to the third client, so that the third client determines a target access path associated with the target service from the access paths associated with the service provided by the target application program, and controls the target application program to provide an access page associated with the target service according to the target access path.

25. The method of claim 22, further comprising:

obtaining an access path associated with a service provided by the first application program;

determining a target application program to which the target service belongs and a target access path associated with the target service under the target application program according to the identification information of the target service;

and sending the target access path to the third client so that the third client can control the target application program to provide an access page associated with the target service according to the target access path.

26. An application program, comprising:

27. A page through processing method is characterized by comprising the following steps:

loading an installation package corresponding to the application program according to claim 26 by the smart sound box;

28. An information collection method, comprising:

29. The method of claim 28,

the extracting target operation object information from the second voice data includes:

obtaining information of selectable operation objects, and pushing the information of the selectable operation objects in a voice broadcasting mode;

and acquiring the second voice data, wherein the second voice data comprises target operation object information determined by the user from the selectable operation object information.

30. The method of claim 28,

31. The method of claim 28,

32. An apparatus control method characterized by comprising:

33. The method of claim 32, wherein the fifth client is deployed on a terminal device, and wherein the target smart device establishes a long connection with a smart sound box,

the controlling the target intelligent device to execute the action related to the target operation behavior comprises the following steps:

and sending the identification information of the target intelligent equipment and the executed action information to the intelligent sound box so that the intelligent sound box controls the target intelligent equipment to execute the action.

34. A page through processing device is applied to a first client and comprises:

35. A page through processing device is characterized in that the page through processing device is applied to terminal equipment and comprises the following components:

36. A page through processing device is applied to a first application program and comprises the following components:

37. The utility model provides a page is processing apparatus through which characterized in that, is applied to the second customer end that intelligent audio amplifier is correlated with, includes:

38. The utility model provides a page is processing apparatus through which is characterized in that, is applied to intelligent audio amplifier, includes:

39. An information collection device, applied to a fourth client, includes:

40. The device control apparatus is applied to a fifth client, and comprises:

41. An electronic device, comprising:

one or more processors; and

42. An electronic device, comprising:

one or more processors; and

43. An electronic device, comprising:

one or more processors; and

44. An electronic device, comprising:

one or more processors; and

45. An electronic device, comprising:

one or more processors; and

46. An electronic device, comprising:

one or more processors; and

47. An electronic device, comprising:

one or more processors; and