WO2022262298A1

WO2022262298A1 - Application or service processing method, device, and storage medium

Info

Publication number: WO2022262298A1
Application number: PCT/CN2022/076123
Authority: WO
Inventors: 沈剑锋; 汪智勇; 李晨雄
Original assignee: 深圳传音控股股份有限公司
Priority date: 2021-06-15
Filing date: 2022-02-13
Publication date: 2022-12-22

Abstract

Disclosed in the present application are an application or service processing method, a device, and a storage medium. The application or service processing method comprises: in response to acquiring information to be processed, detecting whether a first application or service that is currently woken up or running meets a processing condition; and according to a detection result, processing the first application or service and/or a second application or service on the basis of a preset policy. By means of the application or service processing method, the device, and the storage medium disclosed in the present application, after information to be processed is acquired, a first application or service and/or a second application or service are/is processed, such that when an application or service is used, the data security and/or interaction effect can be improved, thereby improving the user experience. In another mode, the first application or service and/or the second application or service are/is processed in collaboration with an association device, such that the data security and/or interaction effect may be improved on the basis of functions and control capabilities of multiple devices, thereby improving the user experience.

Description

Application or service processing method, device and storage medium

This application claims priority to Chinese Patent Application No. 202110658632.7, filed June 15, 2021, and Chinese Patent Application No. 202110706372.6, filed June 24, 2021, which are incorporated by reference in their entirety into this application .

technical field

The present application relates to the field of communication technologies, and in particular to an application or service processing method, device, and storage medium.

Background technique

With the advent of the era of artificial intelligence, the research and development of intelligent applications has become more in-depth and the scope of use has become wider, which has brought great convenience to people's lives. Most devices (such as mobile phones, headphones, cars or TVs, etc.) There are two or more human-computer interaction applications (such as voice assistants), and/or there are two or more human-computer interaction applications between different devices.

The foregoing description is provided to provide general background information and does not necessarily constitute prior art.

technical problem

During the process of conceiving and implementing this application, the inventor found at least the following problems: Since different human-computer interaction applications work independently, when using human-computer interaction applications to process information, the functions of different human-computer interaction applications cannot be fully utilized and interaction capabilities, there is a problem that human-computer interaction applications cannot be effectively managed or utilized, or data security cannot be effectively controlled, there are data security problems, or the interaction effect is not good, affecting users experience.

technical solution

In view of the above technical problems, this application provides a processing method, device and storage medium for applications or services, which can improve the accuracy of the response to the data to be processed and/or improve the interaction effect after obtaining the data to be processed, or, after obtaining the data to be processed After the information is processed, processing the first application or service and/or the second application or service can improve data security and/or interaction effect and improve user experience when using the application or service.

In order to solve the above technical problems, in the first aspect, the present application provides an application or service processing method applied to a processing device, including:

Step S1: in response to obtaining the data to be processed, determine at least one target application or target service;

Step S2: In response to the target application or target service, perform corresponding processing according to a preset policy.

Optionally, the step S1 includes:

Step S11a: According to the acquired operation, and/or preset information, and/or scene information, and/or source information of the data to be processed, and/or related information of the data to be processed, and/or According to the response result of the data to be processed, at least one target application or target service is determined.

Optionally, the step S1 includes:

If the processing device is not a control center, perform step S11a; and/or,

If the processing device is the control center, perform step S11b: determine whether there is an associated device, and if there is an associated device, determine at least one target application or target service from the associated device.

Optionally, the determining at least one target application or target service from the associated device includes at least one of the following:

If there is only one associated device, and the associated device has multiple applications or services, the application or service that can respond to the data to be processed is determined as the target application or target service; and/or,

If there are multiple associated devices, at least one target device is determined according to a preset rule, and an application or service in the at least one target device that can respond to the data to be processed is determined as a target application or a target service.

Optionally, the determining at least one target device according to preset rules includes at least one of the following:

Taking the associated device whose physiological parameter information of the user satisfies the first preset condition as the target device;

Taking at least one associated device whose device system information satisfies a second preset condition as a target device;

Taking at least one associated device whose communication information of the device satisfies the third preset condition as the target device;

Taking at least one associated device whose device application information satisfies the fourth preset condition as a target device;

Taking at least one associated device whose device reminder information satisfies the fifth preset condition as the target device;

Taking at least one associated device whose device detection information satisfies the sixth preset condition as the target device;

Taking at least one associated device whose device state information satisfies the seventh preset condition as a target device;

At least one associated device whose device environment information satisfies the eighth preset condition is taken as the target device.

Optionally, the step S11a includes:

Determine at least one processing information according to the relevant information of the data to be processed, and determine a first target application or target service according to the at least one processing information; and/or,

In response to a response result of the first target application or target service to the data to be processed, a second target application or target service is determined.

Optionally, the step S11a includes:

obtain at least one processing information;

If there is only one processing information, determine at least one first application or service that can respond to the processing information, and determine a target application or target service from the at least one first application or service according to a first determination strategy; and /or,

If there are at least two processing information, determine at least one second application or service that can partially and/or completely respond to the processing information, and determine from the at least one second application or service according to a second determination strategy Target application or target service.

Optionally, the step S2 includes:

outputting the data to be processed, and/or the processing request obtained based on the data to be processed, and/or the response result obtained based on the data to be processed, to the target application or target service with a preset transmission strategy, to make the target application or target service respond.

Optionally, the target application or target service includes at least one first target application or target service and at least one second target application or target service, and the step S2 includes at least one of the following:

If the first target application or target service and the second target application or target service belong to the same device, perform processing according to a first preset policy; and/or,

If the first target application or target service and the second target application or target service do not belong to the same device, processing is performed according to a second preset policy.

Optionally, the processing according to the first preset strategy includes at least one of the following:

waking up the first target application or target service and/or the second target application or target service according to a first wakeup policy;

Executing the first target application or target service and/or the second target application or target service according to a first execution policy;

exiting the first target application or target service and/or the second target application or target service according to a first exit policy;

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a first output strategy;

And/or, the processing according to the second preset strategy includes at least one of the following:

waking up the first target application or target service and/or the second target application or target service according to a second wakeup policy;

Executing the first target application or target service and/or the second target application or target service according to a second execution policy;

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a second output policy;

Exiting the first target application or target service and/or the second target application or target service according to a second exit policy.

Optionally, the wake-up strategy includes at least one of the following: sequential wake-up based on the priority of the application or service, sequential wake-up based on the distance from the device where the application or service is located, and simultaneous wake-up; and/or,

The running strategy includes at least one of the following: running sequentially based on the wake-up time of the application or service, running sequentially based on the network status of the device where the application or service is located, and running simultaneously; and/or,

The output strategy includes at least one of the following: sequential output based on the priority order of the application or service, sequential output based on the content of the response result, and simultaneous output; and/or,

The exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit.

Optionally, the step S2 further includes: outputting the response information according to a preset output policy in response to receiving the response information sent by the target application or target service.

Optionally, the outputting the response information according to a preset output strategy includes at least one of the following:

Outputting the response according to the receiving chronological order, and/or the priority order of the target application or target service, and/or the current scene, and/or the received operation information, and/or the device corresponding to the response information information. .

In a second aspect, the present application provides an application or service processing method applied to a processing device, including:

Step S10: Responding to the processing request of the first target application or target service;

Step S20: wake up or run the second target application or target service of the associated device;

Step S30: In response to a preset operation, process the first target application or target service according to a first preset policy; and/or process the second target application or target service according to a second preset policy .

Optionally, the step S10 includes:

Step S110a: In response to obtaining the data to be processed, according to the obtained operation, and/or preset information, and/or scene information, and/or source information of the data to be processed, and/or related information of the data to be processed, determine A first target application or target service.

Optionally, the step S10 includes:

If the processing device is not a control center, perform step S110a; and/or,

If the processing device is the control center, perform step S110b: determine whether there is an associated device, and if there is an associated device, determine the first target application or target service from the associated device.

Optionally, the step S110a includes: determining at least one piece of processing information according to the relevant information of the data to be processed; and determining a first target application or target service according to the at least one piece of processing information.

Optionally, the step S10 includes:

The first target application or target service meets the first preset condition in response to the received data to be processed, and/or the device where the first target application or target service is located meets the second preset condition, and/or the first target application or The response result of the target service does not satisfy the third preset condition, and/or the acquired operation information satisfies the fourth preset condition, and a processing request is sent.

Optionally, before the step S20, it also includes:

According to the response result of the first target application or target service, and/or, preset information, and/or, data to be processed, and/or, operation information, and/or the scene where the processing device is located, determine at least one associated device.

Optionally, the step S20 includes:

If there is only one associated device, and the associated device has multiple applications or services, then determine the application or service that can respond to the processing request as the second target application or target service; and/or,

If there are multiple associated devices, at least one target device is determined according to preset rules, and an application or service in the at least one target device that can respond to the processing request is determined as a second target application or target service.

Optionally, the processing the first target application or target service according to a first preset strategy includes at least one of the following: controlling the first target application or target service to respond to the processing request; controlling the The first target application or target service is closed or hidden or frozen or dormant; in response to a response result of the second target application or target service to the processing request, controlling the first target application or target service to output a feedback message;

And/or, the processing of the second target application or target service according to a second preset strategy includes at least one of the following: controlling the second target application or target service not to respond to the processing request; The second target application or target service delays responding to the processing request; controlling the second target application or target service to respond to the processing request, and sending a response result to the first target application or target service.

In a third aspect, the present application provides an application or service processing method applied to a processing device, including:

Step S100: Responding to a first preset operation, wake up or run at least one first target application or target service, and/or at least one second target application or target service;

Step S200: In response to a second preset operation, perform preset processing on the first target application or target service and/or the second target application or target service according to a preset policy.

Optionally, before waking up or running at least one first target application or target service, and/or, before at least one second target application or target service, further includes: determining at least one piece of processing information in response to acquiring data to be processed , and determine a first target application or target service according to the at least one processing information; and/or, in response to a response result of the first target application or target service to the data to be processed, determine a second target application or target Serve.

Optionally, the step S100 includes at least one of the following:

waking up the first target application or target service and/or the second target application or target service sequentially according to the priority order of the applications or services;

simultaneously waking up the first target application or target service and the second target application or target service;

Running the first target application or target service and/or the second target application or target service sequentially based on the wake-up time sequence of the applications or services;

Running the first target application or target service and/or the second target application or target service sequentially based on the network status of the device where the application or service is located.

Optionally, the preset processing of the first target application or target service and/or the second target application or target service according to a preset strategy includes at least one of the following:

Send a management request to the associated device, and control the corresponding application or service in the first target application or target service and the second target application or target service to respond according to the feedback information from the associated device;

Outputting a prompt message for prompting whether the first target application or target service and/or the second target application or target service responds.

Optionally, the preset strategy includes:

exiting the first target application or target service and/or the second target application or target service according to a second exit policy;

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to the second output strategy.

Optionally, the exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit; and/or,

The output strategy includes at least one of the following: sequential output based on the priority order of applications or services, sequential output based on content of response results, and simultaneous output.

Optionally, the step S200 also includes:

In response to receiving the response information sent by the first target application or target service and/or the second target application or target service, output the response information according to a preset output policy.

According to the received chronological order, and/or the priority order of the first target application or target service and/or the second target application or target service, and/or the current scene, and/or the received operation information, and /or the device corresponding to the response information outputs the response information.

In a fourth aspect, the present application provides an application or service processing method applied to a processing device, including:

Step S01: In response to acquiring information to be processed, detecting whether the currently awakened or running first application or service meets processing conditions;

Step S02: according to the detection result, process the first application or service and/or the second application or service based on a preset policy.

Optionally, the meeting the treatment conditions includes at least one of the following:

Being in a preset scene; being in a preset mode; having preset permissions; supporting the functions to be realized by the information to be processed; allowing the functions required to use the information to be processed; being in the scene associated with the information to be processed and / or pattern.

Optionally, the meeting the processing conditions includes being in a scene and/or mode associated with the information to be processed, and the step S01 includes: determining key information in response to obtaining the information to be processed; detecting the current Whether the awakened or running first application or service is in a scene and/or mode associated with the information to be processed.

Optionally, the key information includes at least one of a location of a processing object of the information to be processed, a trigger location, a processing time, a source application, and a target application.

Optionally, the step S02 includes:

If the first application or service does not meet the processing conditions, then process the first application or service and/or the second application or service according to a first preset policy; and/or,

If the first application or service meets the processing condition, the first application or service and/or the second application or service are processed according to a second preset policy.

Optionally, the step S02 includes:

outputting prompt information if the first application or service does not meet the processing conditions;

In response to a selection operation, processing a corresponding application or service among the first application or service and the second application or service according to the selection result; and/or,

In response to not responding to the prompt information, the first application or service and/or the second application or service are processed according to a first preset policy.

Optionally, processing the first application or service according to a first preset strategy includes at least one of the following:

controlling the first application or service to process part of the information to be processed;

controlling the first application or service not to process the pending information;

Outputting information for prompting whether to process the information to be processed by the first application or service;

In response to a first preset operation, controlling the first application or service to process the information to be processed;

Delay processing the information to be processed; and/or, after the first application or service meets the processing condition, control the first application or service to process the information to be processed;

And/or, processing the second application or service according to the first preset strategy includes at least one of the following:

wake up or run the second application or service;

controlling the second application or service to process at least a part of the information to be processed;

Outputting information for prompting whether to process the information to be processed by the second application or service;

In response to a second preset operation, controlling the second application or service to process the information to be processed;

controlling the second application or service to process at least a part of the information to be processed, and sending a processing result to the first application or service;

And/or, processing the first application or service and the second application or service according to a first preset strategy includes at least one of the following:

controlling the first application or service to process part of the information to be processed, sending a processing result to the second application or service, and controlling the second application or service to output feedback information;

Controlling the first application or service to process at least a part of the information to be processed and sending the processing result to the second application or service, controlling the second application or service to the first application or service Process the results and output feedback information;

Controlling the second application or service to process at least a part of the information to be processed, sending a processing result to the first application or service, and controlling the first application or service to output feedback information.

Optionally, processing the first application or service according to a second preset strategy includes at least one of the following:

controlling the first application or service to start processing at least a part of the information to be processed;

controlling the first application or service to process at least a part of the information to be processed within a preset time period;

Control the first application or service to process the information to be processed according to the current scene or mode; output a processing result;

And/or, processing the second application or service according to a second preset strategy includes at least one of the following:

controlling the second application or service to sleep or exit the second application or service;

Outputting information for prompting whether the second application or service processes part of the information to be processed;

In response to a second preset operation, controlling the second application or service to process part of the information to be processed;

And/or, processing the first application or service and the second application or service according to a second preset strategy includes at least one of the following:

controlling the first application or service to process the information to be processed, sending a processing result to the second application or service, and controlling the second application or service to output feedback information;

controlling the first application or service to process the information to be processed and sending the processing result to the second application or service, controlling the second application or service to process the processing result of the first application or service and Output feedback information;

The second application or service is controlled to process part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output the processing result.

Optionally, processing the first application or service based on a preset strategy includes:

The step S02 further includes: before processing the first application or service and/or the second application or service based on a preset policy, splitting the information to be processed, and determining that the information to be processed is determined by the first application or service Some information processed by the service.

Optionally, the step S02 includes:

Step S02a: Determine the first processing result according to the detection result;

Step S02b: Outputting at least one prompt message on the processing device or associated device in response to the first processing result meeting a preset condition;

Step S02c: In response to the preset operation, perform preset processing on the first application or service according to a preset policy and/or a second processing result, optionally, the second processing result is determined by the At least one second application or service is obtained.

Optionally, the meeting preset conditions includes at least one of the following:

The processing device is not a control center; there is an associated device;

The first application or service does not support the function to be realized by the information to be processed;

The first application or service supports some functions to be realized by the information to be processed;

At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions;

There is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.

Optionally, the preset processing includes at least one of the following:

Hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.

Optionally, the step S02c includes at least one of the following:

The second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;

The second processing result is a processing result of the second application or service outputting a part of the information to be processed, and controlling the first application or service to determine or generate at least one associated third application or service to process the Another part of the processing results of the information to be processed;

The second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;

If the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service;

And/or, performing preset processing on the first application or service according to a preset strategy includes at least one of the following:

According to the control instruction generated by the preset operation, perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernating the first application or service;

When the first application or service supports some functions to be realized by the information to be processed, controlling the first application or service to determine or generate at least one associated third application or service to support another function to be realized by the information to be processed some functions;

Closing or hiding or freezing or hibernating the first application or service when at least one of the power, scene or mode, and running state of the processing device does not meet the conditions.

Optionally, after the step S02, further include: Step S03: Determine whether the processing result matches the processing condition; Step S04: If not, output information for prompting to update the processing condition.

Optionally, the step S03 includes at least one of the following:

Determine whether the processing result matches the processing condition according to the source application or service of the processing result;

determining whether the processing result matches the processing condition according to the function realized by the processing result;

Determine whether the processing result matches the processing condition according to the authority used by the processing result.

In a fifth aspect, the present application provides an application or service processing method applied to a processing device, including:

Step S010: in response to acquiring the information to be processed, process the first application or service according to a first preset policy;

Step S020: According to the processing result and/or whether the first preset operation meets the preset condition, process the second application or service based on the second preset policy.

Optionally, in the step S020, the meeting the preset conditions includes at least one of the following:

The processing result matches the functions and/or permissions allowed by the second application or service;

The processing result is a result to be output or a result to be filtered;

The first preset operation is a preset operation allowing the second application or service to process the processing result;

The processing result does not match the functions and/or permissions allowed by the second application or service, and the first preset operation is a preset operation that allows the second application or service to process the processing result;

The processing result is not a result to be output or a result to be filtered, and the first preset operation is a preset operation allowing the second application or service to process the processing result.

Optionally, the step S010 includes:

In response to obtaining the information to be processed, detecting whether the first application or service meets processing conditions;

Processing the first application or service based on a first preset policy according to the detection result;

Optionally, after the step S020, it also includes:

Step S030: Determine whether the processing result matches the processing condition and/or the preset condition;

Step S040: If not, output information for prompting to update the processing condition and/or the preset condition.

Optionally, the step S030 includes at least one of the following:

Determine whether the processing result matches the processing condition and/or the preset condition according to the source application or service of the processing result;

determining whether the processing result matches the processing condition and/or the preset condition according to the function realized by the processing result;

Determine whether the processing result matches the processing condition and/or the preset condition according to the authority used by the processing result.

Optionally, in the second method, the processing the first application or service according to the first preset policy includes at least one of the following:

wake up or run the first application or service;

In response to a second preset operation, controlling the first application or service to process the information to be processed;

Controlling the first application or service to process the information to be processed according to the current scenario or mode.

Optionally, in the second method, the processing the first application or service according to a first preset policy includes: controlling the first application or service to process part of the information to be processed ;

The step S010 further includes: before processing the first application or service according to a first preset strategy, splitting the information to be processed to determine part of the information to be processed by the first application or service.

Optionally, the step S020 includes at least one of the following:

waking up or running the second application or service in response to the processing result meeting the preset condition;

outputting information for prompting whether the information to be processed is to be processed by the second application or service in response to the processing result meeting the preset condition;

In response to the processing result meeting the preset condition, controlling the second application or service to process the processing result of the first application or service and output feedback information;

In response to the first preset operation meeting a preset condition, controlling the second application or service to process at least a part of the information to be processed;

In response to the first preset operation meeting a preset condition, controlling the second application or service to process at least a part of the information to be processed, and sending a processing result to the first application or service;

In response to the first preset operation meeting a preset condition, the second application or service is controlled to output a processing result.

In a sixth aspect, the present application provides an application or service processing method applied to a processing device, including:

Step S0100: Outputting at least one prompt message in response to the first application or service acquiring information to be processed;

Step S0200: In response to a preset operation, process the first application or service according to a first preset policy; and/or process at least one second application or service according to a second preset policy.

Optionally, the step S0100 includes: determining key information in response to acquiring information to be processed by the first application or service; and outputting at least one prompt message according to the key information.

Optionally, in the third method, the key information includes the location of the processing object of the information to be processed, the location where the information to be processed is triggered, the time when the information to be processed is triggered, the At least one of the time of the information to be processed, the source application of the information to be processed, the target application of the information to be processed, the function to be used by the information to be processed, and the permission to be used by the information to be processed kind;

The step S0100 includes at least one of the following: outputting prompt information whether the first application or service meets processing conditions; outputting prompt information for selecting an application or service.

Optionally, in the third method, the meeting the treatment conditions includes at least one of the following:

Optionally, the step S0100 includes:

Outputting prompt information indicating whether the first application or service meets processing conditions;

After the step S0200, it also includes:

Step S0300: Determine whether the processing result matches the processing condition;

Step S0400: If not, output information for prompting to update the processing condition.

Optionally, the step S0300 includes at least one of the following: determining whether the processing result matches the processing condition according to the source application or service of the processing result;

Optionally, in the third method, the processing the first application or service according to the first preset strategy includes at least one of the following:

wake up or run the second application or service;

controlling the second application or service to process at least a part of the information to be processed, and sending the processing result to the first application or service; and/or, the first preset policy according to the first Processing by an application or service, and processing the second application or service according to a second preset strategy includes at least one of the following:

Controlling the first application or service to process at least part of the information to be processed and sending the processing result to the second application or service, controlling the second application or service to the first application or service Process the results and output feedback information;

Optionally, the step S0200 includes:

Step S0200a: In response to a preset operation, the first application or service determines a first processing result based on the information to be processed;

Step S0200b: In response to the first processing result meeting the preset condition, perform preset processing on the first application or service according to the second processing result, optionally, the second processing result is sent by the associated device The at least one second application or service process is obtained.

Optionally, in the third method, the meeting the preset conditions includes at least one of the following:

The processing device is not a control center; there is an associated device;

The processing device is not part of the functions to be realized by the first application or service of the control center to support the information to be processed;

The processing device does not control at least one of the power, scene or mode, and operating status of the processing device;

Optionally, the preset processing includes at least one of the following:

Optionally, the step S0200b includes at least one of the following:

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and the first application or service is controlled to determine or generate at least one associated third application or service to process the information to be processed Another part of the processing results of the information;

If the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service.

In a seventh aspect, the present application provides a method for processing an application or service, which is applied to a processing device, including:

Step S01000: In response to the first processing result meeting the preset condition, output at least one prompt message on the processing device and/or associated device, optionally, the first processing result is the first application or service to be processed based on The information is processed;

Step S02000: In response to a preset operation, perform preset processing on the first application or service according to a preset strategy and/or a second processing result, optionally, the second processing result is determined by the At least one second application or service is obtained.

Optionally, in the fourth method, the meeting the preset conditions includes at least one of the following:

The processing device is not a control center; there is an associated device;

Optionally, the step S01000 includes: determining key information in response to acquiring information to be processed; determining the first processing result according to the key information.

Optionally, the key information includes at least one of the location of the processing object of the information to be processed, trigger location, processing time, source application, target application, function to be implemented, associated device, and processing device information.

Optionally, the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.

Optionally, performing preset processing on the first application or service according to the second processing result includes at least one of the following:

In an eighth aspect, the present application provides a method for processing an application or service, which is applied to an associated device, including:

Step T1: Outputting at least one prompt message in response to the processing request output by the processing device meeting the first preset condition;

Step T2: Outputting at least one piece of feedback information in response to a preset operation and/or the associated device meeting a second preset condition, so as to enable at least one first application or service on the processing device to perform preset processing.

Optionally, the meeting the first preset condition includes at least one of the following:

The processing device is not a control center; the processing request is a preset type of request;

And/or, meeting the second preset condition includes at least one of the following: the associated device is a control center; the preset operation is an operation that allows processing the processing request; the associated device supports the processing A required function or permission is requested; the associated device is in a preset state, mode or scene.

Optionally, said step T2 includes:

Step T2a: In response to a preset operation and/or the associated device meets a second preset condition, acquire a first processing result determined by the first application or service based on the information to be processed;

Step T2b: Process at least one second application or service to obtain a second processing result;

Step T2c: Based on the second processing result, output at least one piece of feedback information, so that at least one first application or service on the processing device performs preset processing.

Optionally, said step T2c includes at least one of the following:

The second processing result is that the second application or service outputs all processing results of the information to be processed, and outputs feedback information for closing or hiding or freezing or dormant the first application or service;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and outputs feedback information that controls the first application or service to output another part of the processing result of the information to be processed;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and the output controls the first application or service to determine or generate an associated at least one third application or service to process the Feedback information about the processing results of another part of the information to be processed;

The second processing result is allowing the use of preset permissions, and outputting feedback information that controls the first application or service to output the processing result of the information to be processed;

The second processing result is to close or hide or freeze or hibernate the first application or service, and output feedback information for closing or hiding or freezing or dormant the first application or service.

In the ninth aspect, the present application provides a method for processing an application or service, which is applied to an associated device, including:

Step T10: in response to the processing request output by the processing device meeting the first preset condition, and/or the preset operation and/or the associated device meeting the second preset condition;

Step T20: Obtain a second processing result based on at least one second application or service;

Step T30: Perform preset processing on at least one first application or service based on the second processing result and/or the preset policy.

And/or, the second preset condition is met, including:

The associated device is a control center; the preset operation is an operation that allows processing the processing request; the associated device supports the functions or permissions required for the processing request; the associated device is in a preset state, mode or Scenes.

Optionally, said step T30 includes at least one of the following:

The second processing result is closing or hiding or freezing or dormant the first application or service, closing or hiding or freezing or dormant the first application or service;

In a tenth aspect, the embodiment of the present application provides a device, the device comprising: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, any of the above-mentioned The steps of the processing method of the application or service.

In the eleventh aspect, the embodiment of the present application provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the processing method of any one of the above applications or services is implemented A step of.

The present application relates to an application or service processing method, device, and storage medium. The application or service processing method includes: in response to acquiring data to be processed, determining at least one target application or target service; in response to the target application or the target service, and perform corresponding processing according to the preset policy. In this way, after obtaining the data to be processed, at least one target application or target service is determined first, and then the determined target application or target service is processed, which can improve the accuracy and/or Improve the interaction effect and enhance the user experience. The present application also relates to a processing method, device, and storage medium of an application or service, the processing method of the application or service includes: in response to obtaining information to be processed, detecting whether the first application or service currently awakened or running meets the processing conditions , according to the detection result, process the first application or service and/or the second application or service based on a preset policy. In this way, after obtaining the information to be processed, processing the first application or service and/or the second application or service can improve data security and/or interaction effect and improve user experience when using the application or service. In another manner, the joint associated device processes the first application or service and/or the second application or service, which can improve data security and/or interaction effects based on the functions and control capabilities of multiple devices, and improve user experience.

Beneficial effect

For the application or service method, device, and storage medium of the present application, after obtaining the data to be processed, at least one target application or target service is determined first, and then the determined target application or target service is processed. After obtaining the data to be processed , improve the accuracy of the response to the data to be processed and/or improve the interaction effect, and improve the user experience. Or, after obtaining the information to be processed, processing the first application or service and/or the second application or service can improve data security and/or interaction effect and improve user experience when using the application or service.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, the Under the premise, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present application.

FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application.

Fig. 3 is a schematic flowchart of a method for processing an application or service according to the first embodiment.

Fig. 4 is a schematic diagram of an interface of a processing device in a scenario according to the first embodiment.

Fig. 5 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.

Fig. 6 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.

Fig. 7 is a schematic flowchart of a processing method for an application or service according to the second embodiment.

Fig. 8 is a schematic flowchart of a method for processing an application or service according to a third embodiment.

Fig. 9 is a schematic flowchart of a method for processing an application or service according to a fourth embodiment.

Fig. 10 is one of the schematic diagrams of the application or service processing method according to the fourth embodiment.

Fig. 11 is a schematic diagram of an interface of a processing device according to a processing method for an application or service shown in a fourth embodiment.

Fig. 12 is a schematic diagram of an interface of an associated device according to the application or service processing method shown in the fourth embodiment.

Fig. 13 is a second schematic diagram of a scene of an application or service processing method according to the fourth embodiment.

Fig. 14 is a schematic diagram of an interface of another associated device according to the application or service processing method shown in the fourth embodiment.

Fig. 15 is a schematic flowchart of a processing method for an application or service according to a fifth embodiment.

Fig. 16 is a schematic flowchart of an application or service processing method according to the sixth embodiment

Fig. 17 is a schematic flowchart of a method for processing applications or services according to the seventh embodiment.

Fig. 18 is a schematic diagram of an interface of a processing device in a scenario according to a seventh embodiment.

Fig. 19 is one of the schematic diagrams of the application or service processing method according to the seventh embodiment.

Fig. 20 is a schematic diagram of an interface of a processing device in another scenario according to the seventh embodiment.

Fig. 21 is a second schematic diagram of a scene of an application or service processing method according to the seventh embodiment.

Fig. 22 is a schematic diagram of an interface of a processing device in another scenario according to the seventh embodiment.

Fig. 23 is a schematic flowchart of a method for processing applications or services according to the eighth embodiment.

Fig. 24 is a schematic flowchart of a processing method for an application or service according to the ninth embodiment.

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. By means of the above drawings, specific embodiments of the present application have been shown, which will be described in more detail hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the application in any way, but to illustrate the concept of the application for those skilled in the art by referring to specific embodiments.

Embodiment of this application

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element. In addition, different implementations of the present application Components, features, and elements with the same name in the example may have the same meaning, or may have different meanings, and the specific meaning shall be determined based on the explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not exclude one or more other features, steps, operations, The existence, occurrence or addition of an element, component, item, species, and/or group. The terms "or", "and/or", "comprising at least one of" and the like used in this application may be interpreted as inclusive, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C", another example, " A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C". Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that although the various steps in the flow chart in the embodiment of the present application are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figure may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential Instead, it may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (stated condition or event)".

It should be noted that, in this article, step codes such as S1 and S2 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order. Those skilled in the art may, during specific implementation, S1 will be implemented first and then S2, etc., but these should be within the protection scope of this application.

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

In the following description, the use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, 'module', 'part' or 'unit' may be mixedly used.

Mobile terminals may be implemented in various forms. For example, the mobile terminals described in this application may include devices such as mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media player (Portable Media Player, PMP), navigation device, wearable device, smart bracelet, pedometer and other mobile terminals, as well as fixed terminals such as digital TV and desktop computer.

In the subsequent description, a mobile terminal will be taken as an example, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configurations according to the embodiments of the present application can also be applied to fixed-type terminals.

Please refer to FIG. 1, which is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application. The mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, a /V (audio/video) input unit 104 , sensor 105 , display unit 106 , user input unit 107 , interface unit 108 , memory 109 , processor 110 , and power supply 111 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in Figure 1 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than those shown in the figure, or combine some components, or different components layout.

Each component of the mobile terminal is specifically introduced below in combination with FIG. 1:

The radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000, Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution, frequency division duplex long-term evolution) and TDD-LTE (Time Division Duplexing- Long Term Evolution, time-division duplex long-term evolution), etc.

WiFi is a short-distance wireless transmission technology. The mobile terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102, which provides users with wireless broadband Internet access. Although Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the mobile terminal, and can be completely omitted as required without changing the essence of the invention.

The audio output unit 103 can store the audio received by the radio frequency unit 101 or the WiFi module 102 or in the memory 109 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like. The audio data is converted into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. A/V input unit 104 may include a graphics processor (Graphics Processing Unit (GPU) 1041 and a microphone 1042, the graphics processor 1041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 may receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data. The processed audio (voice) data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 101 for output in the case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the mobile terminal 100 moves to the ear. panel 1061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile phones (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and a liquid crystal display (Liquid Crystal Display, LCD), organic light-emitting diodes (Organic Light-Emitting Diode, OLED) and other forms to configure the display panel 1061 .

The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Optionally, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.

Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event. The corresponding visual output is provided on the display panel 1061 . Although in FIG. 1, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.) and the like; the storage data area can be Stores data (such as audio data, phonebook, etc.) created according to the use of the mobile phone, etc. In addition, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 110 is the control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes operating systems, user interfaces, and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The mobile terminal 100 may also include a power source 111 (such as a battery) for supplying power to various components. Preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Although not shown in FIG. 1 , the mobile terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.

In order to facilitate understanding of the embodiments of the present application, the following describes the communication network system on which the mobile terminal of the present application is based.

Please refer to FIG. 2. FIG. 2 is a structure diagram of a communication network system provided by an embodiment of the present application. The communication network system is an LTE system of general mobile communication technology, and the LTE system includes UEs (User Equipment, User Equipment, ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.

Optionally, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on. Optionally, the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC203 can include MME (Mobility Management Entity, mobility management entity) 2031, HSS (Home Subscriber Server, home user server) 2032, other MME 2033, SGW (Serving Gate Way, serving gateway) 2034, PGW (PDN Gate Way, packet data network gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Tariff Function Entity) 2036, etc. Optionally, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as the home location register (not shown in the figure), and save some user-specific information about service characteristics and data rates. All user data can be sent through SGW2034, PGW2035 can provide UE 201 IP address allocation and other functions, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

The IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

Although the LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems. The network system, etc., are not limited here.

Based on the above mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

first embodiment

Fig. 3 is a schematic flowchart of a method for processing an application or service according to the first embodiment. As shown in Figure 3, an application or service processing method of this application is applied to a processing device, including:

Step S02: according to the detection result, process the first application or service and/or the second application or service based on a preset strategy.

Processing devices can include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.). Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures. The information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information. Through the above method, when there is information to be processed, by detecting the first application or service that is currently awakened or running, and then processing the first application or service and/or the second application or service, it is possible to use the application or service , control the use process of applications or services, make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.

Optionally, when using a third-party human-computer interaction application, for the functions supported by the system-level human-computer interaction application or a human-computer interaction application with a higher security level, the system-level human-computer interaction Only use third-party human-computer interaction applications for complementary functions; and/or disable functions with potential safety hazards for third-party human-computer interaction applications, or prompt users to agree to use the functions normally; and/or , third-party human-computer interaction applications are used for interaction, system-level human-computer interaction applications or human-computer interaction applications with higher security levels are used to filter or process response results; Only system-level human-computer interaction applications can be used for a specific time period, and third-party human-computer interaction applications can only be used for specific locations; and/or, human-computer interaction applications that can be used according to application restrictions, such as application A can only use system-level human-computer interaction applications For interactive applications, application B can only use C functions of third-party human-computer interaction applications; or, for functions not supported by third-party human-computer interaction applications, other human-computer interaction applications that support functions can be called to respond. In this way, the functions and interaction capabilities of different applications or services can be fully utilized, which can not only improve data security, but also enhance the interaction effect, so that the interaction scenarios are not limited to the currently used applications or services, the interaction is more flexible and smooth, and the user experience is improved .

Optionally, in step S01, the processing conditions include at least one of the following:

Be in the preset scene; be in the preset mode; have preset permissions; support the functions to be realized by the information to be processed; allow the functions required to use the information to be processed; be in the scene and/or mode associated with the information to be processed.

The preset scene can be that no data is currently being processed or the interconnected scene; the preset mode can be the foreground operation mode, the background operation mode, the interactive mode, etc.; the preset authority can be the contact authority, the control authority, etc.; the information to be processed is supported The function may be to support the search function, translation function, timing function, etc.; the functions required to allow the use of information to be processed may be to allow phone calls, allow transfers, etc.; the scene and/or mode associated with the information to be processed may be in the Specific time periods, specific locations, kid mode, connection status, etc.

Optionally, when the processing condition includes being in a scene and/or mode associated with the information to be processed, step S01 includes: determining key information in response to obtaining the information to be processed; detecting the currently awakened or running first application or Whether the service is in the context and/or mode associated with the information to be processed.

Optionally, the key information includes at least one of a location of a processing object of the information to be processed, a trigger location, a processing time, a source application, and a target application. By performing preliminary processing on the information to be processed, at least one of the location of the processing object, trigger location, processing time, source application, and target application of the information to be processed can be determined. For example, the A human-computer interaction application receives the voice message "Open the living room "air conditioner", it can be determined that the location of the processing object of the information to be processed is the living room, the trigger time is the time when the voice information is input, the processing time is now, the source application is the human-computer interaction application of A, and the target application is the air conditioner application. Optionally, according to the key information, it is detected whether the first application or service that is currently awakened or running is in a scene and/or mode associated with the information to be processed, for example, whether the A human-computer interaction application is in a state where the air conditioner application can be called, and/or Or, whether the human-computer interaction application A is in the living room, and/or, whether the human-computer interaction application A is allowed to turn on the air conditioner in the living room at the current time, etc.

In step S02, according to whether the first application or service meets the processing condition, the first application or service and/or the second application or service are processed based on a preset policy. Optionally, step S02 includes:

If the first application or service does not meet the processing conditions, the first application or service and/or the second application or service are processed according to a first preset policy; and/or,

Optionally, according to whether the first application or service meets the processing conditions, different strategies are used to process the first application or service and/or the second application or service, so that the information to be processed can be processed through an appropriate strategy, and the data can be improved. Security and Interaction Effects. For example, if the human-computer interaction application A has the permission to make a call, then the human-computer interaction application A will make the call; and/or, if the human-computer interaction application A does not have the permission to make a call, then person B who has the permission to make a call can and/or, the human-computer interaction application A does not have the permission to make a call, and can request permission or output a prompt to the human-computer interaction application B, and then make a call after allowing the call.

Optionally, step S02 includes:

If the first application or service does not meet the processing conditions, output prompt information;

In response to the selection operation, processing corresponding applications or services of the first application or service and the second application or service according to the selection result; and/or,

In response to the unresponsive prompt information, the first application or service and/or the second application or service are processed according to a first preset policy.

In some implementations, if the first application or service does not meet the processing conditions, the decision can be made by outputting prompt information, and the user can select the corresponding processing method according to the needs, which meets the needs of the user in a specific scenario. For example, the user says "play Andy Lau's Gong Xi Fa Cai song" to the human-computer interaction application A, but the human-computer interaction application A is set not to play music during the current time period, for example, during working hours, at this time, it can output "whether to delay the playback ", "Continue playing" and other prompt information, if the user needs to play the song now, he can choose to continue playing. If he does not receive the operation of responding to the prompt information, he can not play the music in the current time period according to the original setting. In this way, flexible decision-making can be made according to the actual needs of users, and the accuracy of interactive results can be guaranteed.

When the first application or service does not meet the processing conditions, or the first application or service does not meet the processing conditions and does not respond to the prompt message after a timeout, process the first application or service and/or the second application or service according to the first preset policy , can expand the application scenarios, and in specific scenarios, such as transferring money, making calls, etc., can also improve data security.

Controlling the first application or service to process part of the information to be processed; controlling the first application or service not to process the pending information; outputting information for prompting whether the first application or service processes the pending information; responding to the first preset Assuming an operation, control the first application or service to process the pending information; delay processing the pending information; and/or, wait for the first application or service to meet the processing condition, control the first application or service to process the pending information.

When the first application or service does not meet the processing conditions, or when the first application or service does not meet the processing conditions and fails to respond to the prompt message after a timeout, the first application or service is processed according to a first preset policy. In one scenario, the first application or service may be controlled to process part of the information to be processed, for example, the first application or service extracts key information from the information to be processed. In one scenario, the first application or service may be controlled not to process the information to be processed, that is, not to respond to a processing request of the information to be processed or to be processed by other applications or services. In one scenario, as mentioned above, output information for prompting whether the pending information is processed by the first application or service, and then respond to the first preset operation to confirm that the pending information is processed by the first application or service , to control the first application or service to process the pending information. In one scenario, it is possible to delay processing the pending information, for example, delay playing a song, and then control the first application or service to process the pending information and play the song when the vehicle stops or the speed is low.

Optionally, processing the second application or service according to the first preset strategy includes at least one of the following: waking up or running the second application or service; controlling the second application or service to process at least a part of the information to be processed; Outputting information for prompting whether the pending information is processed by the second application or service; in response to a second preset operation, controlling the second application or service to process the pending information; controlling the second application or service to process at least A part of the information, the processing result is sent to the first application or service.

When the first application or service does not meet the processing conditions, or the first application or service does not meet the processing conditions and fails to respond to the prompt message after a timeout, the second application or service may also be processed according to the first preset policy. In one scenario, wake up or run the second application or service, so that the second application or service can process the information to be processed. In one scenario, the second application or service can be controlled to process at least part of the information to be processed, for example, the information processed by the first application or service can be processed, or when the content to be translated contains different languages, the second application or service can The app or service translates the language for which the first app or service does not support translation. In one scenario, output information for prompting whether to process the pending information by the second application or service, and then control the second application in response to the operation of confirming that the pending information is processed by the second application or service in response to the second preset operation or service processing pending information. In one scenario, control the second application or service to process at least part of the information to be processed, and send the processing result to the first application or service, for example, the second application or service can translate the first application or service does not support translation language or all the content, and then send the translation result to the first application or service, for example, to integrate it into a final translated document output.

Optionally, processing the first application or service and the second application or service according to a first preset strategy includes at least one of the following:

Controlling the first application or service to process part of the information to be processed, sending the processing result to the second application or service, and controlling the second application or service to output feedback information;

Controlling the first application or service to process at least part of the information to be processed and sending the processing result to the second application or service, controlling the second application or service to process the processing result of the first application or service and output feedback information;

The second application or service is controlled to process at least a part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output feedback information.

When the first application or service does not meet the processing conditions, or the first application or service does not meet the processing conditions and does not respond to the prompt message after a timeout, the first application or service and the second application or service can also be processed according to the first preset policy . In one scenario, a first application or service can translate a language that supports translation, a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the second application or service. In one scenario, a first application or service can translate a language that supports translation, a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the first application or service. In one scenario, the first application or service translates the language that supports translation, the second application or service translates the language that the first application or service does not support translation, and then outputs the final translation result through the first application or service. In one scenario, the information to be processed is the rock version of Daolang’s impulsive punishment, and the first application or service can search for the song. When the rock version of the song is not found, the first application or service will search for the song Send it to the second application or service, and the second application or service will edit the sound effect and output it.

When the first application or service meets the processing conditions, the first application or service and/or the second application or service are processed according to the second preset policy, which can ensure maximum interaction with the user on the premise of meeting the interaction requirements. Application Consistency.

Optionally, processing the first application or service according to a second preset policy includes at least one of the following:

In response to the first preset operation, controlling the first application or service to process the information to be processed;

Control the first application or service to process the information to be processed according to the current scene or mode; output the processing result.

It can be understood that, for the same processing condition, when the first application or service meets the processing condition, it means that the current scene can be dominated by the first application or service, and assisted by other applications or services when necessary. For example, the first application or service can be controlled to start processing at least a part of the information to be processed, including all information. In one scenario, a preset time period for the first application or service to process the information to be processed can be set, for example, in summer Turn on the air conditioner in the room at 8 o'clock in the evening to create a comfortable rest environment in advance. And/or, the prompt can still be output, and in response to the first preset operation, the first application or service is controlled to process the information to be processed, so as to improve the interaction accuracy. And/or, control the first application or service to process the information to be processed according to the current scene or mode, for example, if the current power of the processing device is lower than the threshold but needs to play music, then the screen can be turned off while the music is playing to save power. When the first application or service meets the processing condition, for example, in the interactive mode, the first application or service may also output the processing result.

Optionally, processing the second application or service according to the second preset strategy includes at least one of the following: controlling the second application or service to sleep or exiting the second application or service; The service processes information of part of the information to be processed; in response to a second preset operation, controlling the second application or service to process part of the information to be processed.

When the first application or service meets the processing conditions, the second application or service may assist or supplement the functions or interaction capabilities of the first application or service, and/or control the second application or service to sleep or exit. When the second application or service is required to assist or supplement the functions or interaction capabilities of the first application or service, it can confirm to the user by prompting, and then control the second application or service to process the pending information according to the user's operation. partial information. For example, if the first application or service has the function of translating English, but the file has a large number of words, part of the content can be translated by the second application or service, thereby speeding up the translation.

Optionally, processing the first application or service and the second application or service according to a second preset policy includes at least one of the following:

Control the first application or service to process the information to be processed, send the processing result to the second application or service, and control the second application or service to output feedback information;

Controlling the first application or service to process the information to be processed and sending the processing result to the second application or service, controlling the second application or service to process the processing result of the first application or service and outputting feedback information;

When the first application or service meets the processing conditions, the functions or interaction capabilities between the first application or service and the second application or service can still be reasonably allocated, and the first application or service is responsible for most of the data processing or responsible Output the processing result. For example, after the first application or service completes the translation of all documents, the second application or service performs proofreading and output; and/or, after the first application or service completes the translation and proofreading of all documents, the second application or service conducts Output, and/or, the second application or service assists in translating a part of the file, and the first application or service outputs the result.

It can be understood that in different scenarios, the second application or service may participate in the process of processing the information to be processed, but in different scenarios, the roles played by the second application or service are different. For example, when the first When the application or service does not meet the processing conditions, the second application or service needs to process more information and/or filter the data and/or respond to the results and/or process important information, when the first application or service meets the processing conditions In this case, the second application or service can process less information and/or perform simple processing on data, thereby achieving effective integration among multiple applications or services in different scenarios.

Optionally, when processing the first application or service based on a preset policy, including controlling the first application or service to process part of the information to be processed, step S02 further includes:

Before processing the first application or service and/or the second application or service based on a preset policy, the information to be processed is split to determine part of the information processed by the first application or service.

Optionally, when the first application or service only processes part of the information to be processed, the information to be processed may be split, for example, the content to be translated is split into different languages, the amount of translation is split, the amount of translation to be translated Partitioning of the interface, etc.; and/or, splitting different parts of the command, such as "send the email to Xiaocui at 10 o'clock", can be divided into timing and sending emails, and the application or service responsible for sending emails has a higher priority. Security Level.

Optionally, the first application or service and the second application or service may be located on the same device or on different devices, as long as the first application or service and the second application or service can call each other, it is not limited to the application or service Service installation devices, communication methods between applications or services, etc.

Optionally, when the first application or service and the second application or service are located on different devices, step S02 includes: step S02a: determining the first processing result according to the detection result; step S02b: responding to the first processing result conforming to the preset condition, output at least one prompt message on the processing device or associated device; step S02c: in response to the preset operation, perform preset processing on the first application or service according to the preset strategy and/or the second processing result, optionally, The second processing result is obtained by processing at least one second application or service on the associated device.

Optionally, further processing is performed according to the detection result to determine a first processing result. Optionally, when the first application or service does not meet the processing condition, the first processing result may be obtained further based on information related to the processing device and the first application or service. In actual implementation, when the first application or service meets the processing conditions, the first processing result may be obtained further based on information about the processing device and the first application or service. The relevant information of the processing device includes whether it is a control center, battery power, scene or mode, operating status, device association information, etc., and the relevant information of the first application or service includes whether it supports the function to be realized by the information to be processed. Based on the first processing result, at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.

Optionally, the preset conditions include at least one of the following: the processing device is not a control center; the first application or service does not support the functions to be realized by the information to be processed; the first application or service supports some functions to be realized by the information to be processed; At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions; there is an associated device; there is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.

When the first processing result meets the preset condition, output at least one prompt message on the processing device or the associated device, such as prompting "authorization by device C is required", "the current battery is low and the task cannot be completed", "the current application cannot be translated" Wait. Under the same preset conditions, when the first processing result does not meet the preset conditions, the first application or service and/or the second application or service may be processed according to a second preset strategy, and the second preset strategy Reference can be made to the foregoing, and no further details will be given.

Optionally, step S02c includes at least one of the following:

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to determine or generate at least one associated third application or service to process another part of the processing result of the information to be processed;

The second processing result is a processing result of allowing the use of preset permissions to control the output of the information to be processed by the first application or service;

The second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service.

Optionally, performing preset processing on the first application or service according to a preset strategy includes at least one of the following:

Perform corresponding preset processing on the first application or service according to the control instruction generated by the preset operation;

Closing or hiding or freezing or dormant the first application or service when the first application or service does not support the function to be realized by the information to be processed;

When the first application or service supports part of the functions to be realized by the information to be processed, control the first application or service to determine or generate at least one associated third application or service to support another part of the functions to be realized by the information to be processed;

Closing or hiding or freezing or hibernating the first application or service when at least one of the battery power, scene or mode, and running state of the processing device does not meet the conditions.

Optionally, at least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result. In one scenario, when the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed. Another part of processing results of processing information, the third application or service may be an application or service on a processing device, an associated device, or other devices, for example, A human-computer interaction application requests B human-computer interaction application to translate a webpage containing multiple languages, While the human-computer interaction application B can only translate a part of the content of the webpage, at this time, the human-computer interaction application A can request to call the human-computer interaction application C to translate another part of the content of the webpage.

Optionally, the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used. For example, when the power of the processing device is low (eg, the remaining power is less than or equal to a preset value, such as 20%), the associated device may control to close the first application or service. And/or, when receiving an operation to close the first application or service, the associated device may control to close the first application or service.

Optionally, after step S02, further include: step S03: determine whether the processing result matches the processing condition; step S04: if not, output information for prompting to update the processing condition.

Optionally, step S03 includes at least one of the following:

Determine whether the processing result matches the processing conditions according to the source application or service of the processing result;

Determine whether the processing result matches the processing condition according to the function realized by the processing result;

The processing conditions define the rules for using the functions and interaction capabilities of different applications or services. In some implementations, the processing conditions may be default non-modifiable conditions, user-set conditions, or some user-settable conditions.

Optionally, when the user is using the A human-computer interaction assistant and needs to search for pictures, but the A human-computer interaction assistant does not have the function of searching for pictures or the server has less picture data, then the B human-computer interaction assistant can be called to search Picture, after obtaining the search results, the user chooses to have the A human-computer interaction assistant output the results, and the default processing condition is that the A human-computer interaction assistant does not meet the processing conditions and cannot output the results. Then, the output function used to process the results at this time is the same as If the processing conditions do not match, you can output information prompting to update the processing conditions, for example, prompting "Whether to update the search results is only output by the A human-computer interaction assistant", and the user can choose to update or not. In this way, the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.

The application scenarios of the three application or service processing methods based on the present application will be described below.

Fig. 4 is a schematic diagram of an interface of a processing device in a scenario according to the first embodiment. The illustrated scenario is a scenario of searching for pictures, and the application or service is a voice assistant and the voice assistants are installed on the processing device as an example for illustration. (a) in Figure 4 shows the interface of voice assistant A. Voice assistant A prompts "You said, I'm listening..." at this time. At this time, the user can input instructions by voice. Since this application can be used for applications or services The integration of the functions and interaction capabilities between them makes the instructions that the voice assistant A can accept more abundant, without prompting the user for input content; after that, as shown in Figure 4 (b), the device interface displays the content input by the user "Search landscape photos" to prompt the user, and the strategy determined based on the content input by the user is: hide voice assistant A, control voice assistant B to search for landscape photos and output the results, and then output a prompt message "Voice assistant A has been hidden, Recommend voice assistant B to search for you...", the interface shown in (b) in Figure 4 can be a system-level interface or the interface of voice assistant B; after that, as shown in Figure 4 (c), voice assistant B executes Search for instructions, and display the search results on the interface of voice assistant B. In the interface shown in (c) in Figure 4, the user can be prompted for relevant instructions, "You can say: return to voice assistant A; next page; continue to search. .." to prompt the user to input instructions based on the search results to improve interaction efficiency. In this way, in the scene of searching for pictures, using the functions or capabilities of different voice assistants can provide an accurate interactive experience even if the currently used voice assistant cannot meet the requirements.

Fig. 5 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment. The illustrated scenario is a scenario of making a phone call, and the application or service is a voice assistant and the voice assistants are installed on the processing device as an example for illustration. Figure 5 (a) shows the interface of voice assistant A. Voice assistant A prompts "You said, I'm listening..." at this time. At this time, the user can input instructions by voice. Since this application can be used for applications or services The integration of the functions and interaction capabilities between them makes the instructions accepted by the voice assistant A richer, without prompting the user for input content; after that, as shown in Figure 5 (b), the device interface displays the content input by the user "Dial Xiaoyuan's phone" to prompt the user, and the strategy determined based on the content entered by the user is: voice assistant A does not have permission, control voice assistant B to dial or prompt, and output a prompt message "Voice assistant A is not allowed to use Contact information, you can say: voice assistant B to dial; this time allowed, continue to dial", the interface shown in (b) in Figure 5 can be the system-level interface or the interface of voice assistant A; after that, as shown in Figure 5 ( As shown in c), when the user selects voice assistant B to make a call or fails to respond after a timeout, voice assistant B executes the command to make a call, and displays a prompt screen for making a call on the interface of voice assistant B. Conversely, if the user selects "Allow this time, continue to dial", the voice assistant A will execute the command to make a call this time, and display a prompt screen for making a call in the interface of voice assistant A. When making a call next time, it will still be Carry out the decision process shown in Figure 5(b). In this way, in the scenario of making a phone call, the permissions of different voice assistants are allocated and added to the user's decision-making process. Even if the currently used voice assistant cannot meet the needs, it can provide an accurate interactive experience and ensure data security.

Fig. 6 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment. The scenario shown in the figure is a schedule reminder scenario, and the application or service is a voice assistant and the voice assistants are installed on the processing device as an example for illustration. (a) in Figure 6 shows the interface of voice assistant A. Voice assistant A prompts "You said, I'm listening..." at this time, and the user can input instructions by voice. Since this application can be used for applications or services The integration of the functions and interaction capabilities between them makes the instructions accepted by the voice assistant A richer, without prompting the user to input content; after that, as shown in Figure 6 (b), the device interface displays the content input by the user "Remind me of tomorrow's schedule at eight o'clock in the evening" to remind the user, and the strategy determined based on the content entered by the user is: voice assistant A does not have the permission to obtain the schedule, and then obtains the schedule from voice assistant B, and then voice assistant A reminds, and then outputs Prompt message "OK, I will ask voice assistant B to confirm your itinerary tomorrow and remind you at 8 pm", the interface shown in (b) in Figure 6 is the interface of voice assistant A; after that, as shown in Figure 6 ( As shown in c), when the reminder time is reached, voice assistant A executes the command to remind the schedule, obtains the schedule from voice assistant B, and outputs the voice "Hello! It is 8:00 p.m., and your schedule for tomorrow is: start at 8:00 a.m. Discussion meeting...", in the interface shown in Figure 6 (c), the user can be prompted for relevant instructions, "You can say: received; repeat; modify...", prompting the user to input instructions based on the reminder content , improve interaction efficiency. In this way, in the scenario of reminding the schedule, based on the permissions and function configuration interaction methods of different voice assistants, users can use the voice assistant they are accustomed to to remind, even if the currently used voice assistant cannot obtain schedule information, it can also provide an accurate interactive experience. And ensure data security.

The application or service processing method of the present application detects whether the currently awakened or running first application or service meets the processing conditions in response to obtaining the information to be processed; according to the detection result, the first application or service and the and/or a second application or service for processing. In this way, when there is information to be processed, by detecting the currently awakened or running first application or service, and then processing the first application or service and/or the second application or service, when using the application or service, the Manage and control the use process of applications or services, make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.

second embodiment

Fig. 7 is a schematic flowchart of a processing method for an application or service according to the second embodiment. As shown in FIG. 7, an application or service processing method of the present application is applied to a processing device, including:

Processing devices can include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.). Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures. The information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information. Through the above method, when there is information to be processed, by processing the first application or service, and then processing the second application or service, it is possible to control the use process of the application or service when using the application or service, and make full use of The functions and interaction capabilities of different applications or services improve data security and/or interaction effects and enhance user experience.

Optionally, a third-party human-computer interaction application is used for interaction, and a system-level human-computer interaction application or a human-computer interaction application with a higher security level is used for filtering or processing response results; and/or, the third-party human-computer interaction application is disabled For functions with security risks, the function can only be used normally after the user is prompted to agree, or the function can only be used normally after the system-level human-computer interaction application authorizes; the third-party human-computer interaction application processes data with a lower security level, and the system-level The human-computer interaction application further processes data with a higher security level according to the processing results, and then fuses the output. In this way, the functions and interaction capabilities of different applications or services can be fully utilized, which can not only improve data security, but also enhance the interaction effect, so that the interaction scenarios are not limited to the currently used applications or services, the interaction is more flexible and smooth, and the user experience is improved .

Optionally, step S010 includes: in response to acquiring the information to be processed, detecting a processing condition met by the first application or service; and processing the first application or service based on a first preset policy according to the detection result.

Optionally, the processing conditions include at least one of the following: being in a preset scene; being in a preset mode; having a preset authority; supporting the functions to be realized by the information to be processed; allowing the functions required to use the information to be processed; The scene and/or mode associated with the information to be processed.

Optionally, in response to acquiring the information to be processed, key information is determined; and it is detected according to the key information whether the currently awakened or running first application or service is in a scene and/or mode associated with the information to be processed. Optionally, the key information includes at least one of a location of a processing object of the information to be processed, a trigger location, a processing time, a source application, and a target application. By performing preliminary processing on the information to be processed, at least one of the location of the processing object, trigger location, processing time, source application, and target application of the information to be processed can be determined. For example, the A human-computer interaction application receives the voice message "Open the living room "air conditioner", it can be determined that the location of the processing object of the information to be processed is the living room, the trigger time is the time when the voice information is input, the processing time is now, the source application is the human-computer interaction application of A, and the target application is the air conditioner application. Optionally, according to the key information, it is detected whether the first application or service that is currently awakened or running is in a scene and/or mode associated with the information to be processed, for example, whether the A human-computer interaction application is in a state where the air conditioner application can be called, and/or Or, whether the human-computer interaction application A is in the living room, and/or, whether the human-computer interaction application A is allowed to turn on the air conditioner in the living room at the current time, etc.

Wake up or run the first application or service; control the first application or service to process part of the pending information; control the first application or service not to process the pending information; output to prompt whether the first application or service processes the pending information Information of information; in response to a second preset operation, control the first application or service to process the pending information; control the first application or service to start processing at least part of the pending information; control the first application or service to start processing the pending information at a preset time The section processes at least a part of the information to be processed; and controls the first application or service to process the information to be processed according to the current scene or mode.

Optionally, the processing method is determined according to the processing conditions met by the first application or service, for example, the first application or service supports the function to be implemented by the information to be processed but is in a dormant state, and wakes up or runs the first application or service at this time; and /or, the first application or service is not allowed to use the function required by the information to be processed, then the first application or service is controlled not to process the information to be processed, and/or, output is used to prompt whether the first application or service processes the information to be processed process the information of the information, and then control the first application or service to process the information to be processed in response to the second preset operation; and/or, the first application or service is in a scene and/or mode associated with the information to be processed, such as an alarm clock If the application is associated, the alarm clock application is called to ring at ten o'clock according to the instruction "set an alarm clock at ten o'clock".

Optionally, when processing the first application or service according to the first preset strategy includes controlling the first application or service to process part of the information to be processed, step S010 further includes: processing the first application or service according to the first preset strategy Before the first application or service processes, the information to be processed is split to determine part of the information to be processed by the first application or service.

After the first application or service is processed according to the first preset policy, enter step S020, and according to the processing result and/or whether the first preset operation meets the preset condition, the second application or service is processed based on the second preset policy to process.

Optionally, in step S020, the preset conditions include at least one of the following:

The processing result is a result to be output or a result to be filtered;

Optionally, after the first application or service is processed according to the first preset policy, the second application or service may be processed according to the first preset operation, and/or the second application or service may be processed according to the processing result Perform processing, and/or process the second application or service according to the processing result and the first preset operation. When the second application or service is processed according to the first preset operation, after the first application or service is processed according to the first preset policy, a prompt may be output, such as "Whether the second application or service is allowed to process the processing result?" If the user confirms the permission, the second application or service will be processed; when the second application or service is processed according to the first preset operation, it can be judged that the processing result is consistent with the functions and functions allowed by the second application or service. /or whether the permissions match, and/or, whether the processing result is a result to be output or a result to be filtered, if so, process the second application or service; perform processing on the second application or service according to the processing result and the first preset operation When processing, the first preset operation is used as the decision criterion. When the processing result does not meet the conditions, as long as the first preset operation is an operation that allows the second application or service to process the processing result, the second application or service will be processed. deal with.

Optionally, step S020 includes at least one of the following:

In response to the processing result meeting the preset condition, wake up or run the second application or service;

outputting information for prompting whether to process the information to be processed by the second application or service in response to the processing result meeting the preset condition;

In response to the first preset operation meeting the preset condition, controlling the second application or service to process at least a part of the information to be processed;

In response to the first preset operation meeting the preset condition, controlling the second application or service to process at least a part of the information to be processed, and sending the processing result to the first application or service;

In response to the first preset operation meeting the preset condition, the second application or service is controlled to output a processing result.

Optionally, processing the second application or service includes waking up, running, controlling the second application or service to process at least a part of the information to be processed, controlling the second application or service to process at least a part of the information to be processed, and At least one of sending the processing result to the first application or service and controlling the second application or service to output the processing result may be determined according to the processing result of the first application or service and/or the preset condition that the first preset operation meets A processing method for the second application or service to obtain a better interaction effect. For example, if the processing result matches the functions and/or permissions allowed by the second application or service, the second application or service can be controlled to process the processing result of the first application or service and output feedback information, thereby reducing the conflict between applications. Data transmission to reduce computing pressure; and/or, the first preset operation is a preset operation that allows the second application or service to process the processing result, then controlling the second application or service to process at least a part of the information to be processed, The processing result is sent to the first application or service, so that the user can choose to use a familiar application interface to output the result.

Optionally, voice assistant A on the processing device searches for children's cartoons on the Internet according to the instruction "I want to watch cartoons", and the processing result at this time is the result to be filtered, which can be sent to the voice assistant on the associated device Assistant B prompts "Your child wants to watch cartoons, please filter" through voice assistant B, and then voice assistant B can return processing results based on user operations, such as specifying watchable cartoons.

Optionally, voice assistant A determines the instruction as "generate a navigation route from the current location to the location of Oriental Pearl Tower" according to the voice information "navigate to the Oriental Pearl Tower", and sends the instruction to voice assistant B. If voice assistant B has a navigation function, the voice assistant Assistant B generates a navigation route from the current location to the location of the Oriental Pearl Tower.

Optionally, after step S020, further include:

Step S040: If they do not match, output information for prompting to update the processing conditions and/or preset conditions.

Optionally, step S030 includes at least one of the following:

Determine whether the processing result matches the processing conditions and/or preset conditions according to the source application or service of the processing result;

Determine whether the processing results match the processing conditions and/or preset conditions according to the functions realized by the processing results;

Determine whether the processing result matches the processing condition and/or preset condition according to the authority used by the processing result.

The processing conditions and/or preset conditions define the rules for using the functions and interactive capabilities of different applications or services. In some implementations, the processing conditions and/or preset conditions can be default non-modifiable conditions, user-set conditions, or some user-defined conditions. Configurable conditions.

Optionally, when the user is using the A human-computer interaction assistant and needs to search for news, and the A human-computer interaction assistant does not have an independent search engine, then at this time, the B human-computer interaction assistant can be called to search for news, and after obtaining the search results , the user chooses to output the result by A human-computer interaction assistant, and the default processing condition is that the A human-computer interaction assistant cannot output the result if it does not meet the processing conditions. Then, the output function used for the processing result does not match the processing condition at this time, and it can be output Information that prompts to update processing conditions, such as the prompt "whether to update the search results is only output by A human-computer interaction assistant", the user can choose to update or not. In this way, the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.

Optionally, when the user is using the A human-computer interaction assistant, he needs to search for news. After the A human-computer interaction assistant searches for news, the user chooses that the A human-computer interaction assistant output the results, and the default preset condition is B human-computer interaction The interactive assistant displays the results to be output. Then, if the application used to process the results does not match the preset conditions at this time, you can output information prompting to update the processing conditions, for example, prompting "whether to update the search results is only output by A human-computer interaction assistant", the user You can choose to update or not to update. In this way, the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.

The application or service processing method of the present application processes the first application or service according to the first preset policy in response to obtaining the information to be processed; according to whether the processing result and/or the first preset operation meets the preset condition, based on The second preset policy processes the second application or service. In this way, when there is information to be processed, by processing the first application or service, and then processing the second application or service, it is possible to control the use process of the application or service when using the application or service, and make full use of different applications. or service functions and interaction capabilities, improve data security and/or interaction effects, and enhance user experience.

third embodiment

Fig. 8 is a schematic flowchart of a method for processing an application or service according to a third embodiment. As shown in FIG. 8, an application or service processing method of the present application is applied to a processing device, including:

Step S0200: In response to a preset operation, process a first application or service according to a first preset policy; and/or process at least one second application or service according to a second preset policy.

Processing devices can include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.). Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures. The information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information. Through the above method, when the information to be processed is directly received by the first application or service, the first application or service and/or the second application or service can be processed through prompts, and the application or service can be processed when using the application or service. Manage and control the use process of the service, make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.

Optionally, when using a third-party human-computer interaction application, according to the received to-be-processed risk reminder, policy reminder or reminder of related conditions, based on the user's feedback on the reminder, the third-party human-computer interaction application and related applications are processed. In this way, the functions and interaction capabilities of different applications or services can be fully utilized, and combined with user interaction decisions, it can not only improve data security, but also enhance the interaction effect, so that the interaction scenarios are not limited to the currently used applications or services, and the interaction is more flexible. smooth, improving the user experience.

Optionally, step S0100 includes: determining key information in response to acquiring information to be processed by the first application or service; and outputting at least one prompt message according to the key information.

Optionally, the key information includes the location of the processing object of the information to be processed, the location where the information to be processed is triggered, the time when the information to be processed is triggered, the time when the information to be processed is processed, the source application of the information to be processed, the location of the information to be processed At least one of the target application, the function to be used for the information to be processed, and the permission to be used for the information to be processed. According to the key information, it can be determined whether the first application or service meets the processing conditions or how to select the application or service to process information, so as to select the appropriate application or combination of applications among multiple applications to improve data security and enhance interaction The purpose of the experience.

Optionally, at least one prompt message is output according to the key information, including at least one of the following:

Outputting prompt information indicating whether the first application or service meets processing conditions; outputting prompt information for selecting an application or service. Optionally, the processing conditions include at least one of the following:

Optionally, determine whether the first application or service meets the processing conditions according to the key information, and output prompt information, which may include processing conditions that the first application or service meets or does not meet. In one scenario, the prompt information may be "Voice Assistant A does not have payment authority", "Voice Assistant A is currently prohibited from performing this function" and so on. In one scenario, the prompt information can be "Need to use the navigation function, please confirm whether to wake up voice assistant B", "Need to use contact information, please confirm whether to authorize voice assistant A to use contact information", "Need to use contact information , please confirm whether the call is made by voice assistant B", etc. Therefore, the prompt information can only provide information prompts, or provide users with optional decision-making methods, as a key interaction entry for the cooperation between multiple applications or services, and provide key reference information for the processing strategies between multiple applications or services. In order to subsequently perform corresponding processing on the first application or service and/or the second application or service, and obtain a user-satisfactory interactive experience.

Optionally, in step S0200, processing the first application or service according to a first preset strategy includes at least one of the following: controlling the first application or service to process part of the information to be processed; controlling the first application or The service does not process the pending information; outputting information for prompting whether the pending information is processed by the first application or service; in response to the first preset operation, controlling the first application or service to process the pending information; delaying processing the pending information; And/or, after the first application or service meets the processing condition, control the first application or service to process the information to be processed.

Optionally, the above-mentioned first preset policy is applicable to the scenario where the first application or service does not meet the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service does not meet the processing conditions, according to the first preset policy The first application or service is processed. In one scenario, the first application or service may be controlled to process part of the information to be processed, for example, the first application or service extracts key information from the information to be processed. In one scenario, the first application or service may be controlled not to process the information to be processed, that is, not to respond to a processing request of the information to be processed or to be processed by other applications or services. In one scenario, output information for prompting whether to process the pending information by the first application or service, and then control the first application in response to the operation of confirming that the first application or service processes the pending information in response to the first preset operation or service processing pending information. In one scenario, it is possible to delay processing the pending information, for example, delay playing a song, and then control the first application or service to process the pending information and play the song when the vehicle stops or the speed is low.

Optionally, in step S0200, processing the second application or service according to a second preset strategy includes at least one of the following: waking up or running the second application or service; controlling the second application or service to process the pending information at least a part of the information; output information for prompting whether to process the pending information by the second application or service; respond to the second preset operation, control the second application or service to process the pending information; control the second application or service to process the pending information At least a part of the information is processed, and the processing result is sent to the first application or service.

Optionally, the above second preset policy is applicable to the scenario where the first application or service does not meet the processing conditions, that is, when it is determined that the first application or service does not meet the processing conditions in response to the preset operation, according to the second preset policy The second application or service is processed. In one scenario, wake up or run the second application or service, so that the second application or service can process the information to be processed. In one scenario, the second application or service can be controlled to process at least part of the information to be processed, for example, the information processed by the first application or service can be processed, or when the content to be translated contains different languages, the second application or service can The app or service translates the language for which the first app or service does not support translation. In one scenario, output information for prompting whether to process the pending information by the second application or service, and then control the second application in response to the operation of confirming that the pending information is processed by the second application or service in response to the second preset operation or service processing pending information. In one scenario, control the second application or service to process at least part of the information to be processed, and send the processing result to the first application or service, for example, the second application or service can translate the first application or service does not support translation language, and then send the translation result to the first application or service for processing.

Optionally, in step S0200, processing the first application or service according to a first preset policy, and processing the second application or service according to a second preset policy include at least one of the following:

Optionally, in response to a preset operation, when it is determined that the first application or service does not meet the processing conditions, the first application or service is processed according to the first preset policy, and the second application is processed according to the second preset policy or service for processing. In one scenario, a first application or service can translate a language that supports translation, a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the second application or service. In one scenario, a first application or service can translate a language that supports translation, a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the first application or service. In one scenario, the first application or service translates the language that supports translation, the second application or service translates the language that the first application or service does not support translation, and then outputs the final translation result through the first application or service. In one scenario, the information to be processed is the rock version of Dolan’s impulsive punishment, and the first application or service can search for the song. When the rock version of the song is not found, the first application or service will send the searched song to For the second application or service, the second application or service performs sound editing and then outputs it.

Optionally, processing the first application or service according to the first preset policy may also include at least one of the following: controlling the first application or service to start processing at least part of the information to be processed; controlling the first application or service Processing at least a part of the information to be processed within a preset period of time; in response to a first preset operation, controlling the first application or service to process the information to be processed; controlling the first application or service to process the information to be processed according to the current scene or mode; Output the processing result.

Optionally, the above-mentioned first preset policy is applicable to the scenario where the first application or service meets the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service meets the processing conditions, the first application or service is processed according to the first preset policy. An application or service for processing. It can be understood that, for the same processing condition, when the first application or service meets the processing condition, it means that the current scene can be dominated by the first application or service, and assisted by other applications or services when necessary. For example, the first application or service can be controlled to start processing at least a part of the information to be processed, including all information. In one scenario, a preset time period for the first application or service to process the information to be processed can be set, for example, in summer Turn on the air conditioner in the room at 8 o'clock in the evening to create a comfortable rest environment in advance. And/or, the prompt can still be output, and in response to the first preset operation, the first application or service is controlled to process the information to be processed, so as to improve the interaction accuracy. And/or, control the first application or service to process the information to be processed according to the current scene or mode, for example, if the current power of the processing device is lower than the threshold but needs to play music, then the screen can be turned off while the music is playing to save power. When the first application or service meets the processing condition, for example, in the interactive mode, the first application or service may also output the processing result.

Optionally, processing the second application or service according to the second preset policy also includes at least one of the following: controlling the second application or service to sleep or exiting the second application or service; Or the service processes information of part of the information to be processed; in response to a second preset operation, controlling the second application or service to process part of the information to be processed.

Optionally, the above-mentioned second preset policy is applicable to the scenario where the first application or service meets the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service meets the processing conditions, the first application or service is processed according to the second preset policy. 2. The application or service performs the processing. When the first application or service meets the processing conditions, the second application or service may assist or supplement the functions or interaction capabilities of the first application or service, and/or control the second application or service to sleep or exit. When the second application or service is required to assist or supplement the functions or interaction capabilities of the first application or service, it can confirm to the user by prompting, and then control the second application or service to process the pending information according to the user's operation. partial information. For example, if the first application or service has the function of translating English, but the file has a large number of words, part of the content can be translated by the second application or service, thereby speeding up the translation.

Optionally, processing the first application or service according to a first preset policy, and processing the second application or service according to a second preset policy include at least one of the following:

Optionally, the above-mentioned first preset policy and second preset policy are applicable to the scenario where the first application or service meets the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service meets the processing conditions, according to the first A preset policy processes the first application or service and processes the second application or service according to a second preset policy. When the first application or service meets the processing conditions, the functions or interaction capabilities between the first application or service and the second application or service can still be reasonably allocated, and the first application or service is responsible for most of the data processing or responsible Output the processing result. For example, after the first application or service completes the translation of all documents, the second application or service performs proofreading and output; and/or, after the first application or service completes the translation and proofreading of all documents, the second application or service conducts Output, and/or, the second application or service assists in translating a part of the file, and the first application or service outputs the result.

Optionally, when processing the first application or service based on the first preset policy, including controlling the first application or service to process part of the information to be processed, step S0200 further includes:

The information to be processed is split to determine part of the information to be processed by the first application or service.

Optionally, when the first application or service only processes part of the information to be processed, the information to be processed may be split, for example, the content to be translated is split into different languages, the amount of translation is split, the amount of translation to be translated Partitioning of the interface, etc.; and/or, splitting different parts of the instruction, such as "send an email to Xiaoyuan at 10 o'clock", can be divided into timing and sending emails, and the application or service responsible for sending emails has a higher priority. Security Level.

Optionally, when step S0100 outputs the prompt information indicating whether the first application or service meets the processing condition, after step S0200, further include: step S0300: determine whether the processing result matches the processing condition; step S0400: if not, Then, information for prompting to update the processing conditions is output.

Optionally, step S0300 includes at least one of the following:

Optionally, when the first application or service and the second application or service are located on different devices, step S0200 includes:

Step S0200b: In response to the first processing result meeting the preset condition, perform preset processing on the first application or service according to the second processing result. Optionally, the second processing result is used by at least one second application or service on the associated device dealt with.

Optionally, in response to a preset operation, the first processing result is determined according to whether the first application or service meets the processing condition. Optionally, when the first application or service does not meet the processing condition, the first processing result may be obtained further based on information related to the processing device and the first application or service. In actual implementation, when the first application or service meets the processing conditions, the first processing result may be obtained further based on information about the processing device and the first application or service. The relevant information of the processing device includes whether it is a control center, battery power, scene or mode, operating status, device association information, etc., and the relevant information of the first application or service includes whether it supports the function to be realized by the information to be processed. Based on the first processing result, at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.

Optionally, step S0200b includes at least one of the following:

In the application or service processing method of the present application, in response to the first application or service acquiring information to be processed, outputting at least one prompt message; in response to a preset operation, processing the first application or service according to a first preset strategy; and /or, at least one second application or service is processed according to a second preset policy. Through the above method, when the information to be processed is directly received by the first application or service, the first application or service and/or the second application or service can be processed through prompts, and the application or service can be processed when using the application or service. Manage and control the use process of the service, make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.

Fourth embodiment

Fig. 9 is a schematic flowchart of a method for processing an application or service according to a fourth embodiment. As shown in FIG. 9, an application or service processing method of the present application is applied to a processing device, including:

Step S01000: In response to the first processing result meeting the preset condition, output at least one prompt message on the processing device and/or the associated device, the first processing result is obtained based on the information to be processed by the first application or service;

Step S02000: In response to the preset operation, perform preset processing on the first application or service according to a preset strategy and/or a second processing result, and the second processing result is obtained by processing at least one second application or service on the associated device.

Processing devices and associated devices may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), car Networked devices (such as smart cars, vehicle terminals, etc.). Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures. The information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information. Through the above method, when there is information to be processed, through the interaction between different devices, the use process of the application or service can be controlled when using the application or service, and the functions and interaction capabilities of different applications or services can be fully utilized. Improve data security and/or interaction effects and enhance user experience.

Optionally, when using the A human-computer interaction application on the A device, the B device controls or authorizes the A human-computer interaction application; and/or, when using the A A human-computer interaction application on the A device, it can be controlled by B human-computer interaction application on B device controls, information collaborative processing or authorization of A human-computer interaction application; and/or, using B human-computer interaction application on B device as the control center, controls other human-computer interaction applications on other The processing content, functions, permissions and interactions of interactive applications are under overall control. In this way, the functions and interaction capabilities of different applications or services can be fully utilized, which can not only improve data security, but also enhance the interaction effect, so that the interaction scenarios are not limited to the currently used applications or services, the interaction is more flexible and smooth, and the user experience is improved .

Optionally, step S01000 includes: determining key information in response to acquiring information to be processed; and determining a first processing result according to the key information.

Optionally, the key information includes at least one of the location of the processing object of the information to be processed, trigger location, processing time, source application, target application, function to be implemented, associated equipment, and processing equipment information. By performing preliminary processing on the information to be processed, the first processing result can be determined. The first processing result can include the processing result related to the processing device, and can also include the processing result related to the information to be processed. For example, the A human-computer interaction application receives The voice information "projects the patent document", it can be determined that the processing object of the information to be processed is a patent document, the trigger time is the time when the voice information is input, the processing time is now, the source application is A human-computer interaction application, and the target application is a certain projection application. Optionally, the first processing result determined according to the key information may be that the device where the human-computer interaction application A is located is not the control center, or that the human-computer interaction application A does not support calling the projection application, or that the device where the human-computer interaction application A is located has an associated Commonly used projection equipment, or the A human-computer interaction application cannot currently display the XX file that needs to be projected. Based on the first processing result, at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.

When the first processing result meets the preset condition, at least one prompt message is output on the processing device or the associated device, for example, prompting "authorization by device C is required", "the file cannot be displayed currently", etc.

Under the same preset condition, when the first processing result does not meet the preset condition, the first application or service and/or the second application or service may be processed according to a second preset policy.

Optionally, processing the first application or service according to the second preset strategy includes at least one of the following: controlling the first application or service to start processing at least a part of the information to be processed; controlling the first application or service to Set a time period to process at least part of the information to be processed; in response to the first preset operation, control the first application or service to process the information to be processed; control the first application or service to process the information to be processed according to the current scene or mode; output processing result.

Optionally, in one scenario, the first application or service can be controlled to start processing at least a part of the information to be processed, including all information, and in one scenario, a preset for the first application or service to process the pending information can be set Time period, for example, turn on the air conditioner in the room at 8 o'clock in the evening in summer, so as to create a comfortable rest environment in advance. And/or, the prompt can still be output, and in response to the first preset operation, the first application or service is controlled to process the information to be processed, so as to improve the interaction accuracy. And/or, control the first application or service to process the information to be processed according to the current scene or mode, for example, if the current power of the processing device is lower than the threshold but needs to play music, then the screen can be turned off while the music is playing to save power. When the first application or service meets the processing condition, for example, in the interactive mode, the first application or service may also output the processing result.

When the first processing result does not meet the preset condition, the second application or service may assist or supplement the function or interaction capability of the first application or service, and/or control the second application or service to sleep or exit. When the second application or service is required to assist or supplement the functions or interaction capabilities of the first application or service, it can confirm to the user by prompting, and then control the second application or service to process the pending information according to the user's operation. partial information. For example, if the first application or service has the function of translating English, but the file has a large number of words, part of the content can be translated by the second application or service, thereby speeding up the translation.

When the first application or service meets the preset conditions, the functions or interaction capabilities between the first application or service and the second application or service can still be reasonably allocated, and the first application or service is responsible for most of the data processing or Responsible for outputting processing results. For example, after the first application or service completes the translation of all documents, the second application or service performs proofreading and output; and/or, after the first application or service completes the translation and proofreading of all documents, the second application or service conducts Output, and/or, the second application or service assists in translating a part of the file, and the first application or service outputs the result.

Optionally, in step S02000, the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.

According to the control instruction generated by the preset operation, perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernate the first application or service ;

Optionally, at least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result. In one scenario, when the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed. Another part of the processing result of processing information, the third application or service may be an application or service on a processing device, an associated device, or other devices, for example, A human-computer interaction application requests B human-computer interaction application to process different types of audio, and B The human-computer interaction application can only process several types of audio. At this time, the human-computer interaction application A can request to call the human-computer interaction application C to process other types of audio.

Optionally, the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used. For example, when the power of the processing device is low (for example, less than 20%), the associated device may control to close the first application or service. And/or, when receiving an operation to close the first application or service, the associated device may control to close the first application or service.

The application scenarios of the two application or service processing methods based on the present application will be described below.

Fig. 10 is one of the schematic diagrams of the application or service processing method according to the fourth embodiment. As shown in Figure 10, the processing device 301 is provided with a voice assistant A, and the first associated device 302 is provided with a voice assistant B, and the processing device 301 and the first associated device 302 can be connected through a network, and the network includes short-distance transmission The wireless network, such as Bluetooth and WiFi, may also include a network of a mobile operator, and may also include a cloud-based data transmission network, so as to realize data transmission between the processing device 301 and the first association device 302 through the network. The scenario shown in Figure 11 is a transfer scenario, and the application or service is used as a voice assistant as an example for illustration. Figure 11 (a) shows the interface of the voice assistant A on the processing device 301. The voice assistant A prompts "You said, I'm listening..." at this time, and the user can input instructions by voice, because this application can Integrate the functions and interaction capabilities between applications or services, so that the instructions that the voice assistant A can accept are richer, without prompting the user for input content; after that, as shown in (b) in Figure 11, the processing device 301 The interface displays the content "pay 99.9 yuan" input by the user to prompt the user, and the first processing result determined based on the content input by the user is: the voice assistant A or the processing device 301 does not have the payment authority, and the processing device 301 has the associated An associated device 301 . Optionally, a prompt message "requesting permission from the device 302, please wait..." is output. At this time, as shown in Figure 12, the voice assistant B on the first associated device 302 displays a prompt "device 301 requests payment of 99.9 yuan" and prompts the user for related instructions, "transfer to device 303 for processing; allow; not allow... ", improve interaction efficiency by prompting users to enter instructions based on the reminder content. Based on the user's operation on the voice assistant B, for example, the user enters the voice "Allow", the second processing result is obtained. At this time, the voice assistant A can be processed based on the second processing result, that is, the payment is allowed, and the voice can be turned off after the payment Assistant A. In this way, in the scenario of money transfer, data security can be guaranteed based on the permissions of different devices and voice assistants.

Fig. 13 is a second schematic diagram of a scene of an application or service processing method according to the fourth embodiment. The difference from the scenario shown in FIG. 10 is that a second association device 303 is added, and a voice assistant C is installed on the second association device. The second association device 303, the processing device 301 and the first association device 302 can be connected through the network To connect, the network includes a wireless network for short-distance transmission, such as Bluetooth and WiFi, and may also include a network of a mobile operator, and may also include a data transmission network based on the cloud, so that the processing device 301, the first associated device 302, Data transmission between the second associated devices 303 . The interaction among the processing device 301 , the first associated device 302 , and the second associated device is still described in a transfer scenario. The processing methods of the processing device 301 and the first associated device 302 are still the same as those in (a) and (b) in Fig. 11. The difference is that when the user enters the voice "transfer to device 302 for processing" to the voice assistant B, the result is The second processing result is "the second application or service transfer authorization, determine or generate the associated voice assistant C", at this time, the voice assistant A can be processed based on the second processing result, and the second associated device C can perform transfer authorization. At this time, as shown in Figure 14, the voice assistant C on the second associated device 303 displays a prompt "device 301 requests payment of 99.9 yuan", and prompts the user for related instructions, "transfer to device 302 for processing; allow; not allow... ", improve interaction efficiency by prompting users to enter instructions based on the reminder content. Based on the user's operation on the voice assistant C, for example, the user inputs the voice "Allow", the third processing result can be obtained. At this time, the voice assistant A can be processed based on the third processing result, that is, the payment is allowed, and the voice assistant is turned off after payment a. In this way, in the transfer scenario, data security can be guaranteed based on the permissions of multiple devices and voice assistants.

In the application or service processing method of the present application, in response to the first processing result meeting the preset condition, output at least one prompt message on the processing device and/or associated device, optionally, the first processing result is the first application or service Obtained based on information to be processed; in response to a preset operation, perform preset processing on the first application or service according to a preset strategy and/or a second processing result, optionally, the second processing result is determined by at least one of the associated devices The second application or service handles getting. In this way, when there is information to be processed, through the interaction between different devices, the use process of the application or service can be controlled when using the application or service, and the functions and interaction capabilities of different applications or services can be fully utilized , improve data security and/or interaction effects, and enhance user experience.

fifth embodiment

Fig. 15 is a schematic flowchart of a processing method for an application or service according to a fifth embodiment. As shown in Figure 15, an application or service processing method of this application is applied to an associated device, including:

Step T2: Outputting at least one piece of feedback information in response to the preset operation and/or the associated device meeting the second preset condition, so that at least one first application or service on the processing device performs preset processing.

Optionally, in step T1, the processing request output by the processing device includes processing device information and/or a request type, where the request type includes at least one of an authorization request, an assistance request, and a control request. For example, when the processing device receives the information to be processed, it outputs a request for authorization to execute a certain function to the associated device, and/or, when the processing device receives the information to be processed, the battery is low, and outputs a request to the associated device to assist in processing the information, Wait.

Optionally, the first preset condition includes at least one of the following: the processing device is not a control center; the processing request is a request of a preset type; Optionally, the second preset condition includes: the associated device is a control center; Let operation be an operation that allows the processing of the processing request; the associated device supports the functions or permissions required to process the request; the associated device is in a preset state, mode, or scene.

Optionally, step T2 includes: step T2a: in response to the preset operation and/or the associated device meeting the second preset condition, acquire the first processing result determined by the first application or service based on the information to be processed; step T2b: At least one second application or service performs processing to obtain a second processing result; Step T2c: Based on the second processing result, output at least one piece of feedback information, so that at least one first application or service on the processing device performs preset processing.

Optionally, by performing preliminary processing on the information to be processed, the first processing result can be determined, and the first processing result can include processing results related to the processing equipment, and can also include processing results related to the information to be processed, for example, A man-machine When the interactive application receives the voice information "projecting the patent document", it can be determined that the processing object of the information to be processed is the patent document, the trigger time is the time when the voice information is input, the processing time is now, the source application is A human-computer interaction application, and the target The application is a projection application. Optionally, the first processing result determined according to the key information may be that the device where the human-computer interaction application A is located is not the control center, or that the human-computer interaction application A does not support calling the projection application, or that the device where the human-computer interaction application A is located has an associated Commonly used projection equipment, or the A human-computer interaction application cannot currently display the XX file that needs to be projected. Based on the first processing result, at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.

Optionally, step T2c includes at least one of the following:

The second processing result is that the second application or service outputs all the processing results of the information to be processed, and outputs feedback information for closing or hiding or freezing or dormant the first application or service;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and outputs another part of the processing result that controls the first application or service to determine or generate an associated at least one third application or service to process the information to be processed Feedback;

The second processing result is to allow the use of preset permissions and output feedback information for controlling the first application or service to output the processing result of the information to be processed;

Sixth embodiment

Fig. 16 is a schematic flowchart of a method for processing an application or service according to the sixth embodiment. As shown in Figure 16, an application or service processing method of this application is applied to an associated device, including:

Optionally, the first preset condition includes at least one of the following: the processing device is not a control center; the processing request is a request of a preset type;

Optionally, the second preset condition includes at least one of the following: the associated device is a control center; the preset operation is an operation that allows processing the processing request; the associated device supports the functions or permissions required for processing the request; the associated device is in the preset state, mode or scene.

The above first preset condition, second preset condition, and preset processing are the same as those in the fifth embodiment, and will not be repeated here.

Optionally, step T30 includes at least one of the following:

Optionally, the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used. For example, when the power of the processing device is low (such as lower than or equal to a certain preset value, such as 20%), the associated device may control to close the first application or service. And/or, when receiving an operation to close the first application or service, the associated device may control to close the first application or service.

Seventh embodiment

Fig. 17 is a schematic flowchart of a method for processing applications or services according to the seventh embodiment. As shown in Figure 17, the application or service processing method of this application is applied to a processing device, including:

Step S2: In response to the target application or target service, perform corresponding processing according to a preset strategy.

Optionally, the processing device may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.). Optionally, the application or service may include a human-computer interaction application, and the human-computer interaction application includes an application or service that can perform human-computer interaction through touch operations, voice, touch gestures, air gestures, etc. (such as smart assistants, etc.), Other similar applications or services are also possible. The data to be processed includes but is not limited to voice data, touch or air gesture data, body movement data, or data after processing these data, for example, it may be a control instruction obtained after processing voice data. The acquisition of the data to be processed by the processing device may be that the processing device receives the data to be processed input by the user, or it may be that the processing device receives the data to be processed sent by other devices. The target application or target service may be set on the processing device and/or other devices (such as an associated device of the processing device, etc.). Optionally, the target application or target service includes at least one of voice assistant applications, social media applications, information content applications, tool applications, and system services.

Through the above method, after obtaining the data to be processed, at least one target application or target service is determined first, and then the determined target application or target service is processed, so that after obtaining the data to be processed, the accuracy and accuracy of the response to the data to be processed can be improved. / Or improve the interaction effect, thereby enhancing the user experience.

Optionally, when it is determined that at least one target application or target service includes multiple human-computer interaction applications, simultaneously or sequentially invoke the multiple human-computer interaction applications to respond; and/or control the multiple human-computer interaction applications Output the response results simultaneously or sequentially; and/or, preferentially invoke human-computer interaction applications with high priority, and/or high trust level, and/or frequent use to respond to the data to be processed; and/or, according to the scenario The human-computer interaction application corresponding to the information call responds to the data to be processed. For example, only the human-computer interaction application that matches the environment can be called in a specific environment, and only the human-computer interaction application that matches the time can be called in a specific time period; and/or, in In the case of an associated device, call the human-computer interaction application in the associated device to respond to the data to be processed, for example, call the mobile phone and play songs with the car machine associated with the mobile phone; and/or, the human-computer interaction application as the control center It is used to interact with users, and other human-computer interaction applications are used to respond to pending data and so on. In this way, the functions and interaction capabilities of the application or service can be fully utilized, which can not only improve the accuracy of the response result, but also improve the interaction effect, making the interaction more flexible and convenient, and improving the user experience.

Optionally, the step S1 includes: step S11a: according to the acquired operation, and/or preset information, and/or scene information, and/or the source information of the data to be processed, and/or the Relevant information of the processed data, and/or a response result to the data to be processed, determines at least one target application or target service.

Optionally, the acquired operations include but are not limited to: information such as touch gesture operations, air gesture operations, and voice operations. The above operation information can be collected through corresponding sensors in the device or image or voice acquisition devices, for example, Air gestures can be obtained through the camera in the mobile phone or the voice input by the user can be obtained through the microphone.

Determining at least one target application or target service according to the obtained operation may be: selecting an application or service that matches the obtained operation as the target application or service, for example, matching the application or service with the palm open air gesture As the target application or target service, or use the application or service that matches the touch position of the touch gesture as the target application or target service, etc., in this way, the target application or target service can be more accurately determined, thereby providing users with better experience.

Optionally, the preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, and the like. For historical usage information, it is used to distinguish user usage habits, including but not limited to: historical usage times, historical usage time, historical usage locations, etc. For example, users tend to use different applications or services in different locations or at different times. For the supported function information, it is used to distinguish the functions that the application or service can implement, for example, whether it supports reading contacts, whether it supports calling a camera function, and so on. As for the running status information, it is used to distinguish the running status of the application or service, for example, whether it is closed, running in the foreground or running in the background. For device information, it is used to distinguish the identity and/or status of the device where different applications or services are located, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, or associated devices, etc. ), remaining power information, remaining network traffic, network status, etc. For permission information, it is used to distinguish the usage permissions of different applications or services, including but not limited to: priority, callable applications or services, etc. For example, applications or services with different priorities have different usage sequences, or different The third-party applications that an application or service can call are different.

Determining at least one target application or target service according to the preset information may be: the priority, and/or supported function information, and/or running status information, and/or device information, and/or permission information meet the preset Conditional application or service is determined as the target application or service, for example, the application or service that supports the function that can respond to the data to be processed is determined as the target application or service, or the application or service with the highest priority is determined as the target application or the target service, or determine the application or service that is running in the foreground or has been awakened as the target application or service, or determine the application or service of the associated device as the target application or service, or determine the remaining power of the device There are many applications or services with supported functions that can respond to the data to be processed and determined as the target application or target service, etc.

Optionally, the scene information may include at least one of the following information: location type, time information, number of users, user identity, scene image, and the like. For the location type, it is used to distinguish the space where the user is currently located, including but not limited to: closed environment (such as inside the room, inside the vehicle, etc.), open environment (such as outside the room, playground, etc.), and the location type can be passed through the sensor (such as gravity sensor, acceleration sensor, gyroscope, camera, GPS, etc.) to perceive. For time information, it is used to distinguish the current date or time period, such as day or night, morning or afternoon, etc. For the number of users, it is used to distinguish how many users are around the device. For example, there may be only one or multiple users. The number of users can be sensed by sensors (such as cameras, microphones, etc.), such as only one sound source is detected , indicating that there is only one user. For user identity, it is used to distinguish the user's personality characteristics, including but not limited to: age type, gender, occupation type, etc. For the scene image, it is used to distinguish the specific environment of the device or the specific image of the user. For example, the user's gaze direction and/or gesture direction and other information can be obtained according to the user's image.

According to preset information, determining at least one target application or target service may be: determining the application or service corresponding to the user's gaze direction as the target application or target service, for example, when the user's gaze direction is towards the A human-computer interaction application, Determine the A human-computer interaction application as the target application; or determine the application or service that matches the current location type as the target application or service, for example, when the user is in the vehicle, determine the application or service located in the vehicle as the target application The target application or target service; or, determine the application or service that matches the current time and current location type as the target application or target service, etc., so that the target application or target service can be more accurately determined, thereby giving users a better experience .

Optionally, the source information of the data to be processed includes, but is not limited to: time and location for obtaining the data to be processed, information about a device that obtains or outputs the data to be processed, and the like. As for the time to obtain the data to be processed, it is used to distinguish the timing of receiving the data to be processed. For example, the time to obtain the data to be processed may be during working hours or during off working hours. For the location where the data to be processed is obtained, it is used to distinguish the location where the data to be processed is received, for example, the location to obtain the data to be processed may be in a room or in a vehicle. The information about the device that obtains or outputs the data to be processed is used to distinguish the device that obtains or outputs the data to be processed, for example, whether the device that obtains or outputs the data to be processed is an associated device.

According to the source information of the data to be processed, determining at least one target application or target service may be: determining the application or service that matches the time to obtain the data to be processed as the target application or service, for example, if the time to obtain the data to be processed If it is off-duty time, the application or service located in the car is determined as the target application or service, so that the user can know in time, or, if the time to obtain the data to be processed is a rest day, the application or service located in the smart speaker The service is determined as the target application or target service; or, the application or service contained in the device associated with the device that outputs the data to be processed is determined as the target application or target service, for example, if the device that receives the data to be processed is a mobile phone and a smart speaker If it is associated with the mobile phone, the application or service located in the smart speaker is determined as the target application or service. In this way, the application or service required by the user can be accurately determined as the target application or service, thereby bringing better experience to the user.

Optionally, the relevant information of the data to be processed includes, but is not limited to: required functions, and/or applications, and/or response speed, and/or accuracy, and/or privacy level, and the like. For the functions required by the data to be processed, it is used to distinguish the operations required to respond to the data to be processed. For example, the functions required by the data to be processed may be dialing, taking pictures, and so on. For the application required by the pending data, it is used to distinguish the application required to respond to the pending data. The application required by the pending data may be a music application for playing songs, or an application for playing TV or movies video applications, etc. For pending data, this is used to distinguish between fast and slow responses to pending data, for example, translating data may require a faster response than playing a song. The accuracy required for the data to be processed is used to distinguish the correctness of the response to the data to be processed, usually, it can be obtained through the evaluation of different users. For the privacy level required for the data to be processed, it is used to distinguish the level of privacy required for the response to the data to be processed. For example, the privacy level of the transfer or remittance operation may be higher than the privacy level of the phone call.

According to the relevant information of the data to be processed, determining at least one target application or target service may be: determining as the target an application or service that supports the functions required by the data to be processed and whose response speed meets the response speed required by the data to be processed application or target service; or, the application or service whose privacy level meets the privacy level required by the data to be processed and supports the application required by the data to be processed is determined as the target application or target service; or, the accuracy meets the requirements of the data to be processed The application or service with the required accuracy and response speed that meets the response speed required by the data to be processed is determined as the target application or target service, etc., so that the required application or service can be accurately determined as the target application or target service, and then given A better experience for users.

Optionally, the response result to the data to be processed may be a result obtained after the processing device responds to the data to be processed, or may be an operation or voice input by a user. For example, assuming that the data to be processed is "play the sea of songs", if the response to the data to be processed is "the processing device cannot play the song, the associated device can play the song", then the application located on the associated device or The service is determined as the target application or target service; if the user continues to input the voice "play songs through the car device", the application or service located in the car device can be determined as the target application or target service.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 1 below.

Table 1

组合方案 Combination plan	获取的操作 fetched operation	预设信息 default information	场景信息 scene information	待处理数据的来源信息 Information about the origin of the data to be processed	待处理数据的相关信息 Information about the data to be processed	对待处理数据的响应结果 The response result of the data to be processed
组合示例1 Combination Example 1	否 no	是 yes	是 yes	否 no	否 no	否 no
组合示例2 Combination example 2	否 no	是 yes	否 no	否 no	是 yes	否 no
组合示例3 Combination example 3	否 no	否 no	是 yes	是 yes	是 yes	否 no
组合示例4 Combination example 4	否 no	是 yes	是 yes	是 yes	是 yes	否 no
…… ...	…… ...	…… ...	…… ...	…… ...	…… ...	…… ...

For example, for combination example 1, the application or service that matches the scene information (eg, currently located in the vehicle) and preset information (eg, highest priority) may be determined as the target application or target service.

As another example, for combination example 2, the application or service that matches the preset information (such as being in the wake-up state) and the related information of the data to be processed (such as the function required by the data to be processed) can be determined as the target application or target service.

Also, for combination example 3, the scene information (such as currently in the vehicle), the source information of the data to be processed (such as the location where the data to be processed is obtained) and the related information of the data to be processed (such as The application or service matching the privacy level) is determined as the first target application or target service.

As another example, for combination example 4, it can be combined with preset information (such as being in the wake-up state), scene information (such as currently in the vehicle), source information of the data to be processed (such as the location where the data to be processed is obtained) and the data to be processed The application or service that matches the relevant information (such as the privacy level required for the data to be processed) is determined as the target application or target service.

Through the combined solution, the target application or target service can be determined more accurately and/or intelligently from multiple applications or services, thereby improving user experience.

The above listed are only reference examples. In order to avoid redundancy, they will not be listed one by one here. In actual development or application, flexible combinations can be made according to actual needs, but any combination belongs to the technical solution of this application, which also covers the Within the protection scope of this application.

Optionally, based on information such as the number of times each application or service is used, whether the supported function information can respond to the data to be processed, whether the usage scenario matches the current scenario, whether the running status is running or not running, and other information, from at least two applications or determine at least one target application or target service in the service. Assume that the data to be processed is the voice "Please play the song Motherland" input by the user in the vehicle, and the vehicle includes the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone. If the user's historical usage habits determine that the user prefers to use the human-computer interaction application A in the current scenario, then the human-computer interaction application A can be determined as the target application in response to the data to be processed; or, if the human-computer interaction application A is due to If the navigation service is being provided and the human-computer interaction application B is not running, the human-computer interaction application B can be determined as the target application to respond to the data to be processed; or, if the user's gaze direction is A In the direction of the human-computer interaction application, the human-computer interaction application A may be determined as the target application to respond to the data to be processed.

Optionally, the step S1 includes: if the processing device is not a control center, executing step S11a; and/or,

Optionally, if the processing device is not the control center, the processing device according to the acquired operation, and/or preset information, and/or scene information, and/or the source information of the data to be processed, and/or the Information about the data to be processed, and/or the response result to the data to be processed, to determine at least one target application or target service; if the processing device is a control center, the processing device determines whether there is an associated device, and if there is an associated A device, determining at least one target application or target service from the associated device. That is to say, when the processing device is used as the control center, it may only be responsible for interacting with the user alone, and then it controls other devices to perform corresponding operations, that is, the processing device may only serve as the control center and cannot respond to the data to be processed. Therefore, After the processing device obtains the data to be processed, it may respond to the data to be processed through an associated device associated with the processing device, then first judge whether there is an associated device in the processing device, and if there is an associated device, then from the At least one target application or target service is determined in the associated device. For example, taking the processing device as a mobile phone as an example, assuming that the data to be processed is the voice "turn on the air conditioner" input by the user, if the mobile phone is associated with the air conditioner, the target for responding to the data to be processed can be determined from the air conditioner. application or target service. It can be understood that the associated device may include a device capable of invoking corresponding functions, applications, and services, or a device that is bound to a processing device and logged in with the same account, or a device that has other relationships with the data to be processed.

In some scenarios, there may be only one or multiple associated devices of the processing device. Taking the processing device as an example, the user’s mobile phone may only be associated with the TV at home, or it may be associated with the TV at home, and also be associated with equipment such as air conditioners and smart speakers at home. In addition, the associated device may only have One application or service may also have multiple applications or services, and in this case, the target application or target service needs to be determined according to the actual situation. Optionally, when there is only one associated device, and the associated device has multiple applications or services, information such as functions and/or applications required by the data to be processed may be combined with the information of the multiple associated devices The application or service is matched, and the application or service that can respond to the data to be processed is determined as the target application or target service. In the case that there are multiple associated devices, at least one target device can be determined based on the number of times of use, remaining power level, operating status, processing capability, etc., and then the at least one target device that can respond to the pending The application or service of the data is determined as the target application or target service. Optionally, if there are multiple associated devices, the associated device with the most usage times, and/or the most remaining power, and/or the operating state is not running, and/or the strongest processing capability may be determined as the target The device then determines the target application or target service from the target device based on information such as functions and/or applications required by the data to be processed.

For the user's physiological parameter information, it includes the user's heart rate, blood pressure, pulse, blood oxygen, blood sugar, sweating, etc. Generally, the above user's physiological parameter information can be measured by the corresponding sensor in the device, for example, through the smart watch The optical heart rate sensor measures the user's heart rate.

The user's physiological parameter information satisfies the first preset condition, which may be that the user's physiological parameter reaches the preset user's physiological parameter threshold, for example, the user's heart rate reaches the preset user's heart rate threshold; or, in another implementation scenario, it may be possible to detect The device associated with the user's heart rate is used as the target device. In this way, the target application or target service can be determined more intelligently, thereby giving the user a better experience.

Device system information, which can be: system type, system name, system status, etc. Optionally, for the system type, it is used to distinguish different types of systems, such as Android system, Symbian system, Apple system, etc., and another example is a deep customization system based on Android system (such as MIUI (Mobile Internet UI, millet mobile phone operation system)) Optionally, different systems will provide users with different services during operation, for example, the operating mechanisms of the Apple system and the Android system are different.

As for the system name, it is used to specifically distinguish whether the systems are the same system and to determine the specific information of the system, for example, the system name of the system is "Android system", it can be understood that it specifically specifies the system as "Android system", rather than other systems. Optionally, the system name may also include a complete name, for example, the name includes a system version number.

For the system state, it can be the operating state of the system, such as freeze, smooth, sleep, crash, standby, etc.

The device system information meets the second preset condition, which can be: the device system information meets the preset device system information rules. For example, if the system status is non-stuck (such as smooth, fast, extreme speed, etc.), the system status meets the preset device System information rules; in another implementation scenario, devices belonging to the same system type (such as Apple, Hongmeng, Android, etc.) are more compatible with each other. If the associated devices belonging to the same system type can be preferentially determined as target device, it can bring a better experience to users.

Device communication information can be: device communication signal strength, device communication mode (such as Bluetooth, WIFI, NFC, etc.), device communication distance, etc.

The device communication information meets the third preset condition, which may be: the associated device communication information meets the preset device communication information rules, for example, when the device communication signal strength is greater than or equal to the preset signal strength threshold, the device communication signal strength meets the preset device Communication information rules, generally speaking, the stronger the signal strength, the smoother the interaction between devices and the better the user experience.

The device application information may be: device application name information, etc. It can be understood that the application name can be used to distinguish the application, that is, the application can be identified by the application name.

The device application information satisfies the fourth preset condition, which means that the associated device application information satisfies the preset device application information rules. For example, the device application name information meets the preset response operation trigger conditions (for example, it is recognized by the application name that the device is running some preset When setting up applications, such as games, such as WeChat, etc.), the application data information of the device meets the preset device application information rules. Optionally, the more preset applications are running on the associated device, it generally means that the associated device is being used by the user ( Frequent) use, which helps to determine the target application or target service more intelligently, thereby giving users a better experience.

Device reminder information, the reminder information is used to remind the user to prevent the user from forgetting the corresponding event information, for example, remind the user that the scheduled TV program will be played soon through the reminder information of the associated device.

The device reminder information satisfies the fifth preset condition. It can be that the associated device reminder information meets the preset device reminder information rules. For example, when the time and/or location information in the reminder information is consistent with the current time and/or location, the associated device The reminder information meets the default device reminder information rules; in another implementation scenario, as long as the associated device has reminder information, it can be regarded as the associated device reminder information meets the preset device reminder information rules. In this way, there will be reminder information The associated device identified as the target device also helps to determine the target application or target service more intelligently, because the reason why the user sets the associated device to be reminded means that the device is more convenient for the user to operate and/or view device of.

The device detection information may be information for detecting the condition of the device itself, such as whether the device is in normal working state, whether the device hardware is in normal state, the current working state of the device hardware, and so on.

The device detection information meets the sixth preset condition, and the associated device detection information can meet the preset device detection information rules, for example, the current working state of the device hardware meets the preset working state requirements (for example, the associated device software and/or hardware working status is normal) , the current working status of the device hardware satisfies the preset device detection information rules. In this way, it is possible to avoid identifying an associated device with an abnormal working status as the target device, thereby bringing a better experience to the user.

Device status information, which can be: running status, power information, fault information, etc.

For the running state, the device can be in the normal running state, stuck state, unsmooth state, etc.

As for the power information, generally, it can be the current power, the total battery capacity, the ratio of the remaining power, or the estimated usable time based on the user's usage habits in the near future (for example, within 8 hours).

For the fault information, it can be the fault log of the equipment. The fault information can include the cause of the fault, the type of fault, the time of the fault, the frequency of the fault, etc., so that the equipment or engineering and technical personnel can use the fault information to repair or repair. optimization.

The device status information satisfies the seventh preset condition, and the associated device status information can meet the preset device status information rules, for example, the power is greater than or equal to a preset threshold (such as 20%), so that low power and/or card failure can be avoided. Associated devices that fail frequently and/or fail frequently are targeted for a better user experience.

The device environment information may be: device external environment information, device usage environment information, and the like.

For the external environment information of the device, the device has the ability to obtain the external environment information, such as obtaining the brightness of the external ambient light, or obtaining the loudness of the external environmental noise.

For device use environment information, during the use of the device, the use environment information changes with the user's environment. The user's environment can be detected by sensors (such as gravity sensors, acceleration sensors, gyroscopes, cameras, GPS, etc.). Perception, if the user is in motion, the device can detect that the user is in a motion environment, or if the user is driving, the device can detect that the user is in a driving environment, or if the user is in a work or meeting, the device can detect that the user is in a work or meeting in environment.

The device environment information satisfies the eighth preset condition, and the associated device environment information can satisfy the preset device environment information rules. For example, the associated device (such as a car, bicycle, motorcycle, etc.) that the user is driving is used as the target device. Another example, The associated device that the user is exercising (such as wearable devices such as smart watches, smart bracelets, and smart headphones) is used as the target device.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 2 below.

Table 2

预设规则 default rules	第一预设条件 first precondition	第二预设条件 second precondition	第三预设条件 The third precondition	第四预设条件 The fourth precondition	第五预设条件 The fifth precondition	第六预设条件 The sixth precondition	第七预设条件 Seventh Precondition	第八预设条件 Eighth Precondition
组合示例1 Combination Example 1	—— ——	满足 Satisfy	满足 Satisfy	—— ——	—— ——	—— ——	—— ——	—— ——
组合示例2 Combination example 2	—— ——	—— ——	—— ——	满足 Satisfy	—— ——	满足 Satisfy	—— ——	—— ——
组合示例3 Combination example 3	—— ——	—— ——	满足 Satisfy	—— ——	—— ——	—— ——	满足 Satisfy	—— ——
组合示例4 Combination Example 4	—— ——	满足 Satisfy	满足 Satisfy	—— ——	—— ——	—— ——	—— ——	满足 Satisfy
... ...	... ...	... ...	... ...	... ...	... ...	... ...	... ...	... ...

For example, for combination example 1, associated devices that meet the second preset condition (such as belonging to the same system type, such as Apple system) and the third preset condition (such as the communication signal strength greater than or equal to the preset signal strength threshold) can be determined for the target device.

As another example, for combination example 2, associated devices that meet the fourth preset condition (such as running a preset application, such as a game or WeChat) and the sixth preset condition (such as software and/or hardware working normally) can be identified as the target device.

Also, for combination example 3, the third preset condition (such as the communication distance is less than or equal to the preset distance value, such as 5 meters) and the seventh preset condition (the power is greater than or equal to the preset threshold value, such as 20% ) associated device is determined as the target device.

As another example, for combination example 4, the second preset condition (such as belonging to the same system state, such as smoothness) and the third preset condition (such as the communication methods are all Bluetooth) and the eighth preset condition (the user is driving or motion) is identified as the target device.

Through the combined solution, the target device can be determined more accurately and/or intelligently from multiple associated devices, thereby improving user experience.

Optionally, the step S11a includes: determining at least one piece of processing information according to the relevant information of the data to be processed, and determining a first target application or target service according to the at least one piece of processing information; and/or, in response to A response result of the first target application or target service to the data to be processed determines a second target application or target service.

Optionally, since the data to be processed contains the purpose or function that the user wants to achieve, at least one piece of processing information can be determined by parsing the relevant information of the data to be processed, and the processing information can include the applications, and/or services, and/or functions, and/or processing objects, and/or associated devices, and/or processing device information, etc., and according to the at least one processing information, it can be determined to respond to the pending A first target application or target service that processes the data. Since the first target application or target service may not be able to directly and completely respond to the data to be processed, at this time, further cooperation with the second target application or target service may be required to fully respond to the data to be processed. Further, the first target application or target service and the second target application or target service may be the same or different applications or services, or may be the same type or different types of applications or services. Optionally, taking the processing device as an in-vehicle device as an example, assuming that the data to be processed is the voice input by the user "Please call Xiao Li" and the human-computer interaction application A installed in the in-vehicle device supports the dialing function, Then the human-computer interaction application A can be determined as the first target application or target service. If Xiao Li’s phone number is not stored in the car, the human-computer interaction application A cannot make a call to Xiao Li normally. At this time, the The human-computer interaction application B that is set in the mobile phone and supports invoking contact information is determined as the second target application or target service. Based on the response result, it can be determined that at least one second application or service participates in control, processing and decision-making, further improving data security and interaction effect.

Optionally, the step S11a includes: acquiring at least one piece of processing information; if there is only one piece of processing information, determining at least one first application or service that can respond to the processing information, according to the first determination strategy, from the Determine the target application or target service among the at least one first application or service; and/or, if there are at least two processing information, determine at least one second application or service that can partially and/or completely respond to the processing information The service determines a target application or target service from the at least one second application or service according to a second determination strategy.

Optionally, the first determination strategy and the second determination strategy may be the same or different.

In some scenarios, depending on the data to be processed, the determined amount of processing information may also be different. For example, if the data to be processed is the voice "please turn on the air conditioner", the corresponding determined processing information is to turn on the air conditioner. That is, there is only one processing information; if the data to be processed is the voice "please turn on the air conditioner and TV", then the corresponding determined processing information is to turn on the air conditioner and turn on the TV, that is, there are two processing information. Here, at least one piece of processing information may be acquired according to source information of the data to be processed, and/or related information of the data to be processed, and/or a response result to the data to be processed. Optionally, the application or service that can respond to the processing information may be that the application or service can process the processing information based on its own supported function information, or that the application or service can process the processing information by controlling other applications or services. Optionally, assuming that the data to be processed acquired by the processing device is the voice "please turn on the air conditioner", if the first application or service set on the air conditioner can turn on the air conditioner and the second application or service set on the smart speaker can control the If the first application or service is used, both the first application or service and the second application or service may be determined as target applications or target services. Since there may be multiple at least one first application or service that can respond to the processing information, and the user may only need one or part of the applications or services to respond to the data to be processed, then in combination with the first determination strategy Determining a target application or target service from the at least one first application or service, for example, selecting a first application or service with a high priority and/or in an awake state as the target application or target service. When there are at least two processing information, and it is determined that there are multiple second applications or services that can partially and/or fully respond to the processing information, preset information and/or scene information and/or user habits can be combined. , performing priority sorting on at least one second application or service by using a preset sorting method, selecting a second application or service whose priority meets a preset condition according to the priority sorting result and determining it as the target application or target service; and/or, The second application or service whose running state is not running or running is determined as the target application or target service. Optionally, the preset sorting method and the preset condition can be set according to actual needs, for example, the preset sorting method can be sorted in order of priority from low to high or from high to low , the preset condition may be to select the top N applications or services with the highest priority as target applications or target services. Optionally, taking the scene information including the location type and the number of users as an example, assuming that the at least one second application or service includes the human-computer interaction application A set on the mobile phone and the human-computer interaction application B set on the speaker, if The current scene type is a closed environment such as a room and the number of users is one, then the priority of the B human-computer interaction application may be higher than the priority of the A human-computer interaction application to improve user experience; if the current scene type is If the environment is closed and there are many users, the priority of the A human-computer interaction application may be higher than that of the B human-computer interaction application to avoid information leakage. When it is determined that there are at least two second applications or services that can respond to the data to be processed, the second application or service whose running state is not running may be determined as the target application or target service, so as to avoid affecting the running state as running Other second applications or services can work normally, or the second application or service whose running state is running can be determined as the target application or target service, so as to reduce wake-up operations and save resource consumption.

Optionally, before the step S1, it includes: determining at least one application or service management center. Further, before the step S1, the method may further include: if the processing device is a control center, determining at least one application or service management center according to a preset determination strategy.

Optionally, when at least one voice assistant application is installed in the user's mobile phone at the same time, one of the multiple voice assistant applications may be selected as the management center according to a preset determination strategy, wherein the preset determination strategy may include the following: At least one: the application with the highest authority, the highest priority, according to user selection, the highest frequency of use, the highest user score, and the most powerful processing function. Based on the determined application or service management center, it is possible to manage the addition/deletion of target applications or target services in the processing device or associated devices, human-computer interaction interface, permission configuration, etc., for example, the processing device can automatically scan the processing device itself and /or associate the applications or services installed in the device, and add the applications or services that meet the requirements to the application or service management center, or the user can manually add the application or service in the application or service management center, or add the application or service to the added Configure and manage the permissions of applications or services, and visually display the enabled permissions and/or supported processing functions of each application or service.

Optionally, the step S1 further includes: in response to obtaining the data to be processed, determining at least one target application or target service, and displaying the at least one target application or target service corresponding to the at least one target application or target service in the application or service management center Default interface. In addition, after at least one target application or target service is determined, the human-computer interaction interface of the at least one target application or target service can be displayed in the interface of the application or service management center in the form of pop-up windows, floating windows, cards, embedding, etc. , the human-computer interaction interface is used to display the data to be processed and/or response results. Optionally, when the data to be processed requires simultaneous response processing by the first application of the processing device and the second application of the associated device, the interface of the application or service management center displays the first application corresponding to the human-computer interaction interface of the first application. A card and a second card corresponding to the human-computer interaction interface of the second application, so that the first card and the second card can dynamically display the response results of the data to be processed by the first application and the second application. For example, when the acquired data to be processed is that the user issues a voice command to the mobile phone "Please play the song 'Chengdu' with the speaker at the same time", at this time, the interface of the voice assistant management center in the mobile phone will display the interactive interface of the mobile phone voice assistant in the form of a card at the same time The interactive interface with the voice assistant of the speaker, in which the interactive interface of the voice assistant of the mobile phone displays "The following versions of "Chengdu" have been found for you, which version do you want to listen to?" The interactive interface of the voice assistant of the speaker displays "OK, I will play it for you soon "Chengdu" by Zhao Lei".

Optionally, the method further includes: performing preset processing on the target application or target service in response to a preset operation on the preset interface.

Optionally, the application or service management center may also control or interact with the determined target application or target service, which specifically may include at least one of the following:

In response to the close operation on the preset interface, close the application or service corresponding to the preset interface;

In response to the voice instruction acquisition operation in the preset interface, only the application or service corresponding to the preset interface acquires the voice instruction;

In response to a drag operation from the first preset interface to the second preset interface, the first target application or target service corresponding to the first preset interface and the second target application or target service corresponding to the second preset interface Services merged into Super Apps or Services;

In response to the sliding operation on the preset interface, the application or service corresponding to the preset interface is deleted from the application or service management center.

Based on the setting and interactive operation of the application or service management center, it can not only facilitate the management and human-computer interaction of the application or service of the processing device itself, but also use the user interface to visually display the human-computer interaction of each application or service Interface, so that users can more intuitively and clearly know the control and response results of the application or service in the associated device connected to the processing device, which is for associated devices without display screens (such as smart speakers, smart air conditioners, etc.) It can provide a better user control experience.

Optionally, the step S2 includes: transferring the data to be processed, and/or the processing request obtained based on the data to be processed, and/or the response result obtained based on the data to be processed, to a preset transmission Policies are output to the target application or target service to cause the target application or target service to respond.

Optionally, the preset transmission strategy can be set according to actual needs, such as simultaneous output, interval output, and the like. Understandably, if the target application or the target service responds to the data to be processed, there is no interference with each other, for example, one of the at least one target application is used to control the air conditioner, and the other target application is used to control the air conditioner. TV, or the response results can complement or enhance each other, for example, the at least one target application is used to play the same song, at this time, the data to be processed can be output to the target application or target service at the same time. If the target application or the target service interferes with each other when responding to the data to be processed, for example, one of the at least one target application is used to control the vehicle to close the navigation application, and the other target application is used to control the mobile phone To make a call, at this time, the interval between the data to be processed can be output to the target application or target service, for example, firstly control the car machine to close the navigation application, and then control the mobile phone to make a call. It should be noted that since the device where the target application or target service resides may have received the data to be processed, for example, the device where the target application or target service resides and the processing device are both in the vehicle, and the data to be processed The processed data is the voice data sent by the user in the vehicle. At this time, it can be considered that when the processing device receives the data to be processed, the device where the target application or target service is located has also received the data to be processed . Therefore, in order to save resource consumption and speed up processing, the processing device may only output the processing request obtained based on the data to be processed and/or the response result obtained based on the data to be processed to the The target application or target service, so that the target application or target service responds to the data to be processed after receiving it.

Optionally, the target application or target service includes at least one first target application or target service and at least one second target application or target service, and the S2 step includes at least one of the following:

Optionally, when the target application or target service includes at least one first target application or target service and at least one second target application or target service, the at least one first target application or target service and at least one The second target application or target service may or may not belong to the same device, and in this case, a corresponding preset policy may be used in combination with specific circumstances for corresponding processing. The first preset policy and the second preset policy may be set according to actual needs, for example, when the first target application or target service and the second target application or target service belong to the same device, In the case that both can fully respond to the data to be processed, the first target application or target service or the second target application or target service may be randomly awakened to respond to the data to be processed, or output a prompt message, The user can select a target application or target service for responding to the data to be processed. In the case that the first target application or target service and the second target application or target service do not belong to the same device and both can fully respond to the data to be processed, the first target application or target service may be controlled The service and the second target application or target service respectively respond to the data to be processed, or select a corresponding application or service from among them according to the processing capability of the device to respond to the data to be processed. Optionally, it is assumed that the data to be processed is the voice input by the user in the vehicle "play the song Hai Hai", and the target application or target service includes A human-computer interaction application set on the car machine and B set on the user's mobile phone The human-computer interaction application can simultaneously control the A human-computer interaction application and the B human-computer interaction application to wake up or run, so as to respectively respond to the data to be processed, so that the mobile phone and the car simultaneously play the song Dahai, thereby enhancing the song playback effect.

Optionally, the processing according to the first preset policy includes at least one of the following: waking up the first target application or target service and/or the second target application or target service according to the first wake-up policy; Run the first target application or target service and/or the second target application or target service according to the first execution policy; exit the first target application or target service and/or the second target according to the first exit policy an application or a target service; outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a first output policy;

And/or, the processing according to the second preset strategy includes at least one of the following: waking up the first target application or target service and/or the second target application or target service according to a second wakeup strategy; Run the first target application or target service and/or the second target application or target service according to the second execution policy; exit the first target application or target service and/or the second target according to the second exit policy An application or a target service; outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a second output strategy.

Optionally, it is assumed that the target application or target service includes a human-computer interaction application A and a human-computer interaction application B, if the priority or trust level of the human-computer interaction application A is higher than the priority or trust level of the human-computer interaction application B , the human-computer interaction application A can be woken up first, and then the human-computer interaction application B can be woken up; and/or, if the distance between the device where the human-computer interaction application A is located and the processing device is smaller If the distance between the human-computer interaction application A can be woken up first, then the human-computer interaction application B can be woken up; Run the A human-computer interaction application, and then run the B human-computer interaction application; and/or, if the network status of the device where the B human-computer interaction application is located is better than the network status of the device where the A human-computer interaction application is located, you can first wake up the A HMI Interactive application, and then wake up B human-computer interaction application; and/or, if the content of the response result of A human-computer interaction application is a picture, and the content of the response result of B human-computer interaction application is audio, then A human-computer interaction can be output first The response result of the interactive application, and then output the response result of the B human-computer interaction application; if the remaining power of the device where the B human-computer interaction application is located is lower than the remaining power of the device where the A human-computer interaction application is located, you can first exit the B human-computer interaction application, and then exit the A human-computer interaction application.

Here, the processing device may serve as a control center to control the target application or target service to respond to the data to be processed, and to control the output of response information of the target application or target service to the data to be processed. The preset output strategy can be set according to actual needs, such as simultaneous output or sequential output. Certainly, the processing device may also control the target application or target service to output response information according to a preset output strategy. Optionally, the outputting the response information according to the preset output strategy includes at least one of the following: according to the order of receiving time, and/or the priority order of the target application or target service, and/or the current scene, And/or the received operation information, and/or the device corresponding to the response information, outputs the response information, and/or outputs the processed response information.

For the order of receiving time, it is used to distinguish the sequence of the response information returned by the target application or target service. For example, the time when the processing device receives the response information returned by the human-computer interaction application A is earlier than the response information returned by the human-computer interaction application B. time, or the processing device simultaneously receives the response information returned by the human-computer interaction application A and the human-computer interaction application B. Outputting the response information according to the order of receiving time may be: outputting the response information sequentially according to the order of receiving time, or outputting the response information simultaneously.

The priority order of the target application or target service is used to distinguish the importance of the target application or target service. Outputting the response information according to the priority order of the target application or target service may be: outputting the response information sequentially according to the priority order of the target application or target service, that is, outputting the response information with a higher priority first The response information corresponding to the target application or target service, and then output the response information corresponding to the target application or target service with a lower priority.

For the current scene, it is used to distinguish the environment where the device is located, such as in a room or in a vehicle. Outputting the response information according to the current scene may be: determining an output mode according to the current scene, and outputting the response information in the output mode. For example, assuming that the current scene is inside a vehicle, if there is only the user in the vehicle, the response information can be directly output in voice; if there are other users in the vehicle, the response information can be output in text.

For the received operation information, it is used to indicate the output mode or output device of the response information. Outputting the response information according to the received operation information may be: determining an output mode according to the received operation information, and outputting the response information in the output mode, for example, if the processing device receives the user's voice operation information "to Text output", output the response information in text; or determine an output device according to the received operation information, so as to output the response information through the output device.

For the device corresponding to the response information, it is used to distinguish different devices that send the response information. According to the device corresponding to the response information, outputting the response information may be: sequentially outputting the response information according to the priority of the device corresponding to the response information, or, according to the relationship between the device corresponding to the response information and the processing device Output the response information and so on sequentially according to the distance between them.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 3 below.

table 3

组合方案 Combination plan	接收时间先后顺序 Receiving chronological order	优先级顺序 priority order	当前场景 current scene	接收的操作信息 received operational information	响应信息对应的设备 The device corresponding to the response information
组合示例1 Combination Example 1	是 yes	否 no	是 yes	否 no	否 no
组合示例2 Combination example 2	否 no	是 yes	是 yes	否 no	否 no
组合示例3 Combination example 3	是 yes	否 no	是 yes	是 yes	否 no
…… ...	…… ...	…… ...	…… ...	…… ...	…… ...

For example, for combination example 1, the response information may be output according to the order of receiving time (for example, the way of outputting in sequence according to the time of receiving) and the current scene (for example, the way of voice output).

As another example, for combination example 2, the response information may be output according to the priority order of the target application or target service (for example, the way of outputting in order of priority) and the current scene (for example, the way of text output).

Also, for combination example 3, the response information can be output according to the order of receiving time (such as the output method according to the order of receiving time), the current scene (such as the voice output method) and the received operation information (such as specifying the output device) .

By combining solutions, response information can be output more flexibly and/or intelligently, thereby improving user experience.

Optionally, assuming that the processing device receives the response information sent by the human-computer interaction application A and the human-computer interaction application B respectively, if the response information sent by the human-computer interaction application A is received earlier than the response information sent by the human-computer interaction application B information, you can first output the response information sent by the human-computer interaction application of A, and then output the response information sent by the human-computer interaction application of B; if the current scene of the processing device is a scene with multiple people and the response information involves privacy information, the response information may be processed and then output, for example, the response information in audio form is converted into the response information in text form.

Optionally, step S2 further includes at least one of the following: if the target application or target service is a system-level application or service, performing corresponding processing according to a third preset strategy; if the target application or target service is The third-party application or service is processed according to the fourth preset policy.

Optionally, the determined at least one target application or target service may belong to a system-level application or service, or may belong to a third-party application or service. In this case, a corresponding preset policy may be used in combination with specific situations for corresponding processing.

The third preset policy and the fourth preset policy can be set according to actual needs, for example, if the target application or target service belongs to a system-level application or service, then the target application or target service has a system-level In addition to responding or processing the data to be processed, it can call other third-party applications or services to respond or process the data to be processed. Optionally, it is assumed that the data to be processed is that the user enters the voice "navigate to the most popular restaurant nearby" on the mobile phone. At this time, the system voice assistant calls the third-party application installed in the mobile phone, such as Meituan, Dianping, etc., to obtain The address of the restaurant with the highest food popularity ranking in the surrounding area currently located in the third-party application, and then the system voice assistant outputs the navigation route according to the address. If the target application or service belongs to a third-party application or service, the third-party application or service only has partial permissions (such as user-defined permissions), and the third-party application or service is only treated within the scope of its permissions. Process data for response or processing. Optionally, it is assumed that the data to be processed is a voice command issued by the user to the navigation application in the vehicle "send a message to Xiao Li and ask him to wait for me in Hall 1 of the conference center", and since the vehicle navigation application does not have the ability to obtain contacts If you have the permission, it can complete the message editing of "Please wait for me in Hall 1 of the conference center", and then output the voice prompt message "I do not have the contact permission, please manually select the contact or activate the permission". Based on the above method, the response or processing of the data to be processed by at least one target application or target service can be made more intelligent, and the privacy of the user can be fully protected.

The following describes the application scenarios of the three processing methods based on the present application.

Fig. 18 is a schematic diagram of an interface of a processing device in a scenario according to the first embodiment. The scene shown in the illustration is a scene of playing songs, and the application or service is a voice assistant and the voice assistant is used as an example for illustration. (a) in Figure 18 shows the interface of voice assistant A. Voice assistant A prompts "You said, I'm listening..." at this time. At this time, the user can input instructions by voice. and/or the functions and interaction capabilities between different applications or services, so that the instructions that voice assistant A can accept are richer, and there is no need to prompt the user for input content; after that, as shown in (b) in Figure 18 , the device interface displays the content entered by the user "play the song motherland" to prompt the user, and, based on the data to be processed entered by the user, the determined strategy is: wake up or run the voice assistant A on the processing device and the voice assistant on the third-party device B plays the song "Motherland" at the same time, and then outputs the prompt message "Voice Assistant A and Voice Assistant B have been assigned to play the song "Motherland". The interface shown in (b) in Figure 18 is the interface of the processing device; after that, the processing device wakes up or runs the voice assistant A and voice assistant B play the song "Motherland" at the same time, as shown in (c) in Figure 18, and display "Voice Assistant A and Voice Assistant B are playing the song "Motherland" sung by Liu Chang", as shown in (c) in Figure 18 The display interface can also prompt the user for relevant instructions, "You can say: change to another singer; a cappella version...", prompting the user to input instructions based on the reminder content, improving interaction efficiency. In this way, in the scene of playing songs, using the functions or capabilities of different voice assistants can improve the interactive experience.

Fig. 19 is a first schematic diagram of the application or service processing method shown in the first embodiment. Taking the application or service as a voice assistant as an example, as shown in Fig. 19, the processing device 201 is provided with a voice assistant A, and the first device 202 is provided with a voice assistant B, and the second device 203 is provided with a voice assistant C, and the processing device 201, the first device 202, and the second device 203 can be connected through a network, and the network includes a wireless network for short-distance transmission, such as Bluetooth and WiFi may also include the mobile operator's network, and may also include a cloud-based data transmission network, so as to realize data transmission among the processing device 201, the first device 202, and the second device 203 through the network. Fig. 20 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment. The scene shown in the figure is the scene of making a phone call. (a) in Figure 20 shows the interface of the processing device. The processing device prompts "You said, I am listening..." at this time. At this time, the user can input commands by voice. Because this application can integrate the functions and interaction capabilities between applications or services, the instructions that the processing device can accept are more abundant, and there is no need to prompt the user for input content; after that, as shown in (b) in Figure 20 , the processing device interface displays the content input by the user "Call Zhang San's phone number" to prompt the user, and, assuming that voice assistant A and voice assistant B have the right to make calls, and voice assistant A cannot be used to make calls in the current scenario, the voice assistant C does not have the right to make a call. Based on the content entered by the user, the determined strategy is: wake up or run voice assistant B to make a call, wait for a delay to use voice assistant A to make a call, and output a prompt message "Voice assistant cannot be used in the current scenario A and C, you can say: voice assistant B to dial; delay waiting to use voice assistant A to dial", the interface shown in (b) in Figure 20 can be the interface of the processing device; after that, as shown in Figure 20 (c) When the user selects the voice assistant B to make a call or fails to respond after a timeout, wake up or run the voice assistant B to execute the instruction of making a call, and display a prompt screen for making a call on the interface of the processing device. Conversely, if the user selects "Delay and wait to dial with voice assistant A", then when voice assistant A can be used in subsequent scenarios, voice assistant A will be woken up or run to execute the instruction to make a call, and the call will be displayed on the interface of the processing device. prompt screen, when it is necessary to make a call next time, the decision-making process shown in (b) in Figure 20 will still be carried out. In this way, in the scenario of making a phone call, the use of different voice assistants is allocated according to the usage scenarios and permissions, and added to the user's decision-making process, which can improve the interactive experience.

Fig. 21 is a schematic diagram of a scene of an application or service processing method according to the first embodiment. Taking the application or service as a voice assistant as an example, as shown in Fig. 21, a voice assistant A is set on the processing device 301, and a The voice assistant B is set, and the processing device 301 and the associated device 302 can be connected through a network. The network includes a wireless network for short-distance transmission, such as Bluetooth, WiFi, or a network of a mobile operator, or a cloud-based A data transmission network, so as to implement data transmission between the processing device 301 and the associated device 302 through the network. The scene shown in Figure 22 is the game reminder scene, and (a) in Figure 22 shows the interface of voice assistant A on the processing device. The user can input instructions by voice. Since this application can integrate the functions and interaction capabilities between different devices and/or different applications or services, the instructions that the processing device 301 can accept are more abundant, and there is no need to prompt the user for input content ; Afterwards, as shown in (b) in Figure 22, the interface of the processing device 301 displays the content input by the user "Open King of Glory" to prompt the user, and, assuming that the processing device 301 or the voice assistant A does not have the permission to open, the voice assistant B has the permission to open, and the strategy determined based on the content entered by the user is: wake up or run the voice assistant B to request the permission to open. Optionally, output a prompt message "Requesting permission from the associated device 302, please wait..." At this time, as shown in (c) in Figure 22, the voice assistant B on the associated device 302 displays a prompt "Processing the request of the associated device 302 Open "Glory of the King" and prompt the user for relevant instructions, "Allow; Not Allow...", by prompting the user for instructions that can be entered based on the reminder content, the interaction efficiency is improved. Based on the user's operation on the voice assistant B, for example, the user enters the voice "Allow", the processing result will be obtained. At this time, the voice assistant A can be processed based on the processing result, that is, it is allowed to open the glory of the king, and the voice can be turned off after the glory of the king is turned on. Assistant A and Voice Assistant B. In this way, in the game reminder scenario, based on the permissions of different devices and voice assistants, it can provide an accurate interactive experience and ensure data security.

The application or service processing method of the present application is applied to a processing device, and includes the following steps: in response to obtaining data to be processed, determining at least one target application or target service; in response to the target application or target service, according to a preset policy Take appropriate action. After obtaining the data to be processed, the application first determines at least one target application or target service, and then processes the determined target application or target service, which can improve the accuracy and/or response of the data to be processed after obtaining the data to be processed Improve the interaction effect and enhance the user experience.

Eighth embodiment

Fig. 23 is a schematic flowchart of a method for processing applications or services according to the eighth embodiment. As shown in Figure 23, the application or service processing method of this application is applied to a processing device, including the following steps:

S10: Responding to a processing request of the first target application or target service;

S20: wake up or run a second target application or target service of the associated device;

S30: In response to the preset operation, process the first target application or target service according to a first preset policy; and/or process the second target application or target service according to a second preset policy.

Optionally, the processing device may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.). Optionally, the application or service may include a human-computer interaction application, and the human-computer interaction application includes an application or service that can perform human-computer interaction through touch operations, voice, touch gestures, air gestures, etc. (such as smart assistants, etc.), Other similar applications or services are also possible. The first target application or target service may be set on the processing device or other devices (such as devices associated with the processing device, etc.). Optionally, the first target application or target service and/or the second target application or target service include voice assistant applications, social media applications, information content applications, tool applications, and system services at least one. Optionally, the first target application or target service and the second target application or target service may be the same or different applications or services, or may be the same type or different types of applications or services.

Through the above method, after obtaining the processing request of the first target application or target service, first wake up or run the second target application or target service of the associated device, and then execute the first target application or target service and/or the second target application or The processing of the target service can make full use of the functions and interaction capabilities of different applications or services, improve the interaction effect, and enhance the user experience.

Optionally, for the processing request of the first target application or target service, wake up or run the second target application or target service with corresponding permissions and/or functions for processing, and after the request is processed, close or exit the The second target application or target service and the first target application or target service, for example, when the father's mobile phone receives the transfer request sent by the son, the transfer request is sent to the son's mother, so that the son's mother can process the request and/or, wake up or run the second target application or target service in response to the processing request of the first target application or target service, and control the first target application or target service to output the response result of the second target application or target service or control the first target application or target service A target application or target service closes or exits.

Optionally, the step S10 includes: step S110a: in response to obtaining the data to be processed, according to the obtained operation, and/or preset information, and/or scene information, and/or the source information of the data to be processed, and/or related information of the data to be processed to determine the first target application or target service.

The acquisition of the data to be processed by the processing device may be that the processing device receives the data to be processed input by the user, or it may be that the processing device receives the data to be processed input by the user sent by other devices. The data to be processed includes, but is not limited to: voice data, touch or air gesture data, body movement data, or data after processing these data, for example, it may be a control instruction obtained after processing voice data.

According to the obtained operation, determining the first target application or target service may be: selecting the application or service that matches the obtained operation as the first target application or target service, for example, matching the application with the palm open air gesture or service as the first target application or target service, or use the application or service that matches the touch position of the touch gesture as the first target application or target service, etc., so that the first target application or target can be determined more accurately service, thereby giving users a better experience.

According to the preset information, determining the first target application or target service may be: the priority, and/or supported function information, and/or running status information, and/or device information, and/or permission information meet the preset The application or service of the condition is determined as the first target application or service, for example, the application or service whose supported function can respond to the data to be processed is determined as the first target application or service, or the application or service with the highest priority Determining as the first target application or service, or determining an application or service running in the foreground or awakened as the first target application or service, or determining an application or service of an associated device as the first target application or service , or, determine the application or service that has a relatively large remaining power of the device and that supports functions that can respond to the data to be processed as the first target application or target service.

According to preset information, determining the first target application or target service may be: determining the application or service corresponding to the user's gaze direction as the first target application or target service, for example, the user's gaze direction is towards A human-computer interaction application , determine the A human-computer interaction application as the first target application; or determine the application or service that matches the current location type as the first target application or service, for example, when the user is in the vehicle, it will be located in the vehicle or determine the application or service that matches the current time and current location type as the first target application or service, etc., so that the target application or service can be more accurately determined Target service, and then give users a better experience.

According to the source information of the data to be processed, determining the first target application or target service may be: determining the application or service that matches the time when the data to be processed is acquired as the first target application or target service, for example, if the data to be processed is acquired If the time is off-duty, the application or service located in the car will be determined as the first target application or service, so that the user can know in time, or, if the time to obtain the data to be processed is a rest day, the application or service located in the smart speaker The application or service within is determined as the first target application or target service; or, the application or service included in the device associated with the device outputting the data to be processed is determined as the first target application or target service, for example, if the to-be-processed If the data device is a mobile phone and the smart speaker is associated with the mobile phone, the application or service located in the smart speaker is determined as the first target application or target service. In this way, the application or service required by the user can be accurately determined as the target application or service, thereby bringing better experience to the user.

According to the relevant information of the data to be processed, determining the first target application or target service may be: determining the application or service that supports the functions required by the data to be processed and whose response speed meets the response speed required by the data to be processed as the first target application or service A target application or target service; or, the application or service whose privacy level meets the privacy level required by the data to be processed and supports the application required by the data to be processed is determined as the first target application or target service; or, the accuracy meets the The application or service whose accuracy and response speed meet the response speed required by the data to be processed is determined as the first target application or target service, etc., so that the required application or service can be accurately determined as the target application Or target services, thereby bringing a better experience to users.

Optionally, the response result to the data to be processed may be a result obtained after the processing device responds to the data to be processed, or may be an operation or voice input by a user. For example, assuming that the data to be processed is "play the sea of songs", if the response to the data to be processed is "the processing device cannot play the song, the associated device can play the song", then the application located on the associated device or The service is determined as the first target application or target service; if the user continues to input the voice "play songs through the car device", the application or service located in the car device can be determined as the first target application or target service.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 4 below.

Table 4

For example, for combination example 1, the application or service that matches the scene information (eg, currently located in the vehicle) and preset information (eg, highest priority) may be determined as the first target application or target service.

As another example, for combination example 2, the application or service that matches the preset information (such as being in the wake-up state) and the relevant information of the data to be processed (such as the functions required by the data to be processed) can be determined as the first target application or target Serve.

As another example, for combination example 4, it can be combined with preset information (such as being in the wake-up state), scene information (such as currently in the vehicle), source information of the data to be processed (such as the location where the data to be processed is obtained) and the data to be processed The application or service that matches the relevant information (such as the required privacy level of the data to be processed) is determined as the first target application or target service.

Optionally, based on information such as the number of times each application or service is used, whether the supported function information can respond to the data to be processed, whether the usage scenario matches the current scenario, whether the running status is running or not running, and other information, from at least two applications or determine the first target application or target service in the service. Assume that the data to be processed is the voice "Please play the song Motherland" input by the user in the vehicle, and the vehicle includes the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone. If the user's historical usage habits determine that the user prefers to use the human-computer interaction application A in the current scenario, then the human-computer interaction application A can be determined as the first target application; or, if the human-computer interaction application A is in the In the running state, if the B human-computer interaction application is not running, then the B human-computer interaction application can be determined as the first target application; The machine-interactive application is determined as the first target application.

Optionally, the step S10 includes:

If the processing device is not a control center, perform step S110a; and/or,

Optionally, if the processing device is not the control center, the processing device according to the acquired operation, and/or preset information, and/or scene information, and/or the source information of the data to be processed, and/or the Relevant information about the data to be processed, and/or the response result to the data to be processed, determine the first target application or target service; if the processing device is a control center, the processing device determines whether there is an associated device, if there is an associated The device is configured to determine a first target application or target service from the associated device. That is to say, when the processing device is used as the control center, it may only be responsible for interacting with the user alone, and then it controls other devices to perform corresponding operations, that is, the processing device may only serve as the control center and cannot respond to the data to be processed. Therefore, After the processing device obtains the data to be processed, it may respond to the data to be processed through an associated device associated with the processing device, then first judge whether there is an associated device in the processing device, and if there is an associated device, then from the A first target application or target service is determined in the associated device. For example, taking the processing device as a mobile phone as an example, assuming that the data to be processed is the voice "turn on the air conditioner" input by the user, if the mobile phone is associated with the air conditioner, then the first response to the data to be processed can be determined from the air conditioner. A target application or target service. It can be understood that the associated device may include a device capable of invoking corresponding functions, applications, and services, or a device that is bound to a processing device and logged in with the same account, or a device that has other relationships with the data to be processed.

Optionally, since the data to be processed contains the purpose or function that the user wants to achieve, at least one piece of processing information can be determined by parsing the relevant information of the data to be processed, and the processing information can include the applications, and/or services, and/or functions, and/or processing objects, and/or associated devices, and/or processing device information, etc., and according to the at least one processing information, it can be determined to respond to the pending A first target application or target service that processes the data. Optionally, taking the processing device as an in-vehicle device as an example, assume that the data to be processed is the voice input by the user "Please call Xiao Li", and the human-computer interaction application A installed in the in-vehicle device supports the dialing function , then the human-computer interaction application A may be determined as the first target application or target service.

Optionally, the step S10 includes:

The first target application or target service meets the first preset condition in response to the received data to be processed, and/or the device where the first target application or target service is located meets the second preset condition, and/or the first target application or The response result of the target service does not meet the third preset condition, and/or the acquired operation information meets the fourth preset condition, and a processing request is sent.

Optionally, meeting the first preset condition includes but is not limited to: the privacy level is greater than a preset level, the required response speed is greater than a preset speed, contains multiple pending tasks, and is a preset type of data, etc.; Meeting the second preset condition includes but is not limited to: the power is lower than the preset power, the permission does not meet the preset permission, the network status meets the preset network status, and it is in a preset mode or scene; the third preset condition that does not meet includes But not limited to: the first target application or target service does not match the data to be processed (for example, the trust level of the first target application or target service is lower than the trust level required for processing the data to be processed, and the response speed does not meet the requirements of the data to be processed Response speed, etc.), does not match with the processing equipment (such as the format of the response result does not match the function of the processing equipment), etc.; the fourth preset condition includes but is not limited to: no response prompt message after timeout, preset voice command Wait.

Optionally, when the first target application or target service receives the song playing instruction, if the remaining power of the device where the first target application or target service is located is lower than the preset power level and/or is in the power saving mode, the song is sent A play processing request; or, if the trust level of the first target application or target service is lower than the trust level required for processing the song play instruction, then send a song play processing request.

Optionally, before the step S10, it includes: determining at least one application or service management center. Further, before the step S10, the method may further include: if the processing device is a control center, determining at least one application or service management center according to a preset determination policy.

Optionally, the step S20 further includes: displaying in the application or service management center a first preset interface respectively corresponding to the first target application or target service and/or corresponding to the second target application or The second preset interface corresponding to the target service. Wherein, the first preset interface and/or the second preset interface may display the human-computer interaction interface of the target application or target service in the form of pop-up windows, floating windows, cards, embedding, etc. in the interface of the application or service management center , the human-computer interaction interface is used to display the data to be processed and/or response results. Optionally, when the data to be processed requires simultaneous response processing by the first application of the processing device and the second application of the associated device, the interface of the application or service management center displays the first application corresponding to the human-computer interaction interface of the first application. A card and a second card corresponding to the human-computer interaction interface of the second application, so that the first card and the second card can dynamically display the response results of the data to be processed by the first application and the second application. For example, when the acquired data to be processed is that the user issues a voice command to the mobile phone "Please play the song 'Chengdu' with the speaker at the same time", at this time, the interface of the voice assistant management center in the mobile phone will display the interactive interface of the mobile phone voice assistant in the form of a card at the same time The interactive interface with the voice assistant of the speaker, in which the interactive interface of the voice assistant of the mobile phone displays "The following versions of "Chengdu" have been found for you, which version do you want to listen to?" The interactive interface of the voice assistant of the speaker displays "OK, I will play it for you soon "Chengdu" by Zhao Lei".

Optionally, the method further includes: performing preset processing on the target application or target service in response to a preset operation on the first preset interface and/or the second preset interface.

Optionally, the application or service management center may also control or interact with the determined target application or target service, which may specifically include at least one of the following: responding to the first preset interface and/or the second preset The closing operation in the interface closes the application or service corresponding to the preset interface; in response to the voice instruction operation on the first preset interface and/or the second preset interface, only the application or service corresponding to the preset interface The application or service obtains the voice instruction; in response to the drag operation from the first preset interface to the second preset interface, the first target application or target service corresponding to the first preset interface is corresponding to the second preset interface The second target application or target service is merged into a super application or service; in response to the sliding operation on the first preset interface and/or the second preset interface, the application or service corresponding to the preset interface is merged from the application or service Deleted in the management center.

Optionally, before the step S20, it also includes:

For the response result of the first target application or target service, it is used to characterize the processing or analysis result of the data to be processed by the first target application or target service, for example, the response result may be an audio file or a processing request Wait. According to the response result of the first target application or target service, determining at least one associated device may be: when the response result is an audio file, determine a smart speaker with an audio playback function as the associated device; when the response result is a call , determine the smart car machine with the dial-up function as the associated device, etc.

Optionally, the preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, and the like. For historical usage information, it is used to distinguish user usage habits, including but not limited to: historical usage times, historical usage time, historical usage locations, etc. For example, users tend to use different devices in different locations or at different times. For the supported function information, it is used to distinguish the functions that the device can implement, for example, whether it supports reading contacts, whether it supports calling the camera function, and so on. As for the running state information, it is used to distinguish the running state of the device, for example, whether it is in shutdown state or running state. For device information, it is used to distinguish the identity and/or status of different devices, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, etc.), remaining power information, remaining network Traffic, network status, etc. For permission information, it is used to distinguish the usage permissions of different devices, including but not limited to: priority, callable applications or services, etc., for example, devices with different priorities have different usage sequences, or different devices can call Third-party apps are different.

Determining at least one associated device according to preset information may be: a device whose priority, and/or supported function information, and/or operating status information, and/or device information, and/or permission information meet preset conditions Determine as an associated device, for example, determine a device that supports functions that can respond to data to be processed as an associated device, or determine a device with the highest priority as an associated device, or determine a device with a large amount of remaining power and a supported function that can respond The device whose data is to be processed is determined as an associated device or the like.

Optionally, the operation information includes but not limited to: touch gesture operation, air gesture operation, voice operation, selection operation, pointing operation and other information, the above operation information can be collected through corresponding sensors in the device or image or voice The device collects, for example, the gestures in the air through the camera in the mobile phone or the voice input by the user through the microphone.

Determine at least one associated device according to the operation information, which may be: select the device that matches the obtained operation information and determine it as the associated device. icon position, determine the TV as the associated device; or determine the device pointed to by the user-controlled processing device as the associated device, for example, in a smart home environment, when the user points the processing device (such as a mobile phone) at the refrigerator, the refrigerator is determined For associated equipment, etc.

Optionally, the data to be processed includes, but is not limited to, voice data, touch or air gesture data, body movement data, or data processed on these data, for example, it may be a control obtained after processing voice data instruction. Since the data to be processed usually includes information such as functions to be implemented and/or devices for realizing related functions, the associated device for responding to the data to be processed can be accurately and quickly determined according to the data to be processed.

According to the data to be processed, determining at least one associated device may be: determining a device whose supported function can partially or completely respond to the data to be processed as an associated device; or determining the device specified in the data to be processed as an associated device, for example, In a smart home environment, when the data to be processed is to turn on the air conditioner, it is determined that the air conditioner is an associated device.

Optionally, the scene where the processing device is located is used to distinguish different environments, including but not limited to: offices, shopping malls, bus stations, vehicles, and the like. Depending on the scene where the processing device is located, the devices available to respond to the data to be processed may be different. Therefore, the associated device can be accurately and quickly determined according to the scene where the processing device is located.

According to the scene where the processing device is located, determining at least one associated device may be: determining a device connected to the processing device in the scene where the processing device is located as an associated device, for example, if the processing device ( For example, a mobile phone) in a meeting room, the device connected to the processing device (such as a projector) will be used as an associated device; if the processing device (such as a mobile phone) is in the living room at home, the device connected to the processing device (such as a smart speaker) ) as the associated device.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 5 below.

table 5

组合方案 Combination plan	应用或服务的响应结果 The response result of the application or service	预设信息 default information	待处理数据 pending data	操作信息 operating information	处理设备的所处场景 Handle the scene in which the device is located
组合示例1 Combination Example 1	否 no	否 no	是 yes	否 no	是 yes
组合示例2 Combination example 2	否 no	否 no	是 yes	是 yes	否 no
组合示例3 Combination Example 3	是 yes	否 no	否 no	是 yes	是 yes
…… ...	…… ...	…… ...	…… ...	…… ...	…… ...

For example, for combination example 1, a device that matches the scene of the processing device (such as a company) and the data to be processed (such as a projection file required) may be determined as an associated device.

For combination example 2, the device that matches the data to be processed (for example, a song needs to be played) and the operation information (for example, controlling the processing device to point in a certain direction) can be determined as an associated device.

For combination example 3, the response result (such as an audio file) of the first target application or target service, the scene where the processing device is located (such as home) and the operation information (such as controlling the processing device to point to a certain direction) can be matched. The device identified as the associated device.

Through the combined solution, it is possible to more accurately and/or intelligently determine associated devices from multiple devices, thereby improving user experience.

In some implementations, the processing device is connected to at least one device or is in the same connection network. When the processing device outputs a processing request, the processing device needs to determine the associated device from the at least one connected device. At this time, the processing device can according to Determine at least one associated device in response to the result, and/or preset information, and/or the data to be processed, and/or scene information, and/or operation information. Optionally, when the operation information is the operation of selecting the sending device, such as clicking the position of the icon corresponding to the TV displayed on the current interface of the processing device, it is determined that the TV is an associated device; another example, in a smart home environment, the user will process the device ( For example, when a mobile phone is pointed at a refrigerator, it is determined that the refrigerator is an associated device; another example, when the response result is an audio file, the smart speaker is determined to be an associated device according to the matching relationship between the audio file and the smart speaker; another example, in a smart home environment , when the data to be processed is to turn on the air conditioner, it is determined that the air conditioner is the associated device.

Optionally, the step S20 includes:

In some scenarios, there may be only one device associated with the processing device, or there may be multiple devices. Taking the processing device as an example, the user’s mobile phone may only be associated with the TV at home, or it may be associated with both the TV at home and the Devices such as air conditioners and smart speakers in the home are associated. In addition, the associated device may have only one application or service, or may have multiple applications or services. In this case, the target application or target service needs to be determined according to the actual situation. Optionally, when there is only one associated device and the associated device has multiple applications or services, information such as functions and/or applications required to respond to the processing request may be combined with the information of the multiple associated devices The application or service is matched, and the application or service that can respond to the processing request is determined as the target application or target service. In the case of multiple associated devices, at least one target device can be determined based on the number of times of use, remaining power level, operating status, processing capability, etc., and then the at least one target device that can respond to the processing request The application or service of is determined as the target application or target service. Optionally, if there are multiple associated devices, the associated device with the most usage times, and/or the most remaining power, and/or the operating state is not running, and/or the strongest processing capability may be determined as the target The device then determines the target application or target service from the target device based on information such as functions and/or applications required to process the request. In addition, the second target application or target service may also be determined by the user according to the target application or target service selected in the output candidate application or service interface.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 6 below.

Table 6

Optionally, the processing of the first target application or target service according to a first preset strategy includes at least one of the following: controlling the first target application or target service to close or hide or freeze or hibernate; responding Controlling the first target application or target service to output a feedback message based on a response result of the second target application or target service to the processing request;

And/or, the processing of the second target application or target service according to a second preset strategy includes at least one of the following: controlling the second target application or target service to respond to the processing request; controlling the The second target application or target service delays responding to the processing request; controlling the second target application or target service to respond to the processing request, and sending a response result to the first target application or target service.

Optionally, if both the first target application or target service and the second target application or target service can fully respond to the processing request, the first target application or target service and the second target application or service may be controlled to The corresponding application or service in the preset scene or preset mode in the target application or target service responds to the processing request; if both the first target application or target service and the second target application or target service need to respond to the processing request, or both the first target application or target service and the second target application or target service can improve the interaction effect in response to the processing request, then control the first target application or target service and the second target application The target application or target service respectively responds to the processing request, or splits the data to be processed corresponding to the processing request, and determines at least one first data processed by the first target application or target service and at least one piece of data processed by the first target application or target service. At least one second data processed by two target applications or target services to control said first target application or target service to respond to said at least one first data and said second target application or target service to respond to said at least one second data data. In addition, a prompt message may also be output, and in response to the selection operation, control the selected corresponding application or service to respond to the processing request.

Optionally, the preset scene and the preset mode can be set according to actual needs, for example, the preset scene can be a work scene, a meeting scene, an entertainment scene, a game scene, a driving scene, a navigation scene, an outdoor scene , currently unprocessed data or interconnection scenarios, etc., the preset mode may be foreground operation mode, background operation mode, interactive mode, mobile operator network mode, wireless network mode, power saving mode, hands-free mode, etc. Optionally, it is assumed that the processing request is the voice input by the user in the vehicle, "play the song Dahai", and the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone in the vehicle are both Can respond to the processing request, if the human-computer interaction application of A is providing navigation services, it can control the human-computer interaction application of B to respond to the processing request, so that the car and the machine can play the song Dahai, or, if the human-computer interaction application of B and A No human-computer interaction application currently processes data, and the human-computer interaction application A and B can be controlled to respond to the processing request respectively, so that both the mobile phone and the car machine play the song Dahai, thereby enhancing the song playback effect.

Ninth embodiment

Fig. 24 is a schematic flowchart of a processing method for an application or service according to the ninth embodiment. As shown in Figure 24, the application or service processing method of this application is applied to a processing device, including:

Optionally, the processing device may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.). Optionally, the application or service may include a human-computer interaction application, and the human-computer interaction application includes an application or service that can perform human-computer interaction through touch operations, voice, touch gestures, air gestures, etc. (such as smart assistants, etc.), Other similar applications or services are also possible. The first target application or target service and/or the second target application or target service may be set on the processing device and/or other devices (such as an associated device of the processing device, etc.). Optionally, the target application or target service includes at least one of voice assistant applications, social media applications, information content applications, tool applications, and system services. Optionally, the first target application or target service and the second target application or target service may be the same or different applications or services, or may be the same type or different types of applications or services.

Through the above method, after obtaining the preset operation, wake up or run at least one target application or target service first, and then process the target application or target service, which can improve the accuracy and accuracy of the data response to be processed after obtaining the preset operation. / Or improve the interaction effect and enhance the user experience.

Optionally, in a home scenario, for example, the user inputs the voice "Order a crayfish at Meituan, watch a movie to fight crime", then wake up or run the A human-computer interaction application set on the mobile phone to order an order at Meituan Crayfish, and wake up or run the B human-computer interaction application set on the TV to open the movie anti-crime, and output the response result "I have purchased a crayfish" in the A human-computer interaction application and the B human-computer interaction application output the response result "" When "Movie Sweepstakes" is turned on, close the human-computer interaction application A and the human-computer interaction application B.

Optionally, before waking up or running at least one first target application or target service, and/or, before at least one second target application or target service, further includes:

In response to acquiring the data to be processed, determine at least one piece of processing information, and determine a first target application or target service according to the at least one piece of processing information; and/or,

The acquisition of the data to be processed by the processing device may be that the processing device receives the data to be processed input by the user, or it may be that the processing device receives the processed data sent by other devices. The data to be processed includes, but is not limited to: voice data, touch or air gesture data, body movement data, or data after processing these data, for example, it may be a control instruction obtained after processing voice data. The acquired operations include, but are not limited to: gesture operations, voice operations, and the like. The preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, etc., and the historical usage information may include historical usage times, historical usage time, Historical use location, etc., the device information may include device identity information (such as master device and slave device, or control center and non-control center, etc.), and/or remaining power information, and/or remaining network traffic, and/or network Status, etc.; the permission information includes but not limited to: priority, callable applications or services, etc.; the location type includes but not limited to closed environment (such as room, vehicle, etc.) and/or open environment (such as room outside, playground, etc.), etc. The scene information may include at least one of the following information: location type, time information, number of users, user identity, scene image, etc., and the time information includes but is not limited to: current specific date, and/or specific time period, etc. , the number of users may refer to the number of users located near the processing device and/or associated devices, the user identity may refer to age type, gender, occupation type, etc., and the scene image may refer to the current Images of people and/or objects in the scene, based on which information such as the user's gaze direction and/or gesture direction can be known. The source information of the data to be processed includes, but is not limited to: the time and location of obtaining the data to be processed, information about a device that obtains or outputs the data to be processed, and the like. The relevant information of the data to be processed includes, but is not limited to: required functions, and/or applications, and/or response speed, and/or accuracy, and/or privacy level, and the like.

Optionally, since the data to be processed contains the purpose or function that the user wants to achieve, at least one piece of processing information can be determined by parsing the relevant information of the data to be processed, and the processing information can include the applications, and/or services, and/or functions, and/or processing objects, and/or associated devices, and/or processing device information, etc., and according to the at least one processing information, it can be determined to respond to the pending A first target application or target service that processes the data. Optionally, based on information such as the number of times each application or service is used, whether the supported function information can respond to the data to be processed, whether the usage scenario matches the current scenario, whether the running status is running or not running, and other information, from at least two applications or determine the first target application or target service in the service. Assume that the data to be processed is the voice "Please play the song Motherland" input by the user in the vehicle, and the vehicle includes the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone. If the user's historical usage habits determine that the user prefers to use the human-computer interaction application A in the current scenario, then the human-computer interaction application A can be determined as the first target application; or, if the human-computer interaction application A is in the In the running state, if the B human-computer interaction application is not running, then the B human-computer interaction application can be determined as the first target application; The machine-interactive application is determined as the first target application.

In addition, since the first target application or target service may not be able to directly and completely respond to the data to be processed, at this time, further cooperation with the second target application or target service may be required to fully respond to the data to be processed. Optionally, taking the processing device as an in-vehicle device as an example, assuming that the data to be processed is the voice input by the user "Please call Xiao Li" and the human-computer interaction application A installed in the in-vehicle device supports the dialing function, Then the human-computer interaction application A can be determined as the first target application or target service. If Xiao Li’s phone number is not stored in the car, the human-computer interaction application A cannot make a call to Xiao Li normally. At this time, the The human-computer interaction application B that is set in the mobile phone and supports invoking contact information is determined as the second target application or target service. Based on the response result, it can be determined that at least one second application or service participates in control, processing and decision-making, further improving data security and interaction effect.

Optionally, the step S100 includes at least one of the following: sequentially waking up the first target application or target service and/or the second target application or target service according to the priority order of the applications or services; The first target application or target service and the second target application or target service; sequentially run the first target application or target service and/or the second target application or target service based on the wake-up time sequence of the applications or services ; Running the first target application or target service and/or the second target application or target service sequentially based on the network status of the device where the application or service is located.

Optionally, it is assumed that the first target application or target service includes human-computer interaction application A, and the second target application or target service includes human-computer interaction application B, if the priority or trust level of human-computer interaction application A is high Depending on the priority or trust level of the human-computer interaction application B, the human-computer interaction application A can be awakened first, and then the human-computer interaction application B can be awakened; and/or, if the distance between the device where the human-computer interaction application A is located and the processing device is less than the distance between the device where the human-computer interaction application B is located and the processing device, the human-computer interaction application A can be woken up first, and then the human-computer interaction application B can be woken up; and/or, if the human-computer interaction application A is in the wake-up state and the person B If the machine-computer interaction application is not awakened, you can run the A human-computer interaction application first, and then run the B human-computer interaction application; and/or, if the network status of the device where the B human-computer interaction application is located is better than that of the device where the A human-computer interaction application is located network status, the human-computer interaction application A can be woken up first, and then the human-computer interaction application B can be woken up.

Optionally, the management request may include a request type, and the request type includes at least one of an authorization request, an assistance request, and a control request. For example, when the processing device receives the data to be processed, it outputs to the associated device an assistance request for selecting a target application or a target service that responds to the data to be processed. Of course, the processing device may also output a prompt message for prompting whether the first target application or target service and/or the second target application or target service should respond, and respond to the selection operation to control the selected A target application or target service or the second target application or target service responds. Optionally, it is assumed that when the user inputs the voice "I want to listen to a song" to the processing device, the A human-computer interaction application set on the first device and the B human-computer interaction application set on the second device are both awakened or run , if the user continues to input the voice used to start playing the song, a management request can be sent to the associated device associated with the processing device to request whether to choose whether to play the song by the A human-computer interaction application or the B human-computer interaction application, and after receiving the associated device After the feedback information is sent, the human-computer interaction application that does not play the song is closed or exited based on the feedback information.

Optionally, before the step S100, it includes: determining at least one application or service management center. Further, before the step S100, the method may further include: if the processing device is a control center, determining at least one application or service management center according to a preset determination strategy.

Optionally, the step S200 further includes: displaying in the application or service management center a first preset interface respectively corresponding to the first target application or target service and/or corresponding to the second target application or The second preset interface corresponding to the target service. Wherein, the first preset interface and/or the second preset interface may display the human-computer interaction interface of the target application or target service in the form of pop-up windows, floating windows, cards, embedding, etc. in the interface of the application or service management center , the human-computer interaction interface is used to display the data to be processed and/or response results. Optionally, when the data to be processed requires simultaneous response processing by the first application of the processing device and the second application of the associated device, the interface of the application or service management center displays the first application corresponding to the human-computer interaction interface of the first application. A card and a second card corresponding to the human-computer interaction interface of the second application, so that the first card and the second card can dynamically display the response results of the data to be processed by the first application and the second application. For example, when the acquired data to be processed is that the user issues a voice command to the mobile phone "Please play the song 'Chengdu' with the speaker at the same time", at this time, the interface of the voice assistant management center in the mobile phone will display the interactive interface of the mobile phone voice assistant in the form of a card at the same time The interactive interface with the voice assistant of the speaker, in which the interactive interface of the voice assistant of the mobile phone displays "The following versions of "Chengdu" have been found for you, which version do you want to listen to?" The interactive interface of the voice assistant of the speaker displays "OK, I will play it for you soon "Chengdu" by Zhao Lei".

Optionally, the preset policy includes: if the first target application or target service and the second target application or target service belong to the same device, then process according to the first preset policy; and/or , if the first target application or target service and the second target application or target service do not belong to the same device, perform processing according to a second preset policy.

Optionally, the processing according to the first preset policy includes at least one of the following: exiting the first target application or target service and/or the second target application or target service according to the first exit policy; The first output policy outputs a response result corresponding to the first target application or target service and/or the second target application or target service;

And/or, the processing according to the second preset policy includes at least one of the following: exiting the first target application or target service and/or the second target application or target service according to the second exit policy; The second output policy outputs a response result corresponding to the first target application or target service and/or the second target application or target service.

Optionally, it is assumed that the first target application or target service includes A human-computer interaction application, and the second target application or target service includes B human-computer interaction application, if the content of the response result of A human-computer interaction application is a picture , and the content of the response result of the human-computer interaction application B is audio, the response result of the human-computer interaction application A can be output first, and then the response result of the human-computer interaction application B; If the power is lower than the remaining power of the device where the A human-computer interaction application is located, you can first exit the B human-computer interaction application, and then exit the A human-computer interaction application.

Optionally, the step S200 further includes: in response to receiving the response information sent by the first target application or target service and/or the second target application or target service, outputting the Response message.

Here, the processing device may serve as a control center to control the target application or target service to respond to the data to be processed, and to control the output of response information of the target application or target service to the data to be processed. The preset output strategy can be set according to actual needs, such as simultaneous output or sequential output. Certainly, the processing device may also control the target application or target service to output response information according to a preset output policy. Optionally, the outputting the response information according to the preset output strategy includes at least one of the following: according to the order of receiving time, and/or the priority order of the target application or target service, and/or the current scene, And/or the received operation information, and/or the device corresponding to the response information, outputs the response information, and/or outputs the processed response information.

Optionally, in actual implementation, combination judgments may also be made according to actual conditions, as shown in Table 7 below.

Table 7

是否组合 Whether to combine	接收时间先后顺序 Receiving chronological order	优先级顺序 priority order	当前场景 current scene	接收的操作信息 received operational information	响应信息对应的设备 The device corresponding to the response information
组合示例1 Combination Example 1	是 yes	否 no	是 yes	否 no	否 no
组合示例2 Combination example 2	否 no	是 yes	是 yes	否 no	否 no
组合示例3 Combination example 3	是 yes	否 no	是 yes	是 yes	否 no
…… ...	…… ...	…… ...	…… ...	…… ...	…… ...

Optionally, assuming that the processing device receives the response information sent by the human-computer interaction application A and the human-computer interaction application B respectively, if the response information sent by the human-computer interaction application A is received earlier than the response information sent by the human-computer interaction application B information, you can first output the response information sent by the human-computer interaction application of A, and then output the response information sent by the human-computer interaction application of B; if the current scene of the processing device is a scene with multiple people and the response information involves privacy information, the response information may be processed and then output. For example, the response information in audio form may be converted into response information in text form, and then the response information in text form may be output.

The present application also provides a device, which includes: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the above-mentioned application or service processing method is implemented. step.

The present application also provides a computer storage medium, which is characterized in that a computer program is stored on the computer storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned application or service processing method are implemented.

The embodiment of the present application also provides a computer program product, the computer program product includes computer program code, when the computer program code runs on the computer, the computer executes the application or application described in the various possible implementation modes above. The processing method of the service.

The embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the computer installed with the chip The device executes the processing method of the application or service described in the above various possible implementation manners.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.

In this application, descriptions of the same or similar terms, concepts, technical solutions and/or application scenarios are generally only described in detail when they appear for the first time, and when they appear repeatedly later, for the sake of brevity, they are generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions and/or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

In this application, the description of each embodiment has its own emphasis. For the parts that are not detailed or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

The various technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, all It should be regarded as the scope described in this application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the essence of the technical solution of this application or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in the above storage medium (such as ROM/RAM, magnetic CD, CD), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) execute the method of each embodiment of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. coaxial cable, optical fiber, digital subscriber line) or wirelessly (eg, infrared, wireless, microwave, etc.) to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Usable media may be magnetic media (eg, floppy disk, memory disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Industrial Applicability

The processing method, device, and storage medium of the application or service of this application, after obtaining the data to be processed, improve the accuracy of the response to the data to be processed and/or improve the interaction effect, or, after obtaining the information to be processed, the first Processing by an application or service and/or a second application or service can improve data security and/or interaction effects and improve user experience when using the application or service.

Claims

A processing method for an application or service, which is applied to a processing device, comprising:

Step S01: Responding to the currently awakened or running first application or service acquiring information to be processed, detecting whether the first application or service meets processing conditions;

Step S02: According to the detection result, process the first application or service and the second application or service based on a preset policy.
The method according to claim 1, wherein the meeting the processing conditions includes at least one of the following:

Being in a preset scene; being in a preset mode; having preset permissions; supporting the functions to be realized by the information to be processed; allowing the functions required to use the information to be processed; being in the scene associated with the information to be processed and / or pattern.
The method according to claim 2, wherein the meeting the processing conditions includes being in a scene and/or mode associated with the information to be processed, and the step S01 includes: determining the key in response to obtaining the information to be processed Information; detecting whether the currently awakened or running first application or service is in a scene and/or mode associated with the information to be processed according to the key information.
The method according to claim 1, wherein said step S02 comprises:

If the first application or service does not meet the processing conditions, then process the first application or service and/or the second application or service according to a first preset policy; and/or,

If the first application or service meets the processing condition, the first application or service and/or the second application or service are processed according to a second preset policy.
The method according to claim 1, wherein the step S02 includes:

outputting prompt information if the first application or service does not meet the processing conditions;

In response to a selection operation, processing a corresponding application or service among the first application or service and the second application or service according to the selection result; and/or,

In response to not responding to the prompt information, the first application or service and/or the second application or service are processed according to a first preset policy.
The method according to claim 4 or 5, wherein processing the first application or service according to a first preset strategy includes at least one of the following:

controlling the first application or service to process part of the information to be processed;

controlling the first application or service not to process the pending information;

Outputting information for prompting whether to process the information to be processed by the first application or service;

In response to a first preset operation, controlling the first application or service to process the information to be processed;

Delay processing the information to be processed; and/or, after the first application or service meets the processing condition, control the first application or service to process the information to be processed;

And/or, processing the second application or service according to the first preset strategy includes at least one of the following:

wake up or run the second application or service;

controlling the second application or service to process at least a part of the information to be processed;

Outputting information for prompting whether to process the information to be processed by the second application or service;

In response to a second preset operation, controlling the second application or service to process the information to be processed;

controlling the second application or service to process at least a part of the information to be processed, and sending a processing result to the first application or service;

And/or, processing the first application or service and the second application or service according to a first preset strategy includes at least one of the following:

controlling the first application or service to process part of the information to be processed, sending a processing result to the second application or service, and controlling the second application or service to output feedback information;

Controlling the first application or service to process at least a part of the information to be processed and sending the processing result to the second application or service, controlling the second application or service to the first application or service Process the results and output feedback information;

Controlling the second application or service to process at least a part of the information to be processed, sending a processing result to the first application or service, and controlling the first application or service to output feedback information.
The method according to claim 4 or 5, wherein processing the first application or service according to a second preset strategy includes at least one of the following:

controlling the first application or service to start processing at least a part of the information to be processed;

controlling the first application or service to process at least a part of the information to be processed within a preset time period;

In response to a first preset operation, controlling the first application or service to process the information to be processed;

controlling the first application or service to process the information to be processed according to the current scenario or mode;

Output processing results;

And/or, processing the second application or service according to a second preset strategy includes at least one of the following:

controlling the second application or service to sleep or exit the second application or service;

Outputting information for prompting whether the second application or service processes part of the information to be processed;

In response to a second preset operation, controlling the second application or service to process part of the information to be processed;

And/or, processing the first application or service and the second application or service according to a second preset strategy includes at least one of the following:

controlling the first application or service to process the information to be processed, sending a processing result to the second application or service, and controlling the second application or service to output feedback information;

controlling the first application or service to process the information to be processed and sending the processing result to the second application or service, controlling the second application or service to process the processing result of the first application or service and Output feedback information;

The second application or service is controlled to process part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output the processing result.
The method according to any one of claims 1 to 5, wherein processing the first application or service based on a preset policy includes: controlling the first application or service to process the information to be processed Part of the information in;

The step S02 also includes:

Before processing the first application or service and/or the second application or service based on a preset strategy, the information to be processed is split to determine part of the information to be processed by the first application or service.
The method according to any one of claims 1 to 5, wherein the step S02 includes:

Step S02a: Determine the first processing result according to the detection result;

Step S02b: Outputting at least one prompt message on the processing device or associated device in response to the first processing result meeting a preset condition;

Step S02c: In response to the preset operation, perform preset processing on the first application or service according to a preset policy and/or a second processing result.
The method according to claim 9, wherein the meeting the preset conditions includes at least one of the following:

The processing device is not a control center; there is an associated device;

The first application or service does not support the function to be realized by the information to be processed;

The first application or service supports some functions to be realized by the information to be processed;

At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions;

There is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
The method according to claim 9, wherein the preset processing includes at least one of the following:

Hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
The method according to claim 11, wherein the step S02c includes at least one of the following:

The second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;

The second processing result is a processing result of the second application or service outputting a part of the information to be processed, and controlling the first application or service to determine or generate at least one associated third application or service to process the Another part of the processing results of the information to be processed;

The second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;

If the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service;

And/or, performing preset processing on the first application or service according to a preset strategy includes at least one of the following:

According to the control instruction generated by the preset operation, perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernating the first application or service;

When the first application or service supports some functions to be realized by the information to be processed, controlling the first application or service to determine or generate at least one associated third application or service to support another function to be realized by the information to be processed some functions;

Closing or hiding or freezing or hibernating the first application or service when at least one of the power, scene or mode, and running state of the processing device does not meet the conditions.
The method according to any one of claims 1 to 5, characterized in that, after the step S02, further comprising:

Step S03: Determine whether the processing result matches the processing condition;

Step S04: If not, output information for prompting to update the processing condition.
The method according to claim 13, wherein the step S03 includes at least one of the following:

Determine whether the processing result matches the processing condition according to the source application or service of the processing result;

determining whether the processing result matches the processing condition according to the function realized by the processing result;

Determine whether the processing result matches the processing condition according to the authority used by the processing result.
A processing method for an application or service, which is applied to a processing device, comprising:

Step S010: in response to acquiring the information to be processed, process the first application or service according to a first preset policy;

Step S020: According to the processing result and/or whether the first preset operation meets the preset condition, process the second application or service based on the second preset policy.
The method according to claim 15, wherein the meeting preset conditions includes at least one of the following:

The processing result matches the functions and/or permissions allowed by the second application or service;

The processing result is a result to be output or a result to be filtered;

The first preset operation is a preset operation allowing the second application or service to process the processing result;

The processing result does not match the functions and/or permissions allowed by the second application or service, and the first preset operation is a preset operation that allows the second application or service to process the processing result;

The processing result is not a result to be output or a result to be filtered, and the first preset operation is a preset operation allowing the second application or service to process the processing result.
The method according to claim 15, wherein the step S010 includes:

In response to obtaining the information to be processed, detecting whether the first application or service meets processing conditions;

According to the detection result, the first application or service is processed based on a first preset policy.
The method according to claim 17, wherein the meeting the processing conditions comprises:

Being in a preset scene; being in a preset mode; having preset permissions; supporting the functions to be realized by the information to be processed; allowing the functions required to use the information to be processed; being in the scene associated with the information to be processed and / or pattern.
The method according to claim 17, characterized in that, after the step S020, further comprising:

Step S030: Determine whether the processing result matches the processing condition and/or the preset condition;

Step S040: If not, output information for prompting to update the processing condition and/or the preset condition.
The method according to claim 19, wherein the step S030 includes at least one of the following:

Determine whether the processing result matches the processing condition and/or the preset condition according to the source application or service of the processing result;

determining whether the processing result matches the processing condition and/or the preset condition according to the function realized by the processing result;

Determine whether the processing result matches the processing condition and/or the preset condition according to the authority used by the processing result.
The method according to any one of claims 15 to 20, wherein the processing of the first application or service according to a first preset strategy includes at least one of the following:

wake up or run the first application or service;

controlling the first application or service to process part of the information to be processed;

controlling the first application or service not to process the pending information;

Outputting information for prompting whether to process the information to be processed by the first application or service;

In response to a second preset operation, controlling the first application or service to process the information to be processed;

controlling the first application or service to start processing at least a part of the information to be processed;

controlling the first application or service to process at least a part of the information to be processed within a preset time period;

Controlling the first application or service to process the information to be processed according to the current scenario or mode.
The method according to any one of claims 15 to 20, wherein the processing the first application or service according to a first preset policy comprises: controlling the first application or service processing Describe part of the information to be processed;

The step S010 further includes: before processing the first application or service according to a first preset strategy, splitting the information to be processed to determine part of the information to be processed by the first application or service.
The method according to any one of claims 15 to 20, wherein the step S020 includes at least one of the following:

waking up or running the second application or service in response to the processing result meeting the preset condition;

outputting information for prompting whether the information to be processed is to be processed by the second application or service in response to the processing result meeting the preset condition;

In response to the processing result meeting the preset condition, controlling the second application or service to process the processing result of the first application or service and output feedback information;

In response to the first preset operation meeting a preset condition, controlling the second application or service to process at least a part of the information to be processed;

In response to the first preset operation meeting a preset condition, controlling the second application or service to process at least a part of the information to be processed, and sending a processing result to the first application or service;

In response to the first preset operation meeting a preset condition, the second application or service is controlled to output a processing result.
A processing method for an application or service, which is applied to a processing device, comprising:

Step S0100: Outputting at least one prompt message in response to the first application or service acquiring information to be processed;

Step S0200: In response to a preset operation, process the first application or service according to a first preset policy; and process at least one second application or service according to a second preset policy.
The method according to claim 24, wherein the step S0100 includes: determining key information in response to the first application or service acquiring information to be processed; and outputting at least one prompt message according to the key information.
The method according to claim 25, wherein the key information includes the location of the processing object of the information to be processed, the location where the information to be processed is triggered, the time when the information to be processed is triggered, the processing The time of the information to be processed, the source application of the information to be processed, the target application of the information to be processed, the functions required to be used by the information to be processed, and the permissions required to be used by the information to be processed at least one;

The step S0100 includes at least one of the following: outputting prompt information whether the first application or service meets processing conditions; outputting prompt information for selecting an application or service.
The method according to claim 26, wherein the meeting the processing conditions includes at least one of the following:

Being in a preset scene; being in a preset mode; having preset permissions; supporting the functions to be realized by the information to be processed; allowing the functions required to use the information to be processed; being in the scene associated with the information to be processed and / or pattern.
The method according to claim 26, wherein the step S0100 includes:

Outputting prompt information indicating whether the first application or service meets processing conditions;

After the step S0200, it also includes:

Step S0300: Determine whether the processing result matches the processing condition;

Step S0400: If not, output information for prompting to update the processing condition.
The method according to claim 28, wherein the step S0300 includes at least one of the following:

Determine whether the processing result matches the processing condition according to the source application or service of the processing result;

determining whether the processing result matches the processing condition according to the function realized by the processing result;

Determine whether the processing result matches the processing condition according to the authority used by the processing result.
The method according to any one of claims 24 to 29, wherein the processing of the first application or service according to a first preset strategy includes at least one of the following:

controlling the first application or service to process part of the information to be processed;

controlling the first application or service not to process the pending information;

Outputting information for prompting whether to process the information to be processed by the first application or service;

In response to a first preset operation, controlling the first application or service to process the information to be processed;

Delay processing the information to be processed; and/or, after the first application or service meets processing conditions, control the first application or service to process the information to be processed;

And/or, processing the second application or service according to a second preset strategy includes at least one of the following:

wake up or run the second application or service;

controlling the second application or service to process at least a part of the information to be processed;

Outputting information for prompting whether to process the information to be processed by the second application or service;

In response to a second preset operation, controlling the second application or service to process the information to be processed;

controlling the second application or service to process at least a part of the information to be processed, and sending the processing result to the first application or service; and/or, the first preset policy according to the first Processing by an application or service, and processing the second application or service according to a second preset strategy includes at least one of the following:

controlling the first application or service to process part of the information to be processed, sending a processing result to the second application or service, and controlling the second application or service to output feedback information;

Controlling the first application or service to process at least part of the information to be processed and sending the processing result to the second application or service, controlling the second application or service to the first application or service Process the results and output feedback information;

Controlling the second application or service to process at least a part of the information to be processed, sending a processing result to the first application or service, and controlling the first application or service to output feedback information.
The method according to any one of claims 24 to 29, wherein the step S0200 includes:

Step S0200a: In response to a preset operation, the first application or service determines a first processing result based on the information to be processed;

Step S0200b: In response to the first processing result meeting a preset condition, perform preset processing on the first application or service according to a second processing result.
The method according to claim 31, wherein the meeting the preset conditions includes at least one of the following:

The processing device is not a control center; there is an associated device;

The first application or service does not support the function to be realized by the information to be processed;

The first application or service supports some functions to be realized by the information to be processed;

At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions;

There is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
The method according to claim 32, wherein the preset processing includes at least one of the following:

Hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
The method according to claim 33, wherein the step S0200b includes at least one of the following:

The second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;

The second processing result is a processing result of the second application or service outputting a part of the information to be processed, and controlling the first application or service to determine or generate at least one associated third application or service to process the Another part of the processing results of the information to be processed;

The second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;

If the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service.
A processing method for an application or service, which is applied to a processing device, comprising:

Step S01000: output at least one prompt message on the processing device and/or associated device in response to the first processing result meeting the preset condition;

Step S02000: In response to the preset operation, perform preset processing on the first application or service according to the preset policy and/or the second processing result.
The method according to claim 35, wherein the meeting the preset conditions includes at least one of the following:

The processing device is not a control center; there is an associated device;

The first application or service does not support the function to be realized by the information to be processed;

The first application or service supports some functions to be realized by the information to be processed;

At least one of the power, scene or mode, and operating state of the processing device does not meet the conditions;

There is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
The method according to claim 35, wherein the step S01000 includes: determining key information in response to acquiring information to be processed; determining the first processing result according to the key information.
The method according to any one of claims 35 to 37, wherein the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting a pending Processing results of at least a portion of the processing information.
The method according to claim 38, wherein the preset processing for the first application or service according to the second processing result includes at least one of the following:

The second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;

The second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and the first application or service is controlled to determine or generate at least one associated third application or service to process the information to be processed Another part of the processing results of the information;

The second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;

If the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service;

And/or, performing preset processing on the first application or service according to a preset strategy includes at least one of the following:

According to the control instruction generated by the preset operation, perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernating the first application or service;

When the first application or service supports some functions to be realized by the information to be processed, controlling the first application or service to determine or generate at least one associated third application or service to support another function to be realized by the information to be processed some functions;

Closing or hiding or freezing or hibernating the first application or service when at least one of the power, scene or mode, and running state of the processing device does not meet the conditions.
A processing method for an application or service, applied to a processing device, characterized in that it includes:

Step S1: in response to obtaining the data to be processed, determine at least one target application or target service;

Step S2: In response to the target application or target service, perform corresponding processing according to a preset policy;

Wherein, the target application or target service includes at least one first target application or target service and at least one second target application or target service, and the step S2 includes at least one of the following:

If the first target application or target service and the second target application or target service belong to the same device, perform processing according to a first preset policy;

If the first target application or target service and the second target application or target service do not belong to the same device, processing is performed according to a second preset policy.
The method according to claim 40, wherein said step S1 comprises:

Step S11a: According to the acquired operation, and/or preset information, and/or scene information, and/or source information of the data to be processed, and/or related information of the data to be processed, and/or According to the response result of the data to be processed, at least one target application or target service is determined.
The method according to claim 41, wherein the step S1 includes:

If the processing device is not a control center, perform step S11a; and/or,

If the processing device is the control center, perform step S11b: determine whether there is an associated device, and if there is an associated device, determine at least one target application or target service from the associated device.
The method according to claim 42, wherein the determining at least one target application or target service from the associated device comprises at least one of the following:

If there is only one associated device, and the associated device has multiple applications or services, then determine the application or service that can respond to the data to be processed as the target application or target service;

If there are multiple associated devices, at least one target device is determined according to a preset rule, and an application or service in the at least one target device that can respond to the data to be processed is determined as a target application or a target service.
The method according to claim 43, wherein said determining at least one target device according to preset rules includes at least one of the following:

Taking the associated device whose physiological parameter information of the user satisfies the first preset condition as the target device;

Taking at least one associated device whose device system information satisfies a second preset condition as a target device;

Taking at least one associated device whose communication information of the device satisfies the third preset condition as the target device;

Taking at least one associated device whose device application information satisfies the fourth preset condition as a target device;

Taking at least one associated device whose device reminder information satisfies the fifth preset condition as the target device;

Taking at least one associated device whose device detection information satisfies the sixth preset condition as the target device;

Taking at least one associated device whose device state information satisfies the seventh preset condition as a target device;

At least one associated device whose device environment information satisfies the eighth preset condition is taken as the target device.
The method according to claim 41, wherein the step S11a includes: determining at least one processing information according to the relevant information of the data to be processed, and determining the first target application or a target service; and/or, in response to a response result of the first target application or target service to the data to be processed, determining a second target application or target service.
The method according to claim 41, wherein the step S11a includes:

obtain at least one processing information;

If there is only one processing information, determine at least one first application or service that can respond to the processing information, and determine a target application or target service from the at least one first application or service according to a first determination strategy; and /or,

If there are at least two processing information, determine at least one second application or service that can partially and/or completely respond to the processing information, and determine from the at least one second application or service according to a second determination strategy Target application or target service.
The method according to any one of claims 40 to 46, wherein the step S2 includes:

outputting the data to be processed, and/or the processing request obtained based on the data to be processed, and/or the response result obtained based on the data to be processed, to the target application or target service with a preset transmission strategy, to make the target application or target service respond.
The method according to any one of claims 40 to 46, wherein the processing according to the first preset strategy includes at least one of the following:

waking up the first target application or target service and/or the second target application or target service according to a first wakeup policy;

Executing the first target application or target service and/or the second target application or target service according to a first execution policy;

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a first output policy;

exiting the first target application or target service and/or the second target application or target service according to a first exit policy;

And/or, the processing according to the second preset strategy includes at least one of the following:

waking up the first target application or target service and/or the second target application or target service according to a second wakeup policy;

Executing the first target application or target service and/or the second target application or target service according to a second execution strategy;

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a second output policy;

Exiting the first target application or target service and/or the second target application or target service according to a second exit policy.
The method of claim 48, wherein,

The wake-up strategy includes at least one of the following: sequential wake-up based on the priority order of the application or service, sequential wake-up based on the distance from the processing device, and simultaneous wake-up; and/or,

The running strategy includes at least one of the following: running sequentially based on the wake-up time of the application or service, running sequentially based on the network status of the device where the application or service is located, and running simultaneously; and/or,

The output strategy includes at least one of the following: sequential output based on the priority order of the application or service, sequential output based on the content of the response result, and simultaneous output; and/or,

The exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit.
The method according to any one of claims 40 to 46, wherein the step S2 further comprises: in response to receiving the response information sent by the target application or target service, outputting the the above response information.
The method according to claim 50, wherein the outputting the response information according to a preset output strategy includes at least one of the following:

Outputting the response according to the receiving chronological order, and/or the priority order of the target application or target service, and/or the current scene, and/or the received operation information, and/or the device corresponding to the response information information.
A processing method for an application or service, applied to a processing device, characterized in that it includes:

Step S100: Responding to a first preset operation, wake up or run at least one first target application or target service, and/or at least one second target application or target service;

Step S200: In response to a second preset operation, perform preset processing on the first target application or target service and/or the second target application or target service according to a preset policy;

Wherein, the preset strategy includes:

If the first target application or target service and the second target application or target service belong to the same device, perform processing according to a first preset policy; and/or,

If the first target application or target service and the second target application or target service do not belong to the same device, processing is performed according to a second preset policy.
The method according to claim 52, wherein before waking up or running at least one first target application or target service, and/or, before at least one second target application or target service, further comprising:

In response to obtaining the data to be processed, determine at least one piece of processing information, and determine a first target application or target service according to the at least one piece of processing information; and/or, respond to the first target application or target service The response result of processing the data determines the second target application or target service.
The method according to claim 52, wherein the step S100 includes at least one of the following:

Awakening the first target application or target service and/or the second target application or target service sequentially according to the priority order of the applications or services; simultaneously waking up the first target application or target service and the second target application or target services;

Running the first target application or target service and/or the second target application or target service sequentially based on the wake-up time sequence of the applications or services;

Running the first target application or target service and/or the second target application or target service sequentially based on the network status of the device where the application or service is located.
The method according to any one of claims 52 to 54, characterized in that, the first target application or target service and/or the second target application or target service are preset according to a preset policy The processing includes at least one of the following: sending a management request to an associated device, and controlling corresponding applications or services in the first target application or target service and the second target application or target service according to feedback information from the associated device. Response; outputting a prompt message for prompting whether the first target application or target service and/or the second target application or target service responds.
The method according to any one of claims 52 to 54, wherein the processing according to the first preset strategy includes at least one of the following:

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a first output strategy;

exiting the first target application or target service and/or the second target application or target service according to a first exit policy;

And/or, the processing according to the second preset strategy includes at least one of the following:

Outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a second output policy;

Exiting the first target application or target service and/or the second target application or target service according to a second exit policy.
The method according to claim 56, wherein the output strategy includes at least one of the following: sequential output based on the priority order of applications or services, sequential output based on the content of the response results, and simultaneous output; and/or, The exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit.
The method according to any one of claims 52 to 54, wherein the step S200 includes:

In response to receiving the response information sent by the first target application or target service and/or the second target application or target service, output the response information according to a preset output policy.
The method according to claim 58, wherein the outputting the response information according to a preset output strategy includes at least one of the following: according to the order of receiving time, and/or the first target application or target service And/or the priority sequence of the second target application or target service, and/or the current scene, and/or the received operation information, and/or the device corresponding to the response information, output the response information.
A device, characterized in that the device comprises: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the computer program according to any one of claims 1 to 59 is implemented. Steps in the processing method for the application or service described above.
A computer storage medium, characterized in that a computer program is stored on the computer storage medium, and when the computer program is executed by a processor, the processing method of the application or service according to any one of claims 1 to 59 is realized A step of.