WO2022262298A1 - Procédé de traitement d'application ou de service, dispositif, et support de stockage - Google Patents

Procédé de traitement d'application ou de service, dispositif, et support de stockage Download PDF

Info

Publication number
WO2022262298A1
WO2022262298A1 PCT/CN2022/076123 CN2022076123W WO2022262298A1 WO 2022262298 A1 WO2022262298 A1 WO 2022262298A1 CN 2022076123 W CN2022076123 W CN 2022076123W WO 2022262298 A1 WO2022262298 A1 WO 2022262298A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
service
information
processing
processed
Prior art date
Application number
PCT/CN2022/076123
Other languages
English (en)
Chinese (zh)
Inventor
沈剑锋
汪智勇
李晨雄
Original Assignee
深圳传音控股股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110658632.7A external-priority patent/CN113114847B/zh
Priority claimed from CN202110706372.6A external-priority patent/CN113254092B/zh
Application filed by 深圳传音控股股份有限公司 filed Critical 深圳传音控股股份有限公司
Publication of WO2022262298A1 publication Critical patent/WO2022262298A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/4401—Bootstrapping

Definitions

  • the present application relates to the field of communication technologies, and in particular to an application or service processing method, device, and storage medium.
  • this application provides a processing method, device and storage medium for applications or services, which can improve the accuracy of the response to the data to be processed and/or improve the interaction effect after obtaining the data to be processed, or, after obtaining the data to be processed After the information is processed, processing the first application or service and/or the second application or service can improve data security and/or interaction effect and improve user experience when using the application or service.
  • the present application provides an application or service processing method applied to a processing device, including:
  • Step S1 in response to obtaining the data to be processed, determine at least one target application or target service;
  • Step S2 In response to the target application or target service, perform corresponding processing according to a preset policy.
  • step S1 includes:
  • Step S11a According to the acquired operation, and/or preset information, and/or scene information, and/or source information of the data to be processed, and/or related information of the data to be processed, and/or According to the response result of the data to be processed, at least one target application or target service is determined.
  • step S1 includes:
  • step S11a If the processing device is not a control center, perform step S11a; and/or,
  • step S11b determine whether there is an associated device, and if there is an associated device, determine at least one target application or target service from the associated device.
  • the determining at least one target application or target service from the associated device includes at least one of the following:
  • the application or service that can respond to the data to be processed is determined as the target application or target service; and/or,
  • At least one target device is determined according to a preset rule, and an application or service in the at least one target device that can respond to the data to be processed is determined as a target application or a target service.
  • the determining at least one target device according to preset rules includes at least one of the following:
  • At least one associated device whose device environment information satisfies the eighth preset condition is taken as the target device.
  • step S11a includes:
  • a second target application or target service is determined.
  • step S11a includes:
  • step S2 includes:
  • the target application or target service includes at least one first target application or target service and at least one second target application or target service
  • the step S2 includes at least one of the following:
  • first target application or target service and the second target application or target service belong to the same device, perform processing according to a first preset policy; and/or,
  • processing is performed according to a second preset policy.
  • processing according to the first preset strategy includes at least one of the following:
  • the processing according to the second preset strategy includes at least one of the following:
  • the wake-up strategy includes at least one of the following: sequential wake-up based on the priority of the application or service, sequential wake-up based on the distance from the device where the application or service is located, and simultaneous wake-up; and/or,
  • the running strategy includes at least one of the following: running sequentially based on the wake-up time of the application or service, running sequentially based on the network status of the device where the application or service is located, and running simultaneously; and/or,
  • the output strategy includes at least one of the following: sequential output based on the priority order of the application or service, sequential output based on the content of the response result, and simultaneous output; and/or,
  • the exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit.
  • the step S2 further includes: outputting the response information according to a preset output policy in response to receiving the response information sent by the target application or target service.
  • the outputting the response information according to a preset output strategy includes at least one of the following:
  • the present application provides an application or service processing method applied to a processing device, including:
  • Step S10 Responding to the processing request of the first target application or target service
  • Step S20 wake up or run the second target application or target service of the associated device
  • Step S30 In response to a preset operation, process the first target application or target service according to a first preset policy; and/or process the second target application or target service according to a second preset policy .
  • step S10 includes:
  • Step S110a In response to obtaining the data to be processed, according to the obtained operation, and/or preset information, and/or scene information, and/or source information of the data to be processed, and/or related information of the data to be processed, determine A first target application or target service.
  • step S10 includes:
  • step S110a If the processing device is not a control center, perform step S110a; and/or,
  • step S110b determine whether there is an associated device, and if there is an associated device, determine the first target application or target service from the associated device.
  • the step S110a includes: determining at least one piece of processing information according to the relevant information of the data to be processed; and determining a first target application or target service according to the at least one piece of processing information.
  • step S10 includes:
  • the first target application or target service meets the first preset condition in response to the received data to be processed, and/or the device where the first target application or target service is located meets the second preset condition, and/or the first target application or The response result of the target service does not satisfy the third preset condition, and/or the acquired operation information satisfies the fourth preset condition, and a processing request is sent.
  • step S20 it also includes:
  • the processing device determines at least one associated device.
  • step S20 includes:
  • At least one target device is determined according to preset rules, and an application or service in the at least one target device that can respond to the processing request is determined as a second target application or target service.
  • the determining at least one target device according to preset rules includes at least one of the following:
  • At least one associated device whose device environment information satisfies the eighth preset condition is taken as the target device.
  • the processing the first target application or target service according to a first preset strategy includes at least one of the following: controlling the first target application or target service to respond to the processing request; controlling the The first target application or target service is closed or hidden or frozen or dormant; in response to a response result of the second target application or target service to the processing request, controlling the first target application or target service to output a feedback message;
  • the processing of the second target application or target service according to a second preset strategy includes at least one of the following: controlling the second target application or target service not to respond to the processing request; The second target application or target service delays responding to the processing request; controlling the second target application or target service to respond to the processing request, and sending a response result to the first target application or target service.
  • the present application provides an application or service processing method applied to a processing device, including:
  • Step S100 Responding to a first preset operation, wake up or run at least one first target application or target service, and/or at least one second target application or target service;
  • Step S200 In response to a second preset operation, perform preset processing on the first target application or target service and/or the second target application or target service according to a preset policy.
  • waking up or running at least one first target application or target service and/or, before at least one second target application or target service, further includes: determining at least one piece of processing information in response to acquiring data to be processed , and determine a first target application or target service according to the at least one processing information; and/or, in response to a response result of the first target application or target service to the data to be processed, determine a second target application or target Serve.
  • the step S100 includes at least one of the following:
  • the preset processing of the first target application or target service and/or the second target application or target service according to a preset strategy includes at least one of the following:
  • the preset strategy includes:
  • first target application or target service and the second target application or target service belong to the same device, perform processing according to a first preset policy; and/or,
  • processing is performed according to a second preset policy.
  • processing according to the first preset strategy includes at least one of the following:
  • the processing according to the second preset strategy includes at least one of the following:
  • the exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit; and/or,
  • the output strategy includes at least one of the following: sequential output based on the priority order of applications or services, sequential output based on content of response results, and simultaneous output.
  • step S200 also includes:
  • the outputting the response information according to a preset output strategy includes at least one of the following:
  • the device corresponding to the response information According to the received chronological order, and/or the priority order of the first target application or target service and/or the second target application or target service, and/or the current scene, and/or the received operation information, and /or the device corresponding to the response information outputs the response information.
  • the present application provides an application or service processing method applied to a processing device, including:
  • Step S01 In response to acquiring information to be processed, detecting whether the currently awakened or running first application or service meets processing conditions;
  • Step S02 according to the detection result, process the first application or service and/or the second application or service based on a preset policy.
  • the meeting the treatment conditions includes at least one of the following:
  • the meeting the processing conditions includes being in a scene and/or mode associated with the information to be processed
  • the step S01 includes: determining key information in response to obtaining the information to be processed; detecting the current Whether the awakened or running first application or service is in a scene and/or mode associated with the information to be processed.
  • the key information includes at least one of a location of a processing object of the information to be processed, a trigger location, a processing time, a source application, and a target application.
  • step S02 includes:
  • first application or service does not meet the processing conditions, then process the first application or service and/or the second application or service according to a first preset policy; and/or,
  • the first application or service and/or the second application or service are processed according to a second preset policy.
  • step S02 includes:
  • the first application or service and/or the second application or service are processed according to a first preset policy.
  • processing the first application or service according to a first preset strategy includes at least one of the following:
  • controlling the first application or service to process the information to be processed In response to a first preset operation, controlling the first application or service to process the information to be processed;
  • processing the second application or service according to the first preset strategy includes at least one of the following:
  • controlling the second application or service to process at least a part of the information to be processed, and sending a processing result to the first application or service;
  • processing the first application or service and the second application or service according to a first preset strategy includes at least one of the following:
  • processing the first application or service according to a second preset strategy includes at least one of the following:
  • controlling the first application or service to process the information to be processed In response to a first preset operation, controlling the first application or service to process the information to be processed;
  • processing the second application or service according to a second preset strategy includes at least one of the following:
  • processing the first application or service and the second application or service according to a second preset strategy includes at least one of the following:
  • the second application or service is controlled to process part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output the processing result.
  • processing the first application or service based on a preset strategy includes:
  • the step S02 further includes: before processing the first application or service and/or the second application or service based on a preset policy, splitting the information to be processed, and determining that the information to be processed is determined by the first application or service Some information processed by the service.
  • step S02 includes:
  • Step S02a Determine the first processing result according to the detection result
  • Step S02b Outputting at least one prompt message on the processing device or associated device in response to the first processing result meeting a preset condition
  • Step S02c In response to the preset operation, perform preset processing on the first application or service according to a preset policy and/or a second processing result, optionally, the second processing result is determined by the At least one second application or service is obtained.
  • the meeting preset conditions includes at least one of the following:
  • the processing device is not a control center; there is an associated device;
  • the first application or service does not support the function to be realized by the information to be processed
  • the first application or service supports some functions to be realized by the information to be processed
  • At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions
  • the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
  • the preset processing includes at least one of the following:
  • step S02c includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is a processing result of the second application or service outputting a part of the information to be processed, and controlling the first application or service to determine or generate at least one associated third application or service to process the Another part of the processing results of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service;
  • performing preset processing on the first application or service according to a preset strategy includes at least one of the following:
  • control instruction generated by the preset operation perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernating the first application or service;
  • controlling the first application or service to determine or generate at least one associated third application or service to support another function to be realized by the information to be processed some functions;
  • Step S02 further include: Step S03: Determine whether the processing result matches the processing condition; Step S04: If not, output information for prompting to update the processing condition.
  • the step S03 includes at least one of the following:
  • the present application provides an application or service processing method applied to a processing device, including:
  • Step S010 in response to acquiring the information to be processed, process the first application or service according to a first preset policy;
  • Step S020 According to the processing result and/or whether the first preset operation meets the preset condition, process the second application or service based on the second preset policy.
  • the meeting the preset conditions includes at least one of the following:
  • the processing result matches the functions and/or permissions allowed by the second application or service
  • the processing result is a result to be output or a result to be filtered
  • the first preset operation is a preset operation allowing the second application or service to process the processing result
  • the processing result does not match the functions and/or permissions allowed by the second application or service, and the first preset operation is a preset operation that allows the second application or service to process the processing result;
  • the processing result is not a result to be output or a result to be filtered, and the first preset operation is a preset operation allowing the second application or service to process the processing result.
  • step S010 includes:
  • the meeting the treatment conditions includes at least one of the following:
  • step S020 it also includes:
  • Step S030 Determine whether the processing result matches the processing condition and/or the preset condition
  • Step S040 If not, output information for prompting to update the processing condition and/or the preset condition.
  • step S030 includes at least one of the following:
  • the processing the first application or service according to the first preset policy includes at least one of the following:
  • the processing the first application or service according to a first preset policy includes: controlling the first application or service to process part of the information to be processed ;
  • the step S010 further includes: before processing the first application or service according to a first preset strategy, splitting the information to be processed to determine part of the information to be processed by the first application or service.
  • step S020 includes at least one of the following:
  • controlling the second application or service to process the processing result of the first application or service and output feedback information
  • controlling the second application or service In response to the first preset operation meeting a preset condition, controlling the second application or service to process at least a part of the information to be processed;
  • controlling the second application or service In response to the first preset operation meeting a preset condition, controlling the second application or service to process at least a part of the information to be processed, and sending a processing result to the first application or service;
  • the second application or service In response to the first preset operation meeting a preset condition, the second application or service is controlled to output a processing result.
  • the present application provides an application or service processing method applied to a processing device, including:
  • Step S0100 Outputting at least one prompt message in response to the first application or service acquiring information to be processed;
  • Step S0200 In response to a preset operation, process the first application or service according to a first preset policy; and/or process at least one second application or service according to a second preset policy.
  • the step S0100 includes: determining key information in response to acquiring information to be processed by the first application or service; and outputting at least one prompt message according to the key information.
  • the key information includes the location of the processing object of the information to be processed, the location where the information to be processed is triggered, the time when the information to be processed is triggered, the At least one of the time of the information to be processed, the source application of the information to be processed, the target application of the information to be processed, the function to be used by the information to be processed, and the permission to be used by the information to be processed kind;
  • the step S0100 includes at least one of the following: outputting prompt information whether the first application or service meets processing conditions; outputting prompt information for selecting an application or service.
  • the meeting the treatment conditions includes at least one of the following:
  • step S0100 includes:
  • step S0200 it also includes:
  • Step S0300 Determine whether the processing result matches the processing condition
  • Step S0400 If not, output information for prompting to update the processing condition.
  • the step S0300 includes at least one of the following: determining whether the processing result matches the processing condition according to the source application or service of the processing result;
  • the processing the first application or service according to the first preset strategy includes at least one of the following:
  • controlling the first application or service to process the information to be processed In response to a first preset operation, controlling the first application or service to process the information to be processed;
  • processing the second application or service according to a second preset strategy includes at least one of the following:
  • controlling the second application or service to process at least a part of the information to be processed, and sending the processing result to the first application or service; and/or, the first preset policy according to the first Processing by an application or service, and processing the second application or service according to a second preset strategy includes at least one of the following:
  • step S0200 includes:
  • Step S0200a In response to a preset operation, the first application or service determines a first processing result based on the information to be processed;
  • Step S0200b In response to the first processing result meeting the preset condition, perform preset processing on the first application or service according to the second processing result, optionally, the second processing result is sent by the associated device The at least one second application or service process is obtained.
  • the meeting the preset conditions includes at least one of the following:
  • the processing device is not a control center; there is an associated device;
  • the first application or service does not support the function to be realized by the information to be processed
  • the processing device is not part of the functions to be realized by the first application or service of the control center to support the information to be processed;
  • the processing device does not control at least one of the power, scene or mode, and operating status of the processing device
  • the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
  • the preset processing includes at least one of the following:
  • step S0200b includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and the first application or service is controlled to determine or generate at least one associated third application or service to process the information to be processed Another part of the processing results of the information;
  • the second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service.
  • the present application provides a method for processing an application or service, which is applied to a processing device, including:
  • Step S01000 In response to the first processing result meeting the preset condition, output at least one prompt message on the processing device and/or associated device, optionally, the first processing result is the first application or service to be processed based on The information is processed;
  • Step S02000 In response to a preset operation, perform preset processing on the first application or service according to a preset strategy and/or a second processing result, optionally, the second processing result is determined by the At least one second application or service is obtained.
  • the meeting the preset conditions includes at least one of the following:
  • the processing device is not a control center; there is an associated device;
  • the first application or service does not support the function to be realized by the information to be processed
  • the first application or service supports some functions to be realized by the information to be processed
  • At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions
  • the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
  • the step S01000 includes: determining key information in response to acquiring information to be processed; determining the first processing result according to the key information.
  • the key information includes at least one of the location of the processing object of the information to be processed, trigger location, processing time, source application, target application, function to be implemented, associated device, and processing device information.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • performing preset processing on the first application or service according to the second processing result includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is a processing result of the second application or service outputting a part of the information to be processed, and controlling the first application or service to determine or generate at least one associated third application or service to process the Another part of the processing results of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service;
  • performing preset processing on the first application or service according to a preset strategy includes at least one of the following:
  • control instruction generated by the preset operation perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernating the first application or service;
  • controlling the first application or service to determine or generate at least one associated third application or service to support another function to be realized by the information to be processed some functions;
  • the present application provides a method for processing an application or service, which is applied to an associated device, including:
  • Step T1 Outputting at least one prompt message in response to the processing request output by the processing device meeting the first preset condition
  • Step T2 Outputting at least one piece of feedback information in response to a preset operation and/or the associated device meeting a second preset condition, so as to enable at least one first application or service on the processing device to perform preset processing.
  • the meeting the first preset condition includes at least one of the following:
  • the processing device is not a control center; the processing request is a preset type of request;
  • meeting the second preset condition includes at least one of the following: the associated device is a control center; the preset operation is an operation that allows processing the processing request; the associated device supports the processing A required function or permission is requested; the associated device is in a preset state, mode or scene.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • said step T2 includes:
  • Step T2a In response to a preset operation and/or the associated device meets a second preset condition, acquire a first processing result determined by the first application or service based on the information to be processed;
  • Step T2b Process at least one second application or service to obtain a second processing result
  • Step T2c Based on the second processing result, output at least one piece of feedback information, so that at least one first application or service on the processing device performs preset processing.
  • said step T2c includes at least one of the following:
  • the second processing result is that the second application or service outputs all processing results of the information to be processed, and outputs feedback information for closing or hiding or freezing or dormant the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and outputs feedback information that controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and the output controls the first application or service to determine or generate an associated at least one third application or service to process the Feedback information about the processing results of another part of the information to be processed;
  • the second processing result is allowing the use of preset permissions, and outputting feedback information that controls the first application or service to output the processing result of the information to be processed;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, and output feedback information for closing or hiding or freezing or dormant the first application or service.
  • the present application provides a method for processing an application or service, which is applied to an associated device, including:
  • Step T10 in response to the processing request output by the processing device meeting the first preset condition, and/or the preset operation and/or the associated device meeting the second preset condition;
  • Step T20 Obtain a second processing result based on at least one second application or service
  • Step T30 Perform preset processing on at least one first application or service based on the second processing result and/or the preset policy.
  • the meeting the first preset condition includes at least one of the following:
  • the processing device is not a control center; the processing request is a preset type of request;
  • the second preset condition is met, including:
  • the associated device is a control center; the preset operation is an operation that allows processing the processing request; the associated device supports the functions or permissions required for the processing request; the associated device is in a preset state, mode or Scenes.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • said step T30 includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is a processing result of the second application or service outputting a part of the information to be processed, and controlling the first application or service to determine or generate at least one associated third application or service to process the Another part of the processing results of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the first application or service to output the information to be processed;
  • the second processing result is closing or hiding or freezing or dormant the first application or service, closing or hiding or freezing or dormant the first application or service;
  • performing preset processing on the first application or service according to a preset strategy includes at least one of the following:
  • control instruction generated by the preset operation perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernating the first application or service;
  • controlling the first application or service to determine or generate at least one associated third application or service to support another function to be realized by the information to be processed some functions;
  • the embodiment of the present application provides a device, the device comprising: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, any of the above-mentioned The steps of the processing method of the application or service.
  • the embodiment of the present application provides a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the processing method of any one of the above applications or services is implemented A step of.
  • the present application relates to an application or service processing method, device, and storage medium.
  • the application or service processing method includes: in response to acquiring data to be processed, determining at least one target application or target service; in response to the target application or the target service, and perform corresponding processing according to the preset policy. In this way, after obtaining the data to be processed, at least one target application or target service is determined first, and then the determined target application or target service is processed, which can improve the accuracy and/or Improve the interaction effect and enhance the user experience.
  • the present application also relates to a processing method, device, and storage medium of an application or service
  • the processing method of the application or service includes: in response to obtaining information to be processed, detecting whether the first application or service currently awakened or running meets the processing conditions , according to the detection result, process the first application or service and/or the second application or service based on a preset policy.
  • processing the first application or service and/or the second application or service can improve data security and/or interaction effect and improve user experience when using the application or service.
  • the joint associated device processes the first application or service and/or the second application or service, which can improve data security and/or interaction effects based on the functions and control capabilities of multiple devices, and improve user experience.
  • At least one target application or target service is determined first, and then the determined target application or target service is processed.
  • the processing the first application or service and/or the second application or service can improve data security and/or interaction effect and improve user experience when using the application or service.
  • FIG. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present application.
  • FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application.
  • Fig. 3 is a schematic flowchart of a method for processing an application or service according to the first embodiment.
  • Fig. 4 is a schematic diagram of an interface of a processing device in a scenario according to the first embodiment.
  • Fig. 5 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.
  • Fig. 6 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.
  • Fig. 7 is a schematic flowchart of a processing method for an application or service according to the second embodiment.
  • Fig. 8 is a schematic flowchart of a method for processing an application or service according to a third embodiment.
  • Fig. 9 is a schematic flowchart of a method for processing an application or service according to a fourth embodiment.
  • Fig. 10 is one of the schematic diagrams of the application or service processing method according to the fourth embodiment.
  • Fig. 11 is a schematic diagram of an interface of a processing device according to a processing method for an application or service shown in a fourth embodiment.
  • Fig. 12 is a schematic diagram of an interface of an associated device according to the application or service processing method shown in the fourth embodiment.
  • Fig. 13 is a second schematic diagram of a scene of an application or service processing method according to the fourth embodiment.
  • Fig. 14 is a schematic diagram of an interface of another associated device according to the application or service processing method shown in the fourth embodiment.
  • Fig. 15 is a schematic flowchart of a processing method for an application or service according to a fifth embodiment.
  • Fig. 16 is a schematic flowchart of an application or service processing method according to the sixth embodiment
  • Fig. 17 is a schematic flowchart of a method for processing applications or services according to the seventh embodiment.
  • Fig. 18 is a schematic diagram of an interface of a processing device in a scenario according to a seventh embodiment.
  • Fig. 19 is one of the schematic diagrams of the application or service processing method according to the seventh embodiment.
  • Fig. 20 is a schematic diagram of an interface of a processing device in another scenario according to the seventh embodiment.
  • Fig. 21 is a second schematic diagram of a scene of an application or service processing method according to the seventh embodiment.
  • Fig. 22 is a schematic diagram of an interface of a processing device in another scenario according to the seventh embodiment.
  • Fig. 23 is a schematic flowchart of a method for processing applications or services according to the eighth embodiment.
  • Fig. 24 is a schematic flowchart of a processing method for an application or service according to the ninth embodiment.
  • first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information.
  • first information may also be called second information, and similarly, second information may also be called first information.
  • second information may also be called first information.
  • the word “if” as used herein may be interpreted as “at” or “when” or “in response to a determination”.
  • the singular forms "a”, “an” and “the” are intended to include the plural forms as well, unless the context indicates otherwise.
  • A, B, C means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C
  • A, B or C or "A, B and/or C” means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.
  • the words “if”, “if” as used herein may be interpreted as “at” or “when” or “in response to determining” or “in response to detecting”.
  • the phrases “if determined” or “if detected (the stated condition or event)” could be interpreted as “when determined” or “in response to the determination” or “when detected (the stated condition or event) )” or “in response to detection of (stated condition or event)”.
  • step codes such as S1 and S2 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order.
  • S1 will be implemented first and then S2, etc., but these should be within the protection scope of this application.
  • Mobile terminals may be implemented in various forms.
  • the mobile terminals described in this application may include devices such as mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media player (Portable Media Player, PMP), navigation device, wearable device, smart bracelet, pedometer and other mobile terminals, as well as fixed terminals such as digital TV and desktop computer.
  • PDA Personal Digital Assistant
  • PMP portable media player
  • navigation device wearable device
  • smart bracelet smart bracelet
  • pedometer pedometer
  • fixed terminals such as digital TV and desktop computer.
  • a mobile terminal will be taken as an example, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configurations according to the embodiments of the present application can also be applied to fixed-type terminals.
  • FIG. 1 is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application.
  • the mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, a /V (audio/video) input unit 104 , sensor 105 , display unit 106 , user input unit 107 , interface unit 108 , memory 109 , processor 110 , and power supply 111 and other components.
  • RF Radio Frequency, radio frequency
  • the radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station.
  • the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency unit 101 can also communicate with the network and other devices through wireless communication.
  • the above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000, Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution, frequency division duplex long-term evolution) and TDD-LTE (Time Division Duplexing- Long Term Evolution, time-division duplex long-term evolution), etc.
  • GSM Global System of Mobile communication, Global System for Mobile Communications
  • GPRS General Packet Radio Service
  • CDMA2000 Code Division Multiple Access 2000, Code Division Multiple Access 2000
  • WCDMA Wideband Code Division Multiple Access
  • TD-SCDMA Time Division-Synchronous Code Division Multiple Access, Time Division Synchro
  • WiFi is a short-distance wireless transmission technology.
  • the mobile terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102, which provides users with wireless broadband Internet access.
  • Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the mobile terminal, and can be completely omitted as required without changing the essence of the invention.
  • the audio output unit 103 can store the audio received by the radio frequency unit 101 or the WiFi module 102 or in the memory 109 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like.
  • the audio data is converted into an audio signal and output as sound.
  • the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.).
  • the audio output unit 103 may include a speaker, a buzzer, and the like.
  • the A/V input unit 104 is used to receive audio or video signals.
  • A/V input unit 104 may include a graphics processor (Graphics Processing Unit (GPU) 1041 and a microphone 1042, the graphics processor 1041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames may be displayed on the display unit 106 .
  • the image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 .
  • the microphone 1042 may receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data.
  • the processed audio (voice) data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 101 for output in the case of a phone call mode.
  • the microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.
  • the mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor.
  • the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the mobile terminal 100 moves to the ear. panel 1061 and/or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile phones (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.
  • the display unit 106 is used to display information input by the user or information provided to the user.
  • the display unit 106 may include a display panel 1061, and a liquid crystal display (Liquid Crystal Display, LCD), organic light-emitting diodes (Organic Light-Emitting Diode, OLED) and other forms to configure the display panel 1061 .
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • the user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal.
  • the user input unit 107 may include a touch panel 1071 and other input devices 1072 .
  • the touch panel 1071 also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program.
  • the touch panel 1071 may include two parts, a touch detection device and a touch controller.
  • the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it.
  • the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the user input unit 107 may also include other input devices 1072 .
  • other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.
  • the touch panel 1071 may cover the display panel 1061.
  • the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event.
  • the corresponding visual output is provided on the display panel 1061 .
  • the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated.
  • the implementation of the input and output functions of the mobile terminal is not specifically limited here.
  • the interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100 .
  • an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more.
  • the interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.
  • the memory 109 can be used to store software programs as well as various data.
  • the memory 109 can mainly include a program storage area and a data storage area.
  • the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.) and the like;
  • the storage data area can be Stores data (such as audio data, phonebook, etc.) created according to the use of the mobile phone, etc.
  • the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the processor 110 is the control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole.
  • the processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor.
  • the application processor mainly processes operating systems, user interfaces, and application programs, etc.
  • the demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .
  • the mobile terminal 100 may also include a power source 111 (such as a battery) for supplying power to various components.
  • a power source 111 such as a battery
  • the power source 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.
  • the mobile terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.
  • the following describes the communication network system on which the mobile terminal of the present application is based.
  • FIG. 2 is a structure diagram of a communication network system provided by an embodiment of the present application.
  • the communication network system is an LTE system of general mobile communication technology, and the LTE system includes UEs (User Equipment, User Equipment, ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.
  • UEs User Equipment, User Equipment,
  • E-UTRAN Evolved UMTS Terrestrial Radio Access Network
  • EPC Evolved Packet Core, Evolved Packet Core Network
  • the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.
  • E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on.
  • the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .
  • a backhaul for example, X2 interface
  • EPC203 can include MME (Mobility Management Entity, mobility management entity) 2031, HSS (Home Subscriber Server, home user server) 2032, other MME 2033, SGW (Serving Gate Way, serving gateway) 2034, PGW (PDN Gate Way, packet data network gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Tariff Function Entity) 2036, etc.
  • MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management.
  • HSS2032 is used to provide some registers to manage functions such as the home location register (not shown in the figure), and save some user-specific information about service characteristics and data rates.
  • PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.
  • the IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.
  • IMS IP Multimedia Subsystem, IP Multimedia Subsystem
  • LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems.
  • the network system, etc. are not limited here.
  • FIG. 3 is a schematic flowchart of a method for processing an application or service according to the first embodiment. As shown in Figure 3, an application or service processing method of this application is applied to a processing device, including:
  • Step S01 In response to acquiring information to be processed, detecting whether the currently awakened or running first application or service meets processing conditions;
  • Step S02 according to the detection result, process the first application or service and/or the second application or service based on a preset strategy.
  • Processing devices can include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices (such as smart cars, vehicle terminals, etc.).
  • Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
  • the information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information.
  • the system-level human-computer interaction Only use third-party human-computer interaction applications for complementary functions; and/or disable functions with potential safety hazards for third-party human-computer interaction applications, or prompt users to agree to use the functions normally; and/or , third-party human-computer interaction applications are used for interaction, system-level human-computer interaction applications or human-computer interaction applications with higher security levels are used to filter or process response results; Only system-level human-computer interaction applications can be used for a specific time period, and third-party human-computer interaction applications can only be used for specific locations; and/or, human-computer interaction applications that can be used according to application restrictions, such as application A can only use system-level human-computer interaction applications For interactive applications, application B can only use C functions of third-party human-computer interaction applications; or, for functions not supported by third-party human-computer interaction applications, other human-computer interaction applications that
  • the processing conditions include at least one of the following:
  • the preset scene can be that no data is currently being processed or the interconnected scene; the preset mode can be the foreground operation mode, the background operation mode, the interactive mode, etc.; the preset authority can be the contact authority, the control authority, etc.; the information to be processed is supported
  • the function may be to support the search function, translation function, timing function, etc.; the functions required to allow the use of information to be processed may be to allow phone calls, allow transfers, etc.; the scene and/or mode associated with the information to be processed may be in the Specific time periods, specific locations, kid mode, connection status, etc.
  • step S01 includes: determining key information in response to obtaining the information to be processed; detecting the currently awakened or running first application or Whether the service is in the context and/or mode associated with the information to be processed.
  • the key information includes at least one of a location of a processing object of the information to be processed, a trigger location, a processing time, a source application, and a target application.
  • a location of a processing object of the information to be processed By performing preliminary processing on the information to be processed, at least one of the location of the processing object, trigger location, processing time, source application, and target application of the information to be processed can be determined.
  • the A human-computer interaction application receives the voice message "Open the living room "air conditioner", it can be determined that the location of the processing object of the information to be processed is the living room, the trigger time is the time when the voice information is input, the processing time is now, the source application is the human-computer interaction application of A, and the target application is the air conditioner application.
  • the key information it is detected whether the first application or service that is currently awakened or running is in a scene and/or mode associated with the information to be processed, for example, whether the A human-computer interaction application is in a state where the air conditioner application can be called, and/or Or, whether the human-computer interaction application A is in the living room, and/or, whether the human-computer interaction application A is allowed to turn on the air conditioner in the living room at the current time, etc.
  • step S02 according to whether the first application or service meets the processing condition, the first application or service and/or the second application or service are processed based on a preset policy.
  • step S02 includes:
  • the first application or service and/or the second application or service are processed according to a first preset policy; and/or,
  • the first application or service and/or the second application or service are processed according to a second preset policy.
  • the human-computer interaction application A has the permission to make a call
  • the human-computer interaction application A will make the call
  • person B who has the permission to make a call can and/or, the human-computer interaction application A does not have the permission to make a call, and can request permission or output a prompt to the human-computer interaction application B, and then make a call after allowing the call.
  • step S02 includes:
  • the first application or service and/or the second application or service are processed according to a first preset policy.
  • the decision can be made by outputting prompt information, and the user can select the corresponding processing method according to the needs, which meets the needs of the user in a specific scenario.
  • the user says “play Andy Lau's Gong Xi Fa Cai song” to the human-computer interaction application A, but the human-computer interaction application A is set not to play music during the current time period, for example, during working hours, at this time, it can output "whether to delay the playback ", "Continue playing" and other prompt information, if the user needs to play the song now, he can choose to continue playing. If he does not receive the operation of responding to the prompt information, he can not play the music in the current time period according to the original setting. In this way, flexible decision-making can be made according to the actual needs of users, and the accuracy of interactive results can be guaranteed.
  • process the first application or service and/or the second application or service according to the first preset policy can expand the application scenarios, and in specific scenarios, such as transferring money, making calls, etc., can also improve data security.
  • processing the first application or service according to a first preset strategy includes at least one of the following:
  • the first application or service When the first application or service does not meet the processing conditions, or when the first application or service does not meet the processing conditions and fails to respond to the prompt message after a timeout, the first application or service is processed according to a first preset policy.
  • the first application or service may be controlled to process part of the information to be processed, for example, the first application or service extracts key information from the information to be processed.
  • the first application or service may be controlled not to process the information to be processed, that is, not to respond to a processing request of the information to be processed or to be processed by other applications or services.
  • output information for prompting whether the pending information is processed by the first application or service and then respond to the first preset operation to confirm that the pending information is processed by the first application or service , to control the first application or service to process the pending information.
  • it is possible to delay processing the pending information for example, delay playing a song, and then control the first application or service to process the pending information and play the song when the vehicle stops or the speed is low.
  • processing the second application or service according to the first preset strategy includes at least one of the following: waking up or running the second application or service; controlling the second application or service to process at least a part of the information to be processed; Outputting information for prompting whether the pending information is processed by the second application or service; in response to a second preset operation, controlling the second application or service to process the pending information; controlling the second application or service to process at least A part of the information, the processing result is sent to the first application or service.
  • the second application or service may also be processed according to the first preset policy.
  • wake up or run the second application or service so that the second application or service can process the information to be processed.
  • the second application or service can be controlled to process at least part of the information to be processed, for example, the information processed by the first application or service can be processed, or when the content to be translated contains different languages, the second application or service can The app or service translates the language for which the first app or service does not support translation.
  • output information for prompting whether to process the pending information by the second application or service and then control the second application in response to the operation of confirming that the pending information is processed by the second application or service in response to the second preset operation or service processing pending information.
  • control the second application or service to process at least part of the information to be processed, and send the processing result to the first application or service for example, the second application or service can translate the first application or service does not support translation language or all the content, and then send the translation result to the first application or service, for example, to integrate it into a final translated document output.
  • processing the first application or service and the second application or service according to a first preset strategy includes at least one of the following:
  • the second application or service is controlled to process at least a part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output feedback information.
  • the first application or service and the second application or service can also be processed according to the first preset policy .
  • a first application or service can translate a language that supports translation
  • a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the second application or service.
  • a first application or service can translate a language that supports translation
  • a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the first application or service.
  • the first application or service translates the language that supports translation
  • the second application or service translates the language that the first application or service does not support translation
  • the final translation result through the first application or service.
  • the information to be processed is the rock version of Daolang’s impulsive punishment
  • the first application or service can search for the song. When the rock version of the song is not found, the first application or service will search for the song Send it to the second application or service, and the second application or service will edit the sound effect and output it.
  • the first application or service and/or the second application or service are processed according to the second preset policy, which can ensure maximum interaction with the user on the premise of meeting the interaction requirements.
  • Application Consistency
  • processing the first application or service according to a second preset policy includes at least one of the following:
  • the first application or service when the first application or service meets the processing condition, it means that the current scene can be dominated by the first application or service, and assisted by other applications or services when necessary.
  • the first application or service can be controlled to start processing at least a part of the information to be processed, including all information.
  • a preset time period for the first application or service to process the information to be processed can be set, for example, in summer Turn on the air conditioner in the room at 8 o'clock in the evening to create a comfortable rest environment in advance.
  • the prompt can still be output, and in response to the first preset operation, the first application or service is controlled to process the information to be processed, so as to improve the interaction accuracy.
  • control the first application or service to process the information to be processed according to the current scene or mode, for example, if the current power of the processing device is lower than the threshold but needs to play music, then the screen can be turned off while the music is playing to save power.
  • the first application or service may also output the processing result.
  • processing the second application or service according to the second preset strategy includes at least one of the following: controlling the second application or service to sleep or exiting the second application or service;
  • the service processes information of part of the information to be processed; in response to a second preset operation, controlling the second application or service to process part of the information to be processed.
  • the second application or service may assist or supplement the functions or interaction capabilities of the first application or service, and/or control the second application or service to sleep or exit.
  • the second application or service can confirm to the user by prompting, and then control the second application or service to process the pending information according to the user's operation. partial information. For example, if the first application or service has the function of translating English, but the file has a large number of words, part of the content can be translated by the second application or service, thereby speeding up the translation.
  • processing the first application or service and the second application or service according to a second preset policy includes at least one of the following:
  • Control the first application or service to process the information to be processed send the processing result to the second application or service, and control the second application or service to output feedback information;
  • the second application or service is controlled to process part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output the processing result.
  • the functions or interaction capabilities between the first application or service and the second application or service can still be reasonably allocated, and the first application or service is responsible for most of the data processing or responsible Output the processing result.
  • the second application or service performs proofreading and output; and/or, after the first application or service completes the translation and proofreading of all documents, the second application or service conducts Output, and/or, the second application or service assists in translating a part of the file, and the first application or service outputs the result.
  • the second application or service may participate in the process of processing the information to be processed, but in different scenarios, the roles played by the second application or service are different.
  • the second application or service needs to process more information and/or filter the data and/or respond to the results and/or process important information, when the first application or service meets the processing conditions
  • the second application or service can process less information and/or perform simple processing on data, thereby achieving effective integration among multiple applications or services in different scenarios.
  • step S02 when processing the first application or service based on a preset policy, including controlling the first application or service to process part of the information to be processed, step S02 further includes:
  • the information to be processed is split to determine part of the information processed by the first application or service.
  • the information to be processed may be split, for example, the content to be translated is split into different languages, the amount of translation is split, the amount of translation to be translated Partitioning of the interface, etc.; and/or, splitting different parts of the command, such as "send the email to Xiaocui at 10 o'clock", can be divided into timing and sending emails, and the application or service responsible for sending emails has a higher priority. Security Level.
  • the first application or service and the second application or service may be located on the same device or on different devices, as long as the first application or service and the second application or service can call each other, it is not limited to the application or service Service installation devices, communication methods between applications or services, etc.
  • step S02 when the first application or service and the second application or service are located on different devices, step S02 includes: step S02a: determining the first processing result according to the detection result; step S02b: responding to the first processing result conforming to the preset condition, output at least one prompt message on the processing device or associated device; step S02c: in response to the preset operation, perform preset processing on the first application or service according to the preset strategy and/or the second processing result, optionally, The second processing result is obtained by processing at least one second application or service on the associated device.
  • further processing is performed according to the detection result to determine a first processing result.
  • the first processing result may be obtained further based on information related to the processing device and the first application or service.
  • the first processing result may be obtained further based on information about the processing device and the first application or service.
  • the relevant information of the processing device includes whether it is a control center, battery power, scene or mode, operating status, device association information, etc., and the relevant information of the first application or service includes whether it supports the function to be realized by the information to be processed.
  • at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.
  • the preset conditions include at least one of the following: the processing device is not a control center; the first application or service does not support the functions to be realized by the information to be processed; the first application or service supports some functions to be realized by the information to be processed; At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions; there is an associated device; there is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
  • the first processing result meets the preset condition, output at least one prompt message on the processing device or the associated device, such as prompting "authorization by device C is required", "the current battery is low and the task cannot be completed", "the current application cannot be translated” Wait.
  • the first application or service and/or the second application or service may be processed according to a second preset strategy, and the second preset strategy Reference can be made to the foregoing, and no further details will be given.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • step S02c includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to determine or generate at least one associated third application or service to process another part of the processing result of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the output of the information to be processed by the first application or service;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service.
  • performing preset processing on the first application or service according to a preset strategy includes at least one of the following:
  • control the first application or service When the first application or service supports part of the functions to be realized by the information to be processed, control the first application or service to determine or generate at least one associated third application or service to support another part of the functions to be realized by the information to be processed;
  • At least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result.
  • the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed.
  • the third application or service may be an application or service on a processing device, an associated device, or other devices, for example,
  • a human-computer interaction application requests B human-computer interaction application to translate a webpage containing multiple languages, While the human-computer interaction application B can only translate a part of the content of the webpage, at this time, the human-computer interaction application A can request to call the human-computer interaction application C to translate another part of the content of the webpage.
  • the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used.
  • the processing device may control to close the first application or service.
  • the associated device may control to close the first application or service.
  • step S02 further include: step S03: determine whether the processing result matches the processing condition; step S04: if not, output information for prompting to update the processing condition.
  • step S03 includes at least one of the following:
  • the processing conditions define the rules for using the functions and interaction capabilities of different applications or services.
  • the processing conditions may be default non-modifiable conditions, user-set conditions, or some user-settable conditions.
  • the B human-computer interaction assistant can be called to search Picture
  • the user chooses to have the A human-computer interaction assistant output the results
  • the default processing condition is that the A human-computer interaction assistant does not meet the processing conditions and cannot output the results.
  • the output function used to process the results at this time is the same as If the processing conditions do not match, you can output information prompting to update the processing conditions, for example, prompting "Whether to update the search results is only output by the A human-computer interaction assistant", and the user can choose to update or not.
  • the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.
  • Fig. 4 is a schematic diagram of an interface of a processing device in a scenario according to the first embodiment.
  • the illustrated scenario is a scenario of searching for pictures, and the application or service is a voice assistant and the voice assistants are installed on the processing device as an example for illustration.
  • (a) in Figure 4 shows the interface of voice assistant A.
  • Voice assistant A prompts "You said, I'm listening" at this time. At this time, the user can input instructions by voice.
  • Fig. 5 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.
  • the illustrated scenario is a scenario of making a phone call
  • the application or service is a voice assistant and the voice assistants are installed on the processing device as an example for illustration.
  • Figure 5 (a) shows the interface of voice assistant A.
  • Voice assistant A prompts "You said, I'm listening" at this time. At this time, the user can input instructions by voice.
  • the voice assistant A will execute the command to make a call this time, and display a prompt screen for making a call in the interface of voice assistant A.
  • the voice assistant A will execute the command to make a call this time, and display a prompt screen for making a call in the interface of voice assistant A.
  • it will still be Carry out the decision process shown in Figure 5(b).
  • the permissions of different voice assistants are allocated and added to the user's decision-making process. Even if the currently used voice assistant cannot meet the needs, it can provide an accurate interactive experience and ensure data security.
  • Fig. 6 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.
  • the scenario shown in the figure is a schedule reminder scenario, and the application or service is a voice assistant and the voice assistants are installed on the processing device as an example for illustration.
  • (a) in Figure 6 shows the interface of voice assistant A.
  • Voice assistant A prompts "You said, I'm listening" at this time, and the user can input instructions by voice.
  • the application or service processing method of the present application detects whether the currently awakened or running first application or service meets the processing conditions in response to obtaining the information to be processed; according to the detection result, the first application or service and the and/or a second application or service for processing.
  • the Manage and control the use process of applications or services make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.
  • Fig. 7 is a schematic flowchart of a processing method for an application or service according to the second embodiment. As shown in FIG. 7, an application or service processing method of the present application is applied to a processing device, including:
  • Step S010 in response to acquiring the information to be processed, process the first application or service according to a first preset policy;
  • Step S020 According to the processing result and/or whether the first preset operation meets the preset condition, process the second application or service based on the second preset policy.
  • Processing devices can include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices (such as smart cars, vehicle terminals, etc.).
  • Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
  • the information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information.
  • a third-party human-computer interaction application is used for interaction, and a system-level human-computer interaction application or a human-computer interaction application with a higher security level is used for filtering or processing response results; and/or, the third-party human-computer interaction application is disabled
  • the function can only be used normally after the user is prompted to agree, or the function can only be used normally after the system-level human-computer interaction application authorizes;
  • the third-party human-computer interaction application processes data with a lower security level, and the system-level The human-computer interaction application further processes data with a higher security level according to the processing results, and then fuses the output.
  • step S010 includes: in response to acquiring the information to be processed, detecting a processing condition met by the first application or service; and processing the first application or service based on a first preset policy according to the detection result.
  • the processing conditions include at least one of the following: being in a preset scene; being in a preset mode; having a preset authority; supporting the functions to be realized by the information to be processed; allowing the functions required to use the information to be processed; The scene and/or mode associated with the information to be processed.
  • the preset scene can be that no data is currently being processed or the interconnected scene; the preset mode can be the foreground operation mode, the background operation mode, the interactive mode, etc.; the preset authority can be the contact authority, the control authority, etc.; the information to be processed is supported
  • the function may be to support the search function, translation function, timing function, etc.; the functions required to allow the use of information to be processed may be to allow phone calls, allow transfers, etc.; the scene and/or mode associated with the information to be processed may be in the Specific time periods, specific locations, kid mode, connection status, etc.
  • key information is determined; and it is detected according to the key information whether the currently awakened or running first application or service is in a scene and/or mode associated with the information to be processed.
  • the key information includes at least one of a location of a processing object of the information to be processed, a trigger location, a processing time, a source application, and a target application.
  • the A human-computer interaction application receives the voice message "Open the living room "air conditioner", it can be determined that the location of the processing object of the information to be processed is the living room, the trigger time is the time when the voice information is input, the processing time is now, the source application is the human-computer interaction application of A, and the target application is the air conditioner application.
  • the key information it is detected whether the first application or service that is currently awakened or running is in a scene and/or mode associated with the information to be processed, for example, whether the A human-computer interaction application is in a state where the air conditioner application can be called, and/or Or, whether the human-computer interaction application A is in the living room, and/or, whether the human-computer interaction application A is allowed to turn on the air conditioner in the living room at the current time, etc.
  • processing the first application or service according to a first preset strategy includes at least one of the following:
  • the section processes at least a part of the information to be processed; and controls the first application or service to process the information to be processed according to the current scene or mode.
  • the processing method is determined according to the processing conditions met by the first application or service, for example, the first application or service supports the function to be implemented by the information to be processed but is in a dormant state, and wakes up or runs the first application or service at this time; and /or, the first application or service is not allowed to use the function required by the information to be processed, then the first application or service is controlled not to process the information to be processed, and/or, output is used to prompt whether the first application or service processes the information to be processed process the information of the information, and then control the first application or service to process the information to be processed in response to the second preset operation; and/or, the first application or service is in a scene and/or mode associated with the information to be processed, such as an alarm clock If the application is associated, the alarm clock application is called to ring at ten o'clock according to the instruction "set an alarm clock at ten o'clock".
  • step S010 further includes: processing the first application or service according to the first preset strategy Before the first application or service processes, the information to be processed is split to determine part of the information to be processed by the first application or service.
  • the information to be processed may be split, for example, the content to be translated is split into different languages, the amount of translation is split, the amount of translation to be translated Partitioning of the interface, etc.; and/or, splitting different parts of the command, such as "send the email to Xiaocui at 10 o'clock", can be divided into timing and sending emails, and the application or service responsible for sending emails has a higher priority. Security Level.
  • step S020 After the first application or service is processed according to the first preset policy, enter step S020, and according to the processing result and/or whether the first preset operation meets the preset condition, the second application or service is processed based on the second preset policy to process.
  • the preset conditions include at least one of the following:
  • the processing result matches the functions and/or permissions allowed by the second application or service
  • the processing result is a result to be output or a result to be filtered
  • the first preset operation is a preset operation allowing the second application or service to process the processing result
  • the processing result does not match the functions and/or permissions allowed by the second application or service, and the first preset operation is a preset operation that allows the second application or service to process the processing result;
  • the processing result is not a result to be output or a result to be filtered, and the first preset operation is a preset operation allowing the second application or service to process the processing result.
  • the second application or service may be processed according to the first preset operation, and/or the second application or service may be processed according to the processing result Perform processing, and/or process the second application or service according to the processing result and the first preset operation.
  • a prompt may be output, such as "Whether the second application or service is allowed to process the processing result?" If the user confirms the permission, the second application or service will be processed; when the second application or service is processed according to the first preset operation, it can be judged that the processing result is consistent with the functions and functions allowed by the second application or service.
  • the second application or service perform processing on the second application or service according to the processing result and the first preset operation
  • the first preset operation is used as the decision criterion.
  • step S020 includes at least one of the following:
  • controlling the second application or service to process the processing result of the first application or service and output feedback information
  • controlling the second application or service In response to the first preset operation meeting the preset condition, controlling the second application or service to process at least a part of the information to be processed;
  • controlling the second application or service In response to the first preset operation meeting the preset condition, controlling the second application or service to process at least a part of the information to be processed, and sending the processing result to the first application or service;
  • the second application or service In response to the first preset operation meeting the preset condition, the second application or service is controlled to output a processing result.
  • processing the second application or service includes waking up, running, controlling the second application or service to process at least a part of the information to be processed, controlling the second application or service to process at least a part of the information to be processed, and At least one of sending the processing result to the first application or service and controlling the second application or service to output the processing result may be determined according to the processing result of the first application or service and/or the preset condition that the first preset operation meets A processing method for the second application or service to obtain a better interaction effect. For example, if the processing result matches the functions and/or permissions allowed by the second application or service, the second application or service can be controlled to process the processing result of the first application or service and output feedback information, thereby reducing the conflict between applications.
  • the first preset operation is a preset operation that allows the second application or service to process the processing result, then controlling the second application or service to process at least a part of the information to be processed,
  • the processing result is sent to the first application or service, so that the user can choose to use a familiar application interface to output the result.
  • voice assistant A on the processing device searches for children's cartoons on the Internet according to the instruction "I want to watch cartoons", and the processing result at this time is the result to be filtered, which can be sent to the voice assistant on the associated device Assistant B prompts "Your child wants to watch cartoons, please filter” through voice assistant B, and then voice assistant B can return processing results based on user operations, such as specifying watchable cartoons.
  • voice assistant A determines the instruction as "generate a navigation route from the current location to the location of Oriental Pearl Tower” according to the voice information "navigate to the Oriental Pearl Tower", and sends the instruction to voice assistant B. If voice assistant B has a navigation function, the voice assistant Assistant B generates a navigation route from the current location to the location of the Oriental Pearl Tower.
  • step S020 further include:
  • Step S030 Determine whether the processing result matches the processing condition and/or the preset condition
  • Step S040 If they do not match, output information for prompting to update the processing conditions and/or preset conditions.
  • step S030 includes at least one of the following:
  • the processing conditions and/or preset conditions define the rules for using the functions and interactive capabilities of different applications or services.
  • the processing conditions and/or preset conditions can be default non-modifiable conditions, user-set conditions, or some user-defined conditions. Configurable conditions.
  • the B human-computer interaction assistant can be called to search for news, and after obtaining the search results , the user chooses to output the result by A human-computer interaction assistant, and the default processing condition is that the A human-computer interaction assistant cannot output the result if it does not meet the processing conditions. Then, the output function used for the processing result does not match the processing condition at this time, and it can be output Information that prompts to update processing conditions, such as the prompt "whether to update the search results is only output by A human-computer interaction assistant", the user can choose to update or not. In this way, the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.
  • the user when the user is using the A human-computer interaction assistant, he needs to search for news. After the A human-computer interaction assistant searches for news, the user chooses that the A human-computer interaction assistant output the results, and the default preset condition is B human-computer interaction
  • the interactive assistant displays the results to be output. Then, if the application used to process the results does not match the preset conditions at this time, you can output information prompting to update the processing conditions, for example, prompting "whether to update the search results is only output by A human-computer interaction assistant", the user You can choose to update or not to update. In this way, the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.
  • the application or service processing method of the present application processes the first application or service according to the first preset policy in response to obtaining the information to be processed; according to whether the processing result and/or the first preset operation meets the preset condition, based on The second preset policy processes the second application or service.
  • the second preset policy processes the second application or service.
  • FIG. 8 is a schematic flowchart of a method for processing an application or service according to a third embodiment. As shown in FIG. 8, an application or service processing method of the present application is applied to a processing device, including:
  • Step S0100 Outputting at least one prompt message in response to the first application or service acquiring information to be processed;
  • Step S0200 In response to a preset operation, process a first application or service according to a first preset policy; and/or process at least one second application or service according to a second preset policy.
  • Processing devices can include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices (such as smart cars, vehicle terminals, etc.).
  • Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
  • the information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information.
  • the first application or service and/or the second application or service can be processed through prompts, and the application or service can be processed when using the application or service.
  • Manage and control the use process of the service make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.
  • the third-party human-computer interaction application when using a third-party human-computer interaction application, according to the received to-be-processed risk reminder, policy reminder or reminder of related conditions, based on the user's feedback on the reminder, the third-party human-computer interaction application and related applications are processed.
  • the functions and interaction capabilities of different applications or services can be fully utilized, and combined with user interaction decisions, it can not only improve data security, but also enhance the interaction effect, so that the interaction scenarios are not limited to the currently used applications or services, and the interaction is more flexible. smooth, improving the user experience.
  • step S0100 includes: determining key information in response to acquiring information to be processed by the first application or service; and outputting at least one prompt message according to the key information.
  • the key information includes the location of the processing object of the information to be processed, the location where the information to be processed is triggered, the time when the information to be processed is triggered, the time when the information to be processed is processed, the source application of the information to be processed, the location of the information to be processed At least one of the target application, the function to be used for the information to be processed, and the permission to be used for the information to be processed.
  • the key information it can be determined whether the first application or service meets the processing conditions or how to select the application or service to process information, so as to select the appropriate application or combination of applications among multiple applications to improve data security and enhance interaction The purpose of the experience.
  • At least one prompt message is output according to the key information, including at least one of the following:
  • the processing conditions include at least one of the following:
  • the preset scene can be that no data is currently being processed or the interconnected scene; the preset mode can be the foreground operation mode, the background operation mode, the interactive mode, etc.; the preset authority can be the contact authority, the control authority, etc.; the information to be processed is supported
  • the function may be to support the search function, translation function, timing function, etc.; the functions required to allow the use of information to be processed may be to allow phone calls, allow transfers, etc.; the scene and/or mode associated with the information to be processed may be in the Specific time periods, specific locations, kid mode, connection status, etc.
  • the prompt information may be "Voice Assistant A does not have payment authority", “Voice Assistant A is currently prohibited from performing this function” and so on.
  • the prompt information can be "Need to use the navigation function, please confirm whether to wake up voice assistant B", “Need to use contact information, please confirm whether to authorize voice assistant A to use contact information", “Need to use contact information , please confirm whether the call is made by voice assistant B", etc.
  • the prompt information can only provide information prompts, or provide users with optional decision-making methods, as a key interaction entry for the cooperation between multiple applications or services, and provide key reference information for the processing strategies between multiple applications or services. In order to subsequently perform corresponding processing on the first application or service and/or the second application or service, and obtain a user-satisfactory interactive experience.
  • processing the first application or service according to a first preset strategy includes at least one of the following: controlling the first application or service to process part of the information to be processed; controlling the first application or The service does not process the pending information; outputting information for prompting whether the pending information is processed by the first application or service; in response to the first preset operation, controlling the first application or service to process the pending information; delaying processing the pending information; And/or, after the first application or service meets the processing condition, control the first application or service to process the information to be processed.
  • the above-mentioned first preset policy is applicable to the scenario where the first application or service does not meet the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service does not meet the processing conditions, according to the first preset policy
  • the first application or service is processed.
  • the first application or service may be controlled to process part of the information to be processed, for example, the first application or service extracts key information from the information to be processed.
  • the first application or service may be controlled not to process the information to be processed, that is, not to respond to a processing request of the information to be processed or to be processed by other applications or services.
  • output information for prompting whether to process the pending information by the first application or service and then control the first application in response to the operation of confirming that the first application or service processes the pending information in response to the first preset operation or service processing pending information.
  • it is possible to delay processing the pending information for example, delay playing a song, and then control the first application or service to process the pending information and play the song when the vehicle stops or the speed is low.
  • processing the second application or service according to a second preset strategy includes at least one of the following: waking up or running the second application or service; controlling the second application or service to process the pending information at least a part of the information; output information for prompting whether to process the pending information by the second application or service; respond to the second preset operation, control the second application or service to process the pending information; control the second application or service to process the pending information At least a part of the information is processed, and the processing result is sent to the first application or service.
  • the above second preset policy is applicable to the scenario where the first application or service does not meet the processing conditions, that is, when it is determined that the first application or service does not meet the processing conditions in response to the preset operation, according to the second preset policy
  • the second application or service is processed.
  • wake up or run the second application or service so that the second application or service can process the information to be processed.
  • the second application or service can be controlled to process at least part of the information to be processed, for example, the information processed by the first application or service can be processed, or when the content to be translated contains different languages, the second application or service can The app or service translates the language for which the first app or service does not support translation.
  • output information for prompting whether to process the pending information by the second application or service and then control the second application in response to the operation of confirming that the pending information is processed by the second application or service in response to the second preset operation or service processing pending information.
  • control the second application or service to process at least part of the information to be processed, and send the processing result to the first application or service, for example, the second application or service can translate the first application or service does not support translation language, and then send the translation result to the first application or service for processing.
  • processing the first application or service according to a first preset policy, and processing the second application or service according to a second preset policy include at least one of the following:
  • the second application or service is controlled to process at least a part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output feedback information.
  • a first application or service can translate a language that supports translation
  • a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the second application or service.
  • a first application or service can translate a language that supports translation
  • a second application or service can translate a language that the first application or service does not support translation, and then output the final translation result through the first application or service.
  • the first application or service translates the language that supports translation
  • the second application or service translates the language that the first application or service does not support translation
  • the final translation result through the first application or service.
  • the information to be processed is the rock version of Dolan’s impulsive punishment
  • the first application or service can search for the song. When the rock version of the song is not found, the first application or service will send the searched song to For the second application or service, the second application or service performs sound editing and then outputs it.
  • processing the first application or service according to the first preset policy may also include at least one of the following: controlling the first application or service to start processing at least part of the information to be processed; controlling the first application or service Processing at least a part of the information to be processed within a preset period of time; in response to a first preset operation, controlling the first application or service to process the information to be processed; controlling the first application or service to process the information to be processed according to the current scene or mode; Output the processing result.
  • the above-mentioned first preset policy is applicable to the scenario where the first application or service meets the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service meets the processing conditions, the first application or service is processed according to the first preset policy.
  • An application or service for processing It can be understood that, for the same processing condition, when the first application or service meets the processing condition, it means that the current scene can be dominated by the first application or service, and assisted by other applications or services when necessary.
  • the first application or service can be controlled to start processing at least a part of the information to be processed, including all information.
  • a preset time period for the first application or service to process the information to be processed can be set, for example, in summer Turn on the air conditioner in the room at 8 o'clock in the evening to create a comfortable rest environment in advance. And/or, the prompt can still be output, and in response to the first preset operation, the first application or service is controlled to process the information to be processed, so as to improve the interaction accuracy. And/or, control the first application or service to process the information to be processed according to the current scene or mode, for example, if the current power of the processing device is lower than the threshold but needs to play music, then the screen can be turned off while the music is playing to save power.
  • the first application or service may also output the processing result.
  • processing the second application or service according to the second preset policy also includes at least one of the following: controlling the second application or service to sleep or exiting the second application or service; Or the service processes information of part of the information to be processed; in response to a second preset operation, controlling the second application or service to process part of the information to be processed.
  • the above-mentioned second preset policy is applicable to the scenario where the first application or service meets the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service meets the processing conditions, the first application or service is processed according to the second preset policy.
  • the application or service performs the processing.
  • the second application or service may assist or supplement the functions or interaction capabilities of the first application or service, and/or control the second application or service to sleep or exit.
  • the second application or service is required to assist or supplement the functions or interaction capabilities of the first application or service, it can confirm to the user by prompting, and then control the second application or service to process the pending information according to the user's operation. partial information. For example, if the first application or service has the function of translating English, but the file has a large number of words, part of the content can be translated by the second application or service, thereby speeding up the translation.
  • processing the first application or service according to a first preset policy, and processing the second application or service according to a second preset policy include at least one of the following:
  • Control the first application or service to process the information to be processed send the processing result to the second application or service, and control the second application or service to output feedback information;
  • the second application or service is controlled to process part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output the processing result.
  • the above-mentioned first preset policy and second preset policy are applicable to the scenario where the first application or service meets the processing conditions, that is, in response to the preset operation, when it is determined that the first application or service meets the processing conditions, according to the first A preset policy processes the first application or service and processes the second application or service according to a second preset policy.
  • the functions or interaction capabilities between the first application or service and the second application or service can still be reasonably allocated, and the first application or service is responsible for most of the data processing or responsible Output the processing result.
  • the second application or service performs proofreading and output; and/or, after the first application or service completes the translation and proofreading of all documents, the second application or service conducts Output, and/or, the second application or service assists in translating a part of the file, and the first application or service outputs the result.
  • step S0200 when processing the first application or service based on the first preset policy, including controlling the first application or service to process part of the information to be processed, step S0200 further includes:
  • the information to be processed is split to determine part of the information to be processed by the first application or service.
  • the information to be processed may be split, for example, the content to be translated is split into different languages, the amount of translation is split, the amount of translation to be translated Partitioning of the interface, etc.; and/or, splitting different parts of the instruction, such as "send an email to Xiaoyuan at 10 o'clock", can be divided into timing and sending emails, and the application or service responsible for sending emails has a higher priority. Security Level.
  • step S0100 when step S0100 outputs the prompt information indicating whether the first application or service meets the processing condition, after step S0200, further include: step S0300: determine whether the processing result matches the processing condition; step S0400: if not, Then, information for prompting to update the processing conditions is output.
  • step S0300 includes at least one of the following:
  • the processing conditions define the rules for using the functions and interaction capabilities of different applications or services.
  • the processing conditions may be default non-modifiable conditions, user-set conditions, or some user-settable conditions.
  • the B human-computer interaction assistant can be called to search Picture
  • the user chooses to have the A human-computer interaction assistant output the results
  • the default processing condition is that the A human-computer interaction assistant does not meet the processing conditions and cannot output the results.
  • the output function used to process the results at this time is the same as If the processing conditions do not match, you can output information prompting to update the processing conditions, for example, prompting "Whether to update the search results is only output by the A human-computer interaction assistant", and the user can choose to update or not.
  • the decision-making of the device and the decision-making of the user can be effectively integrated, so that the interaction process is more in line with the habits and needs of the user.
  • the first application or service and the second application or service may be located on the same device or on different devices, as long as the first application or service and the second application or service can call each other, it is not limited to the application or service Service installation devices, communication methods between applications or services, etc.
  • step S0200 includes:
  • Step S0200a In response to a preset operation, the first application or service determines a first processing result based on the information to be processed;
  • Step S0200b In response to the first processing result meeting the preset condition, perform preset processing on the first application or service according to the second processing result.
  • the second processing result is used by at least one second application or service on the associated device dealt with.
  • the first processing result is determined according to whether the first application or service meets the processing condition.
  • the first processing result may be obtained further based on information related to the processing device and the first application or service.
  • the first processing result may be obtained further based on information about the processing device and the first application or service.
  • the relevant information of the processing device includes whether it is a control center, battery power, scene or mode, operating status, device association information, etc., and the relevant information of the first application or service includes whether it supports the function to be realized by the information to be processed.
  • at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.
  • the preset conditions include at least one of the following: the processing device is not a control center; the first application or service does not support the functions to be realized by the information to be processed; the first application or service supports some functions to be realized by the information to be processed; At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions; there is an associated device; there is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • step S0200b includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to determine or generate at least one associated third application or service to process another part of the processing result of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the output of the information to be processed by the first application or service;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service.
  • At least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result.
  • the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed.
  • the third application or service may be an application or service on a processing device, an associated device, or other devices, for example,
  • a human-computer interaction application requests B human-computer interaction application to translate a webpage containing multiple languages, While the human-computer interaction application B can only translate a part of the content of the webpage, at this time, the human-computer interaction application A can request to call the human-computer interaction application C to translate another part of the content of the webpage.
  • the application or service processing method of the present application in response to the first application or service acquiring information to be processed, outputting at least one prompt message; in response to a preset operation, processing the first application or service according to a first preset strategy; and /or, at least one second application or service is processed according to a second preset policy.
  • the first application or service and/or the second application or service can be processed through prompts, and the application or service can be processed when using the application or service.
  • Manage and control the use process of the service make full use of the functions and interaction capabilities of different applications or services, improve data security and/or interaction effects, and enhance user experience.
  • FIG. 9 is a schematic flowchart of a method for processing an application or service according to a fourth embodiment. As shown in FIG. 9, an application or service processing method of the present application is applied to a processing device, including:
  • Step S01000 In response to the first processing result meeting the preset condition, output at least one prompt message on the processing device and/or the associated device, the first processing result is obtained based on the information to be processed by the first application or service;
  • Step S02000 In response to the preset operation, perform preset processing on the first application or service according to a preset strategy and/or a second processing result, and the second processing result is obtained by processing at least one second application or service on the associated device.
  • Processing devices and associated devices may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), car Networked devices (such as smart cars, vehicle terminals, etc.).
  • Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
  • the information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information.
  • the use process of the application or service can be controlled when using the application or service, and the functions and interaction capabilities of different applications or services can be fully utilized. Improve data security and/or interaction effects and enhance user experience.
  • the B device controls or authorizes the A human-computer interaction application; and/or, when using the A A human-computer interaction application on the A device, it can be controlled by B human-computer interaction application on B device controls, information collaborative processing or authorization of A human-computer interaction application; and/or, using B human-computer interaction application on B device as the control center, controls other human-computer interaction applications on other
  • the processing content, functions, permissions and interactions of interactive applications are under overall control.
  • the functions and interaction capabilities of different applications or services can be fully utilized, which can not only improve data security, but also enhance the interaction effect, so that the interaction scenarios are not limited to the currently used applications or services, the interaction is more flexible and smooth, and the user experience is improved .
  • step S01000 includes: determining key information in response to acquiring information to be processed; and determining a first processing result according to the key information.
  • the key information includes at least one of the location of the processing object of the information to be processed, trigger location, processing time, source application, target application, function to be implemented, associated equipment, and processing equipment information.
  • the first processing result can be determined.
  • the first processing result can include the processing result related to the processing device, and can also include the processing result related to the information to be processed.
  • the A human-computer interaction application receives The voice information "projects the patent document", it can be determined that the processing object of the information to be processed is a patent document, the trigger time is the time when the voice information is input, the processing time is now, the source application is A human-computer interaction application, and the target application is a certain projection application.
  • the first processing result determined according to the key information may be that the device where the human-computer interaction application A is located is not the control center, or that the human-computer interaction application A does not support calling the projection application, or that the device where the human-computer interaction application A is located has an associated Commonly used projection equipment, or the A human-computer interaction application cannot currently display the XX file that needs to be projected.
  • at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.
  • the preset conditions include at least one of the following: the processing device is not a control center; the first application or service does not support the functions to be realized by the information to be processed; the first application or service supports some functions to be realized by the information to be processed; At least one of the power, scene or mode, and operating status of the processing device does not meet the conditions; there is an associated device; there is an associated device and the associated device supports the function to be realized by the information to be processed or supports part of the functions to be realized by the information to be processed.
  • At least one prompt message is output on the processing device or the associated device, for example, prompting "authorization by device C is required", “the file cannot be displayed currently”, etc.
  • the first application or service and/or the second application or service may be processed according to a second preset policy.
  • processing the first application or service according to the second preset strategy includes at least one of the following: controlling the first application or service to start processing at least a part of the information to be processed; controlling the first application or service to Set a time period to process at least part of the information to be processed; in response to the first preset operation, control the first application or service to process the information to be processed; control the first application or service to process the information to be processed according to the current scene or mode; output processing result.
  • the first application or service can be controlled to start processing at least a part of the information to be processed, including all information
  • a preset for the first application or service to process the pending information can be set Time period, for example, turn on the air conditioner in the room at 8 o'clock in the evening in summer, so as to create a comfortable rest environment in advance.
  • the prompt can still be output, and in response to the first preset operation, the first application or service is controlled to process the information to be processed, so as to improve the interaction accuracy.
  • control the first application or service to process the information to be processed according to the current scene or mode, for example, if the current power of the processing device is lower than the threshold but needs to play music, then the screen can be turned off while the music is playing to save power.
  • the first application or service may also output the processing result.
  • processing the second application or service according to the second preset strategy includes at least one of the following: controlling the second application or service to sleep or exiting the second application or service;
  • the service processes information of part of the information to be processed; in response to a second preset operation, controlling the second application or service to process part of the information to be processed.
  • the second application or service may assist or supplement the function or interaction capability of the first application or service, and/or control the second application or service to sleep or exit.
  • the second application or service can confirm to the user by prompting, and then control the second application or service to process the pending information according to the user's operation. partial information. For example, if the first application or service has the function of translating English, but the file has a large number of words, part of the content can be translated by the second application or service, thereby speeding up the translation.
  • processing the first application or service and the second application or service according to a second preset policy includes at least one of the following:
  • Control the first application or service to process the information to be processed send the processing result to the second application or service, and control the second application or service to output feedback information;
  • the second application or service is controlled to process part of the information to be processed, and the processing result is sent to the first application or service, and the first application or service is controlled to output the processing result.
  • the functions or interaction capabilities between the first application or service and the second application or service can still be reasonably allocated, and the first application or service is responsible for most of the data processing or Responsible for outputting processing results.
  • the second application or service performs proofreading and output; and/or, after the first application or service completes the translation and proofreading of all documents, the second application or service conducts Output, and/or, the second application or service assists in translating a part of the file, and the first application or service outputs the result.
  • the second application or service may participate in the process of processing the information to be processed, but in different scenarios, the roles played by the second application or service are different.
  • the second application or service needs to process more information and/or filter the data and/or respond to the results and/or process important information, when the first application or service meets the processing conditions
  • the second application or service can process less information and/or perform simple processing on data, thereby achieving effective integration among multiple applications or services in different scenarios.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • performing preset processing on the first application or service according to the second processing result includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to determine or generate at least one associated third application or service to process another part of the processing result of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the output of the information to be processed by the first application or service;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, then close or hide or freeze or hibernate the first application or service;
  • performing preset processing on the first application or service according to a preset strategy includes at least one of the following:
  • control instruction generated by the preset operation perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernate the first application or service ;
  • control the first application or service When the first application or service supports part of the functions to be realized by the information to be processed, control the first application or service to determine or generate at least one associated third application or service to support another part of the functions to be realized by the information to be processed;
  • At least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result.
  • the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed.
  • the third application or service may be an application or service on a processing device, an associated device, or other devices, for example,
  • a human-computer interaction application requests B human-computer interaction application to process different types of audio, and B
  • the human-computer interaction application can only process several types of audio.
  • the human-computer interaction application A can request to call the human-computer interaction application C to process other types of audio.
  • the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used.
  • the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used.
  • the power of the processing device is low (for example, less than 20%)
  • the associated device may control to close the first application or service.
  • the associated device may control to close the first application or service.
  • Fig. 10 is one of the schematic diagrams of the application or service processing method according to the fourth embodiment.
  • the processing device 301 is provided with a voice assistant A
  • the first associated device 302 is provided with a voice assistant B
  • the processing device 301 and the first associated device 302 can be connected through a network, and the network includes short-distance transmission
  • the wireless network such as Bluetooth and WiFi, may also include a network of a mobile operator, and may also include a cloud-based data transmission network, so as to realize data transmission between the processing device 301 and the first association device 302 through the network.
  • the scenario shown in Figure 11 is a transfer scenario, and the application or service is used as a voice assistant as an example for illustration.
  • Figure 11 (a) shows the interface of the voice assistant A on the processing device 301.
  • the voice assistant A prompts "You said, I'm listening" at this time, and the user can input instructions by voice, because this application can Integrate the functions and interaction capabilities between applications or services, so that the instructions that the voice assistant A can accept are richer, without prompting the user for input content; after that, as shown in (b) in Figure 11, the processing device 301
  • the interface displays the content "pay 99.9 yuan" input by the user to prompt the user, and the first processing result determined based on the content input by the user is: the voice assistant A or the processing device 301 does not have the payment authority, and the processing device 301 has the associated An associated device 301 .
  • a prompt message "requesting permission from the device 302, please wait" is output.
  • the voice assistant B on the first associated device 302 displays a prompt "device 301 requests payment of 99.9 yuan” and prompts the user for related instructions, "transfer to device 303 for processing; allow; not allow... ", improve interaction efficiency by prompting users to enter instructions based on the reminder content.
  • the voice assistant A can be processed based on the second processing result, that is, the payment is allowed, and the voice can be turned off after the payment Assistant A. In this way, in the scenario of money transfer, data security can be guaranteed based on the permissions of different devices and voice assistants.
  • Fig. 13 is a second schematic diagram of a scene of an application or service processing method according to the fourth embodiment.
  • the difference from the scenario shown in FIG. 10 is that a second association device 303 is added, and a voice assistant C is installed on the second association device.
  • the second association device 303, the processing device 301 and the first association device 302 can be connected through the network
  • the network includes a wireless network for short-distance transmission, such as Bluetooth and WiFi, and may also include a network of a mobile operator, and may also include a data transmission network based on the cloud, so that the processing device 301, the first associated device 302, Data transmission between the second associated devices 303 .
  • the interaction among the processing device 301 , the first associated device 302 , and the second associated device is still described in a transfer scenario.
  • the processing methods of the processing device 301 and the first associated device 302 are still the same as those in (a) and (b) in Fig. 11.
  • the difference is that when the user enters the voice "transfer to device 302 for processing" to the voice assistant B, the result is
  • the second processing result is "the second application or service transfer authorization, determine or generate the associated voice assistant C", at this time, the voice assistant A can be processed based on the second processing result, and the second associated device C can perform transfer authorization.
  • the voice assistant C on the second associated device 303 displays a prompt "device 301 requests payment of 99.9 yuan", and prompts the user for related instructions, "transfer to device 302 for processing; allow; not allow... ", improve interaction efficiency by prompting users to enter instructions based on the reminder content.
  • the voice assistant C Based on the user's operation on the voice assistant C, for example, the user inputs the voice "Allow", the third processing result can be obtained.
  • the voice assistant A can be processed based on the third processing result, that is, the payment is allowed, and the voice assistant is turned off after payment a. In this way, in the transfer scenario, data security can be guaranteed based on the permissions of multiple devices and voice assistants.
  • the first processing result is the first application or service Obtained based on information to be processed; in response to a preset operation, perform preset processing on the first application or service according to a preset strategy and/or a second processing result, optionally, the second processing result is determined by at least one of the associated devices
  • the second application or service handles getting. In this way, when there is information to be processed, through the interaction between different devices, the use process of the application or service can be controlled when using the application or service, and the functions and interaction capabilities of different applications or services can be fully utilized , improve data security and/or interaction effects, and enhance user experience.
  • Fig. 15 is a schematic flowchart of a processing method for an application or service according to a fifth embodiment. As shown in Figure 15, an application or service processing method of this application is applied to an associated device, including:
  • Step T1 Outputting at least one prompt message in response to the processing request output by the processing device meeting the first preset condition
  • Step T2 Outputting at least one piece of feedback information in response to the preset operation and/or the associated device meeting the second preset condition, so that at least one first application or service on the processing device performs preset processing.
  • Processing devices and associated devices may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), car Networked devices (such as smart cars, vehicle terminals, etc.).
  • Applications or services may include human-computer interaction applications, and human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
  • the information to be processed includes, but is not limited to, information such as voice information, gesture information, and body movements, or information after processing such information, for example, it may be a control instruction obtained after processing voice information.
  • the use process of the application or service can be controlled when using the application or service, and the functions and interaction capabilities of different applications or services can be fully utilized. Improve data security and/or interaction effects and enhance user experience.
  • the processing request output by the processing device includes processing device information and/or a request type, where the request type includes at least one of an authorization request, an assistance request, and a control request.
  • the processing device receives the information to be processed, it outputs a request for authorization to execute a certain function to the associated device, and/or, when the processing device receives the information to be processed, the battery is low, and outputs a request to the associated device to assist in processing the information, Wait.
  • the first preset condition includes at least one of the following: the processing device is not a control center; the processing request is a request of a preset type;
  • the second preset condition includes: the associated device is a control center; Let operation be an operation that allows the processing of the processing request; the associated device supports the functions or permissions required to process the request; the associated device is in a preset state, mode, or scene.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • step T2 includes: step T2a: in response to the preset operation and/or the associated device meeting the second preset condition, acquire the first processing result determined by the first application or service based on the information to be processed; step T2b: At least one second application or service performs processing to obtain a second processing result; Step T2c: Based on the second processing result, output at least one piece of feedback information, so that at least one first application or service on the processing device performs preset processing.
  • the first processing result can be determined, and the first processing result can include processing results related to the processing equipment, and can also include processing results related to the information to be processed, for example, A man-machine
  • the interactive application receives the voice information "projecting the patent document”
  • the trigger time is the time when the voice information is input
  • the processing time is now
  • the source application is A human-computer interaction application
  • the target The application is a projection application.
  • the first processing result determined according to the key information may be that the device where the human-computer interaction application A is located is not the control center, or that the human-computer interaction application A does not support calling the projection application, or that the device where the human-computer interaction application A is located has an associated Commonly used projection equipment, or the A human-computer interaction application cannot currently display the XX file that needs to be projected.
  • at least one second application or service on the associated device can participate in management, processing and decision-making, further improving data security and interaction effect.
  • step T2c includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and outputs feedback information for closing or hiding or freezing or dormant the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and outputs feedback information that controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and outputs another part of the processing result that controls the first application or service to determine or generate an associated at least one third application or service to process the information to be processed Feedback;
  • the second processing result is to allow the use of preset permissions and output feedback information for controlling the first application or service to output the processing result of the information to be processed;
  • the second processing result is to close or hide or freeze or hibernate the first application or service, and output feedback information for closing or hiding or freezing or dormant the first application or service.
  • At least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result.
  • the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed.
  • the third application or service may be an application or service on a processing device, an associated device, or other devices, for example,
  • a human-computer interaction application requests B human-computer interaction application to process different types of audio, and B
  • the human-computer interaction application can only process several types of audio.
  • the human-computer interaction application A can request to call the human-computer interaction application C to process other types of audio.
  • Fig. 16 is a schematic flowchart of a method for processing an application or service according to the sixth embodiment. As shown in Figure 16, an application or service processing method of this application is applied to an associated device, including:
  • Step T10 in response to the processing request output by the processing device meeting the first preset condition, and/or the preset operation and/or the associated device meeting the second preset condition;
  • Step T20 Obtain a second processing result based on at least one second application or service
  • Step T30 Perform preset processing on at least one first application or service based on the second processing result and/or the preset policy.
  • the first preset condition includes at least one of the following: the processing device is not a control center; the processing request is a request of a preset type;
  • the second preset condition includes at least one of the following: the associated device is a control center; the preset operation is an operation that allows processing the processing request; the associated device supports the functions or permissions required for processing the request; the associated device is in the preset state, mode or scene.
  • the preset processing includes at least one of the following: hiding; closing; determining or generating at least one associated third application or service; outputting at least a part of processing results of the information to be processed.
  • step T30 includes at least one of the following:
  • the second processing result is that the second application or service outputs all the processing results of the information to be processed, and closes or hides or freezes or sleeps the first application or service;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to output another part of the processing result of the information to be processed;
  • the second processing result is that the second application or service outputs a part of the processing result of the information to be processed, and controls the first application or service to determine or generate at least one associated third application or service to process another part of the processing result of the information to be processed;
  • the second processing result is a processing result of allowing the use of preset permissions to control the output of the information to be processed by the first application or service;
  • the second processing result is closing or hiding or freezing or dormant the first application or service, closing or hiding or freezing or dormant the first application or service;
  • performing preset processing on the first application or service according to a preset strategy includes at least one of the following:
  • control instruction generated by the preset operation perform corresponding preset processing on the first application or service; when the first application or service does not support the function to be realized by the information to be processed, close or hide or freeze or hibernate the first application or service ;
  • control the first application or service When the first application or service supports part of the functions to be realized by the information to be processed, control the first application or service to determine or generate at least one associated third application or service to support another part of the functions to be realized by the information to be processed;
  • At least one second application or service on the associated device obtains the The second processing result enables the processing device to process the first application or service based on the second processing result.
  • the first application or service may also be controlled to determine or generate at least one associated third application or service to process the information to be processed.
  • the third application or service may be an application or service on a processing device, an associated device, or other devices, for example,
  • a human-computer interaction application requests B human-computer interaction application to process different types of audio, and B
  • the human-computer interaction application can only process several types of audio.
  • the human-computer interaction application A can request to call the human-computer interaction application C to process other types of audio.
  • the processing device may directly perform preset processing on the first application or service according to the preset policy without relying on the second processing result, which is applicable to a scenario where the function or authority of the second application or service does not need to be used.
  • the processing device may control to close the first application or service.
  • the associated device may control to close the first application or service.
  • Fig. 17 is a schematic flowchart of a method for processing applications or services according to the seventh embodiment. As shown in Figure 17, the application or service processing method of this application is applied to a processing device, including:
  • Step S1 in response to obtaining the data to be processed, determine at least one target application or target service;
  • Step S2 In response to the target application or target service, perform corresponding processing according to a preset strategy.
  • the processing device may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.).
  • the application or service may include a human-computer interaction application, and the human-computer interaction application includes an application or service that can perform human-computer interaction through touch operations, voice, touch gestures, air gestures, etc. (such as smart assistants, etc.), Other similar applications or services are also possible.
  • the data to be processed includes but is not limited to voice data, touch or air gesture data, body movement data, or data after processing these data, for example, it may be a control instruction obtained after processing voice data.
  • the acquisition of the data to be processed by the processing device may be that the processing device receives the data to be processed input by the user, or it may be that the processing device receives the data to be processed sent by other devices.
  • the target application or target service may be set on the processing device and/or other devices (such as an associated device of the processing device, etc.).
  • the target application or target service includes at least one of voice assistant applications, social media applications, information content applications, tool applications, and system services.
  • At least one target application or target service is determined first, and then the determined target application or target service is processed, so that after obtaining the data to be processed, the accuracy and accuracy of the response to the data to be processed can be improved. / Or improve the interaction effect, thereby enhancing the user experience.
  • At least one target application or target service includes multiple human-computer interaction applications
  • simultaneously or sequentially invoke the multiple human-computer interaction applications to respond and/or control the multiple human-computer interaction applications Output the response results simultaneously or sequentially; and/or, preferentially invoke human-computer interaction applications with high priority, and/or high trust level, and/or frequent use to respond to the data to be processed; and/or, according to the scenario
  • the human-computer interaction application corresponding to the information call responds to the data to be processed.
  • the human-computer interaction application that matches the environment can be called in a specific environment, and only the human-computer interaction application that matches the time can be called in a specific time period; and/or, in In the case of an associated device, call the human-computer interaction application in the associated device to respond to the data to be processed, for example, call the mobile phone and play songs with the car machine associated with the mobile phone; and/or, the human-computer interaction application as the control center It is used to interact with users, and other human-computer interaction applications are used to respond to pending data and so on. In this way, the functions and interaction capabilities of the application or service can be fully utilized, which can not only improve the accuracy of the response result, but also improve the interaction effect, making the interaction more flexible and convenient, and improving the user experience.
  • the step S1 includes: step S11a: according to the acquired operation, and/or preset information, and/or scene information, and/or the source information of the data to be processed, and/or the Relevant information of the processed data, and/or a response result to the data to be processed, determines at least one target application or target service.
  • the acquired operations include but are not limited to: information such as touch gesture operations, air gesture operations, and voice operations.
  • the above operation information can be collected through corresponding sensors in the device or image or voice acquisition devices, for example, Air gestures can be obtained through the camera in the mobile phone or the voice input by the user can be obtained through the microphone.
  • Determining at least one target application or target service according to the obtained operation may be: selecting an application or service that matches the obtained operation as the target application or service, for example, matching the application or service with the palm open air gesture As the target application or target service, or use the application or service that matches the touch position of the touch gesture as the target application or target service, etc., in this way, the target application or target service can be more accurately determined, thereby providing users with better experience.
  • the preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, and the like.
  • historical usage information it is used to distinguish user usage habits, including but not limited to: historical usage times, historical usage time, historical usage locations, etc.
  • supported function information it is used to distinguish the functions that the application or service can implement, for example, whether it supports reading contacts, whether it supports calling a camera function, and so on.
  • the running status information it is used to distinguish the running status of the application or service, for example, whether it is closed, running in the foreground or running in the background.
  • For device information it is used to distinguish the identity and/or status of the device where different applications or services are located, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, or associated devices, etc. ), remaining power information, remaining network traffic, network status, etc.
  • device identity information such as master device and slave device, or control center and non-control center, or associated devices, etc.
  • remaining power information remaining network traffic, network status, etc.
  • For permission information it is used to distinguish the usage permissions of different applications or services, including but not limited to: priority, callable applications or services, etc. For example, applications or services with different priorities have different usage sequences, or different The third-party applications that an application or service can call are different.
  • Determining at least one target application or target service according to the preset information may be: the priority, and/or supported function information, and/or running status information, and/or device information, and/or permission information meet the preset Conditional application or service is determined as the target application or service, for example, the application or service that supports the function that can respond to the data to be processed is determined as the target application or service, or the application or service with the highest priority is determined as the target application or the target service, or determine the application or service that is running in the foreground or has been awakened as the target application or service, or determine the application or service of the associated device as the target application or service, or determine the remaining power of the device There are many applications or services with supported functions that can respond to the data to be processed and determined as the target application or target service, etc.
  • the scene information may include at least one of the following information: location type, time information, number of users, user identity, scene image, and the like.
  • location type it is used to distinguish the space where the user is currently located, including but not limited to: closed environment (such as inside the room, inside the vehicle, etc.), open environment (such as outside the room, playground, etc.), and the location type can be passed through the sensor (such as gravity sensor, acceleration sensor, gyroscope, camera, GPS, etc.) to perceive.
  • time information it is used to distinguish the current date or time period, such as day or night, morning or afternoon, etc.
  • number of users it is used to distinguish how many users are around the device. For example, there may be only one or multiple users.
  • the number of users can be sensed by sensors (such as cameras, microphones, etc.), such as only one sound source is detected , indicating that there is only one user.
  • sensors such as cameras, microphones, etc.
  • For user identity it is used to distinguish the user's personality characteristics, including but not limited to: age type, gender, occupation type, etc.
  • For the scene image it is used to distinguish the specific environment of the device or the specific image of the user. For example, the user's gaze direction and/or gesture direction and other information can be obtained according to the user's image.
  • determining at least one target application or target service may be: determining the application or service corresponding to the user's gaze direction as the target application or target service, for example, when the user's gaze direction is towards the A human-computer interaction application, Determine the A human-computer interaction application as the target application; or determine the application or service that matches the current location type as the target application or service, for example, when the user is in the vehicle, determine the application or service located in the vehicle as the target application The target application or target service; or, determine the application or service that matches the current time and current location type as the target application or target service, etc., so that the target application or target service can be more accurately determined, thereby giving users a better experience .
  • the source information of the data to be processed includes, but is not limited to: time and location for obtaining the data to be processed, information about a device that obtains or outputs the data to be processed, and the like.
  • time to obtain the data to be processed it is used to distinguish the timing of receiving the data to be processed.
  • the time to obtain the data to be processed may be during working hours or during off working hours.
  • location where the data to be processed is obtained it is used to distinguish the location where the data to be processed is received, for example, the location to obtain the data to be processed may be in a room or in a vehicle.
  • the information about the device that obtains or outputs the data to be processed is used to distinguish the device that obtains or outputs the data to be processed, for example, whether the device that obtains or outputs the data to be processed is an associated device.
  • determining at least one target application or target service may be: determining the application or service that matches the time to obtain the data to be processed as the target application or service, for example, if the time to obtain the data to be processed If it is off-duty time, the application or service located in the car is determined as the target application or service, so that the user can know in time, or, if the time to obtain the data to be processed is a rest day, the application or service located in the smart speaker
  • the service is determined as the target application or target service; or, the application or service contained in the device associated with the device that outputs the data to be processed is determined as the target application or target service, for example, if the device that receives the data to be processed is a mobile phone and a smart speaker If it is associated with the mobile phone, the application or service located in the smart speaker is determined as the target application or service. In this way, the application or service required by the user can be accurately determined as the target application or service, thereby bringing better experience to the user.
  • the relevant information of the data to be processed includes, but is not limited to: required functions, and/or applications, and/or response speed, and/or accuracy, and/or privacy level, and the like.
  • the functions required by the data to be processed it is used to distinguish the operations required to respond to the data to be processed.
  • the functions required by the data to be processed may be dialing, taking pictures, and so on.
  • the application required by the pending data it is used to distinguish the application required to respond to the pending data.
  • the application required by the pending data may be a music application for playing songs, or an application for playing TV or movies video applications, etc.
  • pending data this is used to distinguish between fast and slow responses to pending data, for example, translating data may require a faster response than playing a song.
  • the accuracy required for the data to be processed is used to distinguish the correctness of the response to the data to be processed, usually, it can be obtained through the evaluation of different users.
  • For the privacy level required for the data to be processed it is used to distinguish the level of privacy required for the response to the data to be processed. For example, the privacy level of the transfer or remittance operation may be higher than the privacy level of the phone call.
  • determining at least one target application or target service may be: determining as the target an application or service that supports the functions required by the data to be processed and whose response speed meets the response speed required by the data to be processed application or target service; or, the application or service whose privacy level meets the privacy level required by the data to be processed and supports the application required by the data to be processed is determined as the target application or target service; or, the accuracy meets the requirements of the data to be processed
  • the application or service with the required accuracy and response speed that meets the response speed required by the data to be processed is determined as the target application or target service, etc., so that the required application or service can be accurately determined as the target application or target service, and then given A better experience for users.
  • the response result to the data to be processed may be a result obtained after the processing device responds to the data to be processed, or may be an operation or voice input by a user.
  • the data to be processed is "play the sea of songs”
  • the response to the data to be processed is "the processing device cannot play the song, the associated device can play the song”
  • the application located on the associated device or The service is determined as the target application or target service; if the user continues to input the voice "play songs through the car device", the application or service located in the car device can be determined as the target application or target service.
  • Combination plan fetched operation default information scene information Information about the origin of the data to be processed Information about the data to be processed
  • Information about the data to be processed The response result of the data to be processed Combination Example 1 no yes yes no no no no Combination example 2 no yes no no yes no Combination example 3 no no yes yes yes no Combination example 4 no yes yes yes yes no ... ... ... ... ... ... ... ... ...
  • the application or service that matches the scene information (eg, currently located in the vehicle) and preset information (eg, highest priority) may be determined as the target application or target service.
  • the application or service that matches the preset information (such as being in the wake-up state) and the related information of the data to be processed (such as the function required by the data to be processed) can be determined as the target application or target service.
  • the scene information (such as currently in the vehicle), the source information of the data to be processed (such as the location where the data to be processed is obtained) and the related information of the data to be processed (such as The application or service matching the privacy level) is determined as the first target application or target service.
  • combination example 4 it can be combined with preset information (such as being in the wake-up state), scene information (such as currently in the vehicle), source information of the data to be processed (such as the location where the data to be processed is obtained) and the data to be processed
  • preset information such as being in the wake-up state
  • scene information such as currently in the vehicle
  • source information of the data to be processed such as the location where the data to be processed is obtained
  • the application or service that matches the relevant information is determined as the target application or target service.
  • the target application or target service can be determined more accurately and/or intelligently from multiple applications or services, thereby improving user experience.
  • the supported function information can respond to the data to be processed, whether the usage scenario matches the current scenario, whether the running status is running or not running, and other information, from at least two applications or determine at least one target application or target service in the service.
  • the data to be processed is the voice "Please play the song Motherland" input by the user in the vehicle, and the vehicle includes the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone.
  • the human-computer interaction application A can be determined as the target application in response to the data to be processed; or, if the human-computer interaction application A is due to If the navigation service is being provided and the human-computer interaction application B is not running, the human-computer interaction application B can be determined as the target application to respond to the data to be processed; or, if the user's gaze direction is A In the direction of the human-computer interaction application, the human-computer interaction application A may be determined as the target application to respond to the data to be processed.
  • the step S1 includes: if the processing device is not a control center, executing step S11a; and/or,
  • step S11b determine whether there is an associated device, and if there is an associated device, determine at least one target application or target service from the associated device.
  • the processing device determines whether there is an associated device, and if there is an associated A device, determining at least one target application or target service from the associated device.
  • the processing device when used as the control center, it may only be responsible for interacting with the user alone, and then it controls other devices to perform corresponding operations, that is, the processing device may only serve as the control center and cannot respond to the data to be processed. Therefore, After the processing device obtains the data to be processed, it may respond to the data to be processed through an associated device associated with the processing device, then first judge whether there is an associated device in the processing device, and if there is an associated device, then from the At least one target application or target service is determined in the associated device.
  • the processing device as a mobile phone as an example, assuming that the data to be processed is the voice "turn on the air conditioner" input by the user, if the mobile phone is associated with the air conditioner, the target for responding to the data to be processed can be determined from the air conditioner. application or target service. It can be understood that the associated device may include a device capable of invoking corresponding functions, applications, and services, or a device that is bound to a processing device and logged in with the same account, or a device that has other relationships with the data to be processed.
  • the determining at least one target application or target service from the associated device includes at least one of the following:
  • the application or service that can respond to the data to be processed is determined as the target application or target service; and/or,
  • At least one target device is determined according to a preset rule, and an application or service in the at least one target device that can respond to the data to be processed is determined as a target application or a target service.
  • the user’s mobile phone may only be associated with the TV at home, or it may be associated with the TV at home, and also be associated with equipment such as air conditioners and smart speakers at home.
  • the associated device may only have One application or service may also have multiple applications or services, and in this case, the target application or target service needs to be determined according to the actual situation.
  • information such as functions and/or applications required by the data to be processed may be combined with the information of the multiple associated devices The application or service is matched, and the application or service that can respond to the data to be processed is determined as the target application or target service.
  • At least one target device can be determined based on the number of times of use, remaining power level, operating status, processing capability, etc., and then the at least one target device that can respond to the pending The application or service of the data is determined as the target application or target service.
  • the associated device with the most usage times, and/or the most remaining power, and/or the operating state is not running, and/or the strongest processing capability may be determined as the target The device then determines the target application or target service from the target device based on information such as functions and/or applications required by the data to be processed.
  • the determining at least one target device according to preset rules includes at least one of the following:
  • At least one associated device whose device environment information satisfies the eighth preset condition is taken as the target device.
  • the user's physiological parameter information includes the user's heart rate, blood pressure, pulse, blood oxygen, blood sugar, sweating, etc.
  • the above user's physiological parameter information can be measured by the corresponding sensor in the device, for example, through the smart watch
  • the optical heart rate sensor measures the user's heart rate.
  • the user's physiological parameter information satisfies the first preset condition, which may be that the user's physiological parameter reaches the preset user's physiological parameter threshold, for example, the user's heart rate reaches the preset user's heart rate threshold; or, in another implementation scenario, it may be possible to detect
  • the device associated with the user's heart rate is used as the target device. In this way, the target application or target service can be determined more intelligently, thereby giving the user a better experience.
  • Device system information which can be: system type, system name, system status, etc.
  • system type it is used to distinguish different types of systems, such as Android system, Symbian system, Apple system, etc.
  • another example is a deep customization system based on Android system (such as MIUI (Mobile Internet UI, millet mobile phone operation system))
  • MIUI Mobile Internet UI, millet mobile phone operation system
  • different systems will provide users with different services during operation, for example, the operating mechanisms of the Apple system and the Android system are different.
  • system name it is used to specifically distinguish whether the systems are the same system and to determine the specific information of the system, for example, the system name of the system is "Android system", it can be understood that it specifically specifies the system as "Android system”, rather than other systems.
  • system name may also include a complete name, for example, the name includes a system version number.
  • the system state it can be the operating state of the system, such as freeze, smooth, sleep, crash, standby, etc.
  • the device system information meets the second preset condition, which can be: the device system information meets the preset device system information rules. For example, if the system status is non-stuck (such as smooth, fast, extreme speed, etc.), the system status meets the preset device System information rules; in another implementation scenario, devices belonging to the same system type (such as Apple, Hongmeng, Android, etc.) are more compatible with each other. If the associated devices belonging to the same system type can be preferentially determined as target device, it can bring a better experience to users.
  • the system status is non-stuck (such as smooth, fast, extreme speed, etc.)
  • the system status meets the preset device System information rules
  • devices belonging to the same system type such as Apple, Hongmeng, Android, etc.
  • the associated devices belonging to the same system type can be preferentially determined as target device, it can bring a better experience to users.
  • Device communication information can be: device communication signal strength, device communication mode (such as Bluetooth, WIFI, NFC, etc.), device communication distance, etc.
  • device communication mode such as Bluetooth, WIFI, NFC, etc.
  • the device communication information meets the third preset condition, which may be: the associated device communication information meets the preset device communication information rules, for example, when the device communication signal strength is greater than or equal to the preset signal strength threshold, the device communication signal strength meets the preset device Communication information rules, generally speaking, the stronger the signal strength, the smoother the interaction between devices and the better the user experience.
  • the device application information may be: device application name information, etc. It can be understood that the application name can be used to distinguish the application, that is, the application can be identified by the application name.
  • the device application information satisfies the fourth preset condition, which means that the associated device application information satisfies the preset device application information rules.
  • the device application name information meets the preset response operation trigger conditions (for example, it is recognized by the application name that the device is running some preset When setting up applications, such as games, such as WeChat, etc.), the application data information of the device meets the preset device application information rules.
  • the more preset applications are running on the associated device it generally means that the associated device is being used by the user ( Frequent) use, which helps to determine the target application or target service more intelligently, thereby giving users a better experience.
  • the reminder information is used to remind the user to prevent the user from forgetting the corresponding event information, for example, remind the user that the scheduled TV program will be played soon through the reminder information of the associated device.
  • the device reminder information satisfies the fifth preset condition. It can be that the associated device reminder information meets the preset device reminder information rules. For example, when the time and/or location information in the reminder information is consistent with the current time and/or location, the associated device The reminder information meets the default device reminder information rules; in another implementation scenario, as long as the associated device has reminder information, it can be regarded as the associated device reminder information meets the preset device reminder information rules. In this way, there will be reminder information
  • the associated device identified as the target device also helps to determine the target application or target service more intelligently, because the reason why the user sets the associated device to be reminded means that the device is more convenient for the user to operate and/or view device of.
  • the device detection information may be information for detecting the condition of the device itself, such as whether the device is in normal working state, whether the device hardware is in normal state, the current working state of the device hardware, and so on.
  • the device detection information meets the sixth preset condition, and the associated device detection information can meet the preset device detection information rules, for example, the current working state of the device hardware meets the preset working state requirements (for example, the associated device software and/or hardware working status is normal) , the current working status of the device hardware satisfies the preset device detection information rules. In this way, it is possible to avoid identifying an associated device with an abnormal working status as the target device, thereby bringing a better experience to the user.
  • the preset device detection information rules for example, the current working state of the device hardware meets the preset working state requirements (for example, the associated device software and/or hardware working status is normal) , the current working status of the device hardware satisfies the preset device detection information rules.
  • Device status information which can be: running status, power information, fault information, etc.
  • the device can be in the normal running state, stuck state, unsmooth state, etc.
  • the power information generally, it can be the current power, the total battery capacity, the ratio of the remaining power, or the estimated usable time based on the user's usage habits in the near future (for example, within 8 hours).
  • the fault information can be the fault log of the equipment.
  • the fault information can include the cause of the fault, the type of fault, the time of the fault, the frequency of the fault, etc., so that the equipment or engineering and technical personnel can use the fault information to repair or repair. optimization.
  • the device status information satisfies the seventh preset condition, and the associated device status information can meet the preset device status information rules, for example, the power is greater than or equal to a preset threshold (such as 20%), so that low power and/or card failure can be avoided.
  • a preset threshold such as 20%
  • the device environment information may be: device external environment information, device usage environment information, and the like.
  • the device has the ability to obtain the external environment information, such as obtaining the brightness of the external ambient light, or obtaining the loudness of the external environmental noise.
  • the use environment information changes with the user's environment.
  • the user's environment can be detected by sensors (such as gravity sensors, acceleration sensors, gyroscopes, cameras, GPS, etc.). Perception, if the user is in motion, the device can detect that the user is in a motion environment, or if the user is driving, the device can detect that the user is in a driving environment, or if the user is in a work or meeting, the device can detect that the user is in a work or meeting in environment.
  • the device environment information satisfies the eighth preset condition, and the associated device environment information can satisfy the preset device environment information rules.
  • the associated device such as a car, bicycle, motorcycle, etc.
  • the associated device that the user is exercising is used as the target device.
  • associated devices that meet the second preset condition (such as belonging to the same system type, such as Apple system) and the third preset condition (such as the communication signal strength greater than or equal to the preset signal strength threshold) can be determined for the target device.
  • associated devices that meet the fourth preset condition such as running a preset application, such as a game or WeChat
  • the sixth preset condition such as software and/or hardware working normally
  • the third preset condition (such as the communication distance is less than or equal to the preset distance value, such as 5 meters) and the seventh preset condition (the power is greater than or equal to the preset threshold value, such as 20% ) associated device is determined as the target device.
  • the second preset condition (such as belonging to the same system state, such as smoothness) and the third preset condition (such as the communication methods are all Bluetooth) and the eighth preset condition (the user is driving or motion) is identified as the target device.
  • the target device can be determined more accurately and/or intelligently from multiple associated devices, thereby improving user experience.
  • the step S11a includes: determining at least one piece of processing information according to the relevant information of the data to be processed, and determining a first target application or target service according to the at least one piece of processing information; and/or, in response to A response result of the first target application or target service to the data to be processed determines a second target application or target service.
  • At least one piece of processing information can be determined by parsing the relevant information of the data to be processed, and the processing information can include the applications, and/or services, and/or functions, and/or processing objects, and/or associated devices, and/or processing device information, etc., and according to the at least one processing information, it can be determined to respond to the pending A first target application or target service that processes the data. Since the first target application or target service may not be able to directly and completely respond to the data to be processed, at this time, further cooperation with the second target application or target service may be required to fully respond to the data to be processed.
  • the first target application or target service and the second target application or target service may be the same or different applications or services, or may be the same type or different types of applications or services.
  • the processing device as an in-vehicle device as an example, assuming that the data to be processed is the voice input by the user "Please call Xiao Li" and the human-computer interaction application A installed in the in-vehicle device supports the dialing function, Then the human-computer interaction application A can be determined as the first target application or target service. If Xiao Li’s phone number is not stored in the car, the human-computer interaction application A cannot make a call to Xiao Li normally.
  • the human-computer interaction application B that is set in the mobile phone and supports invoking contact information is determined as the second target application or target service. Based on the response result, it can be determined that at least one second application or service participates in control, processing and decision-making, further improving data security and interaction effect.
  • the step S11a includes: acquiring at least one piece of processing information; if there is only one piece of processing information, determining at least one first application or service that can respond to the processing information, according to the first determination strategy, from the Determine the target application or target service among the at least one first application or service; and/or, if there are at least two processing information, determine at least one second application or service that can partially and/or completely respond to the processing information
  • the service determines a target application or target service from the at least one second application or service according to a second determination strategy.
  • the first determination strategy and the second determination strategy may be the same or different.
  • the determined amount of processing information may also be different. For example, if the data to be processed is the voice "please turn on the air conditioner", the corresponding determined processing information is to turn on the air conditioner. That is, there is only one processing information; if the data to be processed is the voice "please turn on the air conditioner and TV", then the corresponding determined processing information is to turn on the air conditioner and turn on the TV, that is, there are two processing information.
  • at least one piece of processing information may be acquired according to source information of the data to be processed, and/or related information of the data to be processed, and/or a response result to the data to be processed.
  • the application or service that can respond to the processing information may be that the application or service can process the processing information based on its own supported function information, or that the application or service can process the processing information by controlling other applications or services.
  • the data to be processed acquired by the processing device is the voice "please turn on the air conditioner”
  • the first application or service set on the air conditioner can turn on the air conditioner and the second application or service set on the smart speaker can control the If the first application or service is used, both the first application or service and the second application or service may be determined as target applications or target services.
  • the user may only need one or part of the applications or services to respond to the data to be processed, then in combination with the first determination strategy Determining a target application or target service from the at least one first application or service, for example, selecting a first application or service with a high priority and/or in an awake state as the target application or target service.
  • preset information and/or scene information and/or user habits can be combined.
  • the preset sorting method and the preset condition can be set according to actual needs, for example, the preset sorting method can be sorted in order of priority from low to high or from high to low , the preset condition may be to select the top N applications or services with the highest priority as target applications or target services.
  • the at least one second application or service includes the human-computer interaction application A set on the mobile phone and the human-computer interaction application B set on the speaker
  • the priority of the B human-computer interaction application may be higher than the priority of the A human-computer interaction application to improve user experience; if the current scene type is If the environment is closed and there are many users, the priority of the A human-computer interaction application may be higher than that of the B human-computer interaction application to avoid information leakage.
  • the second application or service whose running state is not running may be determined as the target application or target service, so as to avoid affecting the running state as running Other second applications or services can work normally, or the second application or service whose running state is running can be determined as the target application or target service, so as to reduce wake-up operations and save resource consumption.
  • step S1 it includes: determining at least one application or service management center. Further, before the step S1, the method may further include: if the processing device is a control center, determining at least one application or service management center according to a preset determination strategy.
  • one of the multiple voice assistant applications may be selected as the management center according to a preset determination strategy, wherein the preset determination strategy may include the following: At least one: the application with the highest authority, the highest priority, according to user selection, the highest frequency of use, the highest user score, and the most powerful processing function.
  • the processing device can automatically scan the processing device itself and /or associate the applications or services installed in the device, and add the applications or services that meet the requirements to the application or service management center, or the user can manually add the application or service in the application or service management center, or add the application or service to the added Configure and manage the permissions of applications or services, and visually display the enabled permissions and/or supported processing functions of each application or service.
  • the step S1 further includes: in response to obtaining the data to be processed, determining at least one target application or target service, and displaying the at least one target application or target service corresponding to the at least one target application or target service in the application or service management center Default interface.
  • the human-computer interaction interface of the at least one target application or target service can be displayed in the interface of the application or service management center in the form of pop-up windows, floating windows, cards, embedding, etc. , the human-computer interaction interface is used to display the data to be processed and/or response results.
  • the interface of the application or service management center displays the first application corresponding to the human-computer interaction interface of the first application.
  • a card and a second card corresponding to the human-computer interaction interface of the second application so that the first card and the second card can dynamically display the response results of the data to be processed by the first application and the second application.
  • the interface of the voice assistant management center in the mobile phone will display the interactive interface of the mobile phone voice assistant in the form of a card at the same time
  • the interactive interface with the voice assistant of the speaker in which the interactive interface of the voice assistant of the mobile phone displays "The following versions of "Chengdu” have been found for you, which version do you want to listen to?"
  • the interactive interface of the voice assistant of the speaker displays "OK, I will play it for you soon "Chengdu” by Zhao Lei”.
  • the method further includes: performing preset processing on the target application or target service in response to a preset operation on the preset interface.
  • the application or service management center may also control or interact with the determined target application or target service, which specifically may include at least one of the following:
  • the first target application or target service corresponding to the first preset interface and the second target application or target service corresponding to the second preset interface Services merged into Super Apps or Services;
  • the application or service corresponding to the preset interface is deleted from the application or service management center.
  • the application or service management center Based on the setting and interactive operation of the application or service management center, it can not only facilitate the management and human-computer interaction of the application or service of the processing device itself, but also use the user interface to visually display the human-computer interaction of each application or service Interface, so that users can more intuitively and clearly know the control and response results of the application or service in the associated device connected to the processing device, which is for associated devices without display screens (such as smart speakers, smart air conditioners, etc.) It can provide a better user control experience.
  • the step S2 includes: transferring the data to be processed, and/or the processing request obtained based on the data to be processed, and/or the response result obtained based on the data to be processed, to a preset transmission Policies are output to the target application or target service to cause the target application or target service to respond.
  • the preset transmission strategy can be set according to actual needs, such as simultaneous output, interval output, and the like. Understandably, if the target application or the target service responds to the data to be processed, there is no interference with each other, for example, one of the at least one target application is used to control the air conditioner, and the other target application is used to control the air conditioner. TV, or the response results can complement or enhance each other, for example, the at least one target application is used to play the same song, at this time, the data to be processed can be output to the target application or target service at the same time.
  • the target application or the target service interferes with each other when responding to the data to be processed, for example, one of the at least one target application is used to control the vehicle to close the navigation application, and the other target application is used to control the mobile phone To make a call, at this time, the interval between the data to be processed can be output to the target application or target service, for example, firstly control the car machine to close the navigation application, and then control the mobile phone to make a call.
  • the device where the target application or target service resides may have received the data to be processed, for example, the device where the target application or target service resides and the processing device are both in the vehicle, and the data to be processed The processed data is the voice data sent by the user in the vehicle.
  • the processing device may only output the processing request obtained based on the data to be processed and/or the response result obtained based on the data to be processed to the The target application or target service, so that the target application or target service responds to the data to be processed after receiving it.
  • the target application or target service includes at least one first target application or target service and at least one second target application or target service
  • the S2 step includes at least one of the following:
  • first target application or target service and the second target application or target service belong to the same device, perform processing according to a first preset policy; and/or,
  • processing is performed according to a second preset policy.
  • the target application or target service includes at least one first target application or target service and at least one second target application or target service
  • the at least one first target application or target service and at least one The second target application or target service may or may not belong to the same device, and in this case, a corresponding preset policy may be used in combination with specific circumstances for corresponding processing.
  • the first preset policy and the second preset policy may be set according to actual needs, for example, when the first target application or target service and the second target application or target service belong to the same device, In the case that both can fully respond to the data to be processed, the first target application or target service or the second target application or target service may be randomly awakened to respond to the data to be processed, or output a prompt message, The user can select a target application or target service for responding to the data to be processed.
  • the first target application or target service and the second target application or target service do not belong to the same device and both can fully respond to the data to be processed
  • the first target application or target service may be controlled
  • the service and the second target application or target service respectively respond to the data to be processed, or select a corresponding application or service from among them according to the processing capability of the device to respond to the data to be processed.
  • the data to be processed is the voice input by the user in the vehicle "play the song Hai Hai Hai"
  • the target application or target service includes A human-computer interaction application set on the car machine and B set on the user's mobile phone
  • the human-computer interaction application can simultaneously control the A human-computer interaction application and the B human-computer interaction application to wake up or run, so as to respectively respond to the data to be processed, so that the mobile phone and the car simultaneously play the song Dahai, thereby enhancing the song playback effect.
  • the processing according to the first preset policy includes at least one of the following: waking up the first target application or target service and/or the second target application or target service according to the first wake-up policy; Run the first target application or target service and/or the second target application or target service according to the first execution policy; exit the first target application or target service and/or the second target according to the first exit policy an application or a target service; outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a first output policy;
  • the processing according to the second preset strategy includes at least one of the following: waking up the first target application or target service and/or the second target application or target service according to a second wakeup strategy; Run the first target application or target service and/or the second target application or target service according to the second execution policy; exit the first target application or target service and/or the second target according to the second exit policy An application or a target service; outputting a response result corresponding to the first target application or target service and/or the second target application or target service according to a second output strategy.
  • the wake-up strategy includes at least one of the following: sequential wake-up based on the priority of the application or service, sequential wake-up based on the distance from the device where the application or service is located, and simultaneous wake-up; and/or,
  • the running strategy includes at least one of the following: running sequentially based on the wake-up time of the application or service, running sequentially based on the network status of the device where the application or service is located, and running simultaneously; and/or,
  • the output strategy includes at least one of the following: sequential output based on the priority order of the application or service, sequential output based on the content of the response result, and simultaneous output; and/or,
  • the exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit.
  • the target application or target service includes a human-computer interaction application A and a human-computer interaction application B
  • the human-computer interaction application A can be woken up first, and then the human-computer interaction application B can be woken up; and/or, if the distance between the device where the human-computer interaction application A is located and the processing device is smaller If the distance between the human-computer interaction application A can be woken up first, then the human-computer interaction application B can be woken up; Run the A human-computer interaction application, and then run the B human-computer interaction application; and/or, if the network status of the device where the B human-computer interaction application is located is better than the network status of the device where the A human-computer interaction application is located, you can first wake up the A HMI Interactive application, and then wake up B human-computer interaction application; and/or, if the content of the response result of
  • the step S2 further includes: outputting the response information according to a preset output policy in response to receiving the response information sent by the target application or target service.
  • the processing device may serve as a control center to control the target application or target service to respond to the data to be processed, and to control the output of response information of the target application or target service to the data to be processed.
  • the preset output strategy can be set according to actual needs, such as simultaneous output or sequential output.
  • the processing device may also control the target application or target service to output response information according to a preset output strategy.
  • the outputting the response information according to the preset output strategy includes at least one of the following: according to the order of receiving time, and/or the priority order of the target application or target service, and/or the current scene, And/or the received operation information, and/or the device corresponding to the response information, outputs the response information, and/or outputs the processed response information.
  • the order of receiving time it is used to distinguish the sequence of the response information returned by the target application or target service. For example, the time when the processing device receives the response information returned by the human-computer interaction application A is earlier than the response information returned by the human-computer interaction application B. time, or the processing device simultaneously receives the response information returned by the human-computer interaction application A and the human-computer interaction application B.
  • Outputting the response information according to the order of receiving time may be: outputting the response information sequentially according to the order of receiving time, or outputting the response information simultaneously.
  • the priority order of the target application or target service is used to distinguish the importance of the target application or target service.
  • Outputting the response information according to the priority order of the target application or target service may be: outputting the response information sequentially according to the priority order of the target application or target service, that is, outputting the response information with a higher priority first
  • the response information corresponding to the target application or target service and then output the response information corresponding to the target application or target service with a lower priority.
  • Outputting the response information according to the current scene may be: determining an output mode according to the current scene, and outputting the response information in the output mode. For example, assuming that the current scene is inside a vehicle, if there is only the user in the vehicle, the response information can be directly output in voice; if there are other users in the vehicle, the response information can be output in text.
  • Outputting the response information according to the received operation information may be: determining an output mode according to the received operation information, and outputting the response information in the output mode, for example, if the processing device receives the user's voice operation information "to Text output", output the response information in text; or determine an output device according to the received operation information, so as to output the response information through the output device.
  • outputting the response information may be: sequentially outputting the response information according to the priority of the device corresponding to the response information, or, according to the relationship between the device corresponding to the response information and the processing device Output the response information and so on sequentially according to the distance between them.
  • Combination plan Receiving chronological order priority order current scene received operational information
  • the device corresponding to the response information Combination Example 1 yes no yes no no no Combination example 2 no yes yes no no Combination example 3 yes no yes yes no ... ... ... ... ... ... ...
  • the response information may be output according to the order of receiving time (for example, the way of outputting in sequence according to the time of receiving) and the current scene (for example, the way of voice output).
  • the response information may be output according to the priority order of the target application or target service (for example, the way of outputting in order of priority) and the current scene (for example, the way of text output).
  • the response information can be output according to the order of receiving time (such as the output method according to the order of receiving time), the current scene (such as the voice output method) and the received operation information (such as specifying the output device) .
  • response information can be output more flexibly and/or intelligently, thereby improving user experience.
  • the processing device receives the response information sent by the human-computer interaction application A and the human-computer interaction application B respectively, if the response information sent by the human-computer interaction application A is received earlier than the response information sent by the human-computer interaction application B information, you can first output the response information sent by the human-computer interaction application of A, and then output the response information sent by the human-computer interaction application of B; if the current scene of the processing device is a scene with multiple people and the response information involves privacy information, the response information may be processed and then output, for example, the response information in audio form is converted into the response information in text form.
  • step S2 further includes at least one of the following: if the target application or target service is a system-level application or service, performing corresponding processing according to a third preset strategy; if the target application or target service is The third-party application or service is processed according to the fourth preset policy.
  • the determined at least one target application or target service may belong to a system-level application or service, or may belong to a third-party application or service.
  • a corresponding preset policy may be used in combination with specific situations for corresponding processing.
  • the third preset policy and the fourth preset policy can be set according to actual needs, for example, if the target application or target service belongs to a system-level application or service, then the target application or target service has a system-level In addition to responding or processing the data to be processed, it can call other third-party applications or services to respond or process the data to be processed. Optionally, it is assumed that the data to be processed is that the user enters the voice "navigate to the most popular restaurant nearby" on the mobile phone.
  • the system voice assistant calls the third-party application installed in the mobile phone, such as Meituan, Dianping, etc., to obtain The address of the restaurant with the highest food popularity ranking in the surrounding area currently located in the third-party application, and then the system voice assistant outputs the navigation route according to the address. If the target application or service belongs to a third-party application or service, the third-party application or service only has partial permissions (such as user-defined permissions), and the third-party application or service is only treated within the scope of its permissions. Process data for response or processing.
  • the third-party application installed in the mobile phone such as Meituan, Dianping, etc.
  • the data to be processed is a voice command issued by the user to the navigation application in the vehicle "send a message to Xiao Li and ask him to wait for me in Hall 1 of the conference center", and since the vehicle navigation application does not have the ability to obtain contacts If you have the permission, it can complete the message editing of "Please wait for me in Hall 1 of the conference center", and then output the voice prompt message "I do not have the contact permission, please manually select the contact or activate the permission".
  • the response or processing of the data to be processed by at least one target application or target service can be made more intelligent, and the privacy of the user can be fully protected.
  • Fig. 18 is a schematic diagram of an interface of a processing device in a scenario according to the first embodiment.
  • the scene shown in the illustration is a scene of playing songs, and the application or service is a voice assistant and the voice assistant is used as an example for illustration.
  • (a) in Figure 18 shows the interface of voice assistant A.
  • Voice assistant A prompts "You said, I'm listening" at this time. At this time, the user can input instructions by voice.
  • the device interface displays the content entered by the user "play the song motherland" to prompt the user, and, based on the data to be processed entered by the user, the determined strategy is: wake up or run the voice assistant A on the processing device and the voice assistant on the third-party device B plays the song "Motherland” at the same time, and then outputs the prompt message "Voice Assistant A and Voice Assistant B have been assigned to play the song "Motherland”.
  • the interface shown in (b) in Figure 18 is the interface of the processing device; after that, the processing device wakes up or runs the voice assistant A and voice assistant B play the song “Motherland” at the same time, as shown in (c) in Figure 18, and display "Voice Assistant A and Voice Assistant B are playing the song “Motherland” sung by Liu Chang", as shown in (c) in Figure 18
  • the display interface can also prompt the user for relevant instructions, "You can say: change to another singer; a cappella version", prompting the user to input instructions based on the reminder content, improving interaction efficiency. In this way, in the scene of playing songs, using the functions or capabilities of different voice assistants can improve the interactive experience.
  • Fig. 19 is a first schematic diagram of the application or service processing method shown in the first embodiment.
  • the processing device 201 is provided with a voice assistant A
  • the first device 202 is provided with a voice assistant B
  • the second device 203 is provided with a voice assistant C
  • the processing device 201, the first device 202, and the second device 203 can be connected through a network
  • the network includes a wireless network for short-distance transmission, such as Bluetooth and WiFi may also include the mobile operator's network, and may also include a cloud-based data transmission network, so as to realize data transmission among the processing device 201, the first device 202, and the second device 203 through the network.
  • FIG. 20 is a schematic diagram of an interface of a processing device in another scenario according to the first embodiment.
  • the scene shown in the figure is the scene of making a phone call.
  • (a) in Figure 20 shows the interface of the processing device.
  • the processing device prompts "You said, I am listening" at this time. At this time, the user can input commands by voice.
  • the instructions that the processing device can accept are more abundant, and there is no need to prompt the user for input content; after that, as shown in (b) in Figure 20 , the processing device interface displays the content input by the user "Call Zhang San's phone number" to prompt the user, and, assuming that voice assistant A and voice assistant B have the right to make calls, and voice assistant A cannot be used to make calls in the current scenario, the voice assistant C does not have the right to make a call.
  • the determined strategy is: wake up or run voice assistant B to make a call, wait for a delay to use voice assistant A to make a call, and output a prompt message "Voice assistant cannot be used in the current scenario A and C, you can say: voice assistant B to dial; delay waiting to use voice assistant A to dial", the interface shown in (b) in Figure 20 can be the interface of the processing device; after that, as shown in Figure 20 (c) When the user selects the voice assistant B to make a call or fails to respond after a timeout, wake up or run the voice assistant B to execute the instruction of making a call, and display a prompt screen for making a call on the interface of the processing device.
  • voice assistant A when voice assistant A can be used in subsequent scenarios, voice assistant A will be woken up or run to execute the instruction to make a call, and the call will be displayed on the interface of the processing device. prompt screen, when it is necessary to make a call next time, the decision-making process shown in (b) in Figure 20 will still be carried out. In this way, in the scenario of making a phone call, the use of different voice assistants is allocated according to the usage scenarios and permissions, and added to the user's decision-making process, which can improve the interactive experience.
  • Fig. 21 is a schematic diagram of a scene of an application or service processing method according to the first embodiment.
  • a voice assistant A is set on the processing device 301, and a The voice assistant B is set, and the processing device 301 and the associated device 302 can be connected through a network.
  • the network includes a wireless network for short-distance transmission, such as Bluetooth, WiFi, or a network of a mobile operator, or a cloud-based A data transmission network, so as to implement data transmission between the processing device 301 and the associated device 302 through the network.
  • the scene shown in Figure 22 is the game reminder scene, and (a) in Figure 22 shows the interface of voice assistant A on the processing device.
  • the user can input instructions by voice. Since this application can integrate the functions and interaction capabilities between different devices and/or different applications or services, the instructions that the processing device 301 can accept are more abundant, and there is no need to prompt the user for input content ; Afterwards, as shown in (b) in Figure 22, the interface of the processing device 301 displays the content input by the user "Open King of Glory" to prompt the user, and, assuming that the processing device 301 or the voice assistant A does not have the permission to open, the voice assistant B has the permission to open, and the strategy determined based on the content entered by the user is: wake up or run the voice assistant B to request the permission to open.
  • a prompt message "Requesting permission from the associated device 302, please wait"
  • the voice assistant B on the associated device 302 displays a prompt "Processing the request of the associated device 302 Open “Glory of the King” and prompt the user for relevant instructions, "Allow; Not Allow", by prompting the user for instructions that can be entered based on the reminder content, the interaction efficiency is improved.
  • the voice assistant B Based on the user's operation on the voice assistant B, for example, the user enters the voice "Allow", the processing result will be obtained.
  • the voice assistant A can be processed based on the processing result, that is, it is allowed to open the glory of the king, and the voice can be turned off after the glory of the king is turned on.
  • Assistant A and Voice Assistant B In this way, in the game reminder scenario, based on the permissions of different devices and voice assistants, it can provide an accurate interactive experience and ensure data security.
  • the application or service processing method of the present application is applied to a processing device, and includes the following steps: in response to obtaining data to be processed, determining at least one target application or target service; in response to the target application or target service, according to a preset policy Take appropriate action.
  • the application After obtaining the data to be processed, the application first determines at least one target application or target service, and then processes the determined target application or target service, which can improve the accuracy and/or response of the data to be processed after obtaining the data to be processed Improve the interaction effect and enhance the user experience.
  • Fig. 23 is a schematic flowchart of a method for processing applications or services according to the eighth embodiment. As shown in Figure 23, the application or service processing method of this application is applied to a processing device, including the following steps:
  • S20 wake up or run a second target application or target service of the associated device
  • S30 In response to the preset operation, process the first target application or target service according to a first preset policy; and/or process the second target application or target service according to a second preset policy.
  • the processing device may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.).
  • the application or service may include a human-computer interaction application, and the human-computer interaction application includes an application or service that can perform human-computer interaction through touch operations, voice, touch gestures, air gestures, etc. (such as smart assistants, etc.), Other similar applications or services are also possible.
  • the first target application or target service may be set on the processing device or other devices (such as devices associated with the processing device, etc.).
  • the first target application or target service and/or the second target application or target service include voice assistant applications, social media applications, information content applications, tool applications, and system services at least one.
  • the first target application or target service and the second target application or target service may be the same or different applications or services, or may be the same type or different types of applications or services.
  • first wake up or run the second target application or target service of the associated device and then execute the first target application or target service and/or the second target application or
  • the processing of the target service can make full use of the functions and interaction capabilities of different applications or services, improve the interaction effect, and enhance the user experience.
  • the second target application or target service and the first target application or target service for example, when the father's mobile phone receives the transfer request sent by the son, the transfer request is sent to the son's mother, so that the son's mother can process the request and/or, wake up or run the second target application or target service in response to the processing request of the first target application or target service, and control the first target application or target service to output the response result of the second target application or target service or control the first target application or target service A target application or target service closes or exits.
  • the step S10 includes: step S110a: in response to obtaining the data to be processed, according to the obtained operation, and/or preset information, and/or scene information, and/or the source information of the data to be processed, and/or related information of the data to be processed to determine the first target application or target service.
  • the acquisition of the data to be processed by the processing device may be that the processing device receives the data to be processed input by the user, or it may be that the processing device receives the data to be processed input by the user sent by other devices.
  • the data to be processed includes, but is not limited to: voice data, touch or air gesture data, body movement data, or data after processing these data, for example, it may be a control instruction obtained after processing voice data.
  • the acquired operations include but are not limited to: information such as touch gesture operations, air gesture operations, and voice operations.
  • the above operation information can be collected through corresponding sensors in the device or image or voice acquisition devices, for example, Air gestures can be obtained through the camera in the mobile phone or the voice input by the user can be obtained through the microphone.
  • determining the first target application or target service may be: selecting the application or service that matches the obtained operation as the first target application or target service, for example, matching the application with the palm open air gesture or service as the first target application or target service, or use the application or service that matches the touch position of the touch gesture as the first target application or target service, etc., so that the first target application or target can be determined more accurately service, thereby giving users a better experience.
  • the preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, and the like.
  • historical usage information it is used to distinguish user usage habits, including but not limited to: historical usage times, historical usage time, historical usage locations, etc.
  • supported function information it is used to distinguish the functions that the application or service can implement, for example, whether it supports reading contacts, whether it supports calling a camera function, and so on.
  • the running status information it is used to distinguish the running status of the application or service, for example, whether it is closed, running in the foreground or running in the background.
  • For device information it is used to distinguish the identity and/or status of the device where different applications or services are located, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, or associated devices, etc. ), remaining power information, remaining network traffic, network status, etc.
  • device identity information such as master device and slave device, or control center and non-control center, or associated devices, etc.
  • remaining power information remaining network traffic, network status, etc.
  • For permission information it is used to distinguish the usage permissions of different applications or services, including but not limited to: priority, callable applications or services, etc. For example, applications or services with different priorities have different usage sequences, or different The third-party applications that an application or service can call are different.
  • determining the first target application or target service may be: the priority, and/or supported function information, and/or running status information, and/or device information, and/or permission information meet the preset
  • the application or service of the condition is determined as the first target application or service, for example, the application or service whose supported function can respond to the data to be processed is determined as the first target application or service, or the application or service with the highest priority Determining as the first target application or service, or determining an application or service running in the foreground or awakened as the first target application or service, or determining an application or service of an associated device as the first target application or service , or, determine the application or service that has a relatively large remaining power of the device and that supports functions that can respond to the data to be processed as the first target application or target service.
  • the scene information may include at least one of the following information: location type, time information, number of users, user identity, scene image, and the like.
  • location type it is used to distinguish the space where the user is currently located, including but not limited to: closed environment (such as inside the room, inside the vehicle, etc.), open environment (such as outside the room, playground, etc.), and the location type can be passed through the sensor (such as gravity sensor, acceleration sensor, gyroscope, camera, GPS, etc.) to perceive.
  • time information it is used to distinguish the current date or time period, such as day or night, morning or afternoon, etc.
  • number of users it is used to distinguish how many users are around the device. For example, there may be only one or multiple users.
  • the number of users can be sensed by sensors (such as cameras, microphones, etc.), such as only one sound source is detected , indicating that there is only one user.
  • sensors such as cameras, microphones, etc.
  • For user identity it is used to distinguish the user's personality characteristics, including but not limited to: age type, gender, occupation type, etc.
  • For the scene image it is used to distinguish the specific environment of the device or the specific image of the user. For example, the user's gaze direction and/or gesture direction and other information can be obtained according to the user's image.
  • determining the first target application or target service may be: determining the application or service corresponding to the user's gaze direction as the first target application or target service, for example, the user's gaze direction is towards A human-computer interaction application , determine the A human-computer interaction application as the first target application; or determine the application or service that matches the current location type as the first target application or service, for example, when the user is in the vehicle, it will be located in the vehicle or determine the application or service that matches the current time and current location type as the first target application or service, etc., so that the target application or service can be more accurately determined Target service, and then give users a better experience.
  • the source information of the data to be processed includes, but is not limited to: time and location for obtaining the data to be processed, information about a device that obtains or outputs the data to be processed, and the like.
  • time to obtain the data to be processed it is used to distinguish the timing of receiving the data to be processed.
  • the time to obtain the data to be processed may be during working hours or during off working hours.
  • location where the data to be processed is obtained it is used to distinguish the location where the data to be processed is received, for example, the location to obtain the data to be processed may be in a room or in a vehicle.
  • the information about the device that obtains or outputs the data to be processed is used to distinguish the device that obtains or outputs the data to be processed, for example, whether the device that obtains or outputs the data to be processed is an associated device.
  • determining the first target application or target service may be: determining the application or service that matches the time when the data to be processed is acquired as the first target application or target service, for example, if the data to be processed is acquired If the time is off-duty, the application or service located in the car will be determined as the first target application or service, so that the user can know in time, or, if the time to obtain the data to be processed is a rest day, the application or service located in the smart speaker The application or service within is determined as the first target application or target service; or, the application or service included in the device associated with the device outputting the data to be processed is determined as the first target application or target service, for example, if the to-be-processed If the data device is a mobile phone and the smart speaker is associated with the mobile phone, the application or service located in the smart speaker is determined as the first target application or target service. In this way, the application or service required by the user can be accurately determined as the target application or service, thereby bringing
  • the relevant information of the data to be processed includes, but is not limited to: required functions, and/or applications, and/or response speed, and/or accuracy, and/or privacy level, and the like.
  • the functions required by the data to be processed it is used to distinguish the operations required to respond to the data to be processed.
  • the functions required by the data to be processed may be dialing, taking pictures, and so on.
  • the application required by the pending data it is used to distinguish the application required to respond to the pending data.
  • the application required by the pending data may be a music application for playing songs, or an application for playing TV or movies video applications, etc.
  • pending data this is used to distinguish between fast and slow responses to pending data, for example, translating data may require a faster response than playing a song.
  • the accuracy required for the data to be processed is used to distinguish the correctness of the response to the data to be processed, usually, it can be obtained through the evaluation of different users.
  • For the privacy level required for the data to be processed it is used to distinguish the level of privacy required for the response to the data to be processed. For example, the privacy level of the transfer or remittance operation may be higher than the privacy level of the phone call.
  • determining the first target application or target service may be: determining the application or service that supports the functions required by the data to be processed and whose response speed meets the response speed required by the data to be processed as the first target application or service A target application or target service; or, the application or service whose privacy level meets the privacy level required by the data to be processed and supports the application required by the data to be processed is determined as the first target application or target service; or, the accuracy meets the The application or service whose accuracy and response speed meet the response speed required by the data to be processed is determined as the first target application or target service, etc., so that the required application or service can be accurately determined as the target application Or target services, thereby bringing a better experience to users.
  • the response result to the data to be processed may be a result obtained after the processing device responds to the data to be processed, or may be an operation or voice input by a user.
  • the data to be processed is "play the sea of songs”
  • the response to the data to be processed is "the processing device cannot play the song, the associated device can play the song”
  • the application located on the associated device or The service is determined as the first target application or target service; if the user continues to input the voice "play songs through the car device", the application or service located in the car device can be determined as the first target application or target service.
  • Combination plan fetched operation default information scene information Information about the origin of the data to be processed Information about the data to be processed
  • Information about the data to be processed The response result of the data to be processed Combination Example 1 no yes yes no no no no Combination example 2 no yes no no yes no Combination Example 3 no no yes yes yes no Combination Example 4 no yes yes yes yes no ... ... ... ... ... ... ... ... ...
  • the application or service that matches the scene information (eg, currently located in the vehicle) and preset information (eg, highest priority) may be determined as the first target application or target service.
  • the application or service that matches the preset information (such as being in the wake-up state) and the relevant information of the data to be processed (such as the functions required by the data to be processed) can be determined as the first target application or target Serve.
  • the scene information (such as currently in the vehicle), the source information of the data to be processed (such as the location where the data to be processed is obtained) and the related information of the data to be processed (such as The application or service matching the privacy level) is determined as the first target application or target service.
  • combination example 4 it can be combined with preset information (such as being in the wake-up state), scene information (such as currently in the vehicle), source information of the data to be processed (such as the location where the data to be processed is obtained) and the data to be processed
  • preset information such as being in the wake-up state
  • scene information such as currently in the vehicle
  • source information of the data to be processed such as the location where the data to be processed is obtained
  • the application or service that matches the relevant information is determined as the first target application or target service.
  • the target application or target service can be determined more accurately and/or intelligently from multiple applications or services, thereby improving user experience.
  • the supported function information can respond to the data to be processed, whether the usage scenario matches the current scenario, whether the running status is running or not running, and other information, from at least two applications or determine the first target application or target service in the service.
  • the data to be processed is the voice "Please play the song Motherland" input by the user in the vehicle, and the vehicle includes the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone.
  • the human-computer interaction application A can be determined as the first target application; or, if the human-computer interaction application A is in the In the running state, if the B human-computer interaction application is not running, then the B human-computer interaction application can be determined as the first target application; The machine-interactive application is determined as the first target application.
  • step S10 includes:
  • step S110a If the processing device is not a control center, perform step S110a; and/or,
  • step S110b determine whether there is an associated device, and if there is an associated device, determine the first target application or target service from the associated device.
  • the processing device determines whether there is an associated device, if there is an associated The device is configured to determine a first target application or target service from the associated device.
  • the processing device when used as the control center, it may only be responsible for interacting with the user alone, and then it controls other devices to perform corresponding operations, that is, the processing device may only serve as the control center and cannot respond to the data to be processed. Therefore, After the processing device obtains the data to be processed, it may respond to the data to be processed through an associated device associated with the processing device, then first judge whether there is an associated device in the processing device, and if there is an associated device, then from the A first target application or target service is determined in the associated device.
  • the processing device as a mobile phone as an example, assuming that the data to be processed is the voice "turn on the air conditioner" input by the user, if the mobile phone is associated with the air conditioner, then the first response to the data to be processed can be determined from the air conditioner.
  • a target application or target service it can be understood that the associated device may include a device capable of invoking corresponding functions, applications, and services, or a device that is bound to a processing device and logged in with the same account, or a device that has other relationships with the data to be processed.
  • the step S110a includes: determining at least one piece of processing information according to the relevant information of the data to be processed; and determining a first target application or target service according to the at least one piece of processing information.
  • At least one piece of processing information can be determined by parsing the relevant information of the data to be processed, and the processing information can include the applications, and/or services, and/or functions, and/or processing objects, and/or associated devices, and/or processing device information, etc., and according to the at least one processing information, it can be determined to respond to the pending A first target application or target service that processes the data.
  • the processing device as an in-vehicle device as an example, assume that the data to be processed is the voice input by the user "Please call Xiao Li", and the human-computer interaction application A installed in the in-vehicle device supports the dialing function , then the human-computer interaction application A may be determined as the first target application or target service.
  • step S10 includes:
  • the first target application or target service meets the first preset condition in response to the received data to be processed, and/or the device where the first target application or target service is located meets the second preset condition, and/or the first target application or The response result of the target service does not meet the third preset condition, and/or the acquired operation information meets the fourth preset condition, and a processing request is sent.
  • meeting the first preset condition includes but is not limited to: the privacy level is greater than a preset level, the required response speed is greater than a preset speed, contains multiple pending tasks, and is a preset type of data, etc.;
  • Meeting the second preset condition includes but is not limited to: the power is lower than the preset power, the permission does not meet the preset permission, the network status meets the preset network status, and it is in a preset mode or scene;
  • the third preset condition that does not meet includes But not limited to: the first target application or target service does not match the data to be processed (for example, the trust level of the first target application or target service is lower than the trust level required for processing the data to be processed, and the response speed does not meet the requirements of the data to be processed Response speed, etc.), does not match with the processing equipment (such as the format of the response result does not match the function of the processing equipment), etc.
  • the fourth preset condition includes but is not limited to: no response prompt message after timeout, preset voice command Wait.
  • the song is sent A play processing request; or, if the trust level of the first target application or target service is lower than the trust level required for processing the song play instruction, then send a song play processing request.
  • the step S10 it includes: determining at least one application or service management center. Further, before the step S10, the method may further include: if the processing device is a control center, determining at least one application or service management center according to a preset determination policy.
  • one of the multiple voice assistant applications may be selected as the management center according to a preset determination strategy, wherein the preset determination strategy may include the following: At least one: the application with the highest authority, the highest priority, according to user selection, the highest frequency of use, the highest user score, and the most powerful processing function.
  • the processing device can automatically scan the processing device itself and /or associate the applications or services installed in the device, and add the applications or services that meet the requirements to the application or service management center, or the user can manually add the application or service in the application or service management center, or add the application or service to the added Configure and manage the permissions of applications or services, and visually display the enabled permissions and/or supported processing functions of each application or service.
  • the step S20 further includes: displaying in the application or service management center a first preset interface respectively corresponding to the first target application or target service and/or corresponding to the second target application or The second preset interface corresponding to the target service.
  • the first preset interface and/or the second preset interface may display the human-computer interaction interface of the target application or target service in the form of pop-up windows, floating windows, cards, embedding, etc. in the interface of the application or service management center , the human-computer interaction interface is used to display the data to be processed and/or response results.
  • the interface of the application or service management center displays the first application corresponding to the human-computer interaction interface of the first application.
  • a card and a second card corresponding to the human-computer interaction interface of the second application so that the first card and the second card can dynamically display the response results of the data to be processed by the first application and the second application.
  • the interface of the voice assistant management center in the mobile phone will display the interactive interface of the mobile phone voice assistant in the form of a card at the same time
  • the interactive interface with the voice assistant of the speaker in which the interactive interface of the voice assistant of the mobile phone displays "The following versions of "Chengdu” have been found for you, which version do you want to listen to?"
  • the interactive interface of the voice assistant of the speaker displays "OK, I will play it for you soon "Chengdu” by Zhao Lei”.
  • the method further includes: performing preset processing on the target application or target service in response to a preset operation on the first preset interface and/or the second preset interface.
  • the application or service management center may also control or interact with the determined target application or target service, which may specifically include at least one of the following: responding to the first preset interface and/or the second preset
  • the closing operation in the interface closes the application or service corresponding to the preset interface; in response to the voice instruction operation on the first preset interface and/or the second preset interface, only the application or service corresponding to the preset interface
  • the application or service obtains the voice instruction; in response to the drag operation from the first preset interface to the second preset interface, the first target application or target service corresponding to the first preset interface is corresponding to the second preset interface
  • the second target application or target service is merged into a super application or service; in response to the sliding operation on the first preset interface and/or the second preset interface, the application or service corresponding to the preset interface is merged from the application or service Deleted in the management center.
  • the application or service management center Based on the setting and interactive operation of the application or service management center, it can not only facilitate the management and human-computer interaction of the application or service of the processing device itself, but also use the user interface to visually display the human-computer interaction of each application or service Interface, so that users can more intuitively and clearly know the control and response results of the application or service in the associated device connected to the processing device, which is for associated devices without display screens (such as smart speakers, smart air conditioners, etc.) It can provide a better user control experience.
  • step S20 it also includes:
  • the processing device determines at least one associated device.
  • the response result of the first target application or target service it is used to characterize the processing or analysis result of the data to be processed by the first target application or target service, for example, the response result may be an audio file or a processing request Wait.
  • determining at least one associated device may be: when the response result is an audio file, determine a smart speaker with an audio playback function as the associated device; when the response result is a call , determine the smart car machine with the dial-up function as the associated device, etc.
  • the preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, and the like.
  • historical usage information it is used to distinguish user usage habits, including but not limited to: historical usage times, historical usage time, historical usage locations, etc.
  • users tend to use different devices in different locations or at different times.
  • supported function information it is used to distinguish the functions that the device can implement, for example, whether it supports reading contacts, whether it supports calling the camera function, and so on.
  • the running state information it is used to distinguish the running state of the device, for example, whether it is in shutdown state or running state.
  • For device information it is used to distinguish the identity and/or status of different devices, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, etc.), remaining power information, remaining network Traffic, network status, etc.
  • device identity information such as master device and slave device, or control center and non-control center, etc.
  • remaining power information remaining network Traffic, network status, etc.
  • permission information it is used to distinguish the usage permissions of different devices, including but not limited to: priority, callable applications or services, etc., for example, devices with different priorities have different usage sequences, or different devices can call Third-party apps are different.
  • Determining at least one associated device according to preset information may be: a device whose priority, and/or supported function information, and/or operating status information, and/or device information, and/or permission information meet preset conditions Determine as an associated device, for example, determine a device that supports functions that can respond to data to be processed as an associated device, or determine a device with the highest priority as an associated device, or determine a device with a large amount of remaining power and a supported function that can respond The device whose data is to be processed is determined as an associated device or the like.
  • the operation information includes but not limited to: touch gesture operation, air gesture operation, voice operation, selection operation, pointing operation and other information
  • the above operation information can be collected through corresponding sensors in the device or image or voice
  • the device collects, for example, the gestures in the air through the camera in the mobile phone or the voice input by the user through the microphone.
  • Determine at least one associated device according to the operation information which may be: select the device that matches the obtained operation information and determine it as the associated device. icon position, determine the TV as the associated device; or determine the device pointed to by the user-controlled processing device as the associated device, for example, in a smart home environment, when the user points the processing device (such as a mobile phone) at the refrigerator, the refrigerator is determined For associated equipment, etc.
  • the data to be processed includes, but is not limited to, voice data, touch or air gesture data, body movement data, or data processed on these data, for example, it may be a control obtained after processing voice data instruction.
  • the data to be processed usually includes information such as functions to be implemented and/or devices for realizing related functions, the associated device for responding to the data to be processed can be accurately and quickly determined according to the data to be processed.
  • determining at least one associated device may be: determining a device whose supported function can partially or completely respond to the data to be processed as an associated device; or determining the device specified in the data to be processed as an associated device, for example, In a smart home environment, when the data to be processed is to turn on the air conditioner, it is determined that the air conditioner is an associated device.
  • the scene where the processing device is located is used to distinguish different environments, including but not limited to: offices, shopping malls, bus stations, vehicles, and the like.
  • the devices available to respond to the data to be processed may be different. Therefore, the associated device can be accurately and quickly determined according to the scene where the processing device is located.
  • determining at least one associated device may be: determining a device connected to the processing device in the scene where the processing device is located as an associated device, for example, if the processing device ( For example, a mobile phone) in a meeting room, the device connected to the processing device (such as a projector) will be used as an associated device; if the processing device (such as a mobile phone) is in the living room at home, the device connected to the processing device (such as a smart speaker) ) as the associated device.
  • the processing device For example, a mobile phone
  • the processing device such as a projector
  • Combination plan The response result of the application or service default information pending data operating information Handle the scene in which the device is located Combination Example 1 no no yes no yes Combination example 2 no no yes yes no Combination Example 3 yes no no yes yes ... ... ... ... ... ... ...
  • a device that matches the scene of the processing device (such as a company) and the data to be processed (such as a projection file required) may be determined as an associated device.
  • the device that matches the data to be processed for example, a song needs to be played
  • the operation information for example, controlling the processing device to point in a certain direction
  • the response result (such as an audio file) of the first target application or target service, the scene where the processing device is located (such as home) and the operation information (such as controlling the processing device to point to a certain direction) can be matched.
  • the processing device is connected to at least one device or is in the same connection network.
  • the processing device When the processing device outputs a processing request, the processing device needs to determine the associated device from the at least one connected device. At this time, the processing device can according to Determine at least one associated device in response to the result, and/or preset information, and/or the data to be processed, and/or scene information, and/or operation information.
  • the operation information is the operation of selecting the sending device, such as clicking the position of the icon corresponding to the TV displayed on the current interface of the processing device, it is determined that the TV is an associated device; another example, in a smart home environment, the user will process the device ( For example, when a mobile phone is pointed at a refrigerator, it is determined that the refrigerator is an associated device; another example, when the response result is an audio file, the smart speaker is determined to be an associated device according to the matching relationship between the audio file and the smart speaker; another example, in a smart home environment , when the data to be processed is to turn on the air conditioner, it is determined that the air conditioner is the associated device.
  • step S20 includes:
  • At least one target device is determined according to preset rules, and an application or service in the at least one target device that can respond to the processing request is determined as a second target application or target service.
  • the processing device there may be only one device associated with the processing device, or there may be multiple devices.
  • the user’s mobile phone may only be associated with the TV at home, or it may be associated with both the TV at home and the Devices such as air conditioners and smart speakers in the home are associated.
  • the associated device may have only one application or service, or may have multiple applications or services. In this case, the target application or target service needs to be determined according to the actual situation.
  • information such as functions and/or applications required to respond to the processing request may be combined with the information of the multiple associated devices
  • the application or service is matched, and the application or service that can respond to the processing request is determined as the target application or target service.
  • at least one target device can be determined based on the number of times of use, remaining power level, operating status, processing capability, etc., and then the at least one target device that can respond to the processing request The application or service of is determined as the target application or target service.
  • the associated device with the most usage times, and/or the most remaining power, and/or the operating state is not running, and/or the strongest processing capability may be determined as the target
  • the device determines the target application or target service from the target device based on information such as functions and/or applications required to process the request.
  • the second target application or target service may also be determined by the user according to the target application or target service selected in the output candidate application or service interface.
  • the determining at least one target device according to preset rules includes at least one of the following:
  • At least one associated device whose device environment information satisfies the eighth preset condition is taken as the target device.
  • the user's physiological parameter information includes the user's heart rate, blood pressure, pulse, blood oxygen, blood sugar, sweating, etc.
  • the above user's physiological parameter information can be measured by the corresponding sensor in the device, for example, through the smart watch
  • the optical heart rate sensor measures the user's heart rate.
  • the user's physiological parameter information satisfies the first preset condition, which may be that the user's physiological parameter reaches the preset user's physiological parameter threshold, for example, the user's heart rate reaches the preset user's heart rate threshold; or, in another implementation scenario, it may be possible to detect
  • the device associated with the user's heart rate is used as the target device. In this way, the target application or target service can be determined more intelligently, thereby giving the user a better experience.
  • Device system information which can be: system type, system name, system status, etc.
  • system type it is used to distinguish different types of systems, such as Android system, Symbian system, Apple system, etc.
  • another example is a deep customization system based on Android system (such as MIUI (Mobile Internet UI, millet mobile phone operation system))
  • MIUI Mobile Internet UI, millet mobile phone operation system
  • different systems will provide users with different services during operation, for example, the operating mechanisms of the Apple system and the Android system are different.
  • system name it is used to specifically distinguish whether the systems are the same system and to determine the specific information of the system, for example, the system name of the system is "Android system", it can be understood that it specifically specifies the system as "Android system”, rather than other systems.
  • system name may also include a complete name, for example, the name includes a system version number.
  • the system state it can be the operating state of the system, such as freeze, smooth, sleep, crash, standby, etc.
  • the device system information meets the second preset condition, which can be: the device system information meets the preset device system information rules. For example, if the system status is non-stuck (such as smooth, fast, extreme speed, etc.), the system status meets the preset device System information rules; in another implementation scenario, devices belonging to the same system type (such as Apple, Hongmeng, Android, etc.) are more compatible with each other. If the associated devices belonging to the same system type can be preferentially determined as target device, it can bring a better experience to users.
  • the system status is non-stuck (such as smooth, fast, extreme speed, etc.)
  • the system status meets the preset device System information rules
  • devices belonging to the same system type such as Apple, Hongmeng, Android, etc.
  • the associated devices belonging to the same system type can be preferentially determined as target device, it can bring a better experience to users.
  • Device communication information can be: device communication signal strength, device communication mode (such as Bluetooth, WIFI, NFC, etc.), device communication distance, etc.
  • device communication mode such as Bluetooth, WIFI, NFC, etc.
  • the device communication information meets the third preset condition, which may be: the associated device communication information meets the preset device communication information rules, for example, when the device communication signal strength is greater than or equal to the preset signal strength threshold, the device communication signal strength meets the preset device Communication information rules, generally speaking, the stronger the signal strength, the smoother the interaction between devices and the better the user experience.
  • the device application information may be: device application name information, etc. It can be understood that the application name can be used to distinguish the application, that is, the application can be identified by the application name.
  • the device application information satisfies the fourth preset condition, which means that the associated device application information satisfies the preset device application information rules.
  • the device application name information meets the preset response operation trigger conditions (for example, it is recognized by the application name that the device is running some preset When setting up applications, such as games, such as WeChat, etc.), the application data information of the device meets the preset device application information rules.
  • the more preset applications are running on the associated device it generally means that the associated device is being used by the user ( Frequent) use, which helps to determine the target application or target service more intelligently, thereby giving users a better experience.
  • the reminder information is used to remind the user to prevent the user from forgetting the corresponding event information, for example, remind the user that the scheduled TV program will be played soon through the reminder information of the associated device.
  • the device reminder information satisfies the fifth preset condition. It can be that the associated device reminder information meets the preset device reminder information rules. For example, when the time and/or location information in the reminder information is consistent with the current time and/or location, the associated device The reminder information meets the default device reminder information rules; in another implementation scenario, as long as the associated device has reminder information, it can be regarded as the associated device reminder information meets the preset device reminder information rules. In this way, there will be reminder information
  • the associated device identified as the target device also helps to determine the target application or target service more intelligently, because the reason why the user sets the associated device to be reminded means that the device is more convenient for the user to operate and/or view device of.
  • the device detection information may be information for detecting the condition of the device itself, such as whether the device is in normal working state, whether the device hardware is in normal state, the current working state of the device hardware, and so on.
  • the device detection information meets the sixth preset condition, and the associated device detection information can meet the preset device detection information rules, for example, the current working state of the device hardware meets the preset working state requirements (for example, the associated device software and/or hardware working status is normal) , the current working status of the device hardware satisfies the preset device detection information rules. In this way, it is possible to avoid identifying an associated device with an abnormal working status as the target device, thereby bringing a better experience to the user.
  • the preset device detection information rules for example, the current working state of the device hardware meets the preset working state requirements (for example, the associated device software and/or hardware working status is normal) , the current working status of the device hardware satisfies the preset device detection information rules.
  • Device status information which can be: running status, power information, fault information, etc.
  • the device can be in the normal running state, stuck state, unsmooth state, etc.
  • the power information generally, it can be the current power, the total battery capacity, the ratio of the remaining power, or the estimated usable time based on the user's usage habits in the near future (for example, within 8 hours).
  • the fault information can be the fault log of the equipment.
  • the fault information can include the cause of the fault, the type of fault, the time of the fault, the frequency of the fault, etc., so that the equipment or engineering and technical personnel can use the fault information to repair or repair. optimization.
  • the device status information satisfies the seventh preset condition, and the associated device status information can meet the preset device status information rules, for example, the power is greater than or equal to a preset threshold (such as 20%), so that low power and/or card failure can be avoided.
  • a preset threshold such as 20%
  • the device environment information may be: device external environment information, device usage environment information, and the like.
  • the device has the ability to obtain the external environment information, such as obtaining the brightness of the external ambient light, or obtaining the loudness of the external environmental noise.
  • the use environment information changes with the user's environment.
  • the user's environment can be detected by sensors (such as gravity sensors, acceleration sensors, gyroscopes, cameras, GPS, etc.). Perception, if the user is in motion, the device can detect that the user is in a motion environment, or if the user is driving, the device can detect that the user is in a driving environment, or if the user is in a work or meeting, the device can detect that the user is in a work or meeting in environment.
  • the device environment information satisfies the eighth preset condition, and the associated device environment information can satisfy the preset device environment information rules.
  • the associated device such as a car, bicycle, motorcycle, etc.
  • the associated device that the user is exercising is used as the target device.
  • associated devices that meet the second preset condition (such as belonging to the same system type, such as Apple system) and the third preset condition (such as the communication signal strength greater than or equal to the preset signal strength threshold) can be determined for the target device.
  • associated devices that meet the fourth preset condition such as running a preset application, such as a game or WeChat
  • the sixth preset condition such as software and/or hardware working normally
  • the third preset condition (such as the communication distance is less than or equal to the preset distance value, such as 5 meters) and the seventh preset condition (the power is greater than or equal to the preset threshold value, such as 20% ) associated device is determined as the target device.
  • the second preset condition (such as belonging to the same system state, such as smoothness) and the third preset condition (such as the communication methods are all Bluetooth) and the eighth preset condition (the user is driving or motion) is identified as the target device.
  • the target device can be determined more accurately and/or intelligently from multiple associated devices, thereby improving user experience.
  • the processing of the first target application or target service according to a first preset strategy includes at least one of the following: controlling the first target application or target service to close or hide or freeze or hibernate; responding Controlling the first target application or target service to output a feedback message based on a response result of the second target application or target service to the processing request;
  • the processing of the second target application or target service according to a second preset strategy includes at least one of the following: controlling the second target application or target service to respond to the processing request; controlling the The second target application or target service delays responding to the processing request; controlling the second target application or target service to respond to the processing request, and sending a response result to the first target application or target service.
  • the first target application or target service and the second target application or target service may be controlled to The corresponding application or service in the preset scene or preset mode in the target application or target service responds to the processing request; if both the first target application or target service and the second target application or target service need to respond to the processing request, or both the first target application or target service and the second target application or target service can improve the interaction effect in response to the processing request, then control the first target application or target service and the second target application
  • the target application or target service respectively responds to the processing request, or splits the data to be processed corresponding to the processing request, and determines at least one first data processed by the first target application or target service and at least one piece of data processed by the first target application or target service.
  • At least one second data processed by two target applications or target services to control said first target application or target service to respond to said at least one first data and said second target application or target service to respond to said at least one second data data.
  • a prompt message may also be output, and in response to the selection operation, control the selected corresponding application or service to respond to the processing request.
  • the preset scene and the preset mode can be set according to actual needs, for example, the preset scene can be a work scene, a meeting scene, an entertainment scene, a game scene, a driving scene, a navigation scene, an outdoor scene , currently unprocessed data or interconnection scenarios, etc.
  • the preset mode may be foreground operation mode, background operation mode, interactive mode, mobile operator network mode, wireless network mode, power saving mode, hands-free mode, etc.
  • the processing request is the voice input by the user in the vehicle, "play the song Dahai"
  • the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone in the vehicle are both Can respond to the processing request
  • the human-computer interaction application of A is providing navigation services
  • it can control the human-computer interaction application of B to respond to the processing request, so that the car and the machine can play the song Dahai
  • the human-computer interaction application of B and A No human-computer interaction application currently processes data and the human-computer interaction application A and B can be controlled to respond to the processing request respectively, so that both the mobile phone and the car machine play the song Dahai, thereby enhancing the song playback effect.
  • Fig. 24 is a schematic flowchart of a processing method for an application or service according to the ninth embodiment. As shown in Figure 24, the application or service processing method of this application is applied to a processing device, including:
  • Step S100 Responding to a first preset operation, wake up or run at least one first target application or target service, and/or at least one second target application or target service;
  • Step S200 In response to a second preset operation, perform preset processing on the first target application or target service and/or the second target application or target service according to a preset policy.
  • the processing device may include terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.).
  • the application or service may include a human-computer interaction application, and the human-computer interaction application includes an application or service that can perform human-computer interaction through touch operations, voice, touch gestures, air gestures, etc. (such as smart assistants, etc.), Other similar applications or services are also possible.
  • the first target application or target service and/or the second target application or target service may be set on the processing device and/or other devices (such as an associated device of the processing device, etc.).
  • the target application or target service includes at least one of voice assistant applications, social media applications, information content applications, tool applications, and system services.
  • the first target application or target service and the second target application or target service may be the same or different applications or services, or may be the same type or different types of applications or services.
  • the user inputs the voice "Order a crayfish at Meituan, watch a movie to fight crime", then wake up or run the A human-computer interaction application set on the mobile phone to order an order at Meituan Crayfish, and wake up or run the B human-computer interaction application set on the TV to open the movie anti-crime, and output the response result "I have purchased a crayfish" in the A human-computer interaction application and the B human-computer interaction application output the response result ""
  • "Movie Sweepstakes" is turned on, close the human-computer interaction application A and the human-computer interaction application B.
  • waking up or running at least one first target application or target service and/or, before at least one second target application or target service, further includes:
  • a second target application or target service is determined.
  • the acquisition of the data to be processed by the processing device may be that the processing device receives the data to be processed input by the user, or it may be that the processing device receives the processed data sent by other devices.
  • the data to be processed includes, but is not limited to: voice data, touch or air gesture data, body movement data, or data after processing these data, for example, it may be a control instruction obtained after processing voice data.
  • the acquired operations include, but are not limited to: gesture operations, voice operations, and the like.
  • the preset information may include at least one of the following information: historical usage information, supported function information, running status information, device information, permission information, etc.
  • the historical usage information may include historical usage times, historical usage time, Historical use location, etc.
  • the device information may include device identity information (such as master device and slave device, or control center and non-control center, etc.), and/or remaining power information, and/or remaining network traffic, and/or network Status, etc.
  • the permission information includes but not limited to: priority, callable applications or services, etc.
  • the location type includes but not limited to closed environment (such as room, vehicle, etc.) and/or open environment (such as room outside, playground, etc.), etc.
  • the scene information may include at least one of the following information: location type, time information, number of users, user identity, scene image, etc., and the time information includes but is not limited to: current specific date, and/or specific time period, etc. , the number of users may refer to the number of users located near the processing device and/or associated devices, the user identity may refer to age type, gender, occupation type, etc., and the scene image may refer to the current Images of people and/or objects in the scene, based on which information such as the user's gaze direction and/or gesture direction can be known.
  • the source information of the data to be processed includes, but is not limited to: the time and location of obtaining the data to be processed, information about a device that obtains or outputs the data to be processed, and the like.
  • the relevant information of the data to be processed includes, but is not limited to: required functions, and/or applications, and/or response speed, and/or accuracy, and/or privacy level, and the like.
  • At least one piece of processing information can be determined by parsing the relevant information of the data to be processed, and the processing information can include the applications, and/or services, and/or functions, and/or processing objects, and/or associated devices, and/or processing device information, etc., and according to the at least one processing information, it can be determined to respond to the pending A first target application or target service that processes the data.
  • the supported function information can respond to the data to be processed, whether the usage scenario matches the current scenario, whether the running status is running or not running, and other information, from at least two applications or determine the first target application or target service in the service.
  • the data to be processed is the voice "Please play the song Motherland" input by the user in the vehicle, and the vehicle includes the A human-computer interaction application installed on the vehicle and the B human-computer interaction application installed on the user's mobile phone.
  • the human-computer interaction application A can be determined as the first target application; or, if the human-computer interaction application A is in the In the running state, if the B human-computer interaction application is not running, then the B human-computer interaction application can be determined as the first target application; The machine-interactive application is determined as the first target application.
  • the processing device as an in-vehicle device as an example, assuming that the data to be processed is the voice input by the user "Please call Xiao Li" and the human-computer interaction application A installed in the in-vehicle device supports the dialing function, Then the human-computer interaction application A can be determined as the first target application or target service. If Xiao Li’s phone number is not stored in the car, the human-computer interaction application A cannot make a call to Xiao Li normally.
  • the human-computer interaction application B that is set in the mobile phone and supports invoking contact information is determined as the second target application or target service. Based on the response result, it can be determined that at least one second application or service participates in control, processing and decision-making, further improving data security and interaction effect.
  • the step S100 includes at least one of the following: sequentially waking up the first target application or target service and/or the second target application or target service according to the priority order of the applications or services; The first target application or target service and the second target application or target service; sequentially run the first target application or target service and/or the second target application or target service based on the wake-up time sequence of the applications or services ; Running the first target application or target service and/or the second target application or target service sequentially based on the network status of the device where the application or service is located.
  • the first target application or target service includes human-computer interaction application A
  • the second target application or target service includes human-computer interaction application B
  • the human-computer interaction application A can be awakened first, and then the human-computer interaction application B can be awakened; and/or, if the distance between the device where the human-computer interaction application A is located and the processing device is less than the distance between the device where the human-computer interaction application B is located and the processing device, the human-computer interaction application A can be woken up first, and then the human-computer interaction application B can be woken up; and/or, if the human-computer interaction application A is in the wake-up state and the person B If the machine-computer interaction application is not awakened, you can run the A human-computer interaction application first, and then run the B human-computer interaction application; and/or, if the network status of the device where
  • the preset processing of the first target application or target service and/or the second target application or target service according to a preset strategy includes at least one of the following:
  • the management request may include a request type, and the request type includes at least one of an authorization request, an assistance request, and a control request.
  • the processing device receives the data to be processed, it outputs to the associated device an assistance request for selecting a target application or a target service that responds to the data to be processed.
  • the processing device may also output a prompt message for prompting whether the first target application or target service and/or the second target application or target service should respond, and respond to the selection operation to control the selected A target application or target service or the second target application or target service responds.
  • a management request can be sent to the associated device associated with the processing device to request whether to choose whether to play the song by the A human-computer interaction application or the B human-computer interaction application, and after receiving the associated device After the feedback information is sent, the human-computer interaction application that does not play the song is closed or exited based on the feedback information.
  • the step S100 it includes: determining at least one application or service management center. Further, before the step S100, the method may further include: if the processing device is a control center, determining at least one application or service management center according to a preset determination strategy.
  • one of the multiple voice assistant applications may be selected as the management center according to a preset determination strategy, wherein the preset determination strategy may include the following: At least one: the application with the highest authority, the highest priority, according to user selection, the highest frequency of use, the highest user score, and the most powerful processing function.
  • the processing device can automatically scan the processing device itself and /or associate the applications or services installed in the device, and add the applications or services that meet the requirements to the application or service management center, or the user can manually add the application or service in the application or service management center, or add the application or service to the added Configure and manage the permissions of applications or services, and visually display the enabled permissions and/or supported processing functions of each application or service.
  • the step S200 further includes: displaying in the application or service management center a first preset interface respectively corresponding to the first target application or target service and/or corresponding to the second target application or The second preset interface corresponding to the target service.
  • the first preset interface and/or the second preset interface may display the human-computer interaction interface of the target application or target service in the form of pop-up windows, floating windows, cards, embedding, etc. in the interface of the application or service management center , the human-computer interaction interface is used to display the data to be processed and/or response results.
  • the interface of the application or service management center displays the first application corresponding to the human-computer interaction interface of the first application.
  • a card and a second card corresponding to the human-computer interaction interface of the second application so that the first card and the second card can dynamically display the response results of the data to be processed by the first application and the second application.
  • the interface of the voice assistant management center in the mobile phone will display the interactive interface of the mobile phone voice assistant in the form of a card at the same time
  • the interactive interface with the voice assistant of the speaker in which the interactive interface of the voice assistant of the mobile phone displays "The following versions of "Chengdu” have been found for you, which version do you want to listen to?"
  • the interactive interface of the voice assistant of the speaker displays "OK, I will play it for you soon "Chengdu” by Zhao Lei”.
  • the method further includes: performing preset processing on the target application or target service in response to a preset operation on the first preset interface and/or the second preset interface.
  • the application or service management center may also control or interact with the determined target application or target service, which may specifically include at least one of the following: responding to the first preset interface and/or the second preset
  • the closing operation in the interface closes the application or service corresponding to the preset interface; in response to the voice instruction operation on the first preset interface and/or the second preset interface, only the application or service corresponding to the preset interface
  • the application or service obtains the voice instruction; in response to the drag operation from the first preset interface to the second preset interface, the first target application or target service corresponding to the first preset interface is corresponding to the second preset interface
  • the second target application or target service is merged into a super application or service; in response to the sliding operation on the first preset interface and/or the second preset interface, the application or service corresponding to the preset interface is merged from the application or service Deleted in the management center.
  • the application or service management center Based on the setting and interactive operation of the application or service management center, it can not only facilitate the management and human-computer interaction of the application or service of the processing device itself, but also use the user interface to visually display the human-computer interaction of each application or service Interface, so that users can more intuitively and clearly know the control and response results of the application or service in the associated device connected to the processing device, which is for associated devices without display screens (such as smart speakers, smart air conditioners, etc.) It can provide a better user control experience.
  • the preset policy includes: if the first target application or target service and the second target application or target service belong to the same device, then process according to the first preset policy; and/or , if the first target application or target service and the second target application or target service do not belong to the same device, perform processing according to a second preset policy.
  • the processing according to the first preset policy includes at least one of the following: exiting the first target application or target service and/or the second target application or target service according to the first exit policy;
  • the first output policy outputs a response result corresponding to the first target application or target service and/or the second target application or target service;
  • the processing according to the second preset policy includes at least one of the following: exiting the first target application or target service and/or the second target application or target service according to the second exit policy;
  • the second output policy outputs a response result corresponding to the first target application or target service and/or the second target application or target service.
  • the exit strategy includes at least one of the following: sequential exit based on the running state information of the application or service, sequential exit based on device information of the device where the application or service is located, and simultaneous exit; and/or,
  • the output strategy includes at least one of the following: sequential output based on the priority order of applications or services, sequential output based on content of response results, and simultaneous output.
  • the first target application or target service includes A human-computer interaction application
  • the second target application or target service includes B human-computer interaction application
  • the content of the response result of A human-computer interaction application is a picture
  • the content of the response result of the human-computer interaction application B is audio
  • the response result of the human-computer interaction application A can be output first, and then the response result of the human-computer interaction application B; If the power is lower than the remaining power of the device where the A human-computer interaction application is located, you can first exit the B human-computer interaction application, and then exit the A human-computer interaction application.
  • the step S200 further includes: in response to receiving the response information sent by the first target application or target service and/or the second target application or target service, outputting the Response message.
  • the processing device may serve as a control center to control the target application or target service to respond to the data to be processed, and to control the output of response information of the target application or target service to the data to be processed.
  • the preset output strategy can be set according to actual needs, such as simultaneous output or sequential output.
  • the processing device may also control the target application or target service to output response information according to a preset output policy.
  • the outputting the response information according to the preset output strategy includes at least one of the following: according to the order of receiving time, and/or the priority order of the target application or target service, and/or the current scene, And/or the received operation information, and/or the device corresponding to the response information, outputs the response information, and/or outputs the processed response information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

La présente demande concerne un procédé de traitement d'application ou de service, un dispositif, et un support de stockage. Le procédé de traitement d'application ou de service comprend : en réponse à l'acquisition d'informations à traiter, le fait de détecter si une première application ou un premier service qui est actuellement réveillé ou en cours d'exécution satisfait une condition de traitement ; et selon un résultat de détection, le traitement de la première application ou du premier service et/ou d'une seconde application ou d'un second service sur la base d'une politique prédéfinie. Au moyen du procédé de traitement d'application ou de service, du dispositif, et du support de stockage décrits dans la présente demande, après que des informations à traiter sont acquises, une première application ou un premier service et/ou une seconde application ou un second service sont traités de sorte que, lorsqu'une application ou un service est utilisé, l'effet de sécurité et/ou d'interaction de données peut être amélioré, ce qui améliore la convivialité d'utilisation. Dans un autre mode, la première application ou le premier service et/ou la seconde application ou le second service sont traités en collaboration avec un dispositif d'association de sorte que l'effet de sécurité et/ou d'interaction de données peut être amélioré sur la base de fonctions et de capacités de commande de multiples dispositifs, ce qui améliore la convivialité d'utilisation.
PCT/CN2022/076123 2021-06-15 2022-02-13 Procédé de traitement d'application ou de service, dispositif, et support de stockage WO2022262298A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202110658632.7A CN113114847B (zh) 2021-06-15 2021-06-15 应用或服务的处理方法、设备及存储介质
CN202110658632.7 2021-06-15
CN202110706372.6A CN113254092B (zh) 2021-06-24 2021-06-24 处理方法、设备及存储介质
CN202110706372.6 2021-06-24

Publications (1)

Publication Number Publication Date
WO2022262298A1 true WO2022262298A1 (fr) 2022-12-22

Family

ID=84525961

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/076123 WO2022262298A1 (fr) 2021-06-15 2022-02-13 Procédé de traitement d'application ou de service, dispositif, et support de stockage

Country Status (1)

Country Link
WO (1) WO2022262298A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104980585A (zh) * 2015-06-26 2015-10-14 小米科技有限责任公司 信息提示方法及装置
US20180204569A1 (en) * 2017-01-17 2018-07-19 Ford Global Technologies, Llc Voice Assistant Tracking And Activation
CN108491257A (zh) * 2018-03-19 2018-09-04 联想(北京)有限公司 一种信息处理方法及电子设备
CN109951424A (zh) * 2017-12-20 2019-06-28 北京三星通信技术研究有限公司 共享方法及相应设备
CN110718218A (zh) * 2019-09-12 2020-01-21 百度在线网络技术（北京）有限公司 一种语音处理方法、装置、设备和计算机存储介质
CN111309857A (zh) * 2020-01-20 2020-06-19 联想(北京)有限公司 一种处理方法及处理装置
CN113114847A (zh) * 2021-06-15 2021-07-13 深圳传音控股股份有限公司 应用或服务的处理方法、设备及存储介质
CN113254092A (zh) * 2021-06-24 2021-08-13 深圳传音控股股份有限公司 处理方法、设备及存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104980585A (zh) * 2015-06-26 2015-10-14 小米科技有限责任公司 信息提示方法及装置
US20180204569A1 (en) * 2017-01-17 2018-07-19 Ford Global Technologies, Llc Voice Assistant Tracking And Activation
CN109951424A (zh) * 2017-12-20 2019-06-28 北京三星通信技术研究有限公司 共享方法及相应设备
CN108491257A (zh) * 2018-03-19 2018-09-04 联想(北京)有限公司 一种信息处理方法及电子设备
CN110718218A (zh) * 2019-09-12 2020-01-21 百度在线网络技术（北京）有限公司 一种语音处理方法、装置、设备和计算机存储介质
CN111309857A (zh) * 2020-01-20 2020-06-19 联想(北京)有限公司 一种处理方法及处理装置
CN113114847A (zh) * 2021-06-15 2021-07-13 深圳传音控股股份有限公司 应用或服务的处理方法、设备及存储介质
CN113254092A (zh) * 2021-06-24 2021-08-13 深圳传音控股股份有限公司 处理方法、设备及存储介质

Similar Documents

Publication Publication Date Title
WO2021052263A1 (fr) Procédé et dispositif d'affichage d'assistant vocal
EP3567584B1 (fr) Appareil électronique et son procédé de fonctionnement
WO2021063343A1 (fr) Procédé et dispositif d'interaction vocale
KR101837333B1 (ko) 전자 디바이스를 깨우기 위한 방법 및 장치
US20160179087A1 (en) Activity-centric contextual modes of operation for electronic devices
KR20180083587A (ko) 전자 장치 및 그의 동작 방법
EP2911417B1 (fr) Procédé permettant de communiquer avec un dispositif voisin, dispositif électronique et support de stockage
CN113114847B (zh) 应用或服务的处理方法、设备及存储介质
WO2021109875A1 (fr) Procédé et appareil d'implémentation d'une application de jeu, support de stockage, et dispositif électronique
EP3118720B1 (fr) Appareil permettant d'afficher une image et son procédé de commande
WO2018099043A1 (fr) Procédé de déclenchement de comportement de terminal, et terminal
WO2022262434A1 (fr) Procédé d'optimisation de puissance et dispositif électronique
CN110932888A (zh) 用于协商对共享音频或视觉资源的控制的系统和方法
US11404065B2 (en) Method for displaying visual information associated with voice input and electronic device supporting the same
WO2023284621A1 (fr) Procédé et appareil de réglage, dispositif électronique et support de stockage
CN113220373B (zh) 处理方法、设备及存储介质
WO2022088964A1 (fr) Procédé et appareil de commande pour dispositif électronique
WO2016206066A1 (fr) Procédé, appareil et terminal intelligent pour commander un mode de terminal intelligent
CN113254092B (zh) 处理方法、设备及存储介质
WO2022110352A1 (fr) Procédé et appareil de commande de maison intelligente, terminal et support de stockage
US20230216702A1 (en) Processing method, device and storage medium
CN113485783B (zh) 处理方法、处理设备及存储介质
CN113254109B (zh) 应用或服务的处理方法、设备及可读存储介质
WO2022262298A1 (fr) Procédé de traitement d'application ou de service, dispositif, et support de stockage
WO2022252437A1 (fr) Procédé et dispositif de traitement et support lisible de stockage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22823791

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE