WO2023005362A1

WO2023005362A1 - Processing method, processing device and storage medium

Info

Publication number: WO2023005362A1
Application number: PCT/CN2022/093316
Authority: WO
Inventors: 朱荣昌; 邵刚; 梁文斌
Original assignee: 深圳传音控股股份有限公司
Priority date: 2021-07-30
Filing date: 2022-05-17
Publication date: 2023-02-02

Abstract

The present application discloses a processing method, a processing device, and a storage medium. The processing method is applied to the processing device. The method comprises: in response to the processing device and/or a first application or service meeting a first preset condition, performing first preset processing; and in response to the processing device and/or an associated device meeting a second preset condition, performing second preset processing. In the present application, corresponding processing is performed on the basis of the determination of whether the processing device, application or service, and/or the associated device meets the corresponding preset conditions, so that the device may conveniently and/or intelligently carry out processing when interacting with a user, thus improving the user experience.

Description

Processing method, processing equipment and storage medium

related application

This application is required to be submitted to the China Patent Office on July 30, 2021, with the application number 202110867324.5, and the title of the invention is "processing method, processing equipment, and storage medium" and submitted to the China Patent Office on September 07, 2021, with the application number 202111046165.9 , the priority of the Chinese patent application titled "processing method, processing equipment and storage medium", the entire contents of which are incorporated by reference in the application.

technical field

The present application relates to the field of electronic technology, and in particular to a processing method, processing equipment and storage medium.

Background technique

With wearable smart devices (such as smart watches, smart headphones, smart bracelets, smart glasses, etc.), smart home devices (such as smart TVs, smart speakers, smart refrigerators, smart desk lamps, smart air conditioners, smart ovens, etc.) and cars The popularity of networked devices (such as smart cars, vehicle-mounted terminals, navigators, etc.) has brought great convenience to people's lives. During the process of conceiving and implementing this application, the inventor found that there are at least the following problems: When users interact, there are problems of insufficient convenience and/or intelligence, which leads to poor user experience.

technical solution

The main purpose of the present application is to provide a processing method, a processing device and a storage medium, aiming at solving the problem that the device is not convenient and/or intelligent enough when interacting with the user, so as to improve the user experience.

In order to achieve the above purpose, the present application provides a processing method applied to processing equipment, including the following steps:

S1: In response to the processing device and/or the first application or service meeting a first preset condition, perform a first preset process;

S2: In response to the processing device and/or associated device meeting a second preset condition, perform a second preset process.

Optionally, the meeting the first preset condition includes at least one of the following:

Obtain at least one first voice and at least one second voice;

in the first preset scene;

in the first default position;

in the first default state;

Provide the first default service or function;

The triggering object is the first preset object;

have a first preset relationship with the second application or service already displayed by the processing device;

said processing device has an associated device;

involves privacy;

The display interface of the first application or service is displayed in a first manner;

The user account of the first application or service logs in to the processing device and the associated device at the same time.

Optionally, said performing the first preset processing includes at least one of the following:

In response to at least one first voice and at least one second voice, detecting whether the first voice and the second voice meet a third preset condition;

controlling the display interface of the first application or service to be displayed in a first manner;

Outputting at least one prompt message in response to displaying the display interface of the first application or service in a first manner;

controlling the display interface of the first application or service to be displayed in the first manner and in the second manner;

Output at least one prompt message.

Optionally, the meeting the third preset condition includes at least one of the following:

The acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold;

The similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold;

The difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold;

The speaking user of the first voice is associated with the speaking user of the second voice;

The first voice and/or the second voice is associated with at least one operation object of the current interface;

The second voice is associated with the first voice.

Optionally, the meeting the second preset condition includes at least one of the following:

The processing device detects that the first voice and the second voice meet the third preset condition;

The processing device and/or the associated device receives a preset operation;

The processing device and/or the associated device is in a second preset scene;

The processing device and/or the associated device is in a second preset position;

The processing device and/or the associated device is in a second preset state;

The processing device provides a second preset service function;

said processing device has an associated device;

The associated device has the first application or service;

Running or closing the first application or service on the associated device.

Optionally, the second preset processing includes at least one of the following:

If the first preset processing is to detect whether the first voice and the second voice meet the third preset condition in response to at least one first voice and at least one second voice, then according to the detection result, based on The first preset policy processes the first operation event corresponding to the first voice and/or the second operation event corresponding to the second voice;

If the first preset processing is to control the display interface of the first application or service to display in the first manner, then control the display interface of the first application or service to switch from the first manner to the second manner. way to display;

If performing the first preset processing is to display at least one prompt message in response to the display interface of the first application or service in a first manner, then control the first application or service based on a second preset policy The display interface is switched from the first mode to the second mode for display;

If performing the first preset process is outputting at least one prompt message, then controlling the display interface of the first application or service to be displayed in the first manner and/or the second manner based on a third preset policy;

If the first preset processing is to control the display interface of the first application or service to be displayed in the first manner and the second manner, then control the display interface of the first application or service based on a fourth preset strategy Shown in a third way.

Optionally, the first preset strategy includes at least one of the following:

If the detection result is that the first voice and the second voice meet the third preset condition, at least one of the following processes is performed: executing the first operation event; executing the second operation event; not executing the The first operation event; not executing the second operation event; merging the first operation event and the second operation event, and executing the combined operation event; outputting a prompt message, and executing the selection in response to a selection instruction Command the operation event corresponding to the selected voice;

If the detection result is that the first voice and the second voice do not meet the third preset condition, perform at least one of the following processes: simultaneously execute the first operation event and the second operation event; Execute the first operation event and the second operation event sequentially; execute the first operation event and the second operation event according to the priority order; execute the first operation event and the second operation event according to the distance from the sound source the second operational event;

And/or, the second preset strategy and/or the third preset strategy include at least one of the following:

displaying after splitting the display interface of the first application or service;

displaying a display interface of the first application or service through the processing device and/or the associated device;

And/or, the fourth preset strategy includes:

Switching the display interface of the first application or service from the processing device to the associated device for presentation.

Optionally, wherein the first mode or the second mode includes a first mode and a second mode, and the controlling the first application or service to switch from the first mode to the second mode for display or The display interface of the first application or service is split and displayed, including:

Splitting the display interface of the first application or service according to preset rules to obtain a first display part and/or a second display part;

Displaying the first display part in a first form, and/or displaying the second display part in a second form.

Optionally, the screen of the processing device includes a first area, a second area, and a foldable area located between the first area and the second area; display in a second form, and/or display the second display part in a second form, including:

The first display part is displayed in a first form in the first area, and/or the second display part is displayed in a second form in the second area.

Optionally, wherein the controlling the display of the first application or service from the first mode to the second mode includes:

A transitional dynamic effect of switching the first application or service from the first mode to the second mode is displayed within a preset duration. Optionally, before the S1 step, it also includes:

According to at least one of scene information, preset information, and information related to the first application or service, it is detected whether the processing device and/or the first application or service meet the first preset condition.

Optionally, the first mode and the second mode include at least one of the following: full screen state, half screen state, floating state, stacked display, stacked display, side by side display, fixed display, direct hiding, and the first A way is different from said second way; and/or,

The first preset state and the second preset state include at least one of the following: a motion state, a static state, a working state, an idle state, a folded state, and an unfolded state, and the second preset state is the same as the a state relative to the first predetermined state; and/or,

The first preset relationship includes at least one of the following: priority relationship, association relationship, and non-association relationship.

Optionally, the first mode and the second mode include at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the The first way is different from the second way.

Optionally, the first operation event and the second operation event include operation objects and/or operation content of the current interface; and/or,

The second preset processing also includes:

According to at least one of current scene information, historical use information, and acquired operations, it is judged whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result.

Optionally, said performing a corresponding operation based on the judgment result includes at least one of the following:

If it is determined according to the current scene information that the current scene type is a preset scene type, the current interface will not be switched;

If it is determined according to the current scene information that the current scene type is not the preset scene type, interface switching is performed according to the processing result.

The present application also provides a second processing method, applied to processing equipment, comprising the following steps:

S10: In response to the processing device and/or the first application or service meeting a first preset condition, perform a first preset process;

S20: Perform second preset processing in response to the processing result.

Obtain at least one first voice and at least one second voice;

Get the first voice;

Acquiring a first operation event and/or a first operation object;

Obtain the first operation event and the second operation event;

in the first preset scene;

in the first default position;

in the first default state;

Provide the first default service or function;

The triggering object is the first preset object;

There is a first preset relationship with the second application or service already displayed by the processing device.

Responding to at least one first voice and at least one second voice, detecting whether the first voice and the second voice meet a second preset condition;

Responding to the first voice, determining at least one first operation event and at least one second operation event, and detecting whether the first operation event and the second operation event meet a third preset condition;

Responding to a first operation event, determining a first operation object, and in response to at least one voice, detecting whether the voice and the first operation object meet a fourth preset condition;

In response to determining a first operation object according to a first operation event and determining a second operation object according to a second operation event, detecting whether the first operation object and the second operation object meet a fifth preset condition;

Detecting whether the second operation event and/or the second operation object meets the seventh preset condition in response to the first operation event and/or the first operation object meeting the sixth preset condition;

Controlling the display interface of the first application or service to display in a first manner, and detecting whether the processing device and/or the first application or service meet an eighth preset condition.

the second speech is associated with the first speech;

And/or, the third preset condition is met, including at least one of the following:

The first operational event conflicts with the second operational event;

The first operational event is associated with the second operational event;

The first operational event does not conflict with the second operational event;

The first operational event is not associated with the second operational event;

And/or, the meeting the fourth preset condition includes at least one of the following:

The acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold;

The second operation object corresponding to the voice is the same as the first operation object;

The second operation object corresponding to the voice is different from the first operation object;

The utterance user of the voice is the same as or related to the input user of the first operation event;

The voice uttering user is not the same as or not associated with the input user of the first operation event;

And/or, said meeting the fifth preset condition includes at least one of the following:

The first operation object is the same as the second operation object;

The first operand is different from the second operand;

The first operation object and/or the second operation object is associated with at least one operation object currently displayed on the interface;

The first operation object and/or the second operation object are not associated with at least one operation object displayed on the current interface;

And/or, said meeting the sixth preset condition includes at least one of the following:

The first operation object is associated with at least one operation object displayed on the current interface;

The first operation object is not associated with at least one operation object displayed on the current interface;

The input user of the first operation event is a preset user;

The input user of the first operation event is not a preset user;

And/or, said meeting the seventh preset condition includes at least one of the following:

The acquisition interval between the second operation event and the first operation event is less than or equal to a preset duration threshold;

The similarity between the first operation event and the second operation event is greater than or equal to a preset similarity threshold;

The second operation object is the same as the first operation object;

The second operand is different from the first operand;

The input user of the second operation event is the same as or associated with the input user of the first operation event;

The input user of the second operation event is not the same as or not associated with the input user of the first operation event;

The first operational event conflicts with the second operational event;

The first operational event is associated with the second operational event;

And/or, said meeting the eighth preset condition includes at least one of the following:

is in the second preset scene;

is in the second default position;

is in the second default state;

Provide a second default service or function;

The triggering object is the second preset object;

have a second preset relationship with the third application or service already displayed by the processing device;

said processing device has an associated device;

Privacy is involved.

If the processing result is that the first voice and the second voice meet the second preset condition, the first operation event corresponding to the first voice and/or the second The second operation event corresponding to the voice is processed;

If the processing result is that the first voice and the second voice do not meet the second preset condition, the first operation event corresponding to the first voice and/or the first operation event corresponding to the first voice according to the second preset policy The second operation event corresponding to the second voice is processed;

If the processing result is at least one of the following: the first operation event and the second operation event meet the third preset condition, the first operation object and the second operation object meet the fifth preset condition Assume that the condition, the second operation event and/or the second operation object meet the seventh preset condition, then process the first operation event and/or the second operation event according to a third preset policy ;

If the result of the processing is that the first operation event and the second operation event do not meet the third preset condition, the first operation event and/or the second operation event are processed according to a fourth preset policy process;

If the processing result is that the voice and the first operation object meet the fourth preset condition, then process the second operation event corresponding to the voice based on a fifth preset policy;

If the processing result is that the voice and the first operation object do not meet the fourth preset condition, then process the second operation event corresponding to the voice based on a sixth preset strategy;

If the processing result is that the first operation object and the second operation object do not meet the fifth preset condition, then perform corresponding processing based on a seventh preset strategy;

If the processing result is that the second operation event and/or the second operation object do not meet the seventh preset condition, then perform corresponding processing based on the eighth preset strategy;

If the processing result is that the processing device and/or the first application or service meet the eighth preset condition, controlling the display interface of the first application or service to switch from the first mode to the second mode for display .

Optionally, the first preset strategy includes at least one of the following:

executing the first operational event;

executing the second operational event;

not performing the first operational event;

not performing the second operational event;

Merge the first operation event and the second operation event, and execute the combined operation event;

Outputting a prompt message, in response to the selection instruction, executing an operation event corresponding to the voice selected by the selection instruction;

And/or, the second preset strategy includes at least one of the following:

executing the first operational event and the second operational event simultaneously;

Executing the first operation event and the second operation event according to the acquisition time sequence;

executing the first operational event and the second operational event according to a priority order;

executing the first operation event and the second operation event according to the distance of the sound source;

And/or, the third preset strategy includes at least one of the following:

executing the first operational event;

executing the second operational event;

not performing the first operational event;

not performing the second operational event;

Outputting a prompt message, and executing an operation event corresponding to the selection instruction in response to the selection instruction;

executing said first and/or said second operating event in response to a third operating event;

And/or, the fourth preset strategy includes at least one of the following:

And/or, the fifth preset strategy includes at least one of the following:

executing the second operation event on the first operation object;

outputting update operation object prompt information, and executing the second operation event on the first operation object in response to the confirmation instruction;

And/or, the sixth preset strategy includes at least one of the following:

not performing the second operation event on the first operation object;

output update operation event prompt information, and execute the third operation event on the first operation object in response to the third operation event;

And/or, the seventh preset strategy includes at least one of the following:

Executing the first operation event and the second operation event according to the distance of the sound source of the corresponding voice;

And/or, the eighth preset strategy includes at least one of the following:

The first operation event and the second operation event are executed according to a priority order.

Optionally, the first operation event and the second operation event include operation objects and/or operation content of the current interface;

and / or,

The second preset processing also includes:

The first preset relationship and the second preset relationship include at least one of the following: a priority relationship, an association relationship, and a non-association relationship, and the second preset relationship is opposite to the first preset relationship Relationship.

The present application also provides a processing device, which includes: a memory, a processor, and a processing program stored in the memory and operable on the processor, when the processing program is executed by the processor The steps of the processing method as described above are realized.

The present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned processing method are realized.

As mentioned above, the present application relates to a processing method, a processing device, and a storage medium. The processing method is applied to the processing device, and includes the following steps: in response to the processing device and/or the first application or service meeting the first preset condition, performing a first preset process; and performing a second preset process in response to the processing device and/or associated device meeting a second preset condition. This application performs corresponding processing based on the judgment of whether the processing device, application or service, and/or associated device meet the corresponding preset conditions, so that the device can perform processing conveniently and/or intelligently when interacting with the user, improving the user experience. experience.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, the Under the premise, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic diagram of a hardware structure of an intelligent terminal implementing various embodiments of the present application;

FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a hardware structure of a controller 140 according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a hardware structure of a network node 150 according to an embodiment of the present application;

Fig. 5 is a schematic flowchart of a processing method shown according to the first embodiment;

Fig. 6 is an interface diagram 1 of a processing device according to the processing method shown in the first embodiment;

Fig. 7 is a second interface diagram of the processing device according to the processing method shown in the first embodiment;

Fig. 8 is a third interface diagram of the processing device according to the processing method shown in the first embodiment;

Fig. 9 is a fourth interface diagram of the processing device according to the processing method shown in the first embodiment;

Fig. 10 is a fifth interface diagram of the processing device according to the processing method shown in the first embodiment;

Fig. 11 is a schematic flowchart of a processing method according to a second embodiment;

Fig. 12 is an interface diagram 1 of a processing device according to the processing method shown in the second embodiment;

Fig. 13 is a second interface diagram of the processing device according to the processing method shown in the second embodiment;

Fig. 14 is a third interface diagram of the processing device according to the processing method shown in the second embodiment;

Fig. 15 is a fourth interface diagram of the processing device according to the processing method shown in the second embodiment.

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. By means of the above drawings, specific embodiments of the present application have been shown, which will be described in more detail hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the application in any way, but to illustrate the concept of the application for those skilled in the art by referring to specific embodiments.

Embodiment of this application

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element. In addition, different implementations of the present application Components, features, and elements with the same name in the example may have the same meaning, or may have different meanings, and the specific meaning shall be determined based on the explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not exclude one or more other features, steps, operations, The existence, occurrence or addition of an element, component, item, species, and/or group. The terms "or", "and/or", "comprising at least one of" and the like used in this application may be interpreted as inclusive, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C", another example, " A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C". Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that although the various steps in the flow chart in the embodiment of the present application are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figure may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential Instead, it may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (a stated condition or event)".

It should be noted that, in this article, step codes such as S1 and S2 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order. Those skilled in the art may, during specific implementation, S2 will be executed first and then S1, etc., but these should be within the protection scope of this application.

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

In the following description, the use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, 'module', 'part' or 'unit' may be mixedly used.

Smart terminals can be implemented in various forms. For example, the smart terminals described in this application may include mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, Smart terminals such as wearable devices, smart bracelets, and pedometers, as well as fixed terminals such as digital TVs and desktop computers.

In the subsequent description, a mobile terminal will be taken as an example for illustration, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configuration according to the embodiments of the present application can also be applied to a fixed type terminal.

Please refer to FIG. 1 , which is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application. The mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, an A /V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in Figure 1 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than those shown in the figure, or combine some components, or different components layout.

Each component of the mobile terminal is specifically introduced below in combination with FIG. 1:

The radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 , Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency division duplex long-term evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution, time-division duplex long-term evolution) and 5G, etc.

WiFi is a short-distance wireless transmission technology. The mobile terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102, which provides users with wireless broadband Internet access. Although Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the mobile terminal, and can be completely omitted as required without changing the essence of the invention.

The audio output unit 103 can store the audio received by the radio frequency unit 101 or the WiFi module 102 or in the memory 109 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like. The audio data is converted into an audio signal and output as sound. Also, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. The A/V input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is used for still pictures or The image data of the video is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data. The processed audio (voice) data can be converted into a format transmittable to a mobile communication base station via the radio frequency unit 101 for output in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the mobile terminal 100 moves to the ear. panel 1061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile phone posture (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Optionally, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.

Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event. The corresponding visual output is provided on the display panel 1061 . Although in FIG. 1, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a storage program area and a storage data area. Optionally, the storage program area can store an operating system, at least one function required application program (such as a sound playback function, an image playback function, etc.) etc.; the storage data area can be Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone. In addition, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 110 is the control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes operating systems, user interfaces, and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The mobile terminal 100 can also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Although not shown in FIG. 1 , the mobile terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.

In order to facilitate understanding of the embodiments of the present application, the following describes the communication network system on which the mobile terminal of the present application is based.

Please refer to Fig. 2, Fig. 2 is a kind of communication network system architecture diagram that the embodiment of the present application provides, and this communication network system is the LTE system of general mobile communication technology, and this LTE system includes the UE (User Equipment, user equipment) that communication connects sequentially ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.

Optionally, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on. Optionally, the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC203 may include MME (Mobility Management Entity, Mobility Management Entity) 2031, HSS (Home Subscriber Server, Home Subscriber Server) 2032, other MME2033, SGW (Serving Gate Way, Serving Gateway) 2034, PGW (PDN Gate Way, packet data Network Gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Charging Functional Entity) 2036, etc. Optionally, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information about service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide UE 201 IP address allocation and other functions, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

The IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

Although the LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems. The network system (such as 5G), etc., is not limited here.

FIG. 3 is a schematic diagram of a hardware structure of a controller 140 provided in the present application. The controller 140 includes: a memory 1401 and a processor 1402, the memory 1401 is used to store program instructions, and the processor 1402 is used to call the program instructions in the memory 1401 to execute the steps performed by the controller in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1403 , and the communication interface 1403 may be connected to the processor 1402 through a bus 1404 . The processor 1402 can control the communication interface 1403 to implement the receiving and sending functions of the controller 140 .

FIG. 4 is a schematic diagram of a hardware structure of a network node 150 provided in the present application. The network node 150 includes: a memory 1501 and a processor 1502, the memory 1501 is used to store program instructions, and the processor 1502 is used to call the program instructions in the memory 1501 to execute the steps performed by the first node in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1503 , and the communication interface 1503 may be connected to the processor 1502 through a bus 1504 . The processor 1502 can control the communication interface 1503 to realize the functions of receiving and sending of the network node 150 .

The above-mentioned integrated modules implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor (English: processor) to execute the methods of the various embodiments of the present application. partial steps.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. A computer can be a general purpose computer, special purpose computer, computer network, or other programmable device. Computer instructions can be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, computer instructions can be sent from a website site, computer, server or data center by wire (such as Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk, SSD), etc.

Based on the above mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

first embodiment

Fig. 5 is a schematic flowchart of a processing method shown according to the first embodiment. As shown in Figure 5, the processing method of the present application is applied to processing equipment, including the following steps:

Optionally, the processing device may be a terminal device (such as a mobile phone, a tablet computer, etc.), a wearable smart device (such as a smart watch, a smart bracelet, a smart earphone, etc.), a smart home device (such as a smart TV, a smart speaker, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.). The applications or services may include human-computer interaction applications, multimedia applications, communication applications, navigation applications, etc. Human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures. Optionally, the associated device may refer to any device that is connected to the processing device (it may be directly connected or indirectly connected, and the connection method may be a short-distance communication method or a data connection, etc.), or any device that meets the predetermined requirements. Any device that sets conditions (such as connecting to the same WIFI access point, or logging in to the same user account, or belonging to the same user, or being in the same local area network, etc.). Associated devices can be terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.). Optionally, the processing device is of the same or different type as the associated device. Through the above method, based on the judgment of whether the processing device, application or service, and/or associated device meet the corresponding preset conditions, corresponding processing is performed, so that the device can conveniently and/or intelligently process when interacting with the user, and improve user experience.

For example, when the processing device displays the music playback interface, if the processing device obtains the first voice "next song" and the second voice "Xiao Zhang is here", since the first voice and the operation object of the current music playback interface If the second voice is not associated with the operation object of the current music playback interface, only the operation event corresponding to the first voice can be executed. For another example, when the processing device is running the instant messaging application in the foreground, it can display the instant messaging application in full screen, and when the associated device is running the instant messaging application in the foreground, the processing device can hide or float the instant messaging application. For another example, when the processing device is running an office application, if the processing device is connected to the projection device, the office application is displayed in full screen, and when the processing device is disconnected from the projection device, the office application is displayed in half screen.

Optionally, the responding before the processing device and/or the first application or service meets a first preset condition further includes: performing preset processing on the first application or service.

Optionally, when the processing device performs preset processing on the first application or service, in response to the processing device and/or the first application or service meeting a first preset condition, control the first application or service Showcased in the first way. Optionally, performing preset processing includes at least one of the following: start, run, sleep, wake up, and exit. It should be noted that starting, running or waking up the first application or service may refer to starting, running or waking up the first application or service when the processing device receives information to be processed. Exemplarily, when the processing device detects that a human-computer interaction application is in an activated state, it displays the human-computer interaction application in a floating state or broadcasts the human-computer interaction application by voice.

Obtain at least one first voice and at least one second voice;

in the first preset scene;

at the first preset time;

in the first default position;

in the first default state;

Provide the first default service or function;

The triggering object is the first preset object;

said processing device has an associated device;

involves privacy;

Optionally, if the first voice and/or the second voice comes from an associated device and/or server, the first voice and/or the second voice may be the associated device and/or the The server directly sends to the processing device, or the associated device and/or the server performs preset processing such as encryption before sending to the processing device. Optionally, the first preset scene may be at least one of the following: a single-person scene, a multi-person scene, a closed environment (such as inside a room, inside a vehicle, etc.), an open environment (such as outdoors, a playground, etc.), and the like. The first preset time may be in a preset time period or in a non-preset time period, and the preset time period may be one or more set time periods, such as 8:00-12:00 in the morning and /or from 13:00 to 14:00 in the afternoon, or a certain day or several days, such as Monday to Friday and/or Saturday to Sunday. Being at the first preset location includes at least one of the following: being in the target object, not in the target object, and the target object can be a company, home, shopping mall, hotel, vehicle, meeting room, etc. The first preset state may be at least one of the following: exercise state (such as running, walking, etc.), static state, working state, idle state, connected state, disconnected state, folded state, unfolded state, etc. The first preset service or function may be at least one of the following: video call service, voice call service, video playback service, audio playback service, and the like. The triggering object of an application or service may refer to an object that triggers the application or service to perform preset processing, and the first preset object may be a user or another application or service. Optionally, the first preset relationship may be a priority relationship, an association relationship, a non-association relationship, and the like. Optionally, the associated device of the processing device may be that a communication connection is established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like. Optionally, the privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like. Exemplarily, if the processing device is in a single-person scene, it may display the first application or service in full screen; and/or, if the trigger object of the first application or service is a user, it may display the first application or service in full screen or displaying the first application or service in a half-screen state; and/or, if the priority of the first application or service is higher than that of the second application or service already displayed by the processing device, it may be displayed in a full-screen state The first application or service; and/or, if the first application or service is used to provide a video playback service, the first application or service may be displayed in full screen; and/or, if the processing has an associated device, it may prompt whether to display the first application or service through the associated device; and/or, if the first application or service involves privacy, it may prompt whether to monitor the privacy of the first application or service The content is hidden and then displayed.

Optionally, the user account of the first application or service logs in the processing device and the associated device at the same time, which means that the user account logged in by the first application or service in the processing device and the associated device is the same, for example, Taking the WeChat application as the first application or service as an example, after the user logs in to the WeChat application in the processing device using a registered user account, if the user sends a request to the processing device to log in to the WeChat application in the associated device using the user account, And the processing device successfully responds to the request. At this time, the user account logs into the processing device and the associated device at the same time, that is, the user account logged in by the WeChat application in the processing device and the associated device is the same.

Output at least one prompt message.

the second voice is associated with the first voice;

The first voice is associated with a preset first device, and/or, the second voice is associated with a preset second device.

Optionally, the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold, indicating that the first voice and the second voice may be acquired at the same time, for example, processing When the device receives the voice "play the next song" input by the first user, it also receives the voice "Are you free tomorrow" input by the second user; or indicates that the first voice and the second voice may It is acquired sequentially at relatively short intervals. For example, the processing device receives the second voice "Zhang San" after receiving the first voice "name". The preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on.

Optionally, the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold, indicating that the first voice and the The second voice may all be to express a certain operation event, but due to a user slip of the tongue or other reasons, the first voice input by the user to the processing device is wrong, but the input second voice is correct. For example, the processing device receives the first voice input by the user. The voice is "name Zhang San", and the second voice is "name Zhang Shan". The preset similarity threshold can be set according to actual needs, for example, it can be set to 90%, 95%, and so on.

Optionally, the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold, indicating that the first voice and the second voice may both be Sent at the same location, that is, the first voice and the second voice may be uttered by the same user, for example, the driver at the front of the vehicle and the passenger at the rear of the vehicle respectively utter a voice within a preset time period. For voice, the processing device can determine whether each voice is issued by the same user according to the distance from the sound source corresponding to each voice. The preset distance threshold can be set according to actual needs, for example, it can be set to 3 cm, 10 cm, and so on.

Optionally, the user who utters the first voice is associated with the user who utters the second voice, the user who utters the first voice and the user who utters the second voice may be the same user, or all There is an association relationship between the user who utters the first voice and the user who utters the second voice. For example, the user who utters the second voice is a family member of the user who utters the first voice. In a specific application, it may be based on Technologies such as voiceprint recognition and image recognition identify whether the user who uttered the first voice is associated with the user who uttered the second voice.

Optionally, the first voice and/or the second voice is associated with at least one operation object on the current interface, which may mean that the operation object corresponding to the first voice and/or the second voice is displayed on the current interface. Interface, for example, assuming that the current interface is a contact creation interface, and the first voice is "name Zhangsan", at this time, the operation object corresponding to the first voice is the "name" control, if the current interface displays "name" control, it means that the first voice is associated with at least one operation object on the current interface. Or, assuming that the current interface displays a picture, the first voice is "enlarge the picture", and the operation object corresponding to the first voice is "picture" at this time, it shows that the first voice and at least one operation object of the current interface associated.

Optionally, associating the first voice with the second voice may mean that the operation object corresponding to the first voice is associated with the operation object corresponding to the second voice, for example, assuming that the first voice is " Zhang San's phone number 1800000000", and the second voice is "Dial Zhang San's phone", at this time, the operation object corresponding to the first voice and the operation object corresponding to the second voice are both "Zhang San", indicating that The first voice is associated with the second voice. Through the above conditions, it can be detected whether the voice meets the conditions, and it is determined whether to perform different processing from the voice that does not meet the conditions, which improves the convenience and/or intelligence of voice processing, and improves user experience.

Optionally, the first voice is associated with a preset first device, and/or, the second voice is associated with a preset second device, and the preset first device and/or the preset second device may be a terminal Devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices (such as smart cars, car terminal, etc.). For example, when the processing device is a mobile phone, the preset first device can be a smart car, and the preset second device can be a user's smart speaker, so when the voice information detected by the mobile phone is from the smart car and/or smart speaker , the mobile phone can respond to the voice information, but when the voice information comes from other illegal devices, the mobile phone will not respond to the voice information, which improves the intelligence and/or security of voice processing.

Optionally, in response to the processing device and/or the first application or service meeting the first preset condition, the display interface of the first application or service may be controlled to display in a first manner, or the first application or service may be controlled to display in a first manner. The display interface of the application or service is displayed in the first manner and the second manner, or at least one prompt message is output. If the first application or service meets the first preset condition and the display interface of the first application or service is displayed in the first manner, the performing of the first preset processing may include outputting at least one prompt message.

Optionally, if the first application or service meets the first preset condition and the display interface of the first application or service is displayed in the first manner, the performing the first preset processing is to output at least one prompt message, including Detecting whether the processing device and/or the first application or service meets a fourth preset condition; outputting prompt information according to a detection result. Optionally, meeting the fourth preset condition includes at least one of the following: being in a first preset scene; being in a first preset time; being in a first preset position; being in a first preset state; The preset service or function; the trigger object is a first preset object; it has a first preset relationship with the second application or service displayed by the processing device; the processing device has an associated device; privacy is involved.

Optionally, meeting the first preset condition includes having a first preset relationship with a second application or service already displayed by the processing device, and the first preset relationship is a priority relationship, the Controlling the display of the first application or service in a first manner includes: displaying the first application or service in a cascaded, stacked or side-by-side manner based on a priority order (high-low or low-high). Exemplarily, assuming that the priority of the first application or service is higher than that of the second application or service, it can be displayed in a stacked form, that is, the display interface of the first application or service is displayed on the above the display interface of the second application or service, or may be displayed in a stacked or side-by-side manner, that is, the display interface of the first application or service is displayed in front of the display interface of the second application or service. Through the above method, the application or service is displayed based on the priority order (high-low or low-high), which is convenient for users to view and operate the application or service, and further improves the flexibility and/or display of the application or service Or intelligence, and further enhance the user experience.

It should be noted that the first method and the second method can be set according to actual needs, including but not limited to full screen state, half screen state, floating state, cascaded display, stacked display, side by side display, voice broadcast, Devices for switching display, encrypted display, blurred display, fixed display, direct hiding, etc., and the first manner is different from the second manner. Optionally, the full screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is 1; the half screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is less than 1 , such as one-half, one-third, or one-fourth, etc.; the floating state means that the application or service is suspended and displayed on the display interface of the device in the form of a floating ball or a floating window; the stacked display refers to According to a preset order (for example, according to the order in which the application or service is operated), the windows displaying the application or service are stacked one by one, for example, the window corresponding to the currently operating application is displayed on the top layer; Stacked display refers to stacking and arranging two windows displaying applications or services horizontally and evenly distributed vertically; the side-by-side display refers to arranging side by side windows displaying applications or services in a manner of two vertically and evenly distributed horizontally Get up; the voice broadcast refers to broadcast information such as the startup and/or operation and/or content of the application or service by voice. For example, after the processing device searches for the application and triggers the voice assistant to start, it can voice broadcast the voice assistant that has been turned on. information, instead of displaying the information that the voice assistant has been turned on on the display interface; the switching display device refers to switching the application or service from the processing device to the associated device for display, for example, switching the navigation map interface displayed on the mobile phone to the same The car machine associated with the mobile phone displays, etc.; the encrypted display means that when there is content related to user privacy, data security, etc. Display, used to protect user privacy and/or improve data security; Blurred display refers to blurring the display interface of an application or service, such as performing Gaussian blurring on at least a part of the image, and the degree of blurring can be set by the user or Automatically match according to the preset scene; fixed display refers to locking the display interface of the application or service so that the user cannot perform other operations except unlocking, for example, when the video application is switched to full-screen playback, the user cannot play at this time. Performing other operations on the interface can avoid receiving misoperations from the user. After the user touches the interface lock through a preset operation (such as clicking a preset control, performing a preset gesture, etc.), the user can perform other operations or control on the application interface; Direct hiding can be switching the application or service to the background or directly closing the process.

Exemplarily, when the user starts a video call service with a friend, if the processing device is in a multi-person scene, the video call service may be displayed in half-screen mode, and when the processing device changes from being in a multi-person scene to In a single-person scenario, the video call service can be displayed in a full-screen state; for another example, when the user starts the music player application, if the processing device is in motion, the music player application can be displayed in a floating state, and the When the processing device changes from a moving state to a static state, it can display the music playing application in a half-screen or full-screen state; for example, when the processing device is running a human-computer interaction application, if the human-computer interaction application is currently The preset service can display the human-computer interaction application in a full-screen state, and when the human-computer interaction application changes from a working state to an idle state, that is, when the preset service is not being provided, the human-computer interaction application can be displayed in a half-screen state or in a floating state. Human-computer interaction application; as another example, when the processing device starts the navigation map application outside the vehicle, it can display the navigation interface of the navigation map application in a full screen state, and when the processing device enters the vehicle and is associated with the vehicle (such as connected) , the navigation interface of the navigation map application can be switched to the car machine for display; for another example, when the processing device is running an office application, if the processing device is connected to a projection device, the office application will be displayed in full screen, while the When the processing device is disconnected from the projection device, the office application is displayed on a half screen; for another example, when the processing device is running the instant messaging application in the foreground, the instant messaging application can be displayed in full screen, and the instant messaging application is running in the foreground of the associated device. When the instant messaging application is used, the processing device may hide or float and display the instant messaging application.

Optionally, the first mode and the second mode include at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the The first way is different from the second way. Optionally, the background color refers to the main color of the display interface of the application or service, including but not limited to white, black, light green, dark green, and the like. The font refers to the size of the text displayed on the display interface of the application or service, such as 12 points, 14 points, and so on. Exemplarily, when the user conducts a text chat with a friend through an instant messaging application, if the processing device is in a multi-person scene, the font of all characters in the instant messaging application may be reduced, or the The background color is adjusted to a darker color such as black or gray, and when the processing device changes from a multi-person scene to a single-player scene, the fonts of all characters in the instant messaging application can be restored to the default size or enlarged. The font of all the text in the instant messaging application, or adjust the background color of the instant messaging application to a brighter color such as pink or bright green; When the processing device moves from a room with lights on to a room without lights on, that is, from a room with bright light to a room with dark light, the brightness of the video playback application can be reduced, while the processing device has never turned on the lights When moving from a room with lights to a room with lights on, that is, when moving from a dark room to a bright room, the brightness of the video playback application can be increased accordingly.

The processing device and/or the associated device receives a preset operation;

The processing device and/or the associated device is in a second preset scene;

The processing device and/or the associated device is in a second preset state;

The processing device provides a second preset service function;

said processing device has an associated device;

The associated device has the first application or service;

Running or closing the first application or service on the associated device.

Optionally, the preset operations include, but are not limited to, preset voice commands, preset gestures, preset button operations, etc., and may be used to instruct displaying on the processing device and/or associated devices. The second preset scene may be a scene opposite to the first preset scene, including but not limited to a single-person scene, a multi-person scene, a closed environment (such as a room, a vehicle, etc.), an open environment (such as an outdoor , playground, etc.) etc. For example, if the first preset scene is a single person scene, the second preset scene may be a multiplayer scene. Optionally, the second preset time may be at a time different from the first preset time, specifically one or more set time periods, such as 13:00-14:00 pm and/or Or from 18:00 to 22:00 in the evening, or a certain day or several days, such as Monday to Wednesday and/or Saturday to Sunday. For example, if the first preset time is from 13:00 to 14:00 in the afternoon, the second preset time can be from 14:01 to 15:00 in the afternoon. The second preset location is a location opposite to the first preset location, which may be a company, a home, a shopping mall, a hotel, and the like. For example, if the being in the first preset position is inside the vehicle, the being in the second preset position may be outside the vehicle and so on.

Optionally, the second preset state is a state opposite to the first preset state, and may be a motion state (such as running, walking, etc.), a static state, a working state, an idle state, or a connection state of the processing device. , disconnected state, folded state, or unfolded state, etc. The second preset state may also be the current operating state of the associated device, such as an idle state (the screen of the associated device only displays the desktop and does not display other applications or services), connection state (connected to the processing device); The second preset state may also be a folded state of the display screen of the associated device, such as a full-screen unfolded state, a fully folded state, a half-folded state, and the like.

Optionally, the second preset service or function is a service or function different from the first preset service or function, and may be a video call service, a voice call service, a video playback service, an audio playback service, and the like. For example, if the first preset service or function is a video call service, then the second preset service or function may be a voice call service or the like. The trigger object of an application or service may refer to an object that triggers an application or service to perform preset processing, and the second preset object may be a user or another application or service. The second preset object is the same as the first The preset objects are not the same. The second preset relationship may be a priority relationship, an association relationship, a non-association relationship, etc., and the second preset relationship is a relationship opposite to the first preset relationship. For example, if the first preset relationship is an association relationship, the second preset relationship may be a non-association relationship or the like. The associated device of the processing device may be a communication connection established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like. The privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like. Exemplarily, if the processing device is in a multi-person scene, the first application or service may be displayed in a floating state; and/or, if the trigger object of the first application or service is another application or service, it may Announce the first application or service by voice; and/or, if the priority of the first application or service is lower than or equal to the priority of the second application or service displayed by the processing device, half-screen displaying the first application or service; and/or, if the first application or service is used to provide an audio playback service, displaying the first application or service in a floating state; and/or, if the processing has associated device, the first application or service may be displayed through the associated device; and/or, if the first application or service involves privacy, the privacy content in the first application or service may be hidden Displayed after processing. The processing device may monitor the state of the associated device and/or the first application or service to determine whether the first application or service is running on or closed on the associated device, or the associated device may also The status information of the first application or service is sent to the processing device, so that the processing device can know in time whether the first application or service is running or closed on the associated device.

If performing the first preset process is outputting at least one prompt message, then controlling the display interface of the first application or service to be displayed in the first manner and/or the second manner based on a third preset strategy;

Optionally, meeting the third preset condition may include that the first voice meets the third preset condition, the second voice meets the third preset condition, and the first voice meets the third preset condition. condition and the second voice meets at least one of the third preset conditions, and the failure to meet the third preset condition may include that the first voice does not meet the third preset condition and the second At least one of the voice does not meet the third preset condition, the first voice does not meet the third preset condition, and the second voice does not meet the third preset condition. The first preset strategy includes at least one of the following: if the detection result shows that the first voice and the second voice meet a third preset condition, then at least one of the following processes is performed: performing the first operation event; execute the second operation event; do not execute the first operation event; do not execute the second operation event; combine the first operation event and the second operation event, and execute the combined operation event ; Output a prompt message, in response to the selection instruction, execute the operation event corresponding to the voice selected by the selection instruction; if the detection result is that the first voice and the second voice do not meet the third preset condition, then execute the following At least one processing: execute the first operation event and the second operation event at the same time; execute the first operation event and the second operation event according to the order of acquisition time; execute the first operation event according to the order of priority An operation event and the second operation event; the first operation event and the second operation event are executed according to the distance of the sound source. Through the above method, when processing the voice, the processing device performs corresponding processing on the operation event corresponding to the voice according to the detection result, which can improve the convenience and/or intelligence of the voice processing, and improve the user experience.

Optionally, after acquiring the voice, the processing device may obtain the operation event corresponding to the voice after extracting, text converting, or voice recognizing the voice. The operation event may only include the operation object, may only include the operation content, and may also include both the operation object and the operation content. Optionally, the operation object may be a control displayed on a graphical user interface, such as an input box and a button, or an object displayed on a display unit, such as an image. That is, the operation event may include the operation object and/or operation content of the current interface. Exemplarily, when at least two voices are acquired, the processing device executes the operation event corresponding to the voice that meets the preset condition, does not execute the operation event corresponding to the voice that does not meet the preset condition, or does not execute the voice that meets the preset condition The corresponding operation event, and execute the operation event corresponding to the voice that does not meet the preset condition, or when the first voice and the second voice meet the preset condition, merge the operation event corresponding to the two voices, and Execute the combined operation event, or output a prompt message when the first voice and the second voice meet the preset conditions, and execute the operation event corresponding to the voice selected by the user, or When the second voice does not meet the preset condition, the first operation event and the second operation event are executed simultaneously or sequentially. For example, when the processing device displays the contact creation interface, if the processing device acquires the first voice "name" and the second voice "Zhang San" input by the user, since the first voice is associated with the second voice, the The first operation event and the second operation event are combined to obtain a combined operation event "name Zhang San", and the combined operation event is executed, that is, "Zhang San" is input into the "name" control. Alternatively, when the processing device displays the contact creation interface, if the processing device acquires the first voice "name Zhang San" and the second voice "name Zhang Shan" within a preset time period, since the first voice corresponds to the second voice If the similarity between an operation event and the second operation event corresponding to the second voice is greater than the preset similarity threshold, the second operation event corresponding to the second voice can be executed instead of the first voice The corresponding first action event.

Optionally, when the first voice meets the third preset condition and/or the second voice meets the third preset condition, the first operation event may be executed, or the second operation event may not be executed. An operational event. For example, assuming that the first voice is "name Zhang San", if the detection finds that the first voice is associated with at least one operation object on the current interface, execute the first operation event corresponding to the first voice. Or, assuming that the first voice is "open the game" and the second voice is "forbidden to play games", if it is found through detection that the user who uttered the first voice is the son of the user who uttered the second voice, Then the first operation event corresponding to the first voice may not be executed.

Optionally, when the second voice meets the third preset condition and/or the first voice meets the third preset condition, the second operation event may be executed, or the first operation event may not be executed. Two operation events. For example, assuming that the first voice is "name Zhang San" and the second voice is "name Zhang Shan", if it is found through detection that the second operation event corresponding to the second voice corresponds to the first voice If the similarity between the first operation events is greater than or equal to the preset similarity threshold, the second operation event corresponding to the second voice may be executed.

Optionally, when the first voice and the second voice meet the third preset condition, the first operation event and the second operation event may be combined, and the combined operation event is executed, For example, assuming that the first voice is "name" and the second voice is "Zhang San", and it is found that the second voice is associated with the first voice through detection, then the first voice corresponding to the first voice is merged. An operation event and a second operation event corresponding to the second voice, and execute the combined operation event. Of course, when the first voice and the second voice meet the third preset condition, a prompt message may also be output, so as to execute the operation event corresponding to the selected voice according to the user selection result.

Optionally, the acquisition interval between the first voice and the second voice is longer than a preset duration threshold, and/or the first operation event corresponding to the first voice is equal to the second voice The similarity between the second operation events is less than a preset similarity threshold, and/or the user who uttered the first voice is not associated with the user who uttered the second voice, and/or the first voice and/or When the second voice is not associated with at least one operation object of the current interface, and/or the second voice is not associated with the first voice, the first operation event and the second operation event may be executed simultaneously , execute the first operation event and the second operation event according to the order of acquisition time, execute the first operation event and the second operation event according to the order of priority, or execute the first operation event according to the distance of the sound source An operational event and said second operational event.

For example, when the processing device is currently displaying the contact creation interface, assuming that the first voice is "name Zhang San" and the second voice is "Ethnic Hmong", if it is found through detection that the first voice corresponding to the first voice is If the similarity between the operation event and the second operation event corresponding to the second voice is less than the preset similarity threshold, the first operation event and the second operation event can be executed at the same time, or can be obtained according to the order of acquisition time The first operation event and the second operation event are executed sequentially. Alternatively, assuming that the processing device obtains that the first voice is "play the song of my motherland" and the second voice is "play the song of the Yangtze River", if the detection finds that the first voice and the second voice are respectively If they are issued by different users that are not associated, the first operation event and the second operation event may be executed according to the order of priority, or the first operation event and the second operation event may be executed according to the distance from the sound source.

It should be noted that the executing the first operation event and the second operation event according to a priority order includes at least one of the following: executing the first operation event and the second operation event according to a user priority order Events, execute the first operation event and the second operation event according to the order of priority of the event, execute the first operation event and the second operation event according to the priority order of the application that obtains the voice, and execute the first operation event and the second operation event according to the device that obtains the voice The first operation event and the second operation event are executed in order of priority. Optionally, the user priority can be set according to actual needs, for example, the priority of the driver is higher than that of the passengers in the vehicle, and the priority of the front row passengers is higher than that of the rear passengers. The event priority can be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event. The application priority can be set according to the actual situation, for example, the priority of the system application is higher than that of the third-party application. The device priority can be set according to the actual situation, for example, the priority of the processing device is higher than that of the associated device, and the priority of the associated device is higher than that of the server.

Optionally, if the second operation event is not associated with the operation object of the current interface, executing the second operation event includes: outputting an interface switching prompt message; and displaying the second operation event in response to a switching confirmation instruction The interface where the corresponding operation object is located, and execute the second operation event. Understandably, when the second operation event is not associated with the operation object of the current interface, for example, the second operation object corresponding to the second operation event is not displayed on the current interface, in order to execute the second operation event, usually An interface switch is required. However, the user may need to return to the current interface for operation after the processing device executes the second operation event. In order to minimize or avoid interface switching, the processing device may first output an interface switching prompt message to Take the appropriate action. For example, assuming that the processing device currently displays Zhang San's contact creation interface, if the second voice is "Call Li Si's phone number", an interface switching prompt message can be output at this time to prompt the user whether to switch to Li Si's contact. A human interface, and then judge whether to perform an interface switching operation based on the user's selection operation.

Fig. 6 is a schematic diagram of the interface of the processing device according to the first embodiment. As shown in (a) in Figure 6, the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the state of contact creation. Voice "telephone 8837297", it is detected that the input interval between the first voice and the second voice is short and the similarity is high, it can be considered that the first voice was input by the user by mistake, then the second voice will not be executed. One voice, and execute the second voice to input the number "8837297" into the "telephone" control, as shown in (b) in FIG. 6 . And/or, assuming that the smart speaker simultaneously receives the first voice "play the song "Motherland"" sent by the first mobile phone and the second voice "play the song "Yangtze River"" sent by the second mobile phone, at this time the smart speaker can The priorities of the mobile phone and the second mobile phone and/or the priority of the user of the first mobile phone and the user of the second mobile phone determine the song playback order. For example, if the priority of the first mobile phone is higher than that of the second mobile phone, then the Play the song "Motherland" first. In this way, when processing voices, considering whether multiple voices meet preset conditions can improve the convenience and/or intelligence of voice processing, and improve user experience.

Optionally, if the first preset processing is to control the display interface of the first application or service to be displayed in a first manner, then controlling the display interface of the first application or service to display in the first manner switch to the second mode for display, so that when the application or service is displayed, according to whether the processing device and/or the application or service and/or the associated device meet the preset conditions, the application or service is controlled to be displayed in a corresponding manner, The flexibility and/or intelligence of displaying applications or services can be improved, and user experience is improved. Exemplarily, when the user starts a video call service with a friend, if the processing device is in a multi-person scene, the video call service may be displayed in half-screen mode, and when the processing device changes from being in a multi-person scene to In a single-person scenario, the video call service can be displayed in a full-screen state; for another example, when the user starts the music player application, if the processing device is in motion, the music player application can be displayed in a floating state, and the When the processing device changes from a moving state to a static state, it can display the music playing application in a half-screen or full-screen state; for example, when the processing device is running a human-computer interaction application, if the human-computer interaction application is currently The preset service can display the human-computer interaction application in a full-screen state, and when the human-computer interaction application changes from a working state to an idle state, that is, when the preset service is not being provided, the human-computer interaction application can be displayed in a half-screen state or in a floating state. Human-computer interaction application; as another example, when the processing device starts the navigation map application outside the vehicle, it can display the navigation interface of the navigation map application in a full screen state, and when the processing device enters the vehicle and is associated with the vehicle (such as connected) , the navigation interface of the navigation map application can be switched to the car machine for display.

Fig. 7 is a schematic diagram of the interface of the processing device according to the first embodiment. Assuming that the user uses the chat application in the processing device to chat with his colleague Xiao Zhang in the shopping mall, since there are other users beside the user at this time, the current chat interface of the chat application is displayed in a half-screen state to protect privacy, as shown in Figure 7 As shown in (a), when there are no other users beside the user, such as when the user walks to the corner of the shopping mall, the current chat interface of the chat application can be displayed in full screen, so that the user can communicate with friends. And/or, assuming that the user starts the voice assistant application on the processing device for interaction while in a stationary state, the processing device displays the voice assistant application in full screen mode, and if it is detected that the processing device is in a motion state, the voice assistant application can be broadcast by voice Demonstrate the voice assistant application.

Optionally, meeting the second preset condition includes that the processing device has an associated device, and controlling the display of the first application or service from the first mode to the second mode includes: The first application or service is switched from the processing device to the associated device for presentation.

Optionally, when the processing device has an associated device, the first application or service may be switched from the processing device to the associated device for presentation, so that users can view the first application or service or operation etc. Optionally, the associated device displays the first application or service in the second manner. For example, when the user uses a mobile phone to start the navigation map application outside the vehicle, the navigation interface of the navigation map application can be displayed in full screen, and when the user enters the vehicle and the mobile phone is associated (such as connected) with the vehicle, the user can use all The car machine displays the navigation interface of the navigation map application; and/or, when the user uses the mobile phone to make a voice call with a friend, if the mobile phone is associated with the smart speaker at home, the voice call service can be switched to the smart speaker for display; And/or, for documents edited by the user on the tablet computer in the work scene, when the connection between the tablet computer and the personal computer is established and the distance between the two is less than the preset distance threshold, switch the document editing interface on the tablet computer to the personal computer displayed on the display. Through the above method, the application or service is switched to the associated device for display, which makes it more convenient for the user to use the application or service, and further improves the user experience.

Optionally, switching the first application or service from the processing device to the associated device for presentation includes:

The processing device closes or hides the first application or service.

Optionally, after the processing device switches the display interface of the first application or service to the management device for presentation, the first application or service may be closed or hidden, so that the processing device no longer accepts the first application or service from the user. The operation or processing of the display interface can be performed on other applications or services. Through the above method, the application or service of the processing device can be switched to the associated device for display if the preset conditions are met, and the processing device itself can perform other services, ensuring the simultaneous display or processing of two different applications or services , to further enhance the user experience.

Optionally, the second preset strategy and/or the third preset strategy includes at least one of the following:

Optionally, the display interface of the first application or service may be split according to preset rules to obtain a first display part and/or a second display part, and the first display part may be displayed in a first form. display, and/or display the second display part in a second form. For example, the picture and text in the display interface of the first application or service are split, and then the picture part is displayed in the first form, and the text part is displayed in the first form. Certainly, the first application or service may also be displayed through the processing device and/or the associated device. Through the above method, the first application or service can be displayed according to the preset operation and/or the detection result of the associated device, so that the display of the application or service is more flexible and/or intelligent, and user experience is improved. Exemplarily, when a user starts a video call service with a friend, the processing device may first display the video call service in a first manner, that is, full screen, and may output whether to switch to a half screen when detecting that it is in a multi-person scene. state, if a switching confirmation instruction is received, the video call service can be switched from the full screen state to the half screen state; and/or, when the processing device starts the navigation map application outside the vehicle, it can first display the full screen state. The navigation interface of the navigation map application, and when the processing device is associated with the car machine in the vehicle and the car machine has a navigation map application, the navigation interface of the navigation map application can be switched to the car machine for display .

Exemplarily, when a user starts a video call service with a friend, if the processing device is in a multi-person scene, the processing device may display the video call service in a half-screen state, and the processing device receives a notification to switch to a full-screen state. operating instructions, the video call service can be displayed in full screen; for another example, when the user starts the music playing application, if the processing device is in a motion state, the processing device can display the music playing application in a suspended state, and the When the associated device of the processing device receives the display operation instruction, it can switch the music playing application to the associated device for display; another example, when the user uses the payment application or service of the computer to perform the payment operation, if the computer is in In a multi-person scenario, the payment application or service can be displayed in an encrypted display and half-screen mode, and when the computer is connected to the mobile phone and the mobile phone has the payment application or service, the payment application or service can be displayed in full screen on the mobile phone. application or service.

Fig. 8 is a schematic diagram of the interface of the processing device according to the first embodiment. Assuming that the user starts the navigation map application on the processing device for navigation, the processing device displays the navigation interface of the navigation map application in a full screen state, as shown in (a) in FIG. 8 , if the processing device detects that the processing device is associated with the vehicle ( If connected) and there is a navigation map application on the vehicle, the navigation interface of the navigation map application can be switched to the vehicle for display, as shown in (b) in FIG. 8 .

Fig. 9 is a schematic diagram of an interface of a processing device according to the first embodiment. Assuming that the user starts the video playback application on the processing device to play the video, since it is detected that the processing device is at home, it can output a prompt message whether to play the video through the smart TV, as shown in (a) in Figure 9, after the user clicks to confirm After the button is pressed, the video can be played on the smart TV, as shown in (b) in Figure 9.

Optionally, the fourth preset strategy includes:

Optionally, when the processing device has an associated device, the first application or service may be switched from the processing device to the associated device for presentation, so that users can view the first application or service or operation etc. For example, when the user uses a mobile phone to start the navigation map application outside the vehicle, the navigation interface of the navigation map application can be displayed in full screen, and when the user enters the vehicle and the mobile phone is associated (such as connected) with the vehicle, the user can use all The car machine displays the navigation interface of the navigation map application; and/or, when the user uses the mobile phone to make a voice call with a friend, if the mobile phone is associated with the smart speaker at home, the voice call service can be switched to the smart speaker for display. Through the above method, the application or service is switched to the associated device for display, which makes it more convenient for the user to use the application or service, and further improves the user experience.

Fig. 10 is a schematic diagram of the interface of the processing device according to the first embodiment. When the processing device starts the music playing application while the user is in motion, it displays the playing interface of the music playing application in the form of a floating ball, as shown in (a) in FIG. 10 , and when the processing device detects that the user enters the vehicle and When the car machine of the vehicle has the music playing application, the playing interface of the music playing application can be switched to the car machine and displayed in a full-screen state, as shown in (b) in FIG. 10 .

Optionally, the first mode or the second mode includes a first form and a second mode, and the controlling the first application or service to switch from the first mode to the second mode to display or display all The display interface of the above-mentioned first application or service is split and displayed, including:

Optionally, the processing device is a terminal device with a foldable screen, and the screen of the terminal device includes a first area, a second area, and a foldable area located between the first area and the second area; The displaying the first display part in a first form, and/or displaying the second display part in a second form includes: displaying the first display part in a second form in the first area display in one form, and/or display the second display part in a second form in the second region.

Optionally, the preset rules can be set according to actual needs, such as the display of the first application or service according to the size of the area, and/or whether privacy is involved, and/or content types such as pictures and text. The interface is split. The first form and the second form include but are not limited to full-screen state, half-screen state, floating state, cascaded display, stacked display, side-by-side display, voice broadcast, switching display equipment, encrypted display, blurred display, fixed display , hide directly, etc. For example, if the display interface of the first application or service involves privacy and the privacy content is located in the upper part, the display interface of the first application or service may be split into the first display part (ie, the upper part) and the first display part (ie, the upper part). The second display part (i.e. the lower half), and the first display part can be displayed in the form of a floating ball, the second display part can be displayed in the form of a floating window, or the first display part and the The second display part is displayed in a stacked form, that is, the second display part is displayed on the upper layer of the first display part, which is equivalent to the second display part blocking the first display part. Through the above method, by splitting the display interface of the application or service, and displaying different display parts in different forms, it is more convenient for users to use the application or service, and the display of the application or service is further improved. flexibility and user experience.

Optionally, for the case where the processing device is a terminal device with a foldable screen, the first display part and/or the second display part obtained after splitting the display interface of the first application or service may be displayed on the processing device. different sub-sections of the screen so that the user sees differently from what other people see. The method can more conveniently and/or intelligently improve user experience in scenarios such as user privacy management and multi-person single-computer interaction. For example, in the electronic payment scenario, the page of the mobile payment application needs to display the payment QR code and the user verification (such as entering a password) interface successively, and the user verification process is very easy to be seen by other people, resulting in the leakage of user privacy information and payment collection. Personnel also need to scan the payment QR code first, and then wait until the payment QR code page switches to the user verification interface and confirm that the verification is passed before completing the electronic payment. The process is complicated; for folding screen devices, users can switch the mobile phone from the unfolded state to In the folded state, at the same time, the QR code of the payment page is displayed on the display area facing the payee, and the user verification interface is displayed on the display area facing the mobile phone user, so that the payee does not need to scan the electronic payment code. Waiting for the page to switch, the mobile phone user can directly enter the password on the other side of the screen, and at the same time, the cashier cannot see the process of entering the password, which effectively protects the user's privacy and improves the flexibility and convenience of multi-person stand-alone interaction scenarios.

Optionally, meeting the second preset condition includes involving privacy, and splitting the display interface of the first application or service according to preset rules to obtain the first display part and/or the second display part, include:

Perform privacy identification on the display interface of the first application or service to obtain a first display part that includes privacy and/or a second display part that does not involve privacy.

Optionally, the display interface of the first application or service may display private content, such as contact information, bank account information, secret documents, etc. Perform privacy identification on the display interface of the service to obtain the location of the private content, and then split the display interface of the first application or service to obtain the first display part that includes privacy and/or includes the first display part that does not involve privacy The second display part of . For example, assuming that the display interface of the first application or service is a chat interface with a friend, and the chat interface displays bank card account information, if the bank card account information involves privacy, then the first application or service can be The display interface performs privacy identification, obtains a first display part including bank card account information and/or a second display part including bank card account information not involved, and displays the first display part in a first form, The second display part is displayed in a second form. Through the above method, the privacy-related part of the display interface of the application or service is split to display the privacy-related part and the non-privacy-related part in different forms, thereby improving data security and further improving user experience.

Optionally, the controlling the first application or service to switch from the first mode to the second mode for presentation includes:

Output switching prompt information;

In response to the switching confirmation instruction, control the first application or service to switch from the first mode to the second mode for presentation.

Optionally, when the processing device needs to control the switching of the first application or service from the first mode to the second mode for display, it may first output a switching prompt message to prompt the user whether to switch, if received The first application or service may be controlled to switch from the first mode to the second mode for display if the switching confirmation command is received or no operation command is received within a preset time period. The switching prompt information may include information in the second manner, and the switching prompt information may be text or voice prompt information.

Optionally, the method further includes: in response to the processing device and/or the first application or service not meeting the first preset condition, controlling the first application or service to display in a third manner.

Optionally, when the processing device and/or the first application or service do not meet the first preset condition, the first application or service may be controlled to be displayed in a third manner, and the third manner may be the last The mode set or selected by the user may also be a default mode, such as a half-screen mode. For example, assuming that the first application or service is a music playing application, the third method is a half-screen state and the processing device meets the first preset condition that the processing device is in a motion state, if it is detected that the After the music player application is started and the processing device is in a static state, the music player application can be controlled to display in a half-screen state. Through the above method, when the processing device and/or application or service does not meet the preset conditions, the application or service is controlled to be displayed in a corresponding manner, which further improves the flexibility and/or intelligence of displaying the application or service, And further enhance the user experience.

Optionally, the controlling the first application or service to switch from the first mode to the second mode for presentation further includes:

A transitional dynamic effect of switching the first application or service from the first mode to the second mode is displayed within a preset duration.

Optionally, when the first application or service is switched from the first mode to the second mode, a transitional dynamic effect is displayed, and the transitional dynamic effect may be a combination of one or more of the following: the interface of the application or service Dynamic changes in size, dynamic changes in the location of the interface of an application or service, dynamic changes in the content of the interface of an application or service, dynamic changes in the number of interfaces in an application or service, dynamic changes in the color of an application or service interface, or changes in the interface of an application or service The dynamic change of transparency; the display transition dynamic effect needs to be completed within a preset time length, and the preset time length can be preset in combination with user habits and dynamic display effects, or can be customized by the user, or follow the user's operation The duration is used to switch and display in real time. For example: when the application interface is switched from the full-screen display to the half-screen display, it can be displayed within 0.5s from the full-screen application interface to the half-screen application interface, and the position of the application interface is also gradually changed from the full-screen position Moving to the half-screen position makes the application interface smoother during the switching process, and at the same time guides the user's focus to follow the switching process, so that the switching process is not too blunt and abrupt, which affects the user experience.

Optionally, before the step S1, it also includes: detecting whether the processing device and/or the first application or service comply with at least one of scene information, preset information, and information about the first application or service The first preset condition or the fourth preset condition.

Optionally, the scene information may include at least one of the following information: location type, time information, number of users, user identity, and the like. For the location type, it is used to distinguish the space where the user is currently located, including but not limited to: a closed environment (such as in a room, inside a vehicle, etc.), an open environment (such as outdoors, a playground, etc.), and the location type can be passed through sensors ( Such as gravity sensor, acceleration sensor, gyroscope, camera, GPS, etc.) to perceive. For time information, it can be used to distinguish the current date or time period. For the number of users, it can be used to distinguish how many users are around the processing device. For example, there may be only one or multiple users. source, indicating that there are multiple users, that is, it is in a multi-person scenario. For user identity, it is used to distinguish the user's personality characteristics, including but not limited to: age type, gender, occupation type, etc.

Optionally, according to the scene information, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition may be: according to location type, time information, number of users and user identity At least one of them is detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition. For example, it can be detected according to the location type whether the processing device is in the first preset scene (such as a single person scene or a multi-person scene), and/or, according to the time information, it can be detected whether the processing device is in the first preset time ( such as day or night).

Optionally, the preset information may include at least one of the following information: provided service or function information, device information, speed information, and the like. For the provided service or function information, it is used to distinguish the functions that the application or service can realize, for example, whether to provide video playback, whether to provide video call function, etc. For device information, it is used to distinguish the identity and/or status of processing devices, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, etc.), device connection information (such as existence associated device), remaining power information, remaining network traffic, network status, etc. For speed information, it is used to process the state of the device in partitions, such as whether it is moving or stationary.

Optionally, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition according to preset information may be: according to provided service or function information, device information, At least one of speed information and permission information, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition. For example, according to the provided service or function information, it can be detected whether the first application or service provides the first preset service or function; and/or, according to the speed information, it can be detected whether the processing device is in the first preset state .

Optionally, the relevant information of the first application or service may include at least one of the following information: received information to be processed, trigger object information, and permission information. For the received pending information, it can be used to distinguish whether the first application or service involves privacy and other information. For example, if the received pending information is "transfer 1,000 yuan to Xiaohe", it means that the first application or service involves privacy . For the trigger object information, it can be used to distinguish the object that triggers the first application or service. For example, if the user manually clicks on the first application or service to control the start of the first application or service, then the first application Or the trigger object of the service is the user; if the third-party application calls the first application or service to control the start of the first application or service, it means that the trigger object of the first application or service is other applications or services. For permission information, it is used to distinguish the usage permissions of different applications or services, including but not limited to: priority, callable applications or services, etc., for example, applications or services with different priorities have different usage or display sequences, or , the third-party applications that can be invoked by different applications or services are different.

Optionally, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition according to the relevant information of the first application or service may be: according to the received information to be processed , at least one of trigger object information and permission information, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition. For example, according to the received information to be processed, it may be detected whether the first application or service involves privacy; and/or, according to the trigger object information, it may be detected whether the trigger object of the first application or service is the first preset object and/or, according to the permission information, it may be detected whether there is a first preset relationship between the first application or service and the second application or service displayed by the processing device. It should be noted that, according to at least one of scene information, preset information, and information about the first application or service, it is also possible to detect whether the processing device and/or associated device meets the second preset condition, and the specific process can be Reference is made to the above process, which will not be repeated here. In this way, according to at least one of the scene information, the preset information, and the relevant information of the first application or service, it can be accurately detected whether the processing device and/or the first application or service meet the preset conditions, and the application or service is improved. The accuracy of the display further improves the user experience.

Optionally, said performing the second preset processing also includes:

According to at least one of current scene information, historical use information, and acquired operations, it is judged whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result. Understandably, in some scenarios, the user may not pay attention to the content displayed on the interface. Therefore, based on the preset policy, the first operation event corresponding to the first voice and/or the operation event corresponding to the second voice When the second operation event is processed, the current interface can still be maintained. For example, in order to drive safely, the user may only pay attention to the song list while driving the vehicle, but not the lyrics of each song. At this time, after receiving the song switching voice, the display interface of the car can be kept on list interface. In other scenarios, the user may pay more attention to the content displayed on the interface. Therefore, based on the first preset policy, the first operation event corresponding to the first voice and/or the second operation event corresponding to the second voice 2. When the operation event is processed, the interface can be switched according to the processing result. For example, when a user listens to a song with a mobile phone at home, he may need to read the lyrics at any time in order to hum synchronously. At this time, after receiving the song switching voice, the display interface of the mobile phone can be switched to the interface where the corresponding song is located. In this way, it is judged according to the current scene information whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result, which further improves the user experience and reduces the resource consumption of the device.

Optionally, performing corresponding operations based on the judgment result includes at least one of the following: if it is determined according to the current scene information that the current scene type is a preset scene type, then the current interface will not be switched; if the current scene type is determined according to the current scene information If it is not a preset scene type, the interface will be switched according to the processing result. Here, the preset scene type can be set according to actual needs, for example, it can be set as driving, low battery, weak signal and other scenes.

second embodiment

Fig. 11 is a schematic flowchart of a processing method according to the first embodiment. As shown in Figure 11, the processing method of the present application is applied to processing equipment, including the following steps:

S20: Perform second preset processing in response to the processing result.

Optionally, the processing device may be a terminal device (such as a mobile phone, a tablet computer, etc.), a wearable smart device (such as a smart watch, a smart bracelet, a smart earphone, etc.), a smart home device (such as a smart TV, a smart speaker, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.). The applications or services may include human-computer interaction applications, multimedia applications, communication applications, navigation applications, etc. Human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures. Optionally, the associated device may refer to any device that is connected to the processing device (it may be directly connected or indirectly connected, and the connection method may be a short-distance communication method or a data connection, etc.), or any device that meets the predetermined requirements. Any device that sets conditions (such as connecting to the same WIFI access point, or logging in to the same user account, or belonging to the same user, or being in the same local area network, etc.). Associated devices can be terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.). Optionally, the processing device is of the same or different type as the associated device. Through the above method, based on the judgment of whether the processing device and/or application or service meets the corresponding preset conditions and/or processing results, corresponding processing is performed, so that the device can conveniently and/or intelligently process when interacting with the user , which improves the user experience.

For example, when the processing device displays the music playback interface, if the processing device obtains the first voice "next song" and the second voice "Xiao Zhang is here", since the first voice and the operation object of the current music playback interface If the second voice is not associated with the operation object of the current music playback interface, only the operation event corresponding to the first voice can be executed. For another example, when the processing device is running the instant messaging application in the foreground, it can display the instant messaging application in full screen, and when the associated device is running the instant messaging application in the foreground, the processing device can hide or float the instant messaging application.

Obtain at least one first voice and at least one second voice;

Get the first voice;

Acquiring a first operation event and/or a first operation object;

Obtain the first operation event and the second operation event;

in the first preset scene;

in the first default position;

in the first default state;

Provide the first default service or function;

The triggering object is the first preset object;

Optionally, the first voice and/or the second voice comes from at least one of the following devices: a processing device, an associated device, and a server. Optionally, if the first voice comes from an associated device and/or a server, the first voice and/or the second voice may be directly sent to the processing by the associated device and/or the server device, and may also be sent to the processing device after preset processing such as encryption by the associated device and/or the server. It should be noted that, after acquiring the voice, the processing device may obtain the operation event corresponding to the voice after extracting the voice, converting the text into text, or recognizing the voice. The operation event may only include the operation object, may only include the operation content, and may also include both the operation object and the operation content. Optionally, the operation object may be a control displayed on a graphical user interface, such as an input box and a button, or an object displayed on a display unit, such as an image. That is, the operation event may include the operation object and/or operation content of the current interface.

Optionally, the first preset scene may be at least one of the following: a single-person scene, a multi-person scene, a closed environment (such as inside a room, inside a vehicle, etc.), an open environment (such as outdoors, a playground, etc.), and the like. The first preset time may be in a preset time period or in a non-preset time period, and the preset time period may be one or more set time periods, such as 8:00-12:00 in the morning and /or from 13:00 to 14:00 in the afternoon, or a certain day or several days, such as Monday to Friday and/or Saturday to Sunday. Being at the first preset location includes at least one of the following: being in the target object, not in the target object, and the target object can be a company, home, shopping mall, hotel, vehicle, meeting room, etc. The first preset state may be at least one of the following: exercise state (such as running, walking, etc.), static state, working state, idle state, connected state, disconnected state, folded state, unfolded state, etc. The first preset service or function may be at least one of the following: video call service, voice call service, video playback service, audio playback service, and the like. The triggering object of an application or service may refer to an object that triggers the application or service to perform preset processing, and the first preset object may be a user or another application or service. Optionally, the first preset relationship may be a priority relationship, an association relationship, a non-association relationship, and the like. Optionally, the associated device of the processing device may be that a communication connection is established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like. Optionally, the privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like. Exemplarily, if the processing device is in a single-person scene, it may display the first application or service in full screen; and/or, if the trigger object of the first application or service is a user, it may display the first application or service in full screen or displaying the first application or service in a half-screen state; and/or, if the priority of the first application or service is higher than that of the second application or service already displayed by the processing device, it may be displayed in a full-screen state The first application or service; and/or, if the first application or service is used to provide a video playback service, the first application or service may be displayed in full screen; and/or, if the processing has an associated device, it may prompt whether to display the first application or service through the associated device; and/or, if the first application or service involves privacy, it may prompt whether to monitor the privacy of the first application or service The content is hidden and then displayed.

the second voice is associated with the first voice;

The first operational event conflicts with the second operational event;

The first operational event is associated with the second operational event;

The first operation event is not associated with the second operation event.

Optionally, the conflict between the first operation event and the second operation event may mean that the operation object of the first operation event is the same as the operation object of the second operation event, but the operations executed are contradictory, for example , the first operation event is "Call Zhang San", and the second operation event is "Don't call Zhang San"; the conflict between the first operation event and the second operation event may also refer to The first operation event is the same as the second operation event, for example, the first operation event is "name Zhang San", and the second operation event is also "name Zhang San"; the first operation event Not conflicting with the second operation event may mean that the operation object of the first operation event is different from the operation object of the second operation event, the first operation event is different from the second operation event, etc. , for example, the first operation event is "name Zhang San", the second operation event is "ethnicity Han" and so on; the association between the first operation event and the second operation event may refer to the first The operation object of the operation event is associated with the operation object of the second operation event, or the operation content of the first operation event is associated with the operation content of the second operation event, for example, the first operation event is " Name Zhang San", the second operation event is "Call Zhang San"; the first operation event is not associated with the second operation event may mean that the operation object of the first operation event is not related to the The operation object of the second operation event is not associated, and the operation content of the first operation event is not associated with the operation content of the second operation event. For example, the first operation event is "name Zhang San", and the The second operation event is "Ethnicity Han" and the like. In this way, it can be detected whether the operation event meets the conditions, and it is determined whether to perform different processing from the operation events that do not meet the conditions, which improves the convenience and/or intelligence of the voice processing, and improves the user experience.

Optionally, the meeting the fourth preset condition includes at least one of the following:

The utterance user of the voice is not the same as or not associated with the input user of the first operation event.

Optionally, the first operation event may be determined or generated according to at least one of gestures, button operations, and voice operations, such as saying "name" by voice, clicking on a name control, or touching a circle or touching a name control with an air gesture wait. Optionally, the acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold, indicating that the voice and the first operation event may be acquired at the same time, for example, the processing device is The contact creation interface receives the voice "Zhang San" input by the user at the same time when the user clicks on the "Name" control, or it indicates that the voice and the first operation event may be sequentially acquired within a short interval, For example, after the processing device detects that the user clicks the "name" control on the contact creation interface, it receives the voice "Zhang San". The preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on.

Optionally, the second operation object corresponding to the voice is the same as the first operation object means that the second operation object indicated by the second operation event corresponding to the voice is the first operation object, for example, assuming The first operation object is "brightness", and the voice is "half brightness" or "half reduction". At this time, the second operation object corresponding to the voice is "brightness", and the same as the first operation object same. Optionally, the fact that the second operation object corresponding to the voice is different from the first operation object means that the second operation object indicated by the second operation event corresponding to the voice is not the first operation object, for example , assuming that the first operation object is "battery capacity", and the voice is "half brightness", at this time, the second operation object corresponding to the voice is "brightness", which is different from the first operation object.

Optionally, the user who uttered the voice is the same as or associated with the user who input the first operation event, it may be that the user who uttered the voice is the same user or has an associated relationship with the user who input the first operation event, For example, the user who uttered the voice is a family member of the input user of the first operation event. In a specific application, it can be identified based on technologies such as voiceprint recognition, face recognition, and fingerprint recognition whether the user who uttered the voice is related to The input user association of the first operation event. For example, after user Zhang San clicks the music play button, Zhang San's son inputs the voice "pause playing", at this time, it is considered that the user who uttered the voice is associated with the input user of the first operation event. Optionally, the user who utters the voice is not the same as or not associated with the user who inputs the first operation event. It may be that the user who utters the voice and the user who inputs the first operation event are not the same user or are not There is an association relationship, for example, the driver and passengers in the bus can be regarded as different or not associated.

Optionally, the meeting the fifth preset condition includes at least one of the following:

The first operation object is the same as the second operation object;

The first operand is different from the second operand;

The input user of the first operation event is the same as or related to the input user of the second operation event;

The input user of the first operation event is not the same as or not associated with the input user of the second operation event;

The first operation object and/or the second operation object are not associated with at least one operation object currently displayed on the interface.

Optionally, the first operation object being the same as the second operation object means that the first operation object is the second operation object, for example, assuming that the first operation event is clicking a brightness button displayed on the interface , the second operation event is the voice "half brightness reduction" or "half reduction", the first operation object is determined to be "brightness" according to the first operation event, and the The second operation object is also "brightness", and at this time, the first operation object is the same as the second operation object.

Optionally, the fact that the first operation object is different from the second operation object means that the first operation object is not the second operation object, for example, assuming that the first operation event is an action displayed on a click interface The power button, the second operation event is the voice "half brightness", the first operation object is determined to be "battery power" according to the first operation event, and the second operation is determined according to the second operation event The object is "brightness", and at this time, the first operation object is different from the second operation object.

Optionally, the input user of the first operation event is the same as or associated with the input user of the second operation event, which may mean that the input user of the first operation event and the input user of the second operation event are The same user may have an associated relationship. For example, the input user of the second operation event is a family member of the input user of the first operation event. In specific applications, it may be based on voiceprint recognition, face recognition, fingerprint recognition, etc. The technique identifies whether the input user of the second operational event is associated with the input user of the first operational event. For example, after user Zhang San clicks the music play button, Zhang San's father inputs the voice "pause playing", at this time, it is considered that the input user of the second operation event is associated with the input user of the first operation event.

Optionally, the input user of the first operation event is not the same as or not associated with the input user of the second operation event, and may be the input user of the first operation event and the input user of the second operation event They are not the same user or have no associated relationship. For example, the driver and passenger in the bus can be regarded as different or not associated.

Optionally, the first operation object and/or the second operation object are associated with at least one operation object displayed on the current interface, which may mean that the first operation object and/or the second operation object are displayed on The current interface, for example, assuming that the current interface is a contact creation interface, and the first operation object is a "name" control, since the current interface displays a "name" control, it means that at least one of the first operation object and the current interface Operation object association, or assuming that the current interface displays a picture, and the second operation object is "picture", it means that the second operation object is associated with at least one operation object on the current interface.

Optionally, the first operation object and/or the second operation object are not associated with at least one operation object displayed on the current interface, which may mean that the first operation object and/or the second operation object are not Displayed on the current interface, for example, assuming that the current interface is a contact creation interface, and the first operation object is a "dial" control, since the current interface does not display a "dial" control, it means that the first operation object is different from the current interface At least one operand for is not associated. Through the above conditions, it can be detected whether the first operation object and the second operation object meet the conditions, and then different processing strategies are determined, which improves the convenience and/or intelligence of processing, and improves user experience.

Optionally, the meeting the sixth preset condition includes at least one of the following:

The input user of the first operation event is a preset user;

The input user of the first operation event is not a preset user.

Optionally, the first operation object is associated with at least one operation object displayed on the current interface, which may mean that the first operation object is displayed on the current interface. For example, assuming that the current interface is a contact creation interface, the first The operation object is a "name" control, and if the current interface displays a "name" control, it means that the first operation object is associated with at least one operation object of the current interface. Alternatively, assuming that a picture is displayed on the current interface, and the first operation object is "picture", it means that the first operation object is associated with at least one operation object on the current interface. The first operation object is not associated with at least one operation object displayed on the current interface, which may mean that the first operation object is not displayed on the current interface. The input user of the first operation event being a preset user may mean that the user triggering the first operation event is a preset user or a user with specific characteristics, such as a family member or a minor.

Optionally, the meeting the seventh preset condition includes at least one of the following:

The second operation object is the same as the first operation object;

The second operand is different from the first operand;

The first operational event conflicts with the second operational event;

The first operational event is associated with the second operational event;

The first operation event is not associated with the second operation event.

Optionally, the acquisition interval between the second operation event and the first operation event is less than or equal to a preset duration threshold, indicating that the first operation event and the second operation event may be acquired at the same time, for example , the processing device receives the second operation event "Are you free tomorrow" input by the second user while receiving the first operation event "play the next song" input by the first user; or indicates that the first The operation event and the second operation event may be acquired sequentially within a short time interval. For example, the processing device receives the second operation event "Zhang San" after receiving the first operation event "name". The preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on. Optionally, the similarity between the first operation event and the second operation event is greater than or equal to a preset similarity threshold, indicating that both the first operation event and the second operation event may be expressed For a certain operation event, due to a user slip of the tongue or other reasons, the first operation event input by the user to the processing device is wrong, but the second operation event input is correct. For example, the processing device receives the first operation event input by the user as "name sheet Three", and the second operation event is "Name Zhang Shan". The preset similarity threshold can be set according to actual needs, for example, it can be set to 90%, 95%, and so on.

Optionally, the second operation object being the same as the first operation object means that the second operation object indicated by the second operation event is the first operation object, for example, assuming that the first operation object is "brightness", the second operation event is "half brightness" or "half reduction", at this time, the second operation object corresponding to the second operation event is "brightness", and it is the same as the first operation object same. Optionally, the second operation object being different from the first operation object means that the second operation object indicated by the second operation event is not the first operation object, for example, assuming that the first operation object The operation object is "battery capacity", and the second operation event is "half brightness", at this time, the second operation object is "brightness", which is different from the first operation object.

Optionally, the input user of the second operation event is the same as or associated with the input user of the first operation event, and may be that the input user of the second operation event is the same as the input user of the first operation event There may be a relationship among users. For example, the input user of the second operation event is a family member of the input user of the first operation event. In specific applications, it can be based on voiceprint recognition, face recognition, fingerprint recognition and other technologies Identifying whether the input user of the second operation event is associated with the input user of the first operation event. For example, after user Zhang San clicks the music play button, Zhang San's son inputs the voice "pause playing", at this time, it is considered that the input user of the second operation event is associated with the input user of the first operation event.

Optionally, the input user of the second operation event is not the same as or not associated with the input user of the first operation event, and may be the input user of the second operation event and the input user of the first operation event They are not the same user or have no associated relationship. For example, the driver and passenger in the bus can be regarded as different or not associated.

Optionally, the conflict between the first operation event and the second operation event may mean that the operation object of the first operation event is the same as the operation object of the second operation event, but the operations executed are contradictory, for example , the first operation event is "Call Zhang San", and the second operation event is "Don't call Zhang San"; the conflict between the first operation event and the second operation event may also refer to The first operation event is the same as the second operation event, for example, the first operation event is "name Zhang San", and the second operation event is also "name Zhang San". The fact that the first operation event does not conflict with the second operation event may mean that the operation object of the first operation event is different from the operation object of the second operation event, and that the operation object of the first operation event is different from that of the second operation event. The two operation events are not equal, for example, the first operation event is "name Zhang San", the second operation event is "ethnicity Han" and so on. The association between the first operation event and the second operation event may mean that the operation object of the first operation event is associated with the operation object of the second operation event, or that the operation content of the first operation event is associated with The operation content of the second operation event is related, for example, the first operation event is "name Zhang San", and the second operation event is "call Zhang San". The fact that the first operation event is not associated with the second operation event may mean that the operation object of the first operation event is not associated with the operation object of the second operation event, and the operation content of the first operation event It is not related to the operation content of the second operation event.

Optionally, the meeting the eighth preset condition includes at least one of the following:

is in the second preset scene;

is in the second default position;

is in the second default state;

Provide a second default service or function;

The triggering object is the second preset object;

said processing device has an associated device;

Privacy is involved.

Optionally, optionally, the second preset scene may be a scene opposite to the first preset scene, including but not limited to a single-player scene, a multi-person scene, a closed environment (such as in a room, in a vehicle) etc.), open environments (such as outdoors, playgrounds, etc.), etc. For example, if the first preset scene is a single person scene, the second preset scene may be a multiplayer scene. Optionally, the second preset time may be at a time different from the first preset time, specifically one or more set time periods, such as 13:00-14:00 pm and/or Or from 18:00 to 22:00 in the evening, or a certain day or several days, such as Monday to Wednesday and/or Saturday to Sunday. For example, if the first preset time is from 13:00 to 14:00 in the afternoon, the second preset time can be from 14:01 to 15:00 in the afternoon. The second preset location is a location opposite to the first preset location, which may be a company, a home, a shopping mall, a hotel, and the like. For example, if the being in the first preset position is inside the vehicle, the being in the second preset position may be outside the vehicle and so on.

Optionally, the second preset service or function is a service or function different from the first preset service or function, and may be a video call service, a voice call service, a video playback service, an audio playback service, and the like. For example, if the first preset service or function is a video call service, then the second preset service or function may be a voice call service or the like. The trigger object of an application or service may refer to an object that triggers an application or service to perform preset processing, and the second preset object may be a user or another application or service. The second preset object is the same as the first The preset objects are not the same. The second preset relationship may be a priority relationship, an association relationship, a non-association relationship, etc., and the second preset relationship is a relationship opposite to the first preset relationship. For example, if the first preset relationship is an association relationship, the second preset relationship may be a non-association relationship or the like. The associated device of the processing device may be a communication connection established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like. The privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like. Exemplarily, if the processing device is in a multi-person scene, the first application or service may be displayed in a floating state; and/or, if the trigger object of the first application or service is another application or service, it may Announce the first application or service by voice; and/or, if the priority of the first application or service is lower than or equal to the priority of the second application or service displayed by the processing device, half-screen displaying the first application or service; and/or, if the first application or service is used to provide an audio playback service, displaying the first application or service in a floating state; and/or, if the processing has associated device, the first application or service may be displayed through the associated device; and/or, if the first application or service involves privacy, the privacy content in the first application or service may be hidden Displayed after processing.

If the processing result is that the voice and the first operation object meet the fourth preset condition, then process the second operation event corresponding to the voice based on a fifth preset strategy;

Optionally, the first preset strategy includes at least one of the following:

executing the first operational event;

executing the second operational event;

not performing the first operational event;

not performing the second operational event;

A prompt message is output, and in response to the selection instruction, an operation event corresponding to the voice selected by the selection instruction is executed.

Optionally, the second preset strategy includes at least one of the following:

The first operation event and the second operation event are executed according to the distance of the sound source.

Optionally, in the case of only including the first voice, the meeting the second preset condition includes that the first voice meets the second preset condition, and the not meeting the second preset condition The condition includes that the first voice does not meet the second preset condition; when only the second voice is included, the meeting the second preset condition includes that the second voice meets the second preset condition, The failure to meet the second preset condition includes that the second voice does not meet the second preset condition; if the first voice and the second voice are included, the second voice does not meet the second preset condition. The preset conditions may include that the first voice meets the second preset condition, the second voice meets the second preset condition, the first voice meets the second preset condition, and the second voice meets the second preset condition. at least one of the preset conditions, and the failure to meet the second preset condition may include that the first voice does not meet the second preset condition and the second voice does not meet the second preset condition, the At least one of the first voice does not meet the second preset condition and the second voice does not meet the second preset condition.

Optionally, when the first voice meets the second preset condition and/or the second voice meets the second preset condition, the first operation event may be executed, or the second operation event may not be executed. An operational event. For example, assuming that the first voice is "name Zhang San", if the detection finds that the first voice is associated with at least one operation object on the current interface, execute the first operation event corresponding to the first voice. Or, assuming that the first voice is "open the game" and the second voice is "forbidden to play games", if it is found through detection that the user who uttered the first voice is the son of the user who uttered the second voice, Then the first operation event corresponding to the first voice may not be executed.

Optionally, when the second voice meets the second preset condition and/or the first voice meets the second preset condition, the second operation event may be executed, or the first operation event may not be executed. Two operation events. For example, assuming that the first voice is "name Zhang San" and the second voice is "name Zhang Shan", if it is found through detection that the second operation event corresponding to the second voice corresponds to the first voice If the similarity between the first operation events is greater than or equal to the preset similarity threshold, the second operation event corresponding to the second voice may be executed.

Optionally, when the first voice and the second voice meet the second preset condition, the first operation event and the second operation event may be combined, and the combined operation event is executed, For example, assuming that the first voice is "name" and the second voice is "Zhang San", and it is found that the second voice is associated with the first voice through detection, then the first voice corresponding to the first voice is merged. An operation event and a second operation event corresponding to the second voice, and execute the combined operation event. Of course, when the first voice and the second voice meet the second preset condition, a prompt message may also be output, so as to execute the operation event corresponding to the selected voice according to the user selection result.

Continue referring to FIG. 6, as shown in (a) in FIG. 6, the current interface of the processing device displays a contact creation interface, indicating that the processing device is in a contact creation state. At this time, the voice assistant responds to the first voice input by the user, "phone 8837291" and the second voice "telephone 8837297", and it is detected that the input interval between the first voice and the second voice is short and the similarity is high, it can be considered that the first voice was input by the user by mistake, then The first voice is not executed, but the second voice is executed, so as to input the number "8837297" into the "telephone" control, as shown in (b) in FIG. 6 . And/or, assuming that the smart speaker simultaneously receives the first voice "play the song "Motherland"" sent by the first mobile phone and the second voice "play the song "Yangtze River"" sent by the second mobile phone, at this time the smart speaker can The priorities of the mobile phone and the second mobile phone and/or the priority of the user of the first mobile phone and the user of the second mobile phone determine the song playback order. For example, if the priority of the first mobile phone is higher than that of the second mobile phone, then the Play the song "Motherland" first. In this way, when processing voices, considering whether multiple voices meet preset conditions can improve the convenience and/or intelligence of voice processing, and improve user experience.

Optionally, if the third preset condition is met, process the first operation event and/or the second operation event according to a third preset policy; if the third preset condition is not met , the first operation event and/or the second operation event are processed according to a fourth preset policy. In the case of only including the first operation event, the meeting the third preset condition includes that the first operation event meets the third preset condition, and the failure to meet the third preset condition includes The first operation event does not meet the third preset condition. In the case of only including the second operation event, the meeting the third preset condition includes that the second operation event meets the third preset condition, and the failure to meet the third preset condition includes The second operation event does not meet the third preset condition.

In the case of including the first operation event and the second operation event, the meeting the third preset condition may include that the first operation event meets the third preset condition, the second operation event Meet the third preset condition, the first operation event meets the third preset condition and the second operation event meets at least one of the preset third conditions, and the third preset condition does not meet It may include that the first operation event does not meet the third preset condition and the second operation event does not meet the third preset condition, the first operation event does not meet the third preset condition, the second operation event At least one of the third preset conditions is not met.

Optionally, the third preset strategy includes at least one of the following:

executing the first operational event;

executing the second operational event;

not performing the first operational event;

not performing the second operational event;

In response to a third operation event, the first operation event and/or the second operation event is executed.

Optionally, the fourth preset strategy includes at least one of the following:

Optionally, when the first operation event conflicts or does not conflict with the second operation event, the first operation event may be executed, the second operation event may not be executed, or the first operation may not be executed Event, execute the second operation event, or output a prompt message, execute the operation event corresponding to the selection instruction in response to the selection instruction, or execute the first operation event or the second operation event in response to the third operation event operation event, or the first operation event and the second operation event are not executed. For example, assuming that the first operation event is "Call Zhang San", and the second operation event is "Call Li Si", if it is found through detection that the first operation event and the second operation event conflict, the first operation event may not be executed, and the second operation event may be executed.

Optionally, when the first operation event is associated or not associated with the second operation event, the first operation event may be executed, the second operation event may not be executed, or the first operation may not be executed event, execute the second operation event, or execute the first operation event and the second operation event, or combine the first operation event and the second operation event, and execute the combined operation event, etc. .

For example, when the processing device displays the contact creation interface, it is assumed that the first operation event is determined to be "name Zhang San" according to the first voice input by the user, and the second operation event is "call Zhang San", if By detecting that the first operation event is found to be associated with the second operation event, the first operation event may be executed, and the second operation event may not be executed, that is, input "Zhang San" into the "name" control. Alternatively, when the current interface of the processing device is used to create an interface for contacts, assuming that the first voice is "name Li Si, Four Seasons' Si", the first operation event is determined to be "name Li Si" according to the first voice. Four" and the second operation event is "Four of Four Seasons", if it is found through detection that the first operation event is associated with the second operation event, the first operation event and the second operation can be combined event, and execute the merged operation event to input "Li Si" into the "Name" control.

Optionally, the third operation event includes but is not limited to: events such as touch gesture operation, air gesture operation, voice operation, etc. Acquired, for example, the air gesture can be acquired through the camera in the mobile phone or the voice input by the user can be acquired through the microphone. The processing device may first output a prompt message, and then execute the first operation event and/or the second operation event in response to a third operation event.

For example, assuming that the first operation event is "Call Zhang San", and the second operation event is "Call Li Si", if it is found through detection that the first operation event and the second operation event Conflict, an event conflict prompt message can be output, and if a voice "execute the following event" is obtained, that is, the third operation event is obtained, the second operation event can be executed. The processing device may also execute the first operation event and/or the second operation event in response to a third operation event after executing the first operation event and/or the second operation event, for example, When the current interface of the processing device creates an interface for a contact, assuming that the first operation event is "name Zhang San" and the second operation event is "name Zhang Shan", the processing device performs the processing according to the first preset policy. After the first operation event and/or the second operation event are processed, "Zhang Shan" is input into the "Name" control, that is, the second operation event is executed. If the user deletes the "Name" control "Zhang Shan" or click the cancel button, then "Zhang San" can be input into the "Name" control, that is, the first operation event is executed.

Optionally, when the first operation event does not conflict with or is not associated with the second operation event, the first operation event and the second operation event may be executed at the same time, or all operations may be executed according to a priority order. The first operation event and the second operation event. For example, when the processing device displays the contact creation interface, suppose the processing device obtains that the first voice input by the user is "name Zhang San, ethnicity Han", and based on the first voice determines that the first operation event is "name Zhang San" and The second operation event is "National Han". Since the first operation event does not conflict with the second operation event, the first operation event and the second operation event can be executed at the same time, that is, "Zhang San" Enter it into the "Name" control, and "Han" into the "Ethnicity" control. It should be noted that the executing the first operation event and the second operation event according to a priority order includes: executing the first operation event and the second operation event according to an event priority order. Optionally, the event priority may be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event.

Fig. 12 is a schematic diagram of the interface of the processing device according to the second embodiment. As shown in (a) in Figure 12, the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the contact creation state. Mountain", determine that the first operation event is "name Zhang San", and the second operation event is "name Zhang Shan", and it is detected that the first operation event conflicts with the second operation event, and the second operation event can be considered The event is what the user needs, so the first operation event is not executed, but the second operation event is executed to input the text "Zhang Shan" into the "Name" control, as shown in (b) in Figure 12 .

Optionally, after determining the first operation object in response to the first operation event, the method further includes: identifying the first operation object according to a preset identification manner. Optionally, after the first operation object is determined in response to the first operation event, the first operation object may be identified according to a preset identification method, such as font enlargement, animation display, Voice broadcast, etc., so that users can know in time and perform follow-up operations.

Optionally, if the voice and/or the first operation object meet the fourth preset condition, then process the second operation event corresponding to the voice based on a fifth preset strategy; if the voice and/or Or if the first operation object does not meet the fourth preset condition, the second operation event corresponding to the voice is processed based on a sixth preset policy.

Optionally, the fifth preset strategy includes at least one of the following:

executing the second operation event on the first operation object;

Optionally, the sixth preset strategy includes at least one of the following:

not performing the second operation event on the first operation object;

Output update operation event prompt information, and execute the third operation event on the first operation object in response to the third operation event.

Optionally, if the voice and/or the first operation object meet a fourth preset condition, for example, the second operation object corresponding to the voice is the same as the first operation object, then the first operation object may be The operation object executes the second operation event, and may also output prompt information for updating the operation object, and executes the second operation event on the first operation object in response to the confirmation instruction. For example, assuming that the current interface of the processing device is a contact creation interface, when the user clicks on the "Name" control, the voice "Zhang San" input by the user is received at the same time, and the first operation object at this time is the "Name" control , and the second operation object is also the "Name" control, if the "Name" control is blank, then input "Zhang San" into the "Name" control; if the "Name" control is not blank, then output Whether it is necessary to update the prompt information of the operation object, after receiving the confirmation instruction of updating the operation object, delete the content in the "Name" control, and input "Zhang San" into the "Name" control.

Optionally, if the voice and/or the first operation object do not meet the fourth preset condition, for example, the second operation object corresponding to the voice is different from the first operation object, the The first operation object executes the second operation event, outputs update operation event prompt information, and executes the third operation event on the first operation object in response to the third operation event. For example, assuming that the current interface of the processing device is a contact creation interface, when the user clicks on the "name" control, the voice "18000000000" input by the user is received at the same time, at this time, the first operation object is the "name" control, And the second operation object is the "Phone" control, since the first operation object is not the same as the first operation object, the number "18000000000" is not written into the "Name" control, or it can output whether It is necessary to update the prompt information of the operation event. After receiving the third operation event such as the voice "phone", execute the third operation event on the first operation object to write the number "18000000000" into the "phone" control .

Fig. 13 is a schematic diagram of the interface of the processing device according to the second embodiment. As shown in (a) in Figure 13, the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the contact creation state, and the user first clicks the "name" control in the current interface to input the first operation event, and then input the voice "Zhang San", the processing device detects whether the acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold, and whether the user who uttered the voice is the same as the user who input the first operation event , when it is detected that the acquisition interval is less than or equal to the preset duration threshold and the user who uttered the voice is the same as the user who input the first operation event, input the voice "Zhang San" into the "Name" control, as shown in Figure 13 Shown in (b).

Optionally, if the first operation object and the second operation object meet a fifth preset condition, then process the first operation event and/or the second operation event according to a third preset strategy ; if the first operation object and the second operation object do not meet the fifth preset condition, process the first operation event and/or the second operation event according to a seventh preset strategy.

Optionally, the seventh preset strategy includes at least one of the following:

The first operation event and the second operation event are executed according to the distance of the sound source of the corresponding voice.

Optionally, when the first operation object and the second operation object meet the fifth preset condition, the first operation event and/or the second operation event may be executed, or the first operation event may not be executed. The operation event and/or the second operation event may also combine the first operation event and the second operation event, and execute the combined operation event. For example, when the current interface is an interface created for contacts, if the processing device acquires that the first operation event is "name Zhang San" and the second operation event is "name Zhang Shan", then the first operation event The object is the same as the second operation object, that is, both are "name" controls, then the second operation event can be directly executed to input "Zhang Shan" into the "name" control, or a prompt message can be output to execute The operation event selected by the user; if the processing device acquires that the first operation event is "name Zhang San" and the second operation event is "ethnicity Han", then the first operation object and the second operation If the objects are not the same, execute the first operation event and the second operation event respectively, so as to input "Zhang San" into the "Name" control and "Han" into the "Ethnicity" control; if the processing device obtains all The first operation event is "name", and the second operation event is "Zhang San". At this time, the first operation object is the same as the second operation object, that is, both are "name" controls, and all The above first operation event and the second operation event are executed, and the combined operation event is executed to input "Zhang San" into the "Name" control.

Optionally, the third operation event may be an event such as a touch operation or a voice operation. For example, assuming that the first operation event is "call Zhang San", and the second operation event is "call Li Si", if it is found that the first operation object is not the same as the second operation object through detection, a prompt message can be output, and if a voice input by the user "execute the following event" is obtained at this time, the second operation object can be obtained. three operation events, the second operation event can be executed. Alternatively, when the current interface of the processing device is an interface created for a contact, assuming that the first operation event is "name Zhang San" and the second operation event is "name Zhang Shan", the processing device generates an interface according to the first preset policy. After the first operation event and/or the second operation event are processed, "Zhang Shan" is input into the "Name" control, that is, the second operation event is executed. If the user deletes the "Name" "Zhang Shan" in the control or click the cancel button, then "Zhang San" can be input into the "Name" control, that is, the first operation event is executed.

Optionally, when the first operation object and the second operation object do not meet the fifth preset condition, the first operation event and the second operation event may be executed at the same time, and all operation events may be executed in sequence according to the acquisition time. The first operation event and the second operation event, or the first operation event and the second operation event are executed according to a priority order. For example, when the processing device currently displays the contact creation interface, assuming that the first operation event is "name Zhang San" and the second operation event is "ethnicity and Hmong", if it is found through detection that the first operation object has the same If the second operation objects are different, the first operation event and the second operation event may be executed at the same time, or the first operation event and the second operation event may be executed in order of acquisition time. Alternatively, assuming that the processing device obtains that the first operation event is "play a song from my motherland" and that the second operation event is "play a song from the Yangtze River", if the input user of the first operation event and the If the input users of the second operation event are different, the first operation event and the second operation event may be executed according to a priority order.

Fig. 14 is a schematic diagram of an interface of a processing device according to a fourth embodiment. As shown in (a) in Figure 14, the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the contact creation state. At this time, the voice assistant responds to the first voice input by the user "name Zhang San, phone 18000000000 ", determine that the first operation event is "name Zhang San", the second operation event is "telephone 18000000000", and detect the second operation corresponding to the first operation object corresponding to the first operation event and the second operation event Objects are different, and the first operation object and the second operation object are respectively displayed on the current interface, it can be considered that the first operation object and the second operation object do not meet the preset conditions, then execute the The first operation event and the second operation event are used to input the text "Zhang Shan" into the "Name" control and the number "18000000000" into the "Phone" control, as shown in (b) in FIG. 14 .

Optionally, if the second operation event and/or the second operation object meet the seventh preset condition, then process the first operation event and/or the second operation event according to a third preset policy ; if the second operation event and/or the second operation object do not meet the seventh preset condition, then process the first operation event and/or the second operation event according to an eighth preset policy.

Optionally, when the first operation object meets the sixth preset condition and the second operation object meets the seventh preset condition, the first operation event and/or the second operation event may be executed, or The first operation event and/or the second operation event may not be executed, or the first operation event and the second operation event may be combined, and the combined operation event may be executed. For example, when the current interface is an interface created for a contact, if the processing device obtains that the first operation event is "telephone" and the second operation event is "1234567", then the first operation object is displayed on the current Interface, that is, it is considered that the first operation object meets the sixth preset condition. Since it is detected that the number of numbers corresponding to the second operation event does not match the number of phone numbers, the first operation event and the number of phone numbers are not executed. The above second operation event, or may output a prompt message for prompting the user to re-input; if the processing device obtains that the first operation event is "telephone", the second operation event is "18000000000", at this time the The first operation object is displayed on the current interface, that is, the first operation object is considered to meet the sixth preset condition, and since it is detected that the number of numbers corresponding to the second operation event matches the number of phone numbers, the merged The first operation event and the second operation event.

Optionally, the eighth preset strategy includes at least one of the following:

Optionally, when the first operation object meets the sixth preset condition and the second operation object does not meet the seventh preset condition, the first operation event and the second operation event may be executed simultaneously, according to Acquiring to execute the first operation event and the second operation event in chronological order, or execute the first operation event and the second operation event according to a priority order. For example, when the processing device currently displays the contact creation interface, assuming that the first operation event is "name Zhang San" and the second operation event is "ethnicity and Miao nationality", if the first operation object and If the second operation object is displayed on the current interface, and the second operation object is different from the first operation object, then the first operation event and the second operation event can be executed at the same time, or according to the acquired The first operation event and the second operation event are executed sequentially in time. Alternatively, assuming that the processing device obtains that the first operation event is "play a song from my motherland" and that the second operation event is "play a song from the Yangtze River", if the input user of the first operation event and the If the input users of the second operation event are different, the first operation event and the second operation event may be executed according to a priority order.

It should be noted that the executing the first operation event and the second operation event according to a priority order includes at least one of the following: executing the first operation event and the second operation event according to a user priority order Events, execute the first operation event and the second operation event according to the order of priority of the event, execute the first operation event and the second operation event according to the priority order of the application that obtains the voice, and execute the first operation event and the second operation event according to the device that obtains the voice The first operation event and the second operation event are executed in order of priority.

Optionally, the user priority can be set according to actual needs, for example, the priority of the driver is higher than that of the passengers in the vehicle, and the priority of the front row passengers is higher than that of the rear passengers. The event priority can be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event. The application priority can be set according to the actual situation, for example, the priority of the system application is higher than that of the third-party application. The device priority can be set according to the actual situation, for example, the priority of the processing device is higher than that of the associated device, and the priority of the associated device is higher than that of the server.

Fig. 15 is a schematic diagram of the interface of the processing device according to the second embodiment. As shown in (a) in Figure 15, the underage daughter uses the shopping application on the mother's mobile phone to select some commodities and generate an order, which is equivalent to the first operation event being an order generation event, and the first operation event The input user is a daughter. At this time, if the mobile phone receives the voice "confirm payment", it will detect whether the input user of the voice is a mother, and if so, execute the payment operation for the order, etc., which is equivalent to the second operation event It is an order payment event, and the input user of the second operation event is mother, as shown in (b) in FIG. 15 .

Optionally, said performing the second preset processing also includes:

Optionally, the first mode and the second mode can be set according to actual needs, including but not limited to full-screen state, half-screen state, floating state, stacked display, stacked display, side-by-side display, voice broadcast, switching Displayed equipment, encrypted display, blurred display, fixed display, direct hiding, etc., and the first manner is different from the second manner. Optionally, the full screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is 1; the half screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is less than 1 , such as one-half, one-third, or one-fourth, etc.; the floating state means that the application or service is suspended and displayed on the display interface of the device in the form of a floating ball or a floating window; the stacked display refers to According to a preset order (for example, according to the order in which the application or service is operated), the windows displaying the application or service are stacked one by one, for example, the window corresponding to the currently operating application is displayed on the top layer; Stacked display refers to stacking and arranging two windows displaying applications or services horizontally and evenly distributed vertically; the side-by-side display refers to arranging side by side windows displaying applications or services in a manner of two vertically and evenly distributed horizontally Get up; the voice broadcast refers to broadcast information such as the startup and/or operation and/or content of the application or service by voice. For example, after the processing device searches for the application and triggers the voice assistant to start, it can voice broadcast the voice assistant that has been turned on. information, instead of displaying the information that the voice assistant has been turned on on the display interface; the switching display device refers to switching the application or service from the processing device to the associated device for display, for example, switching the navigation map interface displayed on the mobile phone to the same The car machine associated with the mobile phone displays, etc.; the encrypted display means that when there is content related to user privacy, data security, etc. Display, used to protect user privacy and/or improve data security; Blurred display refers to blurring the display interface of an application or service, such as performing Gaussian blurring on at least a part of the image, and the degree of blurring can be set by the user or Automatically match according to the preset scene; fixed display refers to locking the display interface of the application or service so that the user cannot perform other operations except unlocking, for example, when the video application is switched to full-screen playback, the user cannot play at this time. Performing other operations on the interface can avoid receiving misoperations from the user. After the user touches the interface lock through a preset operation (such as clicking a preset control, performing a preset gesture, etc.), the user can perform other operations or control on the application interface; Direct hiding can be switching the application or service to the background or directly closing the process.

The above listed are only reference examples. In order to avoid redundancy, they will not be listed one by one here. In actual development or application, flexible combinations can be made according to actual needs, but any combination belongs to the technical solution of this application, which also covers the Within the protection scope of this application.

An embodiment of the present application further provides an intelligent terminal, the intelligent terminal includes a memory and a processor, and a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method in any of the foregoing embodiments are implemented.

An embodiment of the present application further provides a computer-readable storage medium, on which a processing program is stored, and when the processing program is executed by a processor, the steps of the processing method in any of the foregoing embodiments are implemented.

In the embodiments of the intelligent terminal and the computer-readable storage medium provided in the embodiments of the present application, all the technical features of any of the above-mentioned processing method embodiments may be included, and the expansion and explanation of the description are basically the same as the embodiments of the above-mentioned methods. This will not be repeated here.

An embodiment of the present application further provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on the computer, the computer is made to execute the methods in the above various possible implementation manners.

The embodiment of the present application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device installed with the chip executes the above various possible implementation modes. Methods.

It can be understood that the above scenario is only an example, and does not constitute a limitation on the application scenario of the technical solution provided by the embodiment of the present application, and the technical solution of the present application can also be applied to other scenarios. For example, those skilled in the art know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.

In this application, descriptions of the same or similar terms, concepts, technical solutions and/or application scenarios are generally only described in detail when they appear for the first time, and when they appear repeatedly later, for the sake of brevity, they are generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions and/or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

In this application, the description of each embodiment has its own emphasis. For the parts that are not detailed or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

The various technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, all It should be regarded as the scope described in this application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in one of the above storage media (such as ROM/RAM, magnetic CD, CD), including several instructions to make a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) execute the method of each embodiment of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Usable media may be magnetic media, (eg, floppy disk, memory disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Claims

A processing method applied to processing equipment, comprising the following steps:

S1: In response to the processing device and/or the first application or service meeting a first preset condition, perform a first preset process;

S2: In response to the processing device and/or associated device meeting a second preset condition, perform a second preset process.
The processing method according to claim 1, wherein said meeting the first preset condition includes at least one of the following:

Obtain at least one first voice and at least one second voice;

in the first preset scene;

in the first default position;

in the first default state;

Provide the first default service or function;

The triggering object is the first preset object;

have a first preset relationship with the second application or service already displayed by the processing device;

said processing device has an associated device;

involving privacy;

The display interface of the first application or service is displayed in a first manner;

The user account of the first application or service logs in to the processing device and the associated device at the same time.
The method according to claim 2, wherein said performing the first preset processing comprises at least one of the following:

In response to at least one first voice and at least one second voice, detecting whether the first voice and the second voice meet a third preset condition;

controlling the display interface of the first application or service to be displayed in a first manner;

Outputting at least one prompt message in response to displaying the display interface of the first application or service in a first manner;

controlling the display interface of the first application or service to be displayed in the first manner and in the second manner;

Output at least one prompt message.
The method according to claim 3, wherein said meeting the third preset condition includes at least one of the following:

The acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold;

The similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold;

The difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold;

The speaking user of the first voice is associated with the speaking user of the second voice;

The first voice and/or the second voice is associated with at least one operation object of the current interface;

the second speech is associated with the first speech;

The first voice is associated with a preset first device, and/or, the second voice is associated with a preset second device.
The method according to claim 3 or 4, wherein said meeting the second preset condition includes at least one of the following:

The processing device detects that the first voice and the second voice meet the third preset condition;

The processing device and/or the associated device receives a preset operation;

The processing device and/or the associated device is in a second preset scene;

The processing device and/or the associated device is in a second preset position;

The processing device and/or the associated device is in a second preset state;

The processing device provides a second preset service function;

said processing device has an associated device;

The associated device has the first application or service;

Running or closing the first application or service on the associated device.
The method according to claim 3, wherein said performing the second preset processing comprises at least one of the following:

If the first preset processing is to detect whether the first voice and the second voice meet the third preset condition in response to at least one first voice and at least one second voice, then according to the detection result, based on The first preset policy processes the first operation event corresponding to the first voice and/or the second operation event corresponding to the second voice;

If the first preset processing is to control the display interface of the first application or service to display in the first manner, then control the display interface of the first application or service to switch from the first manner to the second manner. way to display;

If performing the first preset processing is to display at least one prompt message in response to the display interface of the first application or service in a first manner, then control the first application or service based on a second preset policy The display interface is switched from the first mode to the second mode for display;

If performing the first preset process is outputting at least one prompt message, then controlling the display interface of the first application or service to be displayed in the first manner and/or the second manner based on a third preset strategy;

If the first preset processing is to control the display interface of the first application or service to be displayed in the first manner and the second manner, then control the display interface of the first application or service based on a fourth preset strategy Shown in a third way.
The processing method according to claim 6, wherein the first preset strategy includes at least one of the following:

If the detection result is that the first voice and the second voice meet the third preset condition, at least one of the following processes is performed: executing the first operation event; executing the second operation event; not executing the The first operation event; not executing the second operation event; merging the first operation event and the second operation event, and executing the combined operation event; outputting a prompt message, and executing the selection in response to a selection instruction Instruct the operation event corresponding to the selected voice; if the detection result is that the first voice and the second voice do not meet the third preset condition, perform at least one of the following processes: simultaneously execute the first operation event and the second voice The second operation event; execute the first operation event and the second operation event according to the acquisition time sequence; execute the first operation event and the second operation event according to the priority order; according to the sound source distance performing the first operation event and the second operation event near and far;

And/or, the second preset strategy and/or the third preset strategy include at least one of the following:

displaying after splitting the display interface of the first application or service;

displaying a display interface of the first application or service through the processing device and/or the associated device;

And/or, the fourth preset strategy includes:

Switching the display interface of the first application or service from the processing device to the associated device for presentation.
The processing method according to claim 6 or 7, wherein the first mode or the second mode includes a first mode and a second mode, and the control of the first application or service from the first mode Switching to the second method for display or splitting and displaying the display interface of the first application or service includes:

Splitting the display interface of the first application or service according to preset rules to obtain a first display part and/or a second display part;

Displaying the first display part in a first form, and/or displaying the second display part in a second form.
The processing method according to claim 8, wherein the screen of the processing device comprises a first area, a second area, and a foldable area between the first area and the second area; The first display part is displayed in a first form, and/or the second display part is displayed in a second form, including:

The first display part is displayed in a first form in the first area, and/or the second display part is displayed in a second form in the second area.
The processing method according to claim 6 or 7, wherein the controlling the display of the first application or service from the first mode to the second mode comprises:

A transitional dynamic effect of switching the first application or service from the first mode to the second mode is displayed within a preset duration.
The processing method according to claim 1, wherein, before the S1 step, further comprising:

According to at least one of scene information, preset information, and information related to the first application or service, it is detected whether the processing device and/or the first application or service meet the first preset condition.
The method according to claim 5, wherein the first mode and the second mode include at least one of the following: full screen state, half screen state, floating state, stacked display, stacked display, side by side display, fixed display, directly concealed, and the first way is different from the second way; and/or,

The first preset state and the second preset state include at least one of the following: a motion state, a static state, a working state, an idle state, a folded state, and an unfolded state, and the second preset state is the same as the a state relative to the first predetermined state; and/or,

The first preset relationship includes at least one of the following: priority relationship, association relationship, and non-association relationship.
The method according to claim 5, wherein the first mode and the second mode comprise at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the first mode is different from the second mode.
The method according to claim 4, wherein the first operation event and the second operation event include operation objects and/or operation content of the current interface; and/or,

The second preset processing also includes:

According to at least one of current scene information, historical use information, and acquired operations, it is judged whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result.
The method according to claim 14, wherein said performing corresponding operations based on the judgment result comprises at least one of the following:

If it is determined according to the current scene information that the current scene type is a preset scene type, the current interface will not be switched;

If it is determined according to the current scene information that the current scene type is not the preset scene type, interface switching is performed according to the processing result.
A processing method applied to processing equipment, comprising the following steps:

S10: In response to the processing device and/or the first application or service meeting a first preset condition, perform a first preset process; S20: In response to a processing result, perform a second preset process.
The method according to claim 16, wherein said meeting the first preset condition comprises at least one of the following:

Obtain at least one first voice and at least one second voice;

Get the first voice;

Acquiring a first operation event and/or a first operation object;

Obtain the first operation event and the second operation event;

in the first preset scene;

in the first default position;

in the first default state;

Provide the first default service or function;

The triggering object is the first preset object;

There is a first preset relationship with the second application or service already displayed by the processing device.
The method according to claim 17, wherein said performing the first preset processing comprises at least one of the following:

Responding to at least one first voice and at least one second voice, detecting whether the first voice and the second voice meet a second preset condition;

Responding to the first voice, determining at least one first operation event and at least one second operation event, and detecting whether the first operation event and the second operation event meet a third preset condition;

Responding to a first operation event, determining a first operation object, and in response to at least one voice, detecting whether the voice and the first operation object meet a fourth preset condition;

In response to determining a first operation object according to a first operation event and determining a second operation object according to a second operation event, detecting whether the first operation object and the second operation object meet a fifth preset condition;

Detecting whether the second operation event and/or the second operation object meets the seventh preset condition in response to the first operation event and/or the first operation object meeting the sixth preset condition;

Controlling the display interface of the first application or service to display in a first manner, and detecting whether the processing device and/or the first application or service meet an eighth preset condition.
The method of claim 18, wherein,

Said meeting the second preset condition includes at least one of the following:

The acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold;

The similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold;

The difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold;

The speaking user of the first voice is associated with the speaking user of the second voice;

The first voice and/or the second voice is associated with at least one operation object of the current interface;

the second voice is associated with the first voice;

And/or, the third preset condition is met, including at least one of the following:

The first operational event conflicts with the second operational event;

The first operational event is associated with the second operational event;

The first operational event does not conflict with the second operational event;

The first operational event is not associated with the second operational event;

And/or, the meeting the fourth preset condition includes at least one of the following:

The acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold;

The second operation object corresponding to the voice is the same as the first operation object;

The second operation object corresponding to the voice is different from the first operation object;

The utterance user of the voice is the same as or related to the input user of the first operation event;

The voice uttering user is not the same as or not associated with the input user of the first operation event;

And/or, said meeting the fifth preset condition includes at least one of the following:

The first operation object is the same as the second operation object;

The first operand is different from the second operand;

The first operation object and/or the second operation object is associated with at least one operation object currently displayed on the interface;

The first operation object and/or the second operation object are not associated with at least one operation object displayed on the current interface;

And/or, said meeting the sixth preset condition includes at least one of the following:

The first operation object is associated with at least one operation object displayed on the current interface;

The first operation object is not associated with at least one operation object displayed on the current interface;

The input user of the first operation event is a preset user;

The input user of the first operation event is not a preset user;

And/or, said meeting the seventh preset condition includes at least one of the following:

The acquisition interval between the second operation event and the first operation event is less than or equal to a preset duration threshold;

The similarity between the first operation event and the second operation event is greater than or equal to a preset similarity threshold;

The second operation object is the same as the first operation object;

The second operand is different from the first operand;

The input user of the second operation event is the same as or associated with the input user of the first operation event;

The input user of the second operation event is not the same as or not associated with the input user of the first operation event;

The first operational event conflicts with the second operational event;

The first operational event is associated with the second operational event;

The first operational event does not conflict with the second operational event;

The first operational event is not associated with the second operational event;

And/or, said meeting the eighth preset condition includes at least one of the following:

is in the second preset scene;

is in the second default position;

is in the second default state;

Provide a second default service or function;

The triggering object is the second preset object;

have a second preset relationship with the third application or service already displayed by the processing device;

said processing device has an associated device;

Privacy is involved.
The method according to claim 18 or 19, wherein said performing the second preset processing includes at least one of the following:

If the processing result is that the first voice and the second voice meet the second preset condition, the first operation event corresponding to the first voice and/or the second The second operation event corresponding to the voice is processed;

If the processing result is that the first voice and the second voice do not meet the second preset condition, the first operation event corresponding to the first voice and/or the first operation event corresponding to the first voice according to the second preset policy The second operation event corresponding to the second voice is processed;

If the processing result is at least one of the following: the first operation event and the second operation event meet the third preset condition, the first operation object and the second operation object meet the fifth preset condition Assume that the condition, the second operation event and/or the second operation object meet the seventh preset condition, then process the first operation event and/or the second operation event according to a third preset policy ;

If the result of the processing is that the first operation event and the second operation event do not meet the third preset condition, the first operation event and/or the second operation event are processed according to a fourth preset policy process;

If the processing result is that the voice and the first operation object meet the fourth preset condition, then process the second operation event corresponding to the voice based on a fifth preset strategy;

If the processing result is that the voice and the first operation object do not meet the fourth preset condition, then process the second operation event corresponding to the voice based on a sixth preset strategy;

If the processing result is that the first operation object and the second operation object do not meet the fifth preset condition, then perform corresponding processing based on a seventh preset strategy;

If the processing result is that the second operation event and/or the second operation object do not meet the seventh preset condition, then perform corresponding processing based on the eighth preset strategy;

If the processing result is that the processing device and/or the first application or service meet the eighth preset condition, controlling the display interface of the first application or service to switch from the first mode to the second mode for display .
The method according to claim 20, wherein the first preset strategy includes at least one of the following:

executing the first operational event;

executing the second operational event;

not performing the first operational event;

not performing the second operational event;

Merge the first operation event and the second operation event, and execute the combined operation event;

Outputting a prompt message, in response to the selection instruction, executing an operation event corresponding to the voice selected by the selection instruction;

And/or, the second preset strategy includes at least one of the following:

executing the first operational event and the second operational event simultaneously;

Executing the first operation event and the second operation event according to the acquisition time sequence;

executing the first operational event and the second operational event according to a priority order;

executing the first operation event and the second operation event according to the distance of the sound source;

And/or, the third preset strategy includes at least one of the following:

executing the first operational event;

executing the second operational event;

not performing the first operational event;

not performing the second operational event;

Merge the first operation event and the second operation event, and execute the combined operation event;

Outputting a prompt message, and executing an operation event corresponding to the selection instruction in response to the selection instruction;

executing said first and/or said second operating event in response to a third operating event;

And/or, the fourth preset strategy includes at least one of the following:

executing the first operational event and the second operational event simultaneously;

executing the first operational event and the second operational event according to a priority order;

And/or, the fifth preset strategy includes at least one of the following:

executing the second operation event on the first operation object;

outputting update operation object prompt information, and executing the second operation event on the first operation object in response to the confirmation instruction;

And/or, the sixth preset strategy includes at least one of the following:

not performing the second operation event on the first operation object;

output update operation event prompt information, and execute the third operation event on the first operation object in response to the third operation event;

And/or, the seventh preset strategy includes at least one of the following:

executing the first operational event and the second operational event simultaneously;

Executing the first operation event and the second operation event according to the acquisition time sequence;

executing the first operational event and the second operational event according to a priority order;

Executing the first operation event and the second operation event according to the distance of the sound source of the corresponding voice;

And/or, the eighth preset strategy includes at least one of the following:

executing the first operational event and the second operational event simultaneously;

Executing the first operation event and the second operation event according to the acquisition time sequence;

The first operation event and the second operation event are executed according to a priority order.
The method according to claim 17, wherein the first operation event and the second operation event include operation objects and/or operation content of the current interface; and/or,

The second preset processing also includes:

According to at least one of current scene information, historical use information, and acquired operations, it is judged whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result.
The method according to claim 22, wherein said performing corresponding operations based on the judgment result comprises at least one of the following:

If it is determined according to the current scene information that the current scene type is a preset scene type, the current interface will not be switched;

If it is determined according to the current scene information that the current scene type is not the preset scene type, interface switching is performed according to the processing result.
The method according to claim 20, wherein the first mode and the second mode include at least one of the following: full screen state, half screen state, floating state, stacked display, stacked display, side by side display, fixed display, directly concealed, and the first way is different from the second way; and/or,

The first preset state and the second preset state include at least one of the following: a motion state, a static state, a working state, an idle state, a folded state, and an unfolded state, and the second preset state is the same as the a state relative to the first predetermined state; and/or,

The first preset relationship and the second preset relationship include at least one of the following: a priority relationship, an association relationship, and a non-association relationship, and the second preset relationship is opposite to the first preset relationship Relationship.
The method according to claim 20, wherein the first mode and the second mode comprise at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the first mode is different from the second mode.
A processing device, wherein the processing device includes: a memory, a processor, and a processing program stored in the memory and operable on the processor, when the processing program is executed by the processor, the following The step of the processing method described in claim 1.
A storage medium, wherein a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the processing method according to claim 1 are realized.