WO2023005362A1 - 处理方法、处理设备及存储介质 - Google Patents
处理方法、处理设备及存储介质 Download PDFInfo
- Publication number
- WO2023005362A1 WO2023005362A1 PCT/CN2022/093316 CN2022093316W WO2023005362A1 WO 2023005362 A1 WO2023005362 A1 WO 2023005362A1 CN 2022093316 W CN2022093316 W CN 2022093316W WO 2023005362 A1 WO2023005362 A1 WO 2023005362A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- voice
- preset
- operation event
- event
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
Definitions
- the present application relates to the field of electronic technology, and in particular to a processing method, processing equipment and storage medium.
- wearable smart devices such as smart watches, smart headphones, smart bracelets, smart glasses, etc.
- smart home devices such as smart TVs, smart speakers, smart refrigerators, smart desk lamps, smart air conditioners, smart ovens, etc.
- networked devices such as smart cars, vehicle-mounted terminals, navigators, etc.
- the main purpose of the present application is to provide a processing method, a processing device and a storage medium, aiming at solving the problem that the device is not convenient and/or intelligent enough when interacting with the user, so as to improve the user experience.
- the present application provides a processing method applied to processing equipment, including the following steps:
- the meeting the first preset condition includes at least one of the following:
- the triggering object is the first preset object
- said processing device has an associated device
- the display interface of the first application or service is displayed in a first manner
- the user account of the first application or service logs in to the processing device and the associated device at the same time.
- said performing the first preset processing includes at least one of the following:
- the meeting the third preset condition includes at least one of the following:
- the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold
- the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold
- the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold
- the speaking user of the first voice is associated with the speaking user of the second voice
- the first voice and/or the second voice is associated with at least one operation object of the current interface
- the second voice is associated with the first voice.
- the meeting the second preset condition includes at least one of the following:
- the processing device detects that the first voice and the second voice meet the third preset condition
- the processing device and/or the associated device receives a preset operation
- the processing device and/or the associated device is in a second preset scene
- the processing device and/or the associated device is in a second preset position
- the processing device and/or the associated device is in a second preset state
- the processing device provides a second preset service function
- said processing device has an associated device
- the associated device has the first application or service
- the second preset processing includes at least one of the following:
- the first preset processing is to detect whether the first voice and the second voice meet the third preset condition in response to at least one first voice and at least one second voice, then according to the detection result, based on The first preset policy processes the first operation event corresponding to the first voice and/or the second operation event corresponding to the second voice;
- first preset processing is to control the display interface of the first application or service to display in the first manner, then control the display interface of the first application or service to switch from the first manner to the second manner. way to display;
- performing the first preset processing is to display at least one prompt message in response to the display interface of the first application or service in a first manner, then control the first application or service based on a second preset policy
- the display interface is switched from the first mode to the second mode for display;
- performing the first preset process is outputting at least one prompt message, then controlling the display interface of the first application or service to be displayed in the first manner and/or the second manner based on a third preset policy;
- the first preset processing is to control the display interface of the first application or service to be displayed in the first manner and the second manner, then control the display interface of the first application or service based on a fourth preset strategy Shown in a third way.
- the first preset strategy includes at least one of the following:
- At least one of the following processes is performed: executing the first operation event; executing the second operation event; not executing the The first operation event; not executing the second operation event; merging the first operation event and the second operation event, and executing the combined operation event; outputting a prompt message, and executing the selection in response to a selection instruction Command the operation event corresponding to the selected voice;
- the second preset strategy and/or the third preset strategy include at least one of the following:
- the fourth preset strategy includes:
- the first mode or the second mode includes a first mode and a second mode
- the display interface of the first application or service is split and displayed, including:
- the screen of the processing device includes a first area, a second area, and a foldable area located between the first area and the second area; display in a second form, and/or display the second display part in a second form, including:
- the first display part is displayed in a first form in the first area, and/or the second display part is displayed in a second form in the second area.
- controlling the display of the first application or service from the first mode to the second mode includes:
- a transitional dynamic effect of switching the first application or service from the first mode to the second mode is displayed within a preset duration.
- it also includes:
- scene information According to at least one of scene information, preset information, and information related to the first application or service, it is detected whether the processing device and/or the first application or service meet the first preset condition.
- the first mode and the second mode include at least one of the following: full screen state, half screen state, floating state, stacked display, stacked display, side by side display, fixed display, direct hiding, and the first A way is different from said second way; and/or,
- the first preset state and the second preset state include at least one of the following: a motion state, a static state, a working state, an idle state, a folded state, and an unfolded state, and the second preset state is the same as the a state relative to the first predetermined state; and/or,
- the first preset relationship includes at least one of the following: priority relationship, association relationship, and non-association relationship.
- the first mode and the second mode include at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the The first way is different from the second way.
- the first operation event and the second operation event include operation objects and/or operation content of the current interface; and/or,
- the second preset processing also includes:
- said performing a corresponding operation based on the judgment result includes at least one of the following:
- the current interface will not be switched
- interface switching is performed according to the processing result.
- the present application also provides a second processing method, applied to processing equipment, comprising the following steps:
- the meeting the first preset condition includes at least one of the following:
- the triggering object is the first preset object
- said performing the first preset processing includes at least one of the following:
- the meeting the second preset condition includes at least one of the following:
- the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold
- the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold
- the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold
- the speaking user of the first voice is associated with the speaking user of the second voice
- the first voice and/or the second voice is associated with at least one operation object of the current interface
- the second speech is associated with the first speech
- the third preset condition is met, including at least one of the following:
- the first operational event conflicts with the second operational event
- the first operational event is associated with the second operational event
- the first operational event does not conflict with the second operational event
- the first operational event is not associated with the second operational event
- the meeting the fourth preset condition includes at least one of the following:
- the acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold
- the second operation object corresponding to the voice is the same as the first operation object
- the second operation object corresponding to the voice is different from the first operation object
- the utterance user of the voice is the same as or related to the input user of the first operation event;
- the voice uttering user is not the same as or not associated with the input user of the first operation event
- said meeting the fifth preset condition includes at least one of the following:
- the first operation object is the same as the second operation object;
- the first operand is different from the second operand
- the first operation object and/or the second operation object is associated with at least one operation object currently displayed on the interface;
- the first operation object and/or the second operation object are not associated with at least one operation object displayed on the current interface
- said meeting the sixth preset condition includes at least one of the following:
- the first operation object is associated with at least one operation object displayed on the current interface
- the first operation object is not associated with at least one operation object displayed on the current interface
- the input user of the first operation event is a preset user
- the input user of the first operation event is not a preset user
- said meeting the seventh preset condition includes at least one of the following:
- the acquisition interval between the second operation event and the first operation event is less than or equal to a preset duration threshold
- the similarity between the first operation event and the second operation event is greater than or equal to a preset similarity threshold
- the second operation object is the same as the first operation object
- the second operand is different from the first operand
- the input user of the second operation event is the same as or associated with the input user of the first operation event
- the input user of the second operation event is not the same as or not associated with the input user of the first operation event
- the first operational event conflicts with the second operational event
- the first operational event is associated with the second operational event
- the first operational event does not conflict with the second operational event
- the first operational event is not associated with the second operational event
- said meeting the eighth preset condition includes at least one of the following:
- the triggering object is the second preset object
- said processing device has an associated device
- the second preset processing includes at least one of the following:
- the processing result is that the first voice and the second voice meet the second preset condition
- the first operation event corresponding to the first voice and/or the second The second operation event corresponding to the voice is processed;
- the processing result is that the first voice and the second voice do not meet the second preset condition
- the first operation event corresponding to the first voice and/or the first operation event corresponding to the first voice according to the second preset policy The second operation event corresponding to the second voice is processed;
- the processing result is at least one of the following: the first operation event and the second operation event meet the third preset condition, the first operation object and the second operation object meet the fifth preset condition Assume that the condition, the second operation event and/or the second operation object meet the seventh preset condition, then process the first operation event and/or the second operation event according to a third preset policy ;
- the first operation event and/or the second operation event are processed according to a fourth preset policy process
- the processing device and/or the first application or service meet the eighth preset condition, controlling the display interface of the first application or service to switch from the first mode to the second mode for display .
- the first preset strategy includes at least one of the following:
- the second preset strategy includes at least one of the following:
- the third preset strategy includes at least one of the following:
- the fourth preset strategy includes at least one of the following:
- the fifth preset strategy includes at least one of the following:
- the sixth preset strategy includes at least one of the following:
- the seventh preset strategy includes at least one of the following:
- the eighth preset strategy includes at least one of the following:
- the first operation event and the second operation event are executed according to a priority order.
- the first operation event and the second operation event include operation objects and/or operation content of the current interface
- the second preset processing also includes:
- said performing a corresponding operation based on the judgment result includes at least one of the following:
- the current interface will not be switched
- interface switching is performed according to the processing result.
- the first mode and the second mode include at least one of the following: full screen state, half screen state, floating state, stacked display, stacked display, side by side display, fixed display, direct hiding, and the first A way is different from said second way; and/or,
- the first preset state and the second preset state include at least one of the following: a motion state, a static state, a working state, an idle state, a folded state, and an unfolded state, and the second preset state is the same as the a state relative to the first predetermined state; and/or,
- the first preset relationship and the second preset relationship include at least one of the following: a priority relationship, an association relationship, and a non-association relationship, and the second preset relationship is opposite to the first preset relationship Relationship.
- the first mode and the second mode include at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the The first way is different from the second way.
- the present application also provides a processing device, which includes: a memory, a processor, and a processing program stored in the memory and operable on the processor, when the processing program is executed by the processor.
- a processing device which includes: a memory, a processor, and a processing program stored in the memory and operable on the processor, when the processing program is executed by the processor.
- the present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned processing method are realized.
- the present application relates to a processing method, a processing device, and a storage medium.
- the processing method is applied to the processing device, and includes the following steps: in response to the processing device and/or the first application or service meeting the first preset condition, performing a first preset process; and performing a second preset process in response to the processing device and/or associated device meeting a second preset condition.
- This application performs corresponding processing based on the judgment of whether the processing device, application or service, and/or associated device meet the corresponding preset conditions, so that the device can perform processing conveniently and/or intelligently when interacting with the user, improving the user experience. experience.
- FIG. 1 is a schematic diagram of a hardware structure of an intelligent terminal implementing various embodiments of the present application
- FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application.
- FIG. 3 is a schematic diagram of a hardware structure of a controller 140 according to an embodiment of the present application.
- FIG. 4 is a schematic diagram of a hardware structure of a network node 150 according to an embodiment of the present application.
- Fig. 5 is a schematic flowchart of a processing method shown according to the first embodiment
- Fig. 6 is an interface diagram 1 of a processing device according to the processing method shown in the first embodiment
- Fig. 7 is a second interface diagram of the processing device according to the processing method shown in the first embodiment.
- Fig. 8 is a third interface diagram of the processing device according to the processing method shown in the first embodiment.
- Fig. 9 is a fourth interface diagram of the processing device according to the processing method shown in the first embodiment.
- Fig. 10 is a fifth interface diagram of the processing device according to the processing method shown in the first embodiment.
- Fig. 11 is a schematic flowchart of a processing method according to a second embodiment
- Fig. 12 is an interface diagram 1 of a processing device according to the processing method shown in the second embodiment
- Fig. 13 is a second interface diagram of the processing device according to the processing method shown in the second embodiment
- Fig. 14 is a third interface diagram of the processing device according to the processing method shown in the second embodiment.
- Fig. 15 is a fourth interface diagram of the processing device according to the processing method shown in the second embodiment.
- first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information.
- first information may also be called second information, and similarly, second information may also be called first information.
- second information may also be called first information.
- the word “if” as used herein may be interpreted as “at” or “when” or “in response to a determination”.
- the singular forms "a”, “an” and “the” are intended to include the plural forms as well, unless the context indicates otherwise.
- A, B, C means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C
- A, B or C or "A, B and/or C” means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.
- the words “if”, “if” as used herein may be interpreted as “at” or “when” or “in response to determining” or “in response to detecting”.
- the phrases “if determined” or “if detected (the stated condition or event)” could be interpreted as “when determined” or “in response to the determination” or “when detected (the stated condition or event) )” or “in response to detection of (a stated condition or event)”.
- step codes such as S1 and S2 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order.
- S2 will be executed first and then S1, etc., but these should be within the protection scope of this application.
- Smart terminals can be implemented in various forms.
- the smart terminals described in this application may include mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, Smart terminals such as wearable devices, smart bracelets, and pedometers, as well as fixed terminals such as digital TVs and desktop computers.
- PDA Personal Digital Assistant
- PMP portable media players
- navigation devices Smart terminals such as wearable devices, smart bracelets, and pedometers
- Smart terminals such as wearable devices, smart bracelets, and pedometers
- fixed terminals such as digital TVs and desktop computers.
- a mobile terminal will be taken as an example for illustration, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configuration according to the embodiments of the present application can also be applied to a fixed type terminal.
- FIG. 1 is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application.
- the mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, an A /V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components.
- RF Radio Frequency, radio frequency
- the radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station.
- the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
- the radio frequency unit 101 can also communicate with the network and other devices through wireless communication.
- the above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 , Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency division duplex long-term evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution, time-division duplex long-term evolution) and 5G, etc.
- GSM Global System of Mobile communication, Global System for Mobile Communications
- GPRS General Packet Radio Service
- CDMA2000 Code Division Multiple Access 2000
- WCDMA Wideband Code Division Multiple Access
- TD-SCDMA Time Division-Synchronous Code Division Multiple Access, Time Division Synchro
- WiFi is a short-distance wireless transmission technology.
- the mobile terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102, which provides users with wireless broadband Internet access.
- Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the mobile terminal, and can be completely omitted as required without changing the essence of the invention.
- the audio output unit 103 can store the audio received by the radio frequency unit 101 or the WiFi module 102 or in the memory 109 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like.
- the audio data is converted into an audio signal and output as sound.
- the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.).
- the audio output unit 103 may include a speaker, a buzzer, and the like.
- the A/V input unit 104 is used to receive audio or video signals.
- the A/V input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is used for still pictures or The image data of the video is processed.
- the processed image frames may be displayed on the display unit 106 .
- the image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 .
- the microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data.
- the processed audio (voice) data can be converted into a format transmittable to a mobile communication base station via the radio frequency unit 101 for output in case of a phone call mode.
- the microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.
- the mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors.
- the light sensor includes an ambient light sensor and a proximity sensor.
- the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the mobile terminal 100 moves to the ear. panel 1061 and/or backlight.
- the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile phone posture (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.
- the display unit 106 is used to display information input by the user or information provided to the user.
- the display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
- LCD Liquid Crystal Display
- OLED Organic Light-Emitting Diode
- the user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal.
- the user input unit 107 may include a touch panel 1071 and other input devices 1072 .
- the touch panel 1071 also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program.
- the touch panel 1071 may include two parts, a touch detection device and a touch controller.
- the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it.
- the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.
- the user input unit 107 may also include other input devices 1072 .
- other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.
- the touch panel 1071 may cover the display panel 1061.
- the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event.
- the corresponding visual output is provided on the display panel 1061 .
- the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated.
- the implementation of the input and output functions of the mobile terminal is not specifically limited here.
- the interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100 .
- an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more.
- the interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.
- the memory 109 can be used to store software programs as well as various data.
- the memory 109 can mainly include a storage program area and a storage data area.
- the storage program area can store an operating system, at least one function required application program (such as a sound playback function, an image playback function, etc.) etc.
- the storage data area can be Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone.
- the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
- the processor 110 is the control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole.
- the processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor.
- the application processor mainly processes operating systems, user interfaces, and application programs, etc.
- the demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .
- the mobile terminal 100 can also include a power supply 111 (such as a battery) for supplying power to various components.
- a power supply 111 (such as a battery) for supplying power to various components.
- the power supply 111 can be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.
- the mobile terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.
- the following describes the communication network system on which the mobile terminal of the present application is based.
- Fig. 2 is a kind of communication network system architecture diagram that the embodiment of the present application provides, and this communication network system is the LTE system of general mobile communication technology, and this LTE system includes the UE (User Equipment, user equipment) that communication connects sequentially ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.
- UE User Equipment, user equipment
- E-UTRAN Evolved UMTS Terrestrial Radio Access Network
- EPC Evolved Packet Core, Evolved Packet Core Network
- the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.
- E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on.
- the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .
- a backhaul for example, X2 interface
- EPC203 may include MME (Mobility Management Entity, Mobility Management Entity) 2031, HSS (Home Subscriber Server, Home Subscriber Server) 2032, other MME2033, SGW (Serving Gate Way, Serving Gateway) 2034, PGW (PDN Gate Way, packet data Network Gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Charging Functional Entity) 2036, etc.
- MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management.
- HSS2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information about service features and data rates.
- PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.
- the IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.
- IMS IP Multimedia Subsystem, IP Multimedia Subsystem
- LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems.
- the network system (such as 5G), etc., is not limited here.
- FIG. 3 is a schematic diagram of a hardware structure of a controller 140 provided in the present application.
- the controller 140 includes: a memory 1401 and a processor 1402, the memory 1401 is used to store program instructions, and the processor 1402 is used to call the program instructions in the memory 1401 to execute the steps performed by the controller in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.
- the foregoing controller further includes a communication interface 1403 , and the communication interface 1403 may be connected to the processor 1402 through a bus 1404 .
- the processor 1402 can control the communication interface 1403 to implement the receiving and sending functions of the controller 140 .
- FIG. 4 is a schematic diagram of a hardware structure of a network node 150 provided in the present application.
- the network node 150 includes: a memory 1501 and a processor 1502, the memory 1501 is used to store program instructions, and the processor 1502 is used to call the program instructions in the memory 1501 to execute the steps performed by the first node in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.
- the foregoing controller further includes a communication interface 1503 , and the communication interface 1503 may be connected to the processor 1502 through a bus 1504 .
- the processor 1502 can control the communication interface 1503 to realize the functions of receiving and sending of the network node 150 .
- the above-mentioned integrated modules implemented in the form of software function modules can be stored in a computer-readable storage medium.
- the above-mentioned software function modules are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor (English: processor) to execute the methods of the various embodiments of the present application. partial steps.
- a computer program product includes one or more computer instructions.
- a computer can be a general purpose computer, special purpose computer, computer network, or other programmable device.
- Computer instructions can be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, computer instructions can be sent from a website site, computer, server or data center by wire (such as Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center.
- the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk, SSD), etc.
- Fig. 5 is a schematic flowchart of a processing method shown according to the first embodiment. As shown in Figure 5, the processing method of the present application is applied to processing equipment, including the following steps:
- the processing device may be a terminal device (such as a mobile phone, a tablet computer, etc.), a wearable smart device (such as a smart watch, a smart bracelet, a smart earphone, etc.), a smart home device (such as a smart TV, a smart speaker, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.).
- the applications or services may include human-computer interaction applications, multimedia applications, communication applications, navigation applications, etc.
- Human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
- the associated device may refer to any device that is connected to the processing device (it may be directly connected or indirectly connected, and the connection method may be a short-distance communication method or a data connection, etc.), or any device that meets the predetermined requirements. Any device that sets conditions (such as connecting to the same WIFI access point, or logging in to the same user account, or belonging to the same user, or being in the same local area network, etc.).
- Associated devices can be terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.).
- the processing device is of the same or different type as the associated device.
- corresponding processing is performed, so that the device can conveniently and/or intelligently process when interacting with the user, and improve user experience.
- the processing device displays the music playback interface
- the processing device obtains the first voice "next song” and the second voice "Xiao Zhang is here” since the first voice and the operation object of the current music playback interface If the second voice is not associated with the operation object of the current music playback interface, only the operation event corresponding to the first voice can be executed.
- the processing device when the processing device is running the instant messaging application in the foreground, it can display the instant messaging application in full screen, and when the associated device is running the instant messaging application in the foreground, the processing device can hide or float the instant messaging application.
- the processing device is running an office application, if the processing device is connected to the projection device, the office application is displayed in full screen, and when the processing device is disconnected from the projection device, the office application is displayed in half screen.
- the responding before the processing device and/or the first application or service meets a first preset condition further includes: performing preset processing on the first application or service.
- performing preset processing includes at least one of the following: start, run, sleep, wake up, and exit. It should be noted that starting, running or waking up the first application or service may refer to starting, running or waking up the first application or service when the processing device receives information to be processed.
- the processing device detects that a human-computer interaction application is in an activated state, it displays the human-computer interaction application in a floating state or broadcasts the human-computer interaction application by voice.
- the meeting the first preset condition includes at least one of the following:
- the triggering object is the first preset object
- said processing device has an associated device
- the display interface of the first application or service is displayed in a first manner
- the user account of the first application or service logs in to the processing device and the associated device at the same time.
- the first voice and/or the second voice may be the associated device and/or the The server directly sends to the processing device, or the associated device and/or the server performs preset processing such as encryption before sending to the processing device.
- the first preset scene may be at least one of the following: a single-person scene, a multi-person scene, a closed environment (such as inside a room, inside a vehicle, etc.), an open environment (such as outdoors, a playground, etc.), and the like.
- the first preset time may be in a preset time period or in a non-preset time period, and the preset time period may be one or more set time periods, such as 8:00-12:00 in the morning and /or from 13:00 to 14:00 in the afternoon, or a certain day or several days, such as Monday to Friday and/or Saturday to Sunday.
- Being at the first preset location includes at least one of the following: being in the target object, not in the target object, and the target object can be a company, home, shopping mall, hotel, vehicle, meeting room, etc.
- the first preset state may be at least one of the following: exercise state (such as running, walking, etc.), static state, working state, idle state, connected state, disconnected state, folded state, unfolded state, etc.
- the first preset service or function may be at least one of the following: video call service, voice call service, video playback service, audio playback service, and the like.
- the triggering object of an application or service may refer to an object that triggers the application or service to perform preset processing, and the first preset object may be a user or another application or service.
- the first preset relationship may be a priority relationship, an association relationship, a non-association relationship, and the like.
- the associated device of the processing device may be that a communication connection is established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like.
- the privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like.
- the processing device may display the first application or service in full screen; and/or, if the trigger object of the first application or service is a user, it may display the first application or service in full screen or displaying the first application or service in a half-screen state; and/or, if the priority of the first application or service is higher than that of the second application or service already displayed by the processing device, it may be displayed in a full-screen state
- the first application or service; and/or, if the first application or service is used to provide a video playback service, the first application or service may be displayed in full screen; and/or, if the processing has an associated device, it may prompt whether to display the first application or service through the associated device; and/or, if the first application or service involves privacy, it may prompt whether to monitor the privacy of the first application or service
- the content is
- the user account of the first application or service logs in the processing device and the associated device at the same time, which means that the user account logged in by the first application or service in the processing device and the associated device is the same, for example, Taking the WeChat application as the first application or service as an example, after the user logs in to the WeChat application in the processing device using a registered user account, if the user sends a request to the processing device to log in to the WeChat application in the associated device using the user account, And the processing device successfully responds to the request. At this time, the user account logs into the processing device and the associated device at the same time, that is, the user account logged in by the WeChat application in the processing device and the associated device is the same.
- said performing the first preset processing includes at least one of the following:
- the meeting the third preset condition includes at least one of the following:
- the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold
- the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold
- the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold
- the speaking user of the first voice is associated with the speaking user of the second voice
- the first voice and/or the second voice is associated with at least one operation object of the current interface
- the second voice is associated with the first voice
- the first voice is associated with a preset first device, and/or, the second voice is associated with a preset second device.
- the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold, indicating that the first voice and the second voice may be acquired at the same time, for example, processing
- a preset duration threshold indicating that the first voice and the second voice may be acquired at the same time
- the processing device receives the second voice "Zhang San” after receiving the first voice "name”.
- the preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on.
- the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold, indicating that the first voice and the The second voice may all be to express a certain operation event, but due to a user slip of the tongue or other reasons, the first voice input by the user to the processing device is wrong, but the input second voice is correct.
- the processing device receives the first voice input by the user.
- the voice is "name Zhang San", and the second voice is "name Zhang Shan”.
- the preset similarity threshold can be set according to actual needs, for example, it can be set to 90%, 95%, and so on.
- the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold, indicating that the first voice and the second voice may both be Sent at the same location, that is, the first voice and the second voice may be uttered by the same user, for example, the driver at the front of the vehicle and the passenger at the rear of the vehicle respectively utter a voice within a preset time period.
- the processing device can determine whether each voice is issued by the same user according to the distance from the sound source corresponding to each voice.
- the preset distance threshold can be set according to actual needs, for example, it can be set to 3 cm, 10 cm, and so on.
- the user who utters the first voice is associated with the user who utters the second voice
- the user who utters the first voice and the user who utters the second voice may be the same user, or all
- the user who utters the second voice is a family member of the user who utters the first voice.
- it may be based on Technologies such as voiceprint recognition and image recognition identify whether the user who uttered the first voice is associated with the user who uttered the second voice.
- the first voice and/or the second voice is associated with at least one operation object on the current interface, which may mean that the operation object corresponding to the first voice and/or the second voice is displayed on the current interface.
- Interface for example, assuming that the current interface is a contact creation interface, and the first voice is "name Zhangsan", at this time, the operation object corresponding to the first voice is the "name” control, if the current interface displays "name” control, it means that the first voice is associated with at least one operation object on the current interface.
- the current interface displays a picture
- the first voice is "enlarge the picture”
- the operation object corresponding to the first voice is "picture” at this time, it shows that the first voice and at least one operation object of the current interface associated.
- associating the first voice with the second voice may mean that the operation object corresponding to the first voice is associated with the operation object corresponding to the second voice, for example, assuming that the first voice is " Zhang San's phone number 1800000000", and the second voice is "Dial Zhang San's phone", at this time, the operation object corresponding to the first voice and the operation object corresponding to the second voice are both "Zhang San", indicating that The first voice is associated with the second voice.
- it can be detected whether the voice meets the conditions, and it is determined whether to perform different processing from the voice that does not meet the conditions, which improves the convenience and/or intelligence of voice processing, and improves user experience.
- the first voice is associated with a preset first device
- the second voice is associated with a preset second device
- the preset first device and/or the preset second device may be a terminal Devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices (such as smart cars, car terminal, etc.).
- the processing device is a mobile phone
- the preset first device can be a smart car
- the preset second device can be a user's smart speaker
- the voice information detected by the mobile phone is from the smart car and/or smart speaker
- the mobile phone can respond to the voice information, but when the voice information comes from other illegal devices, the mobile phone will not respond to the voice information, which improves the intelligence and/or security of voice processing.
- the display interface of the first application or service may be controlled to display in a first manner, or the first application or service may be controlled to display in a first manner.
- the display interface of the application or service is displayed in the first manner and the second manner, or at least one prompt message is output. If the first application or service meets the first preset condition and the display interface of the first application or service is displayed in the first manner, the performing of the first preset processing may include outputting at least one prompt message.
- the performing the first preset processing is to output at least one prompt message, including Detecting whether the processing device and/or the first application or service meets a fourth preset condition; outputting prompt information according to a detection result.
- meeting the fourth preset condition includes at least one of the following: being in a first preset scene; being in a first preset time; being in a first preset position; being in a first preset state; The preset service or function; the trigger object is a first preset object; it has a first preset relationship with the second application or service displayed by the processing device; the processing device has an associated device; privacy is involved.
- meeting the first preset condition includes having a first preset relationship with a second application or service already displayed by the processing device, and the first preset relationship is a priority relationship
- the Controlling the display of the first application or service in a first manner includes: displaying the first application or service in a cascaded, stacked or side-by-side manner based on a priority order (high-low or low-high).
- the priority of the first application or service is higher than that of the second application or service, it can be displayed in a stacked form, that is, the display interface of the first application or service is displayed on the above the display interface of the second application or service, or may be displayed in a stacked or side-by-side manner, that is, the display interface of the first application or service is displayed in front of the display interface of the second application or service.
- the application or service is displayed based on the priority order (high-low or low-high), which is convenient for users to view and operate the application or service, and further improves the flexibility and/or display of the application or service Or intelligence, and further enhance the user experience.
- first method and the second method can be set according to actual needs, including but not limited to full screen state, half screen state, floating state, cascaded display, stacked display, side by side display, voice broadcast, Devices for switching display, encrypted display, blurred display, fixed display, direct hiding, etc., and the first manner is different from the second manner.
- the full screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is 1;
- the half screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is less than 1 , such as one-half, one-third, or one-fourth, etc.;
- the floating state means that the application or service is suspended and displayed on the display interface of the device in the form of a floating ball or a floating window;
- the stacked display refers to According to a preset order (for example, according to the order in which the application or service is operated), the windows displaying the application or service are stacked one by one, for example, the window corresponding to the currently operating application is displayed on the top layer;
- Stacked display refers to stacking and arranging two windows displaying applications or services horizontally and evenly distributed vertically;
- the side-by-side display refers to arranging side by side windows displaying applications or services in a manner of two vertically and evenly distributed horizontally Get up;
- the processing device searches for the application and triggers the voice assistant to start, it can voice broadcast the voice assistant that has been turned on. information, instead of displaying the information that the voice assistant has been turned on on the display interface;
- the switching display device refers to switching the application or service from the processing device to the associated device for display, for example, switching the navigation map interface displayed on the mobile phone to the same The car machine associated with the mobile phone displays, etc.; the encrypted display means that when there is content related to user privacy, data security, etc.
- Blurred display refers to blurring the display interface of an application or service, such as performing Gaussian blurring on at least a part of the image, and the degree of blurring can be set by the user or Automatically match according to the preset scene
- fixed display refers to locking the display interface of the application or service so that the user cannot perform other operations except unlocking, for example, when the video application is switched to full-screen playback, the user cannot play at this time. Performing other operations on the interface can avoid receiving misoperations from the user.
- Direct hiding can be switching the application or service to the background or directly closing the process.
- the video call service when the user starts a video call service with a friend, if the processing device is in a multi-person scene, the video call service may be displayed in half-screen mode, and when the processing device changes from being in a multi-person scene to In a single-person scenario, the video call service can be displayed in a full-screen state; for another example, when the user starts the music player application, if the processing device is in motion, the music player application can be displayed in a floating state, and the When the processing device changes from a moving state to a static state, it can display the music playing application in a half-screen or full-screen state; for example, when the processing device is running a human-computer interaction application, if the human-computer interaction application is currently The preset service can display the human-computer interaction application in a full-screen state, and when the human-computer interaction application changes from a working state to an idle state, that is, when the preset service is not being provided, the human-computer interaction application can be displayed in a half-screen state or in
- Human-computer interaction application when the processing device starts the navigation map application outside the vehicle, it can display the navigation interface of the navigation map application in a full screen state, and when the processing device enters the vehicle and is associated with the vehicle (such as connected) , the navigation interface of the navigation map application can be switched to the car machine for display; for another example, when the processing device is running an office application, if the processing device is connected to a projection device, the office application will be displayed in full screen, while the When the processing device is disconnected from the projection device, the office application is displayed on a half screen; for another example, when the processing device is running the instant messaging application in the foreground, the instant messaging application can be displayed in full screen, and the instant messaging application is running in the foreground of the associated device. When the instant messaging application is used, the processing device may hide or float and display the instant messaging application.
- the first mode and the second mode include at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the The first way is different from the second way.
- the background color refers to the main color of the display interface of the application or service, including but not limited to white, black, light green, dark green, and the like.
- the font refers to the size of the text displayed on the display interface of the application or service, such as 12 points, 14 points, and so on.
- the font of all characters in the instant messaging application may be reduced, or the The background color is adjusted to a darker color such as black or gray, and when the processing device changes from a multi-person scene to a single-player scene, the fonts of all characters in the instant messaging application can be restored to the default size or enlarged.
- the font of all the text in the instant messaging application or adjust the background color of the instant messaging application to a brighter color such as pink or bright green;
- the processing device moves from a room with lights on to a room without lights on, that is, from a room with bright light to a room with dark light, the brightness of the video playback application can be reduced, while the processing device has never turned on the lights
- the brightness of the video playback application can be increased accordingly.
- the meeting the second preset condition includes at least one of the following:
- the processing device detects that the first voice and the second voice meet the third preset condition
- the processing device and/or the associated device receives a preset operation
- the processing device and/or the associated device is in a second preset scene
- the processing device and/or the associated device is in a second preset position
- the processing device and/or the associated device is in a second preset state
- the processing device provides a second preset service function
- said processing device has an associated device
- the associated device has the first application or service
- the preset operations include, but are not limited to, preset voice commands, preset gestures, preset button operations, etc., and may be used to instruct displaying on the processing device and/or associated devices.
- the second preset scene may be a scene opposite to the first preset scene, including but not limited to a single-person scene, a multi-person scene, a closed environment (such as a room, a vehicle, etc.), an open environment (such as an outdoor , playground, etc.) etc.
- the first preset scene is a single person scene
- the second preset scene may be a multiplayer scene.
- the second preset time may be at a time different from the first preset time, specifically one or more set time periods, such as 13:00-14:00 pm and/or Or from 18:00 to 22:00 in the evening, or a certain day or several days, such as Monday to Wednesday and/or Saturday to Sunday.
- the first preset time is from 13:00 to 14:00 in the afternoon
- the second preset time can be from 14:01 to 15:00 in the afternoon.
- the second preset location is a location opposite to the first preset location, which may be a company, a home, a shopping mall, a hotel, and the like. For example, if the being in the first preset position is inside the vehicle, the being in the second preset position may be outside the vehicle and so on.
- the second preset state is a state opposite to the first preset state, and may be a motion state (such as running, walking, etc.), a static state, a working state, an idle state, or a connection state of the processing device. , disconnected state, folded state, or unfolded state, etc.
- the second preset state may also be the current operating state of the associated device, such as an idle state (the screen of the associated device only displays the desktop and does not display other applications or services), connection state (connected to the processing device);
- the second preset state may also be a folded state of the display screen of the associated device, such as a full-screen unfolded state, a fully folded state, a half-folded state, and the like.
- the second preset service or function is a service or function different from the first preset service or function, and may be a video call service, a voice call service, a video playback service, an audio playback service, and the like.
- the first preset service or function is a video call service
- the second preset service or function may be a voice call service or the like.
- the trigger object of an application or service may refer to an object that triggers an application or service to perform preset processing, and the second preset object may be a user or another application or service.
- the second preset object is the same as the first The preset objects are not the same.
- the second preset relationship may be a priority relationship, an association relationship, a non-association relationship, etc., and the second preset relationship is a relationship opposite to the first preset relationship.
- the first preset relationship is an association relationship
- the second preset relationship may be a non-association relationship or the like.
- the associated device of the processing device may be a communication connection established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like.
- the privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like.
- the first application or service may be displayed in a floating state; and/or, if the trigger object of the first application or service is another application or service, it may Announce the first application or service by voice; and/or, if the priority of the first application or service is lower than or equal to the priority of the second application or service displayed by the processing device, half-screen displaying the first application or service; and/or, if the first application or service is used to provide an audio playback service, displaying the first application or service in a floating state; and/or, if the processing has associated device, the first application or service may be displayed through the associated device; and/or, if the first application or service involves privacy, the privacy content in the first application or service may be hidden Displayed after processing.
- the processing device may monitor the state of the associated device and/or the first application or service to determine whether the first application or service is running on or closed on the associated device, or the associated device may also The status information of the first application or service is sent to the processing device, so that the processing device can know in time whether the first application or service is running or closed on the associated device.
- the second preset processing includes at least one of the following:
- the first preset processing is to detect whether the first voice and the second voice meet the third preset condition in response to at least one first voice and at least one second voice, then according to the detection result, based on The first preset policy processes the first operation event corresponding to the first voice and/or the second operation event corresponding to the second voice;
- first preset processing is to control the display interface of the first application or service to display in the first manner, then control the display interface of the first application or service to switch from the first manner to the second manner. way to display;
- performing the first preset processing is to display at least one prompt message in response to the display interface of the first application or service in a first manner, then control the first application or service based on a second preset policy
- the display interface is switched from the first mode to the second mode for display;
- performing the first preset process is outputting at least one prompt message, then controlling the display interface of the first application or service to be displayed in the first manner and/or the second manner based on a third preset strategy;
- the first preset processing is to control the display interface of the first application or service to be displayed in the first manner and the second manner, then control the display interface of the first application or service based on a fourth preset strategy Shown in a third way.
- meeting the third preset condition may include that the first voice meets the third preset condition, the second voice meets the third preset condition, and the first voice meets the third preset condition.
- condition and the second voice meets at least one of the third preset conditions
- the failure to meet the third preset condition may include that the first voice does not meet the third preset condition and the second At least one of the voice does not meet the third preset condition, the first voice does not meet the third preset condition, and the second voice does not meet the third preset condition.
- the first preset strategy includes at least one of the following: if the detection result shows that the first voice and the second voice meet a third preset condition, then at least one of the following processes is performed: performing the first operation event; execute the second operation event; do not execute the first operation event; do not execute the second operation event; combine the first operation event and the second operation event, and execute the combined operation event ; Output a prompt message, in response to the selection instruction, execute the operation event corresponding to the voice selected by the selection instruction; if the detection result is that the first voice and the second voice do not meet the third preset condition, then execute the following At least one processing: execute the first operation event and the second operation event at the same time; execute the first operation event and the second operation event according to the order of acquisition time; execute the first operation event according to the order of priority An operation event and the second operation event; the first operation event and the second operation event are executed according to the distance of the sound source.
- the processing device may obtain the operation event corresponding to the voice after extracting, text converting, or voice recognizing the voice.
- the operation event may only include the operation object, may only include the operation content, and may also include both the operation object and the operation content.
- the operation object may be a control displayed on a graphical user interface, such as an input box and a button, or an object displayed on a display unit, such as an image. That is, the operation event may include the operation object and/or operation content of the current interface.
- the processing device executes the operation event corresponding to the voice that meets the preset condition, does not execute the operation event corresponding to the voice that does not meet the preset condition, or does not execute the voice that meets the preset condition.
- the corresponding operation event and execute the operation event corresponding to the voice that does not meet the preset condition, or when the first voice and the second voice meet the preset condition, merge the operation event corresponding to the two voices, and Execute the combined operation event, or output a prompt message when the first voice and the second voice meet the preset conditions, and execute the operation event corresponding to the voice selected by the user, or
- the first operation event and the second operation event are executed simultaneously or sequentially.
- the processing device displays the contact creation interface
- the processing device acquires the first voice "name” and the second voice "Zhang San” input by the user, since the first voice is associated with the second voice, the The first operation event and the second operation event are combined to obtain a combined operation event "name Zhang San", and the combined operation event is executed, that is, "Zhang San” is input into the "name” control.
- the processing device displays the contact creation interface
- the processing device acquires the first voice "name Zhang San” and the second voice "name Zhang Shan” within a preset time period, since the first voice corresponds to the second voice If the similarity between an operation event and the second operation event corresponding to the second voice is greater than the preset similarity threshold, the second operation event corresponding to the second voice can be executed instead of the first voice The corresponding first action event.
- the first operation event may be executed, or the second operation event may not be executed.
- An operational event For example, assuming that the first voice is "name Zhang San", if the detection finds that the first voice is associated with at least one operation object on the current interface, execute the first operation event corresponding to the first voice. Or, assuming that the first voice is "open the game” and the second voice is "forbidden to play games", if it is found through detection that the user who uttered the first voice is the son of the user who uttered the second voice, Then the first operation event corresponding to the first voice may not be executed.
- the second operation event may be executed, or the first operation event may not be executed.
- Two operation events For example, assuming that the first voice is "name Zhang San” and the second voice is "name Zhang Shan", if it is found through detection that the second operation event corresponding to the second voice corresponds to the first voice If the similarity between the first operation events is greater than or equal to the preset similarity threshold, the second operation event corresponding to the second voice may be executed.
- the first operation event and the second operation event may be combined, and the combined operation event is executed, For example, assuming that the first voice is "name" and the second voice is "Zhang San", and it is found that the second voice is associated with the first voice through detection, then the first voice corresponding to the first voice is merged. An operation event and a second operation event corresponding to the second voice, and execute the combined operation event.
- a prompt message may also be output, so as to execute the operation event corresponding to the selected voice according to the user selection result.
- the acquisition interval between the first voice and the second voice is longer than a preset duration threshold, and/or the first operation event corresponding to the first voice is equal to the second voice
- the similarity between the second operation events is less than a preset similarity threshold, and/or the user who uttered the first voice is not associated with the user who uttered the second voice, and/or the first voice and/or
- the first operation event and the second operation event may be executed simultaneously , execute the first operation event and the second operation event according to the order of acquisition time, execute the first operation event and the second operation event according to the order of priority, or execute the first operation event according to the distance of the sound source An operational event and said second operational event.
- the processing device when the processing device is currently displaying the contact creation interface, assuming that the first voice is "name Zhang San” and the second voice is "Ethnic Hmong", if it is found through detection that the first voice corresponding to the first voice is If the similarity between the operation event and the second operation event corresponding to the second voice is less than the preset similarity threshold, the first operation event and the second operation event can be executed at the same time, or can be obtained according to the order of acquisition time The first operation event and the second operation event are executed sequentially.
- the processing device obtains that the first voice is "play the song of my motherland” and the second voice is “play the song of the Yangtze River”
- the detection finds that the first voice and the second voice are respectively If they are issued by different users that are not associated, the first operation event and the second operation event may be executed according to the order of priority, or the first operation event and the second operation event may be executed according to the distance from the sound source.
- the executing the first operation event and the second operation event according to a priority order includes at least one of the following: executing the first operation event and the second operation event according to a user priority order Events, execute the first operation event and the second operation event according to the order of priority of the event, execute the first operation event and the second operation event according to the priority order of the application that obtains the voice, and execute the first operation event and the second operation event according to the device that obtains the voice
- the first operation event and the second operation event are executed in order of priority.
- the user priority can be set according to actual needs, for example, the priority of the driver is higher than that of the passengers in the vehicle, and the priority of the front row passengers is higher than that of the rear passengers.
- the event priority can be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event.
- the application priority can be set according to the actual situation, for example, the priority of the system application is higher than that of the third-party application.
- the device priority can be set according to the actual situation, for example, the priority of the processing device is higher than that of the associated device, and the priority of the associated device is higher than that of the server.
- executing the second operation event includes: outputting an interface switching prompt message; and displaying the second operation event in response to a switching confirmation instruction
- the interface where the corresponding operation object is located, and execute the second operation event when the second operation event is not associated with the operation object of the current interface, for example, the second operation object corresponding to the second operation event is not displayed on the current interface, in order to execute the second operation event, usually An interface switch is required. However, the user may need to return to the current interface for operation after the processing device executes the second operation event. In order to minimize or avoid interface switching, the processing device may first output an interface switching prompt message to Take the appropriate action.
- an interface switching prompt message can be output at this time to prompt the user whether to switch to Li Si's contact.
- a human interface and then judge whether to perform an interface switching operation based on the user's selection operation.
- Fig. 6 is a schematic diagram of the interface of the processing device according to the first embodiment.
- the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the state of contact creation.
- Voice "telephone 8837297” it is detected that the input interval between the first voice and the second voice is short and the similarity is high, it can be considered that the first voice was input by the user by mistake, then the second voice will not be executed.
- the smart speaker can The priorities of the mobile phone and the second mobile phone and/or the priority of the user of the first mobile phone and the user of the second mobile phone determine the song playback order. For example, if the priority of the first mobile phone is higher than that of the second mobile phone, then the Play the song "Motherland" first. In this way, when processing voices, considering whether multiple voices meet preset conditions can improve the convenience and/or intelligence of voice processing, and improve user experience.
- the first preset processing is to control the display interface of the first application or service to be displayed in a first manner
- controlling the display interface of the first application or service to display in the first manner switch to the second mode for display, so that when the application or service is displayed, according to whether the processing device and/or the application or service and/or the associated device meet the preset conditions, the application or service is controlled to be displayed in a corresponding manner
- the video call service when the user starts a video call service with a friend, if the processing device is in a multi-person scene, the video call service may be displayed in half-screen mode, and when the processing device changes from being in a multi-person scene to In a single-person scenario, the video call service can be displayed in a full-screen state; for another example, when the user starts the music player application, if the processing device is in motion, the music player application can be displayed in a floating state, and the When the processing device changes from a moving state to a static state, it can display the music playing application in a half-screen or full-screen state; for example, when the processing device is running a human-computer interaction application, if the human-computer interaction application is currently The preset service can display the human-computer interaction application in a full-screen state, and when the human-computer interaction application changes from a working state to an idle state, that is, when the preset service is not being provided, the human-computer interaction application can be displayed in a half-screen state or in
- Human-computer interaction application when the processing device starts the navigation map application outside the vehicle, it can display the navigation interface of the navigation map application in a full screen state, and when the processing device enters the vehicle and is associated with the vehicle (such as connected) , the navigation interface of the navigation map application can be switched to the car machine for display.
- Fig. 7 is a schematic diagram of the interface of the processing device according to the first embodiment. Assuming that the user uses the chat application in the processing device to chat with his colleague Xiao Zhang in the shopping mall, since there are other users beside the user at this time, the current chat interface of the chat application is displayed in a half-screen state to protect privacy, as shown in Figure 7 As shown in (a), when there are no other users beside the user, such as when the user walks to the corner of the shopping mall, the current chat interface of the chat application can be displayed in full screen, so that the user can communicate with friends.
- the processing device displays the voice assistant application in full screen mode, and if it is detected that the processing device is in a motion state, the voice assistant application can be broadcast by voice Demonstrate the voice assistant application.
- meeting the second preset condition includes that the processing device has an associated device, and controlling the display of the first application or service from the first mode to the second mode includes: The first application or service is switched from the processing device to the associated device for presentation.
- the first application or service may be switched from the processing device to the associated device for presentation, so that users can view the first application or service or operation etc.
- the associated device displays the first application or service in the second manner.
- the navigation interface of the navigation map application can be displayed in full screen, and when the user enters the vehicle and the mobile phone is associated (such as connected) with the vehicle, the user can use all The car machine displays the navigation interface of the navigation map application; and/or, when the user uses the mobile phone to make a voice call with a friend, if the mobile phone is associated with the smart speaker at home, the voice call service can be switched to the smart speaker for display; And/or, for documents edited by the user on the tablet computer in the work scene, when the connection between the tablet computer and the personal computer is established and the distance between the two is less than the preset distance threshold, switch the document editing interface on the tablet computer to the personal computer displayed on the display.
- switching the first application or service from the processing device to the associated device for presentation includes:
- the processing device closes or hides the first application or service.
- the processing device switches the display interface of the first application or service to the management device for presentation, the first application or service may be closed or hidden, so that the processing device no longer accepts the first application or service from the user.
- the operation or processing of the display interface can be performed on other applications or services.
- the application or service of the processing device can be switched to the associated device for display if the preset conditions are met, and the processing device itself can perform other services, ensuring the simultaneous display or processing of two different applications or services , to further enhance the user experience.
- the second preset strategy and/or the third preset strategy includes at least one of the following:
- the display interface of the first application or service may be split according to preset rules to obtain a first display part and/or a second display part, and the first display part may be displayed in a first form. display, and/or display the second display part in a second form.
- the picture and text in the display interface of the first application or service are split, and then the picture part is displayed in the first form, and the text part is displayed in the first form.
- the first application or service may also be displayed through the processing device and/or the associated device. Through the above method, the first application or service can be displayed according to the preset operation and/or the detection result of the associated device, so that the display of the application or service is more flexible and/or intelligent, and user experience is improved.
- the processing device may first display the video call service in a first manner, that is, full screen, and may output whether to switch to a half screen when detecting that it is in a multi-person scene. state, if a switching confirmation instruction is received, the video call service can be switched from the full screen state to the half screen state; and/or, when the processing device starts the navigation map application outside the vehicle, it can first display the full screen state.
- the navigation interface of the navigation map application and when the processing device is associated with the car machine in the vehicle and the car machine has a navigation map application, the navigation interface of the navigation map application can be switched to the car machine for display .
- the processing device may display the video call service in a half-screen state, and the processing device receives a notification to switch to a full-screen state.
- the video call service can be displayed in full screen; for another example, when the user starts the music playing application, if the processing device is in a motion state, the processing device can display the music playing application in a suspended state, and the When the associated device of the processing device receives the display operation instruction, it can switch the music playing application to the associated device for display; another example, when the user uses the payment application or service of the computer to perform the payment operation, if the computer is in In a multi-person scenario, the payment application or service can be displayed in an encrypted display and half-screen mode, and when the computer is connected to the mobile phone and the mobile phone has the payment application or service, the payment application or service can be displayed in full screen on the mobile phone. application or service.
- Fig. 8 is a schematic diagram of the interface of the processing device according to the first embodiment. Assuming that the user starts the navigation map application on the processing device for navigation, the processing device displays the navigation interface of the navigation map application in a full screen state, as shown in (a) in FIG. 8 , if the processing device detects that the processing device is associated with the vehicle ( If connected) and there is a navigation map application on the vehicle, the navigation interface of the navigation map application can be switched to the vehicle for display, as shown in (b) in FIG. 8 .
- Fig. 9 is a schematic diagram of an interface of a processing device according to the first embodiment. Assuming that the user starts the video playback application on the processing device to play the video, since it is detected that the processing device is at home, it can output a prompt message whether to play the video through the smart TV, as shown in (a) in Figure 9, after the user clicks to confirm After the button is pressed, the video can be played on the smart TV, as shown in (b) in Figure 9.
- the fourth preset strategy includes:
- the first application or service may be switched from the processing device to the associated device for presentation, so that users can view the first application or service or operation etc.
- the navigation interface of the navigation map application can be displayed in full screen, and when the user enters the vehicle and the mobile phone is associated (such as connected) with the vehicle, the user can use all
- the car machine displays the navigation interface of the navigation map application; and/or, when the user uses the mobile phone to make a voice call with a friend, if the mobile phone is associated with the smart speaker at home, the voice call service can be switched to the smart speaker for display.
- the application or service is switched to the associated device for display, which makes it more convenient for the user to use the application or service, and further improves the user experience.
- Fig. 10 is a schematic diagram of the interface of the processing device according to the first embodiment.
- the processing device starts the music playing application while the user is in motion, it displays the playing interface of the music playing application in the form of a floating ball, as shown in (a) in FIG. 10 , and when the processing device detects that the user enters the vehicle and When the car machine of the vehicle has the music playing application, the playing interface of the music playing application can be switched to the car machine and displayed in a full-screen state, as shown in (b) in FIG. 10 .
- the first mode or the second mode includes a first form and a second mode, and the controlling the first application or service to switch from the first mode to the second mode to display or display all
- the display interface of the above-mentioned first application or service is split and displayed, including:
- the processing device is a terminal device with a foldable screen
- the screen of the terminal device includes a first area, a second area, and a foldable area located between the first area and the second area;
- the displaying the first display part in a first form, and/or displaying the second display part in a second form includes: displaying the first display part in a second form in the first area display in one form, and/or display the second display part in a second form in the second region.
- the preset rules can be set according to actual needs, such as the display of the first application or service according to the size of the area, and/or whether privacy is involved, and/or content types such as pictures and text.
- the interface is split.
- the first form and the second form include but are not limited to full-screen state, half-screen state, floating state, cascaded display, stacked display, side-by-side display, voice broadcast, switching display equipment, encrypted display, blurred display, fixed display , hide directly, etc.
- the display interface of the first application or service may be split into the first display part (ie, the upper part) and the first display part (ie, the upper part).
- the second display part i.e. the lower half
- the first display part can be displayed in the form of a floating ball
- the second display part can be displayed in the form of a floating window
- the first display part and the The second display part is displayed in a stacked form, that is, the second display part is displayed on the upper layer of the first display part, which is equivalent to the second display part blocking the first display part.
- the first display part and/or the second display part obtained after splitting the display interface of the first application or service may be displayed on the processing device.
- different sub-sections of the screen so that the user sees differently from what other people see.
- the method can more conveniently and/or intelligently improve user experience in scenarios such as user privacy management and multi-person single-computer interaction.
- the page of the mobile payment application needs to display the payment QR code and the user verification (such as entering a password) interface successively, and the user verification process is very easy to be seen by other people, resulting in the leakage of user privacy information and payment collection.
- the process is complicated; for folding screen devices, users can switch the mobile phone from the unfolded state to In the folded state, at the same time, the QR code of the payment page is displayed on the display area facing the payee, and the user verification interface is displayed on the display area facing the mobile phone user, so that the payee does not need to scan the electronic payment code.
- the mobile phone user can directly enter the password on the other side of the screen, and at the same time, the cashier cannot see the process of entering the password, which effectively protects the user's privacy and improves the flexibility and convenience of multi-person stand-alone interaction scenarios.
- meeting the second preset condition includes involving privacy, and splitting the display interface of the first application or service according to preset rules to obtain the first display part and/or the second display part, include:
- the display interface of the first application or service may display private content, such as contact information, bank account information, secret documents, etc. Perform privacy identification on the display interface of the service to obtain the location of the private content, and then split the display interface of the first application or service to obtain the first display part that includes privacy and/or includes the first display part that does not involve privacy The second display part of .
- private content such as contact information, bank account information, secret documents, etc.
- the display interface of the first application or service is a chat interface with a friend
- the chat interface displays bank card account information
- the first application or service can be The display interface performs privacy identification, obtains a first display part including bank card account information and/or a second display part including bank card account information not involved, and displays the first display part in a first form, The second display part is displayed in a second form.
- the privacy-related part of the display interface of the application or service is split to display the privacy-related part and the non-privacy-related part in different forms, thereby improving data security and further improving user experience.
- controlling the first application or service to switch from the first mode to the second mode for presentation includes:
- control the first application or service In response to the switching confirmation instruction, control the first application or service to switch from the first mode to the second mode for presentation.
- the processing device when it needs to control the switching of the first application or service from the first mode to the second mode for display, it may first output a switching prompt message to prompt the user whether to switch, if received
- the first application or service may be controlled to switch from the first mode to the second mode for display if the switching confirmation command is received or no operation command is received within a preset time period.
- the switching prompt information may include information in the second manner, and the switching prompt information may be text or voice prompt information.
- the method further includes: in response to the processing device and/or the first application or service not meeting the first preset condition, controlling the first application or service to display in a third manner.
- the first application or service may be controlled to be displayed in a third manner, and the third manner may be the last
- the mode set or selected by the user may also be a default mode, such as a half-screen mode.
- the third method is a half-screen state and the processing device meets the first preset condition that the processing device is in a motion state, if it is detected that the After the music player application is started and the processing device is in a static state, the music player application can be controlled to display in a half-screen state.
- the application or service is controlled to be displayed in a corresponding manner, which further improves the flexibility and/or intelligence of displaying the application or service, And further enhance the user experience.
- controlling the first application or service to switch from the first mode to the second mode for presentation further includes:
- a transitional dynamic effect of switching the first application or service from the first mode to the second mode is displayed within a preset duration.
- a transitional dynamic effect is displayed, and the transitional dynamic effect may be a combination of one or more of the following: the interface of the application or service Dynamic changes in size, dynamic changes in the location of the interface of an application or service, dynamic changes in the content of the interface of an application or service, dynamic changes in the number of interfaces in an application or service, dynamic changes in the color of an application or service interface, or changes in the interface of an application or service
- the dynamic change of transparency the display transition dynamic effect needs to be completed within a preset time length, and the preset time length can be preset in combination with user habits and dynamic display effects, or can be customized by the user, or follow the user's operation
- the duration is used to switch and display in real time.
- the application interface when the application interface is switched from the full-screen display to the half-screen display, it can be displayed within 0.5s from the full-screen application interface to the half-screen application interface, and the position of the application interface is also gradually changed from the full-screen position
- Moving to the half-screen position makes the application interface smoother during the switching process, and at the same time guides the user's focus to follow the switching process, so that the switching process is not too blunt and abrupt, which affects the user experience.
- step S1 it also includes: detecting whether the processing device and/or the first application or service comply with at least one of scene information, preset information, and information about the first application or service The first preset condition or the fourth preset condition.
- the scene information may include at least one of the following information: location type, time information, number of users, user identity, and the like.
- location type it is used to distinguish the space where the user is currently located, including but not limited to: a closed environment (such as in a room, inside a vehicle, etc.), an open environment (such as outdoors, a playground, etc.), and the location type can be passed through sensors (such as gravity sensor, acceleration sensor, gyroscope, camera, GPS, etc.) to perceive.
- time information it can be used to distinguish the current date or time period.
- For the number of users it can be used to distinguish how many users are around the processing device. For example, there may be only one or multiple users. source, indicating that there are multiple users, that is, it is in a multi-person scenario.
- user identity it is used to distinguish the user's personality characteristics, including but not limited to: age type, gender, occupation type, etc.
- detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition may be: according to location type, time information, number of users and user identity At least one of them is detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition. For example, it can be detected according to the location type whether the processing device is in the first preset scene (such as a single person scene or a multi-person scene), and/or, according to the time information, it can be detected whether the processing device is in the first preset time (such as day or night).
- the preset information may include at least one of the following information: provided service or function information, device information, speed information, and the like.
- provided service or function information it is used to distinguish the functions that the application or service can realize, for example, whether to provide video playback, whether to provide video call function, etc.
- device information it is used to distinguish the identity and/or status of processing devices, including but not limited to: device identity information (such as master device and slave device, or control center and non-control center, etc.), device connection information (such as existence associated device), remaining power information, remaining network traffic, network status, etc.
- speed information it is used to process the state of the device in partitions, such as whether it is moving or stationary.
- detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition according to preset information may be: according to provided service or function information, device information, At least one of speed information and permission information, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition.
- the processing device is in the first preset state .
- the relevant information of the first application or service may include at least one of the following information: received information to be processed, trigger object information, and permission information.
- received information it can be used to distinguish whether the first application or service involves privacy and other information. For example, if the received pending information is "transfer 1,000 yuan to Xiaohe", it means that the first application or service involves privacy .
- trigger object information it can be used to distinguish the object that triggers the first application or service.
- the first application Or the trigger object of the service is the user; if the third-party application calls the first application or service to control the start of the first application or service, it means that the trigger object of the first application or service is other applications or services.
- permission information it is used to distinguish the usage permissions of different applications or services, including but not limited to: priority, callable applications or services, etc., for example, applications or services with different priorities have different usage or display sequences, or , the third-party applications that can be invoked by different applications or services are different.
- detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition according to the relevant information of the first application or service may be: according to the received information to be processed , at least one of trigger object information and permission information, detecting whether the processing device and/or the first application or service meets the first preset condition or the fourth preset condition.
- the received information to be processed it may be detected whether the first application or service involves privacy; and/or, according to the trigger object information, it may be detected whether the trigger object of the first application or service is the first preset object and/or, according to the permission information, it may be detected whether there is a first preset relationship between the first application or service and the second application or service displayed by the processing device.
- said performing the second preset processing also includes:
- the current interface it is judged whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result. Understandably, in some scenarios, the user may not pay attention to the content displayed on the interface. Therefore, based on the preset policy, the first operation event corresponding to the first voice and/or the operation event corresponding to the second voice When the second operation event is processed, the current interface can still be maintained. For example, in order to drive safely, the user may only pay attention to the song list while driving the vehicle, but not the lyrics of each song. At this time, after receiving the song switching voice, the display interface of the car can be kept on list interface. In other scenarios, the user may pay more attention to the content displayed on the interface.
- the interface can be switched according to the processing result. For example, when a user listens to a song with a mobile phone at home, he may need to read the lyrics at any time in order to hum synchronously. At this time, after receiving the song switching voice, the display interface of the mobile phone can be switched to the interface where the corresponding song is located. In this way, it is judged according to the current scene information whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result, which further improves the user experience and reduces the resource consumption of the device.
- performing corresponding operations based on the judgment result includes at least one of the following: if it is determined according to the current scene information that the current scene type is a preset scene type, then the current interface will not be switched; if the current scene type is determined according to the current scene information If it is not a preset scene type, the interface will be switched according to the processing result.
- the preset scene type can be set according to actual needs, for example, it can be set as driving, low battery, weak signal and other scenes.
- Fig. 11 is a schematic flowchart of a processing method according to the first embodiment. As shown in Figure 11, the processing method of the present application is applied to processing equipment, including the following steps:
- the processing device may be a terminal device (such as a mobile phone, a tablet computer, etc.), a wearable smart device (such as a smart watch, a smart bracelet, a smart earphone, etc.), a smart home device (such as a smart TV, a smart speaker, etc.), Vehicle networking equipment (such as smart cars, vehicle terminals, etc.).
- the applications or services may include human-computer interaction applications, multimedia applications, communication applications, navigation applications, etc.
- Human-computer interaction applications include applications or services that can perform human-computer interaction through gestures, voice, and air gestures.
- the associated device may refer to any device that is connected to the processing device (it may be directly connected or indirectly connected, and the connection method may be a short-distance communication method or a data connection, etc.), or any device that meets the predetermined requirements. Any device that sets conditions (such as connecting to the same WIFI access point, or logging in to the same user account, or belonging to the same user, or being in the same local area network, etc.).
- Associated devices can be terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices ( Such as smart cars, vehicle terminals, etc.).
- the processing device is of the same or different type as the associated device.
- corresponding processing is performed, so that the device can conveniently and/or intelligently process when interacting with the user , which improves the user experience.
- the processing device displays the music playback interface
- the processing device obtains the first voice "next song” and the second voice "Xiao Zhang is here” since the first voice and the operation object of the current music playback interface If the second voice is not associated with the operation object of the current music playback interface, only the operation event corresponding to the first voice can be executed.
- the processing device when the processing device is running the instant messaging application in the foreground, it can display the instant messaging application in full screen, and when the associated device is running the instant messaging application in the foreground, the processing device can hide or float the instant messaging application.
- the meeting the first preset condition includes at least one of the following:
- the triggering object is the first preset object
- the first voice and/or the second voice comes from at least one of the following devices: a processing device, an associated device, and a server.
- the first voice and/or the second voice may be directly sent to the processing by the associated device and/or the server device, and may also be sent to the processing device after preset processing such as encryption by the associated device and/or the server.
- the processing device may obtain the operation event corresponding to the voice after extracting the voice, converting the text into text, or recognizing the voice.
- the operation event may only include the operation object, may only include the operation content, and may also include both the operation object and the operation content.
- the operation object may be a control displayed on a graphical user interface, such as an input box and a button, or an object displayed on a display unit, such as an image. That is, the operation event may include the operation object and/or operation content of the current interface.
- the first preset scene may be at least one of the following: a single-person scene, a multi-person scene, a closed environment (such as inside a room, inside a vehicle, etc.), an open environment (such as outdoors, a playground, etc.), and the like.
- the first preset time may be in a preset time period or in a non-preset time period, and the preset time period may be one or more set time periods, such as 8:00-12:00 in the morning and /or from 13:00 to 14:00 in the afternoon, or a certain day or several days, such as Monday to Friday and/or Saturday to Sunday.
- the first preset location includes at least one of the following: being in the target object, not in the target object, and the target object can be a company, home, shopping mall, hotel, vehicle, meeting room, etc.
- the first preset state may be at least one of the following: exercise state (such as running, walking, etc.), static state, working state, idle state, connected state, disconnected state, folded state, unfolded state, etc.
- the first preset service or function may be at least one of the following: video call service, voice call service, video playback service, audio playback service, and the like.
- the triggering object of an application or service may refer to an object that triggers the application or service to perform preset processing, and the first preset object may be a user or another application or service.
- the first preset relationship may be a priority relationship, an association relationship, a non-association relationship, and the like.
- the associated device of the processing device may be that a communication connection is established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like.
- the privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like.
- the processing device may display the first application or service in full screen; and/or, if the trigger object of the first application or service is a user, it may display the first application or service in full screen or displaying the first application or service in a half-screen state; and/or, if the priority of the first application or service is higher than that of the second application or service already displayed by the processing device, it may be displayed in a full-screen state
- the first application or service; and/or, if the first application or service is used to provide a video playback service, the first application or service may be displayed in full screen; and/or, if the processing has an associated device, it may prompt whether to display the first application or service through the associated device; and/or, if the first application or service involves privacy, it may prompt whether to monitor the privacy of the first application or service
- the content is hidden and then displayed.
- said performing the first preset processing includes at least one of the following:
- the meeting the second preset condition includes at least one of the following:
- the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold
- the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold
- the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold
- the speaking user of the first voice is associated with the speaking user of the second voice
- the first voice and/or the second voice is associated with at least one operation object of the current interface
- the second voice is associated with the first voice
- the first voice is associated with a preset first device, and/or, the second voice is associated with a preset second device.
- the acquisition interval between the first voice and the second voice is less than or equal to a preset duration threshold, indicating that the first voice and the second voice may be acquired at the same time, for example, processing
- a preset duration threshold indicating that the first voice and the second voice may be acquired at the same time
- the processing device receives the second voice "Zhang San” after receiving the first voice "name”.
- the preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on.
- the similarity between the first operation event corresponding to the first voice and the second operation event corresponding to the second voice is greater than or equal to a preset similarity threshold, indicating that the first voice and the The second voice may all be to express a certain operation event, but due to a user slip of the tongue or other reasons, the first voice input by the user to the processing device is wrong, but the input second voice is correct.
- the processing device receives the first voice input by the user.
- the voice is "name Zhang San", and the second voice is "name Zhang Shan”.
- the preset similarity threshold can be set according to actual needs, for example, it can be set to 90%, 95%, and so on.
- the difference between the sound source distance corresponding to the first voice and the sound source distance corresponding to the second voice is less than or equal to a preset distance threshold, indicating that the first voice and the second voice may both be Sent at the same location, that is, the first voice and the second voice may be uttered by the same user, for example, the driver at the front of the vehicle and the passenger at the rear of the vehicle respectively utter a voice within a preset time period.
- the processing device can determine whether each voice is issued by the same user according to the distance from the sound source corresponding to each voice.
- the preset distance threshold can be set according to actual needs, for example, it can be set to 3 cm, 10 cm, and so on.
- the user who utters the first voice is associated with the user who utters the second voice
- the user who utters the first voice and the user who utters the second voice may be the same user, or all
- the user who utters the second voice is a family member of the user who utters the first voice.
- it may be based on Technologies such as voiceprint recognition and image recognition identify whether the user who uttered the first voice is associated with the user who uttered the second voice.
- the first voice and/or the second voice is associated with at least one operation object on the current interface, which may mean that the operation object corresponding to the first voice and/or the second voice is displayed on the current interface.
- Interface for example, assuming that the current interface is a contact creation interface, and the first voice is "name Zhangsan", at this time, the operation object corresponding to the first voice is the "name” control, if the current interface displays "name” control, it means that the first voice is associated with at least one operation object on the current interface.
- the current interface displays a picture
- the first voice is "enlarge the picture”
- the operation object corresponding to the first voice is "picture” at this time, it shows that the first voice and at least one operation object of the current interface associated.
- associating the first voice with the second voice may mean that the operation object corresponding to the first voice is associated with the operation object corresponding to the second voice, for example, assuming that the first voice is " Zhang San's phone number 1800000000", and the second voice is "Dial Zhang San's phone", at this time, the operation object corresponding to the first voice and the operation object corresponding to the second voice are both "Zhang San", indicating that The first voice is associated with the second voice.
- it can be detected whether the voice meets the conditions, and it is determined whether to perform different processing from the voice that does not meet the conditions, which improves the convenience and/or intelligence of voice processing, and improves user experience.
- the first voice is associated with a preset first device
- the second voice is associated with a preset second device
- the preset first device and/or the preset second device may be a terminal Devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles devices (such as smart cars, car terminal, etc.).
- the processing device is a mobile phone
- the preset first device can be a smart car
- the preset second device can be a user's smart speaker
- the voice information detected by the mobile phone is from the smart car and/or smart speaker
- the mobile phone can respond to the voice information, but when the voice information comes from other illegal devices, the mobile phone will not respond to the voice information, which improves the intelligence and/or security of voice processing.
- the meeting the third preset condition includes at least one of the following:
- the first operational event conflicts with the second operational event
- the first operational event is associated with the second operational event
- the first operational event does not conflict with the second operational event
- the first operation event is not associated with the second operation event.
- the conflict between the first operation event and the second operation event may mean that the operation object of the first operation event is the same as the operation object of the second operation event, but the operations executed are contradictory, for example , the first operation event is "Call Zhang San", and the second operation event is "Don't call Zhang San”; the conflict between the first operation event and the second operation event may also refer to The first operation event is the same as the second operation event, for example, the first operation event is "name Zhang San", and the second operation event is also "name Zhang San”; the first operation event Not conflicting with the second operation event may mean that the operation object of the first operation event is different from the operation object of the second operation event, the first operation event is different from the second operation event, etc.
- the first operation event is "name Zhang San", the second operation event is "ethnicity Han” and so on; the association between the first operation event and the second operation event may refer to the first
- the operation object of the operation event is associated with the operation object of the second operation event, or the operation content of the first operation event is associated with the operation content of the second operation event, for example, the first operation event is " Name Zhang San", the second operation event is "Call Zhang San”; the first operation event is not associated with the second operation event may mean that the operation object of the first operation event is not related to the The operation object of the second operation event is not associated, and the operation content of the first operation event is not associated with the operation content of the second operation event.
- the first operation event is "name Zhang San”
- the The second operation event is "Ethnicity Han” and the like. In this way, it can be detected whether the operation event meets the conditions, and it is determined whether to perform different processing from the operation events that do not meet the conditions, which improves the convenience and/or intelligence of the voice processing, and improves the user experience.
- the meeting the fourth preset condition includes at least one of the following:
- the acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold
- the second operation object corresponding to the voice is the same as the first operation object
- the second operation object corresponding to the voice is different from the first operation object
- the utterance user of the voice is the same as or related to the input user of the first operation event;
- the utterance user of the voice is not the same as or not associated with the input user of the first operation event.
- the first operation event may be determined or generated according to at least one of gestures, button operations, and voice operations, such as saying "name” by voice, clicking on a name control, or touching a circle or touching a name control with an air gesture wait.
- the acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold, indicating that the voice and the first operation event may be acquired at the same time, for example, the processing device is The contact creation interface receives the voice "Zhang San" input by the user at the same time when the user clicks on the "Name” control, or it indicates that the voice and the first operation event may be sequentially acquired within a short interval, For example, after the processing device detects that the user clicks the "name” control on the contact creation interface, it receives the voice "Zhang San".
- the preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on.
- the second operation object corresponding to the voice is the same as the first operation object means that the second operation object indicated by the second operation event corresponding to the voice is the first operation object, for example, assuming The first operation object is "brightness", and the voice is "half brightness” or “half reduction”. At this time, the second operation object corresponding to the voice is "brightness”, and the same as the first operation object same.
- the fact that the second operation object corresponding to the voice is different from the first operation object means that the second operation object indicated by the second operation event corresponding to the voice is not the first operation object, for example , assuming that the first operation object is "battery capacity", and the voice is "half brightness”, at this time, the second operation object corresponding to the voice is "brightness", which is different from the first operation object.
- the user who uttered the voice is the same as or associated with the user who input the first operation event, it may be that the user who uttered the voice is the same user or has an associated relationship with the user who input the first operation event, For example, the user who uttered the voice is a family member of the input user of the first operation event. In a specific application, it can be identified based on technologies such as voiceprint recognition, face recognition, and fingerprint recognition whether the user who uttered the voice is related to The input user association of the first operation event. For example, after user Zhang San clicks the music play button, Zhang San's son inputs the voice "pause playing", at this time, it is considered that the user who uttered the voice is associated with the input user of the first operation event.
- the user who utters the voice is not the same as or not associated with the user who inputs the first operation event. It may be that the user who utters the voice and the user who inputs the first operation event are not the same user or are not There is an association relationship, for example, the driver and passengers in the bus can be regarded as different or not associated.
- the meeting the fifth preset condition includes at least one of the following:
- the first operation object is the same as the second operation object;
- the first operand is different from the second operand
- the input user of the first operation event is the same as or related to the input user of the second operation event;
- the input user of the first operation event is not the same as or not associated with the input user of the second operation event;
- the first operation object and/or the second operation object is associated with at least one operation object currently displayed on the interface;
- the first operation object and/or the second operation object are not associated with at least one operation object currently displayed on the interface.
- the first operation object being the same as the second operation object means that the first operation object is the second operation object, for example, assuming that the first operation event is clicking a brightness button displayed on the interface , the second operation event is the voice "half brightness reduction” or “half reduction”, the first operation object is determined to be "brightness” according to the first operation event, and the The second operation object is also "brightness", and at this time, the first operation object is the same as the second operation object.
- the fact that the first operation object is different from the second operation object means that the first operation object is not the second operation object, for example, assuming that the first operation event is an action displayed on a click interface
- the power button, the second operation event is the voice "half brightness”
- the first operation object is determined to be "battery power” according to the first operation event
- the second operation is determined according to the second operation event
- the object is "brightness”, and at this time, the first operation object is different from the second operation object.
- the input user of the first operation event is the same as or associated with the input user of the second operation event, which may mean that the input user of the first operation event and the input user of the second operation event are The same user may have an associated relationship.
- the input user of the second operation event is a family member of the input user of the first operation event. In specific applications, it may be based on voiceprint recognition, face recognition, fingerprint recognition, etc.
- the technique identifies whether the input user of the second operational event is associated with the input user of the first operational event. For example, after user Zhang San clicks the music play button, Zhang San's father inputs the voice "pause playing", at this time, it is considered that the input user of the second operation event is associated with the input user of the first operation event.
- the input user of the first operation event is not the same as or not associated with the input user of the second operation event, and may be the input user of the first operation event and the input user of the second operation event They are not the same user or have no associated relationship.
- the driver and passenger in the bus can be regarded as different or not associated.
- the first operation object and/or the second operation object are associated with at least one operation object displayed on the current interface, which may mean that the first operation object and/or the second operation object are displayed on
- the current interface for example, assuming that the current interface is a contact creation interface, and the first operation object is a "name" control, since the current interface displays a "name” control, it means that at least one of the first operation object and the current interface Operation object association, or assuming that the current interface displays a picture, and the second operation object is "picture", it means that the second operation object is associated with at least one operation object on the current interface.
- the first operation object and/or the second operation object are not associated with at least one operation object displayed on the current interface, which may mean that the first operation object and/or the second operation object are not Displayed on the current interface, for example, assuming that the current interface is a contact creation interface, and the first operation object is a "dial" control, since the current interface does not display a "dial” control, it means that the first operation object is different from the current interface At least one operand for is not associated.
- it can be detected whether the first operation object and the second operation object meet the conditions, and then different processing strategies are determined, which improves the convenience and/or intelligence of processing, and improves user experience.
- the meeting the sixth preset condition includes at least one of the following:
- the first operation object is associated with at least one operation object displayed on the current interface
- the first operation object is not associated with at least one operation object displayed on the current interface
- the input user of the first operation event is a preset user
- the input user of the first operation event is not a preset user.
- the first operation object is associated with at least one operation object displayed on the current interface, which may mean that the first operation object is displayed on the current interface.
- the current interface is a contact creation interface
- the first The operation object is a "name" control
- the current interface displays a "name” control
- a picture is displayed on the current interface
- the first operation object is "picture”
- the first operation object is not associated with at least one operation object displayed on the current interface, which may mean that the first operation object is not displayed on the current interface.
- the input user of the first operation event being a preset user may mean that the user triggering the first operation event is a preset user or a user with specific characteristics, such as a family member or a minor.
- the meeting the seventh preset condition includes at least one of the following:
- the acquisition interval between the second operation event and the first operation event is less than or equal to a preset duration threshold
- the similarity between the first operation event and the second operation event is greater than or equal to a preset similarity threshold
- the second operation object is the same as the first operation object
- the second operand is different from the first operand
- the input user of the second operation event is the same as or associated with the input user of the first operation event
- the input user of the second operation event is not the same as or not associated with the input user of the first operation event
- the first operational event conflicts with the second operational event
- the first operational event is associated with the second operational event
- the first operational event does not conflict with the second operational event
- the first operation event is not associated with the second operation event.
- the acquisition interval between the second operation event and the first operation event is less than or equal to a preset duration threshold, indicating that the first operation event and the second operation event may be acquired at the same time, for example , the processing device receives the second operation event "Are you free tomorrow" input by the second user while receiving the first operation event "play the next song” input by the first user; or indicates that the first The operation event and the second operation event may be acquired sequentially within a short time interval.
- the processing device receives the second operation event "Zhang San” after receiving the first operation event "name”.
- the preset duration threshold can be set according to actual needs, for example, it can be set to 1 second, 2 seconds, and so on.
- the similarity between the first operation event and the second operation event is greater than or equal to a preset similarity threshold, indicating that both the first operation event and the second operation event may be expressed
- a preset similarity threshold indicating that both the first operation event and the second operation event may be expressed
- the processing device receives the first operation event input by the user as "name sheet Three", and the second operation event is "Name Zhang Shan".
- the preset similarity threshold can be set according to actual needs, for example, it can be set to 90%, 95%, and so on.
- the second operation object being the same as the first operation object means that the second operation object indicated by the second operation event is the first operation object, for example, assuming that the first operation object is "brightness", the second operation event is "half brightness” or “half reduction", at this time, the second operation object corresponding to the second operation event is "brightness", and it is the same as the first operation object same.
- the second operation object being different from the first operation object means that the second operation object indicated by the second operation event is not the first operation object, for example, assuming that the first operation object The operation object is "battery capacity", and the second operation event is "half brightness”, at this time, the second operation object is "brightness", which is different from the first operation object.
- the input user of the second operation event is the same as or associated with the input user of the first operation event, and may be that the input user of the second operation event is the same as the input user of the first operation event
- the input user of the second operation event is a family member of the input user of the first operation event.
- it can be based on voiceprint recognition, face recognition, fingerprint recognition and other technologies Identifying whether the input user of the second operation event is associated with the input user of the first operation event. For example, after user Zhang San clicks the music play button, Zhang San's son inputs the voice "pause playing", at this time, it is considered that the input user of the second operation event is associated with the input user of the first operation event.
- the input user of the second operation event is not the same as or not associated with the input user of the first operation event, and may be the input user of the second operation event and the input user of the first operation event They are not the same user or have no associated relationship.
- the driver and passenger in the bus can be regarded as different or not associated.
- the conflict between the first operation event and the second operation event may mean that the operation object of the first operation event is the same as the operation object of the second operation event, but the operations executed are contradictory, for example , the first operation event is "Call Zhang San", and the second operation event is "Don't call Zhang San”; the conflict between the first operation event and the second operation event may also refer to The first operation event is the same as the second operation event, for example, the first operation event is "name Zhang San", and the second operation event is also "name Zhang San”.
- the fact that the first operation event does not conflict with the second operation event may mean that the operation object of the first operation event is different from the operation object of the second operation event, and that the operation object of the first operation event is different from that of the second operation event.
- the two operation events are not equal, for example, the first operation event is "name Zhang San", the second operation event is "ethnicity Han” and so on.
- the association between the first operation event and the second operation event may mean that the operation object of the first operation event is associated with the operation object of the second operation event, or that the operation content of the first operation event is associated with The operation content of the second operation event is related, for example, the first operation event is "name Zhang San", and the second operation event is "call Zhang San”.
- the fact that the first operation event is not associated with the second operation event may mean that the operation object of the first operation event is not associated with the operation object of the second operation event, and the operation content of the first operation event It is not related to the operation content of the second operation event.
- the meeting the eighth preset condition includes at least one of the following:
- the triggering object is the second preset object
- said processing device has an associated device
- the second preset scene may be a scene opposite to the first preset scene, including but not limited to a single-player scene, a multi-person scene, a closed environment (such as in a room, in a vehicle) etc.), open environments (such as outdoors, playgrounds, etc.), etc.
- the first preset scene is a single person scene
- the second preset scene may be a multiplayer scene.
- the second preset time may be at a time different from the first preset time, specifically one or more set time periods, such as 13:00-14:00 pm and/or Or from 18:00 to 22:00 in the evening, or a certain day or several days, such as Monday to Wednesday and/or Saturday to Sunday.
- the second preset time can be from 14:01 to 15:00 in the afternoon.
- the second preset location is a location opposite to the first preset location, which may be a company, a home, a shopping mall, a hotel, and the like. For example, if the being in the first preset position is inside the vehicle, the being in the second preset position may be outside the vehicle and so on.
- the second preset state is a state opposite to the first preset state, and may be a motion state (such as running, walking, etc.), a static state, a working state, an idle state, or a connection state of the processing device. , disconnected state, folded state, or unfolded state, etc.
- the second preset state may also be the current operating state of the associated device, such as an idle state (the screen of the associated device only displays the desktop and does not display other applications or services), connection state (connected to the processing device);
- the second preset state may also be a folded state of the display screen of the associated device, such as a full-screen unfolded state, a fully folded state, a half-folded state, and the like.
- the second preset service or function is a service or function different from the first preset service or function, and may be a video call service, a voice call service, a video playback service, an audio playback service, and the like.
- the first preset service or function is a video call service
- the second preset service or function may be a voice call service or the like.
- the trigger object of an application or service may refer to an object that triggers an application or service to perform preset processing, and the second preset object may be a user or another application or service.
- the second preset object is the same as the first The preset objects are not the same.
- the second preset relationship may be a priority relationship, an association relationship, a non-association relationship, etc., and the second preset relationship is a relationship opposite to the first preset relationship.
- the first preset relationship is an association relationship
- the second preset relationship may be a non-association relationship or the like.
- the associated device of the processing device may be a communication connection established between the processing device and other devices, such as a Bluetooth connection, a short-range wireless communication connection, and the like.
- the privacy-related may be that the application or service belongs to a preset privacy application or service, or that the displayed content involves privacy, and the like.
- the first application or service may be displayed in a floating state; and/or, if the trigger object of the first application or service is another application or service, it may Announce the first application or service by voice; and/or, if the priority of the first application or service is lower than or equal to the priority of the second application or service displayed by the processing device, half-screen displaying the first application or service; and/or, if the first application or service is used to provide an audio playback service, displaying the first application or service in a floating state; and/or, if the processing has associated device, the first application or service may be displayed through the associated device; and/or, if the first application or service involves privacy, the privacy content in the first application or service may be hidden Displayed after processing.
- the second preset processing includes at least one of the following:
- the processing result is that the first voice and the second voice meet the second preset condition
- the first operation event corresponding to the first voice and/or the second The second operation event corresponding to the voice is processed;
- the processing result is that the first voice and the second voice do not meet the second preset condition
- the first operation event corresponding to the first voice and/or the first operation event corresponding to the first voice according to the second preset policy The second operation event corresponding to the second voice is processed;
- the processing result is at least one of the following: the first operation event and the second operation event meet the third preset condition, the first operation object and the second operation object meet the fifth preset condition Assume that the condition, the second operation event and/or the second operation object meet the seventh preset condition, then process the first operation event and/or the second operation event according to a third preset policy ;
- the first operation event and/or the second operation event are processed according to a fourth preset policy process
- the processing device and/or the first application or service meet the eighth preset condition, controlling the display interface of the first application or service to switch from the first mode to the second mode for display .
- the first preset strategy includes at least one of the following:
- a prompt message is output, and in response to the selection instruction, an operation event corresponding to the voice selected by the selection instruction is executed.
- the second preset strategy includes at least one of the following:
- the first operation event and the second operation event are executed according to the distance of the sound source.
- the meeting the second preset condition includes that the first voice meets the second preset condition, and the not meeting the second preset condition
- the condition includes that the first voice does not meet the second preset condition; when only the second voice is included, the meeting the second preset condition includes that the second voice meets the second preset condition, The failure to meet the second preset condition includes that the second voice does not meet the second preset condition; if the first voice and the second voice are included, the second voice does not meet the second preset condition.
- the preset conditions may include that the first voice meets the second preset condition, the second voice meets the second preset condition, the first voice meets the second preset condition, and the second voice meets the second preset condition.
- the failure to meet the second preset condition may include that the first voice does not meet the second preset condition and the second voice does not meet the second preset condition, the At least one of the first voice does not meet the second preset condition and the second voice does not meet the second preset condition.
- the first operation event may be executed, or the second operation event may not be executed.
- An operational event For example, assuming that the first voice is "name Zhang San", if the detection finds that the first voice is associated with at least one operation object on the current interface, execute the first operation event corresponding to the first voice. Or, assuming that the first voice is "open the game” and the second voice is "forbidden to play games", if it is found through detection that the user who uttered the first voice is the son of the user who uttered the second voice, Then the first operation event corresponding to the first voice may not be executed.
- the second operation event may be executed, or the first operation event may not be executed.
- Two operation events For example, assuming that the first voice is "name Zhang San” and the second voice is "name Zhang Shan", if it is found through detection that the second operation event corresponding to the second voice corresponds to the first voice If the similarity between the first operation events is greater than or equal to the preset similarity threshold, the second operation event corresponding to the second voice may be executed.
- the first operation event and the second operation event may be combined, and the combined operation event is executed, For example, assuming that the first voice is "name" and the second voice is "Zhang San", and it is found that the second voice is associated with the first voice through detection, then the first voice corresponding to the first voice is merged. An operation event and a second operation event corresponding to the second voice, and execute the combined operation event.
- a prompt message may also be output, so as to execute the operation event corresponding to the selected voice according to the user selection result.
- the acquisition interval between the first voice and the second voice is longer than a preset duration threshold, and/or the first operation event corresponding to the first voice is equal to the second voice
- the similarity between the second operation events is less than a preset similarity threshold, and/or the user who uttered the first voice is not associated with the user who uttered the second voice, and/or the first voice and/or
- the first operation event and the second operation event may be executed simultaneously , execute the first operation event and the second operation event according to the order of acquisition time, execute the first operation event and the second operation event according to the order of priority, or execute the first operation event according to the distance of the sound source An operational event and said second operational event.
- the processing device when the processing device is currently displaying the contact creation interface, assuming that the first voice is "name Zhang San” and the second voice is "Ethnic Hmong", if it is found through detection that the first voice corresponding to the first voice is If the similarity between the operation event and the second operation event corresponding to the second voice is less than the preset similarity threshold, the first operation event and the second operation event can be executed at the same time, or can be obtained according to the order of acquisition time The first operation event and the second operation event are executed sequentially.
- the processing device obtains that the first voice is "play the song of my motherland” and the second voice is “play the song of the Yangtze River”
- the detection finds that the first voice and the second voice are respectively If they are issued by different users that are not associated, the first operation event and the second operation event may be executed according to the order of priority, or the first operation event and the second operation event may be executed according to the distance from the sound source.
- the executing the first operation event and the second operation event according to a priority order includes at least one of the following: executing the first operation event and the second operation event according to a user priority order Events, execute the first operation event and the second operation event according to the order of priority of the event, execute the first operation event and the second operation event according to the priority order of the application that obtains the voice, and execute the first operation event and the second operation event according to the device that obtains the voice
- the first operation event and the second operation event are executed in order of priority.
- the user priority can be set according to actual needs, for example, the priority of the driver is higher than that of the passengers in the vehicle, and the priority of the front row passengers is higher than that of the rear passengers.
- the event priority can be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event.
- the application priority can be set according to the actual situation, for example, the priority of the system application is higher than that of the third-party application.
- the device priority can be set according to the actual situation, for example, the priority of the processing device is higher than that of the associated device, and the priority of the associated device is higher than that of the server.
- executing the second operation event includes: outputting an interface switching prompt message; and displaying the second operation event in response to a switching confirmation instruction
- the interface where the corresponding operation object is located, and execute the second operation event when the second operation event is not associated with the operation object of the current interface, for example, the second operation object corresponding to the second operation event is not displayed on the current interface, in order to execute the second operation event, usually An interface switch is required. However, the user may need to return to the current interface for operation after the processing device executes the second operation event. In order to minimize or avoid interface switching, the processing device may first output an interface switching prompt message to Take the appropriate action.
- an interface switching prompt message can be output at this time to prompt the user whether to switch to Li Si's contact.
- a human interface and then judge whether to perform an interface switching operation based on the user's selection operation.
- the current interface of the processing device displays a contact creation interface, indicating that the processing device is in a contact creation state.
- the voice assistant responds to the first voice input by the user, "phone 8837291” and the second voice "telephone 8837297", and it is detected that the input interval between the first voice and the second voice is short and the similarity is high, it can be considered that the first voice was input by the user by mistake, then The first voice is not executed, but the second voice is executed, so as to input the number "8837297" into the "telephone” control, as shown in (b) in FIG. 6 .
- the smart speaker can The priorities of the mobile phone and the second mobile phone and/or the priority of the user of the first mobile phone and the user of the second mobile phone determine the song playback order. For example, if the priority of the first mobile phone is higher than that of the second mobile phone, then the Play the song "Motherland" first. In this way, when processing voices, considering whether multiple voices meet preset conditions can improve the convenience and/or intelligence of voice processing, and improve user experience.
- the meeting the third preset condition includes that the first operation event meets the third preset condition, and the failure to meet the third preset condition includes The first operation event does not meet the third preset condition.
- the meeting the third preset condition includes that the second operation event meets the third preset condition, and the failure to meet the third preset condition includes The second operation event does not meet the third preset condition.
- the meeting the third preset condition may include that the first operation event meets the third preset condition, the second operation event Meet the third preset condition, the first operation event meets the third preset condition and the second operation event meets at least one of the preset third conditions, and the third preset condition does not meet It may include that the first operation event does not meet the third preset condition and the second operation event does not meet the third preset condition, the first operation event does not meet the third preset condition, the second operation event At least one of the third preset conditions is not met.
- the third preset strategy includes at least one of the following:
- the first operation event and/or the second operation event is executed.
- the fourth preset strategy includes at least one of the following:
- the first operation event and the second operation event are executed according to a priority order.
- the first operation event when the first operation event conflicts or does not conflict with the second operation event, the first operation event may be executed, the second operation event may not be executed, or the first operation may not be executed Event, execute the second operation event, or output a prompt message, execute the operation event corresponding to the selection instruction in response to the selection instruction, or execute the first operation event or the second operation event in response to the third operation event operation event, or the first operation event and the second operation event are not executed.
- the first operation event is "Call Zhang San”
- the second operation event is "Call Li Si”
- the first operation event may not be executed, and the second operation event may be executed.
- the first operation event when the first operation event is associated or not associated with the second operation event, the first operation event may be executed, the second operation event may not be executed, or the first operation may not be executed event, execute the second operation event, or execute the first operation event and the second operation event, or combine the first operation event and the second operation event, and execute the combined operation event, etc. .
- the processing device displays the contact creation interface
- the first operation event is determined to be "name Zhang San” according to the first voice input by the user
- the second operation event is "call Zhang San”
- the first operation event may be executed, and the second operation event may not be executed, that is, input "Zhang San” into the "name” control.
- the first voice is "name Li Si, Four Seasons' Si”
- the first operation event is determined to be "name Li Si” according to the first voice.
- the second operation event is "Four of Four Seasons"
- the first operation event and the second operation can be combined event, and execute the merged operation event to input "Li Si" into the "Name” control.
- the third operation event includes but is not limited to: events such as touch gesture operation, air gesture operation, voice operation, etc.
- the air gesture can be acquired through the camera in the mobile phone or the voice input by the user can be acquired through the microphone.
- the processing device may first output a prompt message, and then execute the first operation event and/or the second operation event in response to a third operation event.
- the processing device may also execute the first operation event and/or the second operation event in response to a third operation event after executing the first operation event and/or the second operation event, for example, When the current interface of the processing device creates an interface for a contact, assuming that the first operation event is "name Zhang San” and the second operation event is "name Zhang Shan", the processing device performs the processing according to the first preset policy.
- the first operation event and the second operation event may be executed at the same time, or all operations may be executed according to a priority order.
- the first operation event and the second operation event For example, when the processing device displays the contact creation interface, suppose the processing device obtains that the first voice input by the user is "name Zhang San, ethnicity Han", and based on the first voice determines that the first operation event is "name Zhang San” and The second operation event is "National Han”. Since the first operation event does not conflict with the second operation event, the first operation event and the second operation event can be executed at the same time, that is, "Zhang San” Enter it into the "Name” control, and "Han” into the "Ethnicity” control.
- the executing the first operation event and the second operation event according to a priority order includes: executing the first operation event and the second operation event according to an event priority order.
- the event priority may be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event.
- Fig. 12 is a schematic diagram of the interface of the processing device according to the second embodiment.
- the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the contact creation state. Mountain”, determine that the first operation event is "name Zhang San”, and the second operation event is "name Zhang Shan", and it is detected that the first operation event conflicts with the second operation event, and the second operation event can be considered
- the event is what the user needs, so the first operation event is not executed, but the second operation event is executed to input the text "Zhang Shan" into the "Name” control, as shown in (b) in Figure 12 .
- the method further includes: identifying the first operation object according to a preset identification manner.
- the first operation object may be identified according to a preset identification method, such as font enlargement, animation display, Voice broadcast, etc., so that users can know in time and perform follow-up operations.
- the voice and/or the first operation object meet the fourth preset condition, then process the second operation event corresponding to the voice based on a fifth preset strategy; if the voice and/or Or if the first operation object does not meet the fourth preset condition, the second operation event corresponding to the voice is processed based on a sixth preset policy.
- the fifth preset strategy includes at least one of the following:
- the sixth preset strategy includes at least one of the following:
- Output update operation event prompt information and execute the third operation event on the first operation object in response to the third operation event.
- the first operation object may be The operation object executes the second operation event, and may also output prompt information for updating the operation object, and executes the second operation event on the first operation object in response to the confirmation instruction.
- the current interface of the processing device is a contact creation interface
- the voice "Zhang San” input by the user is received at the same time
- the first operation object at this time is the "Name” control
- the second operation object is also the "Name” control
- the The first operation object executes the second operation event, outputs update operation event prompt information, and executes the third operation event on the first operation object in response to the third operation event.
- the current interface of the processing device is a contact creation interface
- the voice "18000000000” input by the user is received at the same time, at this time, the first operation object is the "name” control, And the second operation object is the "Phone” control, since the first operation object is not the same as the first operation object, the number "18000000000” is not written into the "Name” control, or it can output whether It is necessary to update the prompt information of the operation event.
- the third operation event such as the voice "phone
- Fig. 13 is a schematic diagram of the interface of the processing device according to the second embodiment.
- the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the contact creation state, and the user first clicks the "name” control in the current interface to input the first operation event, and then input the voice "Zhang San", the processing device detects whether the acquisition interval between the voice and the first operation event is less than or equal to a preset duration threshold, and whether the user who uttered the voice is the same as the user who input the first operation event , when it is detected that the acquisition interval is less than or equal to the preset duration threshold and the user who uttered the voice is the same as the user who input the first operation event, input the voice "Zhang San” into the "Name” control, as shown in Figure 13 Shown in (b).
- first operation object and the second operation object meet a fifth preset condition, then process the first operation event and/or the second operation event according to a third preset strategy ; if the first operation object and the second operation object do not meet the fifth preset condition, process the first operation event and/or the second operation event according to a seventh preset strategy.
- the seventh preset strategy includes at least one of the following:
- the first operation event and the second operation event are executed according to the distance of the sound source of the corresponding voice.
- the first operation event and/or the second operation event may be executed, or the first operation event may not be executed.
- the operation event and/or the second operation event may also combine the first operation event and the second operation event, and execute the combined operation event.
- the processing device acquires that the first operation event is "name Zhang San” and the second operation event is "name Zhang Shan", then the first operation event The object is the same as the second operation object, that is, both are "name” controls, then the second operation event can be directly executed to input "Zhang Shan" into the "name” control, or a prompt message can be output to execute The operation event selected by the user; if the processing device acquires that the first operation event is "name Zhang San” and the second operation event is "ethnicity Han", then the first operation object and the second operation If the objects are not the same, execute the first operation event and the second operation event respectively, so as to input "Zhang San” into the "Name” control and “Han” into the "Ethnicity” control; if the processing device obtains all The first operation event is "name", and the second operation event is "Zhang San". At this time, the first operation object is the same as the second operation object, that is, both are "name” controls, and
- the third operation event may be an event such as a touch operation or a voice operation.
- the first operation event is "call Zhang San”
- the second operation event is "call Li Si”
- a prompt message can be output, and if a voice input by the user "execute the following event” is obtained at this time, the second operation object can be obtained.
- the second operation event can be executed.
- the processing device when the current interface of the processing device is an interface created for a contact, assuming that the first operation event is "name Zhang San” and the second operation event is "name Zhang Shan", the processing device generates an interface according to the first preset policy.
- the first operation event and the second operation event may be executed at the same time, and all operation events may be executed in sequence according to the acquisition time.
- the first operation event and the second operation event, or the first operation event and the second operation event are executed according to a priority order. For example, when the processing device currently displays the contact creation interface, assuming that the first operation event is "name Zhang San” and the second operation event is "ethnicity and Hmong", if it is found through detection that the first operation object has the same If the second operation objects are different, the first operation event and the second operation event may be executed at the same time, or the first operation event and the second operation event may be executed in order of acquisition time.
- the processing device obtains that the first operation event is "play a song from my motherland” and that the second operation event is "play a song from the Yangtze River", if the input user of the first operation event and the If the input users of the second operation event are different, the first operation event and the second operation event may be executed according to a priority order.
- the executing the first operation event and the second operation event according to a priority order includes at least one of the following: executing the first operation event and the second operation event according to a user priority order Events, execute the first operation event and the second operation event according to the order of priority of the event, execute the first operation event and the second operation event according to the priority order of the application that obtains the voice, and execute the first operation event and the second operation event according to the device that obtains the voice
- the first operation event and the second operation event are executed in order of priority.
- the user priority can be set according to actual needs, for example, the priority of the driver is higher than that of the passengers in the vehicle, and the priority of the front row passengers is higher than that of the rear passengers.
- the event priority can be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event.
- the application priority can be set according to the actual situation, for example, the priority of the system application is higher than that of the third-party application.
- the device priority can be set according to the actual situation, for example, the priority of the processing device is higher than that of the associated device, and the priority of the associated device is higher than that of the server.
- Fig. 14 is a schematic diagram of an interface of a processing device according to a fourth embodiment.
- the current interface of the processing device displays a contact creation interface, indicating that the processing device is in the contact creation state.
- the voice assistant responds to the first voice input by the user "name Zhang San, phone 18000000000 ", determine that the first operation event is "name Zhang San”, the second operation event is "telephone 18000000000", and detect the second operation corresponding to the first operation object corresponding to the first operation event and the second operation event Objects are different, and the first operation object and the second operation object are respectively displayed on the current interface, it can be considered that the first operation object and the second operation object do not meet the preset conditions, then execute the The first operation event and the second operation event are used to input the text "Zhang Shan" into the "Name” control and the number "18000000000” into the "Phone” control, as shown in (b) in FIG. 14 .
- the second operation event and/or the second operation object meet the seventh preset condition, then process the first operation event and/or the second operation event according to a third preset policy ; if the second operation event and/or the second operation object do not meet the seventh preset condition, then process the first operation event and/or the second operation event according to an eighth preset policy.
- the first operation event and/or the second operation event may be executed, or The first operation event and/or the second operation event may not be executed, or the first operation event and the second operation event may be combined, and the combined operation event may be executed.
- the current interface is an interface created for a contact
- the processing device obtains that the first operation event is "telephone” and the second operation event is "1234567”
- the first operation object is displayed on the current Interface, that is, it is considered that the first operation object meets the sixth preset condition.
- the first operation event and the number of phone numbers are not executed.
- the above second operation event or may output a prompt message for prompting the user to re-input; if the processing device obtains that the first operation event is "telephone”, the second operation event is "18000000000", at this time the The first operation object is displayed on the current interface, that is, the first operation object is considered to meet the sixth preset condition, and since it is detected that the number of numbers corresponding to the second operation event matches the number of phone numbers, the merged The first operation event and the second operation event.
- the eighth preset strategy includes at least one of the following:
- the first operation event and the second operation event are executed according to a priority order.
- the first operation event and the second operation event may be executed simultaneously, according to Acquiring to execute the first operation event and the second operation event in chronological order, or execute the first operation event and the second operation event according to a priority order.
- the processing device currently displays the contact creation interface, assuming that the first operation event is "name Zhang San” and the second operation event is "ethnicity and Miao nationality", if the first operation object and If the second operation object is displayed on the current interface, and the second operation object is different from the first operation object, then the first operation event and the second operation event can be executed at the same time, or according to the acquired The first operation event and the second operation event are executed sequentially in time.
- the processing device obtains that the first operation event is "play a song from my motherland” and that the second operation event is "play a song from the Yangtze River", if the input user of the first operation event and the If the input users of the second operation event are different, the first operation event and the second operation event may be executed according to a priority order.
- the executing the first operation event and the second operation event according to a priority order includes at least one of the following: executing the first operation event and the second operation event according to a user priority order Events, execute the first operation event and the second operation event according to the order of priority of the event, execute the first operation event and the second operation event according to the priority order of the application that obtains the voice, and execute the first operation event and the second operation event according to the device that obtains the voice
- the first operation event and the second operation event are executed in order of priority.
- the user priority can be set according to actual needs, for example, the priority of the driver is higher than that of the passengers in the vehicle, and the priority of the front row passengers is higher than that of the rear passengers.
- the event priority can be set according to the actual situation, for example, the priority of the navigation event in the vehicle is higher than that of the music playing event.
- the application priority can be set according to the actual situation, for example, the priority of the system application is higher than that of the third-party application.
- the device priority can be set according to the actual situation, for example, the priority of the processing device is higher than that of the associated device, and the priority of the associated device is higher than that of the server.
- Fig. 15 is a schematic diagram of the interface of the processing device according to the second embodiment.
- the underage daughter uses the shopping application on the mother's mobile phone to select some commodities and generate an order, which is equivalent to the first operation event being an order generation event, and the first operation event
- the input user is a daughter.
- the mobile phone receives the voice "confirm payment"
- it will detect whether the input user of the voice is a mother, and if so, execute the payment operation for the order, etc., which is equivalent to the second operation event It is an order payment event
- the input user of the second operation event is mother, as shown in (b) in FIG. 15 .
- said performing the second preset processing also includes:
- the current interface it is judged whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result. Understandably, in some scenarios, the user may not pay attention to the content displayed on the interface. Therefore, based on the preset policy, the first operation event corresponding to the first voice and/or the operation event corresponding to the second voice When the second operation event is processed, the current interface can still be maintained. For example, in order to drive safely, the user may only pay attention to the song list while driving the vehicle, but not the lyrics of each song. At this time, after receiving the song switching voice, the display interface of the car can be kept on list interface. In other scenarios, the user may pay more attention to the content displayed on the interface.
- the interface can be switched according to the processing result. For example, when a user listens to a song with a mobile phone at home, he may need to read the lyrics at any time in order to hum synchronously. At this time, after receiving the song switching voice, the display interface of the mobile phone can be switched to the interface where the corresponding song is located. In this way, it is judged according to the current scene information whether the current interface needs to be switched, and corresponding operations are performed based on the judgment result, which further improves the user experience and reduces the resource consumption of the device.
- performing corresponding operations based on the judgment result includes at least one of the following: if it is determined according to the current scene information that the current scene type is a preset scene type, then the current interface will not be switched; if the current scene type is determined according to the current scene information If it is not a preset scene type, the interface will be switched according to the processing result.
- the preset scene type can be set according to actual needs, for example, it can be set as driving, low battery, weak signal and other scenes.
- the first mode and the second mode can be set according to actual needs, including but not limited to full-screen state, half-screen state, floating state, stacked display, stacked display, side-by-side display, voice broadcast, switching Displayed equipment, encrypted display, blurred display, fixed display, direct hiding, etc., and the first manner is different from the second manner.
- the full screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is 1;
- the half screen state means that the proportion of the display interface of the application or service to the overall display interface of the device is less than 1 , such as one-half, one-third, or one-fourth, etc.;
- the floating state means that the application or service is suspended and displayed on the display interface of the device in the form of a floating ball or a floating window;
- the stacked display refers to According to a preset order (for example, according to the order in which the application or service is operated), the windows displaying the application or service are stacked one by one, for example, the window corresponding to the currently operating application is displayed on the top layer;
- Stacked display refers to stacking and arranging two windows displaying applications or services horizontally and evenly distributed vertically;
- the side-by-side display refers to arranging side by side windows displaying applications or services in a manner of two vertically and evenly distributed horizontally Get up;
- the processing device searches for the application and triggers the voice assistant to start, it can voice broadcast the voice assistant that has been turned on. information, instead of displaying the information that the voice assistant has been turned on on the display interface;
- the switching display device refers to switching the application or service from the processing device to the associated device for display, for example, switching the navigation map interface displayed on the mobile phone to the same The car machine associated with the mobile phone displays, etc.; the encrypted display means that when there is content related to user privacy, data security, etc.
- Blurred display refers to blurring the display interface of an application or service, such as performing Gaussian blurring on at least a part of the image, and the degree of blurring can be set by the user or Automatically match according to the preset scene
- fixed display refers to locking the display interface of the application or service so that the user cannot perform other operations except unlocking, for example, when the video application is switched to full-screen playback, the user cannot play at this time. Performing other operations on the interface can avoid receiving misoperations from the user.
- Direct hiding can be switching the application or service to the background or directly closing the process.
- the video call service when the user starts a video call service with a friend, if the processing device is in a multi-person scene, the video call service may be displayed in half-screen mode, and when the processing device changes from being in a multi-person scene to In a single-person scenario, the video call service can be displayed in a full-screen state; for another example, when the user starts the music player application, if the processing device is in motion, the music player application can be displayed in a floating state, and the When the processing device changes from a moving state to a static state, it can display the music playing application in a half-screen or full-screen state; for example, when the processing device is running a human-computer interaction application, if the human-computer interaction application is currently The preset service can display the human-computer interaction application in a full-screen state, and when the human-computer interaction application changes from a working state to an idle state, that is, when the preset service is not being provided, the human-computer interaction application can be displayed in a half-screen state or in
- Human-computer interaction application when the processing device starts the navigation map application outside the vehicle, it can display the navigation interface of the navigation map application in a full screen state, and when the processing device enters the vehicle and is associated with the vehicle (such as connected) , the navigation interface of the navigation map application can be switched to the car machine for display; for another example, when the processing device is running an office application, if the processing device is connected to a projection device, the office application will be displayed in full screen, while the When the processing device is disconnected from the projection device, the office application is displayed on a half screen; for another example, when the processing device is running the instant messaging application in the foreground, the instant messaging application can be displayed in full screen, and the instant messaging application is running in the foreground of the associated device. When the instant messaging application is used, the processing device may hide or float and display the instant messaging application.
- the first mode and the second mode include at least one of the following: a first background color, a second background color, a first font, a second font, a first brightness, a second brightness, and the The first way is different from the second way.
- the background color refers to the main color of the display interface of the application or service, including but not limited to white, black, light green, dark green, and the like.
- the font refers to the size of the text displayed on the display interface of the application or service, such as 12 points, 14 points, and so on.
- the font of all characters in the instant messaging application may be reduced, or the The background color is adjusted to a darker color such as black or gray, and when the processing device changes from a multi-person scene to a single-player scene, the fonts of all characters in the instant messaging application can be restored to the default size or enlarged.
- the font of all the text in the instant messaging application or adjust the background color of the instant messaging application to a brighter color such as pink or bright green;
- the processing device moves from a room with lights on to a room without lights on, that is, from a room with bright light to a room with dark light, the brightness of the video playback application can be reduced, while the processing device has never turned on the lights
- the brightness of the video playback application can be increased accordingly.
- An embodiment of the present application further provides an intelligent terminal, the intelligent terminal includes a memory and a processor, and a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method in any of the foregoing embodiments are implemented.
- An embodiment of the present application further provides a computer-readable storage medium, on which a processing program is stored, and when the processing program is executed by a processor, the steps of the processing method in any of the foregoing embodiments are implemented.
- An embodiment of the present application further provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on the computer, the computer is made to execute the methods in the above various possible implementation manners.
- the embodiment of the present application also provides a chip, including a memory and a processor.
- the memory is used to store a computer program
- the processor is used to call and run the computer program from the memory, so that the device installed with the chip executes the above various possible implementation modes. Methods.
- Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.
- the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation.
- the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in one of the above storage media (such as ROM/RAM, magnetic CD, CD), including several instructions to make a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) execute the method of each embodiment of the present application.
- all or part of them may be implemented by software, hardware, firmware or any combination thereof.
- software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
- a computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part.
- the computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus.
- Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center.
- the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media.
- Usable media may be magnetic media, (eg, floppy disk, memory disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (27)
- 一种处理方法,应用于处理设备,其中,包括以下步骤:S1:响应于所述处理设备和/或第一应用或服务符合第一预设条件,进行第一预设处理;S2:响应于所述处理设备和/或关联设备符合第二预设条件,进行第二预设处理。
- 如权利要求1所述的处理方法,其中,所述符合第一预设条件,包括以下至少一项:获取至少一第一语音和至少一第二语音;处于第一预设场景;处于第一预设位置;处于第一预设状态;提供第一预设服务或功能;触发对象为第一预设对象;与所述处理设备已显示的第二应用或服务之间具有第一预设关系;所述处理设备具有关联设备;涉及隐私;所述第一应用或服务的显示界面以第一方式进行展示;所述第一应用或服务的用户账号同时登录所述处理设备和关联设备。
- 如权利要求2所述的方法,其中,所述进行第一预设处理,包括以下至少一项:响应于至少一第一语音和至少一第二语音,检测所述第一语音和所述第二语音是否符合第三预设条件;控制所述第一应用或服务的显示界面以第一方式进行展示;响应于所述第一应用或服务的显示界面以第一方式进行展示,输出至少一提示信息;控制所述第一应用或服务的显示界面以第一方式和第二方式进行展示;输出至少一提示信息。
- 如权利要求3所述的方法,其中,所述符合第三预设条件,包括以下至少一项:所述第一语音与所述第二语音之间的获取间隔时长小于或等于预设时长阈值;所述第一语音对应的第一操作事件与所述第二语音对应的第二操作事件之间的相似度大于或等于预设相似度阈值;所述第一语音对应的声源距离与所述第二语音对应的声源距离之差小于或等于预设距离阈值;所述第一语音的发声用户与所述第二语音的发声用户关联;所述第一语音和/或所述第二语音与当前界面的至少一操作对象关联;所述第二语音与所述第一语音关联;所述第一语音与预设第一设备关联,和/或,所述第二语音与预设第二设备关联。
- 如权利要求3或4所述的方法,其中,所述符合第二预设条件,包括以下至少一项:所述处理设备检测到所述第一语音和所述第二语音符合所述第三预设条件;所述处理设备和/或所述关联设备接收到预设操作;所述处理设备和/或所述关联设备处于第二预设场景;所述处理设备和/或所述关联设备处于第二预设位置;所述处理设备和/或所述关联设备处于第二预设状态;所述处理设备提供第二预设服务功能;所述处理设备具有关联设备;所述关联设备上具有所述第一应用或服务;所述关联设备上运行或关闭所述第一应用或服务。
- 如权利要求3所述的方法,其中,所述进行第二预设处理,包括以下至少一项:若所述进行第一预设处理为响应于至少一第一语音和至少一第二语音,检测所述第一语音和所述第二语音是否符合第三预设条件,则根据检测结果,基于第一预设策略对所述第一 语音对应的第一操作事件和/或所述第二语音对应的第二操作事件进行处理;若所述进行第一预设处理为控制所述第一应用或服务的显示界面以第一方式进行展示,则控制所述第一应用或服务的显示界面从所述第一方式切换为第二方式进行展示;若所述进行第一预设处理为响应于所述第一应用或服务的显示界面以第一方式进行展示,输出至少一提示信息,则基于第二预设策略控制所述第一应用或服务的显示界面从所述第一方式切换为第二方式进行展示;若所述进行第一预设处理为输出至少一提示信息,则基于第三预设策略控制所述第一应用或服务的显示界面以第一方式和/或第二方式进行展示;若所述进行第一预设处理为控制所述第一应用或服务的显示界面以第一方式和第二方式进行展示,则基于第四预设策略控制所述第一应用或服务的显示界面以第三方式进行展示。
- 如权利要求6所述的处理方法,其中,所述第一预设策略,包括以下至少一项:若检测结果为所述第一语音和所述第二语音符合第三预设条件,则执行以下至少一种处理:执行所述第一操作事件;执行所述第二操作事件;不执行所述第一操作事件;不执行所述第二操作事件;合并所述第一操作事件和所述第二操作事件,并执行合并后的操作事件;输出提示消息,响应于选择指令,执行所述选择指令所选择的语音对应的操作事件;若检测结果为所述第一语音和所述第二语音不符合第三预设条件,则执行以下至少一种处理:同时执行所述第一操作事件和所述第二操作事件;根据获取时间先后顺序执行所述第一操作事件和所述第二操作事件;根据优先级顺序执行所述第一操作事件和所述第二操作事件;根据声源距离远近执行所述第一操作事件和所述第二操作事件;和/或,所述第二预设策略和/或所述第三预设策略,包括以下至少一项:对所述第一应用或服务的显示界面进行拆分后展示;通过所述处理设备和/或所述关联设备展示所述第一应用或服务的显示界面;和/或,所述第四预设策略,包括:将所述第一应用或服务的显示界面从所述处理设备切换至所述关联设备进行展示。
- 如权利要求6或7所述的处理方法,其中,所述第一方式或所述第二方式包括第一形态和第二形态,所述控制所述第一应用或服务从所述第一方式切换为第二方式进行展示或对所述第一应用或服务的显示界面进行拆分后展示,包括:按照预设规则对所述第一应用或服务的显示界面进行拆分,得到第一显示部分和/或第二显示部分;将所述第一显示部分以第一形态进行展示,和/或将所述第二显示部分以第二形态进行展示。
- 如权利要求8所述的处理方法,其中,所述处理设备的屏幕包括第一区域、第二区域以及位于所述第一区域和所述第二区域之间的可折叠区域;所述将所述第一显示部分以第一形态进行展示,和/或将所述第二显示部分以第二形态进行展示,包括:在所述第一区域将所述第一显示部分以第一形态进行展示,和/或在所述第二区域将所述第二显示部分以第二形态进行展示。
- 如权利要求6或7所述的处理方法,其中,所述控制所述第一应用或服务从所述第一方式切换为第二方式进行展示,包括:在预设时长内显示所述第一应用或服务从所述第一方式切换为第二方式的过渡动态效果。
- 如权利要求1所述的处理方法,其中,所述S1步骤之前,还包括:根据场景信息、预设信息、第一应用或服务的相关信息中的至少一种,检测所述处理设备和/或第一应用或服务是否符合第一预设条件。
- 如权利要求5所述的方法,其中,所述第一方式和所述第二方式包括以下至少一项:全屏态、半屏态、悬浮态、层叠显示、堆叠显示、并排显示、固定显示、直接隐藏,且所述第一方式与所述第二方式不同;和/或,所述第一预设状态和所述第二预设状态包括以下至少一项:运动状态、静止状态、工作状态、空闲状态、折叠状态、展开状态,且所述第二预设状态为与所述第一预设状态相对的状态;和/或,所述第一预设关系包括以下至少一项:优先级关系、关联关系、非关联关系。
- 如权利要求5所述的方法,其中,所述第一方式和所述第二方式包括以下至少一项:第一背景颜色、第二背景颜色、第一字体、第二字体、第一亮度、第二亮度,且所述第一方式与所述第二方式不同。
- 如权利要求4所述的方法,其中,所述第一操作事件和所述第二操作事件包括当前界面的操作对象和/或操作内容;和/或,所述进行第二预设处理,还包括:根据当前场景信息、历史使用信息、获取的操作中的至少一种,判断是否需要切换当前界面,并基于判断结果执行相应的操作。
- 如权利要求14所述的方法,其中,所述基于判断结果执行相应的操作,包括以下至少一项:若根据当前场景信息确定当前场景类型是预设场景类型,则不切换当前界面;若根据当前场景信息确定当前场景类型不是预设场景类型,则根据处理结果进行界面切换。
- 一种处理方法,应用于处理设备,其中,包括以下步骤:S10:响应于所述处理设备和/或第一应用或服务符合第一预设条件,进行第一预设处理;S20:响应于处理结果,进行第二预设处理。
- 如权利要求16所述的方法,其中,所述符合第一预设条件,包括以下至少一项:获取至少一第一语音和至少一第二语音;获取第一语音;获取第一操作事件和/或第一操作对象;获取第一操作事件和第二操作事件;处于第一预设场景;处于第一预设位置;处于第一预设状态;提供第一预设服务或功能;触发对象为第一预设对象;与所述处理设备已显示的第二应用或服务之间具有第一预设关系。
- 如权利要求17所述的方法,其中,所述进行第一预设处理,包括以下至少一项:响应于至少一第一语音和至少一第二语音,检测所述第一语音和所述第二语音是否符合第二预设条件;响应于第一语音,确定至少一第一操作事件和至少一第二操作事件,并检测所述第一操作事件和所述第二操作事件是否符合第三预设条件;响应于第一操作事件,确定第一操作对象,以及响应于至少一语音,检测所述语音和所述第一操作对象是否符合第四预设条件;响应于根据第一操作事件确定第一操作对象及根据第二操作事件确定第二操作对象,检测所述第一操作对象和所述第二操作对象是否符合第五预设条件;响应于第一操作事件和/或第一操作对象符合第六预设条件,检测第二操作事件和/或第二操作对象是否符合第七预设条件;控制所述第一应用或服务的显示界面以第一方式进行展示,并检测所述处理设备和/或所述第一应用或服务是否符合第八预设条件。
- 如权利要求18所述的方法,其中,所述符合第二预设条件,包括以下至少一项:所述第一语音与所述第二语音之间的获取间隔时长小于或等于预设时长阈值;所述第一语音对应的第一操作事件与所述第二语音对应的第二操作事件之间的相似度大于或等于预设相似度阈值;所述第一语音对应的声源距离与所述第二语音对应的声源距离之差小于或等于预设距离阈值;所述第一语音的发声用户与所述第二语音的发声用户关联;所述第一语音和/或所述第二语音与当前界面的至少一操作对象关联;所述第二语音与所述第一语音关联;和/或,所述符合第三预设条件,包括以下至少一项:所述第一操作事件与所述第二操作事件冲突;所述第一操作事件与所述第二操作事件关联;所述第一操作事件与所述第二操作事件不冲突;所述第一操作事件与所述第二操作事件不关联;和/或,所述符合第四预设条件,包括以下至少一项:所述语音与所述第一操作事件的获取间隔时长小于或等于预设时长阈值;所述语音对应的第二操作对象与所述第一操作对象相同;所述语音对应的第二操作对象与所述第一操作对象不相同;所述语音的发声用户与所述第一操作事件的输入用户相同或关联;所述语音的发声用户与所述第一操作事件的输入用户不相同或不关联;和/或,所述符合第五预设条件,包括以下至少一项:所述第一操作对象与所述第二操作对象相同;所述第一操作对象与所述第二操作对象不相同;所述第一操作对象和/或所述第二操作对象与当前界面显示的至少一操作对象关联;所述第一操作对象和/或所述第二操作对象与当前界面显示的至少一操作对象不关联;和/或,所述符合第六预设条件,包括以下至少一项:第一操作对象与当前界面显示的至少一操作对象关联;第一操作对象与当前界面显示的至少一操作对象不关联;所述第一操作事件的输入用户为预设用户;所述第一操作事件的输入用户不为预设用户;和/或,所述符合第七预设条件,包括以下至少一项:所述第二操作事件与所述第一操作事件的获取间隔时长小于或等于预设时长阈值;所述第一操作事件与所述第二操作事件之间的相似度大于或等于预设相似度阈值;所述第二操作对象与所述第一操作对象相同;所述第二操作对象与所述第一操作对象不相同;所述第二操作事件的输入用户与所述第一操作事件的输入用户相同或关联;所述第二操作事件的输入用户与所述第一操作事件的输入用户不相同或不关联;所述第一操作事件与所述第二操作事件冲突;所述第一操作事件与所述第二操作事件关联;所述第一操作事件与所述第二操作事件不冲突;所述第一操作事件与所述第二操作事件不关联;和/或,所述符合第八预设条件包括以下至少一项:处于第二预设场景;处于第二预设位置;处于第二预设状态;提供第二预设服务或功能;触发对象为第二预设对象;与所述处理设备已显示的第三应用或服务之间具有第二预设关系;所述处理设备具有关联设备;涉及隐私。
- 如权利要求18或19所述的方法,其中,所述进行第二预设处理,包括以下至少一项:若处理结果为所述第一语音和所述第二语音符合所述第二预设条件,则根据第一预设策略对所述第一语音对应的第一操作事件和/或所述第二语音对应的第二操作事件进行处理;若处理结果为所述第一语音和所述第二语音不符合所述第二预设条件,则根据第二预设策略对所述第一语音对应的第一操作事件和/或所述第二语音对应的第二操作事件进行处理;若处理结果为以下至少一项:所述第一操作事件和所述第二操作事件符合所述第三预设条件、所述第一操作对象和所述第二操作对象符合所述第五预设条件、所述第二操作事件和/或所述第二操作对象符合第七预设条件,则根据第三预设策略对所述第一操作事件和/或所述第二操作事件进行处理;若处理结果为所述第一操作事件和所述第二操作事件不符合所述第三预设条件,则根据第四预设策略对所述第一操作事件和/或所述第二操作事件进行处理;若处理结果为所述语音和所述第一操作对象符合所述第四预设条件,则基于第五预设策略对所述语音对应的第二操作事件进行处理;若处理结果为所述语音和所述第一操作对象不符合所述第四预设条件,则基于第六预设策略对所述语音对应的第二操作事件进行处理;若处理结果为所述第一操作对象和所述第二操作对象不符合第五预设条件,则基于第七预设策略执行相应处理;若处理结果为所述第二操作事件和/或所述第二操作对象不符合第七预设条件,则基于第八预设策略执行相应处理;若处理结果为所述处理设备和/或所述第一应用或服务符合第八预设条件,则控制所述第一应用或服务的显示界面从所述第一方式切换为第二方式进行展示。
- 如权利要求20所述的方法,其中,所述第一预设策略,包括以下至少一项:执行所述第一操作事件;执行所述第二操作事件;不执行所述第一操作事件;不执行所述第二操作事件;合并所述第一操作事件和所述第二操作事件,并执行合并后的操作事件;输出提示消息,响应于选择指令,执行所述选择指令所选择的语音对应的操作事件;和/或,所述第二预设策略,包括以下至少一项:同时执行所述第一操作事件和所述第二操作事件;根据获取时间先后顺序执行所述第一操作事件和所述第二操作事件;根据优先级顺序执行所述第一操作事件和所述第二操作事件;根据声源距离远近执行所述第一操作事件和所述第二操作事件;和/或,所述第三预设策略,包括以下至少一项:执行所述第一操作事件;执行所述第二操作事件;不执行所述第一操作事件;不执行所述第二操作事件;合并所述第一操作事件和所述第二操作事件,并执行合并后的操作事件;输出提示消息,响应于选择指令,执行所述选择指令对应的操作事件;响应于第三操作事件,执行所述第一操作事件和/或所述第二操作事件;和/或,所述第四预设策略,包括以下至少一项:同时执行所述第一操作事件和所述第二操作事件;根据优先级顺序执行所述第一操作事件和所述第二操作事件;和/或,所述第五预设策略,包括以下至少一项:对所述第一操作对象执行所述第二操作事件;输出更新操作对象提示信息,响应于确认指令,对所述第一操作对象执行所述第二操作事件;和/或,所述第六预设策略,包括以下至少一项:不对所述第一操作对象执行所述第二操作事件;输出更新操作事件提示信息,响应于第三操作事件,对所述第一操作对象执行所述第三操作事件;和/或,所述第七预设策略,包括以下至少一项:同时执行所述第一操作事件和所述第二操作事件;根据获取时间先后顺序执行所述第一操作事件和所述第二操作事件;根据优先级顺序执行所述第一操作事件和所述第二操作事件;根据对应的语音的声源距离远近执行所述第一操作事件和所述第二操作事件;和/或,所述第八预设策略,包括以下至少一项:同时执行所述第一操作事件和所述第二操作事件;根据获取时间先后顺序执行所述第一操作事件和所述第二操作事件;根据优先级顺序执行所述第一操作事件和所述第二操作事件。
- 如权利要求17所述的方法,其中,所述第一操作事件和所述第二操作事件包括当前界面的操作对象和/或操作内容;和/或,所述进行第二预设处理,还包括:根据当前场景信息、历史使用信息、获取的操作中的至少一种,判断是否需要切换当前界面,并基于判断结果执行相应的操作。
- 如权利要求22所述的方法,其中,所述基于判断结果执行相应的操作,包括以下至少一项:若根据当前场景信息确定当前场景类型是预设场景类型,则不切换当前界面;若根据当前场景信息确定当前场景类型不是预设场景类型,则根据处理结果进行界面切换。
- 如权利要求20所述的方法,其中,所述第一方式和所述第二方式包括以下至少一项:全屏态、半屏态、悬浮态、层叠显示、堆叠显示、并排显示、固定显示、直接隐藏,且所述第一方式与所述第二方式不同;和/或,所述第一预设状态和所述第二预设状态包括以下至少一项:运动状态、静止状态、工作状态、空闲状态、折叠状态、展开状态,且所述第二预设状态为与所述第一预设状态相对的状态;和/或,所述第一预设关系和所述第二预设关系包括以下至少一项:优先级关系、关联关系、非关联关系,且所述第二预设关系为与所述第一预设关系相反的关系。
- 如权利要求20所述的方法,其中,所述第一方式和所述第二方式包括以下至少一项:第一背景颜色、第二背景颜色、第一字体、第二字体、第一亮度、第二亮度,且所述第一方式与所述第二方式不同。
- 一种处理设备,其中,所述处理设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的处理程序,所述处理程序被所述处理器执行时实现如权利要求1所述的处理方法的步骤。
- 一种存储介质,其中,所述存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1所述的处理方法的步骤。
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110867324.5A CN113314120B (zh) | 2021-07-30 | 2021-07-30 | 处理方法、处理设备及存储介质 |
| CN202110867324.5 | 2021-07-30 | ||
| CN202111046165.9A CN113485783B (zh) | 2021-09-07 | 2021-09-07 | 处理方法、处理设备及存储介质 |
| CN202111046165.9 | 2021-09-07 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023005362A1 true WO2023005362A1 (zh) | 2023-02-02 |
Family
ID=85086257
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/093316 Ceased WO2023005362A1 (zh) | 2021-07-30 | 2022-05-17 | 处理方法、处理设备及存储介质 |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2023005362A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119229862A (zh) * | 2023-06-30 | 2024-12-31 | 荣耀终端有限公司 | 一种语音控制方法及电子设备 |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105810188A (zh) * | 2014-12-30 | 2016-07-27 | 联想(北京)有限公司 | 一种信息处理方法和电子设备 |
| CN105917291A (zh) * | 2014-01-08 | 2016-08-31 | 微软技术许可有限责任公司 | 具有多模式显示系统的可穿戴设备 |
| CN106681592A (zh) * | 2016-12-30 | 2017-05-17 | 北京小米移动软件有限公司 | 基于电子设备的显示切换方法及装置、电子设备 |
| CN107302635A (zh) * | 2017-07-12 | 2017-10-27 | 珠海格力电器股份有限公司 | 一种来电显示方法及其装置 |
| CN108319512A (zh) * | 2018-01-23 | 2018-07-24 | 努比亚技术有限公司 | 显示控制方法、终端及计算机可读存储介质 |
| CN108536344A (zh) * | 2018-01-09 | 2018-09-14 | 网易(杭州)网络有限公司 | 信息处理方法、装置、电子设备及存储介质 |
| CN110494835A (zh) * | 2017-12-20 | 2019-11-22 | 华为技术有限公司 | 一种控制方法及装置 |
| CN110543129A (zh) * | 2019-09-30 | 2019-12-06 | 深圳市酷开网络科技有限公司 | 一种智能电器控制方法、智能电器控制系统及存储介质 |
| CN111373348A (zh) * | 2018-02-08 | 2020-07-03 | 华为技术有限公司 | 一种应用切换方法及终端 |
| CN111597000A (zh) * | 2020-05-14 | 2020-08-28 | 青岛海信移动通信技术股份有限公司 | 一种小窗口管理方法及终端 |
| CN111737670A (zh) * | 2019-03-25 | 2020-10-02 | 广州汽车集团股份有限公司 | 多模态数据协同人机交互的方法、系统及车载多媒体装置 |
| CN111897477A (zh) * | 2020-08-04 | 2020-11-06 | 上海传英信息技术有限公司 | 移动终端的操控方法、移动终端及存储介质 |
| CN112581947A (zh) * | 2019-09-29 | 2021-03-30 | 北京安云世纪科技有限公司 | 一种语音指令响应方法、装置及终端设备 |
| CN113114847A (zh) * | 2021-06-15 | 2021-07-13 | 深圳传音控股股份有限公司 | 应用或服务的处理方法、设备及存储介质 |
| CN113220373A (zh) * | 2021-07-07 | 2021-08-06 | 深圳传音控股股份有限公司 | 处理方法、设备及存储介质 |
| CN113282962A (zh) * | 2021-07-26 | 2021-08-20 | 深圳传音控股股份有限公司 | 处理方法、处理设备及存储介质 |
| CN113314120A (zh) * | 2021-07-30 | 2021-08-27 | 深圳传音控股股份有限公司 | 处理方法、处理设备及存储介质 |
| CN113485783A (zh) * | 2021-09-07 | 2021-10-08 | 深圳传音控股股份有限公司 | 处理方法、处理设备及存储介质 |
-
2022
- 2022-05-17 WO PCT/CN2022/093316 patent/WO2023005362A1/zh not_active Ceased
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105917291A (zh) * | 2014-01-08 | 2016-08-31 | 微软技术许可有限责任公司 | 具有多模式显示系统的可穿戴设备 |
| CN105810188A (zh) * | 2014-12-30 | 2016-07-27 | 联想(北京)有限公司 | 一种信息处理方法和电子设备 |
| CN106681592A (zh) * | 2016-12-30 | 2017-05-17 | 北京小米移动软件有限公司 | 基于电子设备的显示切换方法及装置、电子设备 |
| CN107302635A (zh) * | 2017-07-12 | 2017-10-27 | 珠海格力电器股份有限公司 | 一种来电显示方法及其装置 |
| CN110494835A (zh) * | 2017-12-20 | 2019-11-22 | 华为技术有限公司 | 一种控制方法及装置 |
| CN108536344A (zh) * | 2018-01-09 | 2018-09-14 | 网易(杭州)网络有限公司 | 信息处理方法、装置、电子设备及存储介质 |
| CN108319512A (zh) * | 2018-01-23 | 2018-07-24 | 努比亚技术有限公司 | 显示控制方法、终端及计算机可读存储介质 |
| CN111373348A (zh) * | 2018-02-08 | 2020-07-03 | 华为技术有限公司 | 一种应用切换方法及终端 |
| CN111737670A (zh) * | 2019-03-25 | 2020-10-02 | 广州汽车集团股份有限公司 | 多模态数据协同人机交互的方法、系统及车载多媒体装置 |
| CN112581947A (zh) * | 2019-09-29 | 2021-03-30 | 北京安云世纪科技有限公司 | 一种语音指令响应方法、装置及终端设备 |
| CN110543129A (zh) * | 2019-09-30 | 2019-12-06 | 深圳市酷开网络科技有限公司 | 一种智能电器控制方法、智能电器控制系统及存储介质 |
| CN111597000A (zh) * | 2020-05-14 | 2020-08-28 | 青岛海信移动通信技术股份有限公司 | 一种小窗口管理方法及终端 |
| CN111897477A (zh) * | 2020-08-04 | 2020-11-06 | 上海传英信息技术有限公司 | 移动终端的操控方法、移动终端及存储介质 |
| CN113114847A (zh) * | 2021-06-15 | 2021-07-13 | 深圳传音控股股份有限公司 | 应用或服务的处理方法、设备及存储介质 |
| CN113220373A (zh) * | 2021-07-07 | 2021-08-06 | 深圳传音控股股份有限公司 | 处理方法、设备及存储介质 |
| CN113282962A (zh) * | 2021-07-26 | 2021-08-20 | 深圳传音控股股份有限公司 | 处理方法、处理设备及存储介质 |
| CN113314120A (zh) * | 2021-07-30 | 2021-08-27 | 深圳传音控股股份有限公司 | 处理方法、处理设备及存储介质 |
| CN113485783A (zh) * | 2021-09-07 | 2021-10-08 | 深圳传音控股股份有限公司 | 处理方法、处理设备及存储介质 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119229862A (zh) * | 2023-06-30 | 2024-12-31 | 荣耀终端有限公司 | 一种语音控制方法及电子设备 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3567584B1 (en) | Electronic apparatus and method for operating same | |
| WO2019076372A1 (zh) | 会话消息的显示方法及移动终端 | |
| US10389867B2 (en) | Information processing device and information processing method for controlling a transition between a lock screen and an unlocked return screen | |
| CN109379484B (zh) | 一种信息处理方法及终端 | |
| KR20180083587A (ko) | 전자 장치 및 그의 동작 방법 | |
| WO2021017763A1 (zh) | 事件处理方法、终端设备及计算机可读存储介质 | |
| CN113282962A (zh) | 处理方法、处理设备及存储介质 | |
| WO2021083040A1 (zh) | 消息查看方法及终端 | |
| WO2019114522A1 (zh) | 屏幕控制方法、屏幕控制装置及移动终端 | |
| CN111862972A (zh) | 语音交互服务方法、装置、设备及存储介质 | |
| CN108664818B (zh) | 一种解锁控制方法及装置 | |
| CN113314120B (zh) | 处理方法、处理设备及存储介质 | |
| CN109639999B (zh) | 视频通话数据的优化方法、移动终端及可读存储介质 | |
| CN113485783B (zh) | 处理方法、处理设备及存储介质 | |
| CN113254092B (zh) | 处理方法、设备及存储介质 | |
| CN108345775A (zh) | 一种应用访问方法及移动终端 | |
| WO2023005362A1 (zh) | 处理方法、处理设备及存储介质 | |
| CN108170360B (zh) | 一种手势功能的控制方法及移动终端 | |
| WO2022213389A1 (zh) | 组件显示方法、移动终端及存储介质 | |
| WO2022226700A1 (zh) | 控制方法、移动终端及存储介质 | |
| WO2022262298A1 (zh) | 应用或服务的处理方法、设备及存储介质 | |
| US12079639B2 (en) | Automatically changing device property values for a secondary user of a device | |
| CN110908732B (zh) | 应用的任务删除方法及电子设备 | |
| CN115277922A (zh) | 处理方法、智能终端及存储介质 | |
| CN115617293A (zh) | 数据处理方法、源端投屏设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22847974 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202417014052 Country of ref document: IN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 07/06/2024) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22847974 Country of ref document: EP Kind code of ref document: A1 |