WO2021164445A1 - Procédé de traitement de notification, appareil électronique et système - Google Patents

Procédé de traitement de notification, appareil électronique et système Download PDF

Info

Publication number
WO2021164445A1
WO2021164445A1 PCT/CN2020/142600 CN2020142600W WO2021164445A1 WO 2021164445 A1 WO2021164445 A1 WO 2021164445A1 CN 2020142600 W CN2020142600 W CN 2020142600W WO 2021164445 A1 WO2021164445 A1 WO 2021164445A1
Authority
WO
WIPO (PCT)
Prior art keywords
message
electronic device
user
content
prompt
Prior art date
Application number
PCT/CN2020/142600
Other languages
English (en)
Chinese (zh)
Inventor
刘敏
余平
杜仲
张莉容
党茂昌
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202010102903.6A external-priority patent/CN111404802A/zh
Priority claimed from CN202010473781.1A external-priority patent/CN113746718B/zh
Priority claimed from CN202010844313.0A external-priority patent/CN114157756A/zh
Priority claimed from CN202010844642.5A external-priority patent/CN114173000B/zh
Priority claimed from CN202010844414.8A external-priority patent/CN114173204B/zh
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN202080100013.XA priority Critical patent/CN115428413A/zh
Publication of WO2021164445A1 publication Critical patent/WO2021164445A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21—Monitoring or handling of messages
    • H04L51/224—Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages

Definitions

  • This application relates to the field of terminals, and more specifically, to a notification processing method, electronic device, and system.
  • the present application provides a notification processing system, method, and electronic device, which can increase the coordination capability between devices, so that multiple devices can process tasks in notifications cooperatively, and improve the information processing capability between multiple devices. It also enables users to be notified in time and facilitate follow-up operations.
  • a notification processing system in a first aspect, includes a first device and a second device.
  • the first device is configured to: When the device is configured, the first message is sent to the second device.
  • the second device is configured to: receive the first message, and generate a prompt for executing the task corresponding to the notification in the third device; in response to receiving the user's input corresponding to the prompt, send a second message to request the first message 3.
  • the device executes the task corresponding to the notification.
  • the second device When the first device generates the notification, the second device prompts the first device to receive the notification and prompts the third device to perform the task. When the second device detects the user's input corresponding to the prompt, it sends a second message to the third device to execute the task on the third device.
  • the first device and the second device have the ability to coordinate notifications, which improves the efficiency of processing notifications among multiple devices.
  • the third device is configured to perform the task corresponding to the notification.
  • the system formed by the first device, the second device, and the third device can work together to realize the corresponding tasks of processing notifications among multiple devices.
  • the system further includes the third device, where the second device is specifically configured to: send the second message to the third device; The device is configured to perform the task in response to receiving the second message.
  • the second message when the second device detects the user's input, the second message can be sent to the third device, so that the third device can perform the task, which helps to improve the efficiency of processing notifications among multiple devices .
  • the second message includes the content of the task.
  • the system further includes the third device, where the second device is specifically configured to: send a second message to the first device; the first device, It is also used to send a third message to the third device in response to receiving the second message; the third device is used to perform the task in response to receiving the third message.
  • the second message when the second device detects the user's input, the second message can be sent to the first device, so that the first device can send the third message to the third device, so that the third device can perform the task. Helps improve the efficiency of processing notifications between multiple devices.
  • the third message includes the content of the task.
  • the first device is also used to detect devices within the communication range that can be used to prompt the notification; after detecting that the second device can be used to prompt the notification device, send the notification to the second device.
  • the device sends the first message, and the first message includes notification information, and the notification information is used to prompt the first device to generate the notification.
  • the first device is also used to detect devices within the communication range that can be used to perform the task corresponding to the notification; after detecting that the third device can be used to perform the task corresponding to the notification, send the notification to the first device.
  • the second device sends the first message, and the first message further includes third device information, and the third device information is used to generate the prompt on the second device.
  • the second device is also used to detect devices within the communication range that can be used to perform the task corresponding to the notification; after detecting that the third device can be used to perform the task corresponding to the notification, it is generated in the first 3. Prompts to perform the task corresponding to the notification in the device.
  • the second device is further configured to display a first interface in response to the first message; wherein, the first interface includes interface elements corresponding to N devices one-to-one, and the N devices Each device can be used to perform the task corresponding to the notification.
  • the N devices include the third device, where N ⁇ 1; receiving the user's input corresponding to the prompt includes: receiving the user interface corresponding to the third device The trigger operation of the element.
  • the third device is specifically configured to: run the service corresponding to the notification.
  • the third device is specifically configured to: send a screen projection request to the first device; the first device is also configured to send a display to the third device in response to the screen projection request.
  • the display data is used to display the interface of the first device on the third device.
  • the first message includes description information of the task
  • the second device is specifically configured to: in response to receiving the first message, display a first prompt A window, where the first prompt window includes a first control and description information of the task, the first control is associated with the third device; and the second message is sent in response to a user's input to the first control.
  • the first message sent by the first device to the second device can carry the description information of the task
  • the second device displays the description information of the task content
  • the user selects the third device to execute the task content, which realizes cross-device Task processing.
  • the second device can conveniently trigger the processing task of the third device through the first prompt window, the user experience is improved.
  • the second device is further configured to: after sending the second message, display a second control; receive user input on the second control, and send the second control Four messages to request the third device to stop performing the task.
  • a stop control is provided on the prompt device (the second device).
  • the second device can output the stop control (the second control) when the third device executes the task content, and the user passes the second device.
  • the second control controls the third device to stop executing the task content.
  • the user can pause the device to perform task content at any time to improve the efficiency of processing notifications between multiple devices, thereby helping to improve the user experience.
  • the system further includes a fourth device, and the second device is further configured to: after sending the second message, display a third control, the third control Associating with the fourth device; in response to receiving the user's input for the third control, sending a fifth message to request the third device to stop performing the task and request the fourth device to perform the task.
  • a switching control is provided on the prompting device (the second device).
  • the second device can output the switching control (the third control) when the third device executes the task content, and the user passes through the second device.
  • the three controls control the third device to stop executing the task content, and instruct other devices (the fourth device) to execute the task content.
  • the second device is specifically configured to: in response to receiving a user input for the third control, send first indication information to the third device and send second indication information to the fourth device, the The first instruction information is used to instruct the third device to stop performing the task, and the second instruction information is used to instruct the fourth device to perform the task.
  • the second device is specifically configured to send the fifth message to the first device in response to receiving a user input for the third control; and the first device is configured to respond to receiving The fifth message sends first indication information to the third device and second indication information to the fourth device.
  • the first indication information is used to instruct the third device to stop performing the task, and the second indication information is used to indicate the The fourth device performs the task.
  • the first prompt window further includes a fourth control, the fourth control is associated with one or more controls, each of the one or more controls The controls are respectively associated with an available device other than the third device; the second device is also used to display the one or more Control.
  • a control for selecting a device list is provided on the prompt device (the second device).
  • the second device can output a control for selecting the connected device list (the fourth control), and the user can view the control through the fourth control.
  • One or more available devices and then autonomously select the device to perform the task content. The effect of independent selection is realized, and the user can select the device that executes the task content from multiple devices, which improves the efficiency of processing notifications among multiple devices, thereby helping to improve the user experience.
  • the first message includes the device information of one or more devices associated with one or more controls; the second device, in response to receiving the device information of the one or more devices, displays The fourth control.
  • the one or more controls include a fifth control, and the fifth control is associated with a fifth device; the second device is also used to display the After a prompt window, when one or more devices within the communication range of the second device no longer include the fifth device, delete the fifth control; the second device is also used to detect For input of four controls, one or more controls are displayed, and the fifth control is not included in the one or more controls.
  • the controls in the first prompt window may change as the state of the device changes.
  • the fifth device is an available device, prompting the device (the second device) to output the fifth control associated with the fifth device; at the second moment, the status of the fifth device changes (not within the communication range of the second device), Then the second device deletes the fifth control associated with the fifth device.
  • the state of the fifth device changes again at the third moment (within the communication range of the second device)
  • the second device outputs the fifth control associated with the fifth device. In this way, the way of changing the output control according to the device state improves the timeliness, can provide users with the latest available devices in real time, and enhance the user experience.
  • the first device instructs the second device to delete the fifth control associated with the fifth device, thereby Make the second device delete the fifth control associated with the fifth device.
  • the first device instructs the second device to output the fifth control associated with the fifth device, so that the second device outputs the associated The fifth control of the fifth device.
  • the notification is the content of the message in the first application, where the third device is used to receive the content of the message and display a message reminder box, and the message reminds
  • the box includes the message content and the reply control; when the user's operation of replying to the message content is detected, the reply content is sent to the first device; the first device is also used for the message content according to the reply content Reply.
  • the third device may be a device with a keyboard (for example, a notebook computer).
  • the third device is further configured to receive instruction information, and the instruction information is used to instruct the third device to add the reply control.
  • the message content in the first application includes a first message content and a second message content
  • the third device is specifically configured to: The first message content identified by the first identification information and the second message content identified by the second identification information; in response to detecting the first reply content of the user's reply to the first message content and detecting the user's response
  • the second reply content replied to the second message content, the first reply content identified by the first identification information and the second reply content identified by the second identification information are sent to the first device;
  • the first A device is specifically configured to: reply to the first message content according to the first reply content identified by the first identification information, and to respond to the second reply content based on the second reply content identified by the second identification information Reply to the content of the message.
  • the third device receives the message identified by the identification information, so that when the third device obtains the user's reply content, it can use the identification information to identify the reply content, so that the first device clarifies the reply
  • the content is the reply content for which message.
  • the first device receives multiple messages, it helps to improve the accuracy of the first device's message reply.
  • the third device is a device that does not install the first application program.
  • the second device is specifically configured to: generate a prompt for executing the task corresponding to the notification in the third device according to the device information of the second device.
  • different second devices have different device information, and can present prompts in different ways to the user, which helps to improve the user's experience when viewing the prompts on the prompting device.
  • the device information includes that the second device has a display screen, and the second device is specifically configured to: when the second device detects that the user's input is being received , Display a first prompt window through the display screen without positioning the cursor on the first prompt window, the first prompt window includes prompt information, and the prompt information is used to prompt the execution of the task in the third device; or, When the second device detects that the user's input is not received, the first prompt window is displayed on the display screen and the cursor is positioned on the first prompt window.
  • the second device may not position the cursor on the first device. Prompt window, thus avoiding the trouble to the user's current operation, and improving the user's experience.
  • the second device is further configured to: when the second device detects that the user's input is being received, further display a prompt message on the display screen, the prompt The information is used to remind the user to locate the cursor to the first prompt window through the first operation.
  • the second device may also prompt the user to locate the cursor to the message reminder box through a preset operation. In this way, while avoiding trouble to the user's current operation, the user can quickly locate the first prompt window through the prompt information, which helps to improve the user experience.
  • the second device is further configured to: before generating a prompt for executing the notification corresponding task in the third device, determine that the second device is in a non-do not disturb Mode, or it is determined that the second device is not currently running a preset application.
  • an electronic device in a second aspect, includes: a processor, a memory, a display screen, and a communication module; the processor, the communication module, the display screen and the memory are coupled, and the memory is used to store a computer program Code, the computer program code includes a computer instruction, when the computer instruction is executed by the electronic device, the electronic device is caused to perform the following operations: receiving the first message sent by the first device; in response to receiving the first message, generating A prompt for the task corresponding to the notification is executed in the third device; in response to receiving the user's input corresponding to the prompt, a second message is sent to request the third device to perform the task corresponding to the notification.
  • a notification processing method includes: the second device receives the first message sent by the first device; the second device generates in the third device in response to receiving the first message Perform a prompt for the task corresponding to the notification; the second device sends a second message in response to receiving the user's input corresponding to the prompt to request the third device to perform the task corresponding to the notification.
  • the sending the second message includes sending the second message to the third device, and the second message includes the content of the task.
  • the sending the second message includes: sending the second message to the first device, so that the first device sends the second message to the first device according to the second message.
  • the three devices send a third message, and the third message includes the content of the task.
  • the first message includes description information of the task
  • the second device generates a prompt for executing the task corresponding to the notification in the third device, including: a response
  • a first prompt window is displayed.
  • the first prompt window includes a first control and description information of the task.
  • the first control is associated with the third device; Enter and send the second message.
  • the method includes: after sending the second message, displaying a second control; in response to receiving a user input for the second control, sending a fourth Message to request the third device to stop performing the task.
  • the method includes: after sending the second message, displaying a third control, the third control is associated with the fourth device; in response to receiving the user In response to the input of the third control, a fifth message is sent to request the third device to stop performing the task and to request the fourth device to perform the task.
  • the first prompt window further includes a fourth control
  • the fourth control is associated with one or more controls
  • each of the one or more controls The controls are respectively associated with an available device other than the third device; wherein, the method includes: after the first prompt window is displayed, when an input directed to the fourth control is detected, displaying the one or more controls.
  • the one or more controls include a fifth control, and the fifth control is associated with a fifth device; wherein, the method further includes: displaying the first After the prompt window, when the fifth device is no longer included in one or more devices within the communication range of the second device, the fifth control is deleted; the input for the fourth control is detected, and one or more Controls, the fifth control is not included in the one or more controls.
  • the notification is the content of the message in the first application
  • the method further includes: the second device sends instruction information to the third device, and the instruction information is used Instruct the third device to add a reply control to the content of the message.
  • the second device generates a prompt for executing the notification corresponding task in the third device, including: generating a notification in the third device according to the device information of the second device. A reminder to perform the task corresponding to the notification in the device.
  • the device information includes that the second device has a display screen, and the second device generates a prompt to execute the notification corresponding task in the third device, including: When the second device detects that it is receiving user input, it displays a first prompt window through the display screen and does not position the cursor on the first prompt window.
  • the first prompt window includes prompt information, and the prompt information is used for prompting Perform the task in the third device; or, when the second device detects that the user's input is not received, the first prompt window is displayed on the display screen and the cursor is positioned on the first prompt window.
  • the method further includes: when the second device detects that the user's input is being received, further displaying prompt information through the display screen, and the prompt information is used for The user is reminded to locate the cursor to the first prompt window through the first operation.
  • the method further includes: before generating a prompt for executing the notification corresponding task in the third device, determining that the second device is in a non-do not disturb mode, or To determine that the second device is not currently running the preset application.
  • an electronic device in a fourth aspect, includes: a processor, a memory, a display screen, a communication module, and a notification decision manager; the processor, the mobile communication module, the display screen and the memory are coupled, the The memory is used to store computer program code.
  • the computer program code includes computer instructions.
  • the electronic device When the computer instructions are executed by the electronic device, the electronic device performs the following operations: generating a notification; detecting devices within the communication range that can be used to prompt the notification , And detect devices within the communication range that can be used to perform the task corresponding to the notification; detect that the second device can be used to prompt the device of the notification, and the third device can be used to perform the task corresponding to the notification; send to the second device
  • the first message the first message includes notification information and third device information, the notification information is used to prompt the first device to generate the notification, and the third device information is used to generate the prompt on the second device.
  • a notification processing method includes: a first device obtains a notification; when the first device determines that the device focused by the owner of the first device is the second device, Send the first message so that the second device generates a prompt for executing the task corresponding to the notification on the third device.
  • the first device detects a device within the communication range that can be used to prompt the notification, and detects a device within the communication range that can be used to perform the task corresponding to the notification, and detects that the second device can be used for the notification.
  • the third device can be used to perform the task corresponding to the notification; the first device sends the first message to the second device, and the first message includes notification information and third device information.
  • the third device information is used to generate the prompt on the second device.
  • the method further includes: the first device receives a second message sent by the second device; in response to receiving the second message, the first device A third message is sent to the third device, where the third message includes the content of the task, so that the third device executes the task.
  • the method further includes: the first device receives a fourth message sent by the second device; in response to receiving the fourth message, the first device Send a fifth message to the third device, where the fifth message is used to instruct the third device to stop performing the task.
  • the method further includes: in response to receiving the fourth message, the first device sends a sixth message to the fourth device, the sixth message being Instruct the fourth device to perform the task.
  • the notification is the message content in the first application
  • the third message includes the message content
  • the method further includes: the first device receives the first device The content of the reply to the content of the message sent by the third device; the first device replies to the content of the message according to the content of the reply.
  • the method further includes: in response to receiving the second message, the first device sends instruction information to the third device, where the instruction information is used to indicate The third device adds a reply control to the content of the message.
  • the message content in the first application program includes the first message content and the second message content
  • the third message includes the content after being identified by the first identification information.
  • the first message content and the second message content after being identified by the second identification information; wherein the method further includes: receiving the first reply content after being identified by the first identification information and sent by the third device And the second response content identified by the second identification information; reply to the first message content according to the first response content identified by the first identification information, and the content identified according to the second identification information
  • the second reply content is a reply to the second message content.
  • an apparatus in a sixth aspect, includes: a receiving unit, configured to receive a first message sent by a first device; a generating unit, configured to generate a prompt for executing the notification corresponding task in a third device; and detecting The unit is used to receive the user's input corresponding to the prompt; the sending unit is used to send a second message in response to the input to request the third device to perform the task corresponding to the notification.
  • an apparatus in a seventh aspect, includes: an acquiring unit, configured to acquire notification; a detecting unit, configured to detect that the device currently focused by the owner of the first device is the second device; and a sending unit, configured to The first message is sent to the second device, so that the second device generates a prompt for executing the task corresponding to the notification on the third device.
  • an embodiment of the present application provides a computer storage medium, including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to execute the notification processing method in any one of the possible implementations of the foregoing aspects .
  • the present application provides a chip system, which is applied to electronic devices including memories, display screens, and sensors; the chip system includes: one or more interface circuits and one or more processors; interface circuits and processors Interconnected by wires; the interface circuit is used to receive signals from the memory and send signals to the processor, the signals include computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes any of the third aspect and the third aspect The notification processing method in a possible implementation manner; or, when the processor executes a computer instruction, the electronic device executes the notification processing method in any of the fifth aspect and any one of the possible implementation manners of the fifth aspect.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the notification processing method in any one of the possible implementations of the third aspect; or, when the computer When the program product runs on the computer, the computer executes the notification processing method in any one of the possible implementations of the fifth aspect.
  • an embodiment of the present application provides a task processing method, including: a first device obtains a first message, the first message includes task content and description information of the task content; the first device displays on a first interface The first prompt window, the first prompt window includes description information of the first control and the task content, the first control is associated with the second device; the first device receives the user's first input for the first control; in response to the first input, the first A device sends a first instruction to a second device, and the first instruction is used to instruct the second device to perform task content.
  • the first device obtains the first message.
  • the first message may be notification information provided by a third-party server, may be notification information provided by the system application of the first device, or may be derived from other electronic devices, such as other electronic devices that send messages to the first device.
  • One device shares the data content, and other electronic devices send a first message carrying the data content to the first device.
  • the first message includes information such as text content, task content, message source, etc.
  • the text content is used to briefly explain the first message
  • the task content includes data content, which is used to instruct to view the data content.
  • the first message can be called description information of the task content, such as text content, source of the message, and so on.
  • the first device determines available devices that support the execution of the task content of the first message from the peripheral devices.
  • a first prompt window is displayed on the first interface, and the first prompt window is used to prompt the user to select the device to perform task content.
  • the first prompt window includes the description information of the first control and the task content.
  • the first control indicates the second device.
  • the first device detects a user operation on the first control, the first device sends the task content to the second device.
  • the second device instructs the second device to perform task content.
  • the first device displays the description information of the task content, and the user selects the second device to execute the task content, thus realizing cross-device task processing.
  • the second device can be easily triggered to handle another task through the first prompt window, which improves the user experience.
  • the first device sends a first instruction to the second device, and then further includes: the first device displays the second control; the first device receives the user's first instruction for the second control Two inputs; in response to the second input, the first device sends a second instruction to the second device, and the second instruction is used to instruct the second device to stop executing the task content.
  • a stop control is provided.
  • the first device can output the stop control (second control), and the user controls the second device to stop executing the task content through the second control. Users can pause the device to perform tasks at any time, which improves user experience.
  • the first device sends a first instruction to the second device, and then further includes: the first device displays a third control, and the third control is associated with the third device; first The device receives the user's third input for the third control; in response to the third input, the first device sends a second instruction to the second device, the second instruction is used to instruct the second device to stop executing the task content; in response to the third input, The first device sends a third instruction to the third device, and the third instruction is used to instruct the third device to perform task content.
  • a switch control is provided.
  • the first device can output the switch control (third control), and the user controls the second device to stop executing the task content through the third control, and instructs Other devices perform task content.
  • the effect of real-time switching is realized, and the user can switch the device that executes the task content at any time, which improves the user experience.
  • the third device may restart the execution of the task content, and the third device may also continue the execution progress of the second device and continue to execute the task content.
  • the second device is performing task content and playing a certain video; at this time, the first device receives a user operation to switch the playback of the third device, and the first device instructs the second device to stop playing the video and at the same time instructs the third device Play the video, where the playback progress of the third device can be played from the beginning, or it can be continued from the progress where the second device has stopped playing.
  • the first interface is a lock screen interface; in response to the first input, the first device sends a first instruction to the second device, which specifically includes: in response to the first input, After the first device detects the unlocking operation for the lock screen interface and the unlocking is successful, the first device sends the first instruction to the second device.
  • the first message includes the task type of the task content, and before the first device displays the first prompt window on the first interface, it further includes: Device information of one or more devices within the communication range of the device; the first device determines one or more task types that support the execution of the task content based on the device information of one or more devices within the communication range of the first device Available device, the available device includes the second device.
  • the second device is a device within the communication range of the first device, and is a character-type device that supports the task content.
  • the task type can include video tasks, audio tasks, graphic tasks, etc., then the corresponding support Devices that perform video tasks need to have display and audio functions, devices that support audio tasks need to have audio functions, and devices that support graphics tasks need to have display functions, etc.
  • the first message includes a list of devices that support performing task content, and before the first device displays the first prompt window on the first interface, it further includes: the first device acquires the communication range of the first device The device information of one or more devices in the first device; based on the device list, the first device determines one or more available devices from the device information of one or more devices within the communication range of the first device, and the available devices include the first device Two equipment.
  • the list of devices that support task execution in the first message may be a list that includes device types.
  • the list of devices that support task execution is a computer or tablet
  • the list of devices that support task execution in the first message may be a list that includes device attributes.
  • the list of devices that support task content is devices with display and audio functions
  • the list of devices that support task content in the first device can be a list that includes specific device identifiers, each device identifier represents a device, etc. .
  • the method further includes: the first device determines the available device with the highest priority among the one or more available devices as the second device.
  • the only available device is selected by priority to provide users with the most suitable device for performing task content and reduce user selection operations.
  • the priority information may be set by the user, may be the system default of the first device, may be set by a third-party application, may be automatically determined by the first device according to device attributes, and so on.
  • the method further includes: the first device determining the available device with the smallest physical distance from the first device among the one or more available devices as the first device Two equipment. The only available device is selected based on the physical distance, so as to provide users with the most suitable device for performing tasks and reduce the user's selection operations.
  • the first prompt window further includes a fourth control, the fourth control is associated with one or more controls, and each of the one or more controls is associated with one Available devices other than the second device; after the first device displays the first prompt window on the first interface, it also includes: when the first device detects the fourth input for the fourth control, the first device displays one or Multiple controls.
  • a control for selecting a device list is provided. After the first device determines one or more available devices, the first device can output a control for selecting a device list (the fourth control), and the user can view the control through the fourth control. One or more available devices, and then autonomously select the device to perform the task content. The effect of independent selection is realized, and the user can select the device that executes the task content from multiple devices, which improves the user experience.
  • one or more controls include a fifth control, the fifth control is associated with the fifth device, and after the first device displays the first prompt window on the first interface, It also includes: when one or more devices within the communication range of the first device no longer include the fifth device, the first device deletes the fifth control; the first device detects the fourth input for the fourth control, and the first device detects the fourth input for the fourth control.
  • One device displays one or more controls, and the fifth control is not included in the one or more controls.
  • the controls in the first prompt window can be changed as the device status changes.
  • the fifth device is an available device, and the first device outputs the fifth control associated with the fifth device; at the second moment, the status of the fifth device changes (not within the communication range of the first device), then the first device Delete the fifth control associated with the fifth device.
  • the state of the fifth device changes again (within the communication range of the first device) at the third moment, the first device outputs the fifth control associated with the fifth device.
  • the way of changing the output control according to the device state improves the timeliness, can provide users with the latest available devices in real time, and enhance the user experience.
  • the second device and the first device are the same device.
  • the user can select the first device to perform the task content.
  • the first device and the second device log in to the same account or an associated account of the same account.
  • the first message includes: email notification information, video application notification information, instant messaging message notification information, and video call notification information.
  • the first device is a mobile phone or a watch
  • the second device is a computer or a tablet or a TV.
  • an embodiment of the present application provides an electronic device.
  • the electronic device may be a first device, including one or more processors, one or more memories, and a touch screen.
  • the one or more memories are coupled with one or more processors, and the one or more memories are used to store computer program codes.
  • the computer program codes include computer instructions.
  • the electronic device executes : Acquire the first message, the first message includes the task content and the description information of the task content; the first prompt window is displayed on the first interface, the first prompt window includes the first control and the description information of the task content, the first control and the first
  • the second device is associated; the user's first input for the first control is received; in response to the first input, the first instruction is sent to the second device, and the first instruction is used to instruct the second device to perform task content.
  • the electronic device obtains the first message.
  • the first message can be notification information provided by a third-party server, can be notification information provided by the system application of the electronic device, or can be from other electronic devices, for example, other electronic devices share with the electronic device
  • Data content another electronic device sends a first message carrying data content to the electronic device.
  • the first message includes information such as text content, task content, message source, etc.
  • the text content is used to briefly explain the first message
  • the task content includes data content, which is used to instruct to view the data content.
  • the first message can be called description information of the task content, such as text content, source of the message, and so on.
  • the electronic device determines from the peripheral devices available devices that support the execution of the task content of the first message.
  • a first prompt window is displayed on the first interface, and the first prompt window is used to prompt the user to select the device to perform task content.
  • the first prompt window includes the first control and description information of the task content.
  • the first control indicates the second device.
  • the electronic device detects a user operation on the first control, the electronic device sends the task content to the second device , Instruct the second device to perform the task content.
  • the electronic device displays the description information of the task content, and the user selects the second device to execute the task content, which realizes the task processing across devices.
  • the second device can be easily triggered to process another task through the first prompt window, which improves the user experience.
  • the electronic device after sending the first instruction to the second device, the electronic device further executes: displaying the second control; receiving the user's second input for the second control; responding to the second Input and send a second instruction to the second device.
  • the second instruction is used to instruct the second device to stop executing the task content.
  • a stop control is provided.
  • the electronic device can output the stop control (second control), and the user controls the second device to stop executing the task content through the second control. Users can pause the device to perform tasks at any time, which improves user experience.
  • the electronic device after sending the first instruction to the second device, the electronic device further executes: displaying a third control, the third control is associated with the third device; In response to the third input, send a second instruction to the second device, the second instruction is used to instruct the second device to stop executing task content; in response to the third input, send a third instruction to the third device, The three instructions are used to instruct the third device to perform task content.
  • a switch control is provided.
  • the electronic device can output the switch control (third control), and the user controls the second device to stop executing the task content through the third control, and instructs other The content of the task performed by the device.
  • the effect of real-time switching is realized, and the user can switch the device that executes the task content at any time, which improves the user experience.
  • the third device may restart the execution of the task content, and the third device may also continue the execution progress of the second device and continue to execute the task content.
  • the second device is performing task content and playing a certain video; at this time, the first device receives a user operation to switch the playback of the third device, and the first device instructs the second device to stop playing the video and at the same time instructs the third device Play the video, where the playback progress of the third device can be played from the beginning, or it can be continued from the progress where the second device has stopped playing.
  • the first interface is a lock screen interface; in response to the first input, the electronic device executes and sends the first instruction to the second device, which specifically includes: in response to the first input, When the unlocking operation for the lock screen interface is detected and the unlocking is successful, the first instruction is sent to the second device.
  • the first message includes the task type of the task content
  • the electronic device before the first prompt window is displayed on the first interface, the electronic device also executes: Get within the communication range of the electronic device The device information of one or more devices; based on the device information of one or more devices within the communication range of the electronic device, one or more available devices that support the task type to perform the task content are determined, and the available devices include the second device .
  • the second device is a device within the communication range of the electronic device and is a character-type device that supports the execution of task content.
  • the task type can include video tasks, audio tasks, graphic tasks, etc., then the corresponding execution is supported Devices for video tasks need to have display and audio functions, devices that support audio tasks need to have audio functions, and devices that support graphics tasks need to have display functions, etc.
  • the first message includes a list of devices that support the execution of the task content
  • the electronic device before the first prompt window is displayed on the first interface, the electronic device also executes: acquiring one or more devices within the communication range of the electronic device Device information of a device; based on the device list, one or more available devices are determined from the device information of one or more devices within the communication range of the electronic device, and the available devices include the second device.
  • the list of devices that support task execution in the first message may be a list that includes device types.
  • the list of devices that support task execution is a computer or tablet
  • the list of devices that support task execution in the first message may be a list that includes device attributes.
  • the list of devices that support task content is devices with display and audio functions
  • the list of devices that support task content in an electronic device may be a list that includes specific device identifiers, each device identifier represents a device, and so on.
  • the electronic device further executes: determining the available device with the highest priority among the one or more available devices as the second device.
  • the only available device is selected by priority to provide users with the most suitable device for performing task content and reduce user selection operations.
  • the priority information may be set by the user, may be the default of the electronic device's system, may be set by a third-party application, or may be automatically determined by the electronic device according to device attributes, and so on.
  • the electronic device further executes: determining the available device with the smallest physical distance from the first device among the one or more available devices as the second device .
  • the only available device is selected based on the physical distance, so as to provide users with the most suitable device for performing tasks and reduce the user's selection operations.
  • the first prompt window further includes a fourth control, the fourth control is associated with one or more controls, and each of the one or more controls is associated with one Available devices other than the second device; after displaying the first prompt window on the first interface, the electronic device further executes: when detecting a fourth input for the fourth control, display one or more controls.
  • a control for selecting a device list is provided. After the electronic device determines one or more available devices, the electronic device can output a control for selecting a device list (fourth control), and the user can view the one or more through the fourth control. Multiple available devices, and then independently select the device to perform the task content. The effect of independent selection is realized, and the user can select the device that executes the task content from multiple devices, which improves the user experience.
  • one or more controls include a fifth control
  • the fifth control is associated with the fifth device
  • the electronic device also Execution: When one or more devices within the communication range of the electronic device no longer include the fifth device, delete the fifth control; detect the fourth input for the fourth control, display one or more controls, one or The fifth control is not included in the plurality of controls.
  • the controls in the first prompt window can be changed as the device status changes.
  • the fifth device is an available device, and the electronic device outputs the fifth control associated with the fifth device; at the second moment, when the status of the fifth device changes (not within the communication range of the electronic device), the electronic device deletes the associated first The fifth control for five devices.
  • the state of the fifth device changes again (within the communication range of the electronic device) at the third moment, the electronic device outputs the fifth control associated with the fifth device.
  • the way of changing the output control according to the device state improves the timeliness, can provide users with the latest available devices in real time, and enhance the user experience.
  • the second device and the electronic device are the same device.
  • the user can select the electronic device to perform the task content.
  • the electronic device and the second device log in to the same account or an associated account of the same account.
  • the first message includes: email notification information, video application notification information, instant messaging message notification information, and video call notification information.
  • the electronic device is a mobile phone or a watch
  • the second device is a computer or a tablet or a TV.
  • an embodiment of the present application provides a task processing system, including a first device and a second device, where the first device is used to obtain a first message, and the first message includes task content and a description of the task content Information; the first device is also used to display a first prompt window on the first interface, the first prompt window includes description information of the first control and task content, the first control is associated with the second device; the first device is also used To receive a user's first input for the first control; the first device is also used to send a first instruction to the second device in response to the first input; the second device is used to execute a task based on the received first instruction content.
  • the first device obtains the first message.
  • the first message may be notification information provided by a third-party server, may be notification information provided by the system application of the first device, or may be derived from other electronic devices, such as other electronic devices that send messages to the first device.
  • One device shares the data content, and other electronic devices send a first message carrying the data content to the first device.
  • the first message includes information such as text content, task content, message source, etc.
  • the text content is used to briefly explain the first message
  • the task content includes data content, which is used to instruct to view the data content.
  • the first message can be called description information of the task content, such as text content, source of the message, and so on.
  • the first device determines available devices that support the execution of the task content of the first message from the peripheral devices.
  • a first prompt window is displayed on the first interface, and the first prompt window is used to prompt the user to select the device to perform task content.
  • the first prompt window includes the description information of the first control and the task content.
  • the first control indicates the second device.
  • the first device detects a user operation on the first control, the first device sends the task content to the second device.
  • the second device instructs the second device to perform task content.
  • the first device displays the description information of the task content, and the user selects the second device to execute the task content, realizing cross-device task processing.
  • the second device can be easily triggered to handle another task through the first prompt window, which improves the user experience.
  • the first device is further configured to: after sending the first instruction to the second device, display the second control; The first device is also used to send a second instruction to the second device in response to the second input; the second device is also used to stop executing the task content based on the received second instruction.
  • the system further includes a third device; the first device is also used to display the third control after sending the first instruction to the second device, the third control and the third Device association; the first device is also used to receive a user's third input for the third control; the first device is also used to send a second instruction to the second device in response to the third input; the second device is also used to Based on the received second instruction, stop executing the task content; the first device is also used to send a third instruction to the third device in response to the third input; the third device is used to execute the task content based on the third input .
  • the first interface is a lock screen interface; the first device is used to respond to the first input, when an unlocking operation for the lock screen interface is detected and the unlocking is successful , Send the first command to the second device.
  • the first message includes the task type of the task content; the first device is also used to obtain information on the first device before displaying the first prompt window on the first interface. Device information of one or more devices within the communication range; the first device is also used to determine one or more task types that support the execution of the task content based on the device information of one or more devices within the communication range of the first device Multiple available devices, and the available devices include the second device.
  • the first message includes a list of devices that support the execution of the task content; the first device is also used to obtain information on the first prompt window before displaying the first prompt window on the first interface.
  • Device information of one or more devices within the communication range of the device the first device is also used to determine one or more device information from the device information of one or more devices within the communication range of the first device based on the device list
  • One available device, the available device includes the second device.
  • the first device is further configured to determine the available device with the highest priority among the one or more available devices as the second device.
  • the first device is further configured to determine the available device with the smallest physical distance from the first device among the one or more available devices as the second device.
  • the first prompt window further includes a fourth control, the fourth control is associated with one or more controls, and each of the one or more controls is associated with one Available devices other than the second device; the first device is also used to display one or more controls when the fourth input for the fourth control is detected after the first prompt window is displayed on the first interface.
  • one or more controls include a fifth control, and the fifth control is associated with the fifth device; the first device is also used to display the first control on the first interface. After the prompt window, when one or more devices within the communication range of the first device no longer include the fifth device, delete the fifth control; the first device is also used to detect the fourth input for the fourth control , Display one or more controls, one or more controls do not include the fifth control.
  • the second device and the first device are the same device.
  • the first device and the second device log in to the same account or an associated account of the same account.
  • the first message includes: email notification information, video application notification information, instant messaging message notification information, and video call notification information.
  • the first device is a mobile phone or a watch
  • the second device is a computer or a tablet or a TV.
  • an embodiment of the present application provides a computer storage medium, including computer instructions.
  • the computer instructions run on an electronic device, the electronic device executes any of the eleventh and eleventh aspects described above.
  • the method of task processing in the realization mode is any of the eleventh and eleventh aspects described above.
  • this application provides a chip system, which is applied to electronic devices including memories, display screens, and sensors; the chip system includes: one or more interface circuits and one or more processors; interface circuits and processing The interface circuit is used to receive signals from the memory and send signals to the processor.
  • the signals include computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes the eleventh and eleventh aspects.
  • the task processing method in any possible implementation.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to perform the tasks in the eleventh aspect and any one of the possible implementations of the eleventh aspect. Processing method.
  • an apparatus configured to obtain a first message, the first message including task content and description information of the task content; a display unit, configured to display the first message on the first interface A prompt window, the first prompt window includes description information of the first control and task content, the first control is associated with the second device; the detection unit is used to receive the user's first input for the first control; the sending unit is used to respond In the first input, the first instruction is sent to the second device, and the first instruction is used to instruct the second device to execute the task content.
  • a system includes a first electronic device and a second electronic device.
  • the first electronic device is configured to receive messages; and the first electronic device is also configured to determine When the device focused by the owner of the device is the second electronic device, the message and instruction information are sent to the second electronic device, and the instruction information is used to instruct the second electronic device to add a reply control to the message; the second The electronic device is used to display a message reminder box, the message reminder box includes the message and the reply control; the second electronic device is also used to detect the user's operation to reply to the message, to the first electronic The device sends reply content; the first electronic device is also used to reply to the message according to the reply content.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and instruction information to the second electronic device , So that the second electronic device can present a message reminder box including the message and a reply control to the user. This can facilitate the owner of the first electronic device to complete the virtual reply to the message on the second electronic device.
  • the second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to timely receive the message reminder and complete the reply to the message, avoid the process of the user returning to the first electronic device to reply to the message, and also avoid the user from missing important messages.
  • the second electronic device may be a device in the device list of the first electronic device; or, the second electronic device may also be a device surrounding the first electronic device.
  • the first electronic device is specifically configured to respond to the message according to the reply content and the API provided by the application corresponding to the message; or, according to the reply content and the drag event, Reply to the message.
  • the indication information may be a quick reply flag attribute.
  • the first electronic device is specifically configured to: send the message identified by the identification information to the second electronic device; and the second electronic device specifically uses Yu: Send the reply content identified by the identification information to the first electronic device.
  • the first electronic device can send a message identified by the identification information to the second electronic device, so that the second electronic device can use the identification information to identify the message when acquiring the user's reply content, so that The first electronic device clarifies to which message the reply content is the reply content.
  • the first electronic device receives multiple messages, it helps to improve the accuracy of the first electronic device's response to the message.
  • the identification information may be a notification ID attribute and/or a notification channel attribute.
  • the first electronic device is further configured to display a first interface before receiving the message; after replying to the message, display the first interface interface.
  • the first electronic device can return to the display interface before receiving the message after completing the real reply to the message, so that the real reply process of the first electronic device to the message is insensitive to the user, which helps to improve the user Experience.
  • the content of the message is text information
  • the second electronic device includes a voice function
  • the second electronic device is further configured to: after receiving the message , To prompt the user the text information by voice.
  • the second electronic device may prompt the user to receive the message through voice or prompt The content of the user's message. In this way, it is avoided that the user can learn the prompt of the message through the voice prompt by viewing the screen of the second electronic device, and prevents the user from missing important messages, thereby improving the user experience.
  • the second electronic device is a car machine or a smart speaker.
  • the second electronic device is specifically configured to: before sending the reply content to the first electronic device, collect the user's reply voice information; An electronic device sends the voice information, or sends text information corresponding to the voice signal to the first electronic device.
  • the first electronic device can reply to the message with the voice information, or can also reply to the message with the corresponding voice information. Text information.
  • the reply content includes a file.
  • the user can reply to multimedia files (such as pictures, videos), work files (such as word documents or excel documents, etc.) on the second electronic device, which helps increase the diversity of the user's reply content , which helps to improve the user’s experience when replying to a message.
  • multimedia files such as pictures, videos
  • work files such as word documents or excel documents, etc.
  • the first electronic device is further configured to: before sending the message and the instruction information to the second electronic device, determine that the type of the message is user The set message type; or, before sending the message and the instruction information to the second electronic device, it is determined that the message is an instant messaging IM type message.
  • the first electronic device before the first electronic device forwards the message to the second electronic device, it may first determine that the message is the message type set by the user or is an IM type message, which helps prevent some unimportant messages from being forwarded to the first electronic device. Second, electronic equipment, thereby avoiding the interference caused by these unimportant messages to the user, and helping to improve the user's experience.
  • the first electronic device is further configured to: before sending the message and the instruction information to the second electronic device, determine that the second electronic device is A device set by the user to receive message forwarding; or before sending the message and the instruction information to the second electronic device, it is determined that the account logged in on the first electronic device is associated with the account logged in on the second electronic device.
  • the first electronic device may first determine the device set by the second electronic device for the user to receive message forwarding or determine the account logged in on the first electronic device and the second electronic device.
  • the accounts logged in on the device are associated with each other, which helps prevent messages from being forwarded to unauthorized devices by the user, improves the security of message forwarding, and avoids leakage of user privacy, thereby helping to improve user experience.
  • the first electronic device is specifically configured to: when it is determined that the device currently focused by the owner of the first electronic device is not the first electronic device, The second electronic device sends request information, and the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device is also used to request information according to the request information , Sending response information to the first electronic device, where the response information is used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device; the first electronic device is specifically used to: respond to receiving the In response to the information, the message is sent to the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect user characteristics and match them with the user characteristics preset in the second electronic device. If the matching is successful, determine the first The device currently focused by the owner of the electronic device is the second electronic device, so that the response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • the second electronic device may first determine whether the first electronic device and the second electronic device are devices under the same account. If the second electronic device determines that the first electronic device and the second electronic device are devices under the same account, the second electronic device can collect the feature information of the user focusing on the second electronic device through the user feature collection device, and the collected information The user characteristic information matches the user characteristic information preset in the second electronic device, and if the matching is successful, the response information is sent to the first electronic device.
  • the second electronic device includes a user feature collection device
  • the first electronic device is specifically configured to: determine the current focus of the owner of the first electronic device When the device of is not the first electronic device, send request information to the second electronic device, the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device;
  • the second electronic device is also used to: collect user characteristics through the user characteristics collection device according to the request information and send the user characteristics to the first electronic device; the first electronic device is specifically used to: send to the second electronic device Before the message, it is determined that the user characteristic matches the user characteristic preset in the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can store information of different users); or, the second electronic device can also be a device around the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collection device and send the feature information to the first electronic device.
  • the first electronic device matches the user characteristic information preset in the first electronic device according to the characteristic information, and if the matching succeeds, forwards the message to the second electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • the message is a message of the first application
  • the second electronic device is a device that does not have the first application installed.
  • the second electronic device may also add a reply control in the message reminder box after receiving the instruction information, so that the second electronic device
  • the device may obtain the user's reply content through the reply content input by the user and the detected operation of clicking the reply control, and send the reply content to the first electronic device.
  • the real reply to the message is completed on the first electronic device. This helps the user to receive the message reminder in time and avoids the user from missing important messages, thereby helping to improve the user's experience.
  • a method for replying to a message is provided.
  • the method is applied to a first electronic device.
  • the method includes: the first electronic device receives the message; In the case of the second electronic device, the first electronic device sends the message and instruction information to the second electronic device.
  • the instruction information is used to instruct the second electronic device to add a reply control to the message; the first electronic device receives the first electronic device. 2.
  • the reply content to the message sent by the electronic device; the first electronic device replies to the message according to the reply content.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and instruction information to the second electronic device , So that the second electronic device can present a message reminder box including the message and a reply control to the user. This can facilitate the owner of the first electronic device to complete the virtual reply to the message on the second electronic device.
  • the second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to receive the message reminder in time and complete the reply to the message, avoid the process of the user returning to the first electronic device to reply to the message, and avoid the user from missing important messages.
  • the first electronic device sending the message to the second electronic device includes: the first electronic device sends the passing identification information to the second electronic device The identified message; wherein the first electronic device receives the reply content to the message sent by the second electronic device, including: the first electronic device receives the message identified by the identification information sent by the second electronic device The content of the reply.
  • the first electronic device can send a message identified by the identification information to the second electronic device, so that the second electronic device can use the identification information to identify the message when acquiring the user's reply content, so that The first electronic device clarifies to which message the reply content is the reply content.
  • the first electronic device receives multiple messages, it helps to improve the accuracy of the first electronic device's response to the message.
  • the identification information may be a notification ID attribute and/or a notification channel attribute.
  • the method further includes: before receiving the message, the first electronic device displays a first interface; after replying to the message, the first electronic device The electronic device displays the first interface.
  • the first electronic device can return to the display interface before receiving the message after completing the real reply to the message, so that the real reply process of the first electronic device to the message is insensitive to the user, which helps to improve the user Experience.
  • the reply content is voice information, or the reply content is text information corresponding to the voice information; wherein, the voice information is collected by the second electronic device Voice messages replied by users.
  • the second electronic device may prompt the user to receive the message through voice or prompt The content of the user's message. This prevents the user from being able to learn the prompt of the message through the voice prompt by viewing the screen of the second electronic device, and prevents the user from missing important messages, thereby improving the user experience.
  • the second electronic device is a car machine or a smart speaker.
  • the reply content is a file.
  • the user can reply to multimedia files (such as pictures, videos), work files (such as word documents or excel documents, etc.) on the second electronic device, which helps increase the diversity of user reply content , which helps to improve the user’s experience when replying to a message.
  • multimedia files such as pictures, videos
  • work files such as word documents or excel documents, etc.
  • the method further includes: before sending the message and the instruction information to the second electronic device, the first electronic device determines that the type of the message is The message type set by the user; or, before sending the message and the instruction information to the second electronic device, the first electronic device determines that the message is an IM message.
  • the first electronic device before the first electronic device forwards the message to the second electronic device, it may first determine that the message is the message type set by the user or is an IM type message, which helps prevent some unimportant messages from being forwarded to the first electronic device. Second, electronic equipment, thereby avoiding the interference caused by these unimportant messages to the user, and helping to improve the user's experience.
  • the method further includes: before sending the message and the instruction information to the second electronic device, the first electronic device determines that the second electronic device A device set for the user to receive message forwarding; or before sending the message and the instruction information to the second electronic device, the first electronic device determines the account logged in on the first electronic device and the log in on the second electronic device Is associated with the account.
  • the first electronic device may first determine the device set by the second electronic device for the user to receive message forwarding or determine the account logged in on the first electronic device and the second electronic device.
  • the accounts logged in on the device are associated with each other, which helps prevent messages from being forwarded to unauthorized devices by the user, improves the security of message forwarding, and avoids leakage of user privacy, thereby helping to improve user experience.
  • the method before the first electronic device sends the message and the instruction information to the second electronic device, the method further includes: the first electronic device determines that the When the device currently focused by the owner of the first electronic device is not the first electronic device, send request information to the second electronic device, and the request information is used to request the second electronic device to determine whether the owner of the first electronic device Focus the second electronic device; the first electronic device receives response information sent by the second electronic device, and the response information is used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect user characteristics and match them with the user characteristics preset in the second electronic device. If the matching is successful, determine the first The device currently focused by the owner of the electronic device is the second electronic device, so that the response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • the second electronic device may first determine whether the first electronic device and the second electronic device are devices under the same account. If the second electronic device determines that the first electronic device and the second electronic device are devices under the same account, the second electronic device can collect the feature information of the user focusing on the second electronic device through the user feature collection device, and the collected information The user characteristic information matches the user characteristic information preset in the second electronic device, and if the matching is successful, the response information is sent to the first electronic device.
  • the second electronic device includes a user feature collection device, and before the first electronic device sends the message and instruction information to the second electronic device, the method It also includes: when the first electronic device determines that the device currently focused by the owner of the first electronic device is not the first electronic device, sending request information to the second electronic device, the request information being used to request the second electronic device The device determines whether the owner of the first electronic device focuses on the second electronic device; the first electronic device receives the user feature sent by the second electronic device, and the user feature is collected by the second electronic device through the user feature collection device The user characteristics; the first electronic device determines that the user characteristics match the user characteristics preset in the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can store different user information); or, the second electronic device can also be a device surrounding the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collection device and send the feature information to the first electronic device.
  • the first electronic device matches the user characteristic information preset in the first electronic device according to the characteristic information, and if the matching succeeds, forwards the message to the second electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • a method for replying to a message is provided, the method is applied to a second electronic device, and the method includes: the second electronic device receives a message and instruction information sent by the first electronic device, and the instruction information is used to indicate The second electronic device adds a reply control to the message; the second electronic device displays a message reminder box, and the message reminder box includes the message and the reply control; when it detects that the user has responded to the message, the The second electronic device sends the reply content to the first electronic device.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and instruction information to the second electronic device , So that the second electronic device can present a message reminder box including the message and a reply control to the user. This can facilitate the owner of the first electronic device to complete the virtual reply to the message on the second electronic device.
  • the second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to receive the message reminder in time and complete the reply to the message, avoid the user from returning to the first electronic device to reply to the message, and also prevent the user from missing important messages.
  • the method further includes: the second electronic device receiving the message identified by the identification information sent by the first electronic device; wherein the second electronic device The electronic device sending response content to the first electronic device includes: the second electronic device sending the response content after the identification information to the first electronic device.
  • the first electronic device can send a message identified by the identification information to the second electronic device, so that the second electronic device can use the identification information to identify the message when acquiring the user's reply content, so that The first electronic device clarifies to which message the reply content is the reply content.
  • the first electronic device receives multiple messages, it helps to improve the accuracy of the first electronic device's response to the message.
  • the identification information may be a notification ID attribute and/or a notification channel attribute.
  • the content of the message is text information
  • the second electronic device includes a voice function
  • the method further includes: after receiving the message, the second electronic device Prompt the text information to the user by voice.
  • the second electronic device may prompt the user to receive the message through voice or prompt The content of the user's message. In this way, it is avoided that the user can learn the prompt of the message through the voice prompt by viewing the screen of the second electronic device, and prevents the user from missing important messages, thereby improving the user experience.
  • the second electronic device is a car machine or a smart speaker.
  • the second electronic device sending reply content to the first electronic device includes: the second electronic device collects the voice information of the user's reply; the second electronic device The electronic device sends the voice information to the first electronic device, or text information corresponding to the voice signal to the first electronic device.
  • the first electronic device can reply to the message with the voice information, or can also reply to the message with the corresponding voice information. Text information.
  • the reply content includes a file.
  • the user can reply to multimedia files (such as pictures, videos), work files (such as word documents or excel documents, etc.) on the second electronic device, which helps increase the diversity of user reply content , which helps to improve the user’s experience when replying to a message.
  • multimedia files such as pictures, videos
  • work files such as word documents or excel documents, etc.
  • the method before the second electronic device receives the message and instruction information sent by the first electronic device, the method further includes: the second electronic device receives the first The request information sent by the electronic device, the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device sends the request to the first electronic device according to the request information The device sends response information, where the response information is used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect user characteristics and match them with the user characteristics preset in the second electronic device. If the matching is successful, determine the first The device currently focused by the owner of the electronic device is the second electronic device, so that the response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • the second electronic device includes a user feature collection device, and before the second electronic device receives the message and instruction information sent by the first electronic device, the method further The method includes: the second electronic device receives request information sent by the first electronic device, the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device According to the request information, the device collects user characteristics through the user characteristic collection device and sends the user characteristics to the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can store information of different users); or, the second electronic device can also be a device around the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collection device and send the feature information to the first electronic device.
  • the first electronic device matches the user characteristic information preset in the first electronic device according to the characteristic information, and if the matching succeeds, forwards the message to the second electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • the message is a message of the first application
  • the second electronic device is a device that does not have the first application installed.
  • the second electronic device may also add a reply control in the message reminder box after receiving the instruction information, so that the second electronic device
  • the device may obtain the user's reply content through the reply content input by the user and the detected operation of clicking the reply control, and send the reply content to the first electronic device.
  • the real reply to the message is completed on the first electronic device. This helps the user to receive the message reminder in time and complete the reply to the message, avoiding the user from missing important messages, thereby helping to improve the user experience.
  • a device for replying to a message is provided, the device for replying to a message is set in a first electronic device, and the device includes: a first receiving unit for receiving a message; a sending unit for determining the first electronic device When the device focused by the owner of an electronic device is a second electronic device, send the message and instruction information to the second electronic device, where the instruction information is used to instruct the second electronic device to add a reply control to the message; second The receiving unit is configured to receive the reply content to the message sent by the second electronic device; the reply unit is configured to reply to the message according to the reply content.
  • a device for replying to a message is provided.
  • the device for replying to a message is set in a second electronic device.
  • the device includes a receiving unit for receiving a message and instruction information sent by the first electronic device. The information is used to instruct the second electronic device to add a reply control to the message; the display unit is used to display a message reminder box that includes the message and the reply control; the sending unit is used to detect the user’s response When a reply operation is performed on the message, the reply content is sent to the first electronic device.
  • an electronic device including: one or more processors; a memory; and one or more computer programs.
  • one or more computer programs are stored in the memory, and the one or more computer programs include instructions.
  • the electronic device is caused to execute the method for replying to a message in any one of the possible implementations of the nineteenth aspect.
  • an electronic device including: one or more processors; a memory; and one or more computer programs.
  • one or more computer programs are stored in the memory, and the one or more computer programs include instructions.
  • the electronic device is caused to execute the method for replying to a message in any possible implementation of the above-mentioned twentieth aspect.
  • a computer program product containing instructions which when the computer program product runs on a first electronic device, causes the first electronic device to execute the reply message described in the nineteenth aspect above ⁇ ; Or, when the computer program product is running on a second electronic device, the second electronic device is caused to execute the method for replying to a message as described in the twentieth aspect.
  • a computer-readable storage medium including instructions, which, when the instructions run on a first electronic device, cause the first electronic device to execute the reply message as described in the nineteenth aspect. ⁇ ; Or, when the instruction is executed on a second electronic device, the second electronic device is caused to execute the method for replying to a message as described in the twentieth aspect.
  • a chip for executing instructions.
  • the chip executes the method for replying to the message in the nineteenth aspect; or, when the chip is running, The chip executes the method for replying to the message described in the twentieth aspect.
  • a system including a first electronic device and a second electronic device, wherein the first electronic device is used for receiving messages; the first electronic device is also used for determining the first electronic device When the device focused by the owner of an electronic device is the second electronic device, the message is sent to the second electronic device; the second electronic device is used to prompt the user of the message according to the device information of the second electronic device.
  • the first electronic device when the first electronic device determines that the device focused by the user is not the first electronic device but the second electronic device, the first electronic device may forward the message to the second electronic device, and the second electronic device may The device information of the second electronic device prompts the user of the message, which helps the user to receive the reminder of the message in time and prevents the user from missing important messages; at the same time, different second electronic devices have different device information, which can be presented to the user Reminders in different ways help to improve the user experience when receiving messages.
  • the device information of the second electronic device may include, but is not limited to: hardware capability information of the second electronic device (for example, the second electronic device is a large-screen device or a second electronic device). Second, the electronic device is a car machine), the current state of the device (for example, whether the device is currently interacting with the user, or whether the device is in an immersive state), and so on.
  • hardware capability information of the second electronic device for example, the second electronic device is a large-screen device or a second electronic device.
  • the electronic device is a car machine
  • the current state of the device for example, whether the device is currently interacting with the user, or whether the device is in an immersive state
  • the second electronic device may be a device in the device list of the first electronic device; or, the second electronic device may also be a device surrounding the first electronic device.
  • the device information includes that the second electronic device has a display screen, and the second electronic device is specifically configured to: The screen displays a message reminder box, the message reminder box includes the message and the message reminder box does not include controls.
  • the second electronic device may not display controls when prompting the user with the message.
  • the user can use the notification center of the second electronic device when he wants to reply to the message. In this way, it helps users to receive message reminders in a timely manner, and prevents users from missing important messages, thereby improving user experience.
  • the device information includes that the second electronic device has a display screen, and the second electronic device is specifically configured to: When receiving user input, display a message reminder box through the display screen without positioning the cursor on the message reminder box, the message reminder box includes the message; or, the second electronic device detects that the user's input is not received When the time, the reminder box is displayed on the display screen and the cursor is positioned on the message reminder box.
  • the second electronic device may not position the cursor in the message reminder box, thereby avoiding troubles to the user's current operation and improving the user's experience.
  • the second electronic device is further configured to: when the second electronic device detects that the user's input is being received, display on the display screen Prompt information, the prompt information is used to remind the user to locate the cursor to the message reminder box through the first operation.
  • the second electronic device if the second electronic device is receiving the user's input (or the second electronic device is interacting with the user) while the second electronic device receives the message forwarded by the first electronic device, then the second electronic device It can also prompt the user to locate the cursor to the message reminder box through a preset operation. In this way, while avoiding trouble to the user's current operation, the user can quickly locate the message reminder box through the prompt information, thereby facilitating the user to reply to the message, and helping to improve the user experience.
  • the prompt information is used to remind the user to position the cursor to the message reminder box through the first operation, including: the prompt information is used to remind the user to position the cursor to the message reminder through the first operation Reply control in the box.
  • the device information includes that the second electronic device has a voice function, and the second electronic device is specifically configured to: remind the user to receive the message by voice ; Or, remind the user of the content of the message by voice.
  • the second electronic device may prompt the user to receive the message through voice or prompt The content of the user's message. In this way, it is avoided that the user can learn the prompt of the message through the voice prompt by viewing the screen of the second electronic device, and prevents the user from missing important messages, thereby improving the user experience.
  • the second electronic device is a car machine or a smart speaker.
  • the first electronic device is further used to send instruction information to the second electronic device, and the instruction information is used to instruct the second electronic device to add A reply control for the message;
  • the second electronic device is specifically used to display a message reminder box based on the device information and the instruction information, the message reminder box including the message and the reply control;
  • the second electronic device is also used for When the user's operation of replying to the message is detected, the reply content is sent to the first electronic device; the first electronic device is also used to reply to the message according to the reply content.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and instruction information to the second electronic device , So that the second electronic device can present a message reminder box including the message and a reply control to the user. This can facilitate the owner of the first electronic device to complete the virtual reply to the message on the second electronic device.
  • the second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to timely receive the message reminder and complete the reply to the message, avoid the process of the user returning to the first electronic device to reply to the message, and also avoid the user from missing important messages.
  • the second electronic device is a large-screen device, and when the second electronic device receives the instruction information, if the second electronic device is receiving user input, the second electronic device may display a message reminder Box and position the cursor on the reply control in the message reminder box; if the second electronic device does not receive the user’s input when the second electronic device receives the instruction information, the second electronic device can display the message reminder box without changing The cursor is positioned on the reply control in the message reminder box.
  • the message is a message of the first application
  • the second electronic device is a device that does not have the first application installed.
  • the second electronic device may also add a reply control in the message reminder box after receiving the instruction information, so that the second electronic device
  • the device may obtain the user's reply content through the reply content input by the user and the detected operation of clicking the reply control, and send the reply content to the first electronic device.
  • the real reply to the message is completed on the first electronic device. This helps the user to receive the message reminder in time, and prevents the user from missing important messages, thereby helping to improve the user's experience.
  • the device information includes that the second electronic device has a camera, and the second electronic device is further used to: When only the owner of the first electronic device focuses on the second electronic device, the content of the message is prompted; or, when the second electronic device detects multiple devices including the owner of the first electronic device through a camera, When a user focuses on the second electronic device, it is prompted to receive the message.
  • the second electronic device for a second electronic device with a camera, if the second electronic device detects through the camera that only the owner of the first electronic device is focusing on the second electronic device, the second electronic device can prompt the user to The content of the message; if multiple users, including the owner of the first electronic device, focus on the second electronic device, the second electronic device can prompt the user that a message has been received. This helps to avoid leakage of user privacy, ensures the security of message forwarding, and improves user experience.
  • the second electronic device is further configured to: before prompting the user with the message, determine that the second electronic device is in a non-do not disturb mode, or , It is determined that the second electronic device is not currently running the preset application program.
  • the second electronic device may first determine that it is in a non-immersed state before prompting the user with the message.
  • the immersive state can also be understood as a notification prohibited state.
  • the immersive state can be that the user disables notifications or turns on the do not disturb mode, or the immersive state can also be that the application running in the foreground of the second electronic device is a preset application (for example, Video App or Game App). This helps to avoid causing interference to the user, thereby helping to improve the user's experience.
  • the first electronic device is further configured to: before sending the message to the second electronic device, determine that the type of the message is set by the user Message type; or, before sending the message to the second electronic device, determine that the message is an IM message.
  • the first electronic device before the first electronic device forwards the message to the second electronic device, it may first determine that the message is the message type set by the user or is an IM type message, which helps prevent some unimportant messages from being forwarded to the first electronic device. Second, electronic equipment, thereby avoiding the interference caused by these unimportant messages to the user, and helping to improve the user's experience.
  • the first electronic device is further configured to: before sending the message to the second electronic device, determine that the second electronic device is the user setting The device that receives the message forwarding; or before sending the message to the second electronic device, it is determined that the account logged in on the first electronic device is associated with the account logged in on the second electronic device.
  • the first electronic device may first determine the device set by the second electronic device for the user to receive message forwarding or determine the account logged in on the first electronic device and the second electronic device.
  • the accounts logged in on the device are associated with each other, which helps prevent messages from being forwarded to unauthorized devices by the user, improves the security of message forwarding, and avoids leakage of user privacy, thereby helping to improve user experience.
  • the first electronic device is specifically configured to: when it is determined that the device currently focused by the owner of the first electronic device is not the first electronic device , Sending request information to the second electronic device, the request information being used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device is also used to request the second electronic device Information, sending response information to the first electronic device, the response information being used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device; the first electronic device is specifically used to: respond to receiving The response information sends the message to the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect user characteristics and match with the characteristics of the owner of the first electronic device preset in the second electronic device. If the matching is successful, it is determined that the device currently focused by the owner of the first electronic device is the second electronic device, and the response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • the second electronic device may first determine whether the first electronic device and the second electronic device are devices under the same account. If the second electronic device determines that the first electronic device and the second electronic device are devices under the same account, the second electronic device can collect the feature information of the user focusing on the second electronic device through the user feature collection device, and the collected information The user characteristic information matches the characteristic information of the owner of the first electronic device preset in the second electronic device, and if the matching is successful, the response information is sent to the first electronic device.
  • the second electronic device includes a user feature collection device
  • the first electronic device is specifically configured to: determine the owner of the first electronic device When the currently focused device is not the first electronic device, sending request information to the second electronic device, the request information being used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device;
  • the second electronic device is further used to: collect user characteristics through the user characteristics collection device according to the request information and send the user characteristics to the first electronic device;
  • the first electronic device is specifically used to: send the user characteristics to the second electronic device Before sending the notification message, it is determined that the user characteristic matches the preset user characteristic in the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or the first electronic device and the second electronic device).
  • the electronic device may store information of different users); or, the second electronic device may also be a device surrounding the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collection device and send the feature information to the first electronic device.
  • the first electronic device matches the user characteristic information preset in the first electronic device according to the characteristic information, and if the matching succeeds, forwards the message to the second electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of the first electronic device from receiving the message prompt, thereby helping to improve the user experience.
  • a method for prompting a message is provided, the method is applied to an electronic device, and the method includes: the electronic device receives a message sent by another electronic device, and the message is obtained by the other electronic device from a server The message; the electronic device prompts the user of the message according to the device information of the electronic device.
  • the first electronic device when the first electronic device determines that the device focused by the user is not the first electronic device but the second electronic device, the first electronic device may forward the message to the second electronic device, and the second electronic device may The device information of the second electronic device prompts the user of the message, which helps the user to receive the reminder of the message in time and prevents the user from missing important messages; at the same time, different second electronic devices have different device information, which can be presented to the user Reminders in different ways help to improve the user experience when receiving messages.
  • the device information of the second electronic device may include, but is not limited to: the hardware capability information of the second electronic device (for example, the second electronic device is a large-screen device or a second electronic device). Second, the electronic device is a car machine), the current state of the device (for example, whether the device is currently interacting with the user, or whether the device is in an immersive state), and so on.
  • the device information includes that the electronic device has a display screen, and the electronic device prompts the user with the message according to the device information of the electronic device, including: A message reminder box is displayed through the display screen, the message reminder box includes the message and the message reminder box does not include controls.
  • the electronic device may not display controls when prompting the user with the message, and the user can check it in the notification center of the electronic device when he wants to reply to the message, which is helpful
  • the user receives the message reminder in time to prevent the user from missing important messages, thereby improving the user experience.
  • the device information includes that the electronic device has a display screen, and the electronic device prompts the user with the message according to the device information of the electronic device, including: When the electronic device detects that the user’s input is being received, a message reminder box is displayed on the display screen and the cursor is not positioned on the message reminder box.
  • the message reminder box includes the message; or, the electronic device detects no When receiving the user's input, the message reminder box is displayed on the display screen and the cursor is positioned on the message reminder box.
  • the electronic device may not position the cursor in the message reminder box, thereby avoiding confusion to the user's current operation and improving the user's experience.
  • the method further includes: when the electronic device detects that the user's input is being received, displaying prompt information on the display screen, and the prompt information is used To remind the user to locate the cursor to the message reminder box through the first operation.
  • the electronic device may also prompt the user to pre- Set the cursor to the message reminder box. In this way, while avoiding trouble to the user's current operation, the user can quickly locate the message reminder box through the prompt information, thereby facilitating the user to reply to the message, and helping to improve the user experience.
  • the prompt information is used to remind the user to position the cursor to the message reminder box through the first operation, including: the prompt information is used to remind the user to position the cursor to the message reminder through the first operation Reply control in the box.
  • the device information includes that the electronic device has a voice function, and the electronic device prompts the user with the message according to the device information of the electronic device, including: The electronic device voice reminds the user that the message is received; or, the electronic device voice reminds the user of the content of the message.
  • the electronic device may prompt the user to receive the message or the content of the message through voice. In this way, it is avoided that the user can learn the prompt of the message through the voice prompt by viewing the screen of the electronic device, and prevents the user from missing important messages, thereby improving the user experience.
  • the electronic device is a car machine or a smart speaker.
  • the method before the electronic device prompts the user of the message, the method further includes: the electronic device receives the instruction information sent by the other electronic device, the The instruction information is used to instruct the electronic device to add a reply control to the message; the electronic device prompts the user of the message according to the device information, including: the electronic device displays a message reminder box according to the device information and the instruction information, the The message reminder box includes the message and the reply control; after the electronic device prompts the user of the message, the method further includes: upon detecting the user's reply to the message, sending the reply content to the other electronic device.
  • the electronic device may present a message reminder box including the message and a reply control to the user according to the device information of the electronic device and the instruction information.
  • the electronic device can send the reply content to another electronic device, so that the other electronic device completes a true reply to the message. This helps the user to timely receive the message reminder and complete the reply to the message, avoid the process of the user returning to another electronic device to reply to the message, and also avoid the user from missing important messages.
  • the message is a message of the first application
  • the electronic device is a device that does not have the first application installed.
  • the second electronic device may also add a reply control in the message reminder box after receiving the instruction information, so that the second electronic device
  • the device may obtain the user's reply content through the reply content input by the user and the detected operation of clicking the reply control, and send the reply content to the first electronic device.
  • the real reply to the message is completed on the first electronic device. This helps the user to receive the message reminder in time, and prevents the user from missing important messages, thereby helping to improve the user's experience.
  • the device information includes that the electronic device has a camera, and the electronic device prompts the user of the message according to the device information of the electronic device, including: When the electronic device detects through the camera that only the owner of the other electronic device focuses on the electronic device, the electronic device prompts the content of the message; or, when the electronic device detects through the camera that the owner of the other electronic device focuses on the electronic device, When multiple users including the master focus on the electronic device, the user is prompted to receive the message.
  • the electronic device can prompt the user of the content of the message; If multiple users including the owner of another electronic device focus on the electronic device, the electronic device can prompt the user that a message has been received. This helps to avoid leakage of user privacy, ensures the security of message forwarding, and improves user experience.
  • the method further includes: before prompting the user with the message, determining that the electronic device is in a non-do not disturb mode, or determining that the electronic device is currently The preset application is not running.
  • the electronic device may first determine that it is in a non-immersed state before prompting the user with the message.
  • the immersive state can also be understood as the notification prohibited state.
  • the immersive state can be that the user disables notifications or turns on the Do Not Disturb mode, or the immersive state can also be that the application running in the foreground of the electronic device is a preset application (for example, video App Or game App). This helps to avoid causing interference to the user, thereby helping to improve the user's experience.
  • the method further includes: before receiving the message sent by the another electronic device, the electronic device receives the request information sent by the other electronic device , The request information is used to request the electronic device to determine whether the owner of the other electronic device focuses on the electronic device; the electronic device sends response information to the other electronic device according to the request information, and the response information is used to indicate the The device currently focused by the owner of another electronic device is the electronic device.
  • the electronic device may be a device in the message forwarding list of another electronic device, and the electronic device may be a device under the same account as the other electronic device (or, the electronic device and the other electronic device may store the same user ⁇ ), so that after receiving the request information, the electronic device can collect user characteristics and match with the user characteristics preset in the electronic device. If the matching is successful, it is determined that the currently focused device of the owner of another electronic device is The electronic device thus sends response information to another electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of another electronic device from receiving the prompt of the message, thereby helping to improve the user experience.
  • the electronic device may first determine whether another electronic device and the electronic device are devices under the same account. If the electronic device determines that the other electronic device and the electronic device are devices under the same account, the electronic device can collect the feature information of the user focusing on the electronic device through the user feature collection device, and the collected user feature information is in the electronic device The preset feature information of the owner of another electronic device is matched, and if the matching is successful, the response information is sent to the other electronic device.
  • the electronic device includes a user feature collection device, and the method further includes: before receiving a message sent by the other electronic device, the electronic device receives Request information sent by the other electronic device, the request information is used to request the electronic device to determine whether the owner of the other electronic device focuses on the electronic device; the electronic device collects users through the user feature collection device according to the request information Feature and send the user feature to the other electronic device.
  • the electronic device may be a device in the message forwarding list of another electronic device, and the electronic device may not be a device under the same account as the other electronic device (or, the electronic device and the other electronic device may store different The user's information); or, the electronic device can also be a device surrounding another electronic device.
  • the electronic device can collect the characteristic information of the user who is focusing on the electronic device through the user characteristic collection device and send the characteristic information to another electronic device.
  • the other electronic device matches the user characteristic information preset in the other electronic device according to the characteristic information, and if the matching succeeds, forwards the message to the electronic device. This helps to improve the security of message forwarding, and prevents users other than the owner of another electronic device from receiving the prompt of the message, thereby helping to improve the user experience.
  • a device for prompting messages is provided.
  • the device for prompting messages is set in an electronic device.
  • the device includes: a receiving unit for receiving a message sent by another electronic device;
  • the device information of the device prompts the user of the message.
  • an electronic device including: one or more processors; a memory; and one or more computer programs.
  • one or more computer programs are stored in the memory, and the one or more computer programs include instructions.
  • the electronic device is caused to execute the method for prompting the message in any one of the possible implementations of the twenty-ninth aspect.
  • a computer program product containing instructions is provided, when the computer program product runs on an electronic device, the electronic device executes the prompt message method described in the twenty-ninth aspect.
  • a computer-readable storage medium including instructions, which when the instructions run on an electronic device, cause the electronic device to execute the method for prompting a message as described in the twenty-ninth aspect.
  • a method for a chip to execute instructions and when the chip is running, the chip executes the prompt message described in the twenty-ninth aspect.
  • the embodiments of the present application also provide a content sharing method, device, and system, which can simplify the operation steps for users to share content (such as pictures, videos, documents, etc.), improve the purpose of content sharing, and provide users with convenience.
  • content such as pictures, videos, documents, etc.
  • a content sharing method which is applied to a first terminal, and the method includes: the first terminal detects a first operation and generates first content. In response to the generated first content, the first terminal sends a first message to a second terminal, where the first terminal and the second terminal are in a near field connection, and the first terminal and the second terminal are in a near field connection.
  • the two terminals have a predetermined association relationship.
  • the first message is used to cause the second terminal to display a first prompt when the second terminal detects a second operation, where the first prompt is a prompt for the first content.
  • the first terminal sends the first content to the second terminal in response to a second message, where the second message is after the second terminal detects the third operation on the first prompt, A message sent to the first terminal.
  • the first terminal in addition to the operation of generating the content, the first terminal can share the content to the nearby required equipment without any other operations, which provides convenience to users and improves content sharing. Purpose, enhance the user experience.
  • the first content is a picture, where the picture comes from a photographing application, a scanning application, or a screenshot application.
  • the first terminal can conveniently and quickly share the generated pictures to nearby required devices, which improves the efficiency of sharing pictures.
  • the first message includes a picture thumbnail
  • the first prompt includes a picture thumbnail notification box, wherein the picture thumbnail notification box includes a thumbnail of the picture.
  • the picture thumbnail is sent to other devices, and the other devices can intuitively display the information of the picture to be received, which is convenient for the user to perform subsequent operations.
  • the third operation includes a detected click operation on the thumbnail in the picture thumbnail notification box, or a click operation on a download button, wherein the thumbnail notification box includes The download button, or a drag operation on the thumbnail in the picture thumbnail notification box.
  • the second message is a message requesting the picture. In this way, the user can obtain the original picture of the picture.
  • the first message is a message to be received for the picture, and the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message When the second terminal detects the second operation, it sends a picture thumbnail request message to the first terminal; in response to the picture thumbnail request message, the first terminal sends a thumbnail of the picture to all In the second terminal, the second terminal displays the first prompt including the thumbnail notification frame.
  • the first device does not directly send the thumbnail to other devices after obtaining the picture, but waits for other devices to request the thumbnail to be sent to other devices, which can save network resources and avoid pushing thumbnails to other devices that do not need pictures.
  • Sketch map the first message to be received for the picture
  • the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message When the second terminal detects the second operation, it sends a picture thumbnail request message to the first terminal; in response to the picture thumbnail request message, the first terminal sends a thumbnail of the picture to all In the second terminal, the second terminal
  • the picture thumbnail request message includes the picture thumbnail request message sent to the first terminal after the second terminal detects the second operation within a first limited time. In this way, timeliness is increased in detecting the second operation of sending the image thumbnail request message, and the user experience is enhanced.
  • the near field connection includes a Bluetooth connection or a Wi-Fi connection
  • the association relationship includes: the device account of the first terminal and the second terminal are the same, or the second terminal
  • the device account of is in the shared device list of the first terminal, where the shared device list is a collection of device accounts.
  • data is transmitted via Bluetooth or Wi-Fi, which improves the efficiency of transmission.
  • Users can share content to designated devices according to their own settings, which improves the purpose of content sharing.
  • the first prompt includes: the first prompt displayed when the second terminal detects the second operation within a second limited time. In this way, the timeliness of displaying the first prompt when the second operation is detected is increased, and the user experience is enhanced.
  • the second message includes: a message sent to the first terminal after the second terminal detects the third operation on the first prompt within a third limited time . In this way, the timeliness of detecting the third operation of the first prompt is increased, and the user experience is enhanced.
  • the method before the first terminal detects the first operation and generates the first content, the method further includes: the first terminal detects the first operation and generates the second content. The first terminal sends a third message to the second terminal in response to the generated second content.
  • the first content is a first picture; the second content is a second picture; the first message is a message to be received for the first picture; and the third message is a The message to be received for the second picture.
  • the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message causes the second terminal to send multiple thumbnail request messages to the In the first terminal, in response to the multiple thumbnail request messages, the first terminal sends a thumbnail including the first picture and the number of pictures to the second terminal, and the second terminal displays the thumbnail including the thumbnail The first prompt of the thumbnail notification frame, wherein the thumbnail notification frame includes the thumbnail of the first picture and the number of pictures.
  • the third operation includes a click operation on a download button
  • the thumbnail notification box includes the download button, or a drag operation on the thumbnail of the first picture.
  • the first terminal in response to the second message, sending the first content to the second terminal, including: the first terminal in response to the second message, sending the first picture and the second picture to The second terminal.
  • the third operation includes a click operation on the thumbnail of the first picture.
  • the first terminal sending the first content to the second terminal in response to the second message includes: the first terminal sending a fourth message to the second terminal in response to the second message, wherein The fourth message includes the thumbnail of the second picture, the fourth message causes the second terminal to display a second prompt, wherein the second prompt includes the thumbnail of the first picture and the second The thumbnail of the picture.
  • the first terminal sends the first picture to the second terminal, where the fifth message is the fifth message of the thumbnail of the first picture received by the second terminal.
  • a message sent to the first terminal a message sent to the first terminal. In this way, the user can click on the thumbnails in the multiple thumbnail notification box to expand and display multiple thumbnails, and further the user can operate on one of the thumbnails to select the picture they want, which enhances the user experience.
  • the first content includes a video or text or a file.
  • users can purposefully share content such as videos or texts or downloaded files to other nearby devices, which enhances the user experience.
  • a first terminal including: one or more processors, one or more memories, the one or more memories stores one or more computer programs, the one or more A computer program includes instructions that, when the instructions are executed by the one or more processors, cause the first terminal to perform the following steps: detecting a first operation, generating first content, and responding to the generated first Content, send a first message to a second terminal, where the first terminal and the second terminal are in a near field connection state, the first terminal and the second terminal have a predetermined association relationship, and the first terminal
  • the message causes the second terminal to display a first prompt when the second operation is detected, where the first prompt is a prompt for the first content; the first terminal sends the first prompt in response to the second message Content to the second terminal, where the second message is a message sent to the first terminal after the second terminal detects the third operation on the first prompt.
  • the terminal adopting the above scheme, in the entire content sharing process, in addition to the operation of generating the content, the content can be shared to the nearby required equipment without any other operations, which provides convenience to users and improves the purpose of content sharing. , To enhance the user experience.
  • the first content is a picture, wherein the picture comes from a photographing application or a scanning application or a screenshot application.
  • the terminal can easily and quickly share the generated pictures to nearby required devices, which improves the efficiency of sharing pictures.
  • the first message includes a picture thumbnail
  • the first prompt includes a picture thumbnail notification box, wherein the thumbnail notification box includes a thumbnail of the picture.
  • the picture thumbnail is sent to other devices, and the other devices can intuitively display the information of the picture to be received, which is convenient for the user to perform subsequent operations.
  • the third operation includes a detected click operation on the thumbnail in the picture thumbnail notification box, or a click operation on a download button, wherein the thumbnail notification box includes The download button, or a drag operation on the thumbnail in the picture thumbnail notification box.
  • the second message is a message requesting the picture. In this way, the user can obtain the original picture of the picture.
  • the first message is a message to be received for the picture.
  • the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message causes the second terminal to send a picture thumbnail request message to all when the second operation is detected.
  • the first terminal in response to the picture thumbnail request message, the first terminal sends a thumbnail of the picture to the second terminal, and the second terminal displays the thumbnail notification box including the The first hint.
  • the first terminal does not directly send the thumbnail to other devices after obtaining the picture, but waits for the other device to request it before sending the thumbnail to other devices, which can save network resources and avoid pushing thumbnails to other devices that do not need pictures.
  • Sketch map the first message to be received for the picture.
  • the picture thumbnail request message includes: the picture thumbnail request message sent to the first terminal after the second terminal detects the second operation within a first limited time . In this way, timeliness is increased in detecting the second operation of sending the image thumbnail request message, and the user experience is enhanced.
  • the near field connection includes a Bluetooth connection or a Wi-Fi connection.
  • the association relationship includes: the device account of the first terminal and the second terminal are the same, or the device account of the second terminal is in the sharing device list of the first terminal, wherein the sharing device The list is a collection of device accounts.
  • data is transmitted via Bluetooth or Wi-Fi, which improves the efficiency of transmission. Users can share content to designated devices according to their own settings, which improves the purpose of content sharing.
  • the first prompt includes: the first prompt displayed when the second terminal detects the second operation within a second limited time. In this way, the timeliness of displaying the first prompt when the second operation is detected is increased, and the user experience is enhanced.
  • the second message includes: a message sent to the first terminal after the second terminal detects the third operation on the first prompt within a third limited time . In this way, the timeliness of detecting the third operation of the first prompt is increased, and the user experience is enhanced.
  • the processor is further configured to: before the first terminal detects the first operation and generates the first content, the first operation is detected, and the second content is generated; the first terminal In response to the generated second content, a third message is sent to the first terminal.
  • the first content is a first picture; the second content is a second picture; the first message is a message to be received for the first picture; and the third message is a The message to be received for the second picture.
  • the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message causes the second terminal to send multiple thumbnail request messages to the In the first terminal, in response to the multiple thumbnail request messages, the first terminal sends a thumbnail including the first picture and the number of pictures to the second terminal, and the second terminal displays the thumbnail including the thumbnail The first prompt of the thumbnail notification frame, wherein the thumbnail notification frame includes the thumbnail of the first picture and the number of pictures.
  • the third operation includes a click operation on a download button
  • the thumbnail notification box includes the download button, or a drag operation on the thumbnail of the first picture.
  • the first terminal in response to the second message, sending the first content to the second terminal, including: the first terminal in response to the second message, sending the first picture and the second picture to The second terminal.
  • the third operation includes a click operation on the thumbnail of the first picture.
  • the first terminal sending the first content to the second terminal in response to the second message includes: the first terminal sending a fourth message to the second terminal in response to the second message, wherein The fourth message includes the thumbnail of the second picture, the fourth message causes the second terminal to display a second prompt, wherein the second prompt includes the thumbnail of the first picture and the second The thumbnail of the picture.
  • the first terminal sends the first picture to the second terminal, where the fifth message is the fifth message of the thumbnail of the first picture received by the second terminal.
  • a message sent to the first terminal a message sent to the first terminal. In this way, the user can click on the thumbnails in the multiple thumbnail notification box to expand and display multiple thumbnails, and further the user can operate on one of the thumbnails to select the picture they want, which enhances the user experience.
  • the first content includes a video or text or a file.
  • users can purposefully share content such as videos or texts or downloaded files to other nearby devices, which enhances the user experience.
  • a content sharing system including a first terminal and a second terminal, wherein the first terminal and the second terminal are in a near field connection state, and the first terminal is The terminal and the second terminal have a predetermined association relationship; the first terminal detects the first operation and generates first content; the first terminal responds to the generated first content, and sends a first message to all The second terminal; the second terminal detects the second operation and displays a first prompt, where the first prompt is a prompt for the first content; the second terminal detects that the first prompt The third operation is to send a second message to the first terminal. The first terminal sends the first content to the second terminal in response to the second message.
  • the first terminal in the entire content sharing process, can share the content to nearby required devices without any other operations except for the operation of generating content, and the second terminal performs according to its own needs.
  • Responding to receiving content provides convenience to users, improves the purpose of content sharing, and enhances user experience.
  • the first content is a picture, wherein the picture comes from a photographing application or a scanning application or a screenshot application.
  • the terminal can easily and quickly share the generated pictures to nearby required devices, which improves the efficiency of sharing pictures.
  • the first message includes a picture thumbnail
  • the first prompt includes a picture thumbnail notification box, wherein the thumbnail notification box includes a thumbnail of the picture.
  • the picture thumbnail is sent to other devices, and the other devices can intuitively display the information of the picture to be received, which is convenient for the user to perform subsequent operations.
  • the third operation includes a detected click operation on the thumbnail in the picture thumbnail notification box, or a click operation on a download button, wherein the thumbnail notification box includes The download button, or a drag operation on the thumbnail in the picture thumbnail notification box.
  • the second message is a message requesting the picture. In this way, the user can obtain the original picture of the picture.
  • the first message is a message to be received for the picture.
  • the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message causes the second terminal to send a picture thumbnail request message to all when the second operation is detected.
  • the first terminal in response to the picture thumbnail request message, the first terminal sends a thumbnail of the picture to the second terminal, and the second terminal displays the thumbnail notification box including the The first hint.
  • the first terminal does not directly send the thumbnail to other devices after obtaining the picture, but waits for the other device to request it before sending the thumbnail to other devices, which can save network resources and avoid pushing thumbnails to other devices that do not need pictures.
  • Sketch map the first message to be received for the picture.
  • the picture thumbnail request message includes: the picture thumbnail request message sent to the first terminal after the second terminal detects the second operation within a first limited time . In this way, timeliness is increased in detecting the second operation of sending the image thumbnail request message, and the user experience is enhanced.
  • the near field connection includes a Bluetooth connection or a Wi-Fi connection.
  • the association relationship includes: the device account of the first terminal and the second terminal are the same, or the device account of the second terminal is in the sharing device list of the first terminal, wherein the sharing device The list is a collection of device accounts.
  • data is transmitted via Bluetooth or Wi-Fi, which improves the efficiency of transmission. Users can share content to designated devices according to their own settings, which improves the purpose of content sharing.
  • the first prompt includes: the first prompt displayed when the second terminal detects the second operation within a second limited time. In this way, the timeliness of displaying the first prompt when the second operation is detected is increased, and the user experience is enhanced.
  • the second message includes: a message sent to the first terminal after the second terminal detects the third operation on the first prompt within a third limited time . In this way, the timeliness of detecting the third operation of the first prompt is increased, and the user experience is enhanced.
  • the processor is further configured to: before the first terminal detects the first operation and generates the first content, the first operation is detected, and the second content is generated; the first terminal In response to the generated second content, a third message is sent to the first terminal.
  • the first content is a first picture; the second content is a second picture; the first message is a message to be received for the first picture; and the third message is a The message to be received for the second picture.
  • the first message causes the second terminal to display a first prompt when the second operation is detected, including: the first message causes the second terminal to send multiple thumbnail request messages to the In the first terminal, in response to the multiple thumbnail request messages, the first terminal sends a thumbnail including the first picture and the number of pictures to the second terminal, and the second terminal displays the thumbnail including the thumbnail The first prompt of the thumbnail notification frame, wherein the thumbnail notification frame includes the thumbnail of the first picture and the number of pictures.
  • the third operation includes a click operation on a download button
  • the thumbnail notification box includes the download button, or a drag operation on the thumbnail of the first picture.
  • the first terminal in response to the second message, sending the first content to the second terminal, including: the first terminal in response to the second message, sending the first picture and the second picture to The second terminal.
  • the third operation includes a click operation on the thumbnail of the first picture.
  • the first terminal sending the first content to the second terminal in response to the second message includes: the first terminal sending a fourth message to the second terminal in response to the second message, wherein The fourth message includes the thumbnail of the second picture, and the fourth message causes the second terminal to display a second prompt, wherein the second prompt includes the thumbnail of the first picture and the second The thumbnail of the picture.
  • the first terminal sends the first picture to the second terminal, where the fifth message is the fifth message of the thumbnail of the first picture received by the second terminal.
  • a message sent to the first terminal a message sent to the first terminal. In this way, the user can click on the thumbnails in the multiple thumbnail notification box to expand and display multiple thumbnails, and further the user can operate on one of the thumbnails to select the picture they want, which enhances the user experience.
  • the first content includes a video or text or a file.
  • users can purposefully share content such as videos or texts or downloaded files to other nearby devices, which enhances the user experience.
  • a computer program product containing instructions is provided, which when the computer program product runs on a first terminal, causes the first terminal to execute the method described in the thirty-fifth aspect.
  • a computer-readable storage medium including instructions, which, when the instructions run on a first terminal, cause the first terminal to execute the method described in the thirty-fifth aspect.
  • a chip is provided for executing instructions, and when the chip is running, the chip executes the method described in the thirty-fifth aspect.
  • a content sharing device the content sharing device is provided in a first terminal, the content sharing device includes: a generating unit configured to detect a first operation to generate the first content; a sending unit, Used to send a first message to a second terminal in response to the generated first content, where the first terminal and the second terminal are in a near field connection state, and the first terminal and the second terminal There is a predetermined association relationship, the first message causes the second terminal to display a first prompt when the second terminal detects a second operation, wherein the first prompt is a prompt for the first content; the sending unit is further configured to In response to a second message, send the first content to the second terminal, where the second message is sent to the first terminal after the second terminal detects the third operation on the first prompt The message of the terminal.
  • FIG. 1 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application.
  • Fig. 2 is a block diagram of the software structure provided by an embodiment of the present application.
  • Fig. 3 is a schematic diagram of a network architecture provided in an embodiment of the present application.
  • Fig. 4 is a notification processing method provided in an embodiment of the present application.
  • Figure 5 is a set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 6 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 7 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 8 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 9 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 10 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 11 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 12 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 13 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 14 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 15 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 16 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 17 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 18 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 19 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 20 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 21 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 22 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 23 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 24 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 25 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 26 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 27 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 28 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 29 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 30 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 31 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 32 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 33 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 34 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 35 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 36 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 37 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 38 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 39 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 40 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 41 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 42 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 43 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 44 is another set of graphical user interfaces provided by an embodiment of the present application.
  • FIG. 45 is a schematic block diagram of a sending end and a receiving end provided by an embodiment of the present application.
  • FIG. 46 is a schematic flowchart of a method for prompting a message provided by an embodiment of the present application.
  • FIG. 47 is an implementation process of the sending end and the receiving end provided by an embodiment of the present application.
  • Figure 48 is another set of graphical user interfaces provided by an embodiment of the present application.
  • FIG. 49 is a process of reproducing the interface of the sending end at the receiving end in the audio and video collection provided by the embodiment of the present application.
  • FIG. 50 is a schematic flowchart of a quick reply method provided by an embodiment of the present application.
  • FIG. 51 is a block diagram of another software structure provided by an embodiment of the present application.
  • FIG. 52 is a flowchart of interaction between devices provided by an embodiment of the present application.
  • FIG. 53 is a schematic structural diagram of a notification decision manager provided by an embodiment of the present application.
  • FIG. 54 is a flowchart of a notification processing method provided by an embodiment of the present application.
  • FIG. 55 is a schematic block diagram of a method for transmitting pictures across devices according to an embodiment of the present application.
  • FIG. 56 is a schematic flowchart of a picture sharing method provided by an embodiment of the present application.
  • FIG. 57 is another schematic flowchart of a picture sharing method provided by an embodiment of the present application.
  • FIG. 58 is another schematic flowchart of a picture sharing method provided by an embodiment of the present application.
  • FIG. 59 is another schematic flowchart of a picture sharing method provided by an embodiment of the present application.
  • FIG. 60 is another schematic flowchart of a picture sharing method provided by an embodiment of the present application.
  • Fig. 61 is a system module architecture for picture sharing provided by an embodiment of the present application.
  • FIG. 62 is an interactive message flow of the main modules in the mobile phone terminal and the personal computer terminal provided by an embodiment of the present application.
  • FIG. 63 is a schematic flowchart of a task processing method provided by an embodiment of the present application.
  • Fig. 64 is a schematic frame diagram of a task processing system provided by an embodiment of the present application.
  • Figure 65 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Figure 66 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 67 is another set of graphical user interfaces provided by an embodiment of the present application.
  • Fig. 68 is another set of graphical user interfaces provided by an embodiment of the present application.
  • FIG. 69 is a schematic flowchart of a notification processing method provided by an embodiment of the present application.
  • FIG. 70 is a schematic block diagram of a notification processing apparatus provided by an embodiment of the present application.
  • FIG. 71 is another schematic block diagram of a notification processing apparatus according to an embodiment of the present application.
  • FIG. 72 is a schematic structural diagram of a prompt electronic device provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present embodiment, unless otherwise specified, “plurality” means two or more.
  • the method provided in the embodiments of this application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (ultra mobile personal computers).
  • augmented reality (AR)/virtual reality (VR) devices notebook computers
  • ultra-mobile personal computers ultra mobile personal computers
  • -Mobile personal computer UMPC
  • netbook personal digital assistant
  • PDA personal digital assistant
  • FIG. 1 shows a schematic structural diagram of an electronic device 100.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM Subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter/receiver (universal asynchronous) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter/receiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the I2C interface is a bidirectional synchronous serial bus, which includes a serial data line (SDA) and a serial clock line (SCL).
  • the processor 110 may include multiple sets of I2C buses.
  • the processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively through different I2C bus interfaces.
  • the processor 110 may couple the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the electronic device 100.
  • the I2S interface can be used for audio communication.
  • the processor 110 may include multiple sets of I2S buses.
  • the processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170.
  • the audio module 170 may transmit audio signals to the wireless communication module 160 through an I2S interface, so as to realize the function of answering calls through a Bluetooth headset.
  • the PCM interface can also be used for audio communication to sample, quantize and encode analog signals.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the UART interface is generally used to connect the processor 110 and the wireless communication module 160.
  • the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function.
  • the audio module 170 may transmit audio signals to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a Bluetooth headset.
  • the MIPI interface can be used to connect the processor 110 with the display screen 194, the camera 193 and other peripheral devices.
  • the MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI), and so on.
  • the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 100.
  • the processor 110 and the display screen 194 communicate through a DSI interface to realize the display function of the electronic device 100.
  • the GPIO interface can be configured through software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and so on.
  • the GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect earphones and play audio through earphones. This interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the electronic device 100.
  • the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be provided in the processor 110.
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and so on.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is an image processing microprocessor, which is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations and is used for graphics rendering.
  • the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, and the like.
  • the display screen 194 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one.
  • the electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include one or N cameras 193, and N is a positive integer greater than one.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, and so on.
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • applications such as intelligent cognition of the electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.
  • the speaker 170A also called “speaker” is used to convert audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the electronic device 100 answers a call or voice message, it can receive the voice by bringing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 170C through the human mouth, and input the sound signal into the microphone 170C.
  • the electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement noise reduction functions in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the earphone interface 170D is used to connect wired earphones.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA, CTIA
  • the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be provided on the display screen 194.
  • the capacitive pressure sensor may include at least two parallel plates with conductive materials.
  • the electronic device 100 determines the intensity of the pressure according to the change in capacitance.
  • the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A.
  • touch operations that act on the same touch position but have different touch operation strengths may correspond to different operation instructions. For example: when a touch operation whose intensity of the touch operation is less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
  • the gyro sensor 180B may be used to determine the movement posture of the electronic device 100.
  • the angular velocity of the electronic device 100 around three axes ie, x, y, and z axes
  • the gyro sensor 180B can be used for image stabilization.
  • the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement to achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenes.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip holster.
  • the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Then, according to the detected opening and closing status of the leather case or the opening and closing status of the flip cover, features such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and apply to applications such as horizontal and vertical screen switching, pedometers, and so on.
  • the electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.
  • the proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the electronic device 100 emits infrared light to the outside through the light emitting diode.
  • the electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.
  • the electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power.
  • the proximity light sensor 180G can also be used in leather case mode, and the pocket mode will automatically unlock and lock the screen.
  • the ambient light sensor 180L is used to sense the brightness of the ambient light.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on.
  • the temperature sensor 180J is used to detect temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection.
  • the electronic device 100 when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature.
  • the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180K is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can obtain the vibration signal of the vibrating bone mass of the human voice.
  • the bone conduction sensor 180M can also contact the human pulse and receive the blood pressure pulse signal.
  • the bone conduction sensor 180M may also be provided in the earphone, combined with the bone conduction earphone.
  • the audio module 170 can parse the voice signal based on the vibration signal of the vibrating bone block of the voice obtained by the bone conduction sensor 180M, and realize the voice function.
  • the application processor can analyze the heart rate information based on the blood pressure beating signal obtained by the bone conduction sensor 180M, and realize the heart rate detection function.
  • the button 190 includes a power-on button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.
  • touch operations applied to different applications can correspond to different vibration feedback effects.
  • Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminding, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
  • the electronic device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
  • the same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards can be the same or different.
  • the SIM card interface 195 can also be compatible with different types of SIM cards.
  • the SIM card interface 195 may also be compatible with external memory cards.
  • the electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication.
  • the electronic device 100 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of the present application takes an Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 by way of example.
  • FIG. 2 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
  • the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
  • the application layer can include a series of application packages.
  • the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • the content provider is used to store and retrieve data and make these data accessible to applications.
  • the data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, and so on.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.
  • the phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call status (including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, and so on.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.
  • Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.
  • the application layer and application framework layer run in a virtual machine.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • the system library can include multiple functional modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • surface manager surface manager
  • media library media libraries
  • 3D graphics processing library for example: OpenGL ES
  • 2D graphics engine for example: SGL
  • the surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes touch operations into original input events (including touch coordinates, time stamps of touch operations, etc.).
  • the original input events are stored in the kernel layer.
  • the application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, and the control corresponding to the click operation is the control of the camera application icon as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer.
  • the camera 193 captures still images or videos.
  • FIG. 3 shows a schematic diagram of a network architecture 200 provided in an embodiment of the present application.
  • the network architecture 200 includes multiple electronic devices.
  • the electronic device may include a mobile phone 201, a watch 202, a smart speaker 203, a personal computer (or notebook) 204, a smart TV 205, a tablet computer 206, etc., which are not limited in the embodiment of the present application.
  • each electronic device can communicate with each other.
  • the multiple electronic devices can all be connected to a local area network (LAN) via a wired or Wi-Fi connection; they can also communicate via a mobile network or the Internet.
  • LAN local area network
  • the network architecture 200 may further include a router 207, and the router 207 may be set up as an access point (AP) to provide a signal source for the network.
  • each electronic device in the network architecture 200 can be used as a station (STA) to access the router 207.
  • the router 207 can respectively communicate with each electronic device through a wired network or a wireless network.
  • each electronic device establishes a Wi-Fi link through the -Wi-Fi protocol to realize communication between the devices.
  • the specific implementation may be that a peer-to-peer (peer-to-peer, P2P) is established between each electronic device. ) Connection (or called Wi-Fi Direct), or each connected to the same router 207 to implement communication between devices.
  • the Bluetooth protocol can also be used to establish a Bluetooth link between each device, and the communication between the devices can be realized based on the Bluetooth link; or, the electronic devices can also be interconnected through a cellular network; or, between each electronic device It can also be interconnected through a switching device (for example, a USB data cable or a Dock device), so as to realize the communication function between various electronic devices, which is not limited in the embodiment of the present application.
  • a switching device for example, a USB data cable or a Dock device
  • the network architecture 200 further includes a three-party server 208.
  • the third-party server 208 may be a server of third-party application software, which is connected to the electronic device through a network.
  • the three-party server 208 may send notification information to the electronic device.
  • the number of the three-party server 208 is not limited to one, but may be multiple, which is not limited here.
  • FIG. 3 shows a schematic diagram of yet another network architecture 300 provided in an embodiment of the present application.
  • the network architecture 300 includes multiple electronic devices.
  • the electronic device may include a smart phone 201, a smart watch 202, a smart speaker 203, a personal computer 204, a smart TV 205, a tablet computer 206, etc., which are not limited in the embodiment of the present application.
  • there is a central device between multiple electronic devices such as a smart phone 201. Create a Wi-Fi P2P GO, or Group Owner, on the central device.
  • Other devices connect to this GO as P2P GC or Group Client. These devices also form a one-to-many network that can communicate with each other.
  • the network architecture further includes a three-party server 208.
  • the three-party server 208 may be a server of third-party application software, and is connected to the smart phone 201 via a network.
  • the three-party server 208 sends notification information to the smart phone 201.
  • the number of the three-party server 208 is not limited to one, but may be multiple, which is not limited here.
  • FIG. 3 shows a schematic diagram of another network architecture 400 provided in an embodiment of the present application.
  • the network architecture 300 includes multiple electronic devices.
  • the electronic device may include a smart phone 201, a smart watch 202, a smart speaker 203, a personal computer 204, a smart TV 205, a tablet computer 206, etc., which are not limited in the embodiment of the present application.
  • the smart phone 201, the smart watch 202, the smart speaker 203, the personal computer 204, the smart TV 205, and the tablet 206 may be devices under the same account (for example, a Huawei account), then the devices under the account may pass through the cloud server 209 establish connection.
  • the notification processing method includes:
  • S401 The first device determines a trigger condition.
  • the first device After the first device obtains the content (for example, a message, a multimedia file, and a notification), it will determine under what circumstances will trigger the cross-device notification to the user, and what content needs to be cross-device notification to the user.
  • the content for example, a message, a multimedia file, and a notification
  • the first device may determine the state of the first device after acquiring the content. Taking a mobile phone as an example, if the mobile phone determines that the mobile phone is in the locked-screen state after acquiring the content, the mobile phone can determine that the content needs to be notified to the user across devices, so as to prevent the user from missing some important or valuable content.
  • the first device may turn on the camera to collect facial information of the user. If the first device does not collect the face information of the user, the first device can determine that the user's current focus is not on the first device, and the first device can notify the user across devices.
  • the first device may determine that there is a visual interruption (for example, content that can be notified by a lock screen) or content that has a sound/vibration reminder, and can notify the user across devices.
  • a visual interruption for example, content that can be notified by a lock screen
  • content that has a sound/vibration reminder for example, content that has a sound/vibration reminder
  • the first device selects the second device.
  • the criterion for the first device to select the second device may be to ensure that the user receives the reminder in time.
  • the first device may determine the second device according to the priority of the user's visual focus device, the personal device, and the interactive device.
  • the specific determination process refer to the following specific embodiments.
  • S403 The second device prompts the user.
  • the second device prompting the user may include but not limited to the following considerations:
  • the second device may select a notification form according to the device status and capabilities of the second device. For example, for a screened device, a banner can be used to prompt the user in an unlocked state; a lock screen notification can be used to prompt the user in a locked screen state; another example, for a screenless device, the user can be prompted by voice.
  • the second device may prompt the user with content (for example, the content of a message received by the first device) when it is determined that only the user is currently focusing on the second device; and when the second device determines When multiple users, including the user, focus on the second device, they only prompt the user that the content is received without prompting the detailed information of the content.
  • content for example, the content of a message received by the first device
  • the content when the content sent by the first device is received, the content can be displayed but the interactive controls are not displayed, and the user can view and process the content in the notification center.
  • the content when the content sent by the first device is received, the content can be displayed but the interactive controls are not displayed, and the user can view and process the content in the notification center.
  • the car machine although the car machine also has a display screen, considering the safety of the user while driving, the car machine may preferentially use the voice broadcast.
  • the second device may also prompt the user after detecting a preset operation of the user. For example, as shown in Figure 32, after the mobile phone captures (or screenshots) the picture, it can send the thumbnail of the picture to the laptop. After the laptop receives the thumbnail of the picture, in order to reduce the interference to the user, the laptop The computer may prompt the user with the thumbnail of the picture when it detects the user's operation of sliding the mouse.
  • S404 The second device receives the processing operation of the user.
  • the user After receiving the prompt on the second device, the user can process the corresponding content. Exemplarily, if the content is a message, the user can reply to the message on the second device.
  • the user can obtain the information of the original picture from the first device by clicking the thumbnail or clicking the download control on the second device.
  • the second device may also prompt the user to check the mail content through the third device (for example, a notebook computer).
  • the third device for example, a notebook computer
  • GUI graphical user interface
  • Figure 5 is a set of GUIs provided by an embodiment of the present application.
  • the user is watching a smart TV in the living room, the mobile phone is placed on a table aside by the user, and the mobile phone is locked.
  • the smart TV is currently playing video.
  • the mobile phone receives a message of App1 sent by user Li Hua (the content of the message is "There is a meeting at 9 AM").
  • the mobile phone judges that the user's current focus is on the smart TV and not on the mobile phone, then the mobile phone can send the content of the App1 message to the smart TV, and the TV reminds the user of the received App1 message content.
  • a message reminder box 501 may be displayed on the smart TV.
  • the message reminder box 501 includes the message that the message is App1, the user who sent the message is Li Hua, and the content of the message is "there is a meeting at 9 am”.
  • the smart TV is currently performing a channel switching operation.
  • the mobile phone receives a message of App1 sent by user Li Hua (the content of the message is "There is a meeting at 9 AM").
  • the mobile phone judges that the user's current focus is on the smart TV and not on the mobile phone, then the mobile phone can send the content of the App1 message to the smart TV, and the TV reminds the user of the received App1 message content.
  • a message reminder box 502 may be displayed on the smart TV.
  • the message reminder box 502 includes that the message is App1, the user who sent the message is Li Hua, and the content of the message is "There is a meeting at 9 AM".
  • the smart TV can automatically position the cursor of the smart TV in the message reminder box when the message reminder box is displayed.
  • the smart TV detects that the user clicks the OK button through the remote control, the smart TV can automatically jump to the notification center. The user can complete the reply to the message in the notification center.
  • the smart TV can hide the message reminder box.
  • the user can enter the notification center of the smart TV through the operation after watching the video or ending the channel changing operation.
  • the notification center displayed by the smart TV includes the previously received message reminder box 503 of App1, where the message reminder box 503 of App1 includes the message that the message is App1, and the source of the App1 message is from the user Lily’s P40 mobile phone,
  • the user who sent the message is Li Hua, and the content of the message is the reply control 504 of "there is a meeting at 9 am" and the ignore control 505.
  • the smart TV detects that the user has clicked the operation of the reply control 504, the smart TV can display the GUI as shown in (d) in FIG. 5.
  • the smart TV can display the input method of the smart TV. At this time, the user can reply to the App1 message through the input method.
  • the mobile phone after the mobile phone judges that the user is not focused on the mobile phone, although it receives the App1 message, the mobile phone does not need to turn on the screen. show. Instead, the device that the user is currently focusing on is a smart TV, and the content of the notification message is sent to the smart TV, thereby prompting the user through the smart TV.
  • the mobile phone detects that the user has clicked the power button, the mobile phone is in a locked and on-screen state. At this time, the mobile phone can display the App1 message reminder on the lock screen interface.
  • the smart TV shown in Figure 5 (a) is playing video at this time, and the smart TV shown in Figure 5 (b) is performing a channel switching operation, then the smart TV is displaying the message of App1 at this time
  • no control action can be added in the message reminder box 501 (for example, no reply control or ignoring control can be added in the message reminder box 501), so as to avoid the trouble caused by the user's accidental click.
  • Figure 6 shows another set of GUIs provided by an embodiment of the present application.
  • the smart TV can display a message reminder box and at this time the smart TV can automatically locate the cursor to the reply control.
  • the smart TV detects that the user clicks the OK button through the remote control, the user can complete the reply to the App1 message during the video playback.
  • the smart TV can automatically hide the message reminder box. The user can view the content of the message in the notification center of the smart TV and reply.
  • the smart TV may not perform automatic positioning at this time, thereby avoiding trouble to the user's operation.
  • the GUI shown in Figure 6(b) contains a text prompt "click the menu button to process" near the message reminder window, so that although the user is using the remote control (the user clicks the up, down, left, and right buttons) to switch channels, However, the user can click the menu button after seeing the text prompt.
  • the smart TV detects that the user clicks the menu key, the smart TV can automatically position the cursor to the reply control, thereby completing the reply to the App1 message.
  • the smart TV when the smart TV detects that the user has clicked the menu button, the smart TV can automatically position the cursor to the reply control.
  • the message reminder box shown in (a) of FIG. 6 may not include controls.
  • the smart TV detects that the user has no interaction with the smart TV, the smart TV can position the cursor to the message reminder box.
  • the smart TV can jump to the notification center, where the notification center includes the notification message and the corresponding reply control. The user can complete the reply to the message in the notification center.
  • Figure 7 shows another set of GUIs provided by an embodiment of the present application.
  • the user is driving the car, and the navigation information is displayed on the display of the car.
  • the mobile phone is placed in the storage slot of the car by the user and the mobile phone is in a locked screen state at this time.
  • the mobile phone receives a message of App1 sent by user Li Hua (the content of the message is "There is a meeting at 9 AM"). At this time, the mobile phone judges that the user's current focus is on the car and not on the mobile phone, then the mobile phone can send the message content of the App1 to the display of the car, and the display will remind the user of the received App1 message.
  • a message reminder box 701 may be displayed on the display screen of the vehicle.
  • the message reminder box 701 includes the message that the message is App1, the user who sent the message is Li Hua, and the content of the message is "there is a meeting at 9 am”.
  • the car machine can remind the user "there is a meeting at 9 o'clock in the morning” by means of voice reminders. Or, the car machine can remind the user by voice reminding that "the user Li Hua reminds that there is a meeting at 9 o'clock in the morning.”
  • the car machine can collect the user's voice information through the microphone. For example, the voice message that the car machine can collect is "OK, I get it.”
  • the car machine can send the voice information to the user Li Hua, or can convert the voice information into text information and send it to the user Li Hua.
  • the display screen of the car machine may also include a voice broadcast control.
  • the car machine detects that the user has clicked on the voice broadcast control, the car machine can remind the user "there is a meeting at 9 am" by means of voice reminders.
  • a digital signal processor may be included on the vehicle.
  • the DSP can process the voice information, so that the text content corresponding to the voice information can be analyzed.
  • the vehicle may include a voice recognition (automatic speech recognition, ASR) module.
  • ASR automatic speech recognition
  • the main function of the ASR module is to recognize the user's voice information as text content.
  • the message reminder box displayed on the display screen of the car machine may also include a sending control. After the user clicks the sending control, the car machine can send the content of the user's reply to the mobile phone. Or, the message reminder box may not include the sending control. After the car machine collects the user's voice message "Yes to Li Hua, I know" through the microphone, the car machine can send the user's reply to the mobile phone.
  • the car machine may also send the preset quick reply content to the mobile phone.
  • the car can convert text information into voice information to prompt the user, which can avoid the user's inattention caused by viewing the message content on the display screen, thereby improving the user Safety when driving a car.
  • Fig. 8 shows another set of GUIs provided by an embodiment of the present application.
  • the user is sitting on the sofa, the mobile phone is placed on the table beside the user and the speaker is on the table beside the user.
  • the mobile phone receives an email from the user Li Hua (the subject of the email is "Conference Notice”). At this time, the mobile phone judges that the user's current focus is not on the mobile phone, then the mobile phone can send the email reminder to the speaker, and the speaker reminds the user by voice "You have received an email, please check it on the phone”.
  • the speaker can remind the user through voice, which can better attract the user's attention and prevent the user from missing important emails.
  • Figure 9 shows another set of GUIs provided by an embodiment of the present application.
  • the user is wearing a wearable device and is sitting on a sofa, and the notebook computer is in a sleep (or hibernation) state and is placed on a table by the user.
  • the user sets a schedule on the laptop.
  • the schedule is from 9 am to 10 am, and the events of the schedule are seminars.
  • the laptop determines that there are still 5 minutes for the event of the schedule to occur, the user cannot be notified because the laptop is in a sleep state at this time (when the laptop detects that it is from the closed sleep state to the open working state, the laptop can report The user is prompted for the schedule information). Therefore, the notebook computer can send the schedule reminder to the wearable device for reminding.
  • the wearable device prompts information of the schedule through the display screen.
  • multiple devices of the user may be connected to each other and perceive each other.
  • the device A receives the notification message, the device A can determine the current focus of the user's attention. If the user's current focus is not on device A, the notification forwarding is triggered. When it is judged that the focus device is on device B, the mobile phone can forward the notification message to device B, then device A does not notify, and device B does notification, so as to avoid causing harassment to the user.
  • device B After the notification is forwarded to device B, device B can also optimize the presentation and interaction of the notification according to the capabilities of device B.
  • Fig. 10 shows another set of GUIs provided by an embodiment of the present application.
  • the user is playing with the tablet on the sofa, the mobile phone is placed on the table aside by the user, and the mobile phone is locked.
  • the mobile phone receives a message of App1 sent by user Li Hua (the content of the message is "There is a meeting at 9 AM"). At this time, the mobile phone judges that the user's current focus is on the tablet and not on the mobile phone, then the mobile phone can send the message content of App1 to the tablet. The tablet can determine whether to remind the user of the App1 message according to the current status of the tablet.
  • the tablet may not prompt the user about the App1 message.
  • the tablet may not prompt the App1 message.
  • the immersive state can also be understood as a notification prohibited state.
  • the immersive state can be that the user disables notifications or turns on the do not disturb mode. For example, if a user is in a remote meeting, especially when sharing a desktop, if there is a notification, it will not only be affected by interference, but also be seen by other participants, which may affect the user experience and may leak the user's privacy.
  • the tablet can display a message reminder box 1001.
  • the message reminder box 1001 includes the message that the message is App1, the user who sent the message is Li Hua, the content of the message is "there is a meeting at 9 am", a reply control, and an ignore control.
  • the focus device when the focus device receives the notification message, the focus device may first determine whether it is in the immersed state. If the focus device is in the immersive state, the focus device may not remind the user; if the focus device is not in the immersion state, the focus device may remind the user.
  • the immersion state includes but is not limited to:
  • the focus device is in the do not disturb mode
  • the focus device is in scenes such as games and videos.
  • the focus device may be notified and reminded according to the user's setting.
  • the user can set that the message reminder is not allowed in the game scene, and the message reminder can be carried out in the video scene.
  • Fig. 11 shows another set of GUIs provided by an embodiment of the present application.
  • the user is watching a smart TV in the living room, the mobile phone is placed on a table aside by the user, and the mobile phone is locked.
  • the smart TV is playing video at this time.
  • the mobile phone receives a message of App1 sent by user Li Hua (the content of the message is "There is a meeting at 9 AM").
  • the mobile phone judges that the user's current focus is on the smart TV and not on the mobile phone, then the mobile phone can send the content of the App1 message to the smart TV, and the TV reminds the user of the received App1 message content.
  • the smart TV can automatically turn on the camera to collect the user's facial information. If the smart TV judges that the user is the user based on the collected face information, a message reminder box 1101 can be displayed on the smart TV.
  • the message reminder box 1101 includes the message that the message is App1, the user who sent the message is Li Hua, and the message The content is "there is a meeting at 9 am”.
  • the smart TV can display a message reminder box 1102 at this time, where the message reminder box 1102 includes the message that the message is App1 and prompts the user "You There is a message from Lily's P40". If the user wants to view the message that should be App1, the user can view it in the notification center of the smart TV, or the user can go back to the mobile phone to view the message of App1.
  • the focus device when the focus device prompts the user with a notification message, the focus device can obtain the user's face information, iris information, and other user information, so as to determine whether it is the user himself. If it is the user, the focused device may prompt the user with the notification message; if it is not the user, or there are other users besides the user, the focused device may only prompt that there is a notification message without displaying the content of the notification message. This is beneficial to avoid the user's privacy leakage, and helps to improve the security in the message forwarding process.
  • the smart TV after the smart TV receives a message from App1 sent by the mobile phone, it can first determine whether the message is a private message. If it is a private message, it can then determine whether it is the user or multiple users; if it is not a private message , Then you can display the message content directly to the user without making a judgment.
  • the private message may be set by the user, or may also be a default instant messaging (IM) type of message.
  • IM instant messaging
  • the device A when the device A receives a notification message, the device A can determine the current focus of the user's attention. If the user's current focus is not on device A, the notification forwarding is triggered. When it is determined that the focus device is on device B, the mobile phone can forward the notification message to device B, then device A does not notify at this time, and device B does notification. In another embodiment of the present application, after the user determines that the focused device is on device B, device A can also send a notification message to device B and other users' devices, then the focused device can notify, but other devices do not.
  • Fig. 12 shows another set of GUIs provided by an embodiment of the present application.
  • the user is wearing the wearable device and is sitting on the sofa.
  • the mobile phone is placed on the table by the user and the tablet is placed on the sofa on the other side by the mobile phone.
  • the mobile phone receives an e-mail sent by user Li Hua (the subject of the e-mail is "Conference Notice"). At this time, the mobile phone judges that the user's current focus is not on the mobile phone, and the mobile phone can send the content of the email to the tablet and wearable devices. Since the wearable device determines that the user is wearing the wearable device at this time, the wearable device can be used as the focus device for notification. As shown in Figure 12, the wearable device can remind the user of the email content through vibration. For mobile phones and tablets, because they are not the focus devices, the user can also be prompted on the lock screen by brightening the screen of the email content.
  • Figure 13 shows another set of GUIs provided by an embodiment of the present application.
  • the GUI includes a plurality of application (App1, App2, and App3) icons, and the plurality of application icons includes an icon 1301 of App3.
  • the mobile phone detects that the user has clicked the setting icon 1301 on the desktop, it can start setting the mobile phone related functions, and display the GUI as shown in (b) in FIG. 13.
  • the GUI shown in (b) in FIG. 13 is the setting interface of the mobile phone.
  • the GUI includes multiple functional options.
  • the multiple functional options include wireless and network, device connection, desktop and wallpaper, sound, notification center, applications and notifications, among which users can manage permissions and default applications through applications and notifications. And notification management and other functions.
  • the mobile phone detects the operation of clicking the application and notification function 1302 with the user, the GUI shown in (c) of FIG. 13 is displayed.
  • GUI shown in (c) in FIG. 13 is an application and notification function setting interface of the mobile phone.
  • the GUI includes multiple function options for wireless and network, and the multiple function options include permission management, default applications, application avatars, and cross-device notifications.
  • the GUI shown in (d) in FIG. 13 is displayed.
  • the GUI includes multiple functional options under cross-device notifications, including switch controls for cross-device notifications, notification types, device management, and device authorization.
  • the switch control of cross-device notification includes the function description of cross-device notification "When the notification comes, if you are using another device, forward the notification to that device".
  • the mobile phone detects that the user clicks on the notification type 1304, the mobile phone can display the GUI as shown in (e) in FIG. 13.
  • FIG. 13 is the notification type setting interface of the mobile phone.
  • the user can select the type of notification he wants to forward from the notification types shown in (e) in FIG. 13.
  • the user can select messages of App5, App6, and App7 as the type of notification that they want to forward.
  • the user can select the type of notification he wants to forward through setting options, so as to avoid the harassment of the user caused by unnecessary notification message forwarding.
  • the mobile phone When the mobile phone detects that the user has clicked on the device management 1401 shown in (a) in FIG. 14, the mobile phone can display the GUI as shown in (b) in FIG.
  • the device management includes my device and other devices.
  • my device is a device with the same Huawei ID as the mobile phone.
  • my device includes tablet "HUAWEI MatePad Pro", smart watch “HUAWEI WATCH GT 2", another mobile phone "HUAWEI P40 Pro", notebook computer “HUAWEI MatBook X” and smart speaker “HUAWEI Sound X”.
  • the mobile phone selects all the above devices, the mobile phone can forward the notification message to the above devices.
  • the user can select devices under the same Huawei ID as the forwarding object of the notification message, or select devices under the same Huawei ID as the forwarding object.
  • the mobile phone When the mobile phone detects that the user has clicked on the device authorization 1501 as shown in (a) in FIG. 15, the mobile phone can display the GUI as shown in (b) in FIG. 15.
  • the display interface includes the option of adding a device and the option of nearby devices.
  • the description of adding a device is that you can add devices under other Huawei IDs to other devices.
  • the user can add the Huawei IDs of other family members in the family group, and the devices under the Huawei IDs of other family members can appear in other devices as shown in (b) in FIG. 14.
  • the mobile phone detects the user's operation of opening the controls of nearby devices, the mobile phone can search for nearby devices and display the GUI as shown in (c) in FIG. 15.
  • FIG. 15 is another display interface of the device authorization function.
  • the display interface shows that the nearby devices searched by the mobile phone include iphone 11 Pro, iPad Pro 11, and Huawei 10 Pro.
  • the mobile phone detects that the user clicks to add iPad Pro 11 and Mi 10 Pro, the mobile phone can add these two devices to other devices in the device management.
  • FIG. 15 is another display interface for device management. Two nearby devices, iPad Pro 11 and Huawei 10 Pro, have been added to the "other devices" on the display interface.
  • the mobile phone can search for other surrounding devices through short-distance communication methods such as Bluetooth and Wi-Fi.
  • short-distance communication methods such as Bluetooth and Wi-Fi.
  • the mobile phone can send Bluetooth low energy (BLE) data packets to these two devices, where the BLE data packet can carry Request to be added as the request information of the device forwarding the notification message.
  • BLE Bluetooth low energy
  • the mobile phone receives the response of two devices (for example, ACK message)
  • the mobile phone can successfully add the two devices to the "other devices”.
  • the iPad Pro 11 and Mi 10 Pro the user can be prompted through a reminder box whether to agree to the request for adding the mobile phone. If the iPad Pro 11 and Mi 10 Pro detect the user's request that they agree to be added as a device for notification message forwarding, the two devices can send a response to the mobile phone.
  • Figure 16 is another set of GUIs provided by an embodiment of the present application.
  • User Lily is currently using a tablet to watch the video, and the phone is placed on a table by the user Lily.
  • the mobile phone receives a social App message (for example, Happy Birthday!) from the user Tom.
  • the mobile phone can forward the message to the tablet that the user is focusing on, and the tablet can display a message reminder box 1601.
  • the message reminder box 1601 contains the source of the message (for example, the name of the social app, and the message comes from the P40 of user Lily), the information of the user who sent the message (for example, "Tom" and the avatar of user Tom), and the The content of the message (for example, Happy Birthday!) and the control 1602.
  • the tablet may be an account that is logged in to the same social app as the mobile phone; or, the tablet may be installed with the social app but the user has not logged in to the social app using the same account as the mobile phone; or, the tablet may not be installed.
  • Social App device may be an account that is logged in to the same social app as the mobile phone; or, the tablet may be installed with the social app but the user has not logged in to the social app using the same account as the mobile phone; or, the tablet may not be installed.
  • the mobile phone after the mobile phone receives a notification, if the mobile phone determines that the user is currently a focused mobile phone but a focused tablet, then the mobile phone can carry the content of the message in the message sent to the tablet, and the user’s Information and "quick reply" attributes. Further, the mobile phone can also carry the information of the mobile phone in the information sent to the tablet. Therefore, the tablet can display a reminder box 1601 to the user according to the information sent by the mobile phone.
  • the notification message forwarded by the mobile phone in the embodiment of the present application may be a notification type set by the user in advance.
  • the user can set the notification message of WeChat, QQ, DingTalk, etc. App to be forwardable in the system settings.
  • the notification message forwarded by the mobile phone can also be a default IM type message (such as SMS, WeChat, etc.).
  • the tablet When the tablet detects that the user clicks on the control 1602, it can display the GUI as shown in (b) in FIG. 16.
  • the mobile phone After the mobile phone receives the message for a period of time, the message is automatically hidden.
  • the user can process the message by entering the notification center or by means of a drop-down menu.
  • a text input box 1603 can be displayed in the message reminder box, and a send control 1604 can also be displayed in the text input box 1603.
  • the tablet can also call up the system input method.
  • the user can edit the content he needs to reply (for example, Thank you!) through the input method, and the content of the user's reply can be displayed in the text input box 1603.
  • the tablet When the tablet detects that the user clicks on the control 1604, the tablet can send the reply content to the mobile phone. At the same time, the input method and message reminder box on the tablet can be automatically hidden. The changes of the GUI on the mobile phone can be seen from (c) to (f) in Figure 16.
  • the mobile phone when the mobile phone receives the user's reply content sent by the tablet, the mobile phone can automatically start the social application App.
  • the social application App On the display interface of the social application App, the historical chat records of the user Tom, the user Sam, the user Lucy, and the user Mike can be displayed in sequence according to the order of the moment when the message is received.
  • the mobile phone can automatically open the chat interface of the user Tom.
  • the message (Happy Birthday!) sent by the user Tom to the user Lily can be displayed on the chat interface.
  • the mobile phone can automatically reply the content of the user's reply on the tablet to the user Tom.
  • the phone can return to the state before receiving the message. See (f) in Figure 16.
  • the mobile phone can automatically return to the desktop of the mobile phone from the chat interface of the user Tom in the social app.
  • the user's reply message does not complete the actual reply.
  • the actual reply process is actually completed on the mobile phone. For example, when the mobile phone displays the interface as shown in (e) in Figure 16, the mobile phone completes the actual reply to the message.
  • the process of completing the reply to the message by the mobile phone can also be implemented internally, and the mobile phone can automatically complete the reply to the message in the background after receiving the content of the user reply sent by the tablet.
  • the process in which the mobile phone completes the actual reply to the message may be insensitive to the user.
  • the user can directly complete the reply to the message on the tablet without returning to the mobile phone to process the message. This can prevent the user from missing important information, and at the same time avoid the user from going back to the mobile phone to process the message, which helps to improve the user's experience.
  • Figure 17 is another set of GUIs provided by an embodiment of the present application.
  • the user is working on a laptop in the room, and the phone is locked and placed in another room by the user.
  • the mobile phone receives a social App message from the user Tom (for example, Happy Birthday!) and a social App message from the user Amy (for example, Happy Birthday!).
  • the mobile phone can send messages of the user Tom and the user Amy to the laptop that the user is focusing on, and the laptop can display a message reminder box 1701 and a message reminder box 1702.
  • the first message reminder box 1701 contains the source of the message (for example, the message belongs to a social App message, and the message comes from the P40 of the user Lily), and the information of the user who sent the message (for example, "Tom" and the user Tom ’S avatar), the content of the message (for example, Happy Birthday!), and the control 1703.
  • the second message reminder box 1702 contains the source of the message (for example, the message belongs to a social app, and the message comes from the P40 of user Lily), the information of the user who sent the message (for example, "Amy” and the avatar of user Amy) ), the content of the message (for example, Happy Birthday! and the reply control.
  • the source of the message for example, the message belongs to a social app, and the message comes from the P40 of user Lily
  • the information of the user who sent the message for example, "Amy" and the avatar of user Amy
  • the content of the message for example, Happy Birthday
  • the notebook computer When the notebook computer detects that the user clicks on the control 1703, it can display the GUI as shown in (b) in FIG. 17.
  • the notebook computer can display a text input box 1704 in the message reminder box, and can also display a sending control 1705 in the text input box 1704. At the same time, the notebook computer can also detect that the user detects the content of the user's reply through the keyboard (for example, Thank you!), and the content of the user's reply can be displayed in the text input box 1704.
  • the notebook computer When the notebook computer detects that the user clicks on the control 1705, the notebook computer can send the reply content to the mobile phone. At the same time, the message reminder box 1701 on the laptop can be automatically hidden. The changes of the GUI on the mobile phone can be seen from (c) to (f) in Figure 17.
  • the mobile phone can directly pull up the display interface of the social application App on the lock screen interface.
  • the display interface can display the historical chat records of user Tom, user Amy, user Sam, user Lucy, and user Mike in the order of the time when the message is received.
  • the answering interface of a friend's video call and voice call in some social apps can be directly displayed on the lock screen interface of the mobile phone.
  • the mobile phone by adding (flags) attributes supporting lock screen loading in the social App, the mobile phone can directly pull up the display interface of the social App on the lock screen interface.
  • the mobile phone enters the lock screen state after completing the actual reply to the message.
  • the message reminder box 1701 may disappear; and the message reminder box 1702 may continue to be displayed on the notebook computer. After a period of time, if the user does not reply to the user Amy on the laptop, the message reminder box 1702 can be automatically hidden.
  • the message prompt information of the user Tom on the lock screen interface can be automatically hidden; and the message prompt of the user Amy can continue to be displayed on the lock screen interface.
  • the notebook computer can automatically turn on the camera to collect the user's facial information while detecting the user's keyboard to detect the content of the user's reply. While the laptop computer sends the user's reply to the user, it can also send the collected face information to the mobile phone. When the mobile phone determines that the facial information collected by the laptop computer matches the facial information preset in the mobile phone, the mobile phone can complete a true reply to the message. At the same time, because the facial information collected by the laptop matches the facial information preset in the mobile phone, the mobile phone can automatically unlock and enter the non-lock screen state. Thereby, the reply process shown in (c) to (e) in FIG. 17 is realized.
  • the laptop computer while the laptop computer sends the user's reply content to the mobile phone, the laptop computer can also send the user's face information collected by the laptop computer to the mobile phone.
  • the mobile phone can first determine whether it is the user's own reply based on the facial information. If the user responds in person, the mobile phone completes the actual reply to the notification message; otherwise, the mobile phone does not need to reply to the notification message. This helps to improve the protection of the user's privacy by the mobile phone and enhances the user's experience.
  • Figure 18 is another set of GUIs provided by an embodiment of the present application.
  • the user is driving at this time, and the display on the car machine shows that the user is using navigation.
  • the mobile phone is placed in the storage slot of the car by the user.
  • the mobile phone receives a social App message (for example, Happy Birthday! from the user Tom.
  • the mobile phone can send this message to the user's vehicle, and the vehicle displays a message reminder box 1801 on the display screen.
  • the message reminder box 1801 may include the source of the message (for example, the message belongs to a social App message, and the message comes from the P40 of the user Lily), and the information of the user who sent the message (for example, "Tom" and the avatar of the user Tom) , The content of the message (for example, Happy Birthday!).
  • the car machine can also prompt the user through a voice reminder, "Tom sends you Happy Birthday! through the social app.
  • the message reminder box displayed on the display screen of the vehicle machine may not include the sending control.
  • the car machine prompts the user by means of voice reminders, the car machine can collect the content of the user's reply through the microphone. As shown in the figure, the user replied "Thank you!. At this time, the vehicle can display the content of the user's reply through the message reminder box 1801.
  • a DSP may be included on the vehicle.
  • the DSP can process the voice information, so that the text content corresponding to the voice information can be analyzed.
  • an ASR module may be included on the vehicle, where the main function of the ASR module is to recognize the user's voice information as text content.
  • the message reminder box displayed on the display screen of the car machine may also include a sending control. After the user clicks the sending control, the car machine can send the content of the user's reply to the mobile phone. Or, the message reminder box may not include the sending control. After the car machine collects the user's voice message "Thank you for Tom's reply! through the microphone, the car machine can send the user's reply to the mobile phone.
  • the reply button on the message reminder box can also be mapped to the button on the steering wheel, so that the user can directly click the button on the steering wheel to make a voice reply, thereby further improving driving safety.
  • the content of the reply from the car machine to the mobile phone may be voice information or text content.
  • the mobile phone after the mobile phone receives the reply content sent by the car machine, it can directly pull up the display interface of the social application App on the lock screen interface.
  • the display interface can sequentially display the historical chat records of the user Tom, the user Sam, the user Lucy, and the user Mike according to the order of the time when the message is received.
  • the mobile phone can automatically open the user Tom's chat interface.
  • the message (Happy Birthday!) sent by the user Tom to the user Lily can be displayed on the chat interface.
  • the mobile phone can automatically reply the text content corresponding to the voice message to the user Tom. Or, referring to the GUI shown in (d) in FIG. 18, the mobile phone can reply the voice message to the user Tom.
  • a text-to-speech function can be added to the receiving end device.
  • it helps increase the safety and convenience of users using message notification forwarding, and helps improve user experience.
  • Figure 19 is another set of GUIs provided by an embodiment of the present application.
  • the user is working on a laptop in the room, and the phone is locked and placed in another room by the user.
  • the mobile phone receives a social App message from the user Tom (for example, please send me the project plan).
  • the mobile phone can send this message to the laptop that the user is focusing on, and the laptop can display a message reminder box 1901.
  • the message reminder box 1901 contains the source of the message (for example, the message belongs to a social App message, and the message comes from the P40 of the user Lily), and the information of the user who sent the message (for example, "Tom" and the avatar of the user Tom ), the content of the message (for example, please send me the project plan) and control 1902.
  • the notebook computer when the notebook computer detects that the user clicks on the control 1902, the notebook computer can display the input box 1903 and the sending control 1904. After the notebook computer detects the user's operation of dragging and dropping the project plan (word document) on the notebook computer desktop into the input box 1903, the notebook computer can send the project plan (word document) to the mobile phone. Or, after the notebook computer detects that the user drags the project plan (word document) on the notebook computer desktop to the input box 1903 and the user clicks the operation of the control 1904, the notebook computer can send the project plan (word document) to the mobile phone.
  • the display interface of the mobile phone after receiving the project plan (word document) sent by the notebook computer can refer to (c) to (f) in FIG. 19.
  • the mobile phone can directly pull up the display interface of the social application App on the lock screen interface.
  • the display interface can sequentially display the historical chat records of the user Tom, the user Sam, the user Lucy, and the user Mike according to the order of the time when the message is received.
  • the mobile phone can automatically open the user Tom's chat interface.
  • the chat interface is opened, the message sent by user Tom to user Lily can be displayed on the chat interface (please send me the project plan).
  • the mobile phone can send the project plan (word document) to the user Tom.
  • the mobile phone completes the reply, it can return to the state before receiving the notification message.
  • the sink device may send the attachment to the source device.
  • the attachments can be files of types such as pictures, videos, audios, and documents.
  • the user can complete the same interaction as the mail email in the notification, which increases the convenience for the user to use the message notification forwarding, and helps to improve the user experience.
  • Fig. 20 is another set of GUIs provided by an embodiment of the present application.
  • the mobile phone receives a social App message (for example, Happy Birthday!) from the user Tom.
  • the mobile phone can send this message to the laptop that the user is focusing on, and the laptop can display a message reminder box 2001.
  • the notebook computer detects that the user has clicked the operation of the message reminder box 2001, it can display the GUI as shown in (b) in FIG. 20.
  • the notebook computer when the notebook computer detects that the user has clicked a certain position in the message reminder box, the notebook computer can display another message reminder box 2002. Compared with the message reminder box 2001, the message reminder box 2002 is more in line with the display style of the PC-side social app.
  • the laptop After the laptop detects that the user enters the reply content (for example, Thank you!) in the input box of the message reminder box 2002 and clicks the operation of the send control, it can send the user's reply content to the mobile phone.
  • the mobile phone can automatically pull up the chat interface with the user Tom after receiving the content of the user's reply, so as to automatically complete the real reply to the message.
  • the laptop can continue to display the message reminder box 2003.
  • the message reminder box 2003 may contain the content that the user just replied (for example, Thank you!).
  • the notebook computer can detect the reply content entered by the user and after detecting that the user has clicked the send control 1704, The reply content is sent to the mobile phone. While being sent to the mobile phone, the message reminder box 1701 can disappear automatically. When the mobile phone receives the message next time, the notebook computer can continue to display the message reminder box. As for the message reminder box in the GUI shown in (b) in Figure 20, the user can keep it after replying to the message. When the notebook computer detects that the user closes the message reminder box 2002, the notebook computer can close the message Reminder box 2002.
  • the message reminder box 2002 also includes a scroll bar 2004.
  • the notebook computer detects that the user uses the mouse to slide the scroll bar 2004 up, the notebook computer can request the mobile phone for the historical chat records with the user Tom. Thereby, more chat content can be displayed through the message reminder box 2003.
  • Figure 21 is another set of GUIs provided by an embodiment of the present application.
  • the user Lily is currently using a laptop, and the mobile phone is placed aside by the user Lily.
  • the mobile phone receives a video call request from user Tom.
  • the mobile phone can forward the message to the laptop that the user is focusing on, and the laptop can display a message reminder box 2101.
  • the message reminder box 2101 contains the source of the message (for example, the name of the social app, and the message comes from the P40 of user Lily), the information of the user who sent the message (for example, "Tom" and Tom's avatar), and prompt information (For example, "Tom invited you to have a video call") and controls 2102 and 2103.
  • the laptop detects that the user has clicked on the control 2103, and can turn on the camera to collect the user's face information, and send the collected face information to the mobile phone (user Lily's face) Information) and instruction information, the instruction information is used to instruct the mobile phone to connect to the video call.
  • the mobile phone can connect to the video call and display the video call interface.
  • the face information (the face information of user Lily) displayed in the small window 2104 in the video call interface is the face information collected by the camera of the notebook computer.
  • the mobile phone may also send the image information collected by the device of the user Tom received by the mobile phone to the notebook computer, and the notebook computer may display a window 2105 when receiving the face information collected by the device of the user Tom.
  • the window 2105 can display the face information of the user Tom sent by the mobile phone and the face information of the user Lily collected by the camera of the laptop computer.
  • the window 2105 also includes a control 2106.
  • the mobile phone may also connect to the video call without displaying the video call interface after receiving the instruction information.
  • the mobile phone receives the facial information collected by the device of the user Tom, the facial information can be sent to the notebook computer.
  • the notebook computer when the notebook computer detects that the user clicks on the control 2106, it can send instruction information to the mobile phone, and the instruction information is used to instruct the mobile phone to stop the video call with the user Tom. In response to receiving the instruction information, the mobile phone can hang up the video call.
  • Figure 22 is another set of GUIs provided by an embodiment of the present application.
  • the mobile phone receives a voice call request from user Tom.
  • the mobile phone can forward the message to the laptop that the user is focusing on, and the laptop can display a message reminder box 2201.
  • the message reminder box 2201 contains the source of the message (for example, the name of the social app, and the message is from the P40 of user Lily), the information of the user who sent the message (for example, "Tom” and Tom's avatar), and prompt information (For example, "Tom invited you to make a voice call") and controls 2202 and 2203.
  • the notebook computer detects that the user has clicked on the control 2203, and can collect the audio information sent by the user Lily through the microphone, and send the collected audio information and instructions to the mobile phone. The information is used to instruct the mobile phone to connect to the voice call.
  • the mobile phone can connect to the voice call and display the voice call interface.
  • the voice call interface includes the prompt message "Voice call with Tom" and the duration of the voice call "00:05".
  • the mobile phone may also send the audio information of the user Tom received by the mobile phone to the notebook computer, and the notebook computer may display a window 2204 when receiving the audio information of the user Tom.
  • the audio information of the user Tom sent by the mobile phone can be displayed in the window 2204.
  • the window 2204 also includes a control 2205.
  • the mobile phone may also connect the voice call without displaying the voice call interface after receiving the instruction information. After the mobile phone receives the audio information of the user Tom, it can send the audio information to the notebook computer.
  • the notebook computer when the notebook computer detects that the user clicks on the control 2205, it can send instruction information to the mobile phone, and the instruction information is used to instruct the mobile phone to stop the voice call with the user Tom. In response to receiving the instruction information, the mobile phone can hang up the voice call.
  • the mobile phone may also judge the notification type of the message. If the notification type corresponding to the message is a notification type message that is allowed to be forwarded, then the mobile phone can forward the notification message to the notebook computer; and/or the mobile phone can also judge the user's focus device before sending the message to the notebook computer . If the user's focus device is in the list of devices allowed to be forwarded, then the mobile phone can forward the notification message to the notebook computer.
  • process of selecting the notification type by the mobile phone can refer to the description in the embodiment corresponding to FIG. 13 and the process of selecting the receiving device by the mobile phone can be combined with the description in the embodiment corresponding to FIG. No longer.
  • Figure 23 is another set of GUIs provided by an embodiment of the present application.
  • the mail application of the mobile phone 201 receives a new e-mail, and the mobile phone 201 pops up a window 2311 through the display 2310 to remind the user to receive the new e-mail. If the mobile phone 201 handles the off-screen unused state, or the mobile phone 201 is not in front of the user, the user cannot perceive the notification of the mobile phone 201 in time, and may miss important emails.
  • the mobile phone 201 can determine that the notification needs to be prompted by other devices according to the type of notification (for example, screen off notification) and the type of notification service (for example, mail), which can increase the interaction and coordination capabilities between devices to avoid The user misses an important email.
  • the type of notification for example, screen off notification
  • the type of notification service for example, mail
  • the mobile phone 201 can select a suitable device (as a notification device) among the devices that are networked with the mobile phone 201 for prompting, and the mobile phone 201 can select a suitable device (as a connection device) among the devices that are networked with the mobile phone 201.
  • the task of notification Select the notification device and the connection device from the devices in the network to ensure the security of data access and information transmission between devices.
  • the devices that are networked with a mobile phone may include a tablet computer 206, a watch 202, a smart TV 205, and a notebook 204.
  • a tablet computer 206 For the process of network connection between the mobile phone and other devices, refer to (a) to (c) in Figure 3 above.
  • the process of establishing connections between Chinese mobile phones and other devices will not be repeated here.
  • the mobile phone 201 can learn that the watch 202 is worn on the user.
  • the watch 202 has interactive capabilities and can display brief information of notifications.
  • the watch 202 has poor interactive capabilities and is not suitable for replying to emails.
  • the mobile phone can transfer important notifications to the watch 202 for prompting, which can increase the interaction and collaboration capabilities between devices, so as to prevent users from missing important notifications, and to obtain the latest notifications quickly and conveniently.
  • the mobile phone 201 can also know that the notebook 204 is closest to the watch 202 (it can be considered that the notebook 204 is the closest to the user).
  • the notebook 204 has better display capabilities and interactive capabilities, and is suitable for processing emails. Therefore, the mobile phone 201 can select the notebook 204 as a connection device to perform notification tasks (ie, process emails).
  • the process of the mobile phone learning that the watch 202 is worn on the user and the process of the mobile phone 201 learning that the notebook 204 is closest to the watch 202 can refer to the specific implementation process in the following embodiments.
  • the mobile phone 201 can send a reminder message to the watch 202.
  • the reminder message is used to remind the mobile phone 201 to receive an email on the watch 202, and is used to notify that the notebook 204 is suitable as a connecting device to process emails.
  • the reminder message may include the notification in the mobile phone 201.
  • Information and information of the notebook 204 are used to remind the mobile phone 201 to receive an email on the watch 202, and is used to notify that the notebook 204 is suitable as a connecting device to process emails.
  • the reminder message may include the notification in the mobile phone 201.
  • Information and information of the notebook 204 may include the notification in the mobile phone 201.
  • the watch 202 after the watch 202 receives the prompt message, it can display the prompt text 2341 through the display 2340.
  • the prompt text 2341 is used to remind the user that the mobile phone 201 has received an e-mail, and the display 2340 of the watch 202 returns An interface element can be displayed, such as a shortcut entry 2342, and the corresponding words "notebook view details".
  • the watch 202 detects that the user clicks on the shortcut entry 2342, the watch 202 can send an execution message to the notebook 204 based on the connection device information in the prompt message to trigger the notebook 204 to execute the email.
  • the execution message may include the notebook for Information required to perform the task, for example, the execution message may include one or more of the service intent (Intent), service name, service data, etc., so that after the notebook 204 receives the execution message, the notebook 204 can be automatically pulled up
  • Corresponding services or running corresponding applications or programs can improve the collaborative processing capabilities between devices and improve the efficiency of information processing.
  • the notebook 204 after the notebook 204 receives the execution message sent by the watch 202, it can display the corresponding e-mail through the display 2370 without opening the corresponding e-mail from the e-mail application portal, and the e-mail application It does not need to be in the running state (including background running) before receiving the execution message.
  • the user can directly process emails in the notebook 204 through one interaction with the watch 202, which saves operations, improves display efficiency, and enhances user experience.
  • Figure 24 is another set of GUIs provided by an embodiment of the present application.
  • the display screen 2370 of the notebook 204 can pop up a window 2371 to remind the user that the notebook 204 has received the e-mail.
  • the notebook 204 can determine whether the user's focus is on the notebook 204 by turning on the camera. Exemplarily, the notebook 204 can turn on the camera to collect the facial information of the user. If the facial information is not collected through the camera, the notebook 204 can select the prompt device and the connection device. Exemplarily, the notebook 204 can select the watch 202 as the reminder device and the notebook 204 as the connection device.
  • the shortcut entry 2342 can be clicked.
  • the watch 202 sends an execution message to the notebook 204, as shown in (c) in Figure 24.
  • the notebook 204 can pull up the email service and open the corresponding email. You can directly process e-mails and reply to e-mails. The user can directly process emails in the notebook 204 through one interaction with the watch 202.
  • Figure 25 is another set of GUIs provided by an embodiment of the present application.
  • the mobile phone 201 has received a video playback update notification in the background of the video application, and the mobile phone 201 can pop up a window 2312 on the display screen 2310 to remind the user that the basketball game has been updated. If the user cannot perceive the notification of the mobile phone 201 in time, he may miss the latest basketball game.
  • the mobile phone 201 can determine that the notification needs to be reminded by other devices according to the type of notification (for example, screen off notification) and the type of notification service (for example, video application), which can increase the interaction and coordination capabilities between devices to Prevent users from missing the latest basketball game.
  • the type of notification for example, screen off notification
  • the type of notification service for example, video application
  • the mobile phone 201 can learn that the tablet computer 206 is being used by the user, and the tablet computer 206 can display notifications and can prompt the user immediately. Therefore, the mobile phone 201 can select the tablet computer 206 as a reminder device.
  • the mobile phone 201 can also learn that the smart TV 205 and the notebook 204 are close to the tablet computer 206, and both the smart TV 205 and the notebook 204 have better display capabilities and are suitable for playing videos. Therefore, the mobile phone 201 can push the smart TV 205 and the notebook 204 to the user, and the user selects which one as the connection device to perform the notification task (that is, play a basketball game).
  • the process in which the mobile phone 201 learns that the tablet computer 206 is being used by the user and the mobile phone 201 learns that the smart TV 205 and the notebook 204 are close to the tablet computer 206 may refer to the following specific implementation process.
  • the tablet computer 206 pops up a window 2321 on the display screen 2320.
  • the window 2321 is used to remind the user that the mobile phone 201 has received the notification of the basketball game update, and the window 2321 It can be displayed as a status bar or banner notification.
  • the window 2321 can also display two shortcut entrances, the words "Smart Screen View” corresponding to the shortcut entrance 2322, and the words "Notebook View” corresponding to the shortcut entrance 2323.
  • the quick entry 2322 can be clicked on.
  • the quick entry 2323 can be clicked on.
  • An exemplary user wants to watch a basketball game through the smart TV 205, and clicks on the shortcut entrance 2322.
  • the tablet computer 206 sends an execution message to the smart TV 205 to trigger the smart TV 205 to play a basketball game.
  • the smart TV 205 executes the notified task, opens the video application, calls the corresponding Activity, and plays the basketball game, without the user having to open it and install it in the smart TV 205. If there is a corresponding video application, the video service will be directly launched and the basketball game will be played, which saves the user's operation and enhances the user experience.
  • Figure 26 is another set of GUIs provided by an embodiment of the present application.
  • the display screen 2310 of the mobile phone 201 displays a window 2313 and a shortcut entry 2314, and the words "smart screen view" corresponding to the shortcut entry 2314 are displayed.
  • the quick entry 2314 can be clicked on.
  • the mobile phone 201 sends an execution message to the smart TV 205, and the smart TV 205 executes the notified task after receiving the execution message.
  • the smart TV 205 plays a basketball game.
  • the user can directly play a basketball game on the smart TV 205 through one interaction with the mobile phone 201.
  • Figure 27 is another set of GUIs provided by an embodiment of the present application.
  • the mobile phone 201 can pop up a window 2312 on the display screen 2310 to remind the user that the basketball game has been updated. If the tablet computer 206 is being used by the user at this time, and there is no device around the user with a larger display screen than the tablet computer 206, the mobile phone 201 can select the tablet computer 206 as the prompt device and send a prompt message to the tablet computer 206.
  • a window 2324 pops up on the display 2320 of the tablet 206, and the window 2324 can also display a shortcut entry 2325.
  • the shortcut entry 2325 corresponds to the words "View on Tablet ".
  • the shortcut entry 2325 can be clicked on.
  • the tablet computer 206 pulls up the corresponding video service and plays a basketball game. The user can directly play a basketball game on the tablet computer 206 through one interaction with the tablet computer 206.
  • Figure 28 is another set of GUIs provided by an embodiment of the present application.
  • the mobile phone 201 is performing an operation.
  • the operation is a camera operation, and the mobile phone 201 may display a camera window 2315 on the display screen 2310.
  • the operation may also be a photographing operation, a call operation, a video playback operation, a music playback operation, and so on.
  • the watch 202 and the smart TV 205 are both networked with the mobile phone 201, and the mobile phone 201 learns that the watch 202 is worn by the user, and the watch 202 can display notifications and can prompt the user immediately. Therefore, the mobile phone 201 can select the watch 202 as a reminder device.
  • the mobile phone 201 learns that the smart TV 205 is closer to the watch 202, and the smart TV 205 has better display capabilities and is suitable for video calls.
  • the video call application of the mobile phone 201 receives the notification of the video call request in the background. As shown in (b) of FIG. 28, the mobile phone 201 can pop up a window 2316 on the display screen 2310 to remind the user that there is a new video call request. If the request for a video call is accepted on the mobile phone 201, the video call application will call the camera of the mobile phone 201, and the mobile phone 201 will interrupt the camera. The mobile phone 201 can determine that the notification needs to be reminded by other devices according to the type of notification (for example, bright screen notification) and the type of notification service (for example, video call application), which can increase the interaction and collaboration capabilities between devices. In order to prevent the mobile phone 201 from interrupting the video recording due to the execution of the video call. The mobile phone can send a reminder message to the watch 202.
  • the type of notification for example, bright screen notification
  • the type of notification service for example, video call application
  • the watch 202 receives the prompt message, and the watch 202 reminds the user through the display 2340 that the mobile phone 201 has received the notification of the video call request.
  • the display screen 2340 can also display the shortcut entry 2343, and the words "smart screen connected" corresponding to the shortcut entry 2343.
  • the quick entry 2343 can be clicked on.
  • the smart TV 205 starts the corresponding video call service, calls the corresponding activity (Activity), and calls the camera and audio module of the smart TV 205. Perform the task of the notification, that is, make a video call.
  • Figure 29 is another set of GUIs provided by an embodiment of the present application.
  • the mail application of the mobile phone 201 receives a new e-mail, and the mobile phone 201 pops up a window 2311 through the display 2310 to remind the user to receive the new e-mail.
  • the mobile phone 201 handles the off-screen unused state, or the mobile phone 201 is not in front of the user, the user cannot perceive the notification of the mobile phone 201 in time, and may miss important emails.
  • the mobile phone 201 can determine that the notification needs to be prompted by other devices according to the type of notification (for example, screen off notification) and the type of notification service (for example, mail), which can increase the interaction and coordination capabilities between devices to avoid The user misses an important email.
  • the mobile phone can select the watch 202 as the reminder device and the notebook 204 as the connection device.
  • the mobile phone 201 can send a reminder message to the watch 202.
  • the watch 202 after the watch 202 receives the prompt message sent by the mobile phone 201, it can display the prompt text 2341 through the display 2340, which is used to prompt the user Lily's mobile phone (P40) to receive an email ,
  • the display screen 2340 of the watch 202 may also display an interface element, such as a shortcut entry 2342, and the corresponding words "notebook view details".
  • the mobile phone 201 After the mobile phone 201 sends a reminder message to the watch 202, if the mobile phone detects the user's operation of picking up the mobile phone, the mobile phone 201 can send another reminder message to the watch 202.
  • the other reminder message can carry the information of the new connection device.
  • the new connection device may be a mobile phone 201.
  • the watch 202 can update the information of the shortcut entry displayed on the display screen 2340.
  • the shortcut entry 2342 can be updated to the shortcut entry 2343, and the corresponding wording of the shortcut entry 2343 is "View details on the mobile phone".
  • the watch 202 after the watch 202 receives another prompt message sent by the mobile phone 201, it can also add another interface element on the display 2340, such as a shortcut entry 2343, and the corresponding words "View on mobile Details".
  • the information of the notebook may be carried in the prompt message sent to the watch.
  • the mobile phone detects that the user picks up the mobile phone, the mobile phone can determine that the mobile phone is the device closest to the user. Then the mobile phone can carry the information of the mobile phone in another prompt message sent to the watch, so that the watch can dynamically update the information of the connected device. It is convenient for users to view the contents of emails on the device closest to them.
  • the user needs to open the camera application on the terminal to take a photo.
  • the GUI shown in (a) in Figure 30 is a main interface 3010 displayed by a terminal such as a smart phone.
  • the interface 3010 displays a page on which application icons are placed.
  • the page includes multiple icons (for example, clock Application icon, calendar application icon, gallery application icon, memo application icon, file management application icon, browser application icon, camera application icon, etc.).
  • a page prompt 3011 is also displayed below the multiple application icons to indicate the positional relationship between the currently displayed page and other pages.
  • the above-mentioned page may also include multiple application icons and page indicators.
  • the page indicator may not be a part of the page and exist alone.
  • a status bar 3012 is displayed in the upper part of the interface 3010.
  • the status bar 3012 may include: one or more signal strength indicators of mobile communication signals (also called cellular signals), battery status indicators, time indicators, and many more.
  • the status bar 3012 may also display a Bluetooth on indicator.
  • the user can operate the terminal through preset gestures, such as returning to the main interface, displaying opened applications, etc.
  • the application does not limit the specific operating gestures. Not limited to gesture operations, the terminal can perform related operations through virtual keys or physical keys.
  • the GUI shown in (b) in Figure 30 is the interface 3020 of the camera application.
  • the interface 3020 includes a preview area 3021 of the subject, a shooting button 3022, a thumbnail button 3023 of the latest photo in the gallery, and a front and rear camera switch button 3024, etc.
  • the camera application interface 3020 also includes a camera camera focus adjustment button 3025, and the user can adjust the camera camera focus by dragging the button 3025.
  • the user can click the shooting button 3022 to shoot.
  • the terminal responds to this operation and displays the camera interface as shown in (c) in Figure 30 after obtaining the photo.
  • the thumbnail button 3023 of the latest photo in the gallery displays the one just taken.
  • the thumbnail of the photo is the thumbnail of the photo.
  • the user can click the thumbnail button 3023 of the latest photo in the gallery in (c) in FIG. 30, and the terminal displays a picture display interface 3040 as shown in (d) in FIG. 30 in response to this operation.
  • the picture display interface 3040 displays a picture 3041 and a menu 3042.
  • the menu 3042 includes a share button 3043, a favorite button 3044, an edit button 3045, a delete button 3046, and a more button 3047.
  • the share button 3043 can be used to trigger the opening of the picture sharing interface.
  • the favorite button 3044 can add the picture 3041 to the favorite folder.
  • the edit button 3045 can be used to trigger editing functions such as rotation, trimming, adding filters, and blurring of the picture 3041.
  • the delete button 3046 can be used to trigger the deletion of the picture 3041.
  • the more button 3047 can be used to open more picture-related functions.
  • the terminal may receive the user's input operation (for example, click) on the sharing button 3043 in (d) in FIG. 30, and in response to the input operation, the terminal may display a file sharing interface 3050 as shown in (e) in FIG. 30.
  • the file sharing interface 3050 includes an area 3051, an area 3057, and an area 3059. in:
  • the area 3051 may be used to display one or more pictures or videos in the gallery, and the one or more pictures or videos may include a picture or video selected by the user, for example, a picture 3052 has been selected. Among them, a mark 3054 may be displayed on the selected picture 3052, and the mark 3054 may be used to indicate that the corresponding picture 3052 is selected by the terminal.
  • the area 3051 also displays a control 3055 and a control 3056, and the control 3055 and the control 3056 can switch and update the picture displayed in the area 3051.
  • the picture or video screen displayed in the area 3051 may be a thumbnail.
  • Area 3057 can be used to display options for nearby devices discovered by the terminal and one or more user options. This user option corresponds to nearby devices discovered by the terminal. Among them, the terminal may display a search prompt 3058 in the area 3057 when searching for nearby devices.
  • One or more service options can be displayed in the area 3059.
  • the application corresponding to the service option can support sharing the picture selected by the user to a contact or server. Users can share data through the application corresponding to the service option. For example, sharing the selected picture to one or more contacts of WeChat, or sharing the selected picture to the dynamic publishing platform (ie server) of WeChat.
  • the user can click the nearby device option in the picture sharing interface to share the selected picture to nearby devices.
  • the terminal may display nearby device options or user options corresponding to nearby devices in area 3057 after searching for nearby devices, for example, user option 3061.
  • the terminal may receive an input operation (for example, a click) of the user option 3061 from the user, and in response to the input operation, the terminal may establish a communication connection with the device corresponding to the user option 3061, and then communicate to the device corresponding to the user option through the communication connection Transfer the selected pictures.
  • an input operation for example, a click
  • the system 31 includes a first device mobile phone 310 and a nearby second device.
  • the second device includes a mobile phone 311, a personal computer (PC) 312, and so on.
  • FIG. 31 exemplarily shows some application scenarios of the embodiments of the present application, and a mobile phone 311 and a personal computer (PC) 312 are on the right side of the mobile phone 310.
  • the three devices in FIG. 31 are in the near field connection state.
  • the lightning icon 313 and the lightning icon 314 respectively indicate that the mobile phone 310 and the mobile phone 311 and the personal computer (PC) 312 are in the near field connection state.
  • the first device may be a mobile phone, a personal computer (PC), a tablet computer (PAD), or the like.
  • the second device may also be a mobile phone, a personal computer (PC), a tablet computer (PAD), etc.
  • FIG. 31 only exemplarily uses two second devices around the first device as an example to explain the present application, which should not constitute a limitation.
  • the user can trigger to open the camera application on the mobile phone 310, click the camera button, and send the thumbnail of the picture obtained by taking the picture to other devices.
  • the other device and the mobile phone 310 are in a near field connection state, and they log in with the same ID.
  • Fig. 32(a) contains a mobile phone 310 and a personal computer (PC) 312.
  • the figure exemplarily shows the interface 3210 of the camera application of the mobile phone 310.
  • This interface 3210 is similar to the one shown in Fig. 30(b)
  • the interface 3020 is the same. Therefore, the text description of the interface 3020 in (b) in FIG. 30 is also applicable to the interface 3210 of the mobile phone 310 in (a) in FIG. 32, and will not be repeated here.
  • the user can click the shooting button 3211 to take a shot. At this time, the thumbnail button 3212 of the latest photo in the gallery displays the thumbnail of the photo just taken.
  • the mobile phone 310 After the mobile phone 310 takes a photo, it will send the thumbnail information of the photo just taken to other devices that are in a near field connection state and log in with the same ID as the mobile phone 310 through a near field communication method (such as Bluetooth, Wi-Fi, etc.).
  • a personal computer (PC) 312 that is connected and logged in with the same ID detects an interactive event (such as a mouse sliding operation, etc.), it will display a notification of the photo thumbnail as shown in Figure 32 (a) on the desktop frame.
  • a notification box 3216 appears in the lower right corner of the desktop interface 3215 of the personal computer (PC) 312, and a partial enlarged view 3218 of the notification box 3216 is shown in the figure.
  • the notification frame 3216 displays a thumbnail of the latest photo just taken by the mobile phone 310, and a download button 3217 is displayed in the upper right corner of the notification frame 3216.
  • the personal computer (PC) 312 can receive the user's click operation on the thumbnail in the notification box 3216.
  • the user uses a mouse to place the cursor 3221 on the thumbnail in the notification box 3216.
  • the left mouse button click operation the figure shows a partial enlarged view 3218 of the notification box 3216.
  • the personal computer (PC) 3212 will send an original photo request message to the mobile phone 310, and the mobile phone 310 will send the original photo of the latest photo just taken to the personal computer (PC) 312 in response to the original photo request message.
  • the personal computer (PC) 312 invokes the photo viewer to display the photo just taken by the mobile phone 310, as shown in (c) of FIG. 32.
  • the personal computer (PC) 312 when the mobile phone 310 takes a photo and sends the thumbnail of the photo to the personal computer (PC) 312, the personal computer (PC) 312 is currently opening a document editing program (such as a Word program) and is in an editing state. As shown in (d) in Figure 32, the editing cursor 3241 is at a certain position of the Word document, and the user slides the mouse (without pressing the left or right mouse button), and a notification box 3242 of thumbnails appears near the editing cursor 3241. . If the user clicks on the thumbnail in the notification box 3242, the personal computer (PC) 312 will send an original photo request to the mobile phone 310.
  • a document editing program such as a Word program
  • the mobile phone 310 sends the original photo of the latest photo just taken to the personal computer (PC) 312.
  • the personal computer (PC) 312 inserts the original photo at the position of the editing cursor 3241 of the document.
  • the notification box 3242 of the thumbnail is displayed at the editing cursor 3241, if the user does not want to use the picture, he can click the left mouse button at another location, and the notification box 3242 of the thumbnail will disappear at this time.
  • the personal computer (PC) 312 detects the user's click operation on the thumbnail in the thumbnail notification box and requests the original photo from the mobile phone 310.
  • the mobile phone 310 sends the original photo to the personal computer (PC) 312, it will send a message to the mobile phone 311 that has not requested the original photo to notify the deletion of the photo thumbnail.
  • the subsequent mobile phone 311 will not display the photo thumbnail to the user even if an interaction event is detected. Notification message. This improves the purpose of image transmission and avoids interference with other devices.
  • the personal computer (PC) 312 after the personal computer (PC) 312 displays the notification box 3216, it can receive the user's drag operation of the thumbnail in the notification box 3216. As shown in (e) in Figure 32, the user can place the mouse cursor on the thumbnail in the notification box 3216, press the left mouse button, and drag the thumbnail to the desktop along the dashed track 3251 (or Other folders). The user drags the thumbnail to the desktop and releases the left mouse button. At this time, the personal computer (PC) 312 will send an original photo request message to the mobile phone 310. In response to the original photo request message, the mobile phone 310 will update the latest photo just taken. The original photo is sent to the personal computer (PC) 312. The personal computer (PC) 312 will display the thumbnail information of the photo and the name information 3261 of the photo on the desktop interface 3215, as shown in (f) in FIG. 32. The user can view the photo by double-clicking and other operations.
  • the user can drag the thumbnail in the notification box 3216 to a target application, such as a document editing program.
  • a target application such as a document editing program.
  • the personal computer (PC) 312 displays that the document editing program is being opened, and a thumbnail notification box 3216 is displayed on the desktop at this time.
  • the user can place the mouse cursor on the thumbnail in the notification box 3216, press and hold the left mouse button, and drag the thumbnail along the dotted line 3271 to the open document editing program.
  • the user drags the thumbnail to an appropriate position in the document editing program and releases the left mouse button.
  • the personal computer (PC) 312 will send the original photo request to the mobile phone 310.
  • the mobile phone 310 sends the original photo of the latest photo just taken to the personal computer (PC) 312.
  • the personal computer (PC) 312 will insert the original photo of the photo in the document editor. The user can perform further operations on the photo later.
  • the user can click the download button 3217 of the thumbnail displayed in the notification box 3216 (as shown in (a) in FIG. 32). This At that time, the personal computer (PC) 312 will send the original photo request to the mobile phone 310. In response to the original photo request message, the mobile phone 310 sends the original photo of the latest photo just taken to the personal computer (PC) 312. The personal computer (PC) 312 saves the original photo in a default folder or a folder designated by the user.
  • the personal computer (PC) 312 after the personal computer (PC) 312 displays the notification box 3216, it will automatically hide the notification box 3216 if it does not receive any operation on the notification box 3216 by the user for a period of time (for example, 10 seconds).
  • the user can subsequently find the thumbnail notification of the photo in the notification bar of the personal computer (PC) 312 to continue the aforementioned click, drag, and download operations.
  • the user can set to hide notifications that do not need to be displayed on the desktop.
  • the currently hidden notification information is displayed in the notification bar expansion window 3282.
  • the figure shows a partial enlarged view 3284 of the notification bar expansion window 3282.
  • the user can find the thumbnail of the photo in the expanded window 3282 of the notification bar and notify 3283 to continue operations, such as clicking, downloading, etc.
  • FIG. 32 described the image sharing method by taking pictures and sharing on the terminal device.
  • the embodiment of this application is also applicable to the image sharing of operations such as scanning and screenshots.
  • the specific GUI embodiment is shown in FIG. 32 Similar to, I won’t repeat them here.
  • the user can trigger the screen capture function of the mobile phone 310 to obtain a screenshot picture, and the mobile phone 310 sends a message waiting for the picture to be received to other devices.
  • the other device and the mobile phone 310 are in a near field connection state, and they log in with the same ID.
  • the other device After receiving the picture pending message, the other device sends a thumbnail request message to the mobile phone 310 if it detects a user interaction event.
  • the mobile phone 310 sends the thumbnail of the picture obtained by the screenshot to the requesting other device.
  • the mobile phone 310 displays a weather application interface 3310.
  • the weather interface 3310 includes current location information, time information, and weather information.
  • the mobile phone 310 can receive a user's screen capture operation (which may be a gesture operation or a physical key operation, etc.), and after the screen capture, a thumbnail 3321 of the screenshot image is displayed at the bottom left of the terminal interface 3310.
  • the mobile phone 310 will send a picture pending message to other devices that are in a near field connection state and log in to the same ID as the mobile phone 310 through a near field communication method (such as Bluetooth, Wi-Fi, etc.).
  • the other device PC 312 detects the user's mouse sliding operation, and sends a thumbnail request message to the mobile phone 310.
  • the mobile phone 310 sends the thumbnail information of the picture just obtained from the screenshot to the mobile phone 310.
  • a notification box 3331 appears in the lower right corner of the desktop interface 3330 of the personal computer (PC) 312, and a partial enlarged view 3333 of the notification box 3331 is shown in the figure.
  • the notification box 3331 displays a thumbnail of the latest photo obtained by the mobile phone 310 just after taking a screenshot, and a download button 3332 is displayed in the upper right corner of the notification box 3331.
  • the personal computer (PC) 312 can receive the user's click operation on the thumbnail in the notification box 3331.
  • the user uses the mouse to place the cursor 3341 on the thumbnail in the notification box 3331.
  • the left mouse button click operation the figure shows a partial enlarged view 3333 of the notification box 3331.
  • the personal computer (PC) 312 will send an original photo request message to the mobile phone 310, and the mobile phone 310 will send the original photo of the latest photo just obtained by the screenshot to the personal computer (PC) 312 in response to the original photo request message.
  • the personal computer (PC) 312 will call the photo viewer to display the photo just taken by the mobile phone 310, as shown in (e) of FIG. 33.
  • the personal computer (PC) 312 when the mobile phone 310 sends the thumbnail to the personal computer (PC) 312 in response to the thumbnail request message, the personal computer (PC) 312 is currently opening a document editing program (such as a Word program) and is in an editing state .
  • a document editing program such as a Word program
  • the editing cursor 3361 is in a certain position of the Word document, and the user slides the mouse (without pressing the left or right mouse button), and a notification box of thumbnails will appear near the editing cursor 3361. 3362. If the user clicks on the thumbnail in the notification box 3362, the personal computer (PC) 312 will send an original photo request to the mobile phone 310. In response to the original photo request message, the mobile phone 310 sends the original photo of the latest photo just taken to the personal computer (PC) 312. After receiving the original photo, the personal computer (PC) 312 inserts the original photo at the position of the editing cursor 3361 of the document. After the notification box 3362 of the thumbnail is displayed at the editing cursor 3361, if the user does not want to use the picture, he can click the left button of the mouse at another location, and the notification box 3362 of the thumbnail will disappear at this time.
  • the personal computer (PC) 312 detects the user's click operation on the thumbnail in the thumbnail notification box and requests the original photo from the mobile phone 310.
  • the mobile phone 310 sends the original photo to the personal computer (PC) 312, and at the same time sends a message to the mobile phone 311 that has not requested the original photo to notify the deletion of the photo thumbnail.
  • the subsequent mobile phone 311 will not display the notification message of the photo thumbnail to the user even if an interaction event is detected. . This improves the purpose of image transmission and avoids interference with other devices.
  • the personal computer (PC) 312 after the personal computer (PC) 312 displays the notification box 3331, it can receive a drag operation of the thumbnail in the notification box 3331 by the user.
  • the user can place the mouse cursor on the thumbnail in the notification box 3331, press the left mouse button, and drag the thumbnail to the desktop along the dashed track 3361 (or other Folder). The user drags the thumbnail to the desktop and releases the left mouse button.
  • the personal computer (PC) 312 will send an original photo request message to the mobile phone 310, and the mobile phone 310 will respond to the original photo request message and will capture the latest photo just obtained from the screenshot.
  • the personal computer (PC) 312 will display the thumbnail of the picture and the name information 3371 of the picture on the desktop interface 3330, as shown in (h) in FIG. 33. The user can view the photo by double-clicking and other operations.
  • the user can drag the thumbnail in the notification box 3331 to a target application, such as a document editing program.
  • a target application such as a document editing program.
  • the personal computer (PC) 312 displays that the document editing program is being opened, and a thumbnail notification box 3331 is displayed on the desktop at this time.
  • the user can place the mouse cursor on the thumbnail in the notification box 3331 and hold down the left mouse button, and drag the thumbnail along the dotted line 3381 to the document editing program being opened.
  • the user drags the thumbnail to an appropriate position in the document editing program and releases the left mouse button.
  • the personal computer (PC) 312 will send the original photo request to the mobile phone 310.
  • the mobile phone 310 sends the original photo of the latest photo just obtained by taking a screenshot to the personal computer (PC) 312.
  • the personal computer (PC) 312 will insert the original photo of the photo in the document editor. The user can perform further operations on the photo later.
  • the user can click the download button 3332 of the thumbnail displayed in the notification box 3331 (as shown in (c) in FIG. 33).
  • the personal computer (PC) 312 will send the original photo request to the mobile phone 310.
  • the mobile phone 310 sends the original photo of the latest photo just obtained by taking a screenshot to the personal computer (PC) 312.
  • the personal computer (PC) 312 saves the original photo in a default folder or a folder designated by the user.
  • the notification box 3331 after the personal computer (PC) 312 displays the notification box 3331, the notification box will be automatically hidden if the user does not receive any operation on the thumbnail notification box 3331 for a period of time (for example, 10 seconds).
  • the user can subsequently find the thumbnail of the photo in the status bar of the personal computer (PC) 312 to notify to continue the aforementioned click, drag, and download operations.
  • the user can set to hide notifications that do not need to be displayed on the desktop.
  • the currently hidden notification information is displayed in the notification bar expansion window 3392.
  • the figure shows a partial enlarged view 3394 of the notification bar expansion window 3392.
  • the user can find the thumbnail 3393 of the photo in the expanded window 3392 of the notification bar to continue operations, such as clicking, downloading, and so on.
  • FIG. 33 described the image sharing method by sharing screenshots of terminal equipment.
  • the embodiment of this application is also applicable to the image sharing of photographing, scanning and other operations.
  • the specific GUI embodiment is shown in FIG. 33 The display is similar, so I won’t repeat it here.
  • the user can call the camera function of the mobile phone 310 to take multiple photos continuously within a period of time.
  • the other device and the mobile phone 310 are in a near field connection state, and log in to the same ID.
  • the other device receives the picture waiting message of multiple photos, if a user interaction event is detected, it sends multiple thumbnail request messages to the mobile phone 310.
  • the mobile phone 310 sends the thumbnail of the last photo of the captured multiple photos and the total number of photos to the requesting other device.
  • Fig. 34(a) contains a mobile phone 310 and a personal computer (PC) 312.
  • the figure exemplarily shows the interface 3410 of the camera application of the mobile phone 310.
  • This interface 3410 is similar to the interface shown in Fig. 32(b) 3220 is the same. Therefore, the text description of the interface 3220 in FIG. 32(b) is also applicable to the interface 3410 of the mobile phone 310 in FIG. 34(a), and will not be repeated here.
  • the mobile phone 310 can receive the user's operation (for example, clicking) on the shooting button 3411 for continuous shooting.
  • the thumbnail button 3412 of the latest photo in the gallery at this time displays the last one of the multiple photos just taken continuously.
  • the thumbnail of the photo is exemplarily shows the interface 3410 of the camera application of the mobile phone 310.
  • This interface 3410 is similar to the interface shown in Fig. 32(b) 3220 is the same. Therefore, the text description of the interface 3220 in FIG. 32(b) is also applicable to the interface 3
  • a near field communication method (such as Bluetooth, Wi-Fi, etc.) will be used to send a picture pending message to other devices that are connected and log in with the same ID as the mobile phone 310.
  • the personal computer (PC) 312 of other devices After receiving the message waiting for receiving the pictures of multiple photos, the personal computer (PC) 312 of other devices detects the user's mouse sliding operation, and sends multiple thumbnail request messages to the mobile phone 310. In response to the multiple thumbnail request message, the mobile phone 310 sends the thumbnail of the last photo of the multiple photos just taken and the total number of photos to the personal computer (PC) 312. As shown in (a) of FIG.
  • a notification box 3416 appears in the lower right corner of the desktop of the personal computer (PC) 312, and a partially enlarged view 3419 of the notification box 3416 is shown in the figure.
  • the notification box 3416 displays the thumbnail of the last photo of the multiple photos that the mobile phone 310 has just taken continuously, and the total number of photos icon 3418 is displayed in the upper right corner, and the download button 3417 is also displayed in the upper right corner of the notification box 3416.
  • the personal computer (PC) 312 can receive the user's click operation on the thumbnail in the notification box 3416. For example, the user uses the mouse to place the cursor 3421 on the thumbnail in the notification box 3416. Click the left mouse button, and a partial enlarged view 3419 of the notification box 3416 is shown in the figure. At this time, the personal computer (PC) 312 will send a request message for thumbnails of pictures other than the last picture to the mobile phone 310, and the mobile phone 310 will just delete the last picture in response to the request message for thumbnails of pictures other than the last picture. Send thumbnails of other pictures to the personal computer (PC) 312.
  • the personal computer (PC) 312 receives other picture thumbnails except the last picture, and then combines with the last picture thumbnail that has been received to expand and display multiple thumbnail information 3431 .
  • the icon 3432 is a progress bar, and the user can drag the progress bar left and right to view other undisplayed picture thumbnails.
  • the user can click on one of the thumbnails. For example, the user can use the mouse to place the cursor 3433 on a certain thumbnail to perform a left-click operation.
  • the personal computer (PC) 312 sends an original photo request corresponding to the thumbnail to the mobile phone 310.
  • the mobile phone 310 After receiving the original photo request, the mobile phone 310 sends the original photo to the personal computer (PC) 312. After receiving the original photo, the personal computer (PC) 312 invokes the photo viewer to open the original photo. As shown in (d) in Figure 34, the thumbnail of the photo just clicked has been deleted from the expanded thumbnail notification box 3431, and the personal computer (PC) 312 is opening the folder where the original photo was saved. The thumbnail of the picture and the picture file name icon 3441 are shown.
  • the user can drag one of the thumbnails to the target folder.
  • the user can place the mouse cursor on a certain thumbnail, press the left mouse button, and drag the thumbnail to the desktop along the dashed track 3451 (or other Folder). The user drags the thumbnail to the desktop and releases the left mouse button.
  • the personal computer (PC) 312 will send an original photo request to the mobile phone 310, and the mobile phone 310 will send the original photo corresponding to the thumbnail in response to the original photo request message For personal computer (PC) 312.
  • the personal computer (PC) 312 will display the thumbnail information and file name information 3461 of the photo on the desktop, as shown in (f) in Figure 34. At this time, the thumbnail of the photo just dragged is from the expanded thumbnail Deleted in the notification box 3431. The user can view the photo by double-clicking and other operations.
  • the user can drag one of the thumbnails to a target application, such as a document editing program.
  • a target application such as a document editing program.
  • the personal computer (PC) 312 shows that the document editing program is being opened.
  • the user can place the mouse cursor 3472 on a certain thumbnail and press the left button, along the dotted line Trace 3471 drags the thumbnail into the document editing program.
  • the user drags the thumbnail to a specific location in the document editing program and releases the left mouse button.
  • the personal computer (PC) 312 will send an original photo request to the mobile phone 310.
  • the mobile phone 310 sends the original photo corresponding to the thumbnail to the personal computer (PC) 312.
  • the personal computer (PC) 312 will display the original photo of the photo in the document editor. The user can perform further operations on the photo later.
  • the user can click the download button in the upper right corner of one of the thumbnails.
  • a partial enlarged view 3483 of one of the thumbnails is shown in the figure, and there is a download button 3482 in the upper right corner of the thumbnail.
  • the user can use the mouse cursor to click the download button 3482 in the upper right corner of one of the thumbnails.
  • the personal computer (PC) 312 will send the original photo request to the mobile phone 310.
  • the mobile phone 310 sends the corresponding original photo to the personal computer (PC) 312 in response to the original photo request message.
  • the personal computer (PC) 312 saves the original photo in a default folder or a folder designated by the user.
  • the user can directly check the notification box 3416 Drag and drop thumbnails.
  • the user can place the mouse cursor 3421 on the thumbnail in the notification box 3416, press the left button, and drag the thumbnail to the desktop along the dashed track 3491 (or other
  • the personal computer (PC) 312 will send the original photo request of multiple photos to the mobile phone 310.
  • the terminal sends multiple original photos to the personal computer (PC) 312 in response to the original photo request message for all photos.
  • the personal computer (PC) 312 will automatically create a folder on the desktop to store the received multiple original photos.
  • the user can directly check the notification box 3416 Click the download button 3417 in the upper right corner (as shown in (a) in Figure 34).
  • the user can use the mouse cursor to click the download button 3417 in the upper right corner of the notification box 3416.
  • the personal computer (PC) 312 will send the original photo request of all the photos to the mobile phone 310.
  • the terminal sends multiple original photos to the personal computer (PC) 312 in response to the original photo request message for all photos.
  • the personal computer (PC) 312 can store the received multiple original photos in a designated folder or a default folder.
  • FIG. 34 The embodiment of FIG. 34 is described by taking a photo as an example.
  • the transmission of multiple consecutive photos is also applicable to application scenarios such as screenshots and scanning.
  • the operation is similar to the above embodiment, and will not be further elaborated here.
  • the embodiments of this application all use the same ID as the mobile phone 310, the mobile phone 311 and the personal computer (PC) 312 as an example.
  • the embodiment of the application also supports image transmission between devices that do not belong to the same ID (for example, a Huawei account ID).
  • a list of picture sharing devices can be set on the mobile phone 310 for image transmission in the embodiment of the present application.
  • the ID of the mobile phone 311 and the ID of the personal computer (PC) 312 can be set as a list of picture sharing devices for the mobile phone 310 to share pictures.
  • 35 shows another GUI provided by an embodiment of the present application.
  • the GUI is a picture sharing list device setting interface 3510 of the mobile phone 310.
  • the interface 3510 includes a return button 3511, picture sharing target device ID information 3512, and picture sharing target device ID information 3513, Add button 3514 for picture sharing device.
  • the return button 3511 can trigger the return to the upper level setting menu interface
  • the picture sharing device add button 3514 can trigger the addition of a picture sharing device.
  • the media library monitoring module in the mobile phone 310 can obtain the picture sharing device list information through the interface provided by the setting module in the mobile phone. In this way, when the mobile phone 311 and the personal computer (PC) 312 are in a near field connection state with the mobile phone 310, the mobile phone 310 can share the pictures obtained by taking pictures, scanning, and screenshots to the mobile phone 311 and the personal computer (PC) 312. In this way, users can customize the list of devices for picture sharing and share pictures to designated devices, which improves the user experience.
  • FIG. 36 shows another set of GUI provided by an embodiment of the present application.
  • the first device uses a scanning program to scan a poster to obtain a picture, as shown in (a) in FIG. 36, which contains a character Like, email address and personal blog address, where the email address is joanna@163.com and the personal blog address is www.joanna.blog.com.
  • the first device After the first device obtains the picture, it uses picture recognition technology to extract the email address and personal blog address, packs the thumbnail of the picture, the email address text, and the personal blog address text into a message and sends it to the second device.
  • the second device After the second device detects the interaction event, it displays a notification box to the user.
  • a thumbnail is displayed in the lower right corner of the desktop interface 3610 of the personal computer (PC) 312 Notification box 3611.
  • FIG. 36(b) shows a partial enlarged view 3616 of the thumbnail notification frame 3611.
  • the thumbnail notification frame 3611 includes a thumbnail 3615, a personal blog card address card 3613, an email address card 3614, and a download button 3612.
  • the user can click the personal blog address card 3613 to conveniently access the personal blog, and also click the email address card 3614 to perform operations such as sending emails. In this way, by extracting the key information in the picture and sending it to other required devices, it is convenient for the operation of other devices, and the user experience can be enhanced.
  • Figure 37 shows another set of GUIs provided by an embodiment of the present application.
  • the GUI shown in (a) in FIG. 37 shows a lock screen interface 370.
  • the lock screen interface 370 includes a status bar 3701 and a notification bar 3702, wherein,
  • the status bar 3701 may include: one or more signal strength indicators 3705 of mobile communication signals (also called cellular signals), one or more signal strength indicators 3706 of Wi-Fi signals, Bluetooth indicator 3707, battery status Indicator 3708.
  • the Bluetooth module of the electronic device When the Bluetooth module of the electronic device is turned on (that is, the electronic device supplies power to the Bluetooth module), the Bluetooth indicator 3707 is displayed on the display interface of the electronic device.
  • the notification bar 3702 displays a notification provided by the embodiment of the application.
  • the notification content of the notification describes the source of the notification (for example, Huawei Video) and the brief content of the notification (the new video is online, such as the "TV Drama 1" section).
  • the 9th episode of the second season is online).
  • the notification in the notification bar 3702 also includes a control 3703 and a control 3704.
  • the control 3703 is to watch immediately, and the control 3704 is to select the device to watch.
  • the electronic device detects a user operation on the control 3703 and performs the operation described in the control 3703, that is, after the electronic device is unlocked, it immediately jumps to the video playback interface, that is, immediately plays the 9th episode of the second season of "TV Series 1".
  • Window 37041 includes selectable devices, such as living room TV, bedroom TV, stereo, computer and other equipment.
  • the user selects the device to play video in window 37041. For example, if the user selects the living room TV, the living room TV will jump to the video playback interface. Play the 9th episode of the second season of "TV Series 1" now.
  • the arrangement order of the devices in the window 37041 may be arranged by priority, may be arranged by the signal strength of the devices, or may be arranged randomly, which is not limited in this application.
  • the GUI shown in (c) of FIG. 37 shows a user interface 371 after unlocking.
  • multiple application icons such as settings, mail, video, gallery, etc.
  • the notification bar 3702 is displayed at the top of the user interface 371, and the electronic device displays a notification provided by the embodiment of the present application in the notification bar 3702.
  • the electronic device detects a user operation on the control 3703, it executes the operation described by the control 3703, that is, the electronic device immediately jumps to the video playback interface.
  • the electronic device when the electronic device detects a user operation on the control 3704 and executes the operation described by the control 3704, the electronic device displays a window 37041.
  • the window 37041 includes selectable devices, such as living room TV, bedroom TV, stereo, computer and other equipment, the user selects the device to play the video in the window 37041, then the device jumps to the video Play interface.
  • the notification in the notification bar 3702 may also include different controls.
  • Figure 38 shows another set of GUIs provided by an embodiment of the present application.
  • the notification in the notification bar 3702 may also include a control 3705.
  • the control 3705 recommends only one device for the user, such as a living room TV for viewing.
  • the electronic device detects a user operation on the control 3705, it executes the operation described by the control 3705, sends a request message to the living room TV, and the living room TV plays the relevant content in the notification.
  • the device indicated in the control 3705 can be the device with the highest priority, the device closest to the electronic device, or the device with the highest resolution (the clearest image quality) in the device properties, so that the user does not need to be in multiple devices Make choices to improve the user experience.
  • the notification in the notification bar 3702 further includes a control 3705.
  • the electronic device detects a user operation on the control 3705, it sends a request message to the living room TV, and the living room TV plays the relevant content in the notification.
  • the electronic device sends a request message to the living room TV in response to the user operation, and the living room TV responds to the request message. Play the relevant content in the announcement, that is, episode 9 of the second season of "TV Series 1.”
  • FIG. 39 may also include a function bar 3901.
  • the function bar 3901 includes a back control 3902, a playback control 3903, a fast forward control 3904, a progress bar 3905, and a time progress value 3906.
  • the progress bar 3905 is used to indicate the progress of the video playback.
  • the living room TV detects a user operation that triggers the back control 3902 , The length of the progress bar 3905 becomes shorter; the fast forward control 3904 is used to control the progress of the video playback.
  • the playback control 3903 is used to control the start of the video Play and stop playback.
  • the notification in the notification bar 3702 may also include controls such as "view later” and "view later on TV in the living room".
  • the electronic device detects a user operation on the controls of "View Later” and “View Later Living Room TV”
  • the electronic device outputs the notification on the display screen again after a preset time.
  • the electronic device recognizes that there is no network connection with the TV in the living room, and can display the control of "Viewing the TV in the living room later" in the notification, and the electronic device detects the user for the control of "Viewing the TV in the living room later” Operation: After the electronic device establishes a network connection with the living room TV, it sends a request message to the living room TV, and the living room TV plays the relevant content in the notification.
  • the control may be associated with time information.
  • the notification in the notification bar 3702 may also include controls such as “view in five minutes”, “view in living room TV in five minutes”.
  • the electronic device detects a user operation for the "view in five minutes” control, the electronic device plays the relevant content in the notification five minutes later.
  • the electronic device When the electronic device detects a user operation for the "View on TV in the living room in five minutes” control, the electronic device sends a request message to the TV in the living room after five minutes, and the TV in the living room plays the relevant content in the notification; optionally, when the electronic device Detecting a user operation for the "Living room TV viewing in five minutes” control, the electronic device sends a request message to the living room TV, and the living room TV plays the relevant content in the notification five minutes later.
  • the notification bar 3702 can stay on the user interface 371 for a short time and then disappear automatically without user interaction. If the user does not process the notification in time, the notification bar 3702 will automatically disappear or hide. When the user wants to process the notification information again, he can enter the notification center interface to view the unprocessed notification.
  • FIG. 40 shows another set of GUI provided by an embodiment of the present application.
  • the GUI shows a notification center interface
  • the notification center interface includes an area 4001 and an area 4002.
  • the area 4001 displays multiple switch controls, such as Bluetooth, flashlight, flight mode, and so on.
  • the area 4002 displays multiple notification bars.
  • the notification bar 4003 includes the source of the notification (video software), the time of the notification (2 minutes ago), and the brief content of the notification (the second The 9th episode of the season is now live).
  • the notification bar 4003 also includes an icon 40031. The electronic device detects a user operation on the icon 40031 and expands the notification bar 4003 to display one or more controls.
  • the control 40032 includes an immediate view control 40032, a living room TV view control 40033, and a select device view control 40034.
  • the icon 40031 is optional, and the notification bar 4003 can directly display all the controls, as shown in (b) of FIG. 40, without triggering the icon 40031.
  • the device indicated by the control 40033 may be the device with the highest priority, the device closest to the electronic device, or the device with the highest resolution (the clearest image quality) in the device properties, so that the user does not need to perform the operation in multiple devices. Choose to improve user experience.
  • the control 40034 also includes one or more selectable electronic devices, which can be freely selected by the user to improve the user experience.
  • the electronic device when the electronic device detects a user operation on the control 40033, it performs the operation described by the control 40033, that is, the electronic device sends a request message to the living room TV, and the living room TV responds to the request message and plays the notification in the
  • the relevant content is the 9th episode of the second season of "TV Series 1."
  • the notification bar 4003 will not disappear, and the user can continue to process the notification on the electronic device.
  • the notification bar 4003 displays the status information "Viewing the living room TV", indicating that the notification in the notification bar 4003 is being processed on the living room TV at this time.
  • the electronic device When the electronic device detects a user operation on the icon 40031, it expands the notification bar 4003 to display one or more controls.
  • the electronic device includes stopping the living room TV viewing control 4101, and switching the device viewing control 4102.
  • the electronic device detects a user operation on the control 4101, it performs the operation described by the control 4101, that is, the electronic device sends a request message to the living room TV, and the living room TV stops playing the relevant content in the notification.
  • the electronic device when the electronic device detects a user operation on the control 4102 and executes the operation described by the control 4102, the electronic device displays a list of switchable devices, such as computers, pads and other devices. As shown in (f) in FIG. 40, the electronic device displays a switch pad viewing control 4103 and a switch computer viewing control 4104. The user selects the device to be viewed in the switchable device list.
  • the electronic device detects a user operation for the control 4104 and performs the operation described by the control 4104, the electronic device sends a request message to the living room TV, and the living room TV stops playing the The relevant content in the notification, and the electronic device sends a request message to the computer, and the computer starts to play the relevant content in the notification.
  • (c) in FIG. 40 is optional.
  • the notification center interface as shown in (b) in FIG. 40 when the electronic device detects that the notification in the notification bar 4003 is processed After the user operates, the interface shown in (d) in Figure 40 is displayed.
  • (d) in FIG. 40 and (e) in FIG. 40 are optional.
  • the notification center interface as shown in (c) in FIG. 40 when the electronic device detects the control After the user operation of 40031, an interface as shown in (f) in Figure 40 is displayed.
  • (c) in FIG. 40, (d) in FIG. 40, and (e) in FIG. 40 are optional, and in the notification center interface as shown in (b) in FIG. 40
  • the electronic device detects a user operation for processing the notification in the notification bar 4003, it displays an interface as shown in (f) in FIG. 40.
  • the controls in the notification may change according to changes in the state of the device.
  • the electronic device outputs notification information, the notification information includes a control associated with the target device, the target device is within the communication range of the electronic device, and the control is used to trigger the target device to perform the task in the notification information.
  • the electronic device detects that the target device is not within the communication range of the electronic device, for example, the target device is shut down or disconnected from the network.
  • the electronic device changes the control in the notification information to associate the control with other devices to trigger other devices to perform the tasks in the notification information.
  • Figure 41 shows another set of GUIs provided by an embodiment of the present application.
  • the notification column 4003 outputs notification information.
  • the notification bar 4003 expands, displaying the pad viewing control 40035 and the computer viewing control 40036, prompting the user to also select pad Check with computer.
  • the electronic device detects that the pad is not within the communication range of the electronic device, and the electronic device updates the notification bar 4003.
  • the notification bar 4003 includes controls 40032, control 40033, and control 40034.
  • the notification bar 4003 expands to display the computer viewing control 40036, prompting the user to also select a computer to view.
  • the electronic device detects that the pad is within the communication range of the electronic device, and the electronic device updates the notification bar 4003.
  • the notification bar 4003 includes controls 40032, control 40033, and control 40034.
  • the notification bar 4003 expands, displaying the pad viewing control 40035 and the computer viewing control 40036, prompting the user to also select pad Check with computer.
  • the following uses a smart watch as an example to illustrate a specific application scenario in an embodiment of the present application.
  • Figure 42 shows another GUI provided by an embodiment of the present application.
  • the computer 204 is in a shutdown state (no network connection state) or a standby state; for the smart watch 202, the smart watch 202 does not have the function or permission to check emails.
  • a prompt message 420 is displayed on the display interface of the smart watch 202.
  • the prompt message 420 includes a new mail notification reminder and a control 4201, Control 4201 is for later computer viewing.
  • the smart watch 202 detects a user operation on the control 4201 and executes the operation described by the control 4201.
  • the smart watch 202 detects that the computer is on, it sends an execution message to the computer. After the computer receives the execution message, the computer pops up an email prompt box or directly opens the corresponding email.
  • Figure 43 shows another GUI provided by an embodiment of the present application.
  • the GUI shown in (a) in FIG. 43 is a user interface after the computer receives the execution message, and includes a mail prompt box 4301.
  • the computer detects the user operation for the prompt box 4301, it opens the corresponding email.
  • FIG. 43 exemplarily shows an application interface for opening emails.
  • the computer receives the execution message, it directly opens the corresponding e-mail, that is, the application interface shown in (b) in FIG. 43 is displayed.
  • the smart watch 202 before the smart watch 202 detects a user operation on the control 4201, the smart watch 202 continuously monitors peripheral devices; when the smart watch 202 subsequently detects that the computer is turned on, a prompt message is output again to prompt the user to check new emails.
  • the control in the prompt message can be viewed by the computer or viewed by the computer later.
  • Figure 44 shows another GUI provided by an embodiment of the present application.
  • the user is wearing a watch and is using a mobile phone for navigation.
  • the mobile phone can query surrounding wearable devices. If the mobile phone determines that the user is wearing the watch, the mobile phone can send the navigation interface information to the watch.
  • the mobile phone and the wearable device may be devices under the same account.
  • the watch when the watch receives the navigation interface information sent by the mobile phone, the watch can display the navigation interface on the mobile phone, so that the user does not need to hold the mobile phone to view the navigation information all the time, but Yes, you can use the watch to view navigation information.
  • Figures 45 and 46 show the implementation of the GUI shown in Figures 5 to 12 and the specific interaction process between devices.
  • FIG. 45 shows a schematic block diagram of a sending end (source end) and a receiving end (sink end) provided by an embodiment of the present application.
  • the source end includes a notification monitoring service 4510, a device management module 4520, a message encapsulation module 4530, and a notification forwarding management module 4540, etc.
  • the sink end includes a message parsing module 4550, a system adaptation module 4560 and other modules.
  • the notification monitoring service 4510 is used to register the monitoring notification service with the system on the source side, and obtain system notification messages in real time.
  • the notification message body includes the header, notification ID attributes, notification channel attributes, and message content.
  • the packet header is used to determine the application of which App the notification message belongs to, and the notification ID attribute and the notification channel attribute can be used to find the corresponding notification message.
  • the device management module 4520 is used to manage the sink.
  • the device management module 4520 is used to store the device name, device type, device status information, address information, etc. of the sink, and the device status information is used to indicate that the device is online or offline.
  • the device management module 4520 is also used to save the hardware attribute information of the sink (such as whether there is a screen, whether there is a speaker, etc.).
  • the sink terminal in the embodiment of the present application may be a device under the same account as the source terminal. Then, when the source side sends the notification message body to the sink side, it can be sent to the sink side through short-distance communication, or it can also be sent to the sink side through the server.
  • the device management module 4520 may control the source terminal to periodically send BLE data packets to surrounding devices.
  • the purpose of the BLE data packets is to query whether the surrounding devices are online. If the source terminal receives the response, the status information saved in the device management module 4520 may be online; otherwise, the status information saved in the device management module 4520 is offline.
  • the device management can first determine whether the sink side is online. For offline devices, the source side can choose not to forward the notification message to it.
  • the message encapsulation module 4530 may define a notification message body that is universal across devices, or may also define a notification message body that can be parsed by devices of different operating systems.
  • the message encapsulation module can re-encapsulate the notification message according to the format of the notification message body for the content of the notification message, and obtain the encapsulated notification message body.
  • the encapsulated notification message body may include the header of the message, identification information (for example, notification ID attribute and notification channel attribute), the content of the notification, the information of the user who sent the notification message, and the device information of the source device, etc. Wait.
  • the header of the notification message is used to determine which App the notification message belongs to; the identification information is used to find the corresponding notification message; after detecting the user's reply, the sink can send the user's reply content, header, and identification to the source.
  • Information so that the source can determine that the notification content is a reply to a certain notification message of a certain App.
  • the notification message body sent by the mobile phone to the smart TV may include the notification message belongs to App1, the user who sent the message is Li Hua, and the content of the notification message is "there is a meeting at 9 AM".
  • the notification message body sent by the notebook computer to the wearable device may include the notification belonging to the schedule, and the notification content including the time (9:00-10:00 am) and the event (discussion).
  • the message encapsulation module 4530 may also carry indication information in the notification message body, and the indication information is used to instruct the sink to add a reply control to the notification message.
  • the indication information may be the flag attribute of "quick reply".
  • the sink side determines that the notification message body carries the flag attribute of "quick reply"
  • it can add a reply control in the message reminder box.
  • the sink device can also prompt the user of the notification message, and the user can complete the reply to the notification message through the reply control; thus the sink device can The reply content is sent to the source side, and the source side completes the real reply to the notification message.
  • the notification forwarding management module 4540 can be used to determine whether the user is focused on the current source end. If the user's focus is not on the current device, the notification forwarding management module 4540 is also used to determine the user's focus device.
  • the source can automatically turn on the camera after receiving the notification message from the server. If the user's face information is not collected through the camera, the source can determine that the device currently focused on by the user is not on the source.
  • the source of the notification message received by the source is not specifically limited.
  • the notification message may be a notification message received by the source from the server, or may be received by the source from other devices. Notification message, for example, the source terminal receives the notification message from other devices through Wi-Fi P2P.
  • the source terminal may detect the pupil of the user through a pupil detection sensor (for example, an image sensor). If the pupil detection sensor can detect the user's pupil, the source terminal determines that the user is controlling the device; otherwise, the source terminal determines that the user's current focus is not on the source terminal.
  • a pupil detection sensor for example, an image sensor
  • the source device may also send request information to one or more sinks stored in the device management module, and the request information is used to request the sink The terminal judges whether the user's focus is on the device.
  • the notification forwarding management module 4540 may save the priority determined by the focus device.
  • the priority order can be:
  • the visual focus device may be a device with a camera, such as a smart TV, a tablet computer, a notebook computer, etc.; the personal device may be a user's wearable device, such as VR/AR glasses, smart watches, smart bracelets, etc.
  • the interactive device may be a device with input control, for example, a device with keyboard, mouse, touch control, remote control, voice input, etc.
  • the device on the source side can send request information to the devices in the device list.
  • the source sends the request information to the devices in the device list, it can be sent according to the priority of the device.
  • the mobile phone can first send request information to the smart TV.
  • the request information is used to request the smart TV to determine whether the user's current focus is on the smart TV.
  • the smart TV can determine whether the user's focus is on the smart TV by turning on the camera. If the smart TV determines that the user's current focus device is on the smart TV through the facial information collected by the camera, the smart TV can send a response to the mobile phone, and the response is used to indicate that the user's current focus is on the smart TV. After receiving the response, the mobile phone can no longer send request information to other devices in the device list.
  • the mobile phone can continue to send request information to the smart watch.
  • the smart watch can detect whether the user is wearing the wearable device based on the sensor. For example, a photoplethysmograph (PPG) sensor in a smart watch can determine whether the user is wearing the smart watch by detecting the user's heart rate. If the smart watch determines that the user is wearing the smart watch, the smart watch may send a response to the mobile phone to indicate that the user is currently wearing the smart watch.
  • PPG photoplethysmograph
  • the source When the source sends request information to devices in the device list, it can also send request information to multiple devices in the device list at the same time.
  • the mobile phone can send request information to the smart TV and smart watches at the same time. If the mobile phone only receives the response from the smart TV directly, then the mobile phone can forward the notification message to the smart TV; or, if the mobile phone only receives the response from the smart watch, then the mobile phone can forward the notification message to the smart watch; or, if the mobile phone receives When the smart TV and smart watch respond, the mobile phone can forward the notification message to the smart TV according to the priority of the device.
  • the source end can send request information to the devices around the source end by broadcasting. If the mobile phone only receives a response from a surrounding device, the mobile phone can forward the notification message to that device; or if the mobile phone receives a response from multiple surrounding devices, then the mobile phone can assign a higher priority according to the priority of the device. The device forwards the notification message.
  • the first electronic device if the first electronic device stores a list of devices to which notification messages are forwarded, the first electronic device sends instruction information to the second electronic device, and the instruction information may be used to instruct the second electronic device to determine Whether the owner of the first electronic device focuses on the second electronic device; or, the indication information can also be used to instruct the second electronic device to determine whether there is a user (it can be the owner of the first electronic device, or it can be another user ) Focus on the second electronic device.
  • the source end and the sink end are located in the same system.
  • a smart camera can also be connected to the system.
  • the smart camera can detect the location of the user by means of face recognition or infrared detection, and combine the user's The location is sent to the source, and the source judges which device in the system is closer to the user based on the user's location and the location of each device in the system (the location of each device can be obtained through satellite positioning), so that the device closest to the user is the closest sink end.
  • the notification forwarding management module on the source side can send the encapsulated notification message body to the focus device.
  • the source terminal may send a notification message body to the sink terminal device through a network channel (for example, Bluetooth/Wi-Fi, etc.).
  • the source end may carry the notification message body in the BLE data packet and send it to the sink end.
  • the BLE data packet includes a protocol data unit (protocol data unit, PDU), and the notification message body can carry the service data (service data) field in the PDU, or it can also carry manufacturer specific data in the PDU. Field.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the sink end and the source end can agree on the content of a certain expandable bit.
  • the source end can use GBK, ISO8859-1 and other encoding methods to encode the notification message body, and carry the encoded information on one or more expandable bits.
  • the message parsing module 4550 on the sink side is used to parse the notification message body sent by the source side to obtain the content of the notification message body.
  • the source terminal carries the notification message body in a BLE data packet and sends it to the sink terminal, after receiving the BLE data packet, the sink terminal can use a corresponding decoding method to decode, thereby obtaining the notification message body.
  • the system adaptation module 4560 can optimize the notification interaction and presentation mode forwarded to the sink terminal according to the local notification style rules on the sink terminal or according to the preset correspondence table between the device and the notification optimization mode.
  • the sink device may be a device that does not have the first application installed.
  • the notification message body sent by the source to the sink carries indication information (for example, the "quick reply” flag attribute is used to instruct the source to add a reply control in the message reminder box).
  • the system adaptation module adapts the corresponding system interface of each system to the sink side of different operating systems, and supports the "quick reply" input box, UI presentation and users Interactive response, etc.
  • the sink terminal can provide a notificationManager to realize the drawing of the message reminder box, where the message reminder box includes the notification content in the notification message body, the reply control drawn by the notificationManager, etc. .
  • the smart TV may display the content of the message and the reply control in the message reminder box.
  • the sink terminal When the sink terminal detects that the user has entered the reply content, the sink terminal can display a text input box and send controls.
  • the sink side detects that the user has entered the reply content in the text input box and clicked the send control, the content entered by the user can be obtained through the callback interface getResultsFromIntent().
  • getResultsFromIntent() can establish the relationship between the sending control and the text input box.
  • the sink terminal detects that the user clicks the send control, it triggers the sink terminal to obtain the content of the text input box.
  • the callback interface can be registered on different systems, so that when the sink terminal detects the user's reply content, it can obtain the user's reply content through the callback interface.
  • the sink side After the sink side detects that the user has entered the reply content in the text input box and detects that the user clicks the send control, it can trigger the sending of the user's reply content to the source side.
  • Table 1 shows a correspondence table between devices and notification optimization methods.
  • the smart TV when a notification comes, the smart TV only displays the notification content without displaying the action control, and the subsequent user can view and reply to the notification message in the notification center. In this way, the user experience is consistent and will not cause interference to the user.
  • the smart TV can first determine whether there is interaction with the user. If there is no interaction with the user (for example, the smart TV is playing a video), the smart TV can automatically focus the cursor on the reply control of the message reminder box, and display the action control in the message reminder box; if the smart TV interacts with the user (user The remote control is being used to switch channels), then the smart TV displays the action control in the message reminder box and does not focus the cursor on the reply control, but instead prompts the user to click the menu button to focus the cursor on the reply control. This helps to improve the convenience of interaction.
  • the car machine can prompt the user of the content of the notification message by way of voice broadcast.
  • the smart watch when the smart watch receives a notification message sent by the laptop computer, the smart watch can remind the user through voice, vibration, display screen display, and other reminding methods.
  • the sink side When the sink side detects that the user responds to a notification message, it can package the action response event and the content of the user's reply together into a notification message body.
  • the notification message body can adopt the same encapsulation format as the notification message sent from the source end to the sink end, so that the source end can parse it.
  • the sink can carry the notification message body in a BLE data packet and send it to the source.
  • the BLE data packet includes a PDU
  • the notification message body can be carried in the service data field in the PDU, or can also be carried in the vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the sink end and the source end can agree on the content of a certain expandable bit.
  • the sink can use GBK, ISO8859-1 and other encoding methods to encode the notification message body, and carry the encoded information on one or more expandable bits.
  • the sink can carry the notification ID attribute, notification channel attribute, action response event, and user reply in the notification message. Content. If the notification message body sent by the source to the sink does not carry the notification ID attribute and the notification channel attribute, then the notification message body sent by the sink to the source may not carry the notification ID attribute and the notification channel attribute.
  • the sink terminal when the sink terminal detects a user's click event or notification delete event on the notification message, the corresponding event can be sent to the source terminal in real time.
  • the source can respond in real time to complete the closed-loop processing of messages and achieve the consistency of user experience on different devices.
  • the smart TV can send an action response event and reply content to the mobile phone, and the action response event is used for Indicates that the smart TV has finished replying to the message.
  • the mobile phone receives the action response event and the reply content, it can automatically pull up the chat interface and realize the real reply to the message by dragging and dropping.
  • the source side parses the notification message body sent by the sink side, obtains the header, notification ID attribute, notification channel attribute, action response event and user reply content, and completes the actual reply to the notification message through the following process.
  • the source side can determine that the sink side has responded to the notification message through the action response event; the header determines which notification message in the App is to reply to; the notification ID attribute and the notification channel attribute determine which notification message is performed reply. Then complete the real reply to the notification message through the following process.
  • the source terminal is in the lock screen state, it can be handled in the following ways.
  • the source side can first determine which App the reply content is for according to the header. If the App provides an API to reply to the message, the App can directly complete the actual reply to the notification message through the API provided by the App after obtaining the content of the user's reply. Exemplarily, for the short message application, it provides the API "sendTextMessage" which can be used to notify the actual reply of the message. After the source side obtains the reply content, it can first determine that the reply content is the reply content for the short message application through the header of the reply content. Since the short message provides an API to reply to the notification message, the source can determine which notification message is to be responded to through the notification ID attribute and the notification channel attribute, and the source can directly complete the actual reply to the notification message through "sendTextMessage".
  • the process of message reply is implemented on the source side, and this process is insensitive to the user. If the App does not provide an API to reply to the message, then the App can use Method 2 or Method 3 to complete the reply by dragging the event.
  • the source terminal can directly load the corresponding display interface on the lock screen interface.
  • Such as WeChat voice call requests, video call requests, etc. are directly displayed on the lock screen interface. Then go to step (2), complete the message reply by dragging the event.
  • the reply method of the third method can also be referred to as a cross-device unlocking solution.
  • the sink terminal can complete the collection of user identity authentication information. For example, the sink terminal can obtain the user's password information for unlocking the source terminal, such as digital passwords, fingerprint passwords, iris information, facial features, and so on. information. Then, the sink terminal can send the password information to the source terminal, so that the source terminal determines whether to unlock the device. If the source terminal is determined to unlock according to the password information, then go to step (2) and complete the message reply by dragging the event.
  • the sink terminal can complete the collection of user identity authentication information. For example, the sink terminal can obtain the user's password information for unlocking the source terminal, such as digital passwords, fingerprint passwords, iris information, facial features, and so on. information. Then, the sink terminal can send the password information to the source terminal, so that the source terminal determines whether to unlock the device. If the source terminal is determined to unlock according to the password information, then go to step (2) and complete the message reply
  • the source can determine that the sink device detects the user's operation to reply to the notification message.
  • the source can determine the corresponding App according to the header of the notification message body and start the App to the foreground, and find the corresponding notification message through the notification ID attribute and the notification channel attribute.
  • the view system on the source side can send Drag and Drop events and reply content to the corresponding App.
  • the App pulls up the chat interface of a specific contact through the PendingIntent in the notification message to reply to the notification message. At this time, the actual reply to the notification message is completed.
  • the view system can also send the content attribute of the reply content to the corresponding App.
  • the content attribute can be used to indicate the type of reply content (for example, text, picture, voice). , Videos, files, etc.).
  • App can notify the 3D graphics processing library (OpenGL ES) to draw different display interfaces according to the type of reply content.
  • text content after pulling up the chat interface of a specific contact, the text content can be directly displayed in the reply position.
  • voice messages after pulling up the chat interface of a specific contact, the duration of the voice and the control for answering the voice can be displayed (when the source terminal detects that the user clicks on the control, the content of the voice can be played ).
  • video information after the chat interface of a contact is pulled up, the first frame of image in the video can be displayed and the playback control can be displayed (when the source terminal clicks the playback control, the content of the video can be played).
  • the source side hides the App interface and returns to the display interface before starting the App. If in step (1), the source device was originally locked, then lock the device again. By restoring the original state of the device, the user is unaware of the quick reply function, which can further enhance the user experience.
  • the smart TV when the smart TV detects that the user ignores the App1 message, the smart TV can send a notification message body to the mobile phone.
  • the notification message body can carry an action response event, and the action response event is used to instruct the smart TV to detect that the user ignores the message.
  • the message reminder box After the mobile phone receives the action event, it can automatically hide the message reminder box on the lock screen of the mobile phone.
  • the mobile phone After receiving the notification message body, the mobile phone can determine App1 according to the header of the notification message body.
  • the view system of the application framework layer After responding to the event in response to the action, the view system of the application framework layer can send a hidden event to App1 of the application layer.
  • App1 can notify the 3D graphics processing library (OpenGL ES) to hide the notification message reminder box on the lock screen interface.
  • OpenGL ES 3D graphics processing library
  • FIG. 46 shows a schematic flowchart of a method 4600 for prompting a message provided by an embodiment of the present application.
  • the method may be executed by a first electronic device and a second electronic device, where the first electronic device may be the source terminal as shown in FIG. 45, and the second electronic device may be as shown in FIG. 45
  • the method 4600 includes:
  • S4601 The first electronic device receives the message.
  • the user's mobile phone receives the App1 message sent by the user Li Hua.
  • the messages in the embodiments of the present application may be messages sent by servers of different applications.
  • the types of messages include, but are not limited to, text, voice, audio, video, link, sharing (e.g., location sharing), invitation (e.g., invitation to join the group) and so on.
  • the first electronic device sends the message to the second electronic device when determining that the device focused by the owner of the first electronic device is the second electronic device.
  • the second electronic device can be a device in the device list.
  • the first electronic device can send a request to the second electronic device through short-range wireless communication or through the server Information, the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; if the first electronic device does not save the message forwarding device list, then the second electronic device can be the first electronic device For devices around the electronic device, the first electronic device may send the request information to the surrounding devices by broadcasting.
  • the first electronic device determines that the device focused by the user is not the first electronic device, the first electronic device does not make a notification.
  • the method for determining that the focused device is not an electronic device by the first electronic device is not specifically limited.
  • the second electronic device is an electronic device in the device list of the first electronic device and the user characteristics of the owner of the first electronic device are stored in the second electronic device (for example, the second electronic device and the first electronic device)
  • the device is two devices under the same user (logged in with the same Huawei ID)
  • the first electronic device and the second electronic device can save the same user characteristics (for example, fingerprint information, face information, voiceprint information, iris information, etc.) Etc.))
  • the first electronic device may send the request information to the second electronic device through the server or through short-distance communication.
  • the second electronic device may collect the characteristics of the user and determine whether the characteristics of the user match the preset user characteristics of the owner of the first electronic device.
  • a response message is sent to the first electronic device, and the response message is used to indicate that the owner of the first electronic device is focusing on the second electronic device.
  • the first electronic device may send the message to the second electronic device.
  • the first electronic device when the first electronic device receives the message, the first electronic device can turn on the camera to collect the user's face information. If the user's face information is not collected through the camera, then the first electronic device An electronic device can determine that the device currently focused by the user is not the first electronic device, so that the request information can be sent to the second electronic device. After receiving the request information, the second electronic device can collect the user's face information by turning on the camera. If the information matches, the second electronic device can send response information to the first electronic device.
  • the second electronic device may collect the user's voice information by turning on the microphone.
  • the second electronic device can extract the voiceprint information in the voice information. If the voiceprint information matches the voiceprint information of the owner of the first electronic device preset in the second electronic device, then the second electronic device can send a message to the first electronic device. An electronic device sends a response message.
  • the first electronic device may send the request information to the second electronic device through the server, or may also send the request information to the second electronic device by means of short-range communication.
  • the request information may be a field in the BLE data packet, and the field is used to request the second electronic device to determine whether the user is focused on the second electronic device.
  • the BLE data packet includes a PDU
  • the request information may be carried in a service data field in the PDU, or may also be carried in a vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the first electronic device and the second electronic device may agree on a certain bit in advance to transmit the request information. When this expandable bit is a preset value (for example, 1), the second electronic device can learn that the first electronic device requests it to determine whether the owner of the first electronic device is focused on the device.
  • the second electronic device When determining that the user is focused on the second electronic device, the second electronic device sends response information to the first electronic device, and the response information is used to indicate that the device focused by the user is the second electronic device.
  • the second electronic device may send to the first electronic device the service data field of the PDU in the BLE data packet or the vendor-specific data field.
  • the response information can be carried on the expandable bits in the load of the service data field.
  • the first electronic device and the second electronic device may agree in advance on a certain expandable bit to transmit the response information.
  • this expandable bit is a preset value (for example, 1), it means that the second electronic device determines that the device focused by the owner of the first electronic device is the second electronic device.
  • the second electronic device may determine whether the user is focused on the second electronic device through other existing methods of determining the focus device, which is not limited in the embodiment of the present application.
  • the first electronic device and the second electronic device are devices under the same account, then the first electronic device may also send the request information to the second electronic device through the server. Similarly, if the second electronic device determines that the user is focusing on the second electronic device, the second electronic device may also send response information to the first electronic device through the server.
  • the mobile phone can send request information to the smart watch through the server.
  • the smart watch can send response information to the mobile phone through the server.
  • the second electronic device is an electronic device in the device list of the first electronic device and the user characteristics of the owner of the first electronic device are not saved in the second electronic device, or there is no device in the first electronic device In the list, the second electronic device is a device around the first electronic device. Then, when the first electronic device determines that the owner of the first electronic device is not focused on the first electronic device, it can send the request information to the second electronic device; after receiving the request information, the second electronic device can send the request information through the user
  • the feature collection device collects user features, and sends the collected user features to the first electronic device. When determining that the user characteristics collected by the second electronic device match the user characteristics preset in the first electronic device, the first electronic device may send the message to the second electronic device.
  • the second electronic device is an electronic device in the device list of the first electronic device and the user characteristics of the owner of the first electronic device are stored in the second electronic device
  • the second electronic device is receiving the request information Later, it is also possible to collect the characteristics of the user and send the characteristics of the user to the first electronic device, so that the first electronic device determines whether the owner of the first electronic device is based on the characteristics of the user collected by the second electronic device and the preset user characteristics. Focus on the second electronic device.
  • the user characteristics sent by the second electronic device to the first electronic device may be carried in the service data field in the PDU or in the vendor-specific field.
  • the second electronic device includes a camera. After receiving the request information, the second electronic device may collect the face information through the camera and send it to the first electronic device. The first electronic device judges whether it is the user according to the face information. For example, the first electronic device may match the face information collected by the second electronic device with the face information preset in the first electronic device. If the matching is successful, it is determined that the owner of the first electronic device is currently focusing on the first electronic device. 2. Electronic equipment.
  • the face information collected by the second electronic device may also be the face information of multiple people, so the second electronic device may send the face information of the multiple people to the first electronic device.
  • the first electronic device may match the facial information of each of the multiple persons with the facial information preset in the first electronic device, and if the matching is successful, it is determined that the user is currently focusing on the second electronic device.
  • the first electronic device may send the message to the second electronic device, and the second electronic device may prompt the user that there is a message (or, prompt the user that there is a message and the message comes from the XX device) without prompting the user the content of the message.
  • the second electronic device includes a microphone, and after receiving the request information, the second electronic device may collect the voice information sent by the user through the microphone and send it to the first electronic device.
  • the first electronic device judges whether it is the user himself according to the voice information.
  • the first electronic device may extract the voiceprint information in the voice information collected by the second electronic device.
  • the first electronic device matches the extracted voiceprint information with the voiceprint information preset in the first electronic device. If the matching is successful , It is determined that the user is currently focusing on the second electronic device.
  • the second electronic device when the first electronic device requests the second electronic device whether the owner of the first electronic device focuses on the second electronic device, the second electronic device can send the collected user characteristics to the first electronic device. It is possible for the first electronic device to determine whether the second electronic device is a device focused by the owner of the first electronic device based on the received user characteristics and the preset user characteristics. This helps to improve the security of the message forwarding, avoids the leakage of the user's privacy, and thus helps to improve the user experience.
  • the first electronic device may determine that the user does not focus on the devices around the first electronic device.
  • the first electronic device may remind the user of the message by turning on the screen or vibrating.
  • the first electronic device may carry the content of the message in a BLE data packet and send it to the second electronic device; or, the first electronic device may send the message to the second electronic device through the server.
  • the BLE data packet includes a PDU
  • the message may be carried in a service data field in the PDU, or may also be carried in a vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the first electronic device and the second electronic device may pre-appoint one or more expandable bits for message transmission.
  • the first electronic device may use GBK, ISO8859-1 or other encoding methods to encode the content of the message, and carry the encoded information with one or more expandable bits.
  • the second electronic device can decode the information on the corresponding bit to obtain the content of the message.
  • S4603 The second electronic device prompts the user with the message according to the device information of the second electronic device.
  • the device information of the second electronic device may include, but is not limited to: hardware capability information of the second electronic device (for example, the second electronic device is a large-screen device or the second electronic device is a car machine), the current device Status (for example, whether the user is currently interacting with the user, or whether the device is in an immersive state) and so on.
  • hardware capability information of the second electronic device for example, the second electronic device is a large-screen device or the second electronic device is a car machine
  • the current device Status for example, whether the user is currently interacting with the user, or whether the device is in an immersive state
  • the device information of the second electronic device includes that the second electronic device has a display screen, the second electronic device displays a message reminder box through the display screen, the message reminder box includes the message and the message reminder box does not Including controls.
  • the smart TV after the smart TV receives a message sent by the mobile phone, it can prompt the message through a message reminder box and the message reminder box does not include controls. After seeing the message, the user can view the message in the notification center of the smart TV.
  • the device information of the second electronic device includes that the second electronic device has a display screen, and when the second electronic device detects that it is receiving user input, a message reminder box is displayed on the display screen without positioning the cursor In the message reminder box, the message reminder box includes the message.
  • the smart TV when the smart TV receives a message sent by the mobile phone, there is interaction between the smart TV and the user, or the smart TV detects that the user is controlling the smart TV. Then the smart TV can display a message reminder box and the smart TV does not position the cursor in the message reminder box.
  • the second electronic device may display a message reminder box, but does not position the cursor in the message reminder box. In order to avoid the impact on the current interaction due to the user's accidental click.
  • prompt information is also displayed through the display screen, and the prompt information is used to remind the user to locate the cursor to the message reminder box through the first operation.
  • the prompt message is "click the menu button to process".
  • the smart TV detects that the user clicks the menu button, it can automatically position the cursor in the message reminder box.
  • the smart TV can position the cursor on the reply control in the message reminder box.
  • the user by displaying the prompt information, the user can position the cursor on the message reminder box through the first operation, so as to process the message. This not only avoids troubles to the user's current interactive behavior, but also quickly and conveniently locate the cursor on the smart TV in the message reminder box, thereby facilitating the user to process the message.
  • the device information of the second electronic device includes that the second electronic device has a display screen, and when the second electronic device detects that the user's input is not received, the message reminder box is displayed on the display screen and the cursor Locate in the message reminder box.
  • the smart TV when the smart TV receives a message sent by the mobile phone, there is no interaction between the smart TV and the user, or the smart TV detects that the user does not control the smart TV. Then the smart TV can display a message reminder box and the smart TV positions the cursor on the message reminder box. For example, the smart TV positions the cursor on the reply control in the message reminder box.
  • the smart TV can display a message reminder box and position the cursor on the message reminder box, which is convenient for the user to process the message.
  • the device information of the second electronic device includes a device with a voice function in the smart TV, and the second electronic device may remind the user by voice that the message is received; or, the second electronic device may remind the user by voice The content of the message.
  • the car machine includes a voice function, then after receiving the message sent by the mobile phone, the car machine can convert the content of the message to voice and prompt the user; or the car machine can also prompt the user through voice A message was received.
  • the second electronic device can continue to determine whether the second electronic device is a large-screen device (for example, a smart TV). If it is a large-screen device, Then the second electronic device can prompt the user through a display screen; or, if the second electronic device is a tablet, a PC, etc., it can also prompt the user through a display screen. If the second electronic device is a smart voice device with a small display screen, such as a smart speaker, the second electronic device can prompt the user by voice.
  • a large-screen device for example, a smart TV.
  • the method further includes: the first electronic device sends instruction information to the second electronic device, where the instruction information is used to instruct the second electronic device to add the message
  • the second electronic device prompts the user with the message according to the device information, including: the second electronic device displays a message reminder box based on the device information and the instruction information, and the message reminder box includes the message and the Reply control; after the second electronic device prompts the user of the message, the method further includes: when the second electronic device detects the user's operation of replying to the message, sending the reply content to the first electronic device; the first The electronic device replies to the message according to the reply content.
  • the smart TV can receive messages and instructions sent by the mobile phone. If the smart TV does not currently receive the user's input, the smart TV may display a message reminder box, the message reminder box includes the content of the message and a reply control, and the smart TV positions the cursor on the reply control. When the smart TV detects that the user clicks on the reply control, the input method can be pulled up to facilitate the user to reply to the message. The smart TV can send the reply content to the mobile phone, so that the mobile phone completes the real reply to the message by calling the API or dragging the event.
  • the smart TV can receive messages and instructions sent by the mobile phone. If the smart TV is currently receiving user input (for example, the smart TV is receiving the user’s channel change operation), the smart TV can display a message reminder box, which includes the content of the message and the reply control, and the smart TV does not set the cursor Locate the reply control. The smart TV can also display a prompt message, prompting the user to reply to the message by clicking the menu button. When the smart TV detects the operation of the user clicking the menu key, the smart TV can position the cursor on the reply control. When the smart TV detects that the user clicks on the reply control, the input method can be pulled up to facilitate the user to reply to the message. The smart TV can send the reply content to the mobile phone, so that the mobile phone completes the real reply to the message by calling the API or dragging the event.
  • the smart TV can display a message reminder box, which includes the content of the message and the reply control, and the smart TV does not set the cursor Locate the reply control.
  • the smart TV can also display a
  • the message is a message of the first application
  • the second electronic device may be a device that does not have the first application installed. This can facilitate the user to complete the reply to the message on the focused device, avoid the process of the user returning to the first electronic device to reply to the message, and help improve the user experience.
  • the device information of the second electronic device includes that the second electronic device has a camera.
  • the second electronic device detects through the camera that only the owner of the first electronic device focuses on the second electronic device, the user is prompted with the content of the message.
  • the smart TV when the smart TV detects that only the owner of the mobile phone is focused on the smart TV through the camera, the smart TV can display a message reminder box 1101 on the display screen, where the message reminder The box 1101 includes the content of the message (for example, "There is a meeting at 9 AM").
  • the second electronic device when the second electronic device detects through the camera that multiple users including the owner of the first electronic device focus on the second electronic device, it prompts the user to receive the message.
  • the smart TV when the smart TV detects that multiple users, including the owner of the mobile phone, focus on the smart TV through the camera, the smart TV may display a message reminder box 1102 on the display screen. Among them, the message reminder box 1102 prompts the user "You have a message from Lily's P40".
  • the second electronic device determines that the second electronic device is in a non-immersed state before prompting the user with the message.
  • the immersive state may include a state where the user is watching a video, as shown in (b) of FIG. 10, if the user is watching a video at this time, the tablet may not prompt the user with this message. As shown in Figure 10(a), if the tablet is displaying the desktop at this time, the tablet can prompt the user with this message.
  • the second electronic device may not prompt the message.
  • the immersive state can also be understood as a notification prohibited state.
  • the immersive state can be that the user disables notifications or turns on the do not disturb mode. For example, if a user is in a remote meeting, especially when sharing a desktop, if there is a notification, it will not only be affected by interference, but also be seen by other participants, which may affect the user experience and may leak the user's privacy.
  • the immersive state may be a state in which the second electronic device is running a preset application program.
  • the immersive state may be that the second electronic device is currently running a video App or a game App.
  • the method 4600 further includes: before sending the notification message to the second electronic device, the first electronic device determines that the type of the message is a message type set by the user.
  • the user can set in advance the types of messages that can be notified and forwarded. For example, notification can be forwarded for messages of App5, App6, and App7.
  • the first electronic device receives the message, it determines whether the type of the message is the message type set by the user. If so, the first electronic device may perform S4602.
  • the method 4600 further includes: before sending the notification message to the second electronic device, the first electronic device determines that the message is an instant messaging (IM) type message.
  • IM instant messaging
  • the method 4600 further includes: before sending the message to the second electronic device, the first electronic device determines that the second electronic device is a device set by the user to receive message forwarding.
  • the user can set a device that can receive message forwarding in the mobile phone in advance.
  • the first electronic device receives the message and determines that the device currently focused by the user is not the first electronic device, the device currently focused by the user may be determined from the devices that receive the message forwarding. And send a message to the device.
  • the first electronic device Before sending the message to the second electronic device, the first electronic device determines that the account logged in on the first electronic device is associated with the account logged in on the second electronic device.
  • the account logged in on the electronic device and the account logged in on the wearable device may be the same account; or, the account logged in on the electronic device and the account logged in on the wearable device are in the same family group Or, the account logged in on the wearable device may be an account authorized by the account logged in on the electronic device.
  • the first electronic device when the first electronic device determines that the device focused by the user is not the first electronic device but the second electronic device, the first electronic device may forward the message to the second electronic device, and the second electronic device may The device information of the second electronic device prompts the user of the message, which helps the user to receive the reminder of the message in time and prevents the user from missing important messages; at the same time, the second electronic device presents the message to the user according to the device information of the second electronic device Reminders in different ways help to improve the user experience when receiving messages.
  • Figures 47, 49, and 50 show the implementation of the GUI shown in Figures 16 to 22 and the specific interaction process between devices.
  • the notification service is used to receive messages sent by the social application server. For example, when the user Tom uses the device A to send a message to the user Lily, the device A first sends the message content and the identification information of the user Lily's social application account to the social application server.
  • the social application server saves the device information (for example, Lily's device B) of the social application account of the user Lily logged in.
  • the social application server may send a corresponding message to the device B of the user Lily according to the identification information of the social application account of the user Lily.
  • the notification service in device B can be used to receive messages sent by the server and user Tom's information.
  • the notification monitoring module is used to register the monitoring notification service with the system, and obtain the messages received by the notification service in real time.
  • the notification listener can obtain the notification message body.
  • the notification message body contains the header, notification ID attributes, notification channel attributes, and message content.
  • the header is used to determine which App application the notification message belongs to
  • the notification ID attribute and the notification channel attribute can be used to find the corresponding notification message
  • the message content can include the text information of the message (for example, ( a) As shown in "Happy Birthday!).
  • the notification processing module on the source side When the source side device determines that the user is not currently focusing on the source side device and the message is a message that can be forwarded to other electronic devices, it attaches a "quick reply" attribute to the message.
  • the source side can save a whitelist of applications.
  • the source can only forward messages across devices when it receives a message from an application in the whitelist.
  • all three-party apps that support drag-and-drop event response can be added to the whitelist.
  • the source side can test the application to determine whether it supports drag-and-drop event response.
  • the view system in the application framework layer can send Drag and Drop events and randomly generated content to an application in the application layer.
  • the application After the application receives the Drag and Drop event and the randomly generated content, in response to the Drag and Drop event, it starts the application to the foreground and randomly opens the chat interface of a contact, and returns the randomly generated content to the chat interface. Corresponding location. If the reply is successful, it means that the application supports system drag and drop event response; if the reply is unsuccessful, it means that the application does not support system drag and drop event response.
  • the source can also determine whether to forward the message across devices according to the user's settings.
  • the user can set in advance the App corresponding to the message that can be forwarded across devices.
  • the user can set the notification messages of App5 and App7 to be forwarded to other devices; and the notification messages of App4, App6, App8, and App9 are not forwarded to other devices.
  • the notification message body may include the notification ID attribute and the notification channel attribute of the notification message.
  • the notification ID attribute can be used to distinguish the notification ID attributes sent by different users. For example, if a user has multiple contacts in a three-party app, the multiple contacts can be distinguished by different notification ID attributes. Table 2 shows a way to distinguish.
  • the character string in the notification channel attribute can be used to distinguish different message types.
  • Table 3 shows the correspondence between different message types and the character string in the notification channel attribute.
  • the corresponding notification message can be determined through the notification ID attribute and the notification channel attribute.
  • the user Tom and the user Amy respectively sent two notification messages, which can be distinguished by the notification ID attribute.
  • two notification messages of different message types sent by Tom can be distinguished by the notification channel attribute.
  • Different notification messages of the same message type sent by the same user may not be distinguished, or other identification information may also be used to distinguish.
  • the description of the notification ID attribute and the notification channel attribute may be different.
  • the above is only a description of the notification ID attribute and the notification channel attribute defined in some applications, and the embodiment of this application does not Limited to this.
  • the notification processing module on the source side can add a "quick reply” flag attribute to its message body.
  • the sink side determines that the notification message body carries the flag attribute of "quick reply”
  • it can add a reply control in the message reminder box.
  • the sink side detects that the user has clicked the reply control, it can display the text input box and the reply control.
  • the source side sends the notification message body to the sink side, it can carry the message content and the flag attribute of the "quick reply" in the notification message body.
  • the notification processing module on the source side may not add a "quick reply" flag attribute in the notification message body.
  • the sink side determines that the notification message body includes the message content, it can add a reply control in the message reminder box.
  • a reply control can be added to the message reminder box.
  • the source end may also carry the notification ID attribute and/or the notification channel attribute in the notification message body.
  • the purpose of carrying the notification ID attribute and the notification channel attribute is that after the sink terminal obtains the user's reply content to the notification message, it sends the reply content, the notification ID attribute and the notification channel attribute together to the source terminal, so that the source terminal can determine the reply content is The reply content to which notification message.
  • the source end may carry the notification message body in the BLE data packet and send it to the sink end.
  • the BLE data packet includes a PDU
  • the notification message body can be carried in the service data field in the PDU, or can also be carried in the vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the sink end and the source end can agree on the content of a certain expandable bit.
  • the source end can use GBK, ISO8859-1 and other encoding methods to encode the notification message body, and carry the encoded information on one or more expandable bits.
  • the notification processing module on the sink side After the notification processing module on the sink side receives the notification message body, it can parse the notification message body to obtain the content of the notification message and the flag attribute of the "quick reply". Exemplarily, if the source terminal carries the notification message body in a BLE data packet and sends it to the sink terminal, after receiving the BLE data packet, the sink terminal can use a corresponding decoding method to decode, thereby obtaining the notification message body.
  • Notification UI adaptation module After the notification processing module on the sink side recognizes the notification "quick reply” flag attribute, it notifies the UI adaptation module to adapt to the corresponding system interface of each system for the sink side of different operating systems, and supports “quick reply” "Input box, UI presentation and user interaction response, etc.
  • the sink terminal can provide a notificationManager to realize the drawing of the message reminder box, where the message reminder box includes the notification content in the notification message body, the reply control drawn by the notificationManager, etc. .
  • the tablet may display a reply control 1602 in the message reminder box.
  • FIG. 16(b) after the tablet detects that the user clicks on the control 1602, it can display an input box 1603 and a sending control 1604.
  • the sink side detects that the user has entered the reply content and clicks the send control
  • the content entered by the user can be obtained through the callback interface getResultsFromIntent().
  • getResultsFromIntent() can establish the relationship between the sending control and the text input box.
  • the sink terminal detects that the user clicks on the reply control, it triggers the sink terminal to obtain the content of the text input box.
  • callback interfaces can be registered on different systems, so that when the sink terminal detects the user's reply content, the notification processing module obtains the user's reply content through the callback interface. After the sink side detects that the user has entered the reply content in the input box and detects that the user clicks the send control, it can trigger the sending of the user's reply content to the source side.
  • the event processing module on the sink side When it is recognized that the user responds to a certain notification message, the action response event and the content of the user's reply are packaged together into a notification message body.
  • the notification message body can adopt the same encapsulation format as the notification message sent from the source end to the sink end, so that the source end can parse it.
  • the sink can carry the notification message body in a BLE data packet and send it to the source.
  • the BLE data packet includes a PDU
  • the notification message body can be carried in the service data field in the PDU, or can also be carried in the vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the sink end and the source end can agree on the content of a certain expandable bit.
  • the sink can use GBK, ISO8859-1 and other encoding methods to encode the notification message body, and carry the encoded information on one or more expandable bits.
  • the sink can carry the notification ID attribute, notification channel attribute, action response event, and user reply in the notification message. Content. If the notification message body sent by the source to the sink does not carry the notification ID attribute and the notification channel attribute, then the notification message body sent by the sink to the source may not carry the notification ID attribute and the notification channel attribute.
  • the event processing module on the source side parse the notification message body sent by the sink side to obtain the action response event, notification ID attribute, notification channel attribute and user reply content. Among them, the source side can confirm that the sink side responded to the notification message through the action response event. ; The notification ID attribute and the notification channel attribute are used to determine which notification message is to be responded to. Then complete the real reply to the notification message through the following process.
  • the source terminal is in the lock screen state, it can be handled in the following ways.
  • the source can first determine which App the reply content is for according to the header of the notification message body. If the App provides an API to reply to the message, the App can directly complete the actual reply to the notification message through the API provided by the App after obtaining the content of the user's reply. Exemplarily, for the short message application, it provides the API "sendTextMessage" which can be used to notify the actual reply of the message. After the source side obtains the reply content, it can first determine that the reply content is the reply content for the short message application through the header of the notification message body. Since the short message provides an API to reply to the notification message, the source can determine which notification message is to be responded to through the notification ID attribute and the notification channel attribute, and the source can directly complete the real reply to the notification message through "sendTextMessage".
  • the message reply process is implemented on the source side, and this process is insensitive to the user. If the App does not provide an API to reply to the message, then the App can use Method 2 or Method 3 to complete the reply by dragging the event.
  • the source terminal can directly load the corresponding display interface on the lock screen interface.
  • Such as WeChat voice call requests, video call requests, etc. are directly displayed on the lock screen interface. Then go to step (2), complete the message reply by dragging the event.
  • the reply method of the third method can also be referred to as a cross-device unlocking solution.
  • the sink terminal can complete the collection of user identity authentication information.
  • the sink terminal can obtain the user's password information for unlocking the source terminal, such as digital passwords, fingerprint passwords, iris information, facial features, and so on. information.
  • the sink can carry the password information in the notification message body and send it to the source, so that the source can determine whether to unlock the device. If the source terminal determines to unlock according to the password information, the source terminal can unlock first, enter the non-lock screen state, and then go to step (2) to complete the message reply by dragging the event.
  • the source side can determine that the sink side detects the user's operation to reply to the notification message.
  • the source can determine the corresponding App according to the header of the notification message body and start the App to the foreground, and find the corresponding notification message through the notification ID attribute and the notification channel attribute.
  • the view system on the source side can send Drag and Drop events and reply content to the corresponding App.
  • the App pulls up the chat interface of a specific contact through the PendingIntent in the notification message to reply to the notification message. At this time, the actual reply to the notification message is completed.
  • the view system can also send the content attribute of the reply content to the corresponding App.
  • the content attribute can be used to indicate the type of reply content (for example, text, picture, voice). , Videos, files, etc.).
  • App can notify the 3D graphics processing library (OpenGL ES) to draw different display interfaces according to the type of reply content.
  • text content after pulling up the chat interface of a specific contact, the text content can be directly displayed in the reply position.
  • voice messages after pulling up the chat interface of a specific contact, the duration of the voice and the control for answering the voice can be displayed (when the source terminal detects that the user clicks on the control, the content of the voice can be played ).
  • video information after the chat interface of a contact is pulled up, the first frame of image in the video can be displayed and the playback control can be displayed (when the source terminal clicks the playback control, the content of the video can be played).
  • the source After the source finishes replying, by hiding the App interface, it can return to the display interface before starting social networking. If the source terminal was originally locked, the device will be locked again. By restoring the original state of the device, the user is unaware of the quick reply function, which can further enhance the user experience.
  • the sink end may also include a voice module.
  • a voice module may be included on the vehicle. After the mobile phone sends the received message to the car machine, the car machine can convert the text information corresponding to the message into voice information through the voice module, and remind the user of the message by way of voice reminding.
  • the microphone on the sink side can pick up the voice to get the content of the user's voice reply.
  • the sink end can encapsulate the content of the user's voice reply into the notification message body and send it to the source end.
  • the voice module can also convert the content of the user's voice reply into text information and send it to the source. Alternatively, the voice module may not convert the content of the user's voice reply into text information, but directly carry the content of the user's voice reply in the notification message body.
  • the source terminal determines whether to convert the content of the voice reply into text information.
  • the sink terminal may also support the attachment reply function.
  • the user can send the attachment (project plan) to the user Lily on the laptop.
  • the attachment information can be carried in the notification message body.
  • the sink side may also carry the path information of the attachment on the sink side in the notification message body.
  • the BLE data packet may also be used when the sink terminal sends the content or file of the user's voice response to the source terminal.
  • the specific sending mode refer to the description of the above-mentioned embodiment. For the sake of brevity, it will not be repeated here.
  • the notebook computer when the notebook computer detects that the user clicks on the message reminder box 2001, the notebook computer can send a request to the mobile phone, and the request is used to request configuration information of interface elements.
  • the request may be carried in a BLE data packet and sent to the mobile phone.
  • the BLE data packet includes the PDU, and the request can be carried in the service data field in the PDU, or can also be carried in the vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • Mobile phones and laptops can agree on the content of a certain expandable bit. Exemplarily, when a certain expandable bit is "1", it indicates that the configuration information of the interface element is requested.
  • the source side (for example, a mobile phone) can determine one or more UI interface elements with the help of an integrated development environment (IDE) tool to generate an extensible markup language (XML) file.
  • IDE integrated development environment
  • XML extensible markup language
  • the XML file includes: UI interface background, source-side UI elements, size of UI elements (for example, the UI element displayed on the sink side is twice that of the source-side UI element) and position, where the UI element position may include UI elements The direction relationship between adding controls and text input boxes on the sink side.
  • FIG. 48 shows the chat interface displayed on the source side.
  • the source side can intercept UI elements 4801 on the chat interface.
  • the source side can also determine the background of the chat interface drawn on the sink side. (For example, white), and controls added on the sink (for example, sending controls) and the positions of text input boxes and UI elements.
  • the text input box can be located at the center of the UI element, and the sending control can be located at the bottom right of the UI element.
  • the source end may carry the XML file in a BLE data packet and send it to the sink end.
  • the request can be carried in the service data field in the PDU, or it can also be carried in the vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, where the multiple bits include scalable bits.
  • the source side can use the corresponding encoding technology to encode the XML file, and carry the encoded information on one or more expandable bits.
  • the sink can obtain the XML file by decoding the information on the corresponding bit.
  • the sink can restore the interface according to the XML file.
  • the sink side can draw the UI interface according to the UI interface background, the size and position of the UI elements included in the XML file.
  • the notebook computer can draw a message reminder box 2002.
  • the notebook computer When the notebook computer detects that the user clicks the operation of the send control, the notebook computer can send the reply content to the mobile phone, and the mobile phone completes the real reply to the message.
  • the laptop computer can request a new XML file from the mobile phone again, and the mobile phone can send a new XML file to the laptop computer again, where the XML file can include the UI element 4802. Therefore, the notebook computer can draw a message reminder box as shown in (c) in FIG. 20 according to the UI element 4802 in the XML file.
  • the notebook computer sends the reply content to the mobile phone, the notebook computer can request a new XML file from the mobile phone again, and the mobile phone sends the new XML file to the notebook computer. I won't repeat it.
  • the notebook computer when the notebook computer detects the user slide bar 2004, the notebook computer can request more UI elements from the mobile phone.
  • the mobile phone carries the UI element 4803 in an XML file and sends it to the notebook computer.
  • the notebook computer can draw a message reminder box as shown in (d) in FIG. 20 according to the XML file.
  • the sink side can be combined with the dupwight control to realize the restoration of UI elements, and this control can be combined with the local controls on the sink side (for example, button control, text control, list control) to draw the message reminder window.
  • this control can be combined with the local controls on the sink side (for example, button control, text control, list control) to draw the message reminder window.
  • Figure 49 shows the process of reproducing the source interface on the sink side through audio and video capture.
  • the source terminal can sample the entire display interface of the source terminal at a certain sampling frequency (for example, 60 Hz), and encode the sampled data and the position information of the chat interface on the source terminal interface to the sink terminal.
  • the sink side first decodes the data sent by the source side; the sink side crops the decoded audio and video data according to the location information of the chat interface, so as to perform image rendering, so that a mirror image of the source side chat interface can be obtained on the sink side.
  • the sink side can also add a button control (for example, a sending control) and a text input box.
  • a button control for example, a sending control
  • the mobile phone can connect to the video call and display the video call interface after receiving the instruction information sent by the laptop computer and the face information of the user Lily collected by the laptop computer.
  • the mobile phone can sample the image information in the dashed box 4804 of the mobile phone at a certain sampling frequency (for example, 60 Hz), and then send the sampled data to video encoding laptop.
  • the notebook computer can decode the data to obtain video data, and display the decoded video data in a window 2105 as shown in FIG. 21.
  • the mobile phone may also indicate the control (for example, the hang-up control) added on the notebook computer and the positional relationship between the control and the UI element of the dashed box 4804.
  • the hang-up control may be located in a centered position directly below the UI element of the dashed frame 4804.
  • the laptop computer after the laptop computer detects that the user clicks on the control 2103, it can send instructions to the phone and user Lily's face information collected by the laptop. After receiving the instruction information, the phone can connect to the video Make a call and send (via the server) the face information of user Lily collected by the laptop to the device of user Tom, so that user Tom can see the face information of user Lily through his device. At this time, the mobile phone may not display the video call interface, for example, the mobile phone turns off the screen after connecting to the video call.
  • the mobile phone After the mobile phone (through the server) receives the facial information of the user Tom, it can send the facial information to the notebook computer.
  • the notebook computer displays the face information of the user Tom sent by the mobile phone to the notebook computer and the face information of the user Lily collected through the camera of the notebook computer in the window 2104.
  • the notebook computer when the notebook computer detects that the user clicks on the control 2203, the notebook computer can send instruction information to the mobile phone, and the instruction information is used to instruct the mobile phone to connect to the voice call. If the notebook computer detects the voice content output by the user Lily, the notebook computer can also send the voice content to the mobile phone. After the mobile phone receives the instruction information sent by the laptop computer and the voice information output by the user Lily collected by the laptop computer, it can connect to the voice call and display the voice call interface. The mobile phone can send (through the server) the voice content output by the user Lily to the device of the user Tom, so that the user Tom can hear the voice content of the user Lily through his device.
  • the mobile phone can encode the voice content of the user Tom and send it to the laptop. After receiving the encoded data, the notebook computer can decode the data to obtain the voice content of the user Tom. The notebook computer can output the voice content of the user Tom through the speaker, so that the user Lily can hear the voice content of the user Tom.
  • FIG. 50 shows a schematic flowchart of a method 5000 for quick reply provided in an embodiment of the present application.
  • the method 5000 may be executed by a first electronic device and a second electronic device.
  • the first electronic device may be the source terminal in FIG. 47
  • the second electronic device may be the sink in FIG. 47.
  • the method 5000 includes:
  • S5001 The first electronic device receives the message.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un système et un procédé de notification, ainsi qu'un appareil électronique. Le procédé de traitement de notification comprend les étapes suivantes : un premier appareil génère une notification et envoie un premier message indiquant que la notification a été générée par le premier appareil ; un second appareil reçoit le premier message et génère une suggestion suggérant l'exécution d'une tâche correspondant à la notification sur un troisième appareil ; et en réponse à la réception d'une entrée concernant la suggestion provenant d'un utilisateur, le second appareil envoie un second message demandant au troisième appareil d'exécuter la tâche correspondant à la notification. Les modes de réalisation de l'invention peuvent améliorer la coordination entre de multiples appareils de façon à ce que les appareils puissent traiter une tâche indiquée dans une notification de manière coordonnée, ce qui améliore les performances de traitement d'informations des multiples appareils. L'invention permet à un utilisateur d'être informé d'une notification en temps opportun de façon à pouvoir effectuer une opération ultérieure en conséquence.
PCT/CN2020/142600 2020-02-19 2020-12-31 Procédé de traitement de notification, appareil électronique et système WO2021164445A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202080100013.XA CN115428413A (zh) 2020-02-19 2020-12-31 一种通知处理方法、电子设备和系统

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
CN202010102903.6A CN111404802A (zh) 2020-02-19 2020-02-19 通知处理系统、方法以及电子设备
CN202010102903.6 2020-02-19
CN202010473781.1 2020-05-29
CN202010473781.1A CN113746718B (zh) 2020-05-29 2020-05-29 一种内容分享的方法、装置及系统
CN202010844313.0A CN114157756A (zh) 2020-08-20 2020-08-20 任务处理方法及相关电子设备
CN202010844642.5 2020-08-20
CN202010844642.5A CN114173000B (zh) 2020-08-20 2020-08-20 一种回复消息的方法、电子设备和系统、存储介质
CN202010844414.8 2020-08-20
CN202010844313.0 2020-08-20
CN202010844414.8A CN114173204B (zh) 2020-08-20 2020-08-20 一种提示消息的方法、电子设备和系统

Publications (1)

Publication Number Publication Date
WO2021164445A1 true WO2021164445A1 (fr) 2021-08-26

Family

ID=77390406

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/142600 WO2021164445A1 (fr) 2020-02-19 2020-12-31 Procédé de traitement de notification, appareil électronique et système

Country Status (2)

Country Link
CN (1) CN115428413A (fr)
WO (1) WO2021164445A1 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114063968A (zh) * 2021-11-11 2022-02-18 北京字节跳动网络技术有限公司 一种音频设备选择方法、装置及电子设备
CN114390333A (zh) * 2022-02-09 2022-04-22 百果园技术(新加坡)有限公司 界面内容显示方法、装置、设备和存储介质
CN114844983A (zh) * 2022-03-28 2022-08-02 海信视像科技股份有限公司 一种显示设备、通话设备及投屏控制方法
WO2023040555A1 (fr) * 2021-09-18 2023-03-23 华为技术有限公司 Procédé d'affichage d'informations inter-appareils et dispositif électronique
CN116048832A (zh) * 2022-08-31 2023-05-02 荣耀终端有限公司 一种通知的批量清除方法及设备
WO2023071484A1 (fr) * 2021-10-25 2023-05-04 华为技术有限公司 Procédé de commande automatique basé sur la détection de corps humain, et dispositif électronique et système
CN116095224A (zh) * 2022-08-31 2023-05-09 荣耀终端有限公司 通知显示方法和终端设备
CN116107467A (zh) * 2022-06-15 2023-05-12 荣耀终端有限公司 自动触发快捷指令的方法和装置
WO2023103974A1 (fr) * 2021-12-10 2023-06-15 华为技术有限公司 Procédé de collaboration sur un contenu, dispositif électronique et support de stockage lisible par ordinateur
EP4152780A4 (fr) * 2020-05-29 2023-11-01 Huawei Technologies Co., Ltd. Procédé, appareil et système de partage de contenu
WO2024082871A1 (fr) * 2022-10-19 2024-04-25 荣耀终端有限公司 Système de projection d'écran et dispositif électronique

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117135385A (zh) * 2023-03-23 2023-11-28 荣耀终端有限公司 多设备协同录屏及分享的方法、电子设备及通信系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014088231A1 (fr) * 2012-12-03 2014-06-12 Samsung Electronics Co., Ltd. Procédé de mise à disposition d'informations et terminal mobile associé
CN105049329A (zh) * 2015-07-08 2015-11-11 杭州木梢科技有限公司 一种家居环境下的随身消息推送方法及设备控制系统
US20180063313A1 (en) * 2014-07-31 2018-03-01 Samsung Electronics Co., Ltd. Method and device for providing function of mobile terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103037319B (zh) * 2011-09-30 2016-04-27 联想(北京)有限公司 通信转移方法、移动终端及服务器
CN106294798B (zh) * 2016-08-15 2020-01-17 华为技术有限公司 一种基于缩略图的图像分享方法和终端
US10798283B2 (en) * 2017-11-21 2020-10-06 Olympus Corporation Information apparatus, control method, and computer readable recording medium determining state information of the information apparatus across a power switch and transmitting such state information to an external, portable information terminal
CN110224920B (zh) * 2019-04-23 2022-02-01 维沃移动通信有限公司 一种分享方法及终端设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014088231A1 (fr) * 2012-12-03 2014-06-12 Samsung Electronics Co., Ltd. Procédé de mise à disposition d'informations et terminal mobile associé
US20180063313A1 (en) * 2014-07-31 2018-03-01 Samsung Electronics Co., Ltd. Method and device for providing function of mobile terminal
CN105049329A (zh) * 2015-07-08 2015-11-11 杭州木梢科技有限公司 一种家居环境下的随身消息推送方法及设备控制系统

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4152780A4 (fr) * 2020-05-29 2023-11-01 Huawei Technologies Co., Ltd. Procédé, appareil et système de partage de contenu
US12028300B2 (en) 2020-05-29 2024-07-02 Huawei Technologies Co., Ltd. Method, apparatus, and system for sending pictures after thumbnail selections
WO2023040555A1 (fr) * 2021-09-18 2023-03-23 华为技术有限公司 Procédé d'affichage d'informations inter-appareils et dispositif électronique
WO2023071484A1 (fr) * 2021-10-25 2023-05-04 华为技术有限公司 Procédé de commande automatique basé sur la détection de corps humain, et dispositif électronique et système
CN114063968A (zh) * 2021-11-11 2022-02-18 北京字节跳动网络技术有限公司 一种音频设备选择方法、装置及电子设备
WO2023103974A1 (fr) * 2021-12-10 2023-06-15 华为技术有限公司 Procédé de collaboration sur un contenu, dispositif électronique et support de stockage lisible par ordinateur
CN114390333A (zh) * 2022-02-09 2022-04-22 百果园技术(新加坡)有限公司 界面内容显示方法、装置、设备和存储介质
CN114390333B (zh) * 2022-02-09 2024-04-02 百果园技术(新加坡)有限公司 界面内容显示方法、装置、设备和存储介质
CN114844983A (zh) * 2022-03-28 2022-08-02 海信视像科技股份有限公司 一种显示设备、通话设备及投屏控制方法
CN116107467B (zh) * 2022-06-15 2023-11-21 荣耀终端有限公司 自动触发快捷指令的方法和装置
CN116107467A (zh) * 2022-06-15 2023-05-12 荣耀终端有限公司 自动触发快捷指令的方法和装置
CN116095224B (zh) * 2022-08-31 2023-10-31 荣耀终端有限公司 通知显示方法和终端设备
CN116048832B (zh) * 2022-08-31 2023-11-03 荣耀终端有限公司 一种通知的批量清除方法及设备
CN116095224A (zh) * 2022-08-31 2023-05-09 荣耀终端有限公司 通知显示方法和终端设备
CN116048832A (zh) * 2022-08-31 2023-05-02 荣耀终端有限公司 一种通知的批量清除方法及设备
WO2024082871A1 (fr) * 2022-10-19 2024-04-25 荣耀终端有限公司 Système de projection d'écran et dispositif électronique

Also Published As

Publication number Publication date
CN115428413A (zh) 2022-12-02

Similar Documents

Publication Publication Date Title
WO2021164445A1 (fr) Procédé de traitement de notification, appareil électronique et système
WO2021013158A1 (fr) Procédé d'affichage et appareil associé
WO2021164554A1 (fr) Système et procédé de traitement des notifications, et dispositif électronique
US20220163932A1 (en) Device control page display method, related apparatus, and system
CN113885759B (zh) 通知消息处理方法、设备、系统及计算机可读存储介质
CN114173204B (zh) 一种提示消息的方法、电子设备和系统
EP4113415A1 (fr) Procédé de recommandation de service, dispositif électronique, et système
WO2020155014A1 (fr) Système et un procédé de partage de dispositif domestique intelligent, et dispositif électronique
WO2022037407A1 (fr) Procédé et système de réponse à un message, et dispositif électronique
CN113835649B (zh) 一种投屏方法和终端
WO2020253754A1 (fr) Système et procédé de communication de données multimédia à terminaux multiples
WO2020156230A1 (fr) Procédé de présentation d'une vidéo sur un dispositif électronique lors de l'arrivée d'un appel entrant et dispositif électronique
WO2021233161A1 (fr) Procédé et appareil de fusion de calendrier familial
WO2022037480A1 (fr) Procédé de traitement de tâche et dispositif électronique associé
WO2022135157A1 (fr) Procédé et appareil d'affichage de page, ainsi que dispositif électronique et support de stockage lisible
US12028300B2 (en) Method, apparatus, and system for sending pictures after thumbnail selections
WO2023015963A1 (fr) Procédé de gestion de fichier, dispositif électronique et support de stockage lisible par ordinateur
CN114356195B (zh) 一种文件传输的方法及相关设备
EP4287014A1 (fr) Procédé d'affichage, dispositif électronique et système
WO2022152174A1 (fr) Procédé de projection d'écran et dispositif électronique
WO2022052706A1 (fr) Procédé, système et dispositif électronique de partage de services
WO2023142941A1 (fr) Procédé d'affichage d'enregistrement de lecture et dispositif associé
WO2023142935A1 (fr) Procédé de gestion de composant d'application et dispositif associé
WO2022222733A1 (fr) Procédé de transmission de données et dispositif associé
WO2022022435A1 (fr) Procédé pour rejoindre rapidement une conférence et dispositif associé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20920259

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20920259

Country of ref document: EP

Kind code of ref document: A1