CN114173204B

CN114173204B - Message prompting method, electronic equipment and system

Info

Publication number: CN114173204B
Application number: CN202010844414.8A
Authority: CN
Inventors: 刘敏; 余平
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-08-20
Filing date: 2020-08-20
Publication date: 2023-09-22
Anticipated expiration: 2040-08-20
Also published as: CN114173204A

Abstract

The application provides a method, electronic equipment and a system for prompting a message, wherein the method comprises the following steps: the first electronic device receives a message; the first electronic device sends the message to the second electronic device when determining that the device focused by the owner of the first electronic device is the second electronic device; the second electronic device prompts the message to the user according to the device information of the second electronic device. The embodiment of the application is beneficial to timely receiving the reminding of the message by the user and avoids the user from missing important messages; meanwhile, different message prompt modes are presented to the user through different equipment information, so that the user experience is improved.

Description

Message prompting method, electronic equipment and system

Technical Field

The present application relates to the field of terminals, and more particularly, to a method, an electronic device, and a system for prompting a message.

Background

Currently, users have more and more devices, applications and services on the devices are more and more, notification messages sent by various applications and services are more and more, and users are being inundated with notifications of "flooding". Meanwhile, as more and more devices are provided for users, the users cannot acquire and process notification messages in time, so that the users miss important notification messages, and the experience of the users is affected.

Disclosure of Invention

The method, the electronic equipment and the system for prompting the message are beneficial to users to timely receive the prompt of the message and avoid the users from missing important messages, so that the experience of the users is improved.

In a first aspect, there is provided a system comprising a first electronic device and a second electronic device, wherein the first electronic device is configured to receive a message; the first electronic device is further configured to send the message to the second electronic device when it is determined that the device focused by the owner of the first electronic device is the second electronic device; the second electronic device is used for prompting the message to the user according to the device information of the second electronic device.

In the embodiment of the application, when the first electronic device determines that the device focused by the user is not the first electronic device but the second electronic device, the first electronic device can forward the message to the second electronic device, and the second electronic device can prompt the message to the user according to the device information of the second electronic device, so that the user is helped to timely receive the prompt of the message, and the user is prevented from missing important messages; meanwhile, the second electronic equipment with different equipment information can present reminding in different modes to the user, and the experience of the user when receiving the message is improved.

In some possible implementations, the device information of the second electronic device may include, but is not limited to: hardware capability information of the second electronic device (e.g., the second electronic device is a large screen device or the second electronic device is a car set), a current state of the device (e.g., whether the device is currently interacting with a user or whether the device is in an immersed state), and so forth.

In some possible implementations, the second electronic device may be a device in a list of devices in the first electronic device; alternatively, the second electronic device may be a device surrounding the first electronic device.

With reference to the first aspect, in certain implementation manners of the first aspect, the device information includes that the second electronic device is provided with a display screen, and the second electronic device is specifically configured to: the second electronic device displays a message reminding frame through the display screen, wherein the message reminding frame comprises the message and the message reminding frame does not comprise a control.

In the embodiment of the application, for the second electronic equipment with the display screen, the second electronic equipment can not display a control when prompting the message to the user, and the user can check in the notification center of the second electronic equipment when hopeing to reply the message, so that the user can receive the prompt of the message in time, the user is prevented from missing important messages, and the user experience is improved.

With reference to the first aspect, in certain implementation manners of the first aspect, the device information includes that the second electronic device is provided with a display screen, and the second electronic device is specifically configured to: when the second electronic equipment detects that the input of the user is being received, a message reminding frame is displayed through the display screen, a cursor is not positioned on the message reminding frame, and the message reminding frame comprises the message; or when the second electronic equipment detects that the input of the user is not received, displaying the reminding frame through the display screen and positioning the cursor on the message reminding frame.

In the embodiment of the application, for the second electronic device with the display screen, if the second electronic device receives the message forwarded by the first electronic device and the second electronic device is receiving the input of the user (or the second electronic device is interacting with the user), the second electronic device can not position the cursor at the message reminding frame, so that the trouble to the current operation of the user is avoided, and the user experience is improved.

With reference to the first aspect, in certain implementations of the first aspect, the second electronic device is further configured to: when the second electronic equipment detects that the input of the user is being received, prompt information is displayed through the display screen, and the prompt information is used for reminding the user to position the cursor to the message reminding frame through a first operation.

In the embodiment of the application, if the second electronic device receives the message forwarded by the first electronic device and the second electronic device is receiving the input of the user (or the second electronic device is interacting with the user), the second electronic device can also prompt the user to position the cursor to the message reminding frame through the preset operation. Therefore, when the trouble to the current operation of the user is avoided, the user can quickly locate the message reminding frame through the prompt information, so that the user can reply to the message conveniently, and the user experience is improved.

In some possible implementations, the prompting message is configured to prompt a user to position the cursor to the message reminder box through a first operation, including: the prompt message is used for reminding a user to position the cursor to a reply control in the message reminding frame through a first operation.

With reference to the first aspect, in certain implementation manners of the first aspect, the device information includes that the second electronic device has a voice function, and the second electronic device is specifically configured to: reminding a user of receiving the message through voice; alternatively, the user is alerted to the content of the message by voice.

In the embodiment of the application, for the second electronic device with the voice function, when the second electronic device receives the text message as the message of the first electronic device, the second electronic device can prompt the user to receive the message or prompt the user for the content of the message through voice. Therefore, the user is prevented from looking up the screen of the second electronic device, the prompt of the message can be known through the voice prompt, the user is prevented from missing important messages, and the user experience is improved.

In some possible implementations, the second electronic device is a car set or a smart speaker.

With reference to the first aspect, in some implementations of the first aspect, the first electronic device is further configured to send indication information to the second electronic device, where the indication information is configured to instruct the second electronic device to add a reply control to the message; the second electronic device is specifically configured to display a message reminding frame according to the device information and the indication information, where the message reminding frame includes the message and the reply control; the second electronic equipment is also used for sending reply content to the first electronic equipment when detecting the operation of replying the message by the user; the first electronic device is further configured to reply to the message according to the reply content.

In the embodiment of the application, when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device can send the message and the indication information to the second electronic device, so that the second electronic device can present the message reminding frame comprising the message and the reply control to the user. Thus, the owner of the first electronic device can conveniently complete virtual reply to the message on the second electronic device. The second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a true reply to the message. Thus, the reminding of the user for receiving the message in time and the reply to the message are facilitated, the process that the user returns to the first electronic equipment to reply to the message is avoided, and the user is prevented from missing important messages.

In some possible implementations, the second electronic device is a large screen device, and if the second electronic device is receiving the input of the user when receiving the indication information, the second electronic device may display a message alert box and position a cursor in a reply control in the message alert box; the second electronic device, when receiving the indication information, if the second electronic device does not receive the input of the user, may display a message alert box and not position the cursor in a reply control in the message alert box.

With reference to the first aspect, in some implementations of the first aspect, the message is a message of a first application, and the second electronic device is a device that does not install the first application.

In the embodiment of the application, if the second electronic device is a device without the first application program, the second electronic device may further add a reply control in the message reminding frame after receiving the indication information, so that the second electronic device may acquire the content replied by the user through the reply content input by the user and the detected operation of clicking the reply control, and send the replied content to the first electronic device. Thereby completing a true reply to the message on the first electronic device. Therefore, the reminding method and the reminding device are beneficial to timely receiving the reminding of the message by the user, avoid the user from missing important messages, and further help to improve the experience of the user.

With reference to the first aspect, in certain implementation manners of the first aspect, the device information includes that the second electronic device is provided with a camera, and the second electronic device is further configured to: prompting the content of the message when the second electronic device detects that only the owner of the first electronic device focuses on the second electronic device through the camera; or when the second electronic device detects that a plurality of users including a owner of the first electronic device focus on the second electronic device through the camera, prompting that the message is received.

In the embodiment of the application, for the second electronic device with the camera, if the second electronic device detects that only the owner of the first electronic device focuses on the second electronic device through the camera, the second electronic device can prompt the content of the message to the user; if there are multiple users focusing on the second electronic device, including the owner of the first electronic device, the second electronic device may prompt the user for receipt of a message. Thus, the disclosure of the privacy of the user is avoided, and the safety of message forwarding is ensured, so that the experience of the user is improved.

With reference to the first aspect, in certain implementations of the first aspect, the second electronic device is further configured to: before prompting the message to the user, it is determined that the second electronic device is in a non-do not disturb mode, or it is determined that the second electronic device is not currently running a preset application.

In the embodiment of the application, the second electronic device can determine that the message is in the non-immersed state before prompting the message to the user. The immersion state may also be understood as a notification disabled state, e.g., the immersion state may be that the user has disabled notification or has a do not disturb mode enabled, or the immersion state may be that an application running in the foreground of the second electronic device is a preset application (e.g., a video App or game App). This helps to avoid interference to the user and thus helps to enhance the user's experience.

With reference to the first aspect, in certain implementations of the first aspect, the first electronic device is further configured to: before sending the message to the second electronic device, determining that the type of the message is a message type set by a user; or before sending the message to the second electronic device, determining that the message is an instant messaging IM type message.

In the embodiment of the application, before the first electronic device forwards the message to the second electronic device, the message type set by the user or the IM type message can be determined, so that the problem that some unimportant messages are also forwarded to the second electronic device is solved, the interference of the unimportant messages to the user is avoided, and the experience of the user is improved.

With reference to the first aspect, in certain implementations of the first aspect, the first electronic device is further configured to: before the message is sent to the second electronic device, determining that the second electronic device forwards the received message set by the user; or before sending the message to the second electronic device, determining that the account number registered on the first electronic device is associated with the account number registered on the second electronic device.

In the embodiment of the application, before the first electronic device forwards the message to the second electronic device, the second electronic device can be determined to be the device for receiving the message forwarding set by the user or the account number logged on the first electronic device is determined to be associated with the account number logged on the second electronic device, so that the message is prevented from being forwarded to the unauthorized device of the user, the safety of message forwarding is improved, the leakage of privacy of the user is avoided, and the experience of the user is improved.

With reference to the first aspect, in certain implementation manners of the first aspect, the first electronic device is specifically configured to: when the fact that the device focused by the owner of the first electronic device is not the first electronic device is determined, sending request information to the second electronic device, wherein the request information is used for requesting the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device or not; the second electronic device is further configured to send response information to the first electronic device according to the request information, where the response information is used to indicate that a device currently focused by a owner of the first electronic device is the second electronic device; the first electronic device is specifically configured to: and in response to receiving the response information, sending the message to the second electronic device.

In the embodiment of the application, the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or the first electronic device and the second electronic device may store information of the same user), so that after receiving the request information, the second electronic device may acquire the user characteristics and match with the characteristics of the owner of the first electronic device preset in the second electronic device, and if the matching is successful, determine that the device currently focused by the owner of the first electronic device is the second electronic device, thereby sending response information to the first electronic device. Therefore, the message forwarding safety is improved, and the prompt that other users except the owner of the first electronic equipment receive the message is avoided, so that the user experience is improved.

In some possible implementations, after receiving the request information, the second electronic device may first determine whether the first electronic device and the second electronic device are devices under the same account. If the second electronic device determines that the first electronic device and the second electronic device are devices under the same account, the second electronic device can acquire the characteristic information of the user focusing on the second electronic device through the user characteristic acquisition device, the acquired user characteristic information is matched with the characteristic information of the owner of the first electronic device preset in the second electronic device, and if the matching is successful, the response information is sent to the first electronic device.

With reference to the first aspect, in certain implementation manners of the first aspect, the second electronic device includes a user feature acquisition device, and the first electronic device is specifically configured to: when the fact that the device focused by the owner of the first electronic device is not the first electronic device is determined, sending request information to the second electronic device, wherein the request information is used for requesting the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device or not; the second electronic device is further configured to: according to the request information, collecting user characteristics through the user characteristic collecting device and sending the user characteristics to the first electronic equipment; the first electronic device is specifically configured to: before sending the notification message to the second electronic device, it is determined that the user characteristic matches a preset user characteristic in the first electronic device.

In the embodiment of the application, the second electronic device may be a device in a message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or the first electronic device and the second electronic device may store information of different users); alternatively, the second electronic device may be a device surrounding the first electronic device. Thus, after the second electronic device receives the request information, the user characteristic acquisition device can acquire the characteristic information of the user focusing on the second electronic device and send the characteristic information to the first electronic device. The first electronic equipment is matched with the preset user characteristic information in the first electronic equipment according to the characteristic information, and if the matching is successful, the message is forwarded to the second electronic equipment. Therefore, the message forwarding safety is improved, and the prompt that other users except the owner of the first electronic equipment receive the message is avoided, so that the user experience is improved.

In a second aspect, there is provided a method for prompting a message, the method being applied to an electronic device, the method comprising: the electronic equipment receives a message sent by another electronic equipment, wherein the message is acquired by the other electronic equipment from a server; the electronic device prompts the message to the user according to the device information of the electronic device.

With reference to the second aspect, in some implementations of the second aspect, the device information includes that the electronic device is provided with a display screen, and the electronic device prompts the message to a user according to the device information of the electronic device, including: and displaying a message reminding frame through the display screen, wherein the message reminding frame comprises the message and the message reminding frame does not comprise a control.

In the embodiment of the application, for the electronic equipment with the display screen, the electronic equipment can not display a control when prompting the message to the user, and the user can check in the notification center of the electronic equipment when hopeing to reply the message, so that the user can receive the prompt of the message in time, the user is prevented from missing important messages, and the experience of the user is improved.

With reference to the second aspect, in some implementations of the second aspect, the device information includes that the electronic device is provided with a display screen, and the electronic device prompts the message to a user according to the device information of the electronic device, including: when the electronic equipment detects that the input of a user is being received, a message reminding frame is displayed through the display screen, a cursor is not positioned on the message reminding frame, and the message reminding frame comprises the message; or when the electronic equipment detects that the input of the user is not received, the message reminding frame is displayed through the display screen, and the cursor is positioned on the message reminding frame.

In the embodiment of the application, for the electronic equipment with the display screen, if the electronic equipment receives the input of the user while receiving the message forwarded by another electronic equipment (or the second electronic equipment is interacting with the user), the electronic equipment can not position the cursor at the message reminding frame, thereby avoiding the trouble to the current operation of the user and improving the experience of the user.

With reference to the second aspect, in certain implementations of the second aspect, the method further includes: when the electronic equipment detects that the input of the user is being received, prompt information is displayed through the display screen, and the prompt information is used for reminding the user to position the cursor to the message reminding frame through a first operation.

In the embodiment of the application, if the electronic device receives the input of the user while receiving the message forwarded by another electronic device (or the second electronic device is interacting with the user), the electronic device can also prompt the user to position the cursor to the message reminding frame through the preset operation. Therefore, when the trouble to the current operation of the user is avoided, the user can quickly locate the message reminding frame through the prompt information, so that the user can reply to the message conveniently, and the user experience is improved.

With reference to the second aspect, in some implementations of the second aspect, the device information includes that the electronic device has a voice function, and the electronic device prompts the message to a user according to the device information of the electronic device, including: the electronic equipment prompts the user to receive the message through voice; alternatively, the electronic device alerts the user to the content of the message by voice.

In the embodiment of the application, for the electronic equipment with the voice function, when the electronic equipment receives the text message from another electronic equipment, the electronic equipment can prompt the user to receive the message or prompt the user for the content of the message through voice. Therefore, the user is prevented from looking up the screen of the electronic equipment, the prompt of the message can be known through the voice prompt, and the user is prevented from missing important messages, so that the user experience is improved.

In some possible implementations, the electronic device is a car set or a smart speaker.

With reference to the second aspect, in certain implementations of the second aspect, before the electronic device prompts the message to the user, the method further includes: the electronic equipment receives indication information sent by the other electronic equipment, wherein the indication information is used for indicating the electronic equipment to increase a reply control for the message; the electronic device prompts the message to the user according to the device information, comprising: the electronic equipment displays a message reminding frame according to the equipment information and the indication information, wherein the message reminding frame comprises the message and the reply control; after the electronic device prompts the message to the user, the method further comprises: and when detecting the operation of replying to the message by the user, sending replied content to the other electronic device.

According to the embodiment of the application, the electronic equipment can present the message reminding frame comprising the message and the reply control to the user according to the equipment information and the indication information of the electronic equipment. Thus, the user can conveniently complete virtual reply to the message on the electronic equipment. The electronic device may send the reply content to another electronic device so that the other electronic device completes a true reply to the message. Thus, the reminding of the user for receiving the message in time and the reply to the message are facilitated, the process that the user returns to another electronic device to reply to the message is avoided, and the user is prevented from missing important messages.

With reference to the second aspect, in some implementations of the second aspect, the message is a message of a first application, and the electronic device is a device that does not install the first application.

With reference to the second aspect, in some implementations of the second aspect, the device information includes that the electronic device is provided with a camera, and the electronic device prompts the message to a user according to the device information of the electronic device, including: when the electronic device detects that only the owner of the other electronic device focuses on the electronic device through the camera, the electronic device prompts the content of the message; or when the electronic device detects that a plurality of users including a machine owner of the other electronic device focus on the electronic device through the camera, the user is prompted to receive the message.

In the embodiment of the application, for the electronic equipment with the camera, if the electronic equipment detects that only the owner of another electronic equipment focuses on the electronic equipment through the camera, the electronic equipment can prompt the content of the message to the user; if there are multiple users focusing on the electronic device, including the owner of another electronic device, the electronic device may prompt the user for receipt of a message. Thus, the disclosure of the privacy of the user is avoided, and the safety of message forwarding is ensured, so that the experience of the user is improved.

With reference to the second aspect, in certain implementations of the second aspect, the method further includes: before prompting the message to the user, it is determined that the electronic device is in a non-do not disturb mode or that the electronic device is not currently running a preset application.

In the embodiment of the application, the electronic device can determine that the message is in a non-immersed state before prompting the message to the user. The immersion state may also be understood as a notification disabled state, e.g., the immersion state may be that the user has disabled notification or turned on a do not disturb mode, or the immersion state may be that an application running in the foreground of the electronic device is a preset application (e.g., a video App or game App). This helps to avoid interference to the user and thus helps to enhance the user's experience.

With reference to the second aspect, in certain implementations of the second aspect, the method further includes: before receiving the message sent by the other electronic device, the electronic device receives request information sent by the other electronic device, where the request information is used to request the electronic device to determine whether an owner of the other electronic device focuses on the electronic device; and the electronic equipment sends response information to the other electronic equipment according to the request information, wherein the response information is used for indicating that the equipment currently focused by the owner of the other electronic equipment is the electronic equipment.

In the embodiment of the application, the electronic device may be a device in a message forwarding list of another electronic device, and the electronic device and the other electronic device may be devices under the same account (or the electronic device and the other electronic device may store information of the same user), so that after receiving the request information, the electronic device may acquire user characteristics and match with preset user characteristics in the electronic device, and if the matching is successful, determine that the device currently focused by the owner of the other electronic device is the electronic device, thereby sending response information to the other electronic device. Therefore, the message forwarding safety is improved, and the prompt that other users except the owner of the other electronic equipment receive the message is avoided, so that the user experience is improved.

In some possible implementations, after receiving the request information, the electronic device may first determine whether the other electronic device and the electronic device are devices under the same account. If the electronic equipment determines that the other electronic equipment and the electronic equipment are equipment under the same account, the electronic equipment can acquire the characteristic information of the user focusing the electronic equipment through the user characteristic acquisition device, the acquired user characteristic information is matched with the characteristic information of a machine owner of the other electronic equipment preset in the electronic equipment, and if the matching is successful, the response information is sent to the other electronic equipment.

With reference to the second aspect, in certain implementations of the second aspect, the electronic device includes a user feature acquisition device, and the method further includes: before receiving the message sent by the other electronic device, the electronic device receives request information sent by the other electronic device, where the request information is used to request the electronic device to determine whether an owner of the other electronic device focuses on the electronic device; and the electronic equipment collects the user characteristics through the user characteristic collection device according to the request information and sends the user characteristics to the other electronic equipment.

In the embodiment of the application, the electronic device may be a device in a message forwarding list of another electronic device, and the electronic device may be a device not under the same account as the other electronic device (or the first electronic device and the second electronic device may store information of different users); alternatively, the electronic device may be a device surrounding another electronic device. Thus, after receiving the request information, the electronic device can acquire the characteristic information of the user focusing on the second electronic device through the user characteristic acquisition device and send the characteristic information to the other electronic device. And the other electronic equipment is matched with the user characteristic information preset in the other electronic equipment according to the characteristic information, and if the matching is successful, the information is forwarded to the electronic equipment. Therefore, the message forwarding safety is improved, and the prompt that other users except the owner of the other electronic equipment receive the message is avoided, so that the user experience is improved.

In a third aspect, there is provided an apparatus for prompting a message, the apparatus for prompting a message being provided in an electronic device, the apparatus comprising: a receiving unit, configured to receive a message sent by another electronic device; and the prompting unit prompts the message to the user according to the equipment information of the device.

In a fourth aspect, there is provided an electronic device comprising: one or more processors; a memory; and one or more computer programs. Wherein one or more computer programs are stored in the memory, the one or more computer programs comprising instructions. The instructions, when executed by an electronic device, cause the electronic device to perform the method of prompting a message in any of the possible implementations of the second aspect described above.

In a fifth aspect, there is provided a computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform the method of prompting a message according to the second aspect above.

In a sixth aspect, there is provided a computer readable storage medium comprising instructions which, when executed on an electronic device, cause the electronic device to perform the method of prompting messages of the second aspect above.

In a seventh aspect, a chip is provided for executing instructions, where the chip performs the method of prompting messages according to the second aspect.

Drawings

Fig. 1 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Fig. 2 is a block diagram of a software structure provided in an embodiment of the present application.

FIG. 3 is a set of graphical user interfaces provided by an embodiment of the present application.

FIG. 4 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 5 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 6 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 7 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 8 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 9 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 10 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 11 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 12 is another set of graphical user interfaces provided by embodiments of the present application.

FIG. 13 is another set of graphical user interfaces provided by embodiments of the present application.

Fig. 14 is a schematic diagram of source end and sink end interaction provided by an embodiment of the present application.

Fig. 15 is a schematic flow chart of a method for prompting a message provided by an embodiment of the present application.

Fig. 16 is a schematic block diagram of an apparatus for prompting a message provided by an embodiment of the present application.

Fig. 17 is a schematic structural diagram of a prompt electronic device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plural" or "plurality" means two or more than two.

The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

The method provided by the embodiment of the application can be applied to electronic equipment such as mobile phones, tablet computers, wearable equipment, vehicle-mounted equipment, augmented reality (augmented reality, AR)/Virtual Reality (VR) equipment, notebook computers, ultra-mobile personal computer (UMPC), netbooks, personal digital assistants (personal digital assistant, PDA) and the like, and the embodiment of the application does not limit the specific type of the electronic equipment.

By way of example, fig. 1 shows a schematic diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, such that the processor 110 communicates with the touch sensor 180K through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object in the vicinity of the electronic device 100. The electronic device 100 can detect that the user holds the electronic device 100 close to the ear by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, bone conduction sensor 180M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 180M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 180M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 170 may analyze the voice signal based on the vibration signal of the sound portion vibration bone block obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor may analyze the heart rate information based on the blood pressure beat signal acquired by the bone conduction sensor 180M, so as to implement a heart rate detection function.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The electronic device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195, or removed from the SIM card interface 195 to enable contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, i.e.: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.

Fig. 2 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present application. The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively. The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media library (media library), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

Fig. 3 is a set of graphical user interfaces (graphical user interface, GUI) provided by an embodiment of the present application.

The user is watching the smart television in the living room, the mobile phone is placed on a table beside the user, and the mobile phone is in a screen locking state.

Referring to the GUI shown in (a) of fig. 3, the smart tv is now playing video. The handset receives an App1 message (the message content is "meeting at 9 am") sent by the user Li Hua. At this time, the mobile phone judges that the current focus of the user is on the smart television and not on the mobile phone, and then the mobile phone can send the message content of the App1 to the smart television, and the television reminds the user of the received message content of the App 1. A message reminding box 301 can be displayed on the smart television, and the message reminding box 301 comprises a message that the message is App1, and the content of the message is "meeting at 9 am" for Li Huaju users who send the message.

Referring to the GUI shown in (b) of fig. 3, the smart tv is now performing a zapping operation. The handset receives an App1 message (the message content is "meeting at 9 am") sent by the user Li Hua. At this time, the mobile phone judges that the current focus of the user is on the smart television and not on the mobile phone, and then the mobile phone can send the message content of the App1 to the smart television, and the television reminds the user of the received message content of the App 1. A message reminder box 302 may be displayed on the smart tv, where the message reminder box 302 includes a message that the message is App1, and the content of the message is "meeting at 9 am" for Li Huaju users who send the message.

In one embodiment, the smart television may automatically position a cursor of the smart television at the message alert box when the message alert box is displayed. When the intelligent television detects that the user clicks the determination button through the remote controller, the intelligent television can automatically jump to the notification center. The user may complete a reply to the message at the notification center.

In one embodiment, if the smart tv does not receive any operation of the user within a preset time period of displaying the message alert frame, the smart tv may hide the message alert frame.

Referring to the GUI shown in (c) of fig. 3, after watching a video or ending a zapping operation, the user may enter a notification center of the smart tv through the operation. The notification center of the smart television display includes a message reminding box 303 of App1 received before, where the message reminding box 303 of App1 includes a message that the message is App1, a source of the message of App1 is a P40 mobile phone from a user lie, a user who sends the message is Li Hua, and a content of the message is a "meeting at 9 am" reply control 304 and a ignore control 305. When the smart tv detects that the user clicks the reply control 304, the smart tv may display a GUI as shown in (d) of fig. 3.

See the GUI shown in fig. 3 (d). When the smart television detects that the user clicks the reply control 304, the smart television may display an input method of the smart television. At this time, the user may reply to the message of App1 through an input method.

It should be understood that in the GUI shown in fig. 3 (a) and fig. 3 (b), after the mobile phone determines that the user is not focused on the mobile phone, although the mobile phone receives the App1 message, the mobile phone may not be displayed on the screen. And the content of the notification message is sent to the intelligent television by judging that the device focused by the user is the intelligent television, so that the user is prompted through the intelligent television. When the mobile phone detects that the user clicks the power key, the mobile phone is in a screen locking and screen brightening state, and at the moment, the mobile phone can display the message prompt of App1 on a screen locking interface.

It should also be understood that, when the smart tv shown in (a) in fig. 3 is playing a video, and the smart tv shown in (b) in fig. 3 is performing a channel change operation, the smart tv may not add a control action in the message alert box 301 when the message alert of App1 is displayed (e.g., may not add a reply control, ignore a control in the message alert box 301) so as to avoid the trouble caused by clicking by a user by mistake.

FIG. 4 illustrates another set of GUIs provided by an embodiment of the present application.

See the GUI shown in fig. 4 (a), which is similar to the GUI shown in fig. 3 (a). The difference is that a reply control and a neglect control are added in a message reminding frame displayed by the intelligent television.

In one embodiment, after the smart television receives the App1 message sent by the mobile phone, the smart television may display a message alert box and at this time, the smart television may automatically position the cursor to the reply control. When the intelligent television detects that the user clicks the determination button through the remote controller, the user can finish replying the message of the App1 in the process of playing the video.

In one embodiment, if the smart tv does not detect that the user replies to the App1 message within a preset time, the smart tv may automatically hide the message alert box. The user can look up the message content in the notification center of the smart television and reply.

See the GUI shown in fig. 4 (b), which is similar to the GUI shown in fig. 4 (a). The method is characterized in that when the user is operating the smart television and the smart television receives the notification message sent by the mobile phone, the smart television displays a message reminding frame but does not automatically position a cursor to a reply control, so that the trouble to the current operation of the user is avoided.

Because the user is operating the intelligent television to change channels at the moment, the intelligent television can not automatically position at the moment, so that the trouble to the operation of the user is avoided. Further, as in the GUI shown in fig. 4 (b), a text prompt "click menu key process" is included near the message alert window, so that although the user is using the remote control (the user clicks up, down, left, and right keys) to change channels, the user can click the menu key after seeing the text prompt. When the intelligent television detects that the user clicks the menu key, the intelligent television can automatically position the cursor to the reply control, so that the reply of the message of the App1 is completed.

As shown in (b) of fig. 4, when the smart tv detects that the user clicks the menu key, the smart tv may automatically position the cursor to the reply control.

In one embodiment, the message reminding frame shown in (a) in fig. 4 may also not include a control, and when the smart tv detects that the user has no interaction with the smart tv, the smart tv may position the cursor to the message reminding frame. When the user clicks the "ok" button using the remote control, the smart tv may jump to the notification center, where the notification center includes the notification message and the corresponding reply control. The user may complete a reply to the message in the notification center.

FIG. 5 illustrates another set of GUIs provided by an embodiment of the present application.

The user is driving the car machine at this time, and navigation information is displayed on a display screen of the car machine. The mobile phone is placed in a storage groove on the vehicle by a user and is in a screen locking state at the moment.

The handset receives an App1 message (the message content is "meeting at 9 am") sent by the user Li Hua. At this time, the mobile phone judges that the current focus of the user is on the car machine but not on the mobile phone, and then the mobile phone can send the message content of the App1 to a display screen of the car machine, and the display screen reminds the user of the received message of the App 1. A message reminding frame 501 can be displayed on a display screen of the vehicle, and the message reminding frame 501 comprises a message that the message is App1, a user who sends the message is Li Huaju, and the content of the message is "meeting at 9 am".

The car machine can remind the user of meeting at 9 am through a voice reminding mode. Or, the car machine can remind the user of reminding the meeting at 9 am through a voice reminding mode by the user Li Hua. The car machine can collect voice information of the user through the microphone. For example, the car machine can collect voice information as "good, i know. The car machine may send the voice information to the user Li Hua, or may convert the voice information into text information and send the text information to the user Li Hua.

In one embodiment, the display screen of the car machine can further comprise a voice broadcasting control, and when the car machine detects that the user clicks the voice broadcasting control, the car machine can remind the user of 'meeting at 9 am' through a voice reminding mode.

In one embodiment, a digital signal processor (digital signal processing, DSP) may be included on board the vehicle. The DSP can process the voice information, so that the text content corresponding to the voice information can be obtained through analysis.

In one embodiment, a speech recognition (automatic speech recognition, ASR) module may be included on board the vehicle, wherein the ASR module primarily functions to recognize the user's speech information as textual content.

In one embodiment, the message reminding frame displayed on the display screen of the vehicle machine can also include a sending control, and after the user clicks the sending control, the vehicle machine can send the content replied by the user to the mobile phone. Alternatively, the message alert box may not include a send control. The car machine collects voice information of the user through the microphone and sends the voice information to the Li Hua, and after the car machine knows the voice information, the car machine can send the content replied by the user to the mobile phone.

In one embodiment, after detecting that the user clicks the sending control, the vehicle may also send the preset shortcut reply content to the mobile phone.

In the embodiment of the application, for the scene that the user is driving the car machine, the car machine can convert the text information into the voice information to prompt the user, so that the phenomenon that the attention is not concentrated due to the fact that the user views the message content on the display screen can be avoided, and the safety of the user when driving the car machine is improved.

FIG. 6 illustrates another set of GUIs provided by an embodiment of the present application.

The user is sitting on the sofa, the handset is placed by the user on a table at one side and the speaker is on a table at the other side of the user.

The handset receives a mail (mail subject "meeting notification") from the user Li Hua. At the moment, the mobile phone judges that the current focus of the user is not on the mobile phone, the mobile phone can send the mail reminding to the sound box, and the sound box reminds the user that the user receives a mail through voice, please check the mail on the mobile phone.

It should be understood that although the focus of the user is not on the sound box at this time, the sound box can remind the user through voice, so that the user can be better attracted, and the user is prevented from missing important mails.

FIG. 7 illustrates another set of GUIs provided by an embodiment of the present application.

The user wears the wearable device and is sitting on a sofa, and the notebook computer is in a sleeping (or dormant) state and is placed on a table aside by the user.

The user sets a schedule on the notebook computer, the time of the schedule is 9 to 10 am, and the event of the schedule is a discussion. When the notebook computer determines that the event of the schedule is about to occur for 5 minutes, the user cannot be prompted because the notebook computer is in a sleep state at the moment (when the notebook computer detects that the notebook computer enters an operating state when being opened from a sleep state when being closed, the notebook computer can prompt the schedule information to the user). The notebook computer can send the schedule reminder to the wearable device for prompting.

Referring to the GUI shown in fig. 7, the wearable device prompts the schedule information through the display screen.

In the embodiment of the application, a plurality of devices of the user can be mutually connected and mutually perceived. When device a receives the notification message, device a may determine the focus of the user's current attention. And if the current focus of the user is not in the device A, triggering the notification forwarding. When the focus device is judged to be in the device B, the mobile phone can forward the notification message to the device B, so that the device A does not notify at the moment, and the device B notifies, so that harassment to a user can be avoided.

After the notification is forwarded to device B, device B may also optimize notification presentation and interaction according to device B's capabilities.

FIG. 8 illustrates another set of GUIs provided by an embodiment of the present application.

The user is playing the tablet on the sofa, the mobile phone is placed on a table beside the user and the mobile phone is in a screen locking state.

The handset receives an App1 message (the message content is "meeting at 9 am") sent by the user Li Hua. At this time, the mobile phone judges that the current focus of the user is on the tablet but not on the mobile phone, and then the mobile phone can send the message content of the App1 to the tablet. The tablet may determine, based on the current tablet status, whether to alert the user to the App1 message.

Referring to the GUI shown in (a) of fig. 8, if the tablet is in a state of playing video at this time, the tablet may not prompt the user for a message of App 1.

In the embodiment of the application, if the tablet is in the immersed state, the tablet may not prompt the App1 message. The immersion state may also be understood as a notification disabled state, e.g., the immersion state may be that the user has disabled the notification or has the do-not-disturb mode turned on. For example, users are conducting teleconferencing, especially when sharing desktops, if notification is provided, the notification may not only be affected by interference, but also be seen by other participants, which may affect the user experience and may reveal the privacy of the user.

Referring to the GUI shown in fig. 8 (b), if the tablet is displaying a desktop at this time, the tablet may display a message alert box 801. The message reminding box 801 includes a message that the message is App1, li Hua for the user who sends the message, and "meeting at 9 am" for the content of the message, a reply control, and a ignore control.

In the embodiment of the application, when the focus device receives the notification message, the focus device can firstly judge whether the focus device is in an immersed state or not. If the focus device is in an immersed state, the focus device may not remind the user; if the focus device is not in an immersed state, the focus device may alert the user.

In one embodiment, the immersion state includes, but is not limited to:

(1) The focus device is in a do not disturb mode;

(2) The focal device is in a scene of a game, video, etc.

It should be appreciated that the focus device may make notification reminders as set by the user. The user may set that message reminding is not possible in the game scene, but is possible in the video scene.

FIG. 9 illustrates another set of GUIs provided by an embodiment of the present application.

Referring to the GUI shown in (a) of fig. 9, the smart tv is now playing video. The handset receives an App1 message (the message content is "meeting at 9 am") sent by the user Li Hua. At this time, the mobile phone judges that the current focus of the user is on the smart television and not on the mobile phone, and then the mobile phone can send the message content of the App1 to the smart television, and the television reminds the user of the received message content of the App 1.

Before the intelligent television prompts the message of the App1 to the user, the intelligent television can automatically start the camera to acquire the face information of the user. If the smart television judges that the user is himself/herself through the collected face information, a message reminding frame 901 can be displayed on the smart television, wherein the message reminding frame 901 comprises a message that the message is App1, a user who sends the message is Li Huaju, and the content of the message is "meeting exists at 9 am".

Referring to the GUI shown in (b) of fig. 9, if the face information collected by the camera of the smart tv includes a plurality of face information. Then the smart tv determines that someone other than the user is watching the smart tv at this time, then the smart tv may display a message alert box 902, where the message alert box 902 includes a message that the message is App1 and prompts the user "you have a message, P40 from Lily". If the user wants to view the message of App1, the user can view the message in the notification center of the intelligent television, or the user can also return to the mobile phone to view the message of App 1.

In the embodiment of the application, when the focus device prompts the notification message to the user, the focus device can acquire the face information, iris information and other user information of the user, so as to judge whether the user is the user. If the user himself, the focus device may prompt the user for the notification message; if the user is not himself, or there are other users in addition to the user himself, the focus device may only prompt for a notification message without displaying the content of the notification message. Thus, privacy disclosure of the user is avoided, and safety in the message forwarding process is improved.

In one embodiment, after receiving the App1 message sent by the mobile phone, the smart tv may first determine whether the message is a private message, and if the message is a private message, then determine whether the message is the user or a plurality of users; if the message is not a private message, the message content can be directly displayed to the user without judgment.

In one embodiment, the privacy message may be set by the user, or may be a default Instant Message (IM) type message.

Among the several sets of GUIs shown above through fig. 3 to 9, when the device a receives the notification message, the device a can determine the focus of the user's current attention. And if the current focus of the user is not in the device A, triggering the notification forwarding. When the focus device is judged to be in the device B, the mobile phone can forward the notification message to the device B, and then the device A does not notify at the moment, and the device B notifies. In another embodiment of the present application, when the user determines that the focus device is on device B, device a may also send a notification message to device B and other user devices, and then the focus device may notify and other devices may not notify.

FIG. 10 illustrates another set of GUIs provided by an embodiment of the present application.

The user is sitting on the sofa with the wearable device, at which time the phone is placed by the user on a table beside and the tablet is placed by the phone on another sofa beside.

The handset receives a mail (mail subject is "meeting notice") sent by the user Li Hua. At this time, the mobile phone judges that the current focus of the user is not on the mobile phone, and then the mobile phone can send the mail content to the tablet and the wearable device. Since the wearable device determines that the user is wearing the wearable device at this time, the wearable device may notify as the focus device. As shown in fig. 10, the wearable device may prompt the user for the mail content by vibration. For mobile phones and tablets, as the mobile phones and the tablet computers are not focal devices, the user can be prompted on the screen locking interface in a screen-brightening mode.

FIG. 11 illustrates another set of GUIs provided by an embodiment of the present application.

See the GUI shown in fig. 11 (a), which is the desktop of the handset. The GUI includes a plurality of application (App 1, app2, and App 3) icons including an icon 1101 of App3 therein. When the mobile phone detects an operation of clicking the setting icon 1101 on the desktop by the user, a setting mobile phone-related function may be started, displaying a GUI as shown in (b) of fig. 11.

See the GUI shown in fig. 11 (b), which is a setup interface of the cellular phone. The GUI comprises a plurality of function options including wireless and network, device connection, desktop and wallpaper, sound, notification center, application and notification, etc., wherein the user can perform settings of functions such as rights management, default application and notification management through the application and notification. When the mobile phone detects an operation with the user click application and notification function 1102, a GUI as shown in (c) in fig. 11 is displayed.

Referring to the GUI shown in (c) of fig. 11, the GUI provides an interface for applications and notification functions of the handset. The GUI includes a plurality of functional options for wireless and network applications including rights management, default applications, application-splitting and cross-device notifications, etc. When the handset detects that the user clicks the operation of the cross-device notification function 1103, a GUI as shown in (d) in fig. 11 is displayed.

Referring to the GUI shown in (d) of fig. 11, the GUI provides an interface for the cross-device notification function of the handset. The GUI includes a plurality of function options under cross-device notification including switch controls for cross-device notification, notification type, device management, and device authorization. Wherein the cross-device notification includes under the switch control a functional description of the cross-device notification "when notified, if you are using other devices, forward the notification to that device". When the handset detects an operation of the user click notification type 1104, the handset may display a GUI as shown in (e) of fig. 11.

Referring to a GUI shown in (e) of fig. 11, the GUI sets an interface for a notification type of a cellular phone. The user can select a notification type that he wishes to forward from among notification types shown in (e) in fig. 11. For example, the user may select messages of App5, app6 and App7 as notification types that it is desired to forward.

In the embodiment of the application, the user can select the notification type which the user wants to forward through setting the options, so that the harassment caused by unnecessary notification message forwarding to the user can be avoided.

The process of selecting a notification type by a handset is described above in connection with the GUI of fig. 11. The process of selecting a receiving device by a handset is described below in conjunction with fig. 12 and 13.

When the mobile phone detects that the user clicks on the device management 1201 as shown in (a) in fig. 12, the mobile phone may display a GUI as shown in (b) in fig. 12.

See the GUI shown in fig. 12 (b), which displays an interface for the device management function. Wherein my device and other devices are included in the device management. The device is used for logging in the same device as the mobile phone and is used as an ID. Exemplary my devices include a tablet "HUAWEI MatePad Pro", a smart WATCH "HUAWEI WATCH GT 2", another cell phone "HUAWEI P40 Pro", a notebook "HUAWEI MateBook X" and a smart speaker "HUAWEI Sound X". After the mobile phone selects all the devices, the mobile phone can forward the notification message to the devices.

The user may select a device under the same bloom as the ID as the forwarding object of the notification message, or may select a device under the different bloom as the ID as the forwarding object.

When the handset detects that the user clicks on the device authorization 1301 as shown in fig. 13 (a), the handset may display a GUI as shown in fig. 13 (b).

See the GUI shown in fig. 13 (b), which displays an interface for the device authorization function. The display interface includes additional device options and nearby device options. Wherein, the description of the adding device is that the device under the condition that you can add other Chinese IDs is added into other devices. For example, the user may add the home ID of the other family members in the family group, and the device under the home ID of the other family members may appear in the other devices as shown in (b) of fig. 12.

When the mobile phone detects an operation of opening a control of a nearby device by the user, the mobile phone may search for the nearby device and display a GUI as shown in (c) of fig. 13.

See the GUI shown in fig. 13 (c), which is another display interface for the device authorization function. The display interface displays that the nearby devices searched by the mobile phone comprise iphone 11 Pro, iPad Pro 11 and millet 10 Pro. When the handset detects that the user clicks the operation of adding iPad Pro 11 and millet 10 Pro, the handset can add both devices to the other devices in the device management.

See the GUI shown in fig. 13 (d), which is another display interface for device management. Two devices iPad Pro 11 and millet 10 Pro in the vicinity are added to the "other devices" on the display interface.

In the embodiment of the application, the mobile phone can search other surrounding devices through short-distance communication modes such as Bluetooth, wi-Fi and the like. For example, after detecting that the user clicks on the operation of adding iPad Pro 11 and millet 10 Pro, the handset may send bluetooth low energy (Bluetooth low energy, BLE) data packets to the two devices, where the BLE data packets may carry request information for requesting devices to be added to forward as notification messages. If the handset receives a response (e.g., ACK message) from both devices, the handset may successfully add both devices to the "other device". Further, on the iPad Pro 11 and the millet 10 Pro, the user may be prompted through a reminder box whether to agree with the mobile phone addition request. If iPad Pro 11 and millet 10 Pro detect a request from the user indicating consent to add a device to forward the notification message, both devices may send a response to the handset.

Fig. 14 shows a schematic block diagram of a transmitting end (source end) and a receiving end (sink end) provided by an embodiment of the present application. The source end includes a notification listening service 1410, a device management module 1420, a message encapsulation module 1430, a notification forwarding management module 1440, etc., and the sink end includes a message parsing module 1450, a system adaptation module 1460, etc., where,

The notification monitor service 1410 is configured to register a monitor notification service with a system of a source end, and acquire a system notification message in real time. When a third party App sends a notification message body, the notification message body includes a packet header, a notification ID attribute, a notification channel attribute, a message content, and the like. The packet header is used for determining to which App the notification message belongs, and the notification ID attribute and the notification channel attribute may be used for finding the corresponding notification message.

The device management module 1420 is configured to manage sink ends. The device management module 1420 is used for storing device names, device types, device status information, address information and the like of sink ends, where the device status information is used for indicating that a device is online or offline. For another example, the device management module 1420 is further configured to store hardware attribute information (such as whether there is a screen, whether there is a speaker, etc.) of the sink side.

The sink end in the embodiment of the application can be equipment with the same account number as the source end. When the source end sends the notification message body to the sink end, the notification message body can be sent to the sink end in a short-distance communication mode, or can be sent to the sink end through a server.

In the embodiment of the present application, the device management module 1420 may control the source end to periodically send a BLE data packet to the surrounding devices, where the purpose of the BLE data packet is to query whether the surrounding devices are online. If the source receives a response, the state information stored in the device management module 1420 may be online; otherwise, the state information stored in the device management module 1420 is offline. When the source end has notification messages to be forwarded, the device management can firstly judge whether the sink end is online or not, and for offline devices, the source end can choose not to forward the notification messages to the sink end.

The message encapsulation module 1430 may define a generic notification message body across devices or may define a notification message body that can be parsed by devices of different operating systems. The message encapsulation module may encapsulate the content of the notification message according to the format of the notification message body, to obtain an encapsulated notification message body.

Illustratively, the encapsulated notification message body may include a header of the message, identification information (e.g., a notification ID attribute and a notification channel attribute), a content of the notification, user information for sending the notification message, and device information of the source end device, etc. The packet head of the notification message is used for determining which App the notification message belongs to; the identification information is used for finding out the corresponding notification message; after detecting the reply of the user, the sink end can send the content, the packet header and the identification information of the reply of the user to the source end, so that the source end can determine that the notification content is the reply of a certain notification message aiming at a certain App.

For example, in fig. 3 (a), the notification message body sent by the mobile phone to the smart tv may include that the notification message belongs to App1, that the user who sends the message is Li Huayi, and that the content of the notification message is "meeting at 9 am".

For another example, as shown in fig. 7, the notification message body sent to the wearable device by the notebook computer may include a notification belonging to a schedule, a notification content including time (9:00-10:00 am), and an event (discussion).

In one embodiment, the message encapsulation module 1430 may further carry indication information in the body of the notification message, where the indication information is used to instruct the sink end to add a reply control to the notification message. For example, the indication information may be a flag attribute of "quick reply". When determining that the notification message body carries the flag attribute of 'quick reply', the sink terminal can add a reply control in the message reminding frame. Thus, if the sink terminal device is a device which is not provided with the application program corresponding to the notification message, the sink terminal device can also prompt the user for the notification message, and the user can complete the reply to the notification message through the reply control; therefore, sink terminal equipment can send the reply content to the source terminal, and the source terminal completes the real reply of the notification message. It should be understood that the process of actually replying to the notification message by the source end may refer to the following description in the embodiments, and will not be described herein for brevity.

The notification forwarding management module 1440 may be configured to determine whether the user is focused on the current source side. If the user's focus is not on the current device, the notification forwarding management module 1440 is also configured to determine the user's focus device.

For example, after receiving the notification message from the server, the source terminal may automatically turn on the camera, and if no face information of the user is collected by the camera, the source terminal may determine that the device currently focused by the user is not the source terminal.

Illustratively, the source may detect the user's pupil by a pupil detection sensor (e.g., an image sensor). If the pupil detection sensor can detect the pupil of the user, the source end determines that the user is controlling the device; otherwise, the source end determines that the user is not currently focused on the source end.

In one embodiment, if the notification forwarding management module determines that the current focus of the user is not on the source end, the source end device may further send request information to one or more sink ends stored in the device management module, where the request information is used to request the sink end to determine whether the focus of the user is on the device.

In one embodiment, the notification forwarding management module 1440 may save the priority of the focus device judgment. Illustratively, the prioritization may be:

(1) A visual focus;

(2) An on-body device;

(3) An interactive focus.

It should be understood that the visual focus device may be a device provided with a camera, e.g. a smart tv, a tablet computer, a notebook computer, etc.; the on-body device may be a wearable device of the user, e.g., VR/AR glasses, smart watches, smart bracelets, etc.; the interactive device may be a device with input manipulation, e.g., a device with a keyboard, mouse, touch, remote control, voice input, etc.

If the source maintains a list of devices for notification message forwarding, the source device may send request information to the devices in the list of devices. The source terminal may transmit the request information to the devices in the device list according to the priority of the devices.

For example, the smart television and the smart watch are included in the devices in the device list of the mobile phone, and then the mobile phone may first send request information to the smart television, where the request information is used to request the smart television to determine whether the current focus of the user is on the smart television. After receiving the request information, the intelligent television can judge whether the focus of the user is on the intelligent television or not by starting the camera. If the smart television determines that the current focus of the user is on the smart television through the face information acquired by the camera, the smart television can send a response to the mobile phone, wherein the response is used for indicating that the current focus of the user is on the smart television. After receiving the response, the mobile phone can no longer send request information to other devices in the device list. If the mobile phone does not receive the response of the smart television within the preset duration (or the mobile phone receives the response sent by the smart television, the response indicates that the current focus of the user is not on the smart television), the mobile phone can continue to send the request information to the smart watch. After receiving the request information sent by the mobile phone, the smart watch can detect whether the user is wearing the wearable device or not based on the sensor. For example, a photo volume scanning (photo plethysmo graph, PPG) sensor in a smart watch may determine whether a user is wearing the smart watch by detecting the heart rate of the user. If the smart watch determines that the user is wearing the smart watch, the smart watch may send a response to the cell phone indicating that the user is currently wearing the smart watch.

When the source end sends request information to the devices in the device list, the source end may send request information to a plurality of devices in the device list at the same time.

For example, if the smart television and the smart watch are included in the devices in the device list of the mobile phone, the mobile phone may send request information to the smart television and the smart watch simultaneously. If the mobile phone only directly receives the response of the intelligent television, the mobile phone can forward the notification message to the intelligent television; or if the mobile phone only receives the response of the smart watch, the mobile phone can forward the notification message to the smart watch; or if the mobile phone receives the responses of the smart television and the smart watch, the mobile phone can forward the notification message to the smart television according to the priority of the device.

If the source end does not store the device list for forwarding the notification message, the source end can send request information to devices around the source end in a broadcast mode. If the mobile phone only receives the response of a certain surrounding device, the mobile phone can forward the notification message to the device; alternatively, if the handset receives responses from a plurality of surrounding devices, the handset may forward the notification message to the higher priority device according to the priority of the device.

It should be understood that, in the embodiment of the present application, if the first electronic device stores the device list forwarded by the notification message, the first electronic device sends indication information to the second electronic device, where the indication information may be used to instruct the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; alternatively, the indication information may be used to instruct the second electronic device to determine whether or not a user (which may be the owner of the first electronic device or may be another user) is focusing on the second electronic device.

When the source end determines that the current focus of the user is not on the source end, the notification forwarding management module of the source end can send the encapsulated notification message body to the focus device.

Illustratively, as shown in fig. 14, the source end may send a notification message body to the sink end device through a network channel (e.g., bluetooth/Wi-Fi, etc.). For example, the source end may send the notification message body to the sink end carried in the BLE packet. The BLE packet includes a protocol data unit (protocol data unit, PDU), and the notification message body may be carried in a service data (service data) field in the PDU, or may be carried in vendor specific data (manufacturer specific data) field in the PDU. For example, a plurality of bits may be included in a payload (payload) of the service data field, wherein the plurality of bits includes scalable bits. sink and source may agree on the content of a certain extensible bit. The source end can encode the notification message body by adopting the encoding modes of GBK, ISO8859-1 and the like, and carry the encoded information on one or more expandable bits.

The sink-side message parsing module 1450 is configured to parse the notification message body sent by the source side, so as to obtain the content of the notification message body. For example, if the source end sends the notification message body carried in the BLE data packet to the sink end, the sink end may decode the BLE data packet in a corresponding decoding manner after receiving the BLE data packet, so as to obtain the notification message body.

The system adaptation module 1460 can optimize the notification interaction and presentation mode forwarded to the sink terminal according to the local notification style rule of the sink terminal or according to a preset device and notification optimization mode corresponding table.

In one embodiment, if the notification message is a message of the first application, the sink device may be a device that does not install the first application. The source terminal carries indication information (for example, a "quick reply" flag attribute, which is used for indicating that the source terminal adds a reply control in a message reminding frame) in a notification message body sent by the sink terminal. After the message analysis module at the sink terminal recognizes the quick reply flag attribute, the system adaptation module adapts system interfaces corresponding to the systems aiming at the sink terminals of different operating systems, and supports a quick reply input frame, UI presentation, user interaction response and the like.

For example, if the sink terminal is a device of the Android system, the sink terminal may provide a notification manager, so as to implement drawing of a message reminding frame, where the message reminding frame includes notification content in a notification message body, a reply control drawn by the notification manager, and the like. For example, as shown in (a) of fig. 4, after receiving the message body sent by the mobile phone, the smart tv may display the content of the message and the reply control in the message alert box.

When the sink end detects that the user inputs the reply content, the sink end can display a text input box and a sending control. After the sink end detects that the user inputs the reply content in the text input box and clicks the sending control, the content input by the user can be obtained through a callback interface getrequest from Intnt (). getresultsfromIntent () can establish an association of a send control and a text entry box. When the sink terminal detects that the user clicks the sending control, the sink terminal is triggered to acquire the content in the text input box. In the embodiment of the application, the callback interface can be registered on different systems, so that when the sink end detects the reply content of the user, the reply content of the user can be obtained through the callback interface. After detecting that the user inputs the reply content in the text input box and detecting that the user clicks the sending control, the sink terminal can trigger to send the reply content of the user to the source terminal. Illustratively, table 1 shows a correspondence table of devices and notification optimizations.

TABLE 1

Illustratively, as shown in (a) and (b) in fig. 3, when notified, the smart tv displays only notification content without displaying an action control, and the subsequent user can view and reply to the notification message in the notification center. This is consistent with the user experience and does not interfere with the user.

As shown in (a) and (b) of fig. 4, when notified, the smart tv may first determine whether there is an interaction with the user. If there is no interaction with the user (e.g., the smart television is playing a video), then the smart television may automatically focus the cursor on the reply control of the message alert box and display the action control in the message alert box; if the intelligent television has interaction with the user (the user is using the remote controller to change channels), the intelligent television displays an action control in the message reminding frame and focuses the cursor to the reply control instead of prompting the user to click a menu key and then focuses the cursor to the reply control. Thus, convenience of interaction is improved.

For example, as shown in fig. 5, when the mobile phone sends the notification message to the car machine, the car machine may prompt the user for the content of the notification message by means of voice broadcasting.

For example, as shown in fig. 7, when the smart watch receives a notification message sent by the notebook computer, the smart watch may remind the user through voice, vibration, display of a display screen, and the like.

When detecting that a user replies a certain notification message, the sink end can package the action response event and the content replied by the user together into a notification message body. The notification message body can adopt the same encapsulation format as the notification message sent by the source terminal to the sink terminal, so that the source terminal can analyze the notification message conveniently.

For example, the sink end may send the notification message body to the source end with the notification message body carried in the BLE packet. The BLE data packet includes a PDU, and the notification message body may be carried in a service data field in the PDU, or may be carried in a vendor specific data field in the PDU. For example, the payload of the service data field may include a plurality of bits, wherein the plurality of bits includes scalable bits. sink and source may agree on the content of a certain extensible bit. The sink end can encode the notification message body by adopting encoding modes such as GBK, ISO8859-1 and the like, and carry the encoded information on one or more expandable bits.

In one embodiment, if the source end sends a notification message body to the sink end, where the notification message body carries a notification ID attribute and a notification channel attribute, the sink end may carry the notification ID attribute, the notification channel attribute, the action response event, and the content of the user reply in the notification message. If the notification message body sent by the source end to the sink end does not carry the notification ID attribute and the notification channel attribute, the notification message body sent by the sink end to the source end may not carry the notification ID attribute and the notification channel attribute.

In the embodiment of the application, when the sink end detects the click (click) event or the delete (delete) event of the notification message, the corresponding event can be sent to the source end in real time. The source end can respond in real time, so that closed loop processing of the message is completed, and consistency of experience of the user on different devices is achieved.

For example, as shown in (c) of fig. 3, after the user completes the reply to the App1 message on the smart tv, the smart tv may send an action response event and a reply content to the mobile phone, where the action response event is used to indicate that the smart tv has completed the reply to the message. After receiving the action response event and the reply content, the mobile phone can automatically pull up the chat interface, and realize the true reply of the message in a dragging mode.

Analyzing the notification message body sent by the sink terminal at the source terminal, obtaining a packet header, a notification ID attribute, a notification channel attribute, an action response event and user reply content, and completing the real reply of the notification message through the following processes. The source end can determine that the sink end replies the notification message through an action response event; determining which notification message in the App is replied by the packet header; the notification ID attribute and the notification channel attribute determine which notification message to reply to. And then complete the true reply of the notification message through the following procedure.

(1) Pulling up social App display interface

If the source is in the lock state, the process may be performed in several ways.

Mode one

The source end may first determine which App the reply content is for based on the header. If the App provides an application program interface (application programming interface, API) to reply the message, the App can directly complete the real reply to the notification message through the API provided by the App after obtaining the content replied by the user. For short message applications, it is exemplary that an API "sendTextMessage" is provided that can be used to notify the actual reply of a message. After the source terminal obtains the reply content, the source terminal can determine that the reply content is the reply content for the short message application through the packet header of the reply content. Because the short message provides the API to reply the notification message, the source end can determine which notification message is replied through the notification ID attribute and the notification channel attribute, and the source end can directly complete the real reply of the notification message through 'sendTextMessage'.

It should be appreciated that for the reply mode of mode one, the process of message reply is implemented internally at the source end, which is not felt by the user. If the App does not provide the API to reply to the message, the App may complete the reply by a drag event in either mode two or mode three.

Mode two

If the App supports the flat attribute loaded by the lock screen, the source end can directly load the corresponding display interface on the lock screen interface. Such as a voice call request, a video call request, etc., of a WeChat, are displayed directly on the lock screen interface. Further to step (2), the reply of the message is completed by the drag event.

Mode three

The reply mode of mode three may also be referred to as a cross-device unlocking scheme. In the third mode, the sink end can complete collection of user identity authentication information, for example, the sink end can acquire password information, such as digital passwords, fingerprint passwords, iris information, facial features and other identity authentication information, of a user for unlocking the source end. Then, the sink end can send the password information to the source end, so that the source end judges whether to unlock the equipment. If the source end determines to unlock according to the password information, then the step (2) is carried out, and the reply of the message is completed through the dragging event.

(2) Completion of reply by drag event

The source end responds to the action response event, and can determine that sink end equipment detects the operation of a user for replying to the notification message. The source end can determine a corresponding App according to the packet header of the notification message body, start the App to the foreground, and find a corresponding notification message through the notification ID attribute and the notification channel attribute. The source-side view system may send a dragand Drop event and reply content to the corresponding App. And the App responds to the dragand Drop event and pulls up the chat interface of a specific contact person through the PendingIntent in the notification message, so as to reply to the notification message. The actual reply to the notification message is completed at this point. The view system may send the Drag and Drop event and the reply content to the corresponding App, and may also send the content attribute of the reply content to the corresponding App, which may be used to indicate the type of reply content (e.g., text, picture, voice, video, file, etc.). The App can inform the three-dimensional graphics processing library (OpenGL ES) to draw different display interfaces according to the type of reply content. For example, for text content, the text content may be displayed directly in the location of the reply after the chat interface for a particular contact is pulled up. For another example, for voice information, after a chat interface of a specific contact is pulled up, a duration of voice and a control for answering voice may be displayed (when the source end detects that the user clicks on the control, the content of the voice may be played). For another example, for video information, after pulling up a chat interface of a contact, a first frame image in the video may be displayed and a play control may be displayed (when the source end clicks on the play control, the content of the video may be played).

(3) Restoring source end site

After the source end completes the reply, the interface of the App is hidden, and the display interface before the App is started is returned. If in step (1) the source end device was originally screen locked, the device is screen locked again. The original state of the device is restored, so that the user does not feel the quick reply function, and the user experience can be further improved.

For another example, when the smart television detects that the user ignores the App1 message, the smart television may send a notification message body to the mobile phone, where the notification message body may carry an action response event, where the action response event is used to instruct the smart television to detect that the user ignores the message reminding frame. After the mobile phone receives the action event, a message reminding frame on a screen locking interface of the mobile phone can be automatically hidden. After receiving the notification message body, the mobile phone can determine App1 according to the packet header of the notification message body. In response to the action response event, the view system of the application framework layer may send a hidden event to App1 of the application layer. App1 may notify the three-dimensional graphics processing library (OpenGL ES) to hide the notification message alert box on the lock screen interface.

Fig. 15 shows a schematic flow chart of a method 1500 for prompting a message provided by an embodiment of the application. As shown in fig. 15, the method may be performed by a first electronic device and a second electronic device, where the first electronic device may be a source terminal as shown in fig. 14, and the second electronic device may be a sink terminal as shown in fig. 14, and the method 1500 includes:

s1501, the first electronic device receives a message.

Illustratively, as shown in (a) of fig. 3, the user's handset receives the App1 message sent by the user Li Hua.

It should be appreciated that the messages in embodiments of the present application may be messages sent by servers of different applications, the types of messages including, but not limited to, text, voice, audio, video, links, sharing (e.g., location sharing), invitations (e.g., invitations to groups), and the like.

S1502, when the first electronic device determines that the device focused by the owner of the first electronic device is the second electronic device, the first electronic device sends the message to the second electronic device.

If the first electronic device stores the device list forwarded by the message, the second electronic device may be a device in the device list, where the first electronic device may send, through short-distance wireless communication or through a server, request information to the second electronic device, where the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; if the first electronic device does not store the device list forwarded by the message, the second electronic device may be a device around the first electronic device, and the first electronic device may send the request information to the surrounding devices in a broadcast manner.

Optionally, if the first electronic device determines that the device focused by the user is not the first electronic device, the first electronic device does not notify.

Illustratively, as shown in (a) of fig. 3, when the mobile phone receives the message of App1, if the mobile phone determines that the device focused by the user is not the mobile phone, the mobile phone may notify the user of the message of App1 without lighting the screen.

In the embodiment of the present application, the method for determining that the device focused by the first electronic device is not an electronic device is not specifically limited.

In one embodiment, if the second electronic device is an electronic device in the device list of the first electronic device and the second electronic device stores the user characteristics of the owner of the first electronic device (for example, the second electronic device and the first electronic device are two devices under the same user (the same ID is logged in), the first electronic device and the second electronic device may store the same user characteristics (for example, fingerprint information, face information, voiceprint information, iris information, etc.), and the first electronic device may send the request information to the second electronic device through the server or through a short-distance communication manner. After receiving the request information sent by the first electronic device, the second electronic device can acquire the characteristics of the user and judge whether the characteristics of the user are matched with the user characteristics of a preset owner of the first electronic device. And if so, sending response information to the first electronic device, wherein the response information is used for indicating that the owner of the first electronic device is focusing on the second electronic device. The first electronic device may send the message to the second electronic device after receiving the response information.

For example, if the first electronic device includes a camera, the first electronic device may turn on the camera to collect face information of the user when the first electronic device receives the message, and if face information of the user is not collected by the camera, the first electronic device may determine that the device in which the user is currently focused is not the first electronic device, so that the request information may be transmitted to the second electronic device. After the second electronic device receives the request information, the camera can be started to collect face information of the user, and if the collected face information is matched with face information of a machine owner of the first electronic device preset in the second electronic device, the second electronic device can send response information to the first electronic device.

For another example, the second electronic device may collect the voice information of the user by turning on the microphone after receiving the request information. The second electronic device may extract voiceprint information in the voice information, and if the voiceprint information is matched with voiceprint information of a owner of the first electronic device preset in the second electronic device, the second electronic device may send response information to the first electronic device.

In the embodiment of the application, the first electronic device can send the request information to the second electronic device through the server, or can send the request information to the second electronic device through a short-distance communication mode. For example, the request information may be a field in a BLE data packet that requests the second electronic device to determine whether the user is focused on the second electronic device.

Illustratively, the BLE packet includes a protocol data unit (protocol data unit, PDU), and the request information may be carried in a service data (service data) field in the PDU, or may be carried in vendor specific data (manufacturer specific data) field in the PDU. For example, a plurality of bits may be included in a payload (payload) of the service data field, wherein the plurality of bits includes scalable bits. The first electronic device and the second electronic device may agree on a bit in advance to transmit the request information. When this expandable bit is a preset value (e.g., 1), the second electronic device can learn that the first electronic device requests it to determine whether the owner of the first electronic device is focused on the device.

And when the second electronic equipment determines that the user focuses on the second electronic equipment, sending response information to the first electronic equipment, wherein the response information is used for indicating that the equipment focused by the user is the second electronic equipment.

For example, the second electronic device may send the service data field or vendor specific data field of the PDU in the BLE data packet to the first electronic device upon determining that the user focus is on the second electronic device. The response information may be carried, for example, on bits that are scalable in the payload of the service data field. The first electronic device and the second electronic device can agree on a certain extensible bit in advance to transmit response information. When this scalable bit is a preset value (e.g., 1), the device indicating that the second electronic device determines that the owner of the first electronic device is focused on is the second electronic device.

It should be understood that, in the embodiment of the present application, the second electronic device may determine whether the user is focused on the second electronic device by other existing manners of determining the focus device, which is not limited in the embodiment of the present application.

Optionally, the first electronic device and the second electronic device are devices under the same account, and then the first electronic device may also send the request information to the second electronic device through the server. Likewise, if the second electronic device determines that the user is focusing on the second electronic device, the second electronic device may also send response information to the first electronic device through the server.

For example, the user is wearing a smart watch out and the phone is charged at home, and when the phone receives a message, the phone may send request information to the smart watch through the server. The smart watch may send response information to the handset via the server.

In one embodiment, if the second electronic device is an electronic device in the device list of the first electronic device and the user feature of the owner of the first electronic device is not stored in the second electronic device, or the device list is not stored in the first electronic device, the second electronic device is a device around the first electronic device. The first electronic device may send the request information to the second electronic device upon determining that the owner of the first electronic device is not focused on the first electronic device; after receiving the request information, the second electronic device can acquire user characteristics through the user characteristic acquisition device and send the acquired user characteristics to the first electronic device. The first electronic device may send the message to the second electronic device when it is determined that the user characteristics collected by the second electronic device match the user characteristics preset in the first electronic device.

It should be understood that, in the case that the second electronic device is an electronic device in the device list of the first electronic device and the second electronic device stores the user feature of the owner of the first electronic device, the second electronic device may collect the user feature after receiving the request information and send the user feature to the first electronic device, so that the first electronic device determines whether the owner of the first electronic device focuses on the second electronic device according to the user feature collected by the second electronic device and the preset user feature.

For example, the user characteristics sent by the second electronic device to the first electronic device may be carried in a service data field or vendor specific field in the PDU.

For example, the second electronic device includes a camera. After receiving the request information, the second electronic device can acquire the face information through the camera and send the face information to the first electronic device. And the first electronic equipment judges whether the user is according to the face information. For example, the first electronic device may match the face information collected by the second electronic device with the face information preset in the first electronic device, and if the matching is successful, it is determined that the owner of the first electronic device focuses on the second electronic device currently. The face information collected by the second electronic device may also be face information of a plurality of persons, and then the second electronic device may send the face information of the plurality of persons to the first electronic device. The first electronic device may match face information of each of the plurality of people with face information preset in the first electronic device, and if the matching is successful, it is determined that the user is currently focused on the second electronic device. The first electronic device may send a message to the second electronic device, which may prompt the user for a message (or prompt the user for a message from the XX device) and not prompt the user for the content of the message.

For another example, the second electronic device includes a microphone, and after receiving the request information, the second electronic device may collect, through the microphone, voice information sent by the user and send the voice information to the first electronic device. And the first electronic equipment judges whether the user is the user according to the voice information. For example, the first electronic device may extract voiceprint information in the voice information collected by the second electronic device, and the first electronic device matches the extracted voiceprint information with voiceprint information preset in the first electronic device, and if the matching is successful, it is determined that the user is currently focused on the second electronic device.

In the embodiment of the application, when the first electronic device requests the second electronic device whether the owner of the first electronic device focuses on the second electronic device, the second electronic device can send the collected user characteristics to the first electronic device, so that the first electronic device can judge whether the second electronic device focuses on the owner of the first electronic device according to the received user characteristics and preset user characteristics. Therefore, the security in message forwarding is improved, privacy disclosure of a user is avoided, and user experience is improved.

Optionally, if the first electronic device does not receive the response information sent by any device within the preset time, the first electronic device may determine that the user does not focus on devices around the first electronic device. The first electronic device may alert the user to the message by means of a bright screen or a vibration.

Optionally, the first electronic device may send the content of the message to the second electronic device carried in a BLE data packet; alternatively, the first electronic device may send the message to the second electronic device via the server.

Illustratively, the BLE packet includes a PDU, and the message may be carried in a service data (service data) field in the PDU, or may be carried in vendor specific data (manufacturer specific data) field in the PDU. For example, a plurality of bits may be included in a payload (payload) of the service data field, wherein the plurality of bits includes scalable bits. The first electronic device and the second electronic device may agree on one or more expandable bits in advance for transmission of the message. The first electronic device may encode the content of the message in a GBK, ISO8859-1, or other encoding manner, and carry the encoded information on one or more expandable bits. After receiving the BLE data packet sent by the first electronic device, the second electronic device may decode the information on the corresponding bit, so as to obtain the content of the message.

And S1503, the second electronic device prompts the message to the user according to the device information of the second electronic device.

In the embodiment of the present application, the device information of the second electronic device may include, but is not limited to: hardware capability information of the second electronic device (e.g., the second electronic device is a large screen device or the second electronic device is a car set), a current state of the device (e.g., whether the device is currently interacting with a user or whether the device is in an immersed state), and so forth.

Optionally, the device information of the second electronic device includes that the second electronic device is provided with a display screen, the second electronic device displays a message reminding frame through the display screen, the message reminding frame includes the message, and the message reminding frame does not include a control.

For example, as shown in (a) and (b) in fig. 3, after receiving a message sent by a mobile phone, the smart television may prompt the message through a message prompt box, where the message prompt box does not include a control. After seeing the message, the user can view the message in the notification center of the smart television.

Optionally, the device information of the second electronic device includes that the second electronic device is provided with a display screen, and when the second electronic device detects that the input of the user is being received, a message reminding frame is displayed through the display screen and a cursor is not positioned in the message reminding frame, and the message reminding frame includes the message.

Illustratively, as shown in (b) of fig. 4, when the smart tv receives a message sent by the mobile phone, the smart tv has an interaction with the user, or the smart tv detects that the user is manipulating the smart tv. The smart tv may display a message alert box and the smart tv does not position the cursor at the message alert box.

In the embodiment of the application, if the second electronic device is receiving the input of the user when receiving the message, in order to avoid the trouble to the user, the second electronic device may display the message reminding frame, but does not position the cursor at the message reminding frame. Thereby avoiding the influence on the current interaction caused by the false clicking of the user.

Optionally, when the second electronic device detects that the input of the user is being received, a prompt message is displayed through the display screen, where the prompt message is used to remind the user to position the cursor to the message reminding frame through the first operation.

Illustratively, as shown in (b) of fig. 4, the hint information is "click menu key processing". When the intelligent television detects that the user clicks the menu key, the cursor can be automatically positioned on the message reminding frame. For example, the smart television may position the cursor in a reply control in the message alert box.

In the embodiment of the application, the user can position the cursor on the message reminding frame through the first operation by displaying the prompt information, so that the message is processed. Therefore, the trouble to the current interaction behavior of the user is avoided, and the cursor on the intelligent television can be positioned in the message reminding frame quickly and conveniently, so that the user can process the message conveniently.

Optionally, the device information of the second electronic device includes that the second electronic device is provided with a display screen, and when the second electronic device detects that the input of the user is not received, the message reminding frame is displayed through the display screen and the cursor is positioned at the message reminding frame.

For example, as shown in (a) of fig. 4, when the smart tv receives a message sent by the mobile phone, there is no interaction between the smart tv and the user, or the smart tv detects that the user does not operate the smart tv. The smart tv may display a message alert box and the smart tv positions the cursor at the message alert box. For example, the smart tv positions the cursor at the reply control in the message alert box.

In the embodiment of the application, if the intelligent television does not receive the input of the user when receiving the message, the intelligent television can display the message reminding frame and position the cursor on the message reminding frame, so that the user can conveniently process the message.

Optionally, the device information of the second electronic device includes a device with a voice function of the smart television, and the second electronic device may remind the user of receiving the message through voice; alternatively, the second electronic device may alert the user to the content of the message via voice.

For example, as shown in fig. 5, the vehicle machine includes a voice function, and after receiving a message sent by the mobile phone, the vehicle machine can prompt a user after converting the content of the message into voice; alternatively, the vehicle may also prompt the user to receive a message via voice.

In one embodiment, if the second electronic device has both the display screen and the voice reminding function, the second electronic device may continuously determine whether the second electronic device belongs to a large-screen device (for example, an intelligent television), and if so, the second electronic device may prompt the user through the display screen; alternatively, if the second electronic device is a tablet, PC, or the like, the user may be prompted through the display screen. If the second electronic device is an intelligent voice device such as an intelligent sound box and the like with a smaller display screen, the second electronic device can prompt the user through voice.

Optionally, before the second electronic device prompts the message to the user, the method further comprises: the first electronic device sends indication information to the second electronic device, wherein the indication information is used for indicating the second electronic device to increase a reply control for the message; the second electronic device prompts the message to the user according to the device information, and the method comprises the following steps: the second electronic equipment displays a message reminding frame according to the equipment information and the indication information, wherein the message reminding frame comprises the message and the reply control; after the second electronic device prompts the message to the user, the method further comprises: when the second electronic equipment detects the operation of replying to the message by the user, the second electronic equipment sends reply content to the first electronic equipment; and the first electronic equipment replies the message according to the reply content.

For example, as shown in (a) of fig. 4, the smart tv may receive a message and indication information sent by the mobile phone. If the intelligent television does not receive the input of the user currently, the intelligent television can display a message reminding frame, wherein the message reminding frame comprises the content of the message and a reply control, and the intelligent television positions a cursor on the reply control. When the intelligent television detects that the user clicks the reply control, the input method can be pulled up to facilitate the user to reply to the message. The smart television can send the replied content to the mobile phone, so that the mobile phone can complete the real reply of the message by calling the API or dragging the event.

For example, as shown in (b) in fig. 4, the smart tv may receive a message and indication information sent by the mobile phone. If the smart tv is currently receiving user input (e.g., the smart tv is receiving a channel change operation from the user), the smart tv may display a message alert box, where the message alert box includes the content of the message and a reply control, and the smart tv does not position the cursor at the reply control. The smart television can also display prompt information to prompt the user to reply to the message by clicking the menu key. When the intelligent television detects the operation of clicking the menu key by the user, the intelligent television can position the cursor on the reply control. When the intelligent television detects that the user clicks the reply control, the input method can be pulled up to facilitate the user to reply to the message. The smart television can send the replied content to the mobile phone, so that the mobile phone can complete the real reply of the message by calling the API or dragging the event.

Alternatively, the message is a message of the first application program, and the second electronic device may be a device that does not install the first application program. Therefore, the user can conveniently reply the message on the focused device, the process that the user replies the message on the first electronic device is avoided, and the user experience is improved.

Optionally, the device information of the second electronic device includes that the second electronic device is provided with a camera. And prompting the content of the message to the user when the second electronic device detects that only the owner of the first electronic device focuses on the second electronic device through the camera.

For example, as shown in (a) of fig. 9, when the smart tv detects that only one person of the owner of the mobile phone focuses on the smart tv through the camera, the smart tv may display a message alert box 901 through the display screen, wherein the message alert box 901 includes the content of the message (for example, "there is a meeting at 9 am").

Or when the second electronic device detects that a plurality of users including a owner of the first electronic device focus on the second electronic device through the camera, the user is prompted to receive the message.

For example, as shown in (b) of fig. 9, when the smart tv detects that there are multiple users including a owner of the mobile phone focusing on the smart tv through the camera, the smart tv may display a message alert box 902 through the display screen, where the message alert box 902 alerts the user that "you have a message, P40 from lie".

Optionally, the second electronic device determines that the second electronic device is in a non-immersed state before prompting the message to the user. Illustratively, the immersion state may include a state in which the user is watching the video, as shown in (b) of fig. 8, and if the user is watching the video at this time, the tablet may not prompt the user for the message. If the tablet is now displaying a desktop, as shown in fig. 8 (a), the tablet may prompt the user for the message.

It should be appreciated that in the embodiment of the present application, if the second electronic device is in an immersed state, the second electronic device may not prompt the message. The immersion state may also be understood as a notification disabled state, e.g., the immersion state may be that the user has disabled the notification or has the do-not-disturb mode turned on. For example, users are conducting teleconferencing, especially when sharing desktops, if notification is provided, the notification may not only be affected by interference, but also be seen by other participants, which may affect the user experience and may reveal the privacy of the user. Alternatively, the immersion state may be a state in which the second electronic device is running a preset application. For example, the immersion state may be that the second electronic device is currently running a video App or a game App.

Optionally, the method 1500 further includes: before sending the notification message to the second electronic device, the first electronic device determines that the type of the message is a user-set message type.

For example, as shown in (e) of fig. 11, the user may set in advance the type of message that can be notification-forwarded, such as for messages of App5, app6, and App 7. When the first electronic equipment receives the message, judging whether the type of the message is the message type set by the user. If so, the first electronic device may perform S1502.

Optionally, the method 1500 further includes: before sending the notification message to the second electronic device, the first electronic device determines that the message is an instant messaging (instant messaging, IM) type message.

Optionally, the method 1500 further includes: before sending the message to the second electronic device, the first electronic device determines a device for forwarding a received message set by the second electronic device for the user.

Illustratively, as shown in (b) of fig. 12, the user may set a device capable of receiving message forwarding in the handset in advance. When the first electronic device receives the message and determines that the device currently focused by the user is not the first electronic device, the device currently focused by the user can be determined from the devices for receiving message forwarding. And sends a message to the device.

Before sending the message to the second electronic device, the first electronic device determines that an account number registered on the first electronic device is associated with an account number registered on the second electronic device.

Optionally, the account number logged on the electronic device and the account number logged on the wearable device may be the same account number; or the account number logged in on the electronic equipment and the account number logged in on the wearable equipment are account numbers in the same family group; alternatively, the account number logged on the wearable device may be an account number authorized by the account number logged on the electronic device.

In the embodiment of the application, when the first electronic device determines that the device focused by the user is not the first electronic device but the second electronic device, the first electronic device can forward the message to the second electronic device, and the second electronic device can prompt the message to the user according to the device information of the second electronic device, so that the user is helped to timely receive the prompt of the message, and the user is prevented from missing important messages; meanwhile, the second electronic device presents reminding in different modes to the user according to the device information of the second electronic device, and is beneficial to improving the experience of the user when receiving the message.

Fig. 16 shows a schematic block diagram of an apparatus 1600 for prompting messages provided by an embodiment of the application. The apparatus 1600 may be disposed in the second electronic device, where the apparatus 1600 includes: a receiving unit 1610, configured to receive a message sent by the other electronic device, where the message is a message obtained by the other electronic device from a server; a prompting unit 1620, configured to prompt the user for the message according to the device information of the apparatus.

Fig. 17 shows a schematic structural diagram of an electronic device 1700 provided by an embodiment of the present application. As shown in fig. 17, the electronic device includes: one or more processors 1710, one or more memories 1720, the one or more memories 1720 storing one or more computer programs including instructions. The instructions, when executed by the one or more processors 1710, cause the first electronic device to perform the technical solution in the above embodiment; alternatively, the instructions, when executed by the one or more processors 1710, cause the second electronic device to perform the technical solutions in the above embodiments.

The embodiment of the application provides a system for prompting messages, which comprises a first electronic device and a second electronic device, and is used for executing the technical scheme for prompting messages in the embodiment. The implementation principle and technical effects are similar to those of the related embodiments of the method, and are not repeated here.

An embodiment of the present application provides a computer program product, which when executed on a first electronic device, causes the first electronic device to execute the technical solution in the foregoing embodiment; alternatively, the computer program product, when run on a second electronic device, causes the second electronic device to perform the technical solutions of the above embodiments. The implementation principle and technical effects are similar to those of the related embodiments of the method, and are not repeated here.

An embodiment of the present application provides a readable storage medium, where the readable storage medium includes instructions, when the instructions are executed by a first electronic device, cause the first electronic device to execute the technical solution of the foregoing embodiment; or when the instruction runs on the second electronic device, the second electronic device is caused to execute the technical scheme of the embodiment. The implementation principle and technical effect are similar, and are not repeated here.

The embodiment of the application provides a chip for executing instructions, and when the chip runs, the technical scheme in the embodiment is executed. The implementation principle and technical effect are similar, and are not repeated here.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A system for prompting a message, the system comprising a first electronic device and a second electronic device, characterized in that,

the first electronic device is used for receiving a message;

the first electronic device is further configured to send the message to the second electronic device when it is determined that the device focused by the owner of the first electronic device is the second electronic device, where the message is a message of a first application program, and the second electronic device is a device on which the first application program is not installed;

the second electronic device is used for prompting the message to a user according to the device information of the second electronic device; the device information of the second electronic device includes hardware capability information of the second electronic device;

the first electronic device is further configured to send indication information to the second electronic device, where the indication information is used to instruct the second electronic device to add a reply control to the message;

The second electronic device is specifically configured to: displaying a message reminding frame according to the equipment information and the indication information, wherein the message reminding frame comprises the message and the reply control;

the second electronic device is further configured to send reply content to the first electronic device when detecting an operation for replying to the message;

the first electronic device is further configured to reply to the message according to the reply content.

2. The system of claim 1, wherein the hardware capability information includes that the second electronic device is provided with a display screen, and the second electronic device is specifically configured to: and displaying a message reminding frame through the display screen, wherein the message reminding frame comprises the message and the message reminding frame does not comprise a control.

3. The system of claim 1, wherein the hardware capability information includes that the second electronic device is provided with a display screen, and the second electronic device is specifically configured to:

when the second electronic equipment detects that the input of the user is being received, a message reminding frame is displayed through the display screen, and a cursor is not positioned on the message reminding frame, wherein the message reminding frame comprises the message; or,

And when the second electronic equipment detects that the input of the user is not received, displaying the reminding frame through the display screen and positioning the cursor at the message reminding frame.

4. The system of claim 3, wherein the second electronic device is further configured to:

and when the second electronic equipment detects that the input of the user is being received, prompt information is displayed through the display screen, wherein the prompt information is used for prompting the user to position the cursor to the message reminding frame through a first operation.

5. The system of claim 1, wherein the hardware capability information includes a voice function of the second electronic device, the second electronic device being specifically configured to:

reminding a user of receiving the message through voice; or,

reminding the user of the content of the message through voice.

6. The system of any one of claims 1 to 5, wherein the hardware capability information includes that the second electronic device is provided with a camera, the second electronic device further configured to:

prompting the content of the message when the second electronic device detects that only the owner of the first electronic device focuses on the second electronic device through the camera; or,

And prompting to receive the message when the second electronic device detects that a plurality of users including a owner of the first electronic device focus on the second electronic device through the camera.

7. The system of any one of claims 1 to 5, wherein the second electronic device is further configured to:

before prompting the message to the user, determining that the second electronic device is in a non-do-not-disturb mode, or determining that the second electronic device is not currently running a preset application program.

8. The system of any one of claims 1 to 5, wherein the first electronic device is further configured to:

before sending the message to the second electronic equipment, determining the type of the message as the message type set by a user; or,

and before the message is sent to the second electronic equipment, determining that the message is an instant messaging IM message.

9. The system of any one of claims 1 to 5, wherein the first electronic device is further configured to:

before sending the message to the second electronic device, determining that the second electronic device forwards the received message set by the user; or alternatively

Before sending the message to the second electronic device, determining that an account number registered on the first electronic device is associated with an account number registered on the second electronic device.

10. The system according to any one of claims 1 to 5, wherein the first electronic device is specifically configured to: when the fact that the device focused by the owner of the first electronic device is not the first electronic device is determined, sending request information to the second electronic device, wherein the request information is used for requesting the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device or not;

the second electronic device is further configured to send response information to the first electronic device according to the request information, where the response information is used to indicate that a device currently focused by a owner of the first electronic device is the second electronic device;

the first electronic device is specifically configured to: and sending the message to the second electronic device in response to receiving the response information.

11. The system according to any one of claims 1 to 5, wherein the second electronic device comprises user feature collection means, and the first electronic device is specifically configured to: when the fact that the device focused by the owner of the first electronic device is not the first electronic device is determined, sending request information to the second electronic device, wherein the request information is used for requesting the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device or not;

The second electronic device is further configured to: according to the request information, collecting user characteristics through the user characteristic collecting device and sending the user characteristics to the first electronic equipment;

the first electronic device is specifically configured to: before sending the message to the second electronic device, determining that the user characteristic matches a preset user characteristic in the first electronic device.

12. A method of prompting a message, the method being applied in an electronic device, the method comprising:

the electronic equipment receives a message sent by another electronic equipment, wherein the message is acquired by the other electronic equipment from a server, the message is of a first application program, and the electronic equipment is equipment which is not provided with the first application program;

the electronic equipment prompts the message to a user according to the equipment information of the electronic equipment; the device information of the electronic device comprises hardware capability information of the electronic device;

before prompting the message to the user, the method further comprises: the electronic equipment receives indication information sent by the other electronic equipment, wherein the indication information is used for indicating the electronic equipment to increase a reply control for the message;

The electronic equipment prompts the message to a user according to the equipment information of the electronic equipment, and the method comprises the following steps: the electronic equipment displays a message reminding frame according to the hardware capability information and the indication information, wherein the message reminding frame comprises the message and the reply control;

after prompting the message to the user, the method further comprises: and when the operation of replying to the message is detected, sending reply content to the other electronic equipment.

13. The method of claim 12, wherein the hardware capability information includes a display screen of the electronic device, and wherein the electronic device prompting the user for the message based on the device information of the electronic device comprises:

and displaying a message reminding frame through the display screen, wherein the message reminding frame comprises the message and the message reminding frame does not comprise a control.

14. The method of claim 12, wherein the hardware capability information includes a display screen of the electronic device, and wherein the electronic device prompting the user for the message based on the device information of the electronic device comprises:

when the electronic equipment detects that the input of a user is being received, a message reminding frame is displayed through the display screen, and a cursor is not positioned on the message reminding frame, wherein the message reminding frame comprises the message; or,

And when the electronic equipment detects that the input of the user is not received, displaying the message reminding frame through the display screen and positioning the cursor on the message reminding frame.

15. The method of claim 14, wherein the method further comprises:

when the electronic equipment detects that the input of the user is being received, prompt information is displayed through the display screen, and the prompt information is used for reminding the user to position the cursor to the message reminding frame through a first operation.

16. The method of claim 12, wherein the hardware capability information includes a voice capability of the electronic device, and wherein the electronic device prompting the user for the message based on the device information of the electronic device comprises:

the electronic equipment reminds the user of receiving the message through voice; or,

the electronic equipment reminds the user of the content of the message through voice.

17. The method according to any one of claims 12 to 16, wherein the hardware capability information includes that the electronic device is provided with a camera, and the electronic device prompts the message to a user according to device information of the electronic device, including:

When the electronic equipment detects that only the owner of the other electronic equipment focuses on the electronic equipment through the camera, the electronic equipment prompts the content of the message; or,

and when the electronic equipment detects that a plurality of users including a machine owner of the other electronic equipment focus the electronic equipment through the camera, prompting the users to receive the message.

18. The method according to any one of claims 12 to 16, further comprising:

before prompting the message to the user, determining that the electronic device is in a non-do-not-disturb mode, or determining that the electronic device is not currently running a preset application program.

19. The method according to any one of claims 12 to 16, further comprising:

before receiving a message sent by another electronic device, the electronic device receives request information sent by the other electronic device, where the request information is used to request the electronic device to determine whether a host of the other electronic device focuses on the electronic device;

and the electronic equipment sends response information to the other electronic equipment according to the request information, wherein the response information is used for indicating that the equipment currently focused by the owner of the other electronic equipment is the electronic equipment.

20. The method of any one of claims 12 to 16, wherein the electronic device comprises a user feature collection device, the method further comprising: before receiving a message sent by another electronic device, the electronic device receives request information sent by the other electronic device, where the request information is used to request the electronic device to determine whether a host of the other electronic device focuses on the electronic device;

and the electronic equipment collects the user characteristics through the user characteristic collection device according to the request information and sends the user characteristics to the other electronic equipment.

21. An electronic device, characterized by one or more processors; one or more memories; the one or more memories store one or more computer programs comprising instructions that, when executed by the one or more processors, cause the electronic device to perform the method of prompting messages of any of claims 12 to 20.

22. A computer readable storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform a method of prompting a message according to any one of claims 12 to 20.