WO2022037407A1 - 一种回复消息的方法、电子设备和系统 - Google Patents

一种回复消息的方法、电子设备和系统 Download PDF

Info

Publication number
WO2022037407A1
WO2022037407A1 PCT/CN2021/110420 CN2021110420W WO2022037407A1 WO 2022037407 A1 WO2022037407 A1 WO 2022037407A1 CN 2021110420 W CN2021110420 W CN 2021110420W WO 2022037407 A1 WO2022037407 A1 WO 2022037407A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
message
user
information
reply
Prior art date
Application number
PCT/CN2021/110420
Other languages
English (en)
French (fr)
Inventor
余平
刘敏
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21857502.5A priority Critical patent/EP4187891A4/en
Publication of WO2022037407A1 publication Critical patent/WO2022037407A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. short messaging services [SMS] or e-mails
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3228—Monitoring task completion, e.g. by use of idle timers, stop commands or wait commands
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234—Power saving characterised by the action undertaken
    • G06F1/325—Power saving in peripheral device
    • G06F1/3265—Power saving in display device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions

Definitions

  • the present application relates to the field of terminals, and more particularly, to a method, electronic device and system for replying to a message.
  • Smart devices have many cross-device synchronization functions with notification messages, such as Apple's iMessage, Microsoft's Your Phone and other program services. These synchronization schemes have a common feature. They require logging in to the application (application, App) of the same account on multiple devices, and then control the distribution of messages through the server side, so as to send messages to different device clients. Enables cross-device synchronization of notification messages. If the receiving device does not log in to the App of the same account or the receiving device does not have the App installed, the receiving device cannot obtain the message from the server, which will cause the user to miss some important information, thereby affecting the user experience.
  • notification messages such as Apple's iMessage, Microsoft's Your Phone and other program services.
  • the present application provides a method, electronic device, and system for replying to a message, which helps to improve the collaboration capability under multiple devices, helps prevent users from missing important messages, and thus improves user experience.
  • a system in a first aspect, includes a first electronic device and a second electronic device, the first electronic device is used for receiving a message; the first electronic device is also used for determining the first electronic device When the device focused by the owner is the second electronic device, send the message and the indication information to the second electronic device, the indication information is used to instruct the second electronic device to add a reply control to the message; the second electronic device The device is used to display a message reminder box, the message reminder box includes the message and the reply control; the second electronic device is also used for detecting the user's operation of replying to the message, to the first electronic device Sending reply content; the first electronic device is further configured to reply to the message according to the reply content.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and indication information to the second electronic device , so that the second electronic device can present a message reminder box including the message and a reply control to the user.
  • the owner of the first electronic device it is convenient for the owner of the first electronic device to complete a virtual reply to the message on the second electronic device.
  • the second electronic device can send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to receive the reminder of the message in time and complete the reply to the message, avoids the process of the user returning to the first electronic device to reply to the message, and avoids the user from missing important messages.
  • the second electronic device may be a device in the device list of the first electronic device; or, the second electronic device may also be a device around the first electronic device.
  • the first electronic device is specifically configured to reply to the message according to the reply content and the API provided by the application program corresponding to the message; or, according to the reply content and the drag event, to reply to the message. Reply to this message.
  • the indication information may be a quick reply flag attribute.
  • the first electronic device is specifically configured to: send the message identified by the identification information to the second electronic device; the second electronic device is specifically configured to: The reply content after being identified by the identification information is sent to the first electronic device.
  • the first electronic device may send a message identified by the identification information to the second electronic device, so that the second electronic device can use the identification information to identify the message when acquiring the user's reply content, so that The first electronic device specifies which message the reply content is for.
  • the first electronic device receives multiple messages, it helps to improve the accuracy when the first electronic device responds to messages.
  • the identification information may be a notification ID attribute and/or a notification channel attribute.
  • the first electronic device is further configured to display the first interface before receiving the message; and display the first interface after replying to the message.
  • the first electronic device after the first electronic device completes the real reply to the message, it can restore the display interface before receiving the message, so that the real reply process of the first electronic device to the message is indifferent to the user, which helps to improve the user experience. experience.
  • the content of the message is text information
  • the second electronic device includes a voice function
  • the second electronic device is further configured to: after receiving the message, pass Voice prompts the textual information to the user.
  • the second electronic device may prompt the user to receive the message or prompt by voice The content of the message to the user.
  • the user is prevented from being informed of the message through the voice prompt by viewing the screen of the second electronic device, and the user is prevented from missing important messages, thereby improving the user's experience.
  • the second electronic device is a car machine or a smart speaker.
  • the second electronic device is specifically configured to: collect the voice information replied by the user before sending the reply content to the first electronic device; The device sends the voice information, or sends the text information corresponding to the voice signal to the first electronic device.
  • the first electronic device may reply to the message with the voice information, or may also reply to the message with the voice information corresponding to the voice information. text information.
  • the reply content includes a file.
  • the user can reply to multimedia files (such as pictures, videos) and work files (such as word documents or excel documents, etc.) on the second electronic device, which helps to increase the diversity of the user's reply content , which helps improve the user experience when replying to messages.
  • multimedia files such as pictures, videos
  • work files such as word documents or excel documents, etc.
  • the first electronic device is further configured to: before sending the message and the indication information to the second electronic device, determine that the type of the message is set by the user message type; or, before sending the message and the indication information to the second electronic device, determine that the message is an instant messaging IM message.
  • the first electronic device may first determine that the message is a message type set by the user or an IM type message, which helps to prevent some unimportant messages from being forwarded to the second electronic device. Second, the electronic device avoids the interference to the user caused by these unimportant messages, and helps to improve the user's experience.
  • the first electronic device is further configured to: before sending the message and the indication information to the second electronic device, determine that the second electronic device is set by the user or, before sending the message and the indication information to the second electronic device, determine that the account logged in on the first electronic device is associated with the account logged in on the second electronic device.
  • the first electronic device may first determine that the second electronic device is a device set by the user to receive message forwarding, or determine the account logged in the first electronic device and the second electronic device.
  • the accounts logged in on the device are associated, which helps prevent messages from being forwarded to devices that are not authorized by the user, improves the security of message forwarding, avoids leakage of user privacy, and helps improve user experience.
  • the first electronic device is specifically configured to: when it is determined that the device currently focused by the owner of the first electronic device is not the first electronic device, send the first electronic device to the first electronic device.
  • the second electronic device sends request information, where the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device is further configured to send a request to the second electronic device according to the request information
  • the first electronic device sends response information, where the response information is used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device; the first electronic device is specifically used for: in response to receiving the response information , and send the message to the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or, the first electronic device and the second electronic device may be devices under the same account).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect the user features and match with the preset user features in the second electronic device, and if the matching is successful, determine the first
  • the device currently focused by the owner of the electronic device is the second electronic device, so that response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents other users except the owner of the first electronic device from receiving a prompt of the message, thereby helping to improve user experience.
  • the second electronic device may first determine whether the first electronic device and the second electronic device are devices under the same account. If the second electronic device determines that the first electronic device and the second electronic device are devices under the same account, the second electronic device may collect the feature information of the user focusing on the second electronic device through the user feature collecting device, and collect the collected feature information. The user feature information matches the user feature information preset in the second electronic device, and if the matching is successful, the response information is sent to the first electronic device.
  • the second electronic device includes a user feature collection device
  • the first electronic device is specifically configured to: determine the device currently focused by the owner of the first electronic device When it is not the first electronic device, send request information to the second electronic device, where the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device;
  • the second electronic device The device is further configured to: collect user features through the user feature collection device and send the user features to the first electronic device according to the request information; the first electronic device is specifically used for: sending the message to the second electronic device Before, it is determined that the user characteristic matches the preset user characteristic in the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or, the first electronic device and the second electronic device may be different from devices under the same account).
  • the electronic device may store information of different users); or, the second electronic device may also be a device around the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collecting device and send the feature information to the first electronic device.
  • the first electronic device matches the user feature information preset in the first electronic device according to the feature information, and forwards the message to the second electronic device if the matching is successful. This helps to improve the security of message forwarding, and prevents other users except the owner of the first electronic device from receiving a prompt of the message, thereby helping to improve user experience.
  • the message is a message of the first application
  • the second electronic device is a device that does not have the first application installed.
  • the second electronic device can also add a reply control in the message reminder box after receiving the indication information, so that the second electronic device can The device may acquire the content of the reply from the user through the reply content input by the user and the detected operation of clicking the reply control, and send the reply content to the first electronic device.
  • the real reply to the message is completed on the first electronic device. This helps the user to receive reminders of messages in a timely manner, and prevents the user from missing important messages, thereby helping to improve the user experience.
  • a method for replying to a message is provided, the method is applied to a first electronic device, and the method includes: the first electronic device receives a message; when determining that the device focused by the owner of the first electronic device is the second electronic device When the electronic device is used, the first electronic device sends the message and the indication information to the second electronic device, and the indication information is used to instruct the second electronic device to add a reply control to the message; the first electronic device receives the second electronic device.
  • the reply content to the message sent by the electronic device; the first electronic device replies to the message according to the reply content.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and indication information to the second electronic device , so that the second electronic device can present a message reminder box including the message and a reply control to the user.
  • the owner of the first electronic device it is convenient for the owner of the first electronic device to complete a virtual reply to the message on the second electronic device.
  • the second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to receive the message reminder in time and complete the reply to the message, avoid the process of the user returning to the first electronic device to reply to the message, and prevent the user from missing important messages.
  • sending the message by the first electronic device to the second electronic device includes: the first electronic device sends the second electronic device after the identification information has been identified. the message;
  • the receiving, by the first electronic device, the reply content to the message sent by the second electronic device includes: receiving, by the first electronic device, the reply content that is identified by the identification information and sent by the second electronic device.
  • the first electronic device may send a message identified by the identification information to the second electronic device, so that the second electronic device can use the identification information to identify the message when acquiring the user's reply content, so that The first electronic device specifies which message the reply content is for.
  • the first electronic device receives multiple messages, it helps to improve the accuracy when the first electronic device responds to messages.
  • the identification information may be a notification ID attribute and/or a notification channel attribute.
  • the method further includes: before receiving the message, the first electronic device displays a first interface; after replying to the message, the first electronic device The first interface is displayed.
  • the first electronic device after the first electronic device completes the real reply to the message, it can restore the display interface before receiving the message, so that the real reply process of the first electronic device to the message is indifferent to the user, which helps to improve the user experience. experience.
  • the reply content is voice information, or the reply content is text information corresponding to the voice information; wherein the voice information is a user collected by the second electronic device Reply to the voice message.
  • the second electronic device may prompt the user to receive the message or prompt by voice The content of the message to the user.
  • the user is prevented from being informed of the message through the voice prompt by viewing the screen of the second electronic device, and the user is prevented from missing important messages, thereby improving the user's experience.
  • the second electronic device is a car machine or a smart speaker.
  • the reply content is a file.
  • the user can reply to multimedia files (such as pictures, videos) and work files (such as word documents or excel documents, etc.) on the second electronic device, which helps to increase the diversity of the user's reply content , which helps improve the user experience when replying to messages.
  • multimedia files such as pictures, videos
  • work files such as word documents or excel documents, etc.
  • the method further includes: before sending the message and the indication information to the second electronic device, the first electronic device determines that the type of the message is set by a user or, before sending the message and the indication information to the second electronic device, the first electronic device determines that the message is an instant messaging IM message.
  • the first electronic device may first determine that the message is a message type set by the user or an IM type message, which helps to prevent some unimportant messages from being forwarded to the second electronic device. Second, the electronic device avoids the interference to the user caused by these unimportant messages, and helps to improve the user's experience.
  • the method further includes: before sending the message and the indication information to the second electronic device, the first electronic device determines that the second electronic device is a user The set device for receiving message forwarding; or before sending the message and the indication information to the second electronic device, the first electronic device determines the account logged in on the first electronic device and the account logged in on the second electronic device Associated.
  • the first electronic device may first determine that the second electronic device is a device set by the user to receive message forwarding, or determine the account logged in the first electronic device and the second electronic device.
  • the accounts logged in on the device are associated, which helps prevent messages from being forwarded to devices that are not authorized by the user, improves the security of message forwarding, avoids leakage of user privacy, and helps improve user experience.
  • the method before the first electronic device sends the message and the indication information to the second electronic device, the method further includes: the first electronic device determines the first electronic device When the device currently focused by the owner of the electronic device is not the first electronic device, send request information to the second electronic device, where the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the device a second electronic device; the first electronic device receives response information sent by the second electronic device, where the response information is used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or, the first electronic device and the second electronic device may be devices under the same account).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect the user features and match with the preset user features in the second electronic device, and if the matching is successful, determine the first
  • the device currently focused by the owner of the electronic device is the second electronic device, so that response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents other users except the owner of the first electronic device from receiving a prompt of the message, thereby helping to improve user experience.
  • the second electronic device may first determine whether the first electronic device and the second electronic device are devices under the same account. If the second electronic device determines that the first electronic device and the second electronic device are devices under the same account, the second electronic device may collect the feature information of the user focusing on the second electronic device through the user feature collecting device, and collect the collected feature information. The user feature information matches the user feature information preset in the second electronic device, and if the matching is successful, the response information is sent to the first electronic device.
  • the second electronic device includes a user feature collection device, and before the first electronic device sends the message and the indication information to the second electronic device, the method further includes :
  • the first electronic device determines that the device currently focused by the owner of the first electronic device is not the first electronic device, it sends request information to the second electronic device, where the request information is used to request the second electronic device to determine Whether the owner of the first electronic device focuses on the second electronic device;
  • the first electronic device receives the user feature sent by the second electronic device, and the user feature is the user feature collected by the second electronic device through the user feature collecting device feature; the first electronic device determines that the user feature matches a user feature preset in the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or, the first electronic device and the second electronic device may be different from devices under the same account).
  • the electronic device may store different user information); alternatively, the second electronic device may also be a device around the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collecting device and send the feature information to the first electronic device.
  • the first electronic device matches the user feature information preset in the first electronic device according to the feature information, and forwards the message to the second electronic device if the matching is successful. This helps to improve the security of message forwarding, and prevents other users except the owner of the first electronic device from receiving a prompt of the message, thereby helping to improve user experience.
  • a method for replying to a message is provided, the method is applied to a second electronic device, and the method includes: the second electronic device receives a message and indication information sent by the first electronic device, where the indication information is used to indicate the The second electronic device adds a reply control to the message; the second electronic device displays a message reminder box, and the message reminder box includes the message and the reply control; when detecting the user's operation of replying to the message, the first The second electronic device sends the reply content to the first electronic device.
  • the first electronic device when the first electronic device determines that the device focused by the owner of the first electronic device is not the first electronic device but the second electronic device, the first electronic device may send a message and indication information to the second electronic device , so that the second electronic device can present a message reminder box including the message and a reply control to the user.
  • the owner of the first electronic device it is convenient for the owner of the first electronic device to complete a virtual reply to the message on the second electronic device.
  • the second electronic device may send the reply content to the first electronic device, so that the first electronic device completes a real reply to the message. This helps the user to receive the reminder of the message in time and complete the reply to the message, avoids the user returning to the first electronic device to reply to the message, and prevents the user from missing important messages.
  • the method further includes: receiving, by the second electronic device, the message identified by the identification information sent by the first electronic device; wherein the second electronic device Sending the reply content to the first electronic device includes: the second electronic device sending the reply content after the identification information to the first electronic device.
  • the first electronic device may send a message identified by the identification information to the second electronic device, so that the second electronic device can use the identification information to identify the message when acquiring the user's reply content, so that The first electronic device specifies which message the reply content is for.
  • the first electronic device receives multiple messages, it helps to improve the accuracy when the first electronic device responds to messages.
  • the identification information may be a notification ID attribute and/or a notification channel attribute.
  • the content of the message is text information
  • the second electronic device includes a voice function
  • the method further includes: after receiving the message, the second electronic device The text information is prompted to the user by voice.
  • the second electronic device may prompt the user to receive the message or prompt by voice The content of the message to the user.
  • the user is prevented from being informed of the message through the voice prompt by viewing the screen of the second electronic device, and the user is prevented from missing important messages, thereby improving the user's experience.
  • the second electronic device is a car machine or a smart speaker.
  • the second electronic device sends the reply content to the first electronic device, including: the second electronic device collects the voice information replied by the user; the second electronic device The voice information is sent to the first electronic device, or the text information corresponding to the voice signal is sent to the first electronic device.
  • the first electronic device may reply to the message with the voice information, or may also reply to the message with the voice information corresponding to the voice information. text information.
  • the reply content includes a file.
  • the user can reply to multimedia files (such as pictures, videos) and work files (such as word documents or excel documents, etc.) on the second electronic device, which helps to increase the diversity of the user's reply content , which helps improve the user experience when replying to messages.
  • multimedia files such as pictures, videos
  • work files such as word documents or excel documents, etc.
  • the method before the second electronic device receives the message and the indication information sent by the first electronic device, the method further includes: the second electronic device receives the first electronic device Sending request information, the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device sends to the first electronic device according to the request information response information, where the response information is used to indicate that the device currently focused by the owner of the first electronic device is the second electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may be devices under the same account (or, the first electronic device and the second electronic device may be devices under the same account).
  • the electronic device can save the information of the same user), so that after receiving the request information, the second electronic device can collect the user features and match with the preset user features in the second electronic device, and if the matching is successful, determine the first
  • the device currently focused by the owner of the electronic device is the second electronic device, so that response information is sent to the first electronic device. This helps to improve the security of message forwarding, and prevents other users except the owner of the first electronic device from receiving a prompt of the message, thereby helping to improve user experience.
  • the second electronic device includes a user feature collection device, and before the second electronic device receives the message and the indication information sent by the first electronic device, the method further includes: The second electronic device receives request information sent by the first electronic device, where the request information is used to request the second electronic device to determine whether the owner of the first electronic device focuses on the second electronic device; the second electronic device according to For the request information, the user feature is collected by the user feature collecting device and the user feature is sent to the first electronic device.
  • the second electronic device may be a device in the message forwarding list of the first electronic device, and the first electronic device and the second electronic device may not be devices under the same account (or, the first electronic device and the second electronic device may be different from devices under the same account).
  • the electronic device may store information of different users); or, the second electronic device may also be a device around the first electronic device.
  • the second electronic device can collect the feature information of the user who is focusing on the second electronic device through the user feature collecting device and send the feature information to the first electronic device.
  • the first electronic device matches the user feature information preset in the first electronic device according to the feature information, and forwards the message to the second electronic device if the matching is successful. This helps to improve the security of message forwarding, and prevents other users except the owner of the first electronic device from receiving a prompt of the message, thereby helping to improve user experience.
  • the message is a message of the first application
  • the second electronic device is a device on which the first application is not installed.
  • the second electronic device can also add a reply control in the message reminder box after receiving the indication information, so that the second electronic device can The device may acquire the content of the reply from the user through the reply content input by the user and the detected operation of clicking the reply control, and send the reply content to the first electronic device.
  • the real reply to the message is completed on the first electronic device. This helps the user to receive the reminder of the message in time and complete the reply to the message, so as to prevent the user from missing important messages, thereby helping to improve the user experience.
  • a device for replying to a message is provided, the device for replying to a message is set in a first electronic device, and the device includes: a first receiving unit for receiving a message; a sending unit for determining the first electronic device When the device focused by the owner of the device is the second electronic device, send the message and indication information to the second electronic device, where the indication information is used to instruct the second electronic device to add a reply control to the message; the second receiving unit , for receiving the reply content to the message sent by the second electronic device; the reply unit for replying to the message according to the reply content.
  • a device for replying to a message is provided, the device for replying to a message is set in a second electronic device, and the device includes: a receiving unit for receiving a message and indication information sent by the first electronic device, and the indication information uses to instruct the second electronic device to add a reply control to the message; a display unit, used to display a message reminder frame, the message reminder frame includes the message and the reply control; a sending unit, used to detect the user's response to the message When the reply operation is performed, the reply content is sent to the first electronic device.
  • an electronic device comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions. When the instruction is executed by the electronic device, the electronic device is caused to execute the method for replying to a message in any possible implementation of the second aspect above.
  • an electronic device comprising: one or more processors; a memory; and one or more computer programs. Wherein, one or more computer programs are stored in the memory, the one or more computer programs comprising instructions. When the instruction is executed by the electronic device, the electronic device is caused to execute the method for replying to a message in any possible implementation of the third aspect.
  • a computer program product comprising instructions, when the computer program product is run on a first electronic device, the first electronic device is made to execute the method for replying to a message in the second aspect; Alternatively, when the computer program product runs on the second electronic device, the second electronic device is caused to execute the method for replying to a message described in the third aspect.
  • a computer-readable storage medium comprising instructions, when the instructions are executed on a first electronic device, the first electronic device is caused to execute the method for replying to a message in the second aspect; Alternatively, when the instruction is executed on the second electronic device, the second electronic device is caused to execute the method for replying to a message described in the third aspect.
  • a chip for executing an instruction.
  • the chip executes the method for replying to a message described in the second aspect above; or, when the chip is running, the chip executes The method for replying to a message described in the third aspect above.
  • FIG. 1 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
  • FIG. 2 is a block diagram of a software structure provided by an embodiment of the present application.
  • FIG. 3 is a set of graphical user interfaces provided by an embodiment of the present application.
  • FIG. 4 is another set of graphical user interfaces provided by an embodiment of the present application.
  • FIG. 5 is another set of graphical user interfaces provided by the embodiments of the present application.
  • FIG. 6 is another set of graphical user interfaces provided by an embodiment of the present application.
  • FIG. 7 is another set of graphical user interfaces provided by the embodiments of the present application.
  • FIG. 8 is an internal implementation process of a sending (source) end and a receiving (sink) end provided by an embodiment of the present application.
  • FIG. 9 is another set of graphical user interfaces provided by the embodiments of the present application.
  • FIG. 10 is a process of reproducing the interface of the source end at the sink end through audio and video collection provided by the embodiment of the present application.
  • FIG. 11 is another set of graphical user interfaces provided by the embodiments of the present application.
  • FIG. 12 is another set of graphical user interfaces provided by the embodiments of the present application.
  • FIG. 13 is another set of graphical user interfaces provided by the embodiments of the present application.
  • FIG. 14 is a schematic flowchart of a method for replying to a message provided by an embodiment of the present application.
  • FIG. 15 is a schematic block diagram of an apparatus for replying to a message provided by an embodiment of the present application.
  • FIG. 16 is a schematic block diagram of an apparatus for replying to a message provided by an embodiment of the present application.
  • FIG. 17 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical features.
  • a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature.
  • plural means two or more.
  • the methods provided in the embodiments of the present application can be applied to mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (ultra mobile personal computers) -mobile personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA) and other electronic devices, the embodiments of the present application do not impose any restrictions on the specific types of electronic devices.
  • AR augmented reality
  • VR virtual reality
  • notebook computers notebook computers
  • netbook personal digital assistant
  • PDA personal digital assistant
  • FIG. 1 shows a schematic structural diagram of an electronic device 100 .
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195 and so on.
  • SIM Subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • graphics processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller may be the nerve center and command center of the electronic device 100 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
  • the processor 110 may contain multiple sets of I2C buses.
  • the processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193 and the like through different I2C bus interfaces.
  • the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate with each other through the I2C bus interface, so as to realize the touch function of the electronic device 100 .
  • the I2S interface can be used for audio communication.
  • the processor 110 may contain multiple sets of I2S buses.
  • the processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 .
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through a Bluetooth headset.
  • the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is typically used to connect the processor 110 with the wireless communication module 160 .
  • the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function.
  • the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .
  • MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc.
  • the processor 110 communicates with the camera 193 through a CSI interface, so as to realize the photographing function of the electronic device 100 .
  • the processor 110 communicates with the display screen 194 through the DSI interface to implement the display function of the electronic device 100 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like.
  • the GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones.
  • the interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 may receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 charges the battery 142 , it can also supply power to the electronic device through the power management module 141 .
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance).
  • the power management module 141 may also be provided in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • global positioning system global positioning system, GPS
  • global navigation satellite system global navigation satellite system, GLONASS
  • Beidou navigation satellite system beidou navigation satellite system, BDS
  • quasi-zenith satellite system quadsi -zenith satellite system, QZSS
  • SBAS satellite based augmentation systems
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED diode AMOLED
  • flexible light-emitting diode flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.
  • the electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos of various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG Moving Picture Experts Group
  • MPEG2 moving picture experts group
  • MPEG3 MPEG4
  • MPEG4 Moving Picture Experts Group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 121 .
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • Speaker 170A also referred to as a "speaker" is used to convert audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be answered by placing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C.
  • the electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the earphone jack 170D is used to connect wired earphones.
  • the earphone interface 170D may be the USB interface 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 180A may be provided on the display screen 194 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes.
  • the electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
  • the gyro sensor 180B may be used to determine the motion attitude of the electronic device 100 .
  • the angular velocity of electronic device 100 about three axes ie, x, y, and z axes
  • the gyro sensor 180B can be used for image stabilization.
  • the gyro sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse motion to achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenarios.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 can detect the opening and closing of the flip holster using the magnetic sensor 180D.
  • the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Further, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, characteristics such as automatic unlocking of the flip cover are set.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.
  • the electronic device 100 can measure the distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
  • Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the electronic device 100 emits infrared light to the outside through the light emitting diode.
  • Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100 . When insufficient reflected light is detected, the electronic device 100 may determine that there is no object near the electronic device 100 .
  • the electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power.
  • Proximity light sensor 180G can also be used in holster mode, pocket mode automatically unlocks and locks the screen.
  • the ambient light sensor 180L is used to sense ambient light brightness.
  • the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket, so as to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking pictures with fingerprints, answering incoming calls with fingerprints, and the like.
  • the temperature sensor 180J is used to detect the temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection.
  • the electronic device 100 when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by the low temperature.
  • the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display screen 194.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice.
  • the bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal.
  • the bone conduction sensor 180M can also be disposed in the earphone, combined with the bone conduction earphone.
  • the audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibration bone block obtained by the bone conduction sensor 180M, so as to realize the voice function.
  • the application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and realize the function of heart rate detection.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key.
  • the electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .
  • Motor 191 can generate vibrating cues.
  • the motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback.
  • touch operations acting on different applications can correspond to different vibration feedback effects.
  • the motor 191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be contacted and separated from the electronic device 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 .
  • the electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card and so on. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different.
  • the SIM card interface 195 can also be compatible with different types of SIM cards.
  • the SIM card interface 195 is also compatible with external memory cards.
  • the electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication.
  • the electronic device 100 employs an eSIM, ie: an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of the electronic device 100 .
  • FIG. 2 is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.
  • the application layer can include a series of application packages.
  • the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include window managers, content providers, view systems, telephony managers, resource managers, notification managers, and the like.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications.
  • a display interface can consist of one or more views.
  • the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide the communication function of the electronic device 100 .
  • the management of call status including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (media library), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library media library
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
  • FIG. 3 is a set of graphical user interfaces (graphical user interface, GUI) provided by the embodiments of the present application.
  • the user Lily is currently watching a video on the tablet, and the mobile phone is placed on the table by the user Lily.
  • the phone receives a social app message from user Tom (eg, Happy Birthday!).
  • the mobile phone can forward the message to the tablet that the user is focusing on, and the tablet can display a message reminder box 301 .
  • the message reminder box 301 includes the source of the message (for example, the name of the social app, and the message is from user Lily's P40), the information of the user who sent the message (for example, "Tom" and the avatar of the user Tom), the The content of the message (eg, Happy Birthday! and controls 302.
  • the tablet may be an account that is logged into the same social App as the mobile phone; alternatively, the tablet may be installed with the social App but the user does not use the same account as the mobile phone to log in to the social App; or the tablet may not have the social app installed.
  • Devices for social apps are not limited to, Facebook, Twitter, Twitter, Instagram, etc.
  • the mobile phone after the mobile phone receives a notification, if the mobile phone determines that the user is currently focusing on the mobile phone but the tablet, then the mobile phone can carry the content of the message in the information sent to the tablet, and the user who sent the message information and the Quick Reply attribute. Further, the mobile phone can also carry the information of the mobile phone in the information sent to the tablet. Therefore, the tablet can display the reminder frame 301 to the user according to the information sent by the mobile phone.
  • the notification message forwarded by the mobile phone in the embodiment of the present application may be a message of a notification type set in advance by the user.
  • the user may set the notification messages of apps such as WeChat, QQ, Dingding, etc. in the system settings to be forwardable.
  • the notification message forwarded by the mobile phone may also be a default instant message (IM) type message (such as SMS, WeChat, etc.).
  • IM instant message
  • the phone After the phone receives the message for a period of time, the message is automatically hidden.
  • the user can handle the message by entering the notification center, or by pulling down the menu.
  • a text input box 303 may be displayed in the message reminder box, and a send control 304 may also be displayed in the text input box 303 .
  • the tablet can also call up the system input method.
  • the user can edit the content he needs to reply through the input method (for example, Thank you!), and the content replied by the user can be displayed in the text input box 303 .
  • the tablet After the tablet detects that the user clicks on the control 304, the tablet can send the reply content to the mobile phone. At the same time, the input method and message reminder box on the tablet can be automatically hidden. The changes of the GUI on the mobile phone can be seen in (c) to (f) of FIG. 3 .
  • the mobile phone can automatically start the social application App.
  • the historical chat records of the user Tom, the user Sam, the user Lucy, and the user Mike may be sequentially displayed on the display interface of the social networking application App according to the order of the time when the messages are received.
  • the mobile phone can automatically open the chat interface of user Tom.
  • a message (Happy Birthday!) sent by the user Tom to the user Lily can be displayed on the chat interface.
  • the mobile phone can automatically reply the content replied by the user on the tablet to the user Tom.
  • the phone can go back to the state it was in before the message was received. See (f) in FIG. 3 .
  • the mobile phone can automatically return to the desktop of the mobile phone from the chat interface with user Tom in the social app.
  • the message replied by the user does not complete the actual reply.
  • the real reply process is actually done on the phone. For example, after the mobile phone displays the interface shown in (e) of FIG. 3 , the mobile phone completes the actual reply to the message.
  • the process for the mobile phone to complete the reply to the message may also be implemented internally, and the mobile phone may automatically complete the reply to the message in the background after receiving the content of the user reply sent by the tablet. That is to say, the process that the mobile phone completes the real reply to the message may be indifferent to the user.
  • the user can directly complete the reply to the message on the tablet without returning to the mobile phone to process the message. This can prevent the user from missing important information, and also avoid the process of the user returning to the mobile phone for message processing, which helps to improve the user experience.
  • FIG. 4 is another set of GUIs provided by the embodiments of the present application.
  • the user is working on a laptop in a room, and the phone is locked and placed by the user in another room.
  • the mobile phone receives a social App message (eg, Happy Birthday!) from user Tom and a social App message (eg, Happy Birthday! from user Amy.
  • the mobile phone can send the messages of the user Tom and the user Amy to the laptop computer that the user is focusing on, and the laptop computer can display a message reminder box 401 and a message reminder box 402 .
  • the first message reminder box 401 includes the source of the message (for example, the message belongs to a social App, and the message comes from the P40 of user Lily), the information of the user who sent the message (for example, "Tom" and the user Tom avatar), the content of the message (eg, Happy Birthday!), and controls 403.
  • the second message reminder box 402 includes the source of the message (for example, the message belongs to a social App, and the message comes from user Lily's P40), the information of the user who sent the message (for example, "Amy” and the avatar of user Amy) ), the content of the message (for example, Happy Birthday!), and the reply controls.
  • the source of the message for example, the message belongs to a social App, and the message comes from user Lily's P40
  • the information of the user who sent the message for example, "Amy" and the avatar of user Amy
  • the content of the message for example, Happy Birthday!
  • the notebook computer can display a text input box 404 in the message reminder box, and a send control 405 can also be displayed in the text input box 404 .
  • the notebook computer can also detect the content of the user's reply through the keyboard (for example, Thank you!), and the content of the user's reply can be displayed in the text input box 404 .
  • the notebook computer After the notebook computer detects that the user clicks the control 405, the notebook computer can send the reply content to the mobile phone. At the same time, the message reminder box 401 on the notebook computer can be automatically hidden. The changes of the GUI on the mobile phone can be seen in (c) to (f) of FIG. 4 .
  • the mobile phone can directly pull up the display interface of the social application App on the lock screen interface.
  • the display interface may sequentially display the historical chat records of the user Tom, the user Amy, the user Sam, the user Lucy, and the user Mike according to the order of the times when the messages are received.
  • the answering interfaces of video calls and voice calls of friends in some social apps may be directly displayed on the lock screen interface of the mobile phone.
  • the mobile phone by adding a (flags) attribute supporting lock screen loading in the social app, the mobile phone can directly pull up the display interface of the social app on the lock screen interface.
  • the mobile phone After completing the real reply to the message, the mobile phone enters the lock screen state.
  • the message reminder box 401 may disappear; and the message reminder box 402 may continue to be displayed on the laptop computer. After a period of time, if the user does not reply to user Amy on the laptop, the message reminder box 402 can be automatically hidden.
  • the message prompt information of the user Tom can be automatically hidden on the lock screen interface; and the message prompt information of the user Amy can continue to be displayed on the lock screen interface.
  • the laptop computer can automatically turn on the camera to collect the user's face information while detecting the content of the user's reply through the keyboard.
  • the notebook computer can also send the collected face information to the mobile phone while sending the content of the user's reply to the user.
  • the mobile phone After the mobile phone determines that the face information collected by the laptop matches the preset face information in the mobile phone, the mobile phone can complete the real reply to the message.
  • the mobile phone can automatically perform an unlocking operation and enter a non-lock screen state. Thereby, the recovery process as shown in (c) to (e) in FIG. 4 is realized.
  • the notebook computer when the notebook computer sends the content of the user's reply to the mobile phone, the notebook computer can also send the user's face information collected by the notebook computer to the mobile phone.
  • the mobile phone can first determine whether the reply is for the user himself based on the face information. If the user himself replies, the mobile phone completes the true reply to the notification message; otherwise, the mobile phone may not reply to the notification message. This helps to improve the protection of the user's privacy by the mobile phone, and improves the user's experience.
  • FIG. 5 is another set of GUIs provided by the embodiments of the present application.
  • the user is driving at this time, and the display on the car machine shows that the user is using the navigation.
  • the phone is placed by the user in the car's storage slot.
  • the phone receives a social app message from user Tom (eg, Happy Birthday!).
  • the mobile phone can send this message to the user's car device, and the car device displays a message reminder box 501 through the display screen.
  • the source of the message for example, the message belongs to the message of the social App, and the message comes from the P40 of the user Lily
  • the information of the user who sent the message for example, "Tom” and the avatar of the user Tom
  • the content of the message for example, Happy Birthday!
  • the car machine can also prompt the user "Tom sends you Happy Birthday through the social app! through a voice reminder.
  • the message reminder box displayed on the display screen of the vehicle machine may not include the sending control.
  • the car machine After the car machine prompts the user through a voice reminder, the car machine can collect the content of the user's reply through the microphone. As shown, the user replied "Thank you!”. At this time, the vehicle machine can display the content of the user's reply through the message reminder box 501 .
  • a digital signal processor may be included on the vehicle.
  • the DSP can process the voice information, so that the text content corresponding to the voice information can be obtained by analysis.
  • the vehicle machine may include a speech recognition (automatic speech recognition, ASR) module, wherein the main function of the ASR module is to recognize the user's speech information as text content.
  • ASR automatic speech recognition
  • the message reminder box displayed on the display screen of the car device may also include a sending control. After the user clicks the sending control, the car device can send the content of the user's reply to the mobile phone. Alternatively, the sending control may not be included in the message reminder box. After the car machine collects the user's voice message "Thank you for Tom! through the microphone, the car machine can send the user's reply to the mobile phone.
  • the reply button on the message reminder box can also be mapped to the button on the steering wheel, so that the user can directly click the button on the steering wheel to make a voice reply, thereby further improving driving safety.
  • the content of the reply from the vehicle to the mobile phone may be voice information or text content.
  • the mobile phone after receiving the reply content sent by the car machine, the mobile phone can directly pull up the display interface of the social application App on the lock screen interface.
  • the historical chat records of the user Tom, the user Sam, the user Lucy, and the user Mike can be displayed in sequence according to the order of the times when the messages are received.
  • the mobile phone can automatically open the chat interface of user Tom.
  • a message (Happy Birthday!) sent by the user Tom to the user Lily can be displayed on the chat interface.
  • the mobile phone can automatically reply the text content corresponding to the voice information to the user Tom.
  • the mobile phone can reply the voice information to the user Tom.
  • a text-to-speech function may be added to the receiving end device.
  • vehicle-to-machine scenario it helps to increase the security and convenience for users to use message notification forwarding, and helps to improve the user experience.
  • FIG. 6 is another set of GUIs provided by the embodiments of the present application.
  • the user is working on a laptop in a room, and the phone is locked and placed by the user in another room.
  • the mobile phone receives a social App message from user Tom (eg, please send me the project plan).
  • the mobile phone can send this message to the laptop computer that the user is focusing on, and the laptop computer can display a message reminder box 601 .
  • the message reminder box 601 includes the source of the message (for example, the message belongs to a social App, and the message comes from user Lily's P40), the user information (for example, "Tom" and the avatar of user Tom) who sent the message ), the content of the message (eg, please send me the project plan), and control 602.
  • the notebook computer when the notebook computer detects that the user clicks on the control 602 , the notebook computer can display an input box 603 and a send control 604 . After the notebook computer detects that the user drags and drops the project plan (word document) on the desktop of the notebook computer to the input box 603, the notebook computer can send the project plan (word document) to the mobile phone. Alternatively, after the notebook computer detects that the user drags the project plan (word document) on the desktop of the notebook computer to the input box 603 and the user clicks the control 604, the notebook computer can send the project plan (word document) to the mobile phone.
  • the display interface of the mobile phone after receiving the project plan (word document) sent by the notebook computer can be referred to as shown in (c) to (f) in FIG. 6 .
  • the mobile phone can directly pull up the display interface of the social application App on the lock screen interface.
  • the historical chat records of the user Tom, the user Sam, the user Lucy, and the user Mike can be displayed in sequence according to the order of the times when the messages are received.
  • the mobile phone can automatically open the chat interface of user Tom.
  • the chat interface is opened, a message sent by the user Tom to the user Lily (please send me the project plan) can be displayed on the chat interface.
  • the mobile phone can present the project plan (word document) to the user Tom.
  • the phone can return to the state before the notification message was received.
  • a sink device may send an attachment to a source device.
  • the attachments may be files of types such as pictures, videos, audios, documents, and the like.
  • the user can complete the interaction similar to the email in the notification, which increases the convenience for the user to use the message notification forwarding, and helps to improve the user experience.
  • FIG. 7 is another set of GUIs provided by the embodiments of the present application.
  • the mobile phone receives a social App message (eg, Happy Birthday!) from user Tom.
  • the mobile phone can send this message to the laptop computer that the user is focusing on, and the laptop computer can display a message reminder box 701 .
  • the notebook computer detects that the user has clicked the operation of the message reminder box 701, the GUI as shown in (b) of FIG. 7 can be displayed.
  • the notebook computer when the notebook computer detects that the user clicks a certain position in the message reminder box, the notebook computer can display another message reminder box 702 . Compared with the message reminder box 701 , the message reminder box 702 is more in line with the display style of the PC-side social app. After detecting that the user enters the reply content (for example, Thank you!) in the input box of the message reminder box 702 and clicks the operation of the send control, the laptop computer can send the reply content of the user to the mobile phone.
  • the reply content for example, Thank you!
  • the mobile phone can automatically pull up the chat interface with the user Tom after receiving the content of the user's reply, so as to automatically complete the real reply to the message.
  • the notebook computer can continue to display the message reminder box 703 .
  • the message reminder box 703 may contain the content that the user has just replied (eg Thank you!).
  • the notebook computer can detect the reply content input by the user and, after detecting that the user clicks the send control 404, sends The reply content is sent to the mobile phone.
  • the message reminder box 401 can disappear automatically.
  • the laptop can continue to display the message alert box the next time the phone receives a message.
  • the notebook computer can keep the message after replying to the message.
  • the notebook computer detects the user's operation of closing the message reminder box 702
  • the notebook computer can close the message.
  • the message reminder box 702 further includes a scroll bar 704 .
  • the notebook computer detects that the user uses the mouse to slide the scroll bar 704 upwards, the notebook computer can request the mobile phone for the historical chat record with the user Tom. Therefore, more chat contents can be displayed through the message reminder box 703 .
  • the notification service is used to receive messages sent by the social application server. For example, when user Tom sends a message to user Lily using device A, device A first sends the content of the message and the identification information of user Lily's social application account to the social application server.
  • the social application server stores the device information (for example, Lily's device B) logged in with the user Lily's social application account.
  • the social application server may send a corresponding message to the device B of the user Lily according to the identification information of the social application account of the user Lily.
  • the notification service in device B can be used to receive messages sent by the server and information of user Tom.
  • the notification monitoring module is used to register the monitoring notification service with the system, and obtain the messages received by the notification service in real time.
  • the notification listener can obtain the notification message body, which contains the header, notification ID attribute, notification channel attribute, and message content.
  • the header is used to determine which App the notification message belongs to, the notification ID attribute and the notification channel attribute can be used to find the corresponding notification message, and the message content can include the text information of the message (for example, ( "Happy Birthday! as shown in a).
  • the notification processing module at the source end when the source end device determines that the user does not currently focus on the source end device and the message is a message that can be forwarded to other electronic devices, it adds a "quick reply" attribute to the message.
  • the source side can save a whitelist of applications.
  • the source can only forward messages across devices when it receives messages from applications in the whitelist.
  • all third-party apps that support drag and drop event response can be added to the whitelist.
  • the source side can test the application to determine whether it supports drag event response.
  • the view system in the application framework layer can send Drag and Drop events and randomly generated content to an application in the application layer when testing. After the application receives the Drag and Drop event and the randomly generated content, in response to the Drag and Drop event, it starts the application to the foreground and randomly opens the chat interface of a contact, and replies the randomly generated content to the chat interface. corresponding location. If the response can be successful, it means that the application supports the system drag event response; if the response is unsuccessful, it means that the application does not support the system drag event response.
  • the source end may also determine whether to forward the message across devices according to user settings.
  • the user may set in advance an App corresponding to a message that can be forwarded across devices. For example, the user can set the notification messages of App5 and App7 to be forwarded to other devices; while the notification messages of App4, App6, App8 and App9 are not forwarded to other devices.
  • the notification message body may include a notification ID attribute and a notification channel attribute of the notification message.
  • the notification ID attribute may be used to distinguish notification ID attributes sent by different users. For example, if a user has multiple contacts in a third-party App, the multiple contacts can be distinguished by different notification ID attributes. Table 1 shows one way of differentiation.
  • the strings in the notification channel attribute can be used to distinguish different message types.
  • Table 2 shows the correspondence between different message types and the strings in the notification channel attribute.
  • the corresponding notification message can be determined by the notification ID property and the notification channel property.
  • the user Tom and the user Amy have respectively sent two notification messages, which can be distinguished by the notification ID attribute.
  • the notification channel attribute For another example, for two notification messages of different message types sent by Tom, they can be distinguished by the notification channel attribute. Different notification messages of the same message type sent by the same user may not be distinguished, or may be distinguished by other identification information.
  • the descriptions of the notification ID attribute and the notification channel attribute may be different, and the above is only a description of the notification ID attribute and the notification channel attribute defined in some application programs, and the embodiments of the present application do not. limited to this.
  • the notification processing module on the source side can add the flag attribute of "Quick Reply" to its message body.
  • the sink side determines that the "quick reply” flag attribute is carried in the notification message body, it can add a reply control in the message reminder box.
  • the sink side detects that the user has clicked the reply control, it can display the text input box and reply control.
  • the source end sends the notification message body to the sink end, it can carry the message content and the flag attribute of "quick reply" in the notification message body.
  • the source end may further carry the notification ID attribute and/or the notification channel attribute in the notification message body.
  • the purpose of carrying the notification ID attribute and the notification channel attribute is that after the sink obtains the user's reply content to the notification message, it sends the reply content, the notification ID attribute and the notification channel attribute to the source end, so that the source end can determine that the reply content is The content of the reply to which notification message.
  • the source end may carry the notification message body in the BLE data packet and send it to the sink end.
  • the BLE data packet includes a protocol data unit (PDU), and the notification message body may be carried in the service data (service data) field in the PDU, or may also be carried in the manufacturer specific data (manufacturer specific data) in the PDU. ) field.
  • the payload of the service data field may include multiple bits, wherein the multiple bits include scalable bits.
  • the sink side and the source side can agree on the content of an extensible bit.
  • the source end can use GBK, ISO8859-1 and other encoding methods to encode the notification message body, and carry the encoded information on one or more scalable bits.
  • Notification processing module on the sink side After the notification processing module on the sink side receives the notification message body, it can parse the notification message body to obtain the content of the notification message and the flag attribute of the "quick reply". Exemplarily, if the source end carries the notification message body in the BLE data packet and sends it to the sink end, after receiving the BLE data packet, the sink end can decode it in a corresponding decoding manner to obtain the notification message body.
  • Notification UI adaptation module After the notification processing module on the sink side recognizes the "quick reply” flag attribute of the notification, it notifies the UI adaptation module to adapt to the system interface corresponding to each system for the sink side of different operating systems, and supports “quick reply” "input boxes, UI rendering, and user interaction responses, etc.
  • the sink end can provide notificationManager, so as to realize the drawing of the message reminder box, wherein the message reminder box includes the notification content in the notification message body, the reply control drawn by the notificationManager, etc. .
  • the tablet may display a reply control 302 in the message reminder box.
  • the tablet after detecting that the user clicks on the control 302 , the tablet can display an input box 303 and a sending control 304 .
  • the sink side When the sink side detects that the user has entered the reply content and clicks the send control, the content input by the user can be obtained through the callback interface getResultsFromIntent(). getResultsFromIntent() can establish the relationship between the sending control and the text input box.
  • getResultsFromIntent() can establish the relationship between the sending control and the text input box.
  • the sink side detects that the user clicks the reply control, it will trigger the sink side to obtain the content of the text input box.
  • a callback interface can be registered on different systems, so that when the sink detects the user's reply content, the notification processing module obtains the user's reply content through the callback interface. After the sink side detects that the user has entered the reply content in the input box and detects that the user clicks the send control, it can trigger to send the user's reply content to the source side.
  • the event processing module on the sink side when it is recognized that the user replies to a notification message, the action response event and the content of the user's reply are packaged together into a notification message body.
  • the notification message body can use the same encapsulation format as the notification message sent by the source end to the sink end, so that the source end can parse it.
  • the sink end may carry the notification message body in the BLE data packet and send it to the source end.
  • the BLE data packet includes a PDU
  • the notification message body may be carried in a service data field in the PDU, or may also be carried in a vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, wherein the multiple bits include scalable bits.
  • the sink side and the source side can agree on the content of an extensible bit.
  • the sink end can use GBK, ISO8859-1 and other encoding methods to encode the notification message body, and carry the encoded information on one or more scalable bits.
  • the sink can carry the notification ID attribute, the notification channel attribute, the action response event and the user reply in the notification message. Content. If the notification message body sent by the source end to the sink end does not carry the notification ID attribute and the notification channel attribute, the notification message body sent by the sink end to the source end may not carry the notification ID attribute and the notification channel attribute.
  • Event processing module on the source side parses the notification message body sent by the sink side, and obtains the action response event, notification ID attribute, notification channel attribute, and user reply content.
  • the source side can determine that the sink side has responded to the notification message through the action response event. ; Determine which notification message is replied to by the notification ID property and notification channel property. Then complete the real reply to the notification message through the following process.
  • the source side is in the locked screen state, it can be handled in the following ways.
  • the source can first determine which App the reply content is for according to the header of the notification message body. If the App provides an application programming interface (API) to reply to the message, then the App can directly complete the real reply to the notification message through the API provided by the App after obtaining the content of the user's reply. Exemplarily, for the short message application, it provides the API "sendTextMessage" which can be used to notify the real reply of the message. After obtaining the reply content, the source end can first determine that the reply content is the reply content for the short message application through the packet header of the notification message body. Since the short message provides an API for replying to the notification message, the source side can determine which notification message it is to reply to through the notification ID attribute and the notification channel attribute, and then the source side can directly complete the real reply to the notification message through "sendTextMessage".
  • API application programming interface
  • the process of message reply is implemented inside the source end, and the process is indifferent to the user. If the App does not provide an API to reply to messages, the App can use Method 2 or Method 3 to complete the reply by dragging events.
  • the source side can directly load the corresponding display interface on the lock screen interface. For example, WeChat's voice call request, video call request, etc., are directly displayed on the lock screen interface. Then go to step (2), complete the reply of the message by dragging the event.
  • the reply method of the third method can also be called a cross-device unlocking scheme.
  • the sink terminal can complete the collection of user identity authentication information.
  • the sink terminal can obtain the password information used by the user to unlock the source terminal, such as digital password, fingerprint password, iris information, facial features, etc. information.
  • the sink terminal can carry the password information in the notification message body and send it to the source terminal, so that the source terminal can determine whether to unlock the device. If the source side determines to unlock according to the password information, then the source side can unlock first, enter the non-lock screen state, and then go to step (2) to complete the message reply by dragging the event.
  • the source side can determine that the sink side detects the operation of the user's reply to the notification message.
  • the source side can determine the corresponding App according to the packet header of the notification message body and start the App to the foreground, and find the corresponding notification message through the notification ID attribute and the notification channel attribute.
  • the view system on the source side can send Drag and Drop events and reply content to the corresponding App.
  • the App pulls up the chat interface of a specific contact through the PendingIntent in the notification message, thereby replying to the notification message. At this point, the real reply to the notification message is completed.
  • the view system can also send the content attribute of the reply content to the corresponding App.
  • the content attribute can be used to indicate the type of reply content (for example, text, picture, voice, etc.). , videos, documents, etc.).
  • the App can notify the 3D graphics processing library (OpenGL ES) to draw different display interfaces according to the type of the reply content. For example, for text content, after pulling up the chat interface of a specific contact, the text content can be directly displayed at the position of the reply.
  • OpenGL ES 3D graphics processing library
  • the duration of the voice and the control for answering the voice can be displayed (when the source terminal detects the operation of the user clicking the control, the content of the voice can be played. ).
  • the first frame image in the video can be displayed and the play control can be displayed (when the source terminal clicks the play control, the content of the video can be played).
  • the source end After the source end completes the reply, by hiding the interface of the App, it can return to the display interface before starting the social interaction. If the screen of the source is locked originally, lock the screen of the device again. By restoring the original state of the device, the user can be unaware of the quick reply function, which can further improve the user experience.
  • the sink end may further include a voice module.
  • a voice module may be included on the vehicle machine. After the mobile phone sends the received message to the car machine, the car machine can convert the text information corresponding to the message into voice information through the voice module, and remind the user of the message by means of a voice reminder.
  • the microphone on the sink side can obtain the content of the user's voice reply by picking up sounds.
  • the sink side can encapsulate the content of the user's voice reply into the notification message body and send it to the source side.
  • the voice module can also convert the content of the user's voice reply into text information and send it to the source.
  • the voice module may not convert the content of the user's voice reply into text information, but directly carry the content of the user's voice reply in the notification message body. Therefore, the source terminal determines whether to convert the content of the voice reply into text information.
  • the sink terminal may also support the function of replying to attachments.
  • the user can send the attachment (project plan) to the user Lily on the laptop.
  • the information of the attachment can be carried in the notification message body.
  • the sink side may also carry the path information of the attachment on the sink side in the notification message body.
  • the source side can request the sink side for the attachment under the path. The sink side thus sends the attachment to the source side through the network transmission channel.
  • BLE data packets may also be used when the sink end sends the content or file of the user's voice reply to the source end.
  • the sink end sends the content or file of the user's voice reply to the source end.
  • the notebook computer when the notebook computer detects that the user clicks on the message reminder box 701 , the notebook computer can send a request to the mobile phone, and the request is used to request configuration information of interface elements.
  • the request may be carried in a BLE data packet and sent to the mobile phone.
  • the BLE data packet includes a PDU
  • the request may be carried in a service data field in the PDU, or may also be carried in a vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, wherein the multiple bits include scalable bits.
  • Cell phones and laptops can agree on a scalable bit of content.
  • when a certain extensible bit is "1", it indicates that the configuration information of the interface element is requested.
  • the source side (for example, a mobile phone) can determine one or more UI interface elements by means of an integrated development environment (IDE) tool, and generate an extensible markup language (XML) file.
  • IDE integrated development environment
  • XML extensible markup language
  • the XML file includes: UI interface background, source-side UI elements, size of UI elements (for example, the UI elements displayed on the sink side are twice as large as those of the source-side UI elements) and positions, where the UI element positions may include UI elements The direction relationship between adding controls and text input boxes on the sink side.
  • FIG. 9 shows the chat interface displayed on the source end, the source end can intercept UI element 901 on the chat interface, and the source end can also determine the background (for example, white) of the chat interface drawn on the sink end. , as well as controls added on the sink side (for example, send controls) and the positions of text input boxes and UI elements.
  • a text input box can be centered directly below a UI element, and a send control can be positioned below and to the right of a UI element.
  • the source end can carry the XML file in the BLE data packet and send it to the sink end.
  • the request may be carried in the service data field in the PDU, or may also be carried in the vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, wherein the multiple bits include scalable bits.
  • the source end can use a corresponding encoding technology to encode the XML file, and carry the encoded information on one or more extensible bits.
  • the sink end can obtain the XML file by decoding the information on the corresponding bits.
  • the sink side can restore the interface according to the XML file.
  • the sink end can draw the UI interface according to the UI interface background, the size and position of the UI elements included in the XML file.
  • the notebook computer can draw a message reminder box 702 .
  • the notebook computer When the notebook computer detects that the user clicks the send control operation, the notebook computer can send the reply content to the mobile phone, and the mobile phone completes the real reply to the message. At this time, the notebook computer may re-request the mobile phone for a new XML file, and the mobile phone may re-send the new XML file to the notebook computer, wherein the XML file may include the UI element 902 . Therefore, the notebook computer can draw a message reminder box as shown in (c) in FIG. 7 according to the UI element 902 in the XML file.
  • the notebook computer sends the reply content to the mobile phone
  • the notebook computer can re-request a new XML file from the mobile phone and the specific process of the mobile phone sending the new XML file to the notebook computer can refer to the description in the above-mentioned embodiment. For brevity, here I won't go into details.
  • the laptop computer when the laptop computer detects the user slide bar 704, the laptop computer can request more UI elements from the mobile phone.
  • the mobile phone carries the UI element 903 in an XML file and sends it to the laptop.
  • the notebook computer can draw a message reminder box as shown in (d) in FIG. 7 according to the XML file.
  • the sink side can combine with the dupwight control to realize the restoration of UI elements, and this control can be combined with the local controls (eg, button control, text control, list control) of the sink side to draw the message reminder window.
  • this control can be combined with the local controls (eg, button control, text control, list control) of the sink side to draw the message reminder window.
  • Figure 10 shows the process of reproducing the source interface on the sink through audio and video capture.
  • the source end can sample the entire display interface of the source end according to a certain sampling frequency (for example, 60Hz), and encode the sampled data and the location information of the chat interface on the source end interface and send it to the sink end.
  • the sink side first decodes the data sent by the source side; the sink side trims the decoded audio and video data according to the location information of the chat interface, so as to render the image, so that the sink side can obtain the mirror image of the source side chat interface.
  • the sink side can also add a button control (for example, a send control) and a text input box.
  • a button control for example, a send control
  • FIG. 11 shows another set of GUIs provided by the embodiments of the present application.
  • the GUI is the desktop of the mobile phone.
  • the GUI includes a plurality of application icons, the plurality of application (eg, App1, App2, and App3) icons.
  • the mobile phone detects that the user clicks the icon 1101 on the desktop, it can start setting the related functions of the mobile phone, and display the GUI shown in (b) of FIG. 11 .
  • the GUI is the setting interface of the mobile phone.
  • the GUI includes multiple functional options, including wireless and network, device connection, desktop and wallpaper, sound, notification center, applications and notifications, etc., among which, users can manage permissions, default applications through applications and notifications and notification management functions.
  • the mobile phone detects that the user clicks on the application and notification function 1102, the GUI as shown in (c) of FIG. 11 is displayed.
  • the GUI is a setting interface for the application and notification function of the mobile phone.
  • the GUI includes multiple functional options for wireless and network, the multiple functional options include permission management, default applications, application avatars, and cross-device notifications.
  • the GUI shown in (d) of FIG. 11 is displayed.
  • the GUI is a setting interface for the cross-device notification function of the mobile phone.
  • the GUI includes multiple functional options under cross-device notification, including switch controls for cross-device notifications, notification types, device management, and device authorization.
  • the function description of the cross-device notification is included under the switch control of the cross-device notification: "When the notification comes, if you are using another device, forward the notification to this device".
  • the mobile phone detects that the user clicks on the notification type 1104, the mobile phone can display a GUI as shown in (e) of FIG. 11 .
  • the GUI is the notification type setting interface of the mobile phone.
  • the user can select the notification message of the application program he wishes to forward from the notification types shown in (e) of FIG. 11 .
  • the user may select the types of notification messages of App5 and App7 as notification messages to be forwarded.
  • the user can select the notification message of the application program that he or she wishes to forward through the setting option, so that the harassment caused by the unnecessary forwarding of the notification message to the user can be avoided.
  • the source before sending the notification message to the sink, determines that the sink is a device set by the user to receive the notification message and forwarded; or before sending the notification message to the second electronic device, determines the account and the account logged in on the source. The account logged in on the sink is associated with it.
  • the following describes the process of the source terminal (for example, a mobile phone) selecting the sink terminal with reference to FIG. 12 and FIG. 13 .
  • the mobile phone After the mobile phone detects that the user has clicked the device management 1201 shown in (a) of FIG. 12 , the mobile phone can display the GUI shown in (b) of FIG. 12 .
  • the GUI is a device management function display interface.
  • the device management includes my device and other devices.
  • my device is a device logged in with the same Huawei ID as my mobile phone.
  • my devices include a tablet "HUAWEI MatePad Pro", a smart watch “HUAWEI WATCH GT 2", another mobile phone “HUAWEI P40 Pro", a laptop “HUAWEI MateBook X”, and a smart speaker "HUAWEI Sound X".
  • the mobile phone selects all the above devices, the mobile phone can forward the notification message on the above devices.
  • the mobile phone may display the GUI shown in (b) of FIG. 13 .
  • the GUI is a device authorization function display interface.
  • the display interface includes options for adding devices and options for nearby devices.
  • the description of adding devices is that you can add devices under other Huawei IDs to other devices.
  • the user can add Huawei IDs of other family members in the family group, and then the devices under the Huawei IDs of other family members can appear in other devices as shown in (b) in FIG. 12 .
  • the mobile phone After the mobile phone detects the user's operation of opening the controls of the nearby device, the mobile phone can search for the nearby device and display the GUI as shown in (c) of FIG. 13 .
  • the GUI is another display interface of the device authorization function.
  • the display interface shows that the nearby devices searched by the mobile phone include iPhone 11Pro, iPad Pro 11, and Huawei Mi 10Pro.
  • the phone detects that the user clicks to add iPad Pro 11 and Huawei Mi 10Pro, the phone can add these two devices to other devices in device management.
  • the GUI is another display interface for device management. Two nearby devices, iPad Pro 11 and Huawei Mi 10 Pro, are added to the "Other Devices" on the display interface.
  • the mobile phone can search for other devices around it by means of short-distance communication such as Bluetooth and Wi-Fi.
  • short-distance communication such as Bluetooth and Wi-Fi.
  • the mobile phone can send a BLE data packet to these two devices, wherein the BLE data packet can carry the request information of the device that requests to be added as a forwarding notification message.
  • the request information may be carried on the extensible bits in the service data field.
  • the mobile phone receives responses (eg, ACK messages) from both devices, the mobile phone can successfully add the two devices to "Other Devices".
  • the iPad Pro 11 and Xiaomi Mi 10Pro the user can be prompted through a reminder box whether to agree to the addition request of the mobile phone. If the iPad Pro 11 and Xiaomi Mi 10 Pro detect the user's request to agree to add a device forwarded as a notification message, the two devices can send a response to the phone.
  • FIG. 14 shows a schematic flowchart of a method 1400 for quick reply provided by an embodiment of the present application.
  • the method 1400 may be performed by a first electronic device and a second electronic device, the first electronic device may be the source terminal in the above-mentioned FIG. 8 , and the second electronic device may be the sink in the above-mentioned FIG. 8 end, the method 1400 includes:
  • the first electronic device receives a message.
  • the first electronic device may be a mobile phone, and the mobile phone receives a message sent by the user Tom.
  • the first electronic device may be a mobile phone, and the mobile phone receives a message sent by the user Tom.
  • the messages in the embodiments of the present application may be messages sent by servers of different application programs, and the types of messages include but are not limited to text, voice, audio, video, link, sharing (for example, location sharing), invitation (for example, Invite to join a group) and so on.
  • the first electronic device When determining that the device focused by the owner of the first electronic device is the second electronic device, the first electronic device sends the message and indication information to the second electronic device, where the indication information is used to instruct the second electronic device to add Reply control for this message.
  • the indication information may be a quick reply flag attribute.
  • the first electronic device may send request information to surrounding devices, where the request information is used to request the surrounding devices to determine the first electronic device. Whether the focus of the owner of an electronic device is on the surrounding devices; alternatively, the first electronic device may also store a list of devices to which messages are forwarded. When the first electronic device determines that the focus of the owner of the first electronic device is not on the first electronic device , the first electronic device may send request information to the devices in the device list.
  • the second electronic device is an electronic device in the device list of the first electronic device and the user characteristics of the owner of the first electronic device (for example, the second electronic device and the first electronic device) are stored in the second electronic device If the devices are two devices under the same user (login to the same Huawei ID), the same user characteristics (for example, fingerprint information, face information, voiceprint information, iris information, etc.) can be stored in the first electronic device and the second electronic device. etc.)), the first electronic device may send the request information to the second electronic device through a server or by means of short-range communication. After receiving the request information sent by the first electronic device, the second electronic device may collect user characteristics and determine whether the user characteristics match the preset user characteristics of the owner of the first electronic device. If it matches, sending response information to the first electronic device, where the response information is used to indicate that the owner of the first electronic device is focusing on the second electronic device. After receiving the response information, the second electronic device may send the message to the second electronic device.
  • the user characteristics of the owner of the first electronic device for example,
  • the request information may be carried in a BLE data packet.
  • the BLE data packet includes a PDU, and the request information may be carried in a service data field in the PDU, or may also be carried in a vendor-specific data field in the PDU.
  • the payload of the service data field may include multiple bits, wherein the multiple bits include scalable bits.
  • the first electronic device and the second electronic device may agree on a certain bit in advance to transmit the request information. When this extensible bit is a preset value (eg, 1), the second electronic device can know that the first electronic device requests it to determine whether the user focuses on the device.
  • the first electronic device may save the priority of focus device determination.
  • the prioritization may be:
  • the visual focus device can be a device with a camera, such as a smart TV, a tablet computer, a notebook computer, etc.; the personal device can be a user's wearable device, such as VR/AR glasses, smart watches, smart bracelets, etc. etc.; the interactive device may be a device with input manipulation, for example, a device with keyboard, mouse, touch, remote control, voice input, etc.
  • the first electronic device may send request information to the devices in the device list.
  • the first electronic device may send the request information according to the priority of the devices.
  • the mobile phone can first send request information to the smart TV (which stores the face information of the owner of the first electronic device) , the request information is used to request the smart TV to determine whether the current focus of the owner of the first electronic device is on the smart TV.
  • the smart TV can judge whether the focus of the owner of the mobile phone is on the smart TV by turning on the camera. If the smart TV determines that the current focus device of the owner of the mobile phone is on the smart TV through the face information collected by the camera and the preset face information, the smart TV can send a response to the mobile phone, and the response is used to indicate the owner of the mobile phone.
  • the current focus is on smart TVs.
  • the mobile phone can no longer send request information to other devices in the device list. If the mobile phone does not receive a response from the smart TV within a preset period of time (or the mobile phone receives a response sent by the smart TV, the response indicates that the current focus of the owner of the mobile phone is not on the smart TV), then the mobile phone can continue to the smart watch ( save the heart rate information of the owner of the first electronic device) to send request information. After receiving the request information sent by the mobile phone, the smart watch can detect whether the owner of the mobile phone is wearing a wearable device based on the sensor.
  • the photoplethysmograph (PPG) sensor in the smart watch can determine whether the owner of the first electronic device is wearing the smart watch through the detected heart rate information and the preset heart rate information. If the smart watch determines that the owner of the mobile phone is wearing the smart watch, the smart watch can send a response to the mobile phone, where the response is used to indicate that the owner of the mobile phone is currently wearing the smart watch.
  • PPG photoplethysmograph
  • the first electronic device When the first electronic device sends the request information to the devices in the device list, it may also send the request information to multiple devices in the device list at the same time.
  • the mobile phone may first send request information to the smart TV and the smart watch at the same time. If the phone only receives a response from the smart TV directly, the phone can forward the message to the smart TV; or, if the phone only receives a response from the smartwatch, the phone can forward the message to the smartwatch; or, if the phone receives a smartwatch The response of the TV and smartwatch, then the phone can forward the message to the smart TV based on the device's priority.
  • the response information may be carried in the service data field or the vendor-specific data field of the PDU in the BLE data packet.
  • the response information may be carried in an extensible bit in the payload of the service data field.
  • the first electronic device and the second electronic device may predetermine a certain extensible bit to transmit the response information.
  • the expandable bit is a preset value (for example, 1), it means that the second electronic device determines that the device focused by the user is the second electronic device.
  • the second electronic device is an electronic device in the device list of the first electronic device and the user characteristics of the owner of the first electronic device are not stored in the second electronic device, or if there is no device in the first electronic device In the list, the second electronic device is a device around the first electronic device. Then, when the first electronic device determines that the owner of the first electronic device is not focused on the first electronic device, it can send the request information to the second electronic device; after receiving the request information, the second electronic device can send the request information through the user
  • the feature collection device collects user features, and sends the collected user features to the first electronic device.
  • the first electronic device may send the message to the second electronic device when it is determined that the user characteristic collected by the second electronic device matches the user characteristic preset in the first electronic device.
  • the second electronic device receives the request information. Afterwards, the user's characteristics can also be collected and sent to the first electronic device, so that the first electronic device can determine whether the owner of the first electronic device is the owner of the first electronic device according to the user's characteristics collected by the second electronic device and the preset user characteristics. Focus on the second electronic device.
  • the user feature sent by the second electronic device to the first electronic device may be carried in a service data field or a vendor-specific field in the PDU.
  • the second electronic device includes a camera. After receiving the request information, the second electronic device can collect face information through a camera and send it to the first electronic device. The first electronic device determines whether it is the user himself according to the face information. For example, the first electronic device can match the face information collected by the second electronic device with the face information preset in the first electronic device. If the matching is successful, it is determined that the owner of the first electronic device is currently focusing on the first electronic device. Two electronic equipment.
  • the second electronic device includes a microphone, and after receiving the request information, the second electronic device can collect the voice information sent by the user through the microphone and send it to the first electronic device.
  • the first electronic device determines whether it is the user himself according to the voice information.
  • the first electronic device can extract voiceprint information from the voice information collected by the second electronic device, and the first electronic device matches the extracted voiceprint information with the voiceprint information preset in the first electronic device. If the matching is successful , it is determined that the user is currently focusing on the second electronic device.
  • the second electronic device may send the user characteristics collected by the second electronic device to the first electronic device, so that The first electronic device can be made to determine whether the second electronic device is the device focused by the owner of the first electronic device according to the received user characteristics and the preset user characteristics. This helps to improve the security of message forwarding, avoids the leakage of user privacy, and thus helps to improve user experience.
  • the second electronic device displays a message reminder box, where the message reminder box includes the message and the reply control.
  • the second electronic device may be a tablet.
  • a message reminder box 301 can be displayed, wherein the message reminder box 301 includes a message "Happy Birthday!” and a reply control 302 .
  • the second electronic device may be a notebook computer.
  • a message reminder box 601 can be displayed, wherein the message reminder box 601 includes the message "Please send me the project plan" and a reply control 602 .
  • the second electronic device sends the reply content to the first electronic device when detecting an operation by the user to reply to the message.
  • the tablet can send the reply content in the text input box 303 to the mobile phone.
  • the laptop computer can send the reply content in the text input box 404 to the mobile phone.
  • the first electronic device replies to the message according to the reply content.
  • the mobile phone may first open the social app, and then open the chat with the user Tom. interface, and finally drag the reply content "Thank you!” to the position where you reply to the message "Happy Birthday!.
  • the method 1100 further includes: the first electronic device sends the identification information of the message to the second electronic device; when the second electronic device detects the user's operation of replying to the message, sending the message to the second electronic device The content of the reply after being identified by the identification information.
  • the message body sent by the first electronic device to the second electronic device may carry the content of the message, the indication information, and the identification information of the message.
  • the identification information may be a notification ID attribute and/or a notification channel attribute of the message.
  • the mobile phone receives two messages (message 1 is from Tom, and message 2 is from Amy). At this time, the mobile phone sends the message 1 identified by the identification information 1, the message 2 identified by the identification information 2, and the indication information to the notebook computer.
  • the notebook computer can display the message reminder box 401 and the message reminder box 402 .
  • the notebook computer may send the reply content (for example, "Thank you!”) to the mobile phone after being identified by the identification information 1.
  • the mobile phone can make it clear which message the reply content sent by the laptop computer is a reply to.
  • the first electronic device when the first electronic device receives multiple messages, the first electronic device can identify the multiple messages, so that the first electronic device can distinguish the reply content sent by the second electronic device, thereby The first electronic device can accurately reply to multiple messages.
  • the method further includes: before the first electronic device receives the message, displaying the first interface; and after the first electronic device replies to the message, displaying the first interface.
  • the first electronic device after the first electronic device receives the reply content sent by the second electronic device, it can complete the real reply to the message. After the reply is complete, you can continue to display the status before the message was received. By restoring the original state of the first electronic device, the user is made unaware of the quick reply function, which can further improve the user's experience.
  • the content of the message is text information
  • the second electronic device includes a voice function
  • the second electronic device prompts the user of the text information by voice.
  • the car device includes a voice function, and after receiving the message sent by the mobile phone, the car device can also prompt the user for the text information through voice.
  • the car machine prompts the user through voice "Tom sent you Happy Birthday!” through the social app.
  • the car machine can prompt the user with the content of the message by means of voice broadcast, which can prevent the user from being distracted by viewing the message, thereby helping the user. Improve user driving safety.
  • the second electronic device collects the voice information replied by the user; the second electronic device sends the voice information to the first electronic device, or the second electronic device sends the voice information to the first electronic device Text information corresponding to the voice information.
  • the user replies with the voice message "Thank you!”.
  • the car machine may send the voice information to the mobile phone, or the car machine may also send text information corresponding to the voice information to the mobile phone.
  • the second electronic device can also send the voice information to the first electronic device; the first electronic device can reply to the message according to the voice information; or the first electronic device can reply to the message according to the voice information Corresponding text information, reply to the message.
  • the reply content is a file.
  • the laptop computer can send the word file to the mobile phone.
  • the file may also be a multimedia file, such as photos, videos, audios, and so on.
  • the user can directly reply to the message on the second electronic device without returning to the first electronic device to process the message.
  • the user can be prevented from missing important information, and at the same time, the process of the user returning to the first electronic device for message processing can be avoided, which is helpful to improve the user's experience.
  • FIG. 15 shows a schematic block diagram of an apparatus 1500 for replying to a message provided by an embodiment of the present application.
  • the apparatus 1500 can be set in the above-mentioned first electronic device, and the apparatus 1500 includes: a first receiving unit 1510, configured to receive a message; and a sending unit 1520, configured to determine that the device focused by the owner of the first electronic device is When the second electronic device is used, the message and the indication information are sent to the second electronic device, and the indication information is used to instruct the second electronic device to add a reply control to the message; the second receiving unit 1530 is further configured to receive the first electronic device.
  • the content of the reply to the message sent by the second electronic device; the reply unit 1540 is configured to reply to the message according to the content of the reply.
  • FIG. 16 shows a schematic block diagram of an apparatus 1600 for replying to a message provided by an embodiment of the present application.
  • the apparatus 1600 may be set in the above-mentioned second electronic device, and the apparatus 1600 includes: a receiving unit 1610, configured to receive a message and indication information sent by the first electronic device, where the indication information is used to instruct the second electronic device to add a pair of A reply control for the message; the display unit 1620 is used to display a message reminder box, the message reminder box includes the message and the reply control; the sending unit 1630 is used to detect the user's operation of replying to the message, to send The first electronic device sends the reply content.
  • a receiving unit 1610 configured to receive a message and indication information sent by the first electronic device, where the indication information is used to instruct the second electronic device to add a pair of A reply control for the message
  • the display unit 1620 is used to display a message reminder box, the message reminder box includes the message and the reply control
  • the sending unit 1630 is used to detect the user's
  • FIG. 17 shows a schematic structural diagram of an electronic device 1700 provided by an embodiment of the present application.
  • the electronic device includes: one or more processors 1710, one or more memories 17220, and the one or more memory stores 1720 store one or more computer programs, the one or more computer programs Include instructions.
  • the instruction is executed by the one or more processors 1710
  • the first electronic device is made to execute the technical solutions in the above embodiments; or, when the instruction is executed by the one or more processors 1710, the first electronic device is made
  • the second electronic device implements the technical solutions in the above embodiments.
  • the implementation principle and technical effect thereof are similar to the related embodiments of the above method, and are not repeated here.
  • An embodiment of the present application provides a system for replying to a message, including a first electronic device and a second electronic device, and the system is configured to execute the technical solution for replying to a message in the foregoing embodiment.
  • the implementation principle and technical effect thereof are similar to the related embodiments of the above method, and are not repeated here.
  • the embodiments of the present application provide a computer program product, which enables the first electronic device to execute the technical solutions in the foregoing embodiments when the computer program product runs on a first electronic device; or, when the computer program product is executed on a second electronic device When the electronic device is running, the second electronic device is caused to execute the technical solutions in the foregoing embodiments.
  • the implementation principle and technical effect thereof are similar to the related embodiments of the above method, and are not repeated here.
  • An embodiment of the present application provides a readable storage medium, where the readable storage medium contains instructions, when the instructions are executed on a first electronic device, the first electronic device is caused to execute the technical solutions of the foregoing embodiments; or, When the instruction is executed on the second electronic device, the second electronic device is caused to execute the technical solutions of the foregoing embodiments.
  • the implementation principle and technical effect thereof are similar, and are not repeated here.
  • An embodiment of the present application provides a chip, which is used for executing an instruction, and when the chip is running, executes the technical solutions in the foregoing embodiments.
  • the implementation principle and technical effect thereof are similar, and are not repeated here.
  • the disclosed system, apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-readable storage medium.
  • the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution.
  • the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephone Function (AREA)

Abstract

本申请提供了回复消息的方法、电子设备和系统，该方法包括：第一电子设备接收消息；该第一电子设备在确定该第一电子设备的机主聚焦的设备为该第二电子设备时，向该第二电子设备发送该消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；该第二电子设备显示消息提醒框，该消息提醒框中包括该消息以及该回复控件；该第二电子设备在检测到用户对该消息进行回复的操作时，向该第一电子设备发送回复内容；该第一电子设备根据该回复内容，对该消息进行回复。本申请实施例，有助于提升多设备下的协同能力，有助于避免用户错过重要的消息，从而提升用户的体验。

Description

一种回复消息的方法、电子设备和系统
本申请要求于2020年08月20日提交中国专利局、申请号为202010844642.5、申请名称为“一种回复消息的方法、电子设备和系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端领域，并且更具体地，涉及一种回复消息的方法、电子设备和系统。
背景技术
随着智能设备的普及，用户往往同时使用(或佩戴)多个智能设备，形成了一个以手机为中心的个人设备集合。在日常生活、办公等环境中，为了避免遗漏手机端重要的通知消息，人们经常将社交通讯类消息(如微信、QQ、会议提醒、闹钟等)实时同步到其他设备上。当有通知消息来的时候，同步的设备端通过振动、响铃等方式提醒用户，用户进而根据消息提醒，决定是否及时回到手机侧处理消息。
智能设备有很多具有通知消息的跨设备同步功能，比如苹果的iMessage、微软的Your Phone等程序服务。这些同步方案都有一个共同的特点，他们要求在多个设备上登陆同一账号的应用程序(application，App)，然后通过服务器端控制消息的下发，从而将消息送到不同的设备客户端，实现通知消息的跨设备同步。若接收设备没有登录同一账号的App或者接收设备没有安装该App，那么接收设备无法从服务器获取到消息，这样会让用户错过一些重要的信息，从而影响用户体验。
发明内容
本申请提供一种回复消息的方法、电子设备和系统，有助于提升多设备下的协同能力，有助于避免用户错过重要的消息，从而提升用户的体验。
第一方面，提供了一种系统，该系统包括第一电子设备和第二电子设备，该第一电子设备，用于接收消息；该第一电子设备，还用于在确定该第一电子设备的机主聚焦的设备为该第二电子设备时，向该第二电子设备发送该消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；该第二电子设备，用于显示消息提醒框，该消息提醒框中包括该消息以及该回复控件；该第二电子设备，还用于在检测到用户对该消息进行回复的操作时，向该第一电子设备发送回复内容；该第一电子设备，还用于根据该回复内容，对该消息进行回复。
本申请实施例中，第一电子设备在确定第一电子设备的机主聚焦的设备不是第一电子设备而是第二电子设备时，第一电子设备可以向第二电子设备发送消息以及指示信息，从而第二电子设备可以向用户呈现包括该消息以及回复控件的消息提醒框。这样可以方便第一电子设备的机主在第二电子设备上完成对该消息的虚拟回复。第二电子设备可以将回复 内容发送给第一电子设备，从而第一电子设备对该消息完成真实回复。这样有助于用户及时接收到消息的提醒并完成对该消息的回复，避免了用户回到第一电子设备上对该消息进行回复的过程，也避免用户错过重要的消息。
在一些可能的实现方式中，该第二电子设备可以为第一电子设备中设备列表中的设备；或者，第二电子设备也可以是第一电子设备周围的设备。
在一些可能的实现方式中，该第一电子设备，具体用于根据该回复内容以及该消息对应的应用程序提供的API，对该消息进行回复；或者，根据该回复内容以及拖拽事件，对该消息进行回复。
在一些可能的实现方式中，该指示信息可以为快捷回复flag属性。
结合第一方面，在第一方面的某些实现方式中，该第一电子设备具体用于：向该第二电子设备发送经过标识信息标识后的该消息；该第二电子设备具体用于：向该第一电子设备发送经过该标识信息标识后的该回复内容。
本申请实施例中，第一电子设备可以向第二电子设备发送经过标识信息标识后的消息，这样第二电子设备在获取用户的回复内容时，可以使用该标识信息对该消息进行标识，使得第一电子设备明确该回复内容是针对哪一条消息的回复内容。在第一电子设备接收到多条消息的情况下，有助于提升第一电子设备进行消息回复时的准确性。
在一些可能的实现方式中，该标识信息可以为通知ID属性和/或通知channel属性。
结合第一方面，在第一方面的某些实现方式中，该第一电子设备，还用于在接收该消息之前，显示第一界面；在对该消息进行回复之后，显示该第一界面。
本申请实施例中，第一电子设备在完成对消息的真实回复后可以恢复到接收该消息前的显示界面，使得第一电子设备对消息的真实回复过程对用户无感，有助于提升用户的体验。
结合第一方面，在第一方面的某些实现方式中，该消息的内容为文本信息，该第二电子设备包括语音功能，该第二电子设备还用于：在接收到该消息后，通过语音向用户提示该文本信息。
本申请实施例中，对于具备语音功能的第二电子设备，当第二电子设备接收到第一电子设备的消息为文本类消息时，第二电子设备可以通过语音提示用户接收到该消息或者提示用户该消息的内容。这样避免了用户通过查看第二电子设备的屏幕，通过语音提示就可以获知消息的提示，避免用户错过重要的消息，从而提升了用户的体验。
在一些可能的实现方式中，该第二电子设备为车机或者智能音箱。
结合第一方面，在第一方面的某些实现方式中，该第二电子设备具体用于：在向该第一电子设备发送该回复内容之前，采集用户回复的语音信息；向该第一电子设备发送该语音信息，或者，向该第一电子设备发送该语音信号对应的文本信息。
在一些可能的实现方式中，若第二电子设备向第一电子设备发送采集的语音信息，那么第一电子设备可以向该消息回复该语音信息，或者也可以向该消息回复该语音信息对应的文本信息。
结合第一方面，在第一方面的某些实现方式中，该回复内容包括文件。
本申请实施例中，用户可以在第二电子设备上回复多媒体文件(例如图片、视频)、工作类文件(例如，word文档或者excel文档等等)，这样有助于增加用户回复内容的 多样性，从而有助于提升用户回复消息时的体验。
结合第一方面，在第一方面的某些实现方式中，该第一电子设备还用于：在向该第二电子设备发送该消息和该指示信息之前，确定该消息的类型为用户设置的消息类型；或者，在向该第二电子设备发送该消息和该指示信息之前，确定该消息为即时通讯IM类的消息。
本申请实施例中，第一电子设备在向第二电子设备转发消息之前，可以先确定消息为用户设置的消息类型或者为IM类消息，这样有助于避免一些不重要的消息也转发给第二电子设备，从而避免了这些不重要的消息对用户造成的干扰，有助于提升用户的体验。
结合第一方面，在第一方面的某些实现方式中，该第一电子设备还用于：在向该第二电子设备发送该消息和该指示信息之前，确定该第二电子设备为用户设置的接收消息转发的设备；或者在向该第二电子设备发送该消息和该指示信息之前，确定该第一电子设备上登录的账号和该第二电子设备上登录的账号相关联。
本申请实施例中，第一电子设备在向第二电子设备转发消息之前，可以先确定第二电子设备为用户设置的接收消息转发的设备或者确定第一电子设备上登录的账号和第二电子设备上登录的账号相关联，这样有助于避免消息转发给用户未授权的设备，提升了消息转发的安全性，避免了用户隐私的泄露，从而有助于提升用户的体验。
结合第一方面，在第一方面的某些实现方式中，该第一电子设备具体用于：在确定该第一电子设备的机主当前聚焦的设备不是该第一电子设备时，向该第二电子设备发送请求信息，该请求信息用于请求该第二电子设备确定该第一电子设备的机主是否聚焦该第二电子设备；该第二电子设备，还用于根据该请求信息，向该第一电子设备发送响应信息，该响应信息用于指示该第一电子设备的机主当前聚焦的设备为该第二电子设备；该第一电子设备具体用于：响应于接收到该响应信息，向该第二电子设备发送该消息。
本申请实施例中，第二电子设备可以是第一电子设备的消息转发列表中的设备且第一电子设备可以和第二电子设备为同一账号下的设备(或者，第一电子设备和第二电子设备可以保存同一用户的信息)，这样第二电子设备在接收到该请求信息后，可以通过采集用户特征并与第二电子设备中预置的用户特征进行匹配，若匹配成功则确定第一电子设备的机主当前聚焦的设备为第二电子设备，从而向第一电子设备发送响应信息。这样有助于提升消息转发的安全性，避免了除第一电子设备的机主以外的其他用户接收到该消息的提示，从而有助于提升用户的体验。
在一些可能的实现方式中，该第二电子设备在接收到该请求信息后，可以先判断第一电子设备与第二电子设备是否为同一账号下的设备。若第二电子设备确定第一电子设备和第二电子设备为同一账号下的设备，那么第二电子设备可以通过用户特征采集装置来采集聚焦第二电子设备的用户的特征信息，并采集到的用户特征信息与第二电子设备中预置的用户特征信息匹配，如果匹配成功，则向第一电子设备发送该响应信息。
结合第一方面，在第一方面的某些实现方式中，该第二电子设备包括用户特征采集装置，该第一电子设备具体用于：在确定该第一电子设备的机主当前聚焦的设备不是该第一电子设备时，向该第二电子设备发送请求信息，该请求信息用于请求该第二电子设备确定该第一电子设备的机主是否聚焦该第二电子设备；该第二电子设备还用于：根据该请求信息，通过该用户特征采集装置采集用户特征并向该第一电子设备发送该用户特征；该第一电子设备具体用于：在向该第二电子设备发送该消息之前，确定该用户特征与该第一电子 设备中预置用户特征匹配。
本申请实施例中，第二电子设备可以是第一电子设备的消息转发列表中的设备且第一电子设备可以和第二电子设备不是同一账号下的设备(或者，第一电子设备和第二电子设备可以保存不同用户的信息)；或者，第二电子设备也可以是第一电子设备周围的设备。这样第二电子设备在接收到该请求信息后，可以通过用户特征采集装置来采集正在聚焦第二电子设备的用户的特征信息并向第一电子设备发送该特征信息。第一电子设备根据该特征信息与第一电子设备中预置的用户特征信息匹配，若匹配成功则向第二电子设备转发该消息。这样有助于提升消息转发的安全性，避免了除第一电子设备的机主以外的其他用户接收到该消息的提示，从而有助于提升用户的体验。
结合第一方面，在第一方面的某些实现方式中，该消息为第一应用程序的消息，该第二电子设备为未安装该第一应用程序的设备。
本申请实施例中，如果第二电子设备为未安装第一应用程序的设备，那么第二电子设备也可以在接收到该指示信息后，通过在消息提醒框中增加回复控件，使得第二电子设备可以通过用户输入的回复内容以及检测到的点击回复控件的操作来获取用户回复的内容，并向第一电子设备发送该回复的内容。从而在第一电子设备上完成消息的真实回复。这样有助于用户及时接收到消息的提醒，避免用户错过重要的消息，从而有助于提升用户的体验。
第二方面，提供了一种回复消息的方法，该方法应用于第一电子设备，该方法包括：该第一电子设备接收消息；在确定该第一电子设备的机主聚焦的设备为第二电子设备时，该第一电子设备向该第二电子设备发送该消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；该第一电子设备接收该第二电子设备发送的对该消息的回复内容；该第一电子设备根据该回复内容，对该消息进行回复。
本申请实施例中，第一电子设备在确定第一电子设备的机主聚焦的设备不是第一电子设备而是第二电子设备时，第一电子设备可以向第二电子设备发送消息以及指示信息，从而第二电子设备可以向用户呈现包括该消息以及回复控件的消息提醒框。这样可以方便第一电子设备的机主在第二电子设备上完成对该消息的虚拟回复。第二电子设备可以将回复内容发送给第一电子设备，从而第一电子设备对该消息完成真实回复。这样有助于用户及时接收到消息的提醒并完成对该消息的回复，避免了用户回到第一电子设备上对该消息进行回复的过程，避免用户错过重要的消息。
结合第二方面，在第二方面的某些实现方式中，该第一电子设备向该第二电子设备发送该消息，包括：该第一电子设备向该第二电子设备发送经过标识信息标识后的该消息；
其中，该第一电子设备接收该第二电子设备发送的对该消息的回复内容，包括：该第一电子设备接收该第二电子设备发送的经过该标识信息标识后的该回复内容。
本申请实施例中，第一电子设备可以向第二电子设备发送经过标识信息标识后的消息，这样第二电子设备在获取用户的回复内容时，可以使用该标识信息对该消息进行标识，使得第一电子设备明确该回复内容是针对哪一条消息的回复内容。在第一电子设备接收到多条消息的情况下，有助于提升第一电子设备进行消息回复时的准确性。
在一些可能的实现方式中，该标识信息可以为通知ID属性和/或通知channel属性。
结合第二方面，在第二方面的某些实现方式中，该方法还包括：在接收该消息之前， 该第一电子设备显示第一界面；在对该消息进行回复之后，该第一电子设备显示该第一界面。
本申请实施例中，第一电子设备在完成对消息的真实回复后可以恢复到接收该消息前的显示界面，使得第一电子设备对消息的真实回复过程对用户无感，有助于提升用户的体验。
结合第二方面，在第二方面的某些实现方式中，该回复内容为语音信息，或者，该回复内容为该语音信息对应的文本信息；其中，该语音信息为第二电子设备采集的用户回复的语音信息。
本申请实施例中，对于具备语音功能的第二电子设备，当第二电子设备接收到第一电子设备的消息为文本类消息时，第二电子设备可以通过语音提示用户接收到该消息或者提示用户该消息的内容。这样避免了用户通过查看第二电子设备的屏幕，通过语音提示就可以获知消息的提示，避免用户错过重要的消息，从而提升了用户的体验。
在一些可能的实现方式中，该第二电子设备为车机或者智能音箱。
结合第二方面，在第二方面的某些实现方式中，该回复内容为文件。
本申请实施例中，用户可以在第二电子设备上回复多媒体文件(例如图片、视频)、工作类文件(例如，word文档或者excel文档等等)，这样有助于增加用户回复内容的多样性，从而有助于提升用户回复消息时的体验。
结合第二方面，在第二方面的某些实现方式中，该方法还包括：在向该第二电子设备发送该消息和该指示信息之前，该第一电子设备确定该消息的类型为用户设置的消息类型；或者，在向该第二电子设备发送该消息和该指示信息之前，该第一电子设备确定该消息为即时通讯IM类的消息。
本申请实施例中，第一电子设备在向第二电子设备转发消息之前，可以先确定消息为用户设置的消息类型或者为IM类消息，这样有助于避免一些不重要的消息也转发给第二电子设备，从而避免了这些不重要的消息对用户造成的干扰，有助于提升用户的体验。
结合第二方面，在第二方面的某些实现方式中，该方法还包括：在向该第二电子设备发送该消息和该指示信息之前，该第一电子设备确定该第二电子设备为用户设置的接收消息转发的设备；或者在向该第二电子设备发送该消息和该指示信息之前，该第一电子设备确定该第一电子设备上登录的账号和该第二电子设备上登录的账号相关联。
本申请实施例中，第一电子设备在向第二电子设备转发消息之前，可以先确定第二电子设备为用户设置的接收消息转发的设备或者确定第一电子设备上登录的账号和第二电子设备上登录的账号相关联，这样有助于避免消息转发给用户未授权的设备，提升了消息转发的安全性，避免了用户隐私的泄露，从而有助于提升用户的体验。
结合第二方面，在第二方面的某些实现方式中，该第一电子设备向该第二电子设备发送该消息和指示信息之前，该方法还包括：该第一电子设备在确定该第一电子设备的机主当前聚焦的设备不是该第一电子设备时，向该第二电子设备发送请求信息，该请求信息用于请求该第二电子设备确定该第一电子设备的机主是否聚焦该第二电子设备；该第一电子设备接收该第二电子设备发送的响应信息，该响应信息用于指示该第一电子设备的机主当前聚焦的设备为该第二电子设备。
本申请实施例中，第二电子设备可以是第一电子设备的消息转发列表中的设备且第一 电子设备可以和第二电子设备为同一账号下的设备(或者，第一电子设备和第二电子设备可以保存同一用户的信息)，这样第二电子设备在接收到该请求信息后，可以通过采集用户特征并与第二电子设备中预置的用户特征进行匹配，若匹配成功则确定第一电子设备的机主当前聚焦的设备为第二电子设备，从而向第一电子设备发送响应信息。这样有助于提升消息转发的安全性，避免了除第一电子设备的机主以外的其他用户接收到该消息的提示，从而有助于提升用户的体验。
在一些可能的实现方式中，该第二电子设备在接收到该请求信息后，可以先判断第一电子设备与第二电子设备是否为同一账号下的设备。若第二电子设备确定第一电子设备和第二电子设备为同一账号下的设备，那么第二电子设备可以通过用户特征采集装置来采集聚焦第二电子设备的用户的特征信息，并采集到的用户特征信息与第二电子设备中预置的用户特征信息匹配，如果匹配成功，则向第一电子设备发送该响应信息。
结合第二方面，在第二方面的某些实现方式中，该第二电子设备包括用户特征采集装置，该第一电子设备向该第二电子设备发送该消息和指示信息之前，该方法还包括：该第一电子设备在确定该第一电子设备的机主当前聚焦的设备不是该第一电子设备时，向该第二电子设备发送请求信息，该请求信息用于请求该第二电子设备确定该第一电子设备的机主是否聚焦该第二电子设备；该第一电子设备接收该第二电子设备发送的用户特征，该用户特征为该第二电子设备通过该用户特征采集装置采集的用户特征；该第一电子设备确定该用户特征与该第一电子设备中预置的用户特征匹配。
本申请实施例中，第二电子设备可以是第一电子设备的消息转发列表中的设备且第一电子设备可以和第二电子设备不是同一账号下的设备(或者，第一电子设备和第二电子设备可以保存不同的用户信息)；或者，第二电子设备也可以是第一电子设备周围的设备。这样第二电子设备在接收到该请求信息后，可以通过用户特征采集装置来采集正在聚焦第二电子设备的用户的特征信息并向第一电子设备发送该特征信息。第一电子设备根据该特征信息与第一电子设备中预置的用户特征信息匹配，若匹配成功则向第二电子设备转发该消息。这样有助于提升消息转发的安全性，避免了除第一电子设备的机主以外的其他用户接收到该消息的提示，从而有助于提升用户的体验。
第三方面，提供了一种回复消息的方法，该方法应用于第二电子设备，该方法包括：该第二电子设备接收第一电子设备发送的消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；该第二电子设备显示消息提醒框，该消息提醒框中包括该消息以及该回复控件；在检测到用户对该消息进行回复的操作时，该第二电子设备向该第一电子设备发送回复内容。
本申请实施例中，第一电子设备在确定第一电子设备的机主聚焦的设备不是第一电子设备而是第二电子设备时，第一电子设备可以向第二电子设备发送消息以及指示信息，从而第二电子设备可以向用户呈现包括该消息以及回复控件的消息提醒框。这样可以方便第一电子设备的机主在第二电子设备上完成对该消息的虚拟回复。第二电子设备可以将回复内容发送给第一电子设备，从而第一电子设备对该消息完成真实回复。这样有助于用户及时接收到消息的提醒并完成对该消息的回复，避免了用户回到第一电子设备上的对该消息进行回复，也避免用户错过重要的消息。
结合第三方面，在第三方面的某些实现方式中，该方法还包括：该第二电子设备接收 该第一电子设备发送的经过标识信息标识后的该消息；其中，该第二电子设备向该第一电子设备发送回复内容，包括：该第二电子设备向该第一电子设备发送经过该标识信息后的该回复内容。
本申请实施例中，第一电子设备可以向第二电子设备发送经过标识信息标识后的消息，这样第二电子设备在获取用户的回复内容时，可以使用该标识信息对该消息进行标识，使得第一电子设备明确该回复内容是针对哪一条消息的回复内容。在第一电子设备接收到多条消息的情况下，有助于提升第一电子设备进行消息回复时的准确性。
在一些可能的实现方式中，该标识信息可以为通知ID属性和/或通知channel属性。
结合第三方面，在第三方面的某些实现方式中，该消息的内容为文本信息，该第二电子设备包括语音功能，该方法还包括：在接收到该消息后，该第二电子设备通过语音向用户提示该文本信息。
本申请实施例中，对于具备语音功能的第二电子设备，当第二电子设备接收到第一电子设备的消息为文本类消息时，第二电子设备可以通过语音提示用户接收到该消息或者提示用户该消息的内容。这样避免了用户通过查看第二电子设备的屏幕，通过语音提示就可以获知消息的提示，避免用户错过重要的消息，从而提升了用户的体验。
在一些可能的实现方式中，该第二电子设备为车机或者智能音箱。
结合第三方面，在第三方面的某些实现方式中，该第二电子设备向该第一电子设备发送回复内容，包括：该第二电子设备采集用户回复的语音信息；该第二电子设备向该第一电子设备发送该语音信息，或者，向该第一电子设备该语音信号对应的文本信息。
在一些可能的实现方式中，若第二电子设备向第一电子设备发送采集的语音信息，那么第一电子设备可以向该消息回复该语音信息，或者也可以向该消息回复该语音信息对应的文本信息。
结合第三方面，在第三方面的某些实现方式中，该回复内容包括文件。
本申请实施例中，用户可以在第二电子设备上回复多媒体文件(例如图片、视频)、工作类文件(例如，word文档或者excel文档等等)，这样有助于增加用户回复内容的多样性，从而有助于提升用户回复消息时的体验。
结合第三方面，在第三方面的某些实现方式中，该第二电子设备接收第一电子设备发送的消息和指示信息之前，该方法还包括：该第二电子设备接收该第一电子设备发送的请求信息，该请求信息用于请求该第二电子设备确定该第一电子设备的机主是否聚焦该第二电子设备；该第二电子设备根据该请求信息，向该第一电子设备发送响应信息，该响应信息用于指示该第一电子设备的机主当前聚焦的设备为该第二电子设备。
本申请实施例中，第二电子设备可以是第一电子设备的消息转发列表中的设备且第一电子设备可以和第二电子设备为同一账号下的设备(或者，第一电子设备和第二电子设备可以保存同一用户的信息)，这样第二电子设备在接收到该请求信息后，可以通过采集用户特征并与第二电子设备中预置的用户特征进行匹配，若匹配成功则确定第一电子设备的机主当前聚焦的设备为第二电子设备，从而向第一电子设备发送响应信息。这样有助于提升消息转发的安全性，避免了除第一电子设备的机主以外的其他用户接收到该消息的提示，从而有助于提升用户的体验。
结合第三方面，在第三方面的某些实现方式中，该第二电子设备包括用户特征采集装 置，该第二电子设备接收第一电子设备发送的消息和指示信息之前，该方法还包括：该第二电子设备接收该第一电子设备发送的请求信息，该请求信息用于请求该第二电子设备确定该第一电子设备的机主是否聚焦该第二电子设备；该第二电子设备根据该请求信息，通过该用户特征采集装置采集用户特征并向该第一电子设备发送该用户特征。
本申请实施例中，第二电子设备可以是第一电子设备的消息转发列表中的设备且第一电子设备可以和第二电子设备不是同一账号下的设备(或者，第一电子设备和第二电子设备可以保存不同用户的信息)；或者，第二电子设备也可以是第一电子设备周围的设备。这样第二电子设备在接收到该请求信息后，可以通过用户特征采集装置来采集正在聚焦第二电子设备的用户的特征信息并向第一电子设备发送该特征信息。第一电子设备根据该特征信息与第一电子设备中预置的用户特征信息匹配，若匹配成功则向第二电子设备转发该消息。这样有助于提升消息转发的安全性，避免了除第一电子设备的机主以外的其他用户接收到该消息的提示，从而有助于提升用户的体验。
结合第三方面，在第三方面的某些实现方式中，该消息为第一应用程序的消息，该第二电子设备为未安装该第一应用程序的设备。
本申请实施例中，如果第二电子设备为未安装第一应用程序的设备，那么第二电子设备也可以在接收到该指示信息后，通过在消息提醒框中增加回复控件，使得第二电子设备可以通过用户输入的回复内容以及检测到的点击回复控件的操作来获取用户回复的内容，并向第一电子设备发送该回复的内容。从而在第一电子设备上完成消息的真实回复。这样有助于用户及时接收到消息的提醒并完成对该消息的回复，避免用户错过重要的消息，从而有助于提升用户的体验。
第四方面，提供了一种回复消息的装置，该回复消息的装置设置在第一电子设备，该装置包括：第一接收单元，用于接收消息；发送单元，用于在确定该第一电子设备的机主聚焦的设备为第二电子设备时，向该第二电子设备发送该消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；第二接收单元，用于接收该第二电子设备发送的对该消息的回复内容；回复单元，用于根据该回复内容，对该消息进行回复。
第五方面，提供了一种回复消息的装置，该回复消息的装置设置在第二电子设备，该装置包括：接收单元，用于接收第一电子设备发送的消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；显示单元，用于显示消息提醒框，该消息提醒框中包括该消息以及该回复控件；发送单元，用于在检测到用户对该消息进行回复的操作时，向该第一电子设备发送回复内容。
第六方面，提供了一种电子设备，包括：一个或多个处理器；存储器；以及一个或多个计算机程序。其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令。当指令被电子设备执行时，使得电子设备执行上述第二方面中任一项可能的实现中的回复消息的方法。
第七方面，提供了一种电子设备，包括：一个或多个处理器；存储器；以及一个或多个计算机程序。其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令。当指令被电子设备执行时，使得电子设备执行上述第三方面中任一项可能的实现中的回复消息的方法。
第八方面，提供了一种包含指令的计算机程序产品，当所述计算机程序产品在第一电 子设备上运行时，使得所述第一电子设备执行上述第二方面所述的回复消息的方法；或者，当所述计算机程序产品在第二电子设备上运行时，使得所述第二电子设备执行上述第三方面所述的回复消息的方法。
第九方面，提供了一种计算机可读存储介质，包括指令，当所述指令在第一电子设备上运行时，使得所述第一电子设备执行上述第二方面所述的回复消息的方法；或者，当所述指令在第二电子设备上运行时，使得所述第二电子设备执行上述第三方面所述的回复消息的方法。
第十方面，提供了一种芯片用于执行指令，当所述芯片运行时，所述芯片执行上述第二方面所述的回复消息的方法；或者，当所述芯片运行时，所述芯片执行上述第三方面所述的回复消息的方法。
附图说明
图1是本申请实施例提供的一种电子设备的硬件结构示意图。
图2是本申请实施例提供的软件结构框图。
图3是本申请实施例提供的一组图形用户界面。
图4是本申请实施例提供的另一组图形用户界面。
图5是本申请实施例提供的另一组图形用户界面。
图6是本申请实施例提供的另一组图形用户界面。
图7是本申请实施例提供的另一组图形用户界面。
图8是本申请实施例提供的发送(source)端和接收(sink)端的内部实现过程。
图9是本申请实施例提供的另一组图形用户界面。
图10是本申请实施例提供的通过音视频采集在sink端重现source端界面的过程。
图11是本申请实施例提供的另一组图形用户界面。
图12是本申请实施例提供的另一组图形用户界面。
图13是本申请实施例提供的另一组图形用户界面。
图14是本申请实施例提供的回复消息的方法的示意性流程图。
图15是本申请实施例提供的回复消息的装置的示意性框图。
图16是本申请实施例提供的回复消息的装置的示意性框图。
图17是本申请实施例提供的电子设备的示意性结构图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；本文中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，在本申请实施例的描述中，“复数个”或者“多个”是指两个或多于两个。
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中，除非另有说明，“多 个”的含义是两个或两个以上。
本申请实施例提供的方法可以应用于手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等电子设备上，本申请实施例对电子设备的具体类型不作任何限制。
示例性的，图1示出了电子设备100的结构示意图。电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
可以理解的是，本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中，电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
其中，控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。在一些实施例中，处理器110可以包含多组I2C总 线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K，充电器，闪光灯，摄像头193等。例如：处理器110可以通过I2C接口耦合触摸传感器180K，使处理器110与触摸传感器180K通过I2C总线接口通信，实现电子设备100的触摸功能。
I2S接口可以用于音频通信。在一些实施例中，处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合，实现处理器110与音频模块170之间的通信。在一些实施例中，音频模块170可以通过I2S接口向无线通信模块160传递音频信号，实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中，音频模块170也可以通过PCM接口向无线通信模块160传递音频信号，实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中，UART接口通常被用于连接处理器110与无线通信模块160。例如：处理器110通过UART接口与无线通信模块160中的蓝牙模块通信，实现蓝牙功能。在一些实施例中，音频模块170可以通过UART接口向无线通信模块160传递音频信号，实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器110与显示屏194，摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface，CSI)，显示屏串行接口(display serial interface，DSI)等。在一些实施例中，处理器110和摄像头193通过CSI接口通信，实现电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信，实现电子设备100的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号，也可被配置为数据信号。在一些实施例中，GPIO接口可以用于连接处理器110与摄像头193，显示屏194，无线通信模块160，音频模块170，传感器模块180等。GPIO接口还可以被配置为I2C接口，I2S接口，UART接口，MIPI接口等。
USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电，也可以用于电子设备100与外围设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。该接口还可以用于连接其他电子设备，例如AR设备等。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对电子设备100的结构限定。在本申请另一些实施例中，电子设备100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。在一些有线充电的实施例中，充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中，充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时，还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外 部存储器，显示屏194，摄像头193，和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量，电池循环次数，电池健康状态(漏电，阻抗)等参数。在其他一些实施例中，电源管理模块141也可以设置于处理器110中。在另一些实施例中，电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后，被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A，受话器170B等)输出声音信号，或通过显示屏194显示图像或视频。在一些实施例中，调制解调处理器可以是独立的器件。在另一些实施例中，调制解调处理器可以独立于处理器110，与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在一些实施例中，电子设备100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以 包括全球卫星定位系统(global positioning system，GPS)，全球导航卫星系统(global navigation satellite system，GLONASS)，北斗卫星导航系统(beidou navigation satellite system，BDS)，准天顶卫星系统(quasi-zenith satellite system，QZSS)和/或星基增强系统(satellite based augmentation systems，SBAS)。
电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，电子设备100可以包括1个或N个摄像头193，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样，电子设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存 储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据，电话本等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐，或收听免提通话。
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风170C发声，将声音信号输入到麦克风170C。电子设备100可以设置至少一个麦克风170C。在另一些实施例中，电子设备100可以设置两个麦克风170C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，电子设备100还可以设置三个，四个或更多麦克风170C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。
压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多，如电阻式压力传感器，电感式压力传感器，电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A，电极之间的电容改变。电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194，电子设备100根据压力传感器180A检测所述触摸操作强度。电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中，作用于相同触摸位置，但不同触摸操作强度的触摸操作，可以对应不同的操作指令。例如：当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时，执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时，执行新建短消息的指令。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中，可以 通过陀螺仪传感器180B确定电子设备100围绕三个轴(即，x，y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的，当按下快门，陀螺仪传感器180B检测电子设备100抖动的角度，根据角度计算出镜头模组需要补偿的距离，让镜头通过反向运动抵消电子设备100的抖动，实现防抖。陀螺仪传感器180B还可以用于导航，体感游戏场景。
气压传感器180C用于测量气压。在一些实施例中，电子设备100通过气压传感器180C测得的气压值计算海拔高度，辅助定位和导航。
磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中，当电子设备100是翻盖机时，电子设备100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态，设置翻盖自动解锁等特性。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态，应用于横竖屏切换，计步器等应用。
距离传感器180F，用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中，拍摄场景，电子设备100可以利用距离传感器180F测距以实现快速对焦。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定电子设备100附近有物体。当检测到不充分的反射光时，电子设备100可以确定电子设备100附近没有物体。电子设备100可以利用接近光传感器180G检测用户手持电子设备100贴近耳朵通话，以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式，口袋模式自动解锁与锁屏。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合，检测电子设备100是否在口袋里，以防误触。
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。
温度传感器180J用于检测温度。在一些实施例中，电子设备100利用温度传感器180J检测的温度，执行温度处理策略。例如，当温度传感器180J上报的温度超过阈值，电子设备100执行降低位于温度传感器180J附近的处理器的性能，以便降低功耗实施热保护。在另一些实施例中，当温度低于另一阈值时，电子设备100对电池142加热，以避免低温导致电子设备100异常关机。在其他一些实施例中，当温度低于又一阈值时，电子设备100对电池142的输出电压执行升压，以避免低温导致的异常关机。
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施 例中，触摸传感器180K也可以设置于电子设备100的表面，与显示屏194所处的位置不同。
骨传导传感器180M可以获取振动信号。在一些实施例中，骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏，接收血压跳动信号。在一些实施例中，骨传导传感器180M也可以设置于耳机中，结合成骨传导耳机。音频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号，解析出语音信号，实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息，实现心率检测功能。
按键190包括开机键，音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入，产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作，马达191也可对应不同的振动反馈效果。不同的应用场景(例如：时间提醒，接收信息，闹钟，游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195，或从SIM卡接口195拔出，实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口，N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡，Micro SIM卡，SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同，也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。电子设备100通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，电子设备100采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在电子设备100中，不能和电子设备100分离。
电子设备100的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的Android系统为例，示例性说明电子设备100的软件结构。
图2是本申请实施例的电子设备100的软件结构框图。分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层，安卓运行时(Android runtime)和系统库，以及内核层。应用程序层可以包括一系列应用程序包。
如图2所示，应用程序包可以包括相机，图库，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图2所示，应用程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通，挂断等)。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(media libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。
图3是本申请实施例提供的一组图形用户界面(graphical user interface，GUI)。
用户Lily当前正在使用平板看视频，手机被用户Lily放置在一旁的桌子上。
参见图3中的(a)所示的GUI。手机接收到一条来自于用户Tom的社交App消息(例如，Happy Birthday！)。此时手机可以向用户正在聚焦的平板转发这一条消息，平板可以显示消息提醒框301。其中，消息提醒框301中包含了消息来源(例如，社交App的名称，且该消息来自于用户Lily的P40)、发送该消息的用户信息(例如，“Tom”以及用户Tom的头像)、该消息的内容(例如，Happy Birthday！)以及控件302。
应理解，平板可以是和手机登录了同一社交App的账号；或者，平板也可以是安装有该社交App但是用户未使用与手机相同的账号登录该社交App；或者，平板也可以为未安装该社交App的设备。
本申请实施例中，手机在接收到一条通知后，如果手机确定用户当前为聚焦手机而是聚焦的平板，那么手机可以在向平板发送的信息中携带该消息的内容，发送该消息的用户的信息以及“快捷回复”属性。进一步的，手机还可以在向平板发送的信息中携带手机的信息。从而平板可以根据手机发送的信息，向用户展示提醒框301。
应理解，本申请实施例中的手机转发的通知消息可以是用户提前设置好的通知类型的消息，例如，用户可以在系统设置中设置微信、QQ、钉钉等等App的通知消息为可以转发的消息；或者，手机转发的通知消息也可以是默认的即时通讯(instant message，IM)类消息(如短信、微信、等等)。
当平板检测到用户点击控件302的操作后，可以显示如图3中的(b)所示的GUI。
手机在接收到该消息一段时间后，该消息自动隐藏。用户可以通过进入通知中心，或者下拉菜单的方式来处理该消息。
当平板检测到用户点击控件302的操作后，可以在消息提醒框中显示文本输入框303，在文本输入框303中还可以显示发送控件304。同时，平板还可以调起系统输入法。用户可以通过输入法编辑自己需要回复的内容(例如，Thank you！)，用户回复的内容可以显示在文本输入框303中。
当平板检测到用户点击控件304的操作后，平板可以将回复内容发送给手机。同时，平板上的输入法以及消息提醒框可以自动隐藏。手机上的GUI的变化可以参见图3中的(c)至(f)。
参见图3中的(c)所示的GUI，当手机接收到平板发送的用户的回复内容后，手机可以自动启动社交应用App。在该社交应用App的显示界面上可以依照收到消息的时刻的先后顺序，依次显示用户Tom、用户Sam、用户Lucy以及用户Mike的历史聊天记录。
参见图3中的(d)所示的GUI，手机可以自动打开用户Tom的聊天界面。在打开该聊天界面时，该聊天界面上可以显示用户Tom给用户Lily发送的消息(Happy Birthday！)。
参见图3中的(e)所示的GUI，手机可以将用户在平板上回复的内容自动回复给用户Tom。当手机完成回复后，可以回到接收到该消息之前的状态。参见图3中的(f)所示。手机可以自动从社交App中与用户Tom的聊天界面，返回手机的桌面。
应理解，本申请实施例中，平板上检测到用户点击控件304的操作后，用户回复的消息并没有完成真实的回复。真实的回复过程实际上是在手机上完成的。例如，当手机显示了如图3中的(e)所示的界面后，手机完成了对该消息的真实回复。
还应理解，手机完成对该消息回复的过程也可以是在内部实现的，手机可以在接收到平板发送的用户回复的内容后，自动在后台完成对该消息的回复。也就是说，手机完成对该消息的真实回复的过程可以是对用户无感的。
本申请实施例中，用户可以直接在平板上完成对消息的回复，而无需回到手机对该消息进行处理。这样可以避免用户错过重要的信息，同时也避免了用户在回到手机上进行消息处理的过程，有助于提升用户的体验。
图4是本申请实施例提供的另一组GUI。
用户正在房间使用笔记本电脑工作，手机处于锁屏状态且被用户放在另一个房间内。
参见图4中的(a)所示的GUI，手机接收到一条来自于用户Tom的社交App消息(例如，Happy Birthday！)以及来自于用户Amy的社交App消息(例如，Happy Birthday！)。此时手机可以向用户正在聚焦的笔记本电脑发送用户Tom和用户Amy的消息，笔记本电脑可以显示消息提醒框401和消息提醒框402。其中，第一消息提醒框401中包含了消息来源(例如，该消息属于社交App的消息，且该消息来自于用户Lily的P40)、发送该消息的用户信息(例如，“Tom”以及用户Tom的头像)、该消息的内容(例如，Happy Birthday！)以及控件403。第二消息提醒框402中包含了消息来源(例如，该消息属于社交App的消息，且该消息来自于用户Lily的P40)、发送该消息的用户信息(例如，“Amy”以及用户Amy的头像)、该消息的内容(例如，Happy Birthday！)以及回复控件。
当笔记本电脑检测到用户点击控件403的操作后，可以显示如图4中的(b)所示的GUI。
笔记本电脑可以在消息提醒框中显示文本输入框404，在文本输入框404中还可以显示发送控件405。同时，笔记本电脑还可以检测用户通过键盘检测用户回复的内容(例如，Thank you！)，用户回复的内容可以显示在文本输入框404中。
当笔记本电脑检测到用户点击控件405的操作后，笔记本电脑可以将回复内容发送给手机。同时，笔记本电脑上的消息提醒框401可以自动隐藏。手机上的GUI的变化可以参见图4中的(c)至(f)。
参见图4中的(c)所示，手机可以在锁屏界面上直接拉起社交应用App的显示界面。该显示界面上可以依照收到消息的时刻的先后顺序，依次显示用户Tom、用户Amy、用户Sam、用户Lucy以及用户Mike的历史聊天记录。
应理解，某些社交App中好友的视频通话和语音通话的接听界面，可以直接显示在手机的锁屏界面上。本申请实施例中，通过社交App中添加支持锁屏加载的(flags)属性，手机可以在锁屏界面上直接拉起社交App的显示界面。
应理解，图4中的(d)至(e)可以参考上述图3中的(d)至(e)的描述，为了简洁，在此不再赘述。
参见图4中的(f)所示，手机在完成对该消息的真实回复后，进入锁屏状态。
一个实施例中，当笔记本电脑检测到用户点击了控件405的操作后，消息提醒框401可以消失；而消息提醒框402还可以继续显示在笔记本电脑上。一段时间后，如果用户没有在笔记本电脑上对用户Amy进行回复，那么消息提醒框402可以自动隐藏。
一个实施例中，手机在完成对用户Tom的真实回复后，在锁屏界面上用户Tom的消息提示信息可以自动隐藏；而用户Amy的消息提示可以继续显示在锁屏界面上。
一个实施例中，笔记本电脑在检测用户通过键盘检测用户回复的内容的同时，还可以自动开启摄像头来采集用户的人脸信息。笔记本电脑在向用户发送用户回复的内容的同时，还可以向手机发送采集到的人脸信息。当手机确定笔记本电脑采集的人脸信息和手机中预置的人脸信息匹配后，手机可以完成对该消息的真实回复。同时，由于笔记本电脑采集的人脸信息和手机中预置的人脸信息匹配，那么手机可以自动进行解锁操作，并进入非锁屏状态。从而实现如图4中的(c)至(e)所示的回复过程。
本申请实施例中，在笔记本电脑在向手机发送用户回复的内容的同时，笔记本电脑还 可以向手机发送笔记本电脑采集的用户的人脸信息。手机可以先依据该人脸信息判断是否为用户本人回复。如果是用户本人回复，则手机完成对通知消息真实回复；否则，手机可以不对该通知消息进行回复。这样有助于提高手机对用户隐私的保护，提升了用户的体验。
图5是本申请实施例提供的另一组GUI。
用户此时正在开车，车机上的显示屏上显示用户正在使用导航。手机被用户放置在车上的储物槽内。
手机接收到一条来自于用户Tom的社交App消息(例如，Happy Birthday！)。此时手机可以向用户车机发送这一条消息，车机通过显示屏显示消息提醒框501。其中，消息提醒框501中可以消息来源(例如，该消息属于社交App的消息，且该消息来自于用户Lily的P40)、发送该消息的用户信息(例如，“Tom”以及用户Tom的头像)、该消息的内容(例如，Happy Birthday！)。同时，车机还可以通过语音提醒的方式向用户提示“Tom通过社交App向您发送Happy Birthday！”。
相比于图3或者图4所示的GUI，车机的显示屏显示的消息提醒框中可以不包括发送控件。车机在通过语音提醒的方式提示用户后，车机可以通过麦克风采集用户回复的内容。如图所示，用户回复了“Thank you！”。此时车机可以通过消息提醒框501显示用户回复的内容。
一个实施例中，车机上可以包含数字信号处理器(digital signal processing，DSP)。DSP可以对语音信息进行处理，从而可以分析得到该语音信息对应的文字内容。
一个实施例中，车机上可以包括语音识别(automatic speech recognition，ASR)模块其中，ASR模块主要作用是将用户的语音信息识别为文字内容。
一个实施例中，车机的显示屏上显示的消息提醒框中也可以包括发送控件，在用户点击了发送控件后，车机可以将用户回复的内容发送给手机。或者，消息提醒框中也可以不包括发送控件。车机通过麦克风采集到用户的语音信息“给Tom回复Thank you！”后，车机可以将用户回复的内容发送给手机。
一个实施例中，消息提醒框上的回复按键还可以映射到方向盘上的按键，这样用户可以直接通过点击方向盘上的按键进行语音回复，从而可以进一步提升驾驶安全性。
本申请实施例中，车机向手机回复的内容中可以为语音信息，也可以为文字内容。
参见图5中的(a)所示，手机在接收到车机发送的回复内容后，可以在锁屏界面上直接拉起社交应用App的显示界面。该显示界面上可以依照收到消息的时刻的先后顺序，依次显示用户Tom、用户Sam、用户Lucy以及用户Mike的历史聊天记录。
参见图5中的(b)所示的GUI，手机可以自动打开用户Tom的聊天界面。在打开该聊天界面时，该聊天界面上可以显示用户Tom给用户Lily发送的消息(Happy Birthday！)。
参见图5中的(c)所示的GUI，手机可以将语音信息对应的文字内容自动回复给用户Tom。或者，参见图5中的(d)所示的GUI，手机可以将语音信息回复给用户Tom。
本申请实施例中，可以在接收端设备中增加文本文字转语音功能。在车机场景下有助于增加用户使用消息通知转发的安全性和便利性，有助于提升用户体验。
图6是本申请实施例提供的另一组GUI。
用户正在房间使用笔记本电脑工作，手机处于锁屏状态且被用户放在另一个房间内。
参见图6中的(a)所示的GUI，手机接收到一条来自于用户Tom的社交App消息(例 如，请把项目计划发给我)。此时手机可以向用户正在聚焦的笔记本电脑发送这一条消息，笔记本电脑可以显示消息提醒框601。其中，消息提醒框601中包含了消息来源(例如，该消息属于社交App的消息，且该消息来自于用户Lily的P40)、发送该消息的用户信息(例如，“Tom”以及用户Tom的头像)、该消息的内容(例如，请把项目计划发给我)以及控件602。
参见图6中的(b)所示的GUI，当笔记本电脑检测到用户点击控件602的操作后，笔记本电脑可以显示输入框603和发送控件604。笔记本电脑检测到用户将笔记本电脑桌面上的项目计划(word文档)拖拽到输入框603的操作后，笔记本电脑可以将该项目计划(word文档)发送给手机。或者，笔记本电脑检测到用户将笔记本电脑桌面上的项目计划(word文档)拖拽到输入框603且用户点击了控件604的操作后，笔记本电脑可以将该项目计划(word文档)发送给手机。
手机在接收到笔记本电脑发送的项目计划(word文档)后的显示界面可以参照如图6中的(c)至(f)所示。
参见图6中的(c)所示的GUI，手机可以在锁屏界面上直接拉起社交应用App的显示界面。该显示界面上可以依照收到消息的时刻的先后顺序，依次显示用户Tom、用户Sam、用户Lucy以及用户Mike的历史聊天记录。
参见图6中的(d)所示的GUI，手机可以自动打开用户Tom的聊天界面。在打开该聊天界面时，该聊天界面上可以显示用户Tom给用户Lily发送的消息(请把项目计划发给我)。
参见图6中的(e)所示的GUI，手机可以将项目计划(word文档)给用户Tom。当手机完成回复后，可以回到接收到该通知消息之前的状态。
参见图6中的(f)所示。手机在完成对该消息的真实回复后，进入锁屏状态。
本申请实施例中，接收端(sink)设备可以向发送端(source)设备发送附件。其中，附件可以为图片、视频、音频、文档等等类型的文件。用户可以在通知内完成类似邮件email一样的交互，增加用户使用消息通知转发的便利性，有助于提升用户体验。
图7是本申请实施例提供的另一组GUI。
参见图7中的(a)所示的GUI，手机接收到一条来自于用户Tom的社交App消息(例如，Happy Birthday！)。此时手机可以向用户正在聚焦的笔记本电脑发送这一条消息，笔记本电脑可以显示消息提醒框701。当笔记本电脑检测到用户点击了消息提醒框701的操作后，可以显示如图7中的(b)所示的GUI。
参见图7中的(b)所示的GUI，当笔记本电脑检测到用户点击了消息提醒框中的某个位置后，笔记本电脑可以显示另一消息提醒框702。消息提醒框702相比于消息提醒框701，更符合PC端社交App的显示风格。笔记本电脑在检测到用户在消息提醒框702的输入框中输入回复的内容(例如，Thank you！)并点击了发送控件的操作后，可以将用户回复的内容发送给手机。
参见图7中的(c)所示的GUI，手机可以在接收到用户回复的内容后自动拉起与用户Tom的聊天界面，从而自动完成对消息的真实回复。同时，笔记本电脑可以继续显示消息提醒框703。该消息提醒框中703可以包含用户刚刚回复的内容(例如Thank you！)。
应理解，当用户在如图4中的(b)所示的GUI上点击了回复控件403的操作后，笔 记本电脑可以检测用户输入的回复内容并在检测到用户点击了发送控件404后，将回复内容发送给手机。在发送给手机的同时，该消息提醒框401可以自动消失。当下一次手机接收到消息后，笔记本电脑可以继续显示消息提醒框。而对于图7中的(b)所示的GUI中的消息提醒框，用户在回复消息后可以一直保留下来，当笔记本电脑检测到用户关闭消息提醒框702的操作后，笔记本电脑可以关闭该消息提醒框702。
一个实施例中，参见图7中的(d)所示的GUI，该消息提醒框702中还包括滚动条704。当笔记本电脑检测到用户使用鼠标向上滑动滚动条704后，笔记本电脑可以向手机请求与用户Tom的历史聊天记录。从而可以通过消息提醒框703显示更多的聊天内容。
下面结合图8描述本申请实施例中发送(source)端和接收(sink)端的内部实现过程。
通知服务用于接收社交应用服务器发送的消息。例如，用户Tom在使用设备A向用户Lily发送消息时，设备A首先向社交应用服务器发送该消息内容以及用户Lily的社交应用账号的标识信息。社交应用服务器中保存登录了用户Lily的社交应用账号的设备信息(例如，Lily的设备B)。社交应用服务器可以依据用户Lily的社交应用账号的标识信息，向用户Lily的设备B发送对应的消息。设备B中的通知服务可以用于接收服务器发送的消息以及用户Tom的信息。
通知监听模块，用于向系统注册监听通知服务，实时获取到通知服务接收到的消息。当某个社交应用服务器发送了一条通知消息时，通知监听器可以获取到该条通知消息体，通知消息体中含有包头、通知ID属性、通知channel属性、消息内容等。其中，包头用于确定该通知消息是属于哪一个App的应用程序，通知ID属性和通知channel属性可以用于找到对应的通知消息，消息内容可以包括消息的文本信息(例如，图3中的(a)所示的“Happy Birthday！”)。
source端的通知处理模块：source端设备在确定用户当前没有聚焦source端设备且该消息为可以向其他电子设备转发的消息时，对该消息附加“快捷回复”属性。
source端可以保存有应用的白名单。source端只有在接收到来自于该白名单中的应用的消息时，才可以进行消息的跨设备转发。示例性的，对于支持拖拽事件响应的三方App都可以加入白名单中。source端可以对应用程序进行测试来确定其是否支持拖拽事件响应。在进行测试时应用程序框架层中的视图系统可以向应用程序层的某个应用程序发送Drag and Drop事件以及随机生成的内容。应用程序在接收到Drag and Drop事件以及随机生成的内容后，响应于Drag and Drop事件，将应用程序启动到前台并随机打开某个联系人的聊天界面，将随机生成的内容回复到聊天界面的相应位置。如果可以回复成功则表示该应用程序支持系统拖拽事件响应；如果回复不成功则表示该应用程序不支持系统拖拽事件响应。
一个实施例中，source端也可以根据用户的设置，来判断是否对该消息进行跨设备转发。示例性的，如图11中的(e)所示，用户可以提前设置可以进行跨设备转发的消息对应的App。例如，用户可以设置App5和App7的通知消息转发给其他设备；而对于App4、App6、App8和App9的通知消息不转发给其他设备。
本申请实施例中，通知消息体中可以包括通知消息的通知ID属性和通知channel属性。其中，通知ID属性可以用于区别不同用户发送的通知ID属性。例如，对于某个三方App 中如果用户有多个联系人，那么这多个联系人可以分别用不同的通知ID属性进行区分。表1示出了一种区分方式。
表1联系人与联系人对应的通知ID属性的对应关系
联系人 通知ID属性
联系人1 ID1
联系人2 ID2
联系人3 DI3
… …
通知channel属性中的字符串可以用于区分不同的消息类型，示例性的，表2示出了不同消息类型与通知channel属性中的字符串的对应关系。
表2消息类型与通知channel属性中的字符串的对应关系
消息类型 通知channel属性中的字符串
文本 字符串1
语音 字符串2
视频 字符串3
文件 字符串4
… …
通过通知ID属性以及通知channel属性就可以确定对应的通知消息。例如，对于图4所示的GUI，用户Tom以及用户Amy分别发来了2条通知消息，可以通过通知ID属性就可以对其进行区分。又例如，对于Tom发送的2条不同消息类型的通知消息，可以通过通知channel属性对其进行区分。对于同一用户发送的同一消息类型的不同通知消息可以不进行区分，或者也可以用其他标识信息进行区分。
应理解，对于不同的应用程序，其通知ID属性和通知channel属性的描述可以不同，上述仅仅是对某些应用程序中定义的通知ID属性和通知channel属性进行的描述，本申请实施例并不限于此。
source端的通知处理模块可以在其消息体中增加“快捷回复”的flag属性。sink端在确定通知消息体中携带了“快捷回复”的flag属性时，可以在消息提醒框中增加回复控件。当sink端检测到用户点击了回复控件后，可以显示文本输入框以及回复控件。source端在向sink端发送通知消息体时，可以在通知消息体中携带消息内容以及“快捷回复”的flag属性。
一个实施例中，source端还可以在通知消息体中携带通知ID属性和/或通知channel属性。携带通知ID属性和通知channel属性的目的是sink端获取用户对通知消息的回复内容后，将回复内容、通知ID属性和通知channel属性一起发送给source端，从而可以使得source端确定该回复内容是对哪一条通知消息的回复内容。
示例性的，source端可以将通知消息体携带在BLE数据包中发送给sink端。BLE数据包中包括协议数据单元(protocol data unit，PDU)，该通知消息体可以携带在PDU中的服务数据(service data)字段中，或者，也可以携带在PDU中厂商特定数据(manufacturer specific data)字段中。例如，服务数据字段的负荷(payload)中可以包括多个比特位，其中，多个比特位中包括可扩展的比特位。sink端和source端可以约定某个可扩展的比特位的内容。source端可以采用GBK、ISO8859-1等编码方式对通知消息体进行编码，并将编 码后的信息携带在一个或者多个可扩展的比特位上。
sink端的通知处理模块：在sink端的通知处理模块接收到该通知消息体后，可以对该通知消息体进行解析，从而获得通知消息的内容以及该“快捷回复”的flag属性。示例性的，如果source端将通知消息体携带在BLE数据包中发送给sink端，那么sink端在接收到该BLE数据包之后，可以采用相应的解码方式进行解码，从而获得该通知消息体。
通知UI适配模块：在sink端的通知处理模块识别出了通知“快捷回复”flag属性后，通知UI适配模块针对不同操作系统的sink端，适配各个系统对应的系统接口，支持“快捷回复”输入框、UI呈现和用户交互响应等。
示例性的，若sink端为Android系统的设备，那么sink端可以提供notificationManager，从而实现消息提醒框的绘制，其中，消息提醒框中包括了通知消息体中的通知内容、notificationManager绘制的回复控件等。示例性的，如图3中的(a)所示，平板在接收到手机发送的消息体后，可以在消息提醒框中显示回复控件302。如图3中的(b)所示，平板在检测到用户点击控件302的操作后，可以显示输入框303以及发送控件304。
当sink端检测到用户输入了回复内容并点击了发送控件后，通过回调接口getResultsFromIntent()就可以获取到用户输入的内容了。getResultsFromIntent()可以建立发送控件和文本输入框的关联关系。当sink端检测到用户点击回复控件的操作后，就会触发sink端获取文本输入框中的内容。本申请实施例中，在不同的系统上都可以注册回调接口，这样sink端检测到用户回复内容时，通知处理模块就通过回调接口，获取到用户的回复内容。sink端在检测到用户在输入框中输入了回复内容并检测到用户点击了发送控件后，可以触发向source端发送用户的回复内容。
sink端的事件处理模块：在识别到用户回复某一条通知消息时，将action响应事件和用户回复的内容，一起打包为一个通知消息体。该通知消息体可以采用和source端向sink端发送的通知消息一样的封装格式，以便于source端进行解析。
示例性的，sink端可以将通知消息体携带在BLE数据包中发送给source端。BLE数据包中包括PDU，该通知消息体可以携带PDU中的服务数据字段中，或者，也可以携带在PDU中厂商特定数据字段中。例如，服务数据字段的负荷中可以包括多个比特位，其中，多个比特位中包括可扩展的比特位。sink端和source端可以约定某个可扩展的比特位的内容。sink端可以采用GBK、ISO8859-1等编码方式对通知消息体进行编码，并将编码后的信息携带在一个或者多个可扩展的比特位上。
一个实施例中，若source端向sink端发送的通知消息体中携带了通知ID属性和通知channel属性，那么sink端可以在通知消息中携带通知ID属性、通知channel属性、action响应事件和用户回复的内容。若source端向sink端发送的通知消息体中没有携带通知ID属性和通知channel属性，那么sink端向source端发送的通知消息体中也可以不携带通知ID属性和通知channel属性。
source端的事件处理模块：解析sink端发送的通知消息体，获得action响应事件、通知ID属性、通知channel属性和用户回复内容，其中，source端可以通过action响应事件确定sink端对通知消息进行了回复；通过通知ID属性和通知channel属性确定是对哪一条通知消息进行的回复。进而通过以下过程完成通知消息的真实回复。
(1)拉起社交App显示界面
如果source端处于锁屏状态，可以通过以下几种方式进行处理。
方式一
source端可以先根据通知消息体的包头确定该回复内容是针对哪一个App。若该App提供应用程序接口(application programming interface，API)进行消息的回复，那么该App在获取到用户回复的内容后可以直接通过App提供的API完成对通知消息的真实回复。示例性的，对于短消息应用，其提供了API“sendTextMessage”可以用于通知消息的真实回复。source端在获取到回复内容后，可以先通过该通知消息体的包头确定回复内容是针对短消息应用的回复内容。由于短消息提供了API进行通知消息的回复，source端可以通过通知ID属性和通知channel属性确定是对哪一条通知消息的回复，进而source端可以直接通过“sendTextMessage”完成通知消息的真实回复。
应理解，对于方式一的回复方式，消息回复的过程是在source端内部实现的，该过程对用户无感。若App不提供API进行消息的回复，那么该App可以采用方式二或者方式三，通过拖拽事件完成回复。
方式二
App如果支持锁屏加载的flags属性，source端就可以在锁屏界面上直接加载对应的显示界面。如微信的语音通话请求、视频通话请求等等，就是直接显示在锁屏界面上。进而到步骤(2)，通过拖拽事件完成消息的回复。
方式三
方式三的回复方式还可以称之为跨设备解锁方案。方式三中，sink端可以完成对用户身份认证信息的采集，例如，sink端可以获取到用户用于source端解锁的密码信息，例如数字密码、指纹密码、虹膜信息、脸部特征等等身份认证信息。然后，sink端可以将密码信息携带在通知消息体中发送给source端，从而由source端判断是否对设备进行解锁。如果source端根据密码信息确定进行解锁，那么source端可以先进行解锁，进入非锁屏状态，进而到步骤(2)，通过拖拽事件完成消息的回复。
(2)通过拖拽事件完成回复
source端响应于action响应事件，可以确定sink端检测到用户对通知消息回复的操作。source端可以根据通知消息体的包头确定相应的App并将该App启动到前台，并通过通知ID属性和通知channel属性找到对应的通知消息。source端的视图系统可以向对应的App发送Drag and Drop事件以及回复内容。App响应于Drag and Drop事件，通过通知消息里面的PendingIntent拉起具体某个联系人的聊天界面，从而对通知消息进行回复。此时就完成对该通知消息的真实回复。视图系统在向对应的App发送Drag and Drop事件以及回复内容的同时，还可以向对应的App发送回复内容的内容属性，该内容属性可以用于指示回复内容的类型(例如，文本、图片、语音、视频、文件等等)。App可以根据回复内容的类型，来通知三维图形处理库(OpenGL ES)来绘制不同的显示界面。例如，对于文本内容，在拉起具体某个联系人的聊天界面后，可以直接将文本内容显示在回复的位置。又例如，对于语音信息，在拉起具体某个联系人的聊天界面后，可以显示语音的时长以及接听语音的控件(当source端检测到用户点击该控件的操作时，可以播放该语音的内容)。又例如，对于视频信息，在拉起某个联系人的聊天界面后，可以显示该视频中的第一帧图像并显示播放控件(当source端点击播放控件后，可以播放该视频的内容)。
(3)恢复source端现场
source端在完成回复后，通过将该App的界面隐藏起来，可以返回启动社交前的显示界面。如果source端原来是锁屏的，则重新将设备锁屏。通过恢复设备原有的状态，让用户对快捷回复功能的无感知，可以进一步提升了用户体验。
一个实施例中，如图8所示的source端和sink端的内部实现过程中，sink端中还可以包括语音模块。示例性的，如图5所示的GUI中，车机上可以包括语音模块。在手机将接收到的消息发送给车机后，车机可以通过语音模块将该消息对应的文字信息转化为语音信息，并通过语音提醒的方式向用户提醒该消息。
同时，sink端的麦克风可以通过拾音得到用户语音回复的内容。sink端可以将用户语音回复的内容封装到通知消息体中，发送给source端。语音模块也可以将用户语音回复的内容转化为文字信息发送给source端。或者，语音模块也可以不将用户语音回复的内容转化为文字信息，而是直接在通知消息体中携带用户语音回复的内容。从而由source端来确定是否将该语音回复的内容转化为文字信息。
由于现在许多汽车中控都是大屏，搭载智能系统，提供非常丰富的娱乐功能和驾驶乐趣。通过各种互联技术可以很好的将智能设备与车机连接起来，同样智能设备上的通知也可以实时同步到车机。将通知内容转换为语音播报交互更加人性化，可以提升车机的安全性要求；同时支持用户进行语音回复，也避免了用户在车机的显示屏上进行消息回复的过程，提升了用户的体验。
一个实施例中，sink端还可以支持附件回复的功能。
示例性的，如图6所示的GUI中，用户可以在笔记本电脑上将附件(项目计划)发送给用户Lily。
在sink端向source端发送通知消息体时，可以在通知消息体中携带附件的信息。或者，sink端也可以在通知消息体中携带该附件在sink端的路径信息。当用户在source端点击该附件时，source端可以向sink端请求该路径下的附件。sink端从而通过网络传输通道将该附件发送给source端。
应理解，sink端向source端发送用户语音回复的内容或者文件时也可以采用BLE数据包，具体的发送方式可以参考上述实施例的描述，为了简洁，在此不再赘述。
下面对图7所示的GUI的实现过程进行详细说明。
如图7中的(a)所示的GUI，当笔记本电脑检测到用户点击消息提醒框701的操作后，笔记本电脑可以向手机发送请求，该请求用于请求界面元素的配置信息。
示例性的，该请求可以携带在BLE数据包中发送给手机。BLE数据包中包括PDU，该请求可以携带在PDU中的服务数据字段中，或者，也可以携带在PDU中厂商特定数据字段中。例如，服务数据字段的负荷中可以包括多个比特位，其中，多个比特位中包括可扩展的比特位。手机和笔记本电脑可以约定某个可扩展的比特位的内容。示例性的，当某个可扩展的比特位为“1”时，表示请求界面元素的配置信息。
source端(例如，手机)可以借助集成开发环境(integrated development environment，IDE)工具确定一个或者多个UI界面元素，生成可扩展标记语言(extensible markup language，XML)文件。
其中，XML文件中包括：UI界面背景、source端UI元素、UI元素的大小(例如， sink端显示的UI元素是source端的UI元素的2倍)和位置，其中，UI元素位置可以包括UI元素和sink端添加控件、文本输入框的方向关系。
示例性的，图9示出了source端上显示的聊天界面，source端可以对该聊天界面上截取UI元素901，source端可以还可以决定sink端上绘制的聊天界面的背景(例如，白色)，以及sink端添加的控件(例如，发送控件)以及文本输入框与UI元素的位置。例如，文本输入框可以位于UI元素的正下方居中的位置，发送控件可以位于UI元素的右下方。
示例性的，source端可以将XML文件携带在BLE数据包中发送给sink端。该请求可以携带在PDU中的服务数据字段中，或者，也可以携带在PDU中厂商特定数据字段中。例如，服务数据字段的负荷中可以包括多个比特位，其中，多个比特位中包括可扩展的比特位。source端可以采用相应的编码技术对该XML文件进行编码，并将编码后的信息携带在一个或者多个可扩展比特位上。sink端通过对相应比特位上的信息进行解码就可以获得该XML文件。
sink端可以根据XML文件还原界面。sink端可以根据XML文件中包括的UI界面背景、UI元素的大小以及位置，进行UI界面的绘制，如图7中的(b)所示，笔记本电脑可以绘制出消息提醒框702。
当笔记本电脑检测到用户点击发送控件的操作后，笔记本电脑可以将回复内容发送给手机，由手机完成对消息的真实回复。此时，笔记本电脑可以重新向手机请求新的XML文件，手机可以重新向笔记本电脑发送新的XML文件，其中XML文件中可以包括UI元素902。从而笔记本电脑可以根据XML文件中的UI元素902绘制如图7中的(c)所示的消息提醒框。应理解，笔记本电脑将回复内容发送给手机、笔记本电脑可以重新向手机请求新的XML文件以及手机向笔记本电脑发送新的XML文件的具体过程可以参考上述实施例中的描述，为了简洁，在此不在赘述。
一个实施例中，当笔记本电脑检测到用户滑动条704，那么笔记本电脑可以向手机请求更多的UI元素。示例性的，手机在接收到该请求后，将UI元素903携带在XML文件中发送给笔记本电脑。笔记本电脑可以根据XML文件绘制如图7中的(d)所示的消息提醒框。
本申请实施例中，sink端可以结合dupwight控件实现UI元素的还原，这个控件可以和sink端本地的控件(例如，button控件，text控件，list控件)结合进行消息提醒窗口的绘制。
下面对图7所示的GUI的另一实现过程进行详细说明。
图10示出了通过音视频采集在sink端重现source端界面的过程。source端可以按照一定的采样频率(例如，60Hz)的频率对source端的整个显示界面进行采样，并将采样的数据以及聊天界面在source端界面上的位置信息进行数据编码后发送给sink端。sink端首先对source端发送的数据进行解码；sink端根据聊天界面的位置信息对解码后的音视频数据进行裁剪，从而进行图像渲染，这样在sink端可以得到source端聊天界面的镜像。在sink端通过裁剪获得裁剪并进行图像渲染后，sink端还可以增加button控件(例如，发送控件)以及文本输入框。
图11示出了本申请实施例提供的另一组GUI。
参见图11中的(a)所示的GUI，该GUI为手机的桌面。该GUI包括多个应用图标， 该多个应用(例如，App1、App2和App3)图标。当手机检测到用户点击桌面上的图标1101的操作后，可以启动设置手机相关功能，显示如图11中的(b)所示的GUI。
参见图11中的(b)所示的GUI，该GUI为手机的设置界面。该GUI包括多个功能选项，该多个功能选项中包括无线和网络、设备连接、桌面和壁纸、声音、通知中心、应用和通知等，其中，用户可以通过应用和通知进行权限管理、默认应用和通知管理等功能的设置。当手机检测到与用户点击应用和通知功能1102的操作后，显示如图11中的(c)所示的GUI。
参见图11中的(c)所示的GUI，该GUI为手机的应用和通知功能设置界面。该GUI包括对无线和网络下多个功能选项，该多个功能选项包括权限管理、默认应用、应用分身和跨设备通知等。当手机检测到用户点击跨设备通知功能1103的操作后，显示如图11中的(d)所示的GUI。
参见图11中的(d)所示的GUI，该GUI为手机的跨设备通知功能设置界面。该GUI包括跨设备通知下多个功能选项，其中包括跨设备通知的开关控件、通知类型、设备管理以及设备授权。其中跨设备通知的开关控件下包括对跨设备通知的功能描述“当通知来时，若您在使用其他设备，则转发通知到该设备”。当手机检测到用户点击通知类型1104的操作时，手机可以显示如图11中的(e)所示的GUI。
参见图11中的(e)所示的GUI，该GUI为手机的通知类型设置界面。用户可以从如图11中的(e)所示的通知类型中选择其希望转发的应用程序的通知消息。示例性的，用户可以选择App5和App7的通知消息的类型作为希望转发的通知消息。
本申请实施例中，用户可以通过设置选项选择自己希望转发的应用程序的通知消息，这样可以避免不必要的通知消息转发给用户带来的骚扰。
一个实施例中，source端在向sink端发送通知消息之前，确定sink端为用户设置的接收通知消息转发的设备；或者在向第二电子设备发送通知消息之前，确定source端上登录的账号和sink端上登录的账号相关联。
下面结合图12和图13介绍source端(例如，手机)选择接收sink端的过程。
当手机检测到用户点击了如图12中的(a)所示的设备管理1201后，手机可以显示如图12中的(b)所示的GUI。
参见图12中的(b)所示的GUI，该GUI为设备管理功能显示界面。其中设备管理中包括了我的设备和其他设备。其中，我的设备为与手机登录了同一华为ID的设备。示例性的，我的设备中包括平板“HUAWEI MatePad Pro”、智能手表“HUAWEI WATCH GT 2”、另一手机“HUAWEI P40 Pro”、笔记本电脑“HUAWEI MateBook X”以及智能音箱“HUAWEI Sound X”。当手机选择了以上所有的设备后，手机可以在上述设备转发通知消息。
用户可以选择同一华为ID下的设备作为通知消息的转发对象，也可以选择不是同一华为ID下的设备作为转发对象。示例性的，当手机检测到用户点击了如图13中的(a)所示的设备授权1301后，手机可以显示如图13中的(b)所示的GUI。
参见图13中的(b)所示的GUI，该GUI为设备授权功能显示界面。该显示界面下包括添加设备选项以及附近设备选项。其中，对于添加设备的描述为您可以添加其他华为ID下的设备添加到其他设备中。例如，用户可以添加家庭群组中其他家庭成员的华为ID， 那么其他家庭成员的华为ID下的设备就可以出现在如图12中的(b)所示的其他设备中。当手机检测到用户打开附近设备的控件的操作后，手机可以搜索附近设备且显示如图13中的(c)所示的GUI。
参见图13中的(c)所示的GUI，该GUI为设备授权功能的另一显示界面。该显示界面上显示手机搜索到的附近设备包括iphone 11Pro、iPad Pro 11以及小米10Pro。当手机检测到用户点击添加iPad Pro 11以及小米10Pro的操作后，手机可以将这两个设备添加到设备管理中的其他设备中。
参见图13中的(d)所示的GUI，该GUI为设备管理的另一显示界面。该显示界面上的“其他设备”中增加了附近的两个设备iPad Pro 11以及小米10Pro。
本申请实施例中，手机可以通过蓝牙、Wi-Fi等短距离通讯的方式搜索到周围的其他设备。示例性的，手机在检测到用户点击添加iPad Pro 11以及小米10Pro的操作后，可以向这两个设备发送BLE数据包，其中BLE数据包中可以携带请求添加为通知消息转发的设备的请求信息(该请求信息可以携带在服务数据字段中的可扩展比特位上)。若手机接收到两台设备的响应(例如，ACK信息)，那么手机可以成功将两台设备添加到“其他设备”中。进一步的，在iPad Pro 11以及小米10Pro上，可以通过提醒框提示用户是否同意手机的添加请求。若iPad Pro 11以及小米10Pro检测到用户指示同意添加为通知消息转发的设备的请求，那么这两台设备可以向手机发送响应。
图14示出了本申请实施例提供的快捷回复的方法1400的示意性流程图。如图14所示，该方法1400可以由第一电子设备和第二电子设备执行，该第一电子设备可以为上述图8中的source端，该第二电子设备可以为上述图8中的sink端，该方法1400包括：
S1401，第一电子设备接收消息。
示例性的，如图3中的(a)所示，该第一电子设备可以为手机，手机接收到用户Tom发送的消息。
示例性的，如图6中的(a)所示，该第一电子设备可以为手机，手机接收到用户Tom发送的消息。
应理解，本申请实施例中的消息可以是不同应用程序的服务器发送的消息，消息的类型包括但不限于文本、语音、音频、视频、链接、分享(例如，位置分享)、邀请(例如，邀请加入群组)等等类型。
S1402，第一电子设备在确定该第一电子设备的机主聚焦的设备为第二电子设备时，向第二电子设备发送该消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件。
可选地，该指示信息可以为快捷回复flag属性。
应理解，该第一电子设备向第二电子设备发送消息以及指示信息的过程可以参考上述实施例中的描述，为了简洁，在此不再赘述。
一个实施例中，第一电子设备在确定第一电子设备的机主的焦点不在第一电子设备上时，第一电子设备可以向周围设备发送请求信息，该请求信息用于请求周围设备确定第一电子设备的机主的焦点是否在周围设备上；或者，第一电子设备也可以保存消息转发的设备列表，第一电子设备在确定第一电子设备的机主焦点不在第一电子设备上时，第一电子设备可以向设备列表中的设备发送请求信息。
一个实施例中，若第二电子设备为第一电子设备的设备列表中的电子设备且第二电子设备中保存有第一电子设备机主的用户特征(例如，第二电子设备和第一电子设备为同一用户下的两个设备(登录同一华为ID)，那么第一电子设备和第二电子设备中可以保存相同的用户特征(例如，指纹信息、人脸信息、声纹信息、虹膜信息等等))，第一电子设备可以通过服务器或者通过短距离通信的方式向第二电子设备发送请求信息。第二电子设备在接收到第一电子设备发送的请求信息后，可以通过采集用户的特征并判断用户的特征与预置的第一电子设备的机主的用户特征是否匹配。若匹配，则向第一电子设备发送响应信息，该响应信息用于指示第一电子设备的机主正在聚焦第二电子设备。第二电子设备在接收到该响应信息后，可以向第二电子设备发送该消息。
示例性的，该请求信息可以携带在BLE数据包中。BLE数据包中包括PDU，该请求信息可以携带PDU中的服务数据字段中，或者，也可以携带在PDU中厂商特定数据字段中。例如，服务数据字段的负荷(payload)中可以包括多个比特位，其中，多个比特位中包括可扩展的比特位。第一电子设备和第二电子设备可以提前约定某个比特位进行请求信息的传输。当这个可扩展的比特位为预设值(例如，1)时，第二电子设备就可以获知第一电子设备请求其确定用户是否聚焦在该设备上。
一个实施例中，第一电子设备可以保存焦点设备判断的优先级。示例性的，优先级排序可以为：
(1)视觉焦点；
(2)贴身设备；
(3)交互焦点。
应理解，视觉焦点设备可以是具备摄像头的设备，例如，智能电视、平板电脑、笔记本电脑等等；贴身设备可以是用户的可穿戴设备，例如，VR/AR眼镜、智能手表、智能手环等等；交互设备可以是具有输入操控的设备，例如，具有键盘、鼠标、触控、遥控器、语音输入的设备等。
如果第一电子设备中保存有消息转发的设备列表，那么第一电子设备可以向设备列表中的设备发送请求信息。第一电子设备在向设备列表中的设备发送请求信息时，可以是按照设备的优先级来发送。
例如，第一电子设备(例如，手机)的设备列表中的设备中包括智能电视和智能手表，那么手机可以先向智能电视(保存有第一电子设备的机主的人脸信息)发送请求信息，该请求信息用于请求智能电视判断第一电子设备的机主当前的焦点是否在智能电视上。智能电视在接收到该请求信息后，可以通过开启摄像头的方式判断手机的机主的焦点是否在智能电视上。若智能电视通过摄像头采集的人脸信息与预置的人脸信息，确定手机的机主当前的焦点设备在智能电视上，那么智能电视可以向手机发送响应，该响应用于指示手机的机主当前的焦点在智能电视上。手机在接收到该响应后，可以不再向设备列表中的其他设备发送请求信息。若手机在预设时长内没有接收到智能电视的响应(或者，手机接收到智能电视发送的响应，该响应指示手机的机主当前的焦点不在智能电视上)，那么手机可以继续向智能手表(保存有第一电子设备的机主的心率信息)发送请求信息。智能手表在接收到手机发送的请求信息后，可以基于传感器检测手机的机主是否正在佩戴可穿戴设备。例如，智能手表中的利用光电容积扫描(photo plethysmo graph，PPG)传感器可以通过检 测到的心率信息与预置的心率信息，来判断第一电子设备的机主是否正在佩戴智能手表。若智能手表判断手机的机主正在佩戴智能手表，那么智能手表可以向手机发送响应，该响应用于指示手机的机主当前正在佩戴智能手表。
第一电子设备在向设备列表中的设备发送请求信息时，也可以是同时向设备列表中的多个设备发送请求信息。
例如，手机的设备列表中的设备中包括智能电视和智能手表，那么手机可以先向智能电视和智能手表同时发送请求信息。如果手机只直接收到智能电视的响应，那么手机可以将消息转发给智能电视；或者，如果手机只接收到智能手表的响应，那么手机可以将消息转发给智能手表；或者，如果手机接收到了智能电视和智能手表的响应，那么手机可以根据设备的优先级，向智能电视转发该消息。
示例性的，该响应信息可以携带在BLE数据包中PDU的服务数据字段或者厂商特定数据字段中。例如，在服务数据字段的负荷中可扩展的比特位上可以携带该响应信息。第一电子设备可以和第二电子设备提前约定某个可扩展比特位进行响应信息的传输。当这个可扩展的比特位为预设值(例如，1)时，表示第二电子设备确定用户聚焦的设备为第二电子设备。
一个实施例中，若第二电子设备为第一电子设备的设备列表中的电子设备且第二电子设备中未保存有第一电子设备机主的用户特征，或者，第一电子设备中没有设备列表，第二电子设备为第一电子设备周围的设备。那么第一电子设备在确定第一电子设备的机主没有聚焦在第一电子设备上时，可以向第二电子设备发送该请求信息；第二电子设备在接收到该请求信息后，可以通过用户特征采集装置采集用户特征，并将采集的用户特征发送给第一电子设备。第一电子设备在确定第二电子设备采集的用户特征与第一电子设备中预置的用户特征匹配时，可以向第二电子设备发送该消息。
应理解，对于第二电子设备为第一电子设备的设备列表中的电子设备且第二电子设备中保存有第一电子设备机主的用户特征这种情况，第二电子设备在接收到请求信息后也可以采集用户的特征并向第一电子设备发送用户的特征，从而由第一电子设备根据第二电子设备采集的用户的特征以及预置的用户特征来判断第一电子设备的机主是否聚焦第二电子设备。
示例性的，第二电子设备向第一电子设备发送的用户特征可以携带PDU中的服务数据字段或者厂商特定字段中。
例如，第二电子设备包括摄像头。第二电子设备在接收到该请求信息后，可以通过摄像头采集人脸信息并发送给第一电子设备。第一电子设备根据该人脸信息判断是否为用户本人。例如，第一电子设备可以将第二电子设备采集的人脸信息和第一电子设备中预置的人脸信息进行匹配，若匹配成功，则确定第一电子设备的机主当前聚焦的是第二电子设备。
又例如，第二电子设备包括麦克风，第二电子设备在接收到该请求信息后，可以通过麦克风采集用户发送的语音信息并发送给第一电子设备。第一电子设备根据该语音信息判断是否为用户本人。例如，第一电子设备可以提取第二电子设备采集的语音信息中的声纹信息，第一电子设备将提取的声纹信息和第一电子设备中预置的声纹信息进行匹配，若匹配成功，则确定用户当前聚焦的是第二电子设备。
本申请实施例中，第一电子设备在向第二电子设备请求第一电子设备的机主是否聚焦 第二电子设备时，第二电子设备可以向第一电子设备发送其采集的用户特征，这样可以使得第一电子设备根据接收到的用户特征与预置的用户特征来判断第二电子设备是否为第一电子设备的机主聚焦的设备。这样有利于提升消息转发时的安全性，避免了用户的隐私泄露，从而有助于提升用户体验。
S1403，第二电子设备显示消息提醒框，该消息提醒框中包括该消息和该回复控件。
示例性的，如图3中的(a)所示，第二电子设备可以为平板。当平板接收到手机发送的消息以及指示信息后，可以显示消息提醒框301，其中消息提醒框301中包括消息“Happy Birthday！”以及回复控件302。
示例性的，如图6中的(a)所示，第二电子设备可以为笔记本电脑。当笔记本电脑接收到手机发送的消息以及指示信息后，可以显示消息提醒框601，其中消息提醒框601中包括消息“请把项目计划发给我”以及回复控件602。
S1404，第二电子设备在检测到用户对该消息进行回复的操作时，向第一电子设备发送回复内容。
示例性的，如图3中的(b)所示，当平板检测到用户点击控件304的操作后，平板可以将文本输入框303中的回复内容发送给手机。
示例性的，如图4中的(b)所示，当笔记本电脑检测到用户点击控件405的操作后，笔记本电脑可以将文本输入框404中的回复内容发送给手机。
S1405，第一电子设备根据该回复内容，对该消息进行回复。
本申请实施例中，第一电子设备对该消息进行回复的方式可以参照图8中source端的事件处理模块对消息进行真实回复的过程，为了简洁，在此不再赘述。
示例性的，如图3中的(c)至(e)所示，或者，如图4中的(c)至(e)所示，手机可以先打开社交App，然后打开与用户Tom的聊天界面，最后将回复内容“Thank you！”拖拽至对消息“Happy Birthday！”回复的位置。
可选地，该方法1100还包括：第一电子设备向第二电子设备发送该消息的标识信息；该第二电子设备在检测到用户对该消息进行回复的操作时，向第二电子设备发送经过标识信息标识后的回复内容。示例性的，第一电子设备向第二电子设备发送的消息体中可以携带消息的内容、指示信息以及消息的标识信息。
可选地，该标识信息可以为消息的通知ID属性和/或通知channel属性。
示例性的，如图4中的(a)所示，手机接收到两条消息(消息1来自Tom，消息2来自Amy)。此时，手机在向笔记本电脑发送经过标识信息1标识后的消息1、经过标识信息2标识后的消息2以及该指示信息。
这样笔记本电脑在接收到上述信息后，可以显示消息提醒框401和消息提醒框402。当笔记本电脑检测到用户对消息1回复的操作时，笔记本电脑可以向手机发送经过标识信息1标识后的回复内容(例如，“Thank you！”)。通过对消息进行标识，可以使得手机明确笔记本电脑发送的回复内容是对哪一条消息的回复。
本申请实施例中，当第一电子设备接收到多条消息时，第一电子设备可以对多条消息进行标识，这样可以使得第一电子设备对第二电子设备发送的回复内容进行区分，从而使得第一电子设备可以准确的对多条消息进行回复。
可选地，该方法还包括：第一电子设备在接收到消息之前，显示第一界面；第一电子 设备在对该消息进行回复之后，显示该第一界面。
本申请实施例中，第一电子设备接收到第二电子设备发送的回复内容后，可以完成对该消息的真实回复。在回复完成之后，可以继续显示接收到消息之前的状态。通过恢复第一电子设备原有的状态，让用户对快捷回复功能无感知，可以进一步提升用户的体验。
可选地，该消息的内容为文本信息，该第二电子设备包括语音功能，该第二电子设备在接收到该消息后，通过语音向用户提示该文本信息。
示例性的，如图5中的GUI所示，车机包括语音功能，那么车机在接收到手机发送的消息后，还可以通过语音向用户提示该文本信息。例如，车机通过语音提示用户“Tom通过社交App向您发送Happy Birthday！”。
本申请实施例中，对于第二电子设备为车机的场景，车机可以通过语音播报的方式向用户提示该消息的内容，这样可以避免用户因为查看该消息而造成分神，从而有助于提升用户驾驶的安全性。
可选地，该第二电子设备在向用户发送回复内容之前，采集用户回复的语音信息；第二电子设备向第一电子设备发送该语音信息，或者，第二电子设备向第一电子设备发送该语音信息对应的文本信息。
示例性的，如图5所示的GUI，用户回复了语音信息“Thank you！”。车机可以向手机发送该语音信息，或者，车机也可以向手机发送该语音信息对应的文本信息。
一个实施例中，第二电子设备也可以向第一电子设备发送该语音信息；该第一电子设备可以根据该语音信息，对该消息进行回复；或者，该第一电子设备可以根据该语音信息对应的文本信息，对该消息进行回复。
可选地，该回复内容为文件。
示例性的，如图6中的(b)所示，当笔记本电脑检测到用户将word文件(项目计划.doc)拖拽至文本输入框后，笔记本电脑可以向手机发送该word文件。
可选地，该文件还可以为多媒体文件，例如，照片、视频、音频等等。
本申请实施例中，用户可以直接在第二电子设备上完成对消息的回复，而无需回到第一电子设备对消息进行处理。这样可以避免用户错过重要的信息，同时也避免了用户在回到第一电子设备上进行消息处理的过程，有助于提升用户的体验。
图15示出了本申请实施例提供的回复消息的装置1500的示意性框图。该装置1500可以设置于上述第一电子设备中，该装置1500中包括：第一接收单元1510，用于接收消息；发送单元1520，用于在确定该第一电子设备的机主聚焦的设备为第二电子设备时，向该第二电子设备发送该消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；第二接收单元1530，还用于接收该第二电子设备发送的对该消息的回复内容；回复单元1540，用于根据该回复内容，对该消息进行回复。
图16示出了本申请实施例提供的回复消息的装置1600的示意性框图。该装置1600可以设置于上述第二电子设备中，该装置1600中包括：接收单元1610，用于接收第一电子设备发送的消息和指示信息，该指示信息用于指示该第二电子设备增加对该消息的回复控件；显示单元1620，用于显示消息提醒框，该消息提醒框中包括该消息以及该回复控件；发送单元1630，用于在检测到用户对该消息进行回复的操作时，向该第一电子设备 发送回复内容。
图17示出了本申请实施例提供的电子设备1700的示意性结构图。如图17所示，该电子设备包括：一个或多个处理器1710，一个或多个存储器17220，该一个或多个存储器存储1720存储有一个或多个计算机程序，该一个或多个计算机程序包括指令。当该指令被所述一个或多个处理器1710运行时，使得第一电子设备执行上述实施例中的技术方案；或者，当该指令被所述一个或多个处理器1710运行时，使得第二电子设备执行上述实施例中的技术方案。其实现原理和技术效果与上述方法相关实施例类似，此处不再赘述。
本申请实施例提供了一种回复消息的系统，包括第一电子设备和第二电子设备，该系统用于执行上述实施例中回复消息的技术方案。其实现原理和技术效果与上述方法相关实施例类似，此处不再赘述。
本申请实施例提供一种计算机程序产品，当所述计算机程序产品在第一电子设备运行时，使得第一电子设备执行上述实施例中的技术方案；或者，当所述计算机程序产品在第二电子设备运行时，使得第二电子设备执行上述实施例中的技术方案。其实现原理和技术效果与上述方法相关实施例类似，此处不再赘述。
本申请实施例提供一种可读存储介质，所述可读存储介质包含指令，当所述指令在第一电子设备运行时，使得所述第一电子设备执行上述实施例的技术方案；或者，当所述指令在第二电子设备运行时，使得所述第二电子设备执行上述实施例的技术方案。其实现原理和技术效果类似，此处不再赘述。
本申请实施例提供一种芯片，所述芯片用于执行指令，当所述芯片运行时，执行上述实施例中的技术方案。其实现原理和技术效果类似，此处不再赘述。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储 在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (31)

  1. 一种系统，所述系统包括第一电子设备和第二电子设备，其特征在于，
    所述第一电子设备，用于接收消息；
    所述第一电子设备，还用于在确定所述第一电子设备的机主聚焦的设备为所述第二电子设备时，向所述第二电子设备发送所述消息和指示信息，所述指示信息用于指示所述第二电子设备增加对所述消息的回复控件；
    所述第二电子设备，用于显示消息提醒框，所述消息提醒框中包括所述消息以及所述回复控件；
    所述第二电子设备，还用于在检测到用户对所述消息进行回复的操作时，向所述第一电子设备发送回复内容；
    所述第一电子设备，还用于根据所述回复内容，对所述消息进行回复。
  2. 根据权利要求1所述的系统，其特征在于，所述第一电子设备具体用于：向所述第二电子设备发送经过标识信息标识后的所述消息；
    所述第二电子设备具体用于：向所述第一电子设备发送经过所述标识信息标识后的所述回复内容。
  3. 根据权利要求1或2所述的系统，其特征在于，所述第一电子设备，还用于在接收所述消息之前，显示第一界面；
    在对所述消息进行回复之后，显示所述第一界面。
  4. 根据权利要求1至3中任一项所述的系统，其特征在于，所述消息的内容为文本信息，所述第二电子设备包括语音功能，所述第二电子设备还用于：
    在接收到所述消息后，通过语音向用户提示所述文本信息。
  5. 根据权利要求4所述的系统，其特征在于，所述第二电子设备具体用于：
    在向所述第一电子设备发送所述回复内容之前，采集用户回复的语音信息；
    向所述第一电子设备发送所述语音信息，或者，向所述第一电子设备发送所述语音信号对应的文本信息。
  6. 根据权利要求1至3中任一项所述的系统，其特征在于，所述回复内容包括文件。
  7. 根据权利要求1至6中任一项所述的系统，其特征在于，所述第一电子设备还用于：在向所述第二电子设备发送所述消息和所述指示信息之前，确定所述消息的类型为用户设置的消息类型；或者，
    在向所述第二电子设备发送所述消息和所述指示信息之前，确定所述消息为即时通讯IM类的消息。
  8. 根据权利要求1至7中任一项所述的系统，其特征在于，所述第一电子设备还用于：在向所述第二电子设备发送所述消息和所述指示信息之前，确定所述第二电子设备为用户设置的接收消息转发的设备；或者
    在向所述第二电子设备发送所述消息和所述指示信息之前，确定所述第一电子设备上登录的账号和所述第二电子设备上登录的账号相关联。
  9. 根据权利要求1至8中任一项所述的系统，其特征在于，所述第一电子设备具体 用于：在确定所述第一电子设备的机主当前聚焦的设备不是所述第一电子设备时，向所述第二电子设备发送请求信息，所述请求信息用于请求所述第二电子设备确定所述第一电子设备的机主是否聚焦所述第二电子设备；
    所述第二电子设备，还用于根据所述请求信息，向所述第一电子设备发送响应信息，所述响应信息用于指示所述第一电子设备的机主当前聚焦的设备为所述第二电子设备；
    所述第一电子设备具体用于：响应于接收到所述响应信息，向所述第二电子设备发送所述消息。
  10. 根据权利要求1至8中任一项所述的系统，其特征在于，所述第二电子设备包括用户特征采集装置，所述第一电子设备具体用于：在确定所述第一电子设备的机主当前聚焦的设备不是所述第一电子设备时，向所述第二电子设备发送请求信息，所述请求信息用于请求所述第二电子设备确定所述第一电子设备的机主是否聚焦所述第二电子设备；
    所述第二电子设备还用于：根据所述请求信息，通过所述用户特征采集装置采集用户特征并向所述第一电子设备发送所述用户特征；
    所述第一电子设备具体用于：在向所述第二电子设备发送所述消息之前，确定所述用户特征与所述第一电子设备中预置用户特征匹配。
  11. 根据权利要求1至10中任一项所述的系统，其特征在于，所述消息为第一应用程序的消息，所述第二电子设备为未安装所述第一应用程序的设备。
  12. 一种回复消息的方法，所述方法应用于第一电子设备，其特征在于，所述方法包括：
    所述第一电子设备接收消息；
    在确定所述第一电子设备的机主聚焦的设备为第二电子设备时，所述第一电子设备向所述第二电子设备发送所述消息和指示信息，所述指示信息用于指示所述第二电子设备增加对所述消息的回复控件；
    所述第一电子设备接收所述第二电子设备发送的对所述消息的回复内容；
    所述第一电子设备根据所述回复内容，对所述消息进行回复。
  13. 根据权利要求12所述的方法，其特征在于，所述第一电子设备向所述第二电子设备发送所述消息，包括：
    所述第一电子设备向所述第二电子设备发送经过标识信息标识后的所述消息；
    其中，所述第一电子设备接收所述第二电子设备发送的对所述消息的回复内容，包括：
    所述第一电子设备接收所述第二电子设备发送的经过所述标识信息标识后的所述回复内容。
  14. 根据权利要求12或13所述的方法，其特征在于，所述方法还包括：
    在接收所述消息之前，所述第一电子设备显示第一界面；
    在对所述消息进行回复之后，所述第一电子设备显示所述第一界面。
  15. 根据权利要求12至14中任一项所述的方法，其特征在于，所述回复内容为语音信息，或者，所述回复内容为所述语音信息对应的文本信息；
    其中，所述语音信息为第二电子设备采集的用户回复的语音信息。
  16. 根据权利要求12至14中任一项所述的方法，其特征在于，所述回复内容为文件。
  17. 根据权利要求12至16中任一项所述的方法，其特征在于，所述方法还包括：
    在向所述第二电子设备发送所述消息和所述指示信息之前，所述第一电子设备确定所述消息的类型为用户设置的消息类型；或者，
    在向所述第二电子设备发送所述消息和所述指示信息之前，所述第一电子设备确定所述消息为即时通讯IM类的消息。
  18. 根据权利要求12至17中任一项所述的方法，其特征在于，所述方法还包括：
    在向所述第二电子设备发送所述消息和所述指示信息之前，所述第一电子设备确定所述第二电子设备为用户设置的接收消息转发的设备；或者
    在向所述第二电子设备发送所述消息和所述指示信息之前，所述第一电子设备确定所述第一电子设备上登录的账号和所述第二电子设备上登录的账号相关联。
  19. 根据权利要求12至18中任一项所述的方法，其特征在于，所述第一电子设备向所述第二电子设备发送所述消息和指示信息之前，所述方法还包括：
    所述第一电子设备在确定所述第一电子设备的机主当前聚焦的设备不是所述第一电子设备时，向所述第二电子设备发送请求信息，所述请求信息用于请求所述第二电子设备确定所述第一电子设备的机主是否聚焦所述第二电子设备；
    所述第一电子设备接收所述第二电子设备发送的响应信息，所述响应信息用于指示所述第一电子设备的机主当前聚焦的设备为所述第二电子设备。
  20. 根据权利要求12至18中任一项所述的方法，其特征在于，所述第一电子设备向所述第二电子设备发送所述消息和指示信息之前，所述方法还包括：
    所述第一电子设备在确定所述第一电子设备的机主当前聚焦的设备不是所述第一电子设备时，向所述第二电子设备发送请求信息，所述请求信息用于请求所述第二电子设备确定所述第一电子设备的机主是否聚焦所述第二电子设备；
    所述第一电子设备接收所述第二电子设备发送的用户特征，所述用户特征为所述第二电子设备通过用户特征采集装置采集的用户特征；
    所述第一电子设备确定所述用户特征与所述第一电子设备中预置的用户特征匹配。
  21. 一种回复消息的方法，所述方法应用于第二电子设备，其特征在于，所述方法包括：
    所述第二电子设备接收第一电子设备发送的消息和指示信息，所述指示信息用于指示所述第二电子设备增加对所述消息的回复控件；
    所述第二电子设备显示消息提醒框，所述消息提醒框中包括所述消息以及所述回复控件；
    在检测到用户对所述消息进行回复的操作时，所述第二电子设备向所述第一电子设备发送回复内容。
  22. 根据权利要求21所述的方法，其特征在于，所述方法还包括：
    所述第二电子设备接收所述第一电子设备发送的经过标识信息标识后的所述消息；
    其中，所述第二电子设备向所述第一电子设备发送回复内容，包括：
    所述第二电子设备向所述第一电子设备发送经过所述标识信息后的所述回复内容。
  23. 根据权利要求21或者22所述的方法，其特征在于，所述消息的内容为文本信息，所述第二电子设备包括语音功能，所述方法还包括：
    在接收到所述消息后，所述第二电子设备通过语音向用户提示所述文本信息。
  24. 根据权利要求23所述的方法，其特征在于，所述第二电子设备向所述第一电子设备发送回复内容，包括：
    所述第二电子设备采集用户回复的语音信息；
    所述第二电子设备向所述第一电子设备发送所述语音信息，或者，向所述第一电子设备发送所述语音信号对应的文本信息。
  25. 根据权利要求21或22所述的方法，其特征在于，所述回复内容包括文件。
  26. 根据权利要求21至25中任一项所述的方法，其特征在于，所述第二电子设备接收第一电子设备发送的消息和指示信息之前，所述方法还包括：
    所述第二电子设备接收所述第一电子设备发送的请求信息，所述请求信息用于请求所述第二电子设备确定所述第一电子设备的机主是否聚焦所述第二电子设备；
    所述第二电子设备根据所述请求信息，向所述第一电子设备发送响应信息，所述响应信息用于指示所述第一电子设备的机主当前聚焦的设备为所述第二电子设备。
  27. 根据权利要求21至25中任一项所述的方法，其特征在于，所述第二电子设备包括用户特征采集装置，所述第二电子设备接收第一电子设备发送的消息和指示信息之前，所述方法还包括：
    所述第二电子设备接收所述第一电子设备发送的请求信息，所述请求信息用于请求所述第二电子设备确定所述第一电子设备的机主是否聚焦所述第二电子设备；
    所述第二电子设备根据所述请求信息，通过所述用户特征采集装置采集用户特征并向所述第一电子设备发送所述用户特征。
  28. 根据权利要求21至27中任一项所述的方法，其特征在于，所述消息为第一应用程序的消息，所述第二电子设备为未安装所述第一应用程序的设备。
  29. 一种电子设备，其特征在于，一个或多个处理器；一个或多个存储器；所述一个或多个存储器存储有一个或者多个计算机程序，所述一个或者多个计算机程序包括指令，当所述指令被所述一个或多个处理器执行时，使得所述电子设备执行如权利要求12至20中任一项所述的回复消息的方法。
  30. 一种电子设备，其特征在于，一个或多个处理器；一个或多个存储器；所述一个或多个存储器存储有一个或者多个计算机程序，所述一个或者多个计算机程序包括指令，当所述指令被所述一个或多个处理器执行时，使得所述电子设备执行如权利要求21至28中任一项所述的回复消息的方法。
  31. 一种计算机可读存储介质，其特征在于，包括计算机指令，当所述计算机指令在电子设备上运行时，使得所述电子设备执行如权利要求12至20中任一项所述的回复消息的方法；或者，
    当所述计算机指令在电子设备上运行时，使得所述电子设备执行如权利要求21至28中任一项所述的回复消息的方法。
PCT/CN2021/110420 2020-08-20 2021-08-04 一种回复消息的方法、电子设备和系统 WO2022037407A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21857502.5A EP4187891A4 (en) 2020-08-20 2021-08-04 METHOD AND SYSTEM FOR RESPONDING TO A MESSAGE, AND ELECTRONIC DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010844642.5 2020-08-20
CN202010844642.5A CN114173000B (zh) 2020-08-20 2020-08-20 一种回复消息的方法、电子设备和系统、存储介质

Publications (1)

Publication Number Publication Date
WO2022037407A1 true WO2022037407A1 (zh) 2022-02-24

Family

ID=80323360

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/110420 WO2022037407A1 (zh) 2020-08-20 2021-08-04 一种回复消息的方法、电子设备和系统

Country Status (3)

Country Link
EP (1) EP4187891A4 (zh)
CN (1) CN114173000B (zh)
WO (1) WO2022037407A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024002072A1 (zh) * 2022-06-28 2024-01-04 维沃移动通信有限公司 信息收集方法、装置和电子设备

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116932181A (zh) * 2022-03-30 2023-10-24 华为技术有限公司 一种能力调用方法、系统及电子设备
CN117349871A (zh) * 2022-06-27 2024-01-05 华为技术有限公司 消息管理方法、电子设备及系统
CN117357909A (zh) * 2022-07-01 2024-01-09 腾讯科技(成都)有限公司 虚拟场景中的消息处理方法、装置、电子设备及存储介质
CN114915607B (zh) * 2022-07-18 2022-10-11 荣耀终端有限公司 一种通知消息的处理方法、电子设备及系统
CN118092834A (zh) * 2022-11-28 2024-05-28 华为技术有限公司 跨设备切换焦点的方法、电子设备及系统

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201033818A (en) * 2009-03-10 2010-09-16 Inventec Appliances Corp Message display and reply system and method thereof
CN103037319A (zh) * 2011-09-30 2013-04-10 联想(北京)有限公司 通信转移方法、移动终端及服务器
CN103916984A (zh) * 2013-01-05 2014-07-09 苏州三星电子电脑有限公司 电脑与手机的接管通讯方法
TWM502853U (zh) * 2015-02-03 2015-06-11 Royaltek Company Ltd 將即時訊息顯示於抬頭顯示器上之車載結構
WO2015196656A1 (zh) * 2014-06-27 2015-12-30 中兴通讯股份有限公司 通知消息处理方法、终端及计算机存储介质
CN109088815A (zh) * 2018-08-30 2018-12-25 Oppo广东移动通信有限公司 消息提醒方法、装置、存储介质、移动终端及穿戴式设备
CN109275032A (zh) * 2018-10-08 2019-01-25 深圳康佳电子科技有限公司 基于智能电视的手机操控交互处理方法、系统及存储介质
US20190313367A1 (en) * 2014-05-23 2019-10-10 Samsung Electronics Co., Ltd. Method and apparatus for providing notification
CN112134788A (zh) * 2020-09-18 2020-12-25 Oppo广东移动通信有限公司 事件处理方法、装置、存储介质、移动终端及电脑

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11157148B2 (en) * 2014-07-24 2021-10-26 Blackberry Limited System, method and device-readable medium for message composition within a unified event view
CN104822128A (zh) * 2015-04-02 2015-08-05 深圳市金立通信设备有限公司 一种通信事件提醒方法
CN105049329A (zh) * 2015-07-08 2015-11-11 杭州木梢科技有限公司 一种家居环境下的随身消息推送方法及设备控制系统
KR102683651B1 (ko) * 2017-01-17 2024-07-11 삼성전자주식회사 메시지 생성 방법 및 이를 지원하는 웨어러블 전자 장치
CN111010479A (zh) * 2019-12-04 2020-04-14 深圳传音控股股份有限公司 一种信息共享方法、移动终端及计算机存储介质
CN111404802A (zh) * 2020-02-19 2020-07-10 华为技术有限公司 通知处理系统、方法以及电子设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201033818A (en) * 2009-03-10 2010-09-16 Inventec Appliances Corp Message display and reply system and method thereof
CN103037319A (zh) * 2011-09-30 2013-04-10 联想(北京)有限公司 通信转移方法、移动终端及服务器
CN103916984A (zh) * 2013-01-05 2014-07-09 苏州三星电子电脑有限公司 电脑与手机的接管通讯方法
US20190313367A1 (en) * 2014-05-23 2019-10-10 Samsung Electronics Co., Ltd. Method and apparatus for providing notification
WO2015196656A1 (zh) * 2014-06-27 2015-12-30 中兴通讯股份有限公司 通知消息处理方法、终端及计算机存储介质
TWM502853U (zh) * 2015-02-03 2015-06-11 Royaltek Company Ltd 將即時訊息顯示於抬頭顯示器上之車載結構
CN109088815A (zh) * 2018-08-30 2018-12-25 Oppo广东移动通信有限公司 消息提醒方法、装置、存储介质、移动终端及穿戴式设备
CN109275032A (zh) * 2018-10-08 2019-01-25 深圳康佳电子科技有限公司 基于智能电视的手机操控交互处理方法、系统及存储介质
CN112134788A (zh) * 2020-09-18 2020-12-25 Oppo广东移动通信有限公司 事件处理方法、装置、存储介质、移动终端及电脑

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4187891A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024002072A1 (zh) * 2022-06-28 2024-01-04 维沃移动通信有限公司 信息收集方法、装置和电子设备

Also Published As

Publication number Publication date
CN114173000B (zh) 2023-02-07
EP4187891A1 (en) 2023-05-31
CN114173000A (zh) 2022-03-11
EP4187891A4 (en) 2024-01-24

Similar Documents

Publication Publication Date Title
WO2021164445A1 (zh) 一种通知处理方法、电子设备和系统
WO2022037407A1 (zh) 一种回复消息的方法、电子设备和系统
EP4113415A1 (en) Service recommending method, electronic device, and system
CN113885759B (zh) 通知消息处理方法、设备、系统及计算机可读存储介质
CN114173204B (zh) 一种提示消息的方法、电子设备和系统
US20230216990A1 (en) Device Interaction Method and Electronic Device
WO2019072178A1 (zh) 一种通知处理方法及电子设备
EP4333413A2 (en) Method for presenting video on electronic device when there is incoming call and electronic device
WO2020224447A1 (zh) 一种在联系人中添加智能家居设备的方法及系统
US12058486B2 (en) Method and apparatus for implementing automatic translation by using a plurality of TWS headsets connected in forwarding mode
WO2022037480A1 (zh) 任务处理方法及相关电子设备
EP4293997A1 (en) Display method, electronic device, and system
WO2023015963A1 (zh) 管理文件的方法、电子设备和计算机可读存储介质
WO2021143391A1 (zh) 基于视频通话的共享屏幕方法及移动设备
EP4287014A1 (en) Display method, electronic device, and system
CN114006712A (zh) 一种获取验证码的方法、电子设备和系统
WO2022095820A1 (zh) 一种文本输入的方法、电子设备和系统
WO2021052388A1 (zh) 一种视频通信方法及视频通信装置
WO2023011289A1 (zh) 一种基于位置信息的Wi-Fi连接方法及装置
WO2022135254A1 (zh) 一种编辑文本的方法、电子设备和系统
WO2020216144A1 (zh) 一种添加邮件联系人的方法和电子设备
WO2022052767A1 (zh) 一种控制设备的方法、电子设备和系统
WO2022222733A1 (zh) 数据传输方法及相关设备
CN114071055B (zh) 一种快速加入会议的方法以及相关设备
WO2023155583A1 (zh) 跨设备应用程序管理的方法、电子设备及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21857502

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021857502

Country of ref document: EP

Effective date: 20230221

NENP Non-entry into the national phase

Ref country code: DE