WO2020119492A1

WO2020119492A1 - Message processing method and related apparatus

Info

Publication number: WO2020119492A1
Application number: PCT/CN2019/122234
Authority: WO
Inventors: 陈祥
Original assignee: 华为技术有限公司
Priority date: 2018-12-10
Filing date: 2019-11-30
Publication date: 2020-06-18
Also published as: CN109814767A

Abstract

Disclosed is a message processing method and a related apparatus. The method comprises: when receiving a new message during projection by a projector, an electronic device does not display prompt information of the first message on the projected image projected by the projector. By means of the implementation of the present application, when receiving a new message during projection, an electronic device would not display prompt information on a projected image, thereby avoiding interference on a user. In addition, the electronic device can also automatically reply to the received new message to implement effective communication between users.

Description

Message processing method and related device

This application requires the priority of the Chinese patent application submitted to the State Intellectual Property Office of China on December 10, 2018, with the application number 201811505192.6 and the invention name "message processing method and related devices", the entire content of which is incorporated by reference in this application in.

Technical field

This application relates to the field of projection, in particular to a message processing method and related devices.

Background technique

With the development of projection technology, more and more smart devices (such as wearable devices (such as wrist projection devices), smart phones, tablets, etc.) can realize the projection function. The smart device itself has a physical screen that can receive user operations, and the smart device can perform corresponding steps in response to the user operation. The smart device can also project an image on a three-dimensional object (such as the user's hand, desktop, or wall surface, etc.). The content displayed on the physical screen can be the same as the projected image or different.

During projection, if the smart device receives an SMS or an incoming call, the resulting projection image will include an SMS notification or an incoming call notification, causing interference to the user. When projecting, how to avoid causing interference to users is a problem that needs to be solved urgently.

Summary of the invention

The present application provides a message processing method and related devices. When an electronic device receives a new message during projection, it does not display prompt information on the projected image, which can avoid interference to users.

In a first aspect, an embodiment of the present application provides a message processing method, which is applied to an electronic device and the electronic device is equipped with a projector. The method includes: the electronic device receives the first message; in response to receiving the first message, The electronic device determines whether the projector is projecting the projected image onto the three-dimensional object; when it is determined that the projector is projecting the projected image onto the three-dimensional object, the prompt information of the first message is not displayed on the projected image.

Implementing the message processing method of the first aspect, when the electronic device receives a new message during the projection process, the prompt information is not displayed on the projected image, which can avoid causing interference to the user.

In the embodiment of the present application, the first message may include but is not limited to: short message, incoming call, instant application message (such as WeChat message, QQ message) or application notification message (such as application push message), and so on.

In the embodiment of the present application, the projector may project the projected image onto a three-dimensional object, and the three-dimensional object may include but is not limited to: a part of a human body shape, a desktop, a wall surface, perspective glasses, or a three-dimensional virtual space. A part of the human body shape may include the back of the user's hand, the face of the arm, or the retina.

With reference to the first aspect, in some embodiments, the projected image is generated by the electronic device or transmitted to the electronic device by a terminal connected to the electronic device.

With reference to the first aspect, in some embodiments, the method may further include: the electronic device captures the interaction between the user and the three-dimensional object; the electronic device changes the projected image in response to the interaction between the user and the three-dimensional object. That is, the projection image formed by the projector can receive a user operation and enable the corresponding function in response to the user operation. Here, the interaction between the user and the three-dimensional object may include: a gesture of the user acting on the three-dimensional object. For example, the gesture may be a click operation. Changing the projected image includes: changing the content in the projected image.

With reference to the first aspect, in some embodiments, after the electronic device receives the first message, the method further includes: the electronic device sends a second message to the terminal that initiated the first message, the second message is used to prompt the initiator of the first message The current electronic device of the terminal is inconvenient to respond to the first message.

In some embodiments, the second message carries time information, and the time information is used to indicate when the electronic device can respond to the first message. The time information can be determined in the following ways:

1. The electronic device estimates the time based on the content displayed in the projected image. Exemplarily, T2=T-T1, and T1 is the displayed duration. Where, T2 is the time required to display the document, that is, the time information in the second message, T is the historical average display time of the currently displayed content, and T1 is the displayed time.

2. The electronic device determines the time in the short message according to the meeting time recorded in the agenda. Exemplarily, the schedule records "14:00-16:00, customer meeting". If the electronic device receives a call from the new message originator at 15:00, it will reply the time information in the short message to the new message originator. It can be one hour.

In some embodiments of the present application, the second message may be a short message, an instant application message (such as a QQ message, a WeChat message), or the like.

In the embodiment of the present application, the manner in which the electronic device replies to the terminal initiator who initiated the first message, that is, the form of the second message may have the following setting methods:

1. The way for the electronic device to reply to the terminal that initiated the first message is set by the electronic device. For example, the electronic device 100 may be set to automatically reply to the other party via a short message when receiving an incoming call or a short message.

2. The way for the electronic device to reply to the terminal that initiated the first message is set by the user. For example, the user can set to automatically reply to the other party via SMS when receiving new messages.

In the above embodiment, the operation that the electronic device sends the second message to the initiator of the terminal that initiated the first message is an internal operation of the electronic device, and there is no prompt on the projected image visible to the user. In this way, it is possible to prompt the terminal initiating the first message that the electronic device calling it is currently inconvenient to respond to the first message, so that the user experience of the terminal initiating the first message is better and does not interfere with the user of the electronic device.

With reference to the first aspect, in some embodiments, the method may further include: the electronic device stops projecting the projected image onto the three-dimensional object through the projector; the electronic device prompts the user to receive the first message. Here, after the electronic device stops projection, the user is prompted to receive the first message during the projection process, which can enable the user to process the first message in time, achieve effective communication between users, and improve the user experience.

Specifically, the electronic device may prompt the user to receive the first message through one or more of the following: the electronic device displays prompt information of the first message on the display screen, vibrates, plays a prompt sound, or lights a breathing lamp. The prompt information of the first message displayed by the electronic device on the display screen may include at least one of the following: a prompt window and a corner mark on the application icon.

Implementing the message processing method of the first aspect, when the electronic device receives a new message during the projection process, the prompt information is not displayed on the projected image, which can avoid causing interference to the user. In addition, the electronic device can also automatically reply to the received new message to achieve effective communication between users.

In a second aspect, an embodiment of the present application provides an electronic device, including: a processor, a projector, and a communication module. The processor is connected to the projector and the communication module, where:

The communication module is used to receive the first message;

A processor, configured to determine whether the projector is projecting the projected image onto the three-dimensional object; when it is determined that the projector is projecting the projected image onto the three-dimensional object, prompt information indicating that the projector does not display the first message on the projected image;

The projector is used to project the projected image onto the three-dimensional object in response to the instruction of the processor.

In the embodiment of the present application, the first message may include but is not limited to: short message, incoming call, instant application message (e.g. WeChat message, QQ message) or application notification message (e.g. application push message), etc.

In the embodiment of the present application, the projector may project the projected image onto a three-dimensional object, and the three-dimensional object may include but is not limited to: a part of a human body shape, a desktop, a wall surface, perspective glasses, or a three-dimensional virtual space. A part of the human body shape may include the back of the user's hand, the arm face, or the retina.

With reference to the second aspect, in some embodiments, the projected image is generated by the electronic device or transmitted to the electronic device by a terminal connected to the electronic device.

With reference to the second aspect, in some embodiments, the electronic device further includes a sensor, which is used to capture the interaction between the user and the three-dimensional object; the processor is further configured to change in response to the interaction between the user and the three-dimensional object Project the image. That is, the projection image formed by the projector can receive a user operation, the sensor can detect the user operation, and the processor can enable the corresponding function in response to the user operation. Here, the interaction between the user and the three-dimensional object may include: a gesture of the user acting on the three-dimensional object. For example, the gesture may be a click operation. Changing the projected image includes: changing the content in the projected image.

With reference to the second aspect, in some embodiments, the communication module is further configured to send a second message to the terminal that initiated the first message. The second message is used to prompt the terminal that initiated the first message that the current electronic device is inconvenient to respond to the first message. .

In the embodiment of the present application, the manner in which the communication module replies to the terminal initiator who initiated the first message, that is, the form of the second message may have the following setting methods:

1. The way for the communication module to reply to the terminal that initiated the first message is set by the electronic device. For example, the electronic device 100 may be set to automatically reply to the other party via a short message when receiving an incoming call or a short message.

2. The manner in which the communication module replies to the terminal that initiated the first message is set by the user. For example, the user can set to automatically reply to the other party via SMS when receiving new messages.

In the above embodiment, the operation in which the communication module sends the second message to the initiator of the terminal that initiated the first message is an internal operation of the electronic device, and there is no prompt on the projected image visible to the user. In this way, it is possible to prompt the terminal initiating the first message that the electronic device calling it is currently inconvenient to respond to the first message, so that the user experience of the terminal initiating the first message is better and does not interfere with the user of the electronic device.

With reference to the second aspect, in some embodiments, the processor is further used to instruct the projector to stop projecting the projected image onto the three-dimensional object and prompt the user to receive the first message. Here, after the projector stops projection, the processor prompts the user to receive the first message during the projection process, which can enable the user to process the first message in time, realize effective communication between users, and improve the user experience.

Specifically, the processor may prompt the user to receive the first message in at least one of the following ways:

The electronic device further includes a display screen, and the processor instructs the display screen to display the prompt information of the first message;

The electronic device also includes a motor, and the processor instructs the motor to vibrate;

The electronic device also includes a speaker, and the processor instructs the speaker to play a prompt tone;

The electronic device also includes a breathing light, and the processor instructs the breathing light to blink.

The prompt information of the first message displayed on the display screen may include at least one of the following: a prompt window and a corner mark on the application icon.

In a third aspect, the present application provides an electronic device, including: a hardware layer, an application framework layer, and an application layer, where:

The hardware layer is used to receive the first message and report the first message to the application framework layer;

The application framework layer is used to record the information of the first message, and does not send the information of the first message to the application layer during projection by the electronic device;

The application layer is used to run one or more applications.

In the electronic device of the third aspect, since the application framework layer does not send a broadcast, the application that monitors the call state in the application layer cannot learn that there is a new message, so the electronic device does not display the new message on the projected image when projecting The prompt message can avoid disturbing the user.

With reference to the third aspect, in some embodiments, the application framework layer is also used to send information about the first message to the first application running in the application layer; the first application running in the application layer receives the first message sent by the application framework layer. Information of a message, and reply to the terminal that initiated the first message according to the information of the first message. The first application replies to the terminal that initiated the first message, that is, automatically replies to the received new message, which can achieve effective communication between users.

With reference to the third aspect, in some embodiments, the first application is a short message application, and the first application replies to the terminal that initiated the first message by short message.

With reference to the third aspect, in some embodiments, the application framework layer is also used to send the first message information to the second application running in the application layer when the electronic device stops projection; the second application running in the application layer receives The information of the first message sent by the application framework layer, and prompts the user that the electronic device has received the first message according to the information of the first message. The second application prompts the user that the electronic device has received the first message, which can enable the user to process the first message in time to achieve effective communication between the users.

With reference to the third aspect, in some embodiments, the application framework layer sends the information of the first message to the second application running in the application layer in the form of broadcast.

According to a fourth aspect, an embodiment of the present application provides a computer storage medium, including computer instructions, which when executed on an electronic device, causes the electronic device to execute the message processing method as provided in the first aspect.

According to a fifth aspect, an embodiment of the present application provides a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the message processing method according to the first aspect.

With the implementation of this application, when an electronic device receives a new message during projection, it will not display a prompt message on the projected image, which can avoid interference to the user. In addition, the electronic device can also automatically reply to the received new message to achieve effective communication between users.

BRIEF DESCRIPTION

1 is a schematic structural diagram of an electronic device provided by this application;

FIG. 2 is a schematic diagram of a scenario when an electronic device provided by this application is projected;

3 is a block diagram of the software structure of the electronic device provided by this application;

4 is a schematic diagram of a scene when a new message is received when an electronic device projects;

5 is a schematic flowchart of a message processing method provided by this application;

6 to 10 are schematic diagrams of human-computer interaction provided by this application;

11 is a schematic diagram of internal processing of an electronic device provided by this application;

12 is a schematic diagram of internal processing of an electronic device provided by the application;

13 is a schematic diagram of a scene when an electronic device receives a new message during projection;

14 is a schematic flowchart of another message processing method provided by this application;

15-16 are schematic diagrams of human-computer interaction provided by this application.

detailed description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

In the description of the embodiments of the present application, unless otherwise stated, “/” means or, for example, A/B may mean A or B; “and/or” in this text is merely a description of the related object The association relationship indicates that there can be three relationships, for example, A and/or B, which can indicate: there are three situations in which A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, “plurality” refers to two or more than two.

In the following, the terms "first" and "second" are used for description purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise stated, the meaning of "plurality" is two or more.

Embodiments of the present application provide a message processing method and related device. When an electronic device receives a new message during projection, it does not display prompt information on the projected image, which can avoid interference to users. In addition, the electronic device can also automatically reply to the received new message to achieve effective communication between users.

The message processing method of the embodiment of the present application is applied to a projectable electronic device. This application does not specifically limit the types of electronic devices mentioned. The electronic devices may be mobile phones, tablet computers, personal digital assistants (personal digital assistants (PDAs)), wearable devices (such as wrist projection devices), and laptop computers ( Portable electronic devices such as laptop) may also be non-portable electronic devices such as desktop computers. Examples of electronic devices include, but are not limited to, electronic devices equipped with iOS, android, microsoft, or other operating systems.

First, the structure of the electronic device in this application is introduced. Referring to FIG. 1, FIG. 1 shows a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application.

The electronic device 100 may include a projector, a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1 , Antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or combine some components, or split some components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The projector is used to receive an instruction sent by the processor 110 and project a graphical user interface output by the operating system of the electronic device 100 on a three-dimensional object to form a projected image. The instructions sent by the processor 110 to the projector include changes or adjustments to the content, scale, etc. contained in the projected image. The three-dimensional object includes but is not limited to: a part of the human body, a desktop, a wall surface, see-through glasses, or a three-dimensional virtual space. A part of the human body shape may include the back of the user's hand, the arm face, or the retina. Exemplarily, referring to FIG. 2, taking the electronic device 100 as an electronic device as an example, several projection scenes are shown. Referring to 2a of FIG. 2, the user can wear the electronic device on the wrist, and the electronic device can project a smaller-sized (for example, 2 inches) projection image on the back of the hand. Referring to 2b of FIG. 2, the electronic device can project a projection image similar to a tablet on a desktop or other three-dimensional object. Referring to 2c of FIG. 2, the electronic device can project a projection image of a larger size (for example, 60 inches) on a wall or other three-dimensional object.

In the embodiment of the present application, all devices that can realize the projection effect are included in the projector of the present application. For example, the projector in the embodiment of the present application may be a projection camera with a camera function.

In some embodiments, the electronic device 100 may further include a sensor. The sensor is connected to the projector and used to capture the user's operation on the projected image. In the embodiment of the present application, the sensor senses the shadow area formed on the projected image by the user's finger to capture the coordinates of the user's finger acting on the projected image. Specifically, the sensor senses the shadow area covered by the user's finger on the projected image through infrared rays reflected by the user's finger. In some embodiments, the sensor may include an infrared distance measuring device.

The processor 110 may search for the content matching the coordinates on the output projection image according to the coordinates of the user's finger acting on the projection image and perform the corresponding operation. That is, the projected image formed by the electronic device 100 can receive user operations, and the electronic device 100 can perform corresponding steps in response to the user operations.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), and an image signal processor (image)signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices, or may be integrated in one or more processors.

The controller can generate the operation control signal according to the instruction operation code and the timing signal to complete the control of fetching instructions and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Avoid repeated access, reduce the waiting time of the processor 110, thus improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. Interfaces can include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit, sound, I2S) interface, pulse code modulation (pulse code modulation (PCM) interface, universal asynchronous transceiver (universal asynchronous) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and And/or universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may respectively couple the touch sensor 180K, charger, flash, camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, to realize the function of answering the phone call through the Bluetooth headset.

The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface to realize the function of answering the phone call through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI) and so on. In some embodiments, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the electronic device 100.

The GPIO interface can be configured via software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface may be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that conforms to the USB standard, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic description, and does not constitute a limitation on the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also use different interface connection methods in the foregoing embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some embodiments, the charger may be a dock device. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be set in the same device.

The wireless communication function of the electronic device 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and so on. The mobile communication module 150 can receive electromagnetic waves from the antenna 1 and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it to electromagnetic wave radiation through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a high-frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110, and may be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), and global navigation satellites that are applied to the electronic device 100. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive the signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it to electromagnetic wave radiation through the antenna 2.

In some embodiments, the antenna 1 of the electronic device 100 and the mobile communication module 150 are coupled, and the antenna 2 and the wireless communication module 160 are coupled so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include a global mobile communication system (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long-term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation system (BDS), and a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite-based augmentation systems (SBAS).

The electronic device 100 realizes a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations, and is used for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel may use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (active-matrix organic light) emitting diode, AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

In the embodiment of the present application, the content displayed on the display screen 194 and the projection image formed by the projector may be the same or different, which is not limited herein. The content displayed on the display screen 194 and the projection image formed by the projector can be managed by the processor 110 in a unified manner.

The electronic device 100 can realize a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP processes the data fed back by the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, and the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, which is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be set in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

The digital signal processor is used to process digital signals. In addition to digital image signals, it can also process other digital signals. For example, when the electronic device 100 is selected at a frequency point, the digital signal processor is used to perform Fourier transform on the energy at the frequency point.

Video codec is used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between neurons in the human brain, it can quickly process the input information and can continue to self-learn. The NPU can realize applications such as intelligent recognition of the electronic device 100, such as image recognition, face recognition, voice recognition, and text understanding.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area may store an operating system, at least one function required application programs (such as sound playback function, image playback function, etc.). The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100 and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (Universal Flash Storage (UFS), etc.). The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in the memory provided in the processor.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, and an application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also known as "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be received by bringing the receiver 170B close to the ear.

The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through a person's mouth, and input a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C. In addition to collecting sound signals, it may also implement a noise reduction function. In other embodiments, the electronic device 100 may further include three, four, or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The headset interface 170D is used to connect wired headsets. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile electronic device (open terminal) platform (OMTP) standard interface, and the American Telecommunications Industry Association (cellular telecommunications industry association of the United States, CTIA) standard interface.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. The capacitive pressure sensor may be at least two parallel plates with conductive materials. When force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch position but have different touch operation intensities may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the movement posture of the electronic device 100.

The air pressure sensor 180C is used to measure air pressure.

The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can detect the opening and closing of the flip holster using the magnetic sensor 180D.

The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes).

The distance sensor 180F is used to measure the distance.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.

The ambient light sensor 180L is used to sense the brightness of ambient light.

The fingerprint sensor 180H is used to collect fingerprints.

The temperature sensor 180J is used to detect the temperature.

Touch sensor 180K, also known as "touch panel". The touch sensor 180K may be provided on the display screen 194, and the touch sensor 180K and the display screen 194 constitute a touch screen, also called a "touch screen". The touch sensor 180K is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the location where the display screen 194 is located.

The bone conduction sensor 180M can acquire vibration signals.

The key 190 includes a power-on key, a volume key, and the like. The key 190 may be a mechanical key. It can also be a touch button. The electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100.

The motor 191 may generate a vibration prompt. The motor 191 can be used for vibration notification of incoming calls and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. For the touch operation in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. Touch vibration feedback effect can also support customization.

The indicator 192 may be an indicator light, which may be used to indicate a charging state, a power change, and may also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. The same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards may be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as call and data communication. In some embodiments, the electronic device 100 uses eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The software system of the electronic device 100 may adopt a layered architecture, event-driven architecture, micro-core architecture, micro-service architecture, or cloud architecture. The embodiment of the present application takes an Android system with a layered architecture as an example to exemplarily explain the software structure of the electronic device 100.

Referring to FIG. 3, FIG. 3 is a software structural block diagram of the electronic device 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, each of which has a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer.

The application layer may include a series of application packages.

As shown in FIG. 3, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

The application framework layer provides an application programming interface (application programming interface) and programming framework for applications at the application layer. The application framework layer includes some predefined functions.

As shown in FIG. 3, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, intercept the screen, etc. In the embodiment of the present application, the window manager uniformly manages the content displayed on the display screen 194 and the projection image formed by the projector.

Content providers are used to store and retrieve data, and make these data accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls for displaying text and controls for displaying pictures. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes an SMS notification icon may include a view that displays text and a view that displays pictures.

The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including connection, hang up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloading, message reminders, etc. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, the text message is displayed in the status bar, a sound is emitted, the electronic device vibrates, and the indicator light flashes.

Android Runtime includes core library and virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

The core library contains two parts: one part is the function function that Java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

The system library may include multiple functional modules. For example: surface manager (surface manager), media library (Media library), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

The following describes the workflow of the software and hardware of the electronic device 100 in combination with capturing a photographing scene.

When the touch sensor 180K receives the touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes touch operations into original input events (including touch coordinates, time stamps and other information of touch operations). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, for example, the control corresponding to the click operation is a camera application icon. The camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. The camera 193 captures a still image or video.

Based on the electronic device shown in FIG. 1, an embodiment of the present application proposes a message processing method. By implementing the message processing method of the embodiment of the present application, when the electronic device receives a new message during projection, it will not display prompt information on the projected image, which can avoid interference to the user. In addition, the electronic device can also automatically reply to the received new message to achieve effective communication between users.

The message processing method provided in the embodiments of the present application will be described below in conjunction with specific application scenarios.

Application scenario 1: When a user uses the electronic device 100 for projection, the electronic device 100 receives a new message.

Referring to FIG. 4, it shows a scene where an electronic device 100 (for example, a smart watch) receives an incoming call when projecting. As shown in 4a of FIG. 4, the electronic device 100 is placed on the dock device 200, and the dock device 200 may provide a stand and charging function for the electronic device 100. In some embodiments, the electronic device 100 can also independently complete the projection, that is, the dock device 200 is not required to provide a stand and charging function.

As shown in 4a, the electronic device 100 projects the projected image 10 on the three-dimensional object (eg, wall surface) through the built-in projector. In this case, the display screen of the electronic device 100 may or may not display the content. When content is displayed on the display screen, the content may be the same as or different from the projected image 10, which is not limited here.

Exemplarily, as shown in 4a of FIG. 4, the projected image 10 may include a chart 101 presented by the user. In some embodiments, the projected image 10 may further include a status bar (not shown in the figure), the status bar may include the name of the operator (for example, China Mobile), Wi-Fi icon, signal strength, current remaining power, Bluetooth Icons, alarm clock icons, etc. In some embodiments, the projected image 10 may further include a navigation bar (not shown in the figure), and the navigation bar may include a return key icon, a home screen icon, a multitasking key icon, and the like. In other embodiments, the projected image 10 may also receive user operations, and the electronic device 100 may enable corresponding functions according to the received user operations.

Exemplarily, as shown in 4b of FIG. 4, when the electronic device 100 receives a new message, such as a new call, the top area of the projected image 10 displays a prompt window 102 for the new call. The prompt window 102 may include prompt information such as a caller, an answer control, and a hang-up control. Not limited to the prompt window shown in 4b, in other embodiments, the entire area of the projected image 10 may be used to display an incoming call notification interface to prompt the user of a new incoming call.

In some other embodiments, the electronic device 100 can not only display a prompt window on the projected image 10 to prompt the user, but also prompt the user to have a new message by means of vibration and/or prompt sound.

It can be seen from FIG. 4 that when the electronic device 100 receives a new message, such as a new call, it will display a prompt message on the projected image 10 to interfere with the user, which is undesirable by the user. That is to say, when the electronic device 100 is projecting, the prompt information on the projected image 10 will interfere with the user. In many cases, such as when the user is watching a video or playing a game during a meeting, the user does not want to project the image 10 The prompt message appears.

To solve the above technical problems, the embodiments of the present application provide a message processing method, which can ensure that the user is not disturbed during the projection process. By implementing the message processing method provided by the embodiment of the present application, when the electronic device 100 receives a new message, it will not display the prompt information in the projected image 10, which can avoid disturbing the user.

As shown in FIG. 5, an embodiment of the present application provides a message processing method, specifically including:

Step S101: The electronic device 100 receives a new message.

Specifically, the new messages received by the electronic device 100 during projection may include: short messages, incoming calls, instant application messages (such as WeChat messages, QQ messages) or application notification messages (such as application push messages), and so on. The following embodiments will use the example of receiving a new call during projection by the electronic device 100 as an example to describe the message processing method provided in the embodiments of the present application.

In the embodiment of the present application, the new message received by the electronic device 100 may be referred to as the first message.

Step S102: The electronic device 100 does not display the prompt information of the new message on the projected image.

In the embodiment of the present application, when the electronic device receives a new message in the following situations, it may not display the prompt information of the new message on the projected image:

1. When the electronic device 100 is projecting, the prompt information of the new message is not displayed on the projected image.

In some embodiments, the user does not want to be disturbed when using the electronic device 100 to project. For example, when using the electronic device 100 for projection, the user may display conference-related documents, play games, watch videos, etc. through the projected image. In these scenarios, the user hopes not to be disturbed. In the first case, the user can use the electronic device 100 to project a projected image on a part of a human body shape, a desktop, a wall surface, see-through glasses, a three-dimensional virtual space, or other three-dimensional objects.

In a specific implementation, the electronic device 100 may determine that projection is currently in progress in the following ways:

(1) The electronic device 100 detects that the dock device is currently connected.

The dock device is used to charge the electronic device 100 and switch projections. When the electronic device 100 is connected to a dock device, the electronic device 100 automatically projects and can be charged through the dock device. In other words, the electronic device 100 is connected to the dock device, which is equivalent to the projection of the electronic device 100.

In some embodiments, the electronic device 100 may detect whether it is currently connected to the dock device through a sensor provided at the charging port.

(2) The electronic device 100 detects whether the projector is working, and determines that the electronic device 100 projects when the projector is working.

The projector is used to project the image output by the operating system of the electronic device 100 on the three-dimensional object to form a projected image. That is, the projector is used to form a projected image, and the electronic device 100 projects when the projector is in operation.

2. When the electronic device 100 displays a specific file on the projected image, the prompt information of the new message is not displayed on the projected image.

In some embodiments, the user usually displays some specific files through projected images, such as documents, pictures, etc. When displaying these specific files, the user hopes not to be disturbed.

In a specific implementation, the electronic device 100 may determine whether the file is a specific file through the storage location of the file displayed in the projected image, thereby determining whether to not display the prompt information of the new message on the projected image when the new message is received. Specifically, the user can store a specific file in a specific path of the electronic device 100, for example, the user can store all files used in the conference in the folder "meeting", when the electronic device 100 displays the folder "conference" through the projected image File, it can be determined that the current user does not want to be disturbed, and the electronic device 100 does not display the prompt information of the new message on the projected image when receiving the new message. For another example, when the user displays a Word document or picture in a specific format on the projected image, it can be determined that the current user does not want to be disturbed, and the electronic device 100 does not display the prompt information of the new message on the projected image when receiving the new message.

3. After the user manually starts the projection do not disturb mode of the electronic device 100, the electronic device 100 does not display a prompt message of a new message on the projected image.

In some embodiments, the electronic device 100 may provide the user with a control to start/exit the projection do not disturb mode. Exemplarily, the electronic device 100 may provide a control to start/exit the projection do not disturb mode on the setting interface. Exemplarily, referring to FIG. 6, FIG. 6 is a setting interface 20 provided by the electronic device 100 on the display screen. As shown in FIG. 6, the setting interface 20 includes a control 201 for starting/exiting the projection do not disturb mode. When the electronic device 100 exits the projection do not disturb mode, the user can click the control 201 in the setting interface 20 shown in FIG. 6, and the electronic device 100 can start the projection do not disturb mode after detecting the user's click operation on the control 201. After the electronic device starts the projection do not disturb mode, when a new message is received during projection, the prompt information of the new message is not displayed on the projected image.

It is not limited to the above-mentioned three kinds of cases in which the electronic device 100 does not display the prompt information of the new message on the projected image. In other cases, the electronic device 100 may not display the prompt information of the new message on the projected image, so as to avoid disturbing the user. The embodiments of the present application are not limited. For example, if the electronic device 100 receives a new message during projection at a fixed time period on a working day (for example, 9:00-17:00), the electronic device 100 may not display the prompt information of the new message on the projected image.

Exemplarily, refer to 7a of FIG. 7, and 7a shows a projection image 10 formed by a projector built in the electronic device 100. The projection image 10 shown in 7a is the same as the projection image shown in 4a in FIG. 4, see FIG. 4 Related description. When the electronic device 100 receives a new message such as a new incoming call based on a circuit switched (CS) network, for example, referring to 7b of FIG. 7, the prompt information of the new incoming call will not be displayed on the projected image.

Specifically, in general, when the electronic device 100 receives a new message, the display method of the prompt information of various messages in the projected image may include one or more of the following: Banner display (that is, floating display at the top area of the projected image ), displayed on the status bar, icon corner (that is, the number displayed in the upper right corner of the application icon), etc. Among them, the banner display can refer to the prompt window 102 in 4b of FIG. 4, the display on the status bar means that the icon of the projected image can display the missed call icon, and the icon corner means that when the projected image includes an electronic device for display 100 When the desktop of the application is installed, the number of missed calls (for example, "1") will be displayed in the upper right corner of the icon of the phone application.

In the embodiment of the present application, the electronic device 100 does not display the prompt information of the new message on the projected image. Therefore, the prompt information of any of the above-mentioned display modes will not be displayed on the projected image 10. The above prompt information is not displayed on the projected image, which can avoid interference to the user during the projection process. In particular, when the user uses the electronic device 100 during the conference, interference with the conference can be avoided.

In some other embodiments, when the electronic device 100 receives a new message, it does not display the prompt information on the projected image, but it can remind the user that the electronic device 100 has received the new message during the projection process by vibrating, prompting sound, or breathing light flashing. . Generally, the electronic device 100 is placed on a dock device, and vibration, prompt sound, or breathing light flashing has less interference to the user, and can be used to prompt the user that a new message is coming.

In other embodiments of the present application, when the electronic device 100 receives a new message, it does not display the prompt information on the projected image, and does not prompt the user that the electronic device 100 receives the new message by vibrating, prompting sound, or breathing light flashing. . In this way, all interference caused by new messages can be avoided.

In some embodiments, the message processing method shown in FIG. 5 may further include:

Step S103: The electronic device 100 replies to the initiator of the new message, prompting the initiator of the new message that the current user is inconvenient to respond to the new message.

Specifically, after receiving a new message (such as a new call), the electronic device 100 does not display the prompt information on the projected image 10, but may prompt the new message originator that the current user is inconvenient to respond to the new message (such as answering a call), so that the new message The user experience of the initiator is better. Exemplarily, refer to 8a of FIG. 8, which shows a user interface displayed by the terminal used by the initiator of the new message. The user interface displays a short message sent by the electronic device 100 autonomously received by the terminal, and the short message may be "I am inconvenient to answer the call now, and I will call you later."

Further, in some embodiments, the electronic device 100 automatically replies the new message to the initiator. The short message may also carry time information, and the time information indicates how long after the user can reply to the initiator of the new message. Exemplarily, refer to 8b of FIG. 8, which shows a user interface displayed by the terminal used by the initiator of the new message. The user interface displays a short message sent by the electronic device 100 autonomously received by the mobile phone. The short message may be "I am not convenient to answer the call now, and I will call you in 30 minutes." After receiving the short message sent by the electronic device 100, the initiator of the new message can learn that the other party is inconvenient to answer the call and will not call the user of the electronic device 100 for a period of time.

In the above embodiment, the time information in the short message that the electronic device 100 replies to the originator of the new message can be determined in any of the following ways:

1. The electronic device 100 estimates the time based on the content displayed in the projected image.

For example, during the conference, the user displays the document on the projected image through the electronic device 100. The electronic device 100 may estimate that the document is displayed after the document is displayed for the duration T1, the number of displayed pages P1, and the total number of pages P. The required duration is T2, and use T2 as the time in the SMS. Illustratively, T2=T1*(P-P1)/P1.

For another example, the content displayed by the electronic device 100 in the projected image may be displayed multiple times, and the electronic device 100 may estimate the duration T2 required to display the document based on the historical average display time of the currently displayed content of the projected image, and compare T2 As the time in the text message. For example, if the number of historical impressions of the content is N and the presentation time is t1, t2...tn, then the average presentation time T=(t1+t2+...+tn)/N, and the length of time required to display the document T2=T-T1, T1 is the displayed duration.

For another example, during the conference, the user displays the video on the projected image through the electronic device 100. The electronic device 100 may use the remaining duration of the video as the time in the short message.

2. The electronic device 100 determines the time in the short message according to the meeting time recorded in the schedule.

For example, the user can record various items in the schedule application installed in the electronic device 100. If the meeting time is included, the time in the short message to the originator of the new message can be determined according to the meeting time. For example, "14:00-16:00, customer meeting" is recorded in the schedule. If the electronic device 100 receives a call from the initiator of the new message at 15:00, the text message returned to the initiator of the new message may be "I am now Inconvenient to answer the phone, I will call you in 1 hour."

Understandably, the above operation of replying to the short message is an internal operation of the electronic device 100, and there is no prompt on the projected image 10 visible to the user. In this way, it is possible to prompt the new message originator to call the user of the electronic device 100 side that is currently inconvenient to answer the incoming call, so that the new message originator's experience is better, and does not interfere with the user of the electronic device 100 side.

In the embodiment of the present application, not limited to the short message reply method in step S103, the electronic device 100 may also automatically reply to the initiator of the new message through other methods to prompt the new message initiator that the current user of the electronic device 100 is inconvenient to respond to the new message . For example, when the electronic device 100 receives the WeChat message, it can reply the WeChat message to the new message initiator through the WeChat application, and when the electronic device 100 receives the QQ message, it can reply the QQ message to the new message initiator through the QQ application.

In the embodiment of the present application, the method for the electronic device 100 to reply to the initiator of the new message may have the following setting methods: 1. The method for the electronic device 100 to reply to the initiator of the new message may be set by the electronic device 100. Specifically, the reply method may be a default setting when the electronic device 100 is shipped from the factory. For example, the electronic device 100 may be set to automatically reply to the other party via a short message when receiving an incoming call or a short message; when receiving an instant application message, to reply to the other party via an instant application message. 2. The way for the electronic device 100 to reply to the initiator of the new message may be set by the user. For example, the user can set to automatically reply to the other party via SMS when receiving new messages. Further, in some embodiments, the electronic device 100 or the user may also set specific content for replying to the other party.

In the embodiment of the present application, the message that the electronic device 100 replies to the initiator of the new message may be referred to as a second message.

Step S104: The electronic device 100 prompts the user to receive a new message.

Specifically, the electronic device 100 prompts the user to receive the new message, that is, prompts the user to receive the new message during the projection process. After the electronic device 100 prompts the user to receive the new message, the user can learn that there are currently unprocessed new messages.

In the embodiment of the present application, the electronic device may prompt the user to receive a new message in the following situations:

1. When the electronic device 100 exits the projection, the user is prompted to receive a new message.

In a specific implementation, the electronic device 100 may determine the current exit from the projection in the following ways: (1) The electronic device 100 detects that the current and the dock device are disconnected. In some embodiments, the electronic device 100 may detect whether it is currently disconnected from the dock device through a sensor provided at the charging port. (2) The electronic device 100 detects whether the projector is working, and determines that the electronic device 100 is currently out of projection when the projector is not working.

2. When the electronic device 100 exits the presentation of a specific file on the projected image, the user is prompted to receive a new message.

In some embodiments, the user usually displays some specific files on the projected image, such as documents, pictures, etc. When displaying these specific files, the user hopes not to be disturbed, and when exiting to display these specific files, the user wants the electronic device 100 prompts the user whether a new message has been received.

In a specific implementation, a user may store a specific file in a specific path of the electronic device 100, for example, the user may store all files used in the conference in the folder "meeting", when the electronic device 100 exits the presentation folder on the projected image When the file in the "meeting" is determined, the current user can be determined to exit the meeting, and the electronic device 100 prompts the user to receive a new message. For another example, when the user quits displaying Word documents and pictures in a specific format on the projected image, the electronic device 100 prompts the user to receive a new message.

3. After the user manually exits the projection do not disturb mode of the electronic device 100, the user is prompted to receive a new message.

In some embodiments, the electronic device 100 may provide a user with a control to manually start/exit the projection do not disturb mode, see FIG. 6 and related descriptions. When the electronic device 100 is in the projection do not disturb mode, the user can click on the control 201 in the setting interface 20 shown in FIG. 6. After the electronic device 100 detects the user's click operation on the control 201, it exits the projection do not disturb mode.

It is not limited to the above-mentioned three kinds of cases in which the electronic device 100 prompts the user to receive a new message. In other cases, the electronic device 100 may also prompt the user to receive a new message, which is not limited in the embodiments of the present application. For example, during a fixed time period on a working day (for example, 17:00-9:00), the electronic device 100 may also prompt the user to receive a new message.

Specifically, the electronic device 100 may prompt the user on the display screen and/or the projected image that there are currently unprocessed new messages. The following uses the electronic device 100 to prompt the user on the display screen as an example for description.

In some embodiments, the electronic device 100 may hover over the top area of the display screen to display notification information of missed calls to prompt the user to receive a new message. Exemplarily, referring to 9a of FIG. 9, when the electronic device 100 is projecting, the user interface 30 displayed on the display screen includes a conference folder, and the conference folder includes multiple documents. If the electronic device 100 receives a new call during projection, for example, referring to 9b of FIG. 9, the electronic device 100 may display a prompt window 301 in the top area of the user interface 30. The prompt window 301 may include prompt information such as a phone icon, a caller, a call time, and whether the electronic device 100 has automatically responded. Through the prompt window 301, the user can learn that the electronic device 100 has received a new call during projection.

In some embodiments, the prompt window 301 may receive a user operation, and the electronic device 100 may enable the corresponding function according to the user operation. Exemplarily, referring to 9b of FIG. 9, the user may click on the prompt window 301, and in response to the click operation, the electronic device 100 may display the user interface 40 shown in 9c of FIG. 9. The user interface 40 may include information about missed calls received by the electronic device 100 during the projection process. For example, the user interface 40 may include: a caller, a call time, whether the electronic device 100 has automatically responded, a manner and content of the reply, a control for dialing back a call, and the like. The user can learn detailed information of missed calls through the user interface 40, and can also click the control for dialing back the call to dial back the call to the originator of the call.

In some embodiments, the prompt information 301 shown in 9b of FIG. 9 may disappear after being displayed for a period of time without user interaction. The time when the prompt window 301 disappears may include: 1. When it is detected that the user's finger touches an area other than the prompt window 301 in the display screen (such as the user's finger clicking any file in 9b); 2. The prompt window 301 is continuously displayed When the time exceeds a certain length of time (such as 2 seconds).

In some embodiments, the prompt window 301 may continue to be displayed in the notification bar after continuously displaying for a period of time and disappearing. When the user calls up the notification bar, the prompt window 301 can be seen. Here, the user can call up the notification bar through a gesture of sliding down from the top of the display screen on any interface content output from the display screen of the electronic device 100, or can call up the notification bar through the navigation key, which is not limited in this application.

Exemplarily, see 9d of FIG. 9, which shows a notification bar. As shown in 9d, the notification bar includes a prompt window 301, and may also include one or more of the following: date, weather, location, setting icons, and quick start/shutdown icons for various setting options (such as WiFi, Bluetooth, personal hotspot, etc.) , Screen brightness bar and other prompt information (such as the prompt window of WeChat message), etc. In some embodiments, the prompt window 301 displayed in the notification bar may receive an input user operation (for example, a click operation), and in response to the user operation, the terminal may display detailed missed call information, which may be referred to as 9c in FIG. 9.示的应用应用平台 40.

In some embodiments, the electronic device 100 may also display a reminder message for missed calls on the icon of the phone application to prompt the user to receive a new message. Exemplarily, referring to FIG. 10, it shows the prompt information displayed by the electronic device 100 on the icon of the phone application. As shown in FIG. 10, the display screen of the electronic device 100 displays a user interface 50 output by the operating system. The user interface 50 may include icons of some applications that the electronic device 100 has installed. In some embodiments, the user interface 50 may further include a status bar (not shown in the figure). As shown in FIG. 10, the electronic device 100 may display a corner mark on the icon of the phone application, that is, display a number (for example, "1") in the upper right corner of the icon of the phone application, prompting the user that the electronic device 100 has received a new Call. Here, the user interface 50 may be displayed after the user lights up the display screen of the electronic device 100 and releases the locked state of the electronic device 100, or may be the user through a navigation key from another interface (such as the user interface shown in 9a of FIG. 9) What is obtained by the handover is not limited in the embodiments of the present application.

The method shown in FIG. 9 or FIG. 10 is not limited to the method of prompting the user that the electronic device 100 has received a new call during the projection process. The electronic device 100 may also prompt the user of a missed call in other ways. The embodiment of the present application does not limit it. For example, the electronic device 100 may also display a missed call icon on the status bar displayed on the display screen.

In some embodiments, the electronic device 100 may not only prompt the user by displaying an image as shown in FIG. 9 or FIG. 10, but may also prompt the user by other methods of missed calls during the projection process. For example, the electronic device 100 may also notify the user of a missed call by vibration, prompt sound, or flashing breathing light.

Understandably, the manners mentioned in the foregoing embodiments to prompt the user that the electronic device 100 has received a new call during projection may be implemented in combination. For example, the electronic device 100 may not only display the prompt window 301 in the top area of the screen of the display screen, but also display numbers on the icon of the phone application, and may vibrate at the same time to prompt the user.

With reference to the embodiment of FIG. 9 or FIG. 10, the electronic device 100 prompts the user that a new incoming call is received during the projection process, and there may be the following setting methods: 1. The prompt method may be set by the electronic device 100. Specifically, the prompting method may be the default setting when the electronic device 100 is shipped from the factory. For example, the electronic device may be set to prompt the user in the manner shown in FIGS. 9 and 10. 2. The prompt method can be set by the user. For example, the user may set to prompt the user through the method of FIG. 9 and vibration.

After prompting the user to receive the new message, the electronic device 100 may continue the projection or may quit the projection, which is not limited in the embodiment of the present application.

In the above embodiment, the electronic device 100 receives a new incoming call during projection as an example. The message processing method of the embodiment of the present application is described. Understandably, when the electronic device 100 receives other types of messages during projection, it also The message processing method of the embodiments of the present application may be used. Here, the other messages may include but are not limited to: short messages, incoming calls, instant application messages (such as WeChat messages, QQ messages) or application notification messages (such as application push messages), and so on. When the electronic device 100 receives a new message during projection, no prompt message will appear on the projected image to avoid disturbing the user. When the electronic device 100 receives a new message, the electronic device 100 can also automatically reply to the initiator of the new message, facilitating effective communication between the two parties and improving the user experience.

The embodiments of FIG. 4 and FIG. 6 to FIG. 10 describe the message processing method of the embodiment of the present application through an example of human-computer interaction. The following describes how the embodiment of the present application implements the above message processing method based on the software architecture of the electronic device 100. In the following, the electronic device 100 receives a new incoming call during projection as an example for description.

Referring to 11a of FIG. 11, it is a schematic diagram of internal processing when the electronic device 100 receives a new call during projection in the prior art. As shown in the figure, the message processing method when the electronic device 100 receives a new call may include the following steps:

1. First, the modem of the hardware layer receives the new incoming message and reports the message to the application framework layer (framework layer).

2. The application framework layer receives the new call message and notifies the application (APP) layer of the new call message in the form of broadcast. All applications in the application layer that monitor the call status based on the CS network can receive the new call message. broadcast.

Applications in the application layer can register whether to monitor the call status based on the CS network, and all applications that monitor the call status can receive the broadcast sent by the application framework layer. The broadcast may carry information such as caller, caller number, call time, caller number attribution, etc.

3. The application that receives the broadcast in the application layer performs the corresponding operation.

After receiving the broadcast, different applications in the application layer can perform different operations. These operations are used to prompt the user for a new call. Here, the operation for prompting the user of a new call can be set by the electronic device or the user.

For example, the phone application can receive the broadcast, and after receiving the broadcast, the phone application can display the caller ID screen on the display screen or the projected image of the electronic device 100, and can also display the corner icon on the icon of the phone application. You can call the notification bar to display prompt information in the notification bar. For another example, the video application may receive the broadcast. After the video application receives the broadcast, if the video is currently playing, the currently playing video will be paused.

As can be seen from the above steps, when the electronic device 100 receives an incoming call during projection, it will display a prompt message on the display screen or the projected image, causing interference to the user.

Refer to 11b of FIG. 11, which is a schematic diagram of internal processing when the electronic device 100 receives a new call during projection in the embodiment of the present application. As shown in the figure, the message processing method when the electronic device receives a new call may include the following steps:

1. First, the modem at the hardware layer receives the new call message and reports the message to the application framework layer.

2. The application framework layer receives the new call message, and will not broadcast the call message to the application (APP) layer, that is, all applications in the application layer that monitor the call status based on the CS network cannot know the New call.

In some embodiments, the method may further include the following steps:

3. The application framework layer sends the new call message to the first application in the application layer in the form of a first notification.

Specifically, the first notification may be a customized notification message, and the first notification is directed to the first application. The first notification may carry at least one of the following: the caller, the caller number, the call time, or the place where the caller number belongs.

The first application may be one application (for example, a short message application) or multiple applications.

4. The first application at the application layer receives the first notification and automatically replies to the initiator of the new message according to the first notification.

For example, when the first application is a short message application, it can automatically reply a short message to the new message initiator according to the information carried in the first notification. For the content of the reply message, please refer to the embodiment of FIG. 8 and related description.

Through the internal processing shown in 11b of FIG. 11, since the application framework layer no longer sends broadcasts, the application that monitors the call status in the application layer cannot learn that there is a new call, and will not perform the corresponding operation according to the new call. . The corresponding operation may include displaying a caller ID screen on the display screen or projected image of the electronic device 100, displaying a corner mark on the icon of the phone application, or calling a notification bar to display prompt information in the notification bar, etc., to avoid disturbing the user. In addition, the application framework layer sends the first notification to the first application, which can cause the first application to automatically reply to the originator of the new message, promote effective communication between the two parties, and improve the user experience.

Understandably, the content of the first notification is related to the type of new message received by the electronic device 100. For example, when the electronic device 100 receives a WeChat message, the first notification may carry the identification of the WeChat application, the nickname of the sender, and the content of the WeChat message. For another example, when the electronic device 100 receives the QQ message, the first notification may carry the identifier of the QQ application, the nickname of the sender, and the content of the QQ message.

Understandably, the first application is related to the manner in which the electronic device 100 automatically replies to the originator of the new message when a new message is received during projection. For example, when the electronic device 100 always replies to the initiator of a new message through a short message, the first application is a short message application. For another example, when the electronic device 100 automatically receives a new message originator through a WeChat application when receiving a WeChat message during projection, the first application is a WeChat application. Here, for the way that the electronic device 100 automatically replies to the originator of the new message when receiving a new message in the projection process, reference may be made to the related description above, and details are not described here.

In some embodiments, the electronic device 100 may implement the internal processing procedure when receiving an incoming call during projection as shown in 11b through the following code:

In some embodiments, in some cases (refer to the three cases mentioned in step S104 of the embodiment in FIG. 5), the electronic device 100 may also prompt the user that the electronic device 100 has received a new message during the projection process. It prompts the user that there are currently unprocessed new messages. For the manner in which the electronic device 100 prompts the user that there is an unprocessed new message, reference may be made to the related descriptions in the embodiments of FIGS. The following describes the internal processing procedure when the electronic device 100 prompts the user that there is an unprocessed new message. Referring to FIG. 12, taking the unprocessed new message as a missed call as an example, the process may include the following steps:

1. The application framework layer of the electronic device 100 sends a broadcast to the second application in the application layer, the broadcast carrying information of unprocessed new messages.

Specifically, when the electronic device 100 receives a new message during the projection process, the application framework layer will record the information of the new message. That is to say, in step 1 shown in 11b of FIG. 11, after receiving a new call message uploaded by the hardware layer, the application framework layer records specific information of the new call. The specific information of the new call may include at least one of the following: the caller, the caller number, the call time, or the place where the caller number belongs.

In some cases (refer to the three cases mentioned in step S104 of the embodiment of FIG. 5), the application framework layer sends a broadcast to the second application, and the broadcast may carry at least one of the following: caller, caller number, call time, or Where the caller number belongs.

The second application may be one application (for example, a phone application), or multiple applications.

2. The second application receives the broadcast and performs the corresponding operation according to the broadcast.

The second application performs operations according to the broadcast to prompt the user that the electronic device 100 has missed new calls during the projection process. Here, the operation for prompting the user of a missed new call can be set by the electronic device or the user.

For example, the second application may include a phone application. After receiving the broadcast, the phone application may display a corner icon on the icon of the phone application, and may also call a notification bar to display prompt information in the notification bar.

Understandably, the content broadcast in step 1 is related to the type of new message received by the electronic device 100. For example, when the electronic device 100 receives a WeChat message, the broadcast may carry the WeChat application logo, the sender's nickname, the content of the WeChat message, and so on. For another example, when the electronic device 100 receives the QQ message, the broadcast may carry the identification of the QQ application, the nickname of the sender, and the content of the QQ message.

Understandably, the second application and the operation performed by the second application are related to the manner in which the electronic device 100 prompts the user that the electronic device 100 has received a new message during the projection process. For example, when the electronic device prompts the user through the user interface shown in 9b of FIG. 9, the second application may be a phone application, and the phone application may hover the prompt window 301 in the top area of the screen of the display screen. For another example, when the electronic device prompts the user through the user interface shown in FIG. 10, the second application may be a phone application, and the phone application may display a corner mark on the application icon. For another example, when the electronic device vibrates to prompt the user, the second application may be a phone application, and the phone application may call the motor of the electronic device 100 to generate the vibrating prompt.

With reference to the embodiments of FIG. 5 to FIG. 12, in the application scenario 1, when the electronic device receives a new message during projection, the prompt information will not be displayed on the projected image, which can avoid interference to the user. In addition, the electronic device can also automatically reply to the received new message to achieve effective communication between users.

Application scenario 2: The electronic device 100 is connected to another terminal. When the terminal uses the projection function of the electronic device 100 to project, the terminal receives a new message.

The electronic device 100 can establish a connection with other terminals through Bluetooth, WiFi, ZigBee, NFC, etc. Here, the terminal may be a mobile phone, a computer, a tablet, and other devices. In the application scenario 2, the terminal uses the projection function of the electronic device 100 to project means that the terminal transmits the projection content to the electronic device 100 through the connection with the electronic device 100, and the electronic device 100 uses the built-in projector to form the projection content according to the projection content Project an image and project the projected image on a three-dimensional object. The projected content sent by the terminal to the electronic device 100 includes, but is not limited to: documents, pictures or videos.

Exemplarily, referring to 13a of FIG. 13, it shows a schematic diagram of a scene projected by the terminal 300 using the projection function of the electronic device 100 after the electronic device 100 (eg, smart watch) and the terminal 300 (eg, mobile phone) establish a connection. As shown in 13a, the projected image 10 projected by the terminal 300 using the electronic device 100 may include a chart 101. In some embodiments, the projected image 10 may further include a status bar (not shown in the figure) and/or a navigation bar (not shown in the figure).

Exemplarily, as shown in 13b of FIG. 13, when the terminal 300 receives a new message such as a new incoming call, the top area of the projected image 10 will display a prompt window 102 for the new incoming call. The prompt window 102 may include prompt information such as a caller, an answer control, and a hang-up control. Not limited to the prompt window shown in 13b, in other embodiments, the entire area of the projected image 10 may be used to display an incoming call notification interface to prompt the user of a new incoming call.

In some other embodiments, when the terminal 300 receives a new message, it may not only display a prompt window on the projected image 10 formed by the electronic device 100 to prompt the user, but may also prompt the user through the vibration and/or prompt sound of the terminal 300 New news.

As can be seen from FIG. 13, when the terminal 300 receives a new message such as a new call, it will display a prompt message on the projected image 10 projected by the electronic device 100, interfering with the user, which is undesirable by the user. In many cases, for example, during a meeting, when a user is watching a video or playing a game, etc., the user does not want a prompt message to appear on the projected image 10.

To solve the above technical problems, the embodiments of the present application provide a message processing method, which can ensure that the user is not disturbed during the projection process. Implementing the message processing method provided in the embodiment of the present application, when receiving a new message, the terminal 300 will not send the prompt information of the new message to the electronic device 100, that is, the prompt information will not be displayed on the projected image 10 projected by the electronic device 100 To avoid disturbing users.

As shown in FIG. 14, an embodiment of the present application provides a message processing method, specifically including:

Step S201: The terminal 300 receives a new message.

Specifically, the new messages received by the terminal 300 when projected by the electronic device 100 may include: short messages, incoming calls, instant application messages (such as WeChat messages, QQ messages) or application notification messages (such as application push messages), and so on. The following embodiments will use the terminal 300 to receive a new incoming call when projecting using the electronic device 100 as an example to describe the message processing method provided by the embodiment of the present application.

Step S202: The terminal 300 does not display the prompt information of the new message in the projected image.

In the embodiment of the present application, when the terminal receives a new message in the following situations, it may not display the prompt information of the new message on the projected image:

1. The terminal 300 is connected to the electronic device 100, and when projecting using the projection function of the electronic device 100, the prompt information of the new message is not displayed in the projected image.

In some embodiments, the user does not want to be disturbed when projecting using the projection function of the electronic device 100. In a specific implementation, when the terminal 300 is connected to the electronic device 100 and sends the projected content to the electronic device 100, the prompt information of the new message is not displayed in the projected image.

2. When the terminal 300 uses the projection function of the electronic device 100 to display a specific file on the projected image, the prompt information of the new message is not displayed in the projected image.

In a specific implementation, the terminal 300 may determine whether to display the prompt information of the new message in the projected image according to the projection content sent to the electronic device 100. Specifically, the user may store specific files in a specific path of the terminal 300, for example, the user may store all files used in the conference in the folder "meeting", when the terminal 300 displays the folder "meeting" through the projection function of the electronic device 100 ", it can be determined that the current user does not want to be disturbed, and the terminal 300 does not display the prompt information of the new message in the projected image. For another example, when the terminal 300 displays a Word document or picture in a specific format on the projected image through the projection function of the electronic device 100, it can be determined that the current user does not want to be disturbed, and the terminal 300 does not display the prompt information of the new message in the projected image.

3. After the user manually starts the projection do not disturb mode of the terminal 300, the terminal 300 does not display the prompt information of the new message in the projected image.

In some embodiments, the terminal 300 may provide the user with a control to start/exit the projection do not disturb mode. Exemplarily, the terminal 300 may provide a control to start/exit the projection do not disturb mode on the setting interface. Exemplarily, referring to FIG. 15, FIG. 15 is a setting interface 60 provided by the terminal 300 on the display screen. As shown in FIG. 15, the setting interface 60 includes a control 401 for starting/exiting the projection do not disturb mode. When the terminal 300 exits the projection do not disturb mode, the user can click the control 401 in the setting interface 60 shown in FIG. 15, and the terminal 300 can start the projection do not disturb mode after detecting the user's click operation on the control 401. After the terminal 300 starts the projection do not disturb mode, when a new message is received during projection, the prompt information of the new message is not displayed on the projected image.

It is not limited to the above-mentioned three kinds of cases in which the terminal 300 does not display the prompt information of the new message on the projected image. In other cases, the terminal 300 may not display the prompt information of the new message on the projected image, so as to avoid disturbing the user. The embodiments of the present application are not limited. For example, during a fixed time period on a working day (for example, 9:00-17:00), if the terminal 300 receives a new message during projection, the terminal 300 may not display the prompt information of the new message on the projected image.

Exemplarily, referring to 16a of FIG. 16, 16a shows a projection image 10 formed by the terminal 300 using a projector built in the electronic device 100. The projection image 10 shown in 16a is the same as the projection image shown in 13a of FIG. 13, Refer to the related description of FIG. 13. When the terminal 300 receives a new incoming call, for example, referring to 13b of FIG. 13, the prompt information of the new incoming call will not be displayed on the projected image.

Specifically, in general, when the terminal 300 receives a new message, the display manner of the prompt information of various messages in the projected image may include one or more of the following: banner display (that is, floating display at the top area of the projected image) , Displayed on the status bar, icon corner (that is, the number displayed in the upper right corner of the application icon), etc. Among them, the banner display can refer to the prompt window 102 in 13b of FIG. 13, the display on the status bar means that the icon of the projected image can display the missed call icon, and the icon corner means that when the projected image includes the display terminal 300 When the desktop of the application is installed, the number of missed calls (for example, "1") is displayed in the upper right corner of the icon of the phone application.

In the embodiment of the present application, the terminal 300 does not display the prompt information of the new message on the projected image. Therefore, the projected image 10 does not display the prompt information of any of the above-mentioned display modes. The above prompt information is not displayed on the projected image, which can avoid interference to the user during the projection process. In particular, when the user uses the terminal 300 during the conference and uses the projection function of the electronic device 100 to project, interference with the conference can be avoided. In a specific implementation, the terminal 300 does not send the prompt information of the new message to the electronic device 100 when receiving the new message. Therefore, the above prompt information is not displayed on the projected image projected by the electronic device 100.

In some other embodiments, when the terminal 300 receives a new message, the prompt information is not displayed on the projected image, but the terminal 300 may notify the user that the terminal 300 has received the new message during the projection process by vibrating, prompting sound, or breathing light flashing. .

In other embodiments of the present application, when the terminal 300 receives a new message, it does not display the prompt information on the projected image, and also does not prompt the user that the terminal 300 receives the projection process during the projection process by vibrating, prompting sound, or breathing light flashing. New news. In this way, all interference caused by new messages can be avoided.

In some embodiments, the message processing method shown in FIG. 14 may further include:

Step S203: The terminal 300 replies to the new message originator, prompting the new message originator that the current user is inconvenient to respond to the new message.

Specifically, the manner in which the terminal 300 replies to the initiator of the new message is the same as the manner in which the electronic device 100 replies to the initiator of the new message in Application Scenario 1, and reference may be made to the relevant description of step S103 in the example of FIG. 5.

Step S204: The terminal 300 prompts the user to receive a new message.

Specifically, the terminal 300 prompts the user to receive the new message, that is, prompts the user to receive the new message during the projection process. After the terminal 300 prompts the user to receive the new message, the user can learn that there are currently unprocessed new messages.

In the embodiment of the present application, the terminal 300 may prompt the user to receive a new message in the following situations:

1. When the terminal 300 no longer uses the projection function of the electronic device 100 to project, it prompts the user to receive a new message.

In a specific implementation, the terminal 300 may determine the current exit from the projection in the following manner: (1) The terminal 300 detects that the electronic device 100 is currently disconnected. (2) The terminal 300 detects whether the projection content is currently sent to the electronic device 100, and determines that the terminal 300 is currently exiting projection when no projection content is sent.

2. When the terminal 300 exits the presentation of a specific file on the projected image, the user is prompted to receive a new message.

In some embodiments, the user usually displays some specific files on the projected image, such as documents, pictures, etc. When displaying these specific files, the user hopes not to be disturbed, and when exiting to display these specific files, the user wants the terminal 300 Prompt the user to receive a new message.

3. After the user manually exits the projection do not disturb mode of the terminal 300, the user is prompted to receive a new message.

In some embodiments, the terminal 300 may provide a user with a control to manually start/exit the projection do not disturb mode, see FIG. 15 and related descriptions. When the terminal 300 is in the projection do not disturb mode, the user can click the control 401 in the setting interface 60 shown in FIG. 15. After the terminal 300 detects the user's click operation on the control 401, it exits the projection do not disturb mode.

It is not limited to the above-mentioned three examples of the case where the terminal 300 prompts the user to receive a new message. In other cases, the terminal 300 may also prompt the user to receive a new message, which is not limited in the embodiments of the present application. For example, during a fixed time period on a working day (for example, 17:00-9:00), the terminal 300 may prompt the user to receive a new message.

Specifically, the terminal 300 may prompt the user on the display screen of the terminal 300 and/or the projection image formed by the electronic device 100 that there is a new message that has not yet been processed. The following uses terminal 300 to prompt the user on the display screen as an example for description.

In some embodiments, the terminal 300 may hover over the top area of the display screen to display prompt information for missed calls. Here, the manner in which the terminal 300 floats the prompt information of the missed call in the top area of the display screen is similar to the manner in which the electronic device 100 floats the prompt information in the top area of the display screen in the application scenario 1, and reference may be made to the related description.

In some embodiments, the terminal 300 may display prompt information of missed calls on the icon of the phone application. Here, the manner in which the terminal 300 displays the missed call prompt information on the icon of the phone application is similar to the manner in which the electronic device 100 displays the missed call prompt information on the phone application icon in the application scenario 1, and reference may be made to the related description.

In some embodiments, the terminal 300 may also prompt the user of missed calls in other ways. For example, the terminal 300 may also notify the user of a missed call by means of vibration, prompt sound, or breathing light flashing.

It is understandable that the manner of prompting the user terminal 300 to receive a new call during the projection mentioned in the above embodiments may be implemented in combination. For example, the terminal 300 may not only display a prompt window in the top area of the screen of the display screen, but also display numbers on the icon of the phone application, and may vibrate at the same time to prompt the user.

The method for the terminal 300 to prompt the user to receive a new incoming call during projection may have the following setting methods: 1. The prompt method may be set by the terminal 300. Specifically, the prompting method may be the default setting when the terminal 300 is shipped from the factory. 2. The prompt method can be set by the user.

After the terminal 300 prompts the user to receive the new message, it may continue to use the projection function of the electronic device 100 to project, or may exit projection, which is not limited in the embodiment of the present application.

The above embodiment takes the terminal 300 receiving a new call as an example during the projection process, and describes the message processing method of the embodiment of the present application. It is understandable that the terminal 300 may also adopt other types of messages during the projection process. The message processing method of the embodiment of the present application. Here, the other messages may include but are not limited to: short messages, incoming calls, instant application messages (such as WeChat messages, QQ messages) or application notification messages (such as application push messages), and so on. When the terminal 300 receives a new message during the projection process, no prompt message will appear on the projected image to avoid disturbing the user. When the terminal 300 receives a new message, the terminal 300 can also automatically reply to the initiator of the new message, facilitating effective communication between the two parties and improving the user experience.

14-16, in the application scenario 2, when the terminal uses the projection function of the electronic device to project, if the terminal receives a new message during the projection process, the prompt information will not be displayed on the projected image, which can avoid the user Cause interference. In addition, the terminal can also automatically reply to the received new message to achieve effective communication between users.

In summary, with the implementation of this application, when an electronic device receives a new message during projection, it will not display a prompt message on the projected image, which can avoid interference to the user. In addition, the electronic device can also automatically reply to the received new message, which can achieve effective communication between users and improve the user experience.

The embodiments of the present application can be arbitrarily combined to achieve different technical effects.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the present application are generated in whole or in part. The computer may be a general-purpose computer, a dedicated computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be from a website site, computer, server or data center Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device including a server, a data center, and the like integrated with one or more available media. The available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk).

In short, the above is only an embodiment of the technical solution of the present application, and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions, improvements, etc. made according to the disclosure of this application shall be included in the scope of protection of this application.

Claims

A message processing method, the method is applied to an electronic device, the electronic device is equipped with a projector, characterized in that the method includes:

The electronic device receives the first message;

In response to receiving the first message, the electronic device determines whether the projector is projecting a projection image onto a three-dimensional object;

When it is determined that the projector is projecting the projection image onto the three-dimensional object, the prompt information of the first message is not displayed on the projection image.
The method according to claim 1, wherein after the electronic device receives the first message, the method further comprises:

The electronic device sends a second message to the terminal that initiated the first message, where the second message is used to prompt the terminal that initiated the first message that it is currently inconvenient for the electronic device to respond to the first message.
The method according to claim 1 or 2, wherein the method further comprises:

The electronic device stops projecting the projected image onto the three-dimensional object through the projector;

The electronic device prompts the user to receive the first message.
The method according to any one of claims 1-3, characterized in that

The projected image is generated by the electronic device or transmitted to the electronic device by a terminal connected to the electronic device; or,

The method further includes: the electronic device capturing the interaction between the user and the three-dimensional object, the electronic device changing the projected image in response to the interaction between the user and the three-dimensional object; or,

The first message is any one of the following: SMS, incoming call, instant application message or application notification message; or

The prompt information of the first message includes at least one of the following: a prompt window and a corner mark on the application icon.
An electronic device includes: a processor, a projector and a communication module, the processor is connected to the projector and the communication module, wherein,

The communication module is configured to receive the first message;

The processor is configured to determine whether the projector is projecting a projection image onto a three-dimensional object; when it is determined that the projector is projecting the projection image onto the three-dimensional object, indicating that the projector is not present Displaying the prompt information of the first message on the projection image;

The projector is configured to project the projected image onto the three-dimensional object in response to instructions from the processor.
The electronic device according to claim 5, characterized in that

The communication module is also used to send a second message to the terminal that initiated the first message, the second message is used to prompt the terminal that initiated the first message that the electronic device is currently inconvenient to respond to the first message .
The electronic device according to claim 5 or 6, wherein

The processor is also used to instruct the projector to stop projecting the projected image onto the three-dimensional object and prompt the user to receive the first message.
The electronic device according to any one of claims 5-7, characterized in that

The projected image is generated by the processor or received by the communication module from a terminal connected to the electronic device; or,

The electronic device further includes a sensor for capturing the interaction between the user and the three-dimensional object, and the processor is further for responding to the interaction between the user and the three-dimensional object Change the projected image; or,

The first message is any one of the following: SMS, incoming call, instant application message or application notification message; or

The prompt information of the first message includes at least one of the following: a prompt window and a corner mark on the application icon.
An electronic device is characterized by comprising: a hardware layer, an application framework layer and an application layer, wherein:

The hardware layer is used to receive the first message and report the first message to the application framework layer;

The application framework layer is used to record the information of the first message, and the information of the first message is not sent to the application layer during projection by the electronic device;

The application layer is used to run one or more application programs.
The electronic device according to claim 9, characterized in that

The application framework layer is also used to send the information of the first message to the first application running in the application layer;

The first application running in the application layer receives the information of the first message sent by the application framework layer, and replies to the terminal that initiated the first message according to the information of the first message.
The electronic device according to claim 9 or 10, wherein

The application framework layer is also used to send the information of the first message to the second application running in the application layer when the electronic device stops projection;

The second application running in the application layer receives the information of the first message sent by the application framework layer, and prompts the user according to the information of the first message that the electronic device has received the first message news.
The electronic device according to claim 11, wherein the application framework layer sends the information of the first message to the second application running in the application layer in the form of broadcast.
A computer storage medium, characterized by comprising computer instructions, when the computer instructions run on an electronic device, the electronic device is caused to execute the message processing method according to any one of claims 1-4.