WO2022063110A1 - 一种消息提醒方法及电子设备 - Google Patents

一种消息提醒方法及电子设备 Download PDF

Info

Publication number
WO2022063110A1
WO2022063110A1 PCT/CN2021/119557 CN2021119557W WO2022063110A1 WO 2022063110 A1 WO2022063110 A1 WO 2022063110A1 CN 2021119557 W CN2021119557 W CN 2021119557W WO 2022063110 A1 WO2022063110 A1 WO 2022063110A1
Authority
WO
WIPO (PCT)
Prior art keywords
message
area
application interface
indication
electronic device
Prior art date
Application number
PCT/CN2021/119557
Other languages
English (en)
French (fr)
Inventor
熊刘冬
李春东
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US18/027,592 priority Critical patent/US20240007559A1/en
Priority to EP21871480.6A priority patent/EP4210308A4/en
Publication of WO2022063110A1 publication Critical patent/WO2022063110A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/724094—Interfacing with a device worn on the user's body to provide access to telephonic functionalities, e.g. accepting a call, reading or composing a message
    • H04M1/724097—Worn on the head
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04802—3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions

Definitions

  • the present application relates to the field of terminal technologies, and in particular, to a message reminder method and electronic device.
  • AR augmented reality
  • VR virtual reality
  • the interface of the application will be displayed in all directions of the space.
  • the application interface corresponding to the new message is not available within the visual field that the user can see, for example, the application interface corresponding to the new message is behind the user, in this case, the user may need to find the application program corresponding to the new message in the space, and then the new message can be processed. Therefore, how to enable the user to easily find the application interface corresponding to the new message is a problem to be solved.
  • the present application provides a message reminder method and an electronic device, which are used to facilitate a user to find an application interface corresponding to a message, improve the speed of the user's viewing and processing efficiency, and improve the user experience.
  • the present application provides a message reminder method, which can be applied to a virtual reality VR device or an augmented reality AR device.
  • the method may include: receiving a first message; determining an identifier of the first application interface to which the first message belongs; and obtaining, according to the first application interface identifier, the location of the first application interface to which the first message belongs.
  • the first area when it is determined that the first area where the first application interface to which the first message belongs is not located in the second area, indicating the azimuth relationship between the first message and the first application interface through a first indication form , the second area is the area where the user's field of view is located.
  • the VR/AR device when the VR/AR device receives a new message, it can determine whether the application interface to which the new message belongs is within the user's field of vision. The location of the application interface to which the message belongs, so that the user can quickly find the location of the application interface to which the new message belongs, which can improve user experience.
  • the determining the first application interface identifier to which the first message belongs includes: acquiring the identifier information carried in the first message; according to the identifier information carried in the first message, Determine the first application interface identifier to which the first message belongs.
  • the electronic device can determine the application interface to which the new message belongs according to the identification information carried in the new message, so that when the application interface to which the new message belongs is out of the user's field of vision, the user can be reminded through the displayed indication form .
  • the method further includes: displaying the first message in the second area in the form of a notification.
  • the electronic device when the electronic device receives a new message, if the application interface to which the new message belongs is not within the user's field of vision, it can be displayed within the user's field of vision in the form of a notification, so that the user can see the new message in a timely manner.
  • the message can also enable the user to determine whether the new message is an urgent message according to the content of the new message, which can facilitate the user to arrange and process the message according to the content of the message.
  • the method further includes: if it is determined that the first area is within the second area, displaying the first message on the first application interface to which the first message belongs.
  • the new message can be directly displayed on the application interface to which the new message belongs, so that the user can view and process the message in time.
  • the application may include the following two a situation:
  • Case 1 It is determined that the first area where the first application interface to which the first message belongs is not located in the third area, the third area is the first sub-area of the second area, and the third area is It is the current display area of the VR device or AR device.
  • Scenario 2 It is determined that the first area where the first application interface to which the first message belongs is located in the third area, but not in the fourth area, and the fourth area is the second child of the second area area, the fourth area is the area that the user's eyes are currently looking at.
  • the first indication form can be determined in the following ways, so that the electronic device can indicate the new message and the location information of the application interface to which the new message belongs according to the determined first indication form:
  • Manner 1 Determine the first indication form in the first set according to the distance between the first message and the first application interface.
  • the first set includes at least one indication form, and the first set is pre-stored in the VR device or the AR device.
  • the electronic device can select the indication form according to the distance between the new message and the application interface to which the new message belongs, so that when the electronic device receives multiple new messages, the indication form displayed in the space can be made clearer , which is convenient for users to view.
  • Manner 2 An indication form is arbitrarily selected from the first set as the first indication form.
  • the first set includes at least one indication form, and the first set is pre-stored in the VR device or the AR device.
  • Manner 3 Determine the first indication form according to the numbering sequence of the indication forms in the first set.
  • the first set includes at least one indication form, and the first set is pre-stored in the VR device or the AR device.
  • Manner 4 Display prompt information in the second area, where the prompt information is used to prompt the user to select a first indication form in a first set, where the first set includes at least one indication form, and the first The set is stored in the VR device or the AR device in advance; the first indication form selected by the user is determined as the first indication form.
  • the electronic device can randomly select the instruction form, or select the instruction form in a certain order.
  • the user can also choose the instruction form with reference to the user's habits, which can improve the user experience.
  • the first indication form may include any one of the following forms: pointer indication, connection indication, and animation indication.
  • pointer for example, ball scrolling
  • connection indication for example, ball scrolling
  • animation for example, ball scrolling
  • the new message can be associated with the application interface to which the new message belongs, which can facilitate the user to quickly find the location of the application interface corresponding to the new message.
  • the first indication form can be displayed in an explicit form or can also be displayed in an implicit form.
  • the display form here is the display form that is continuously displayed in the space
  • the implicit form here is the display form that disappears after being displayed in the space for a set period of time.
  • the indication form between the new message and the application interface to which the new message belongs can be displayed all the time, or only for a certain period of time, which is convenient for users to view and process messages according to their own schedule.
  • the present application also provides an electronic device, the electronic device comprising: a display screen; one or more processors; a memory; a plurality of applications; and one or more computer programs; wherein the one or more computers Programs are stored in the memory, and the one or more computer programs include instructions that, when invoked for execution by the one or more processors, cause the electronic device to perform the first aspect and its first described above.
  • the electronic device comprising: a display screen; one or more processors; a memory; a plurality of applications; and one or more computer programs; wherein the one or more computers Programs are stored in the memory, and the one or more computer programs include instructions that, when invoked for execution by the one or more processors, cause the electronic device to perform the first aspect and its first described above.
  • any technical solution that may be designed.
  • the present application further provides an electronic device, the electronic device includes modules/units for implementing the first aspect or any possible design method of the first aspect; these modules/units may be implemented by hardware, or The corresponding software implementation is performed by hardware.
  • an embodiment of the present application further provides a chip, which is coupled to a memory in an electronic device, and implements the first aspect of the embodiment of the present application and any possible design technical solutions of the first aspect; an embodiment of the present application "Coupled" means that two components are directly or indirectly coupled to each other.
  • an embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium includes a computer program, and when the computer program runs on an electronic device, the electronic device is made to execute the first embodiment of the present application.
  • an embodiment of the present application further provides a computer program product, which, when the computer program product runs on an electronic device, enables the electronic device to perform the first aspect of the embodiment of the present application and any possibility of the first aspect thereof designed technical solutions.
  • 1A is a schematic structural diagram of an electronic device according to an embodiment of the application.
  • FIG. 1B provides a schematic diagram of a head-mounted VR device according to an embodiment of the present application
  • FIG. 2 is a block diagram of a software structure of an electronic device provided by an embodiment of the present application.
  • FIG. 3 is a flowchart of a message reminder method provided by an embodiment of the present application.
  • 4A is a schematic display diagram of an application interface provided by an embodiment of the present application.
  • 4B is a schematic diagram of the relationship between the position of an application interface and the position of the user's field of view according to an embodiment of the present application;
  • FIG. 5 is a schematic diagram of a user interface provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a user interface provided by an embodiment of the present application.
  • FIG. 7A is a schematic diagram of a message reminder method provided by an embodiment of the present application.
  • FIG. 7B is a schematic diagram of another message reminder method provided by an embodiment of the present application.
  • FIG. 7C is a schematic diagram of another message reminder mode provided by an embodiment of the present application.
  • FIG. 7D is a schematic diagram of yet another message reminder method provided by an embodiment of the present application.
  • FIG. 8 is a schematic interface diagram of a user selecting an association form according to an embodiment of the present application.
  • FIG. 9A is a schematic interface diagram of another user-selected association form provided by an embodiment of the present application.
  • 9B is a schematic interface diagram of yet another user-selected association form provided by an embodiment of the present application.
  • 9C is a schematic interface diagram of yet another user-selected association form provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.
  • the application (application, App) involved in the embodiments of the present application is a software program capable of implementing one or more specific functions.
  • multiple applications may be installed in an electronic device.
  • Douyin application SMS application
  • browser application WeChat (WeChat), Weibo, iQiyi, Youku, Tencent Video, etc.
  • the application mentioned below may be an application that has been installed when the electronic device is shipped from the factory, or may be an application downloaded from a network or acquired by a user during the use of the electronic device.
  • the methods provided in the embodiments of the present application may be applicable to portable electronic devices with display screens, such as wearable devices (AR/VR devices), for example, VR glasses and AR glasses, which are not limited in the embodiments of the present application.
  • portable electronic devices include, but are not limited to, carry-on Or portable electronic devices with other operating systems.
  • the electronic device includes a processor 110 , a display screen 120 , an audio module 130 , a sensor module 140 , an internal memory 150 , an external memory interface 160 , and a universal serial bus (USB) interface 170 , a charge management module 180 , a power management module 181 and a battery 182 .
  • the electronic device may further include a communication module, keys, and the like.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the display screen 120 is used to display the display interface of the application and the like.
  • the display screen 120 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed
  • quantum dot light-emitting diode quantum dot light emitting diodes, QLED
  • the electronic device can implement audio functions through the audio module 130, the microphone 131, the speaker 132, the AP, and the like. Such as music playback, recording, etc.
  • the audio module 130 can be used for converting digital audio signals into analog audio signals for output, and also for converting analog audio signals into digital audio signals. Audio module 130 may also be used to encode and decode audio signals.
  • the audio module 130 may be provided in the processor 110 , or some functional modules of the audio module 130 may be provided in the processor 110 . It should be noted that, in this embodiment of the present application, the audio module 130 may also be referred to as a codec (codec).
  • the microphone 131 also referred to as “microphone” and “microphone”, is used to convert sound signals into electrical signals.
  • the user uses the electronic device to make a call or send a voice, the user can make a sound through the human mouth close to the microphone 131, and the microphone 131 can be used to collect the user's voice and then convert the user's voice into an electrical signal.
  • the electronic device may be provided with at least one microphone 131 .
  • the electronic device may be provided with two microphones 131 to help realize the noise reduction function.
  • the speaker 132 also called “speaker” is used to convert audio signals into sound signals and play them.
  • the electronic device can listen to music or answer hands-free calls through the speaker 132 .
  • the electronic device in the embodiments of the present application may be provided with one or more speakers, and the type of the speakers provided in the electronic device is not limited.
  • the audio signal output by the audio module 130 may be amplified by an amplifier, and then output to the speaker 132, and the speaker 132 converts the audio signal into a sound signal and plays it. This helps to improve the quality of sound playback.
  • the sound signal played by the speaker 132 may be acquired by the AP from the internal memory 150 or the external memory connected to the external memory interface 160, or may be acquired by the AP from the communication module.
  • the source of the sound signal played by the speaker 132 is not limited in this embodiment of the present application.
  • Sensor module 140 includes one or more sensors.
  • a touch sensor also known as a "touch panel”.
  • the touch sensor may be disposed on the display screen 120, and the touch sensor and the display screen 120 form a touch screen, also referred to as a "touch screen”.
  • a touch sensor is used to detect touch operations on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 120 .
  • the touch sensor may also be disposed on the surface of the electronic device 100 , which is different from the position where the display screen 120 is located.
  • the sensors in the electronic device 100 may further include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a temperature sensor, a bone conduction sensor, etc.
  • a pressure sensor e.g., a Bosch Sensortec BMA150 sensor
  • a gyroscope sensor e.g., an air pressure sensor
  • a magnetic sensor e.g., a Bosch Sensors, etc.
  • Internal memory 150 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 150 .
  • the internal memory 150 may include a stored program area and a stored data area.
  • the storage program area may store the operating system, and the software code of at least one application (eg, iQIYI application, WeChat application, etc.).
  • the storage data area may store data (eg, images, videos, etc.) and the like generated during the use of the electronic device 100 .
  • the internal memory 150 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the external memory interface 160 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
  • the external memory card communicates with the processor 110 through the external memory interface 160 to realize the data storage function. Such as saving pictures, videos and other files in an external memory card.
  • the USB interface 170 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 170 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices.
  • the charging management module 180 is used to receive charging input from the charger.
  • the power management module 181 is used to connect the battery 182 , the charging management module 180 and the processor 110 .
  • the power management module 181 receives input from the battery 182 and/or the charge management module 180, and supplies power to the processor 110, the internal memory 150, the external memory, the display screen 120, and the communication module.
  • the communication module may include a wireless communication module.
  • the wireless communication module can provide applications on electronic devices including wireless local area networks (WLAN) (such as wireless-fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite systems Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite systems
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module may be one or more devices integrating at least one communication processing module. For example, when an electronic device establishes a wireless communication (such as Bluetooth, WiFi) connection with other electronic devices, the wireless communication module receives electromagnetic wave signals sent by other electronic devices, and the wireless communication module can send the received electromagnetic wave signals to the corresponding module for After demodulation and other processing, it is passed to the AP for subsequent processing.
  • a wireless communication such as Bluetooth, WiFi
  • the audio information can be the audio to be played sent by other electronic devices, or the user's voice, etc.
  • the AP can pass the audio module 130, the speaker 132 through the audio information. Thereby, a sound signal is output.
  • FIG. 1A is only an example.
  • the electronic device of the embodiments of the present application may have more or less components than those shown in the figures, may combine two or more components, or may have different component configurations.
  • the various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the electronic device in this embodiment of the present application may be a VR/AR device.
  • FIG. 1B a schematic diagram of a head-mounted VR device is provided in an embodiment of the present application, and a user can wear the VR device on the head through a retractable fixing strap.
  • the software system of the electronic device 100 may adopt a layered architecture, including an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of the electronic device 100 .
  • FIG. 2 is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.
  • the application layer can include a series of application packages. As shown in Figure 2, applications such as browsers, Youku, Tencent Video, Maps, and iQiyi can be installed in the application layer.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a display policy service, a power management service (power manager service, PMS), and a display management service (display manager service, DMS).
  • the application framework layer may also include an activity manager, a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.
  • the window manager provides a window manager service for the window, so as to control and manage the interface displayed on the display screen.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build the interface of an application.
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • the Android runtime includes core libraries and a virtual machine.
  • Android runtime is the runtime environment of the Android operating system, responsible for the scheduling and management of the Android operating system.
  • the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of the Android operating system.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of audio and video in multiple formats, and supports opening of still images in multiple formats.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between the hardware and software of an electronic device.
  • the kernel layer at least includes display drivers, sensor drivers, camera drivers, audio drivers, etc., which are used to drive the hardware in the hardware layer.
  • the hardware layer may include various types of sensors (such as touch sensors, etc.), display screens, cameras, and the like.
  • the electronic device may obtain the location of the application interface to which the new message belongs and the location of the user's field of view from the window manager.
  • the location of the application interface to which the new message belongs is not within the user's field of view, it can
  • the notification control is displayed through the notification manager, and the orientation relationship between the new message and the application interface to which the new message belongs is indicated in the displayed notification control.
  • At least one involved in the following embodiments includes one or more; wherein, multiple refers to greater than or equal to two.
  • words such as “first” and “second” are only used for the purpose of distinguishing and describing.
  • a flowchart of a message reminding method provided by an embodiment of the present application, referring to FIG. 3 , the method may include the following steps:
  • Step 301 The electronic device receives the message, where the electronic device may be an AR/VR device.
  • FIG. 4A it is a schematic display diagram of an application interface provided by an embodiment of the present application.
  • the application interfaces displayed in the hypothetical space include application interface 1, application interface 2, application interface 3, application interface 4, application interface 5, application interface 6, etc. These application interfaces are distributed in different directions in the space.
  • FIG. 4A is only a schematic illustration, and the dotted frame in FIG. 4A is only to illustrate the application interface displayed in the space, and the number of application interfaces included in the space and the direction and position of the application interface display are not included. Not limited to the above examples.
  • a user can open multiple application interfaces in one application, that is, multiple interfaces of one application can be displayed in the space.
  • the user can move the position of the application interface displayed in the space according to his own usage habits.
  • Step 302 The electronic device acquires the identifier of the application interface to which the message belongs.
  • the new message may carry identification information
  • the electronic device may determine the identification of the application interface to which the new message belongs by using the identification information carried in the new message. For example, if an electronic device receives a QQ message sent by a QQ friend, the QQ message may carry a QQ number, so that when the electronic device receives a message, it can determine that the application interface corresponding to the message is that of the application QQ. application interface. That is, there may be a correspondence between the identification information carried in the new message and the identification information of the application interface.
  • the application program there may be a correspondence between the application program and the identification information of the application interface.
  • the application programs opened by the user include: APP1, APP2, and APP3, and each application program only displays one application interface
  • the corresponding relationship between the application program and the identification information of the application interface can be See Table 1.
  • the identifier corresponding to the application interface may also be in other representations.
  • the identifier of the only application interface opened by APP1 may be recorded as 1-1
  • the identifier of the only application interface opened by APP2 may be recorded as 2-1, etc., which is not limited in this application.
  • the electronic device receives a QQ message sent by a QQ friend, the QQ message can carry the QQ number, so that when the electronic device receives the message, , it can be determined that the ID of the application interface to which the message belongs is 1.
  • the application programs opened by the user include: APP1, APP2, and APP3, and each application program displays multiple application interfaces
  • the corresponding relationship between the application programs and the identification information of the application interfaces See Table 2 for details.
  • Table 1 and Table 2 are only schematic descriptions, and the identification information of the application interface may also be represented by other forms such as A, B, C, a, b, and c, which are not limited in this application.
  • APP1 is QQ
  • APP2 is WeChat
  • APP3 is iQIYI
  • interface 1 is the chat interface corresponding to QQ friend 1
  • interface 2 is the chat interface corresponding to QQ friend 2.
  • the QQ message may carry a QQ number, so that when the electronic device receives the message, it can determine that the application interface identifier to which the message belongs is 1-1.
  • the identification information of the application interface may be predefined or randomly defined. Or in other words, the identification information of the application interface may be fixed or changeable.
  • the electronic device may define an identification information for each application interface in advance, or the electronic device may also record identification information when the user opens an application interface, and then open the next interface according to the identification information of the previous interface. analogy.
  • the electronic device may record the identification information of the application interface 1 as 1.
  • the electronic device may record the identification information of the application interface 2 as 1.
  • the identification information is recorded as 2, and so on.
  • the user opens the application interface 1 in APP1, and the electronic device can record the identification information of the application interface 1 as 1-1.
  • the electronic device can record the identification information of the application interface 2. Record it as 1-2, and so on.
  • the identifier of the application interface in the embodiment of the present application is not fixed.
  • the application interface of WeChat can be recorded as "interface 1" at this time. If the user closes the application interface of WeChat When the interface 1 is opened, and then the application interface of WeChat is opened again, the application interface of WeChat at this time may be recorded as "interface 2". That is to say, when the user closes and reopens an application interface, the identity of the application interface will change.
  • Step 303 The electronic device acquires the location of the first interface to which the message belongs according to the identifier of the application interface to which the message belongs.
  • the electronic device After receiving the new message, the electronic device can acquire the identifier of the application interface corresponding to the new message, and then the electronic device can acquire the location of the application interface corresponding to the new message according to the identifier of the application interface.
  • the location where the first interface is located may be represented by the coordinates of the first interface.
  • it can be represented by coordinates in a three-dimensional coordinate system.
  • Step 304 The electronic device detects whether the location where the first interface is located is within the user's field of vision.
  • the electronic device may obtain the location where the user's current field of view is located, and then determine the first interface according to the location of the first interface and the location of the user's current field of view. Whether the location is within the user's field of view.
  • FIG. 4B it is a schematic diagram of the relationship between the position of the application interface and the position of the user's visual field according to an embodiment of the present application.
  • Step 305 If it is detected that the location of the first interface is within the current visual field of the user, the electronic device displays the message on the application interface to which the message belongs.
  • the current visual field of the user may be the display area currently output by the electronic device. That is, when the location where the first interface is located is within the current visual field of the user, the location where the first interface is located is located within the display area currently output by the electronic device.
  • the electronic device When the electronic device detects that the application interface to which the new message belongs is within the user's field of vision, that is, the first area is within the second area, the electronic device can directly display the received new message in the application interface to which the message belongs.
  • FIG. 5 it is a schematic diagram of a user interface provided by an embodiment of the present application.
  • the user opens the chat software QQ in the AR/VR device, and simultaneously opens the chat windows of multiple friends.
  • the interfaces corresponding to the chat windows of multiple friends are interfaces 1-1 respectively.
  • interface 1-2, interface 1-3 if the new message is a message sent by a friend to which interface 1-2 belongs, the message can be directly displayed in interface 1-2, such as (b) in Figure 5 shown.
  • the location of the interface 1-2 can be understood as the first area, and only the display interface of the application interface 1-2 is shown in the figure.
  • the display interfaces of the application interface 1-1 and the application interface 1-3 are the same as The application interface 1-2 is similar, which is not shown in the figure.
  • Step 306 If it is detected that the location where the first interface is located is not within the current visual field of the user, the electronic device associates the message with the application interface.
  • the electronic device may display the new message within the current field of view of the user in the form of a notification control through the notification management system.
  • the user is chatting with the user Amy in the application interface 1-2 shown in FIG. 5(a), and a new message is sent by a WeChat friend at this time, then the new message can be displayed in the form of a notification.
  • the current visual field of the user for example, it may be displayed above the application interface 1-2, as shown in FIG. 6, for example.
  • the electronic device may display a notification through the application corresponding to the new message.
  • the interface for displaying notifications by the application itself is similar to the interface shown in Figure 6. The difference is that one is to control the display of messages in the form of notifications through the notification management system, and the other is to control the display of messages in the form of notifications through the application program itself. .
  • the location where the first interface is located is not within the current visual field of the user, which may include the following two situations:
  • Case 1 The location where the first interface is located is not within the display area currently output by the electronic device.
  • the second situation the location where the first interface is located is within the display area currently output by the electronic device, but not in the area where the user's eyes are currently looking.
  • the VR/AR device can obtain the coordinates of the area that the user's eyes are currently looking at, and then determine the location of the first interface according to the obtained coordinates of the area where the user's eyes are currently looking and the location of the first interface. Whether it belongs to the area the user's eyes are currently looking at.
  • the VR/AR device can associate the received new message with the first interface, so that the user can The application interface corresponding to the new message can be quickly found.
  • the VR/AR device when the VR/AR device can associate the received new message with the first interface, it can indicate the positional relationship between the new message and the application interface corresponding to the new message through animation, pointer, etc.
  • the following combination A specific example introduces the manner in which the new message is associated with the first interface.
  • association form in this embodiment of the present application may be a dynamic form or a static form, which is not limited in the present application.
  • the VR/AR device can convert a new message displayed in the form of a notification control into an animation (eg, spherical) display, and move it to the application interface to which the new message belongs.
  • an animation eg, spherical
  • the APPs displayed in the space may include APP1, APP2, and APP3, wherein the interface corresponding to APP1 is interface 1, the interface corresponding to APP2 is interface 2, and the interface corresponding to APP3 is interface 3.
  • the new message can be displayed in the current visual field of the user in the form of a notification control, for example, displayed on the interface 2 corresponding to APP2 (QQ), for example, as shown in FIG. 7A shown in (a).
  • the notification control can be transformed into a spherical shape and gradually fly towards the application interface corresponding to APP1, as shown in (b) of FIG. 7A, for example.
  • the user can directly see that the new message is transformed from the interface 2 corresponding to QQ to the interface 1 corresponding to WeChat through the naked eye, so that the user can intuitively see the location of the application interface to which the new message belongs.
  • FIG. 7A is only a schematic illustration, and the form of association between the new message and the application interface to which the new message belongs includes, but is not limited to, the form of the above-mentioned spherical scrolling, and can also be other forms, such as VR/AR devices and other forms.
  • the new message displayed in the form of a notification control can be converted into a scroll shape and moved to the application interface to which the new message belongs, which is not limited in this application.
  • the user can click the sphere, and then the new message can be displayed in the chat window of the interface 1, which is convenient for the user to view and process the message. .
  • the message when a new message flies to interface 1 in a spherical form, the message can be automatically displayed in the chat window of interface 1, or it can stay for a set time after flying to interface 1 ( For example 5s), and then display the new message in the chat window of interface 1.
  • a set time For example 5s
  • the above example is only a schematic illustration, which is not limited in this application.
  • the VR/AR device may indicate the new message in a wired manner with the application interface to which the new message belongs.
  • the APPs displayed in the space may include APP1, APP2, and APP3, wherein the interface corresponding to APP1 is interface 1, the interface corresponding to APP2 is interface 2, and the interface corresponding to APP3 is interface 3.
  • the new message is a message corresponding to APP1 (WeChat)
  • the new message can be displayed in the current visual field of the user in the form of a notification control, for example, as shown in (a) of FIG. 7B .
  • the VR/AR device can associate the new message with the interface 1 corresponding to APP1 through a connection, for example, through the solid line shown in (b) in FIG.
  • connection can also be performed by a dotted line, which is not limited in this application.
  • connection when the association is performed by means of a connection, the connection can be a connection with arrows at both ends, a connection without arrows at both ends, or a connection with an arrow at only one end. line, which is not limited in this application.
  • FIG. 7B an arrow at one end is used as an example for illustration.
  • the user can find the location of the application interface to which the new message belongs according to the connection.
  • the new message can be displayed in interface 1, which is convenient for the user to reply to the new message.
  • Example 3 The VR/AR device can point the new message in the form of an arrow to the application interface to which the new message belongs.
  • the new message can be displayed in the user's current visual field in the form of a notification control, such as shown in (a) in FIG. 7C .
  • the VR/AR device can associate the new message with the interface 1 corresponding to APP1 in the form of a pointer.
  • the user can intuitively see the pointer between the new message and the interface 1 , and the location of the application interface to which the new message belongs can be found according to the pointer.
  • Example 4 The VR/AR device can point a new message in the form of a bubble to the application interface to which the new message belongs.
  • FIG. 7D suppose that the application interface corresponding to APP1 (WeChat) is interface 1, the application interface corresponding to APP2 (Gallery) is interface 2, and the new message is the message corresponding to APP1 (WeChat).
  • the bubbles shown in 7D are displayed in the user's current field of view. And the interface 1 to which the new message belongs can be pointed to by the arrow on the bubble. The user can intuitively see the bubble between the new message and interface 1, and the user can find the location of the application interface to which the new message belongs according to the direction of the arrow on the bubble. It should be understood that when the location of the application interface is different, the direction of the arrow on the bubble will also change.
  • the above example is only a schematic illustration, and the form of associating the new message with the application interface to which the new message belongs is not limited to the above method.
  • the VR/AR device can also use other forms to associate the new message with APP1. associated with the application interface, etc., which is not limited in this application.
  • association form may also be an association form with colors, effects, etc.
  • connection line may be a red connection line
  • bubbles may be colored or shaded, etc., which are not specifically limited in this application.
  • the indication mode may be displayed in an implicit form, that is to say, the display time of the indication mode of the new message and the application interface to which the new message belongs may be a preset duration, such as 1 minute, when the time reaches 1 Minutes, the associated form can be hidden. That is to say, if the user does not view the new message in time, when he wants to view the new message later, he can click the notification control corresponding to the new message, and then the associated form can be played again.
  • the VR/AR device receives two new messages, eg, message 1 and message 2.
  • the application interface to which message 1 belongs is within the user's field of vision, and the application interface to which message 2 belongs is not within the user's field of vision.
  • the user first checks the message 1 whose application interface is within the field of view, and then the message 2 can pass the connection. way to connect to the application interface to which message 2 belongs, and the connection can be hidden after 1 minute. If the user wants to view the message 2 after 5 minutes, he can click the notification control of the message 2, and the connection between the message 2 and the application interface to which the message 2 belongs can be displayed again for the user to view.
  • the display time of the indication mode of the new message and the application interface to which the new message belongs may not be limited, and the indication mode may also be displayed in the display form, that is, the indication mode may be displayed in the space all the time.
  • the application is not limited in this regard.
  • the selected association form when the VR/AR device associates the new message with the application interface to which the new message belongs, the selected association form may be random, or may be selected sequentially in a fixed order. .
  • multiple association forms may be pre-stored in the electronic device.
  • any one of the pre-saved association forms can be randomly selected, such as selecting The form of connection associates the new message 1 with the application interface to which it belongs.
  • the VR/AR device receives a new message 2, and the application interface to which the new message 2 belongs is not within the user's field of vision, then randomly selects any one of the pre-saved association forms, for example, the form of selecting a pointer will Message 2 is associated with the application interface to which it belongs.
  • the VR/AR device randomly selects the association form, for different messages, the selected association form can be the same or different.
  • the VR/AR device can also choose to connect The new message 2 is associated with the application interface to which it belongs in the form of a line.
  • the VR/AR device may sequentially associate the received new message with the application interface to which the new message belongs according to multiple pre-saved association forms. It is assumed that each pre-saved association form has a corresponding number, such as 1, 2, 3, 4, and so on. Exemplarily, for example, if the VR/AR device receives a new message 1, and the application interface to which the new message 1 belongs is not within the user's field of vision, the association form numbered 1 can be selected to associate the new message 1 with the application interface to which it belongs. Then the VR/AR device receives the new message 2, and the application interface to which the new message 2 belongs is not within the user's field of vision, then select the association form numbered 2 to associate the new message 2 with the application interface to which it belongs to And so on.
  • the VR/AR device when the VR/AR device receives a new message, and the application interface to which the new message belongs is not within the user's field of vision, the VR/AR device may provide a selection interface for the user to select according to You can choose the connection form according to your preference.
  • the VR/AR device shown in FIG. 8 may be displayed within the user’s field of vision. interface, which can include multiple association forms. Users can choose the association form according to their own needs or preferences.
  • the VR/AR device can follow the association form selected by the user. Associate the new message with the application interface to which the new message belongs.
  • the selection box of the association form connected by the solid line selected by the user is filled with oblique lines.
  • the association form selected by the user may also be displayed in other forms, for example, it may be displayed in a color such as gray or red, which is not limited in this application.
  • the interface shown in FIG. 8 may be displayed at any position within the user's field of vision, for example, may be displayed on the upper layer of any interface within the user's field of vision, which is not limited in this application.
  • the VR/AR device may select different association forms to indicate the positional relationship between the new message and the application interface to which the new message belongs according to the distance between the new message and the application interface to which the new message belongs.
  • a connection can be selected to associate the new message with the application interface to which the new message belongs; when the new message is associated with the application interface to which the new message belongs; When the distance between the interfaces is short, a pointer may be selected to associate the new message with the application interface to which the new message belongs.
  • the VR/AR device can select a connection form among multiple pre-stored association forms to associate message 1 with the application interface to which message 1 belongs, and for message 2, the VR/AR device can
  • the association form of 1 is different, for example, the form of a pointer associates the message 2 with the application interface to which the message 2 belongs.
  • the VR/AR device can also select the same association form as that of the message 1 to associate the message 2 with the application interface to which the message 2 belongs, which is not limited in this application.
  • a selection interface may be displayed for a message.
  • the VR/AR device receives three new messages, it can display three selection interfaces within the user's field of vision.
  • the message source and message content corresponding to each selection interface may be displayed above each selection interface. For example, please refer to the interface shown in FIG. 9A .
  • the new messages are:
  • the above three new messages can be displayed above the three selection interfaces in the display form shown in FIG. 9A .
  • the selection interface may also be the interface shown in FIG. 9B , that is, the selection interfaces for three new messages are displayed in one interface, and the interface may include selection boxes for three new messages.
  • the content displayed at the top of the selection interface can also only display the APP to which the message belongs and the person who sent the message, such as "WeChat Xiaoli: Let's have dinner together at night.” It can also be displayed as "WeChat: Xiaoli", etc. This is not limited.
  • the user can select the form of the message and association through a connection.
  • the interface shown in FIG. 9C may include a pencil 901, an eraser 902, a confirm button 903, and a cancel button 904.
  • the user can click on the pencil 901, and then connect the message to the associated form in turn.
  • the application interface to which message 1 and message 1 belong can be selected to be indicated by a solid line
  • the application interface to which message 2 and message 2 are selected is indicated by a pointer
  • the selection of message 3 and message 3 is indicated by a pointer.
  • the application interface to which it belongs is indicated by a dotted line.
  • the confirmation button 903 can be clicked. If the user wants to adjust the selected association form during the connection process, the association form can be reselected by using the eraser 902 or clicking the cancel button 904 .
  • buttons, controls, etc. displayed on the interface may be displayed or not displayed, and of course other buttons and controls may also be displayed. etc., the present application is not limited thereto.
  • the methods provided by the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject.
  • the electronic device may include a hardware structure and/or software modules, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.
  • the electronic device may be an electronic device with a display screen.
  • the electronic device 1000 includes: a display screen 1001; one or more processors 1002; a memory 1003; a plurality of applications 1004 (not shown in the figure); not shown), the above-mentioned devices may be connected through one or more communication buses 1006.
  • the display screen 1001 is used to display the display interface of the application in the electronic device, and the like.
  • one or more computer programs are stored in the memory 1003, and the one or more computer programs include instructions; the processor 1002 calls the instructions stored in the memory 1003, so that the electronic device 1000 performs the following steps:
  • determining the first application interface identifier to which the first message belongs includes: acquiring the identifier information carried in the first message; and determining the identifier according to the identifier information carried in the first message. The identifier of the first application interface to which the first message belongs.
  • the electronic device 1000 when the instruction is invoked and executed by the one or more processors 1002, the electronic device 1000 is caused to further perform the following step: displaying the first message in the form of a notification in all the second area.
  • the electronic device 1000 when the instruction is invoked and executed by the one or more processors 1002, the electronic device 1000 is caused to further perform the following steps: if it is determined that the first area is within the second area, Then, the first message is displayed on the first application interface to which the first message belongs.
  • determining that the first area where the first application interface to which the first message belongs is not located in the second area includes: determining the first area where the first application interface to which the first message belongs is located If it is not in the third area, the third area is the first sub-area of the second area, and the third area is the current display area of the VR device or AR device; or determine the first sub-area to which the first message belongs.
  • the first area where the application interface is located is in the third area, but not in the fourth area, the fourth area is the second sub-area of the second area, and the fourth area is the area that the user's eyes are currently looking at .
  • indicating the azimuth relationship between the first message and the first application interface in a first indication form includes: according to the distance between the first message and the first application interface, A first indication form is determined in a first set; at least one indication form is included in the first set, and the first set is pre-stored in a VR device or an AR device; the first indication form is used to indicate the first indication form The orientation relationship between a message and the first application interface.
  • indicating the orientation relationship between the first message and the first application interface through a first indication form includes: arbitrarily selecting an indication form from the first set as the first indication form;
  • the first set includes at least one indication form, and the first set is pre-stored in the VR device or AR device; the first indication form is used to indicate the orientation relationship between the first message and the first application interface .
  • indicating the orientation relationship between the first message and the first application interface through a first indication form includes: determining the first indication form according to the numbering sequence of the indication forms in the first set ; Using the first indication form to indicate the azimuth relationship between the first message and the first application interface.
  • the first set includes at least one indication form, and the first set is pre-stored in the VR device or the AR device.
  • indicating the orientation relationship between the first message and the first application interface through a first indication form includes: displaying prompt information in the second area, where the prompt information is used for prompting
  • the user selects a first indication form in a first set, the first set includes at least one indication form, and the first set is pre-stored in the VR device or AR device; the first indication form selected by the user is used Indicates the orientation relationship between the first message and the first application interface.
  • the first indication form includes any one of the following forms: pointer indication, connection indication, and animation indication.
  • the first indication form is displayed in a display form or in an implicit form
  • the display form is a display form continuously displayed in the space
  • the implicit form is a display form in the space A display form that disappears after a long period of time.
  • the processor 1002 may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, which can implement Alternatively, each method, step, and logic block diagram disclosed in the embodiments of the present application are executed.
  • a general purpose processor may be a microprocessor or any conventional processor or the like.
  • the steps of the methods disclosed in conjunction with the embodiments of the present application may be directly embodied as executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.
  • the software module can be located in the memory 1003, and the processor 1002 reads the program instructions in the memory 1003, and completes the steps of the above method in combination with its hardware.
  • the memory 1003 may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or a volatile memory (volatile memory), For example RAM.
  • the memory may also be, but is not limited to, any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and that can be accessed by a computer.
  • the memory in this embodiment of the present application may also be a circuit or any other device capable of implementing a storage function, for storing instructions and/or data.
  • an embodiment of the present application further provides a chip, which is coupled to a memory in an electronic device, and executes the message reminder method provided by the embodiment of the present application;
  • "coupled" in the embodiment of the present application refers to two components combined directly or indirectly with each other.
  • the present application also provides a computer storage medium, where a computer program is stored in the computer storage medium, and when the computer program is executed by a computer, the computer causes the computer to execute the message reminder method provided by the above embodiments.
  • Embodiments of the present application also provide a computer program product, including instructions, which, when run on a computer, cause the computer to execute the message reminding method provided by the above embodiments.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions
  • the apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

Abstract

一种消息提醒方法及电子设备，该方法可应用于虚拟现实VR设备或增强现实AR设备。该方法包括：接收第一消息；确定所述第一消息所属的第一应用界面标识；根据所述第一应用界面标识，获取所述第一消息所属的第一应用界面所在的第一区域；若确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，则通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，所述第二区域为用户视野范围所在的区域。通过本申请的方案，电子设备可以将新消息与新消息所属应用界面的位置关系进行关联并指示出来，可以方便用户快速的找到新消息所属应用界面的位置，能够提高用户查看并处理消息的速率，提升用户体验。

Description

一种消息提醒方法及电子设备
相关申请的交叉引用
本申请要求在2020年09月23日提交中国专利局、申请号为202011009447.7、申请名称为“一种消息提醒方法及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域，尤其涉及一种消息提醒方法及电子设备。
背景技术
近年来，随着显示技术的不断进步，头戴显示设备，例如增强现实(augmented reality，AR)设备、虚拟现实(virtual reality，VR)设备逐渐进入大众的视野。
目前，用户在使用AR/VR设备的过程中，当打开设备中安装的应用程序之后，应用程序的界面会显示在空间的各个方向，当有新消息时，如果该新消息对应的应用界面不在用户可以看到的视野范围内，比如该新消息对应的应用界面在用户的身后，这种情况下可能就需要用户在空间中寻找该新消息对应的应用程序，然后才能处理该新消息。因此，如何使得用户能够容易的找到新消息对应的应用界面是有待解决的问题。
发明内容
本申请提供一种消息提醒方法及电子设备，用以方便用户查找消息对应的应用界面，提高用户查看并处理效率的速率，提升用户体验。
第一方面，本申请提供一种消息提醒方法，该方法可应用于虚拟现实VR设备或增强现实AR设备。具体的，该方法可包括：接收第一消息；确定所述第一消息所属的第一应用界面标识；根据所述第一应用界面标识，获取所述第一消息所属的第一应用界面所在的第一区域；当确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内时，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，所述第二区域为用户视野范围所在的区域。
通过上述技术方案，当VR/AR设备接收到新消息，可以判断新消息所属的应用界面是否在用户视野范围内，如果不在用户视野范围内，可以在空间中显示指示形式，以引导用户找到新消息所属应用界面所在的位置，这样可以方便用户快速的找到新消息所属应用界面的位置，能够提升用户体验。
在一种可能的设计中，所述确定所述第一消息所属的第一应用界面标识，包括：获取所述第一消息中携带的标识信息；根据所述第一消息中携带的标识信息，确定所述第一消息所属的第一应用界面标识。
通过上述技术方案，电子设备可以根据新消息中携带的标识信息确定出新消息所属的应用界面，从而便于在新消息所属的应用界面不在用户视野范围时，可以通过显示的指示形式对用户进行提醒。
在一种可能的设计中，所述方法还包括：将所述第一消息以通知的形式显示在所述第二区域。
在上述技术方案中，电子设备在接收到新消息时，如果新消息所属的应用界面不在用户视野范围内时，可以以通知的形式显示在用户视野范围内，这样可以方便用户及时地看到新消息，也可以使得用户能够根据新消息的内容确定新消息是否是紧急的消息，能够便于用户根据消息的内容安排并处理消息。
在一种可能的设计中，所述方法还包括：若确定所述第一区域在第二区域内，则将所述第一消息显示在所述第一消息所属的第一应用界面。
在上述技术方案中，如果新消息所属的应用界面在用户视野范围内，那么可以将新消息直接显示在新消息所属的应用界面，以便用户能够及时的查看并处理消息。
如果电子设备确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，也就是说，新消息所属的应用界面不在用户视野范围内，在本申请中可包括如下两种情形：
第一种情形：确定所述第一消息所属的第一应用界面所在的第一区域不在第三区域内，所述第三区域为所述第二区域的第一子区域，所述第三区域为VR设备或AR设备当前的显示区域。
第二种情形：确定所述第一消息所属的第一应用界面所在的第一区域在第三区域内，但不在第四区域内，所述第四区域为所述第二区域的第二子区域，所述第四区域为用户眼睛当前所注视的区域。
在申请中，第一指示形式可以通过如下几种方式确定，进而使得电子设备根据确定的第一指示形式对新消息与新消息所属的应用界面的位置信息进行指示：
方式1：根据所述第一消息与所述第一应用界面之间的距离，在第一集合中确定第一指示形式。其中，第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中。
在上述技术方案中，电子设备可以根据新消息与新消息所属应用界面之间的距离，选择指示形式，这样当电子设备接收到多条新消息时，可以使得空间中显示的指示形式比较清晰明了，便于用户查看。
方式2：在第一集合中任意选择一种指示形式作为第一指示形式。其中，第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中。
方式3：按照所述第一集合中指示形式的编号顺序，确定第一指示形式。其中，第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中。
方式4：在所述第二区域内显示提示信息，所述提示信息用于提示用户在第一集合中选择第一指示形式，所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；将用户选择的第一指示形式确定为第一指示形式。
通过上述几种方式，电子设备可以随机的选择指示形式，也可以按照一定的顺序选择指示形式，当然，还可以参考用户的习惯，让用户选择指示形式，这样能够提升用户体验。
在一种可能的设计中，所述第一指示形式可以包括如下形式中的任意一种：指针指示、连线指示、动画指示。需要说明的是，指针、连线、动画(例如，球形滚动)指示仅作为本申请的一部分示例，本申请中也可以为其它的指示形式。通过上述指示形式，可以将新消息与新消息所属的应用界面关联起来，能够方便用户快速的找到新消息对应的应用界面 的位置。
在一种可能的设计中，所述第一指示形式可以以显示形式显示或者也可以以隐式形式显示。其中，这里的显示形式为持续显示在空间中的展示形式，这里的隐式形式为在空间中显示设定时长后消失的展示形式。
在上述技术方案中，新消息与新消息所属应用界面之间的指示形式可以一直显示，也可以仅显示一定时长，这样能够方便用户根据自己的时间安排查看处理消息。
第二方面，本申请还提供一种电子设备，该电子设备包括：显示屏；一个或多个处理器；存储器；多个应用；以及一个或多个计算机程序；其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述一个或多个处理器调用执行时，使得所述电子设备执行上述第一方面及其第一方面任一可能设计的技术方案。
第三方面，本申请还提供一种电子设备，该电子设备包括执行第一方面或者第一方面的任意一种可能的设计的方法的模块/单元；这些模块/单元可以通过硬件实现，也可以通过硬件执行相应的软件实现。
第四方面，本申请实施例还提供一种芯片，所述芯片与电子设备中的存储器耦合，执行本申请实施例第一方面及其第一方面任一可能设计的技术方案；本申请实施例中“耦合”是指两个部件彼此直接或间接地结合。
第五方面，本申请实施例还提供一种计算机可读存储介质，所述计算机可读存储介质包括计算机程序，当计算机程序在电子设备上运行时，使得所述电子设备执行本申请实施例第一方面及其第一方面任一可能设计的技术方案。
第六方面，本申请实施例还提供一种计算机程序产品，当所述计算机程序产品在电子设备上运行时，使得所述电子设备执行本申请实施例第一方面及其第一方面任一可能设计的技术方案。
上述第二方面至第六方面中的各个方面以及各个方面可能达到的技术效果请参照上述针对第一方面中的各种可能方案可以达到的技术效果说明，这里不再重复赘述。
附图说明
图1A为本申请实施例的一种电子设备的结构示意图；
图1B为本申请实施例提供一种头戴式VR设备示意图；
图2为本申请实施例提供的电子设备的软件结构框图；
图3为本申请实施例提供的一种消息提醒方法流程图；
图4A为本申请实施例提供的一种应用界面的显示示意图；
图4B为本申请实施例提供的一种应用界面的位置与用户视野范围所在位置关系的示意图；
图5为本申请实施例提供的一种用户界面示意图；
图6为本申请实施例提供的一种用户界面示意图；
图7A为本申请实施例提供的一种消息提醒方式示意图；
图7B为本申请实施例提供的另一种消息提醒方式示意图；
图7C为本申请实施例提供的又一种消息提醒方式示意图；
图7D为本申请实施例提供的又一种消息提醒方式示意图；
图8为本申请实施例提供的一种用户选择关联形式的界面示意图；
图9A为本申请实施例提供的另一种用户选择关联形式的界面示意图；
图9B为本申请实施例提供的又一种用户选择关联形式的界面示意图；
图9C为本申请实施例提供的又一种用户选择关联形式的界面示意图；
图10为本申请实施例提供的另一种电子设备的结构示意图。
具体实施方式
下面将结合本申请以下实施例中的附图，对本申请实施例中的技术方案进行详尽描述。
以下，首先对本申请实施例中的部分用语进行解释说明，以便于本领域技术人员理解。
本申请实施例涉及的应用程序(application，App)，简称应用，为能够实现某项或多项特定功能的软件程序。通常，电子设备中可以安装多个应用。比如，抖音应用、短信应用、浏览器应用、微信(WeChat)、微博、爱奇艺、优酷、腾讯视频等。下文中提到的应用，可以是电子设备出厂时已安装的应用，也可以是用户在使用电子设备的过程中从网络下载或其他电子设备获取的应用。
需要说明的是，本申请实施例提供的方法，可以适用于具有显示屏的便携式电子设备，诸如可穿戴设备(AR/VR设备)等，例如VR眼镜、AR眼镜，本申请实施例不作限定。便携式电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2021119557-appb-000001
或者其它操作系统的便携式电子设备。
如图1A所示，为本申请实施例的一种电子设备的结构示意图。具体的，如图1A所示，电子设备包括处理器110、显示屏120、音频模块130、传感器模块140、内部存储器150、外部存储器接口160、通用串行总线(universal serial bus，USB)接口170、充电管理模块180、电源管理模块181和电池182。在另一些实施例中，电子设备还可以包括通信模块、按键等。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。其中，控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
显示屏120用于显示应用的显示界面等。显示屏120包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。
电子设备可以通过音频模块130、麦克风131、扬声器132以及AP等实现音频功能。例如音乐播放、录音等。其中，音频模块130可以用于将数字音频信号转换成模拟音频信 号输出，也用于将模拟音频信号转换为数字音频信号。音频模块130还可以用于对音频信号编码和解码。在一些实施例中，音频模块130可以设置于处理器110中，或将音频模块130的部分功能模块设置于处理器110中。需要说明的是，本申请实施例中音频模块130又可以称之为编解码器(codec)。
麦克风131，也称“话筒”、“传声器”，用于将声音信号转换为电信号。当用户使用电子设备拨打电话或发送语音时，用户可以通过人嘴靠近麦克风131发声，麦克风131可以用于采集用户的声音，然后，将用户的声音转换为电信号。电子设备可以设置至少一个麦克风131。例如，电子设备可以设置两个麦克风131，有助于实现降噪功能。
扬声器132，也称“喇叭”，用于将音频信号转换为声音信号，并播放。示例的，电子设备可以通过扬声器132收听音乐、或接听免提通话等。需要说明的是，本申请实施例中的电子设备可以设置一个或多个扬声器，对电子设备中设置的扬声器的类型不作限定。另外，在一些实施例中，音频模块130输出的音频信号可以经过放大器放大后，输出给扬声器132，并由扬声器132将音频信号转换为声音信号，并播放。从而有助于提高声音播放的质量。示例的，扬声器132播放的声音信号，可以是由AP从内部存储器150、或者与外部存储器接口160连接的外部存储器中获取的，也可以是AP从通信模块获取的。本申请实施例对扬声器132播放的声音信号的来源不作限定。
传感器模块140包括一个或多个传感器。例如，触摸传感器，也称“触控面板”。触摸传感器可以设置于显示屏120，由触摸传感器与显示屏120组成触摸屏，也称“触控屏”。触摸传感器用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏120提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器也可以设置于电子设备100的表面，与显示屏120所处的位置不同。
需要说明的是，电子设备100中的传感器还可包括压力传感器、陀螺仪传感器、气压传感器、磁传感器、加速度传感器、距离传感器、接近光传感器、温度传感器、骨传导传感器等，当然，电子设备100还可包括按键(例如开机键，音量键等)。
内部存储器150可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器150的指令，从而执行电子设备100的各种功能应用以及数据处理。内部存储器150可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，以及至少一个应用程序(例如爱奇艺应用，微信应用等)的软件代码等。存储数据区可存储电子设备100使用过程中所产生的数据(例如图像、视频等)等。此外，内部存储器150可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
外部存储器接口160可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口160与处理器110通信，实现数据存储功能。例如将图片，视频等文件保存在外部存储卡中。
USB接口170是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口170可以用于连接充电器为电子设备100充电，也可以用于电子设备100与外围设备之间传输数据。
充电管理模块180用于从充电器接收充电输入。电源管理模块181用于连接电池182，充电管理模块180与处理器110。电源管理模块181接收电池182和/或充电管理模块180 的输入，为处理器110，内部存储器150，外部存储器，显示屏120，和通信模块等供电。
示例性的，通信模块可包括无线通信模块。无线通信模块可以提供应用在电子设备上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless-fidelity，Wi-Fi)网络)、蓝牙(bluetooth，BT)、全球导航卫星系统(global navigation satellite system，GNSS)、调频(frequency modulation，FM)、近距离无线通信技术(near field communication，NFC)、红外技术(infrared，IR)等无线通信的解决方案。无线通信模块可以是集成至少一个通信处理模块的一个或多个器件。例如，当电子设备与其它电子设备建立无线通信(例如蓝牙、WiFi)连接时，通过无线通信模块接收其它电子设备发送的电磁波信号，无线通信模块可以将接收到的电磁波信号发送给相应的模块进行解调等处理后，传递给AP，由AP进行后续处理。示例的，当无线通信模块接收的电磁波信号中承载有音频信息时，例如，该音频信息可以为其它电子设备发送的待播放的音频、或者用户的语音等，AP可以通过音频模块130、扬声器132从而输出声音信号。
需要说明的是，图1A所示的硬件结构仅是一个示例。本申请实施例的电子设备可以具有比图中所示出的更多的或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
作为一种示例，本申请实施例中的电子设备可以为VR/AR设备。如图1B所示，为本申请实施例提供一种头戴式VR设备示意图，用户可通过可伸缩的固定带将VR设备戴在头部。
上述电子设备100的软件系统可以采用分层架构，包括事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的Android系统为例，示例性说明电子设备100的软件结构。
图2是本申请实施例的电子设备100的软件结构框图。分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层，安卓运行时(Android runtime)和系统库，以及内核层。
应用程序层可以包括一系列应用程序包。如图2所示，应用程序层内可以安装浏览器，优酷，腾讯视频，地图，爱奇艺等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图2所示，应用程序框架层可以包括显示策略服务、电源管理服务(power manager service，PMS)、显示管理服务(display manager service，DMS)。当然，应用程序框架层中还可以包括活动管理器、窗口管理器，内容提供器，视图系统，资源管理器，通知管理器等。
其中，窗口管理器，为窗口提供窗口管理服务(window manager service)，以对显示屏显示的界面进行控制管理。
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用的界面。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。
Android runtime包括核心库和虚拟机。Android runtime是Android操作系统的运行时环境，负责Android操作系统的调度和管理。
其中，核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是Android操作系统的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(Media Libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种格式的音频、视频的回放和录制，以及支持打开多种格式的静态图像等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。
图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。2D图形引擎是2D绘图的绘图引擎。
内核层是电子设备的硬件和软件之间的层。内核层至少包含显示驱动，传感器驱动、摄像头驱动，音频驱动等，用于驱动硬件层中的硬件。
硬件层可以包括各类传感器(例如触摸传感器等)、显示屏、摄像头等。
本申请实施例中，电子设备可从窗口管理器获取新消息所属的应用界面的位置以及用户视野范围所在的位置，当新消息所属的应用界面的位置不在用户视野范围所在的位置内时，可通过通知管理器展示通知控件，并在展示的通知控件中指示新消息与新消息所属的应用界面之间的方位关系。
以下实施例以应用在图1A所示的电子设备100所示的架构中为例进行描述。
此外，下述实施例涉及的至少一个，包括一个或者多个；其中，多个是指大于或者等于两个。另外，需要理解的是，在本申请的描述中，“第一”、“第二”等词汇，仅用于区分描述的目的。
如图3所示，为本申请实施例提供的消息提醒方法流程图，参阅图3所示，该方法可包括如下步骤：
步骤301：电子设备接收消息，这里的电子设备可以为AR/VR设备。
本申请实施例中，当用户在电子设备上打开应用程序之后，应用程序的界面(以下简称“应用界面”)可随机显示在空间中的各个位置。参阅图4A所示，为本申请实施例提供的一种应用界面的显示示意图。如图4A所示，假设空间中显示的应用界面包括应用界面1、 应用界面2、应用界面3、应用界面4、应用界面5、应用界面6等，这些应用界面分布在空间中的不同方向。可以理解的是，图4A仅是一种示意性说明，图4A中的虚线框仅是为了示意空间中显示的应用界面，并且空间中包括的应用界面的数量以及应用界面显示的方向位置等并不限于上述举例。
需要说明的是，用户可以在一个应用程序中打开多个应用界面，也就是说，空间中可以显示一个应用程序的多个界面。并且，用户可以按照自己的使用习惯等移动空间中显示的应用界面的位置。
步骤302：电子设备获取该消息所属应用界面的标识。
在一种可能的实现方式中，新消息中可携带有标识信息，电子设备在接收到该消息时，可通过新消息中携带的标识信息确定该新消息所属应用界面的标识。举例来说，比如电子设备接收到QQ好友发送的一条QQ消息，该QQ消息中可携带有QQ号码，这样电子设备在接收到消息时，就可以确定该消息对应的应用界面是应用程序QQ的应用界面。也就是说，新消息中携带的标识信息与应用界面的标识信息之间可具有对应关系。
在本申请实施例中，应用程序与应用界面的标识信息之间可存在对应关系。作为一种示例，假设用户打开的应用程序包括：APP1、APP2、APP3三个应用程序，并且每一个应用程序仅显示了一个应用界面，则应用程序与应用界面的标识信息之间的对应关系可以参阅表1所示。
表1应用程序与应用界面的标识信息之间的对应关系
应用程序 应用界面的标识信息
APP1 1
APP2 2
APP3 3
当然，可以理解的是，当每一个应用程序仅打开一个应用界面时，应用界面对应的标识也可以为其它的表示形式。例如，APP1打开的唯一一个应用界面的标识可以记为1-1，APP2打开的唯一一个应用界面的标识可以记为2-1等，本申请对此不作限定。
举例来说，比如APP1为QQ，APP2为微信，APP3为爱奇艺，假设电子设备接收到QQ好友发送的一条QQ消息，该QQ消息中可携带有QQ号码，这样电子设备在接收到消息时，就可以确定该消息所属的应用界面标识为1。
作为另一种示例，假设用户打开的应用程序包括：APP1、APP2、APP3三个应用程序，并且每一个应用程序显示了多个应用界面，则应用程序与应用界面的标识信息之间的对应关系可以参阅表2所示。
表2应用程序与应用界面的标识信息之间的对应关系
Figure PCTCN2021119557-appb-000002
当然，可以理解的是，上述表格仅是以APP1和APP3打开了两个应用界面，APP2打开了三个应用界面为例，本申请中应用界面还可以打开4个，5个等，本申请这里对打开应用界面的数量不做限定。
需要说明的是，表1和表2仅是一种示意性说明，应用界面的标识信息也可以用A、B、C、a、b、c等其它形式来表示，本申请对此不作限定。
举例来说，比如APP1为QQ，APP2为微信，APP3为爱奇艺，界面1为QQ好友1的对应的聊天界面，界面2为QQ好友2对应的聊天界面。假设电子设备接收到QQ好友1发送的一条QQ消息，该QQ消息中可携带有QQ号码，这样电子设备在接收到消息时，就可以确定该消息所属的应用界面标识为1-1。
在本申请实施例中，应用界面的标识信息可以为预先定义的，也可以为随机定义的。或者换句话说，应用界面的标识信息可以为固定不变的，也可以是变化的。比如，电子设备可以预先对每一个应用界面都定义一个标识信息，或者电子设备也可以在用户打开一个应用界面时记录一个标识信息，然后再打开下一个界面时，按照上一个界面标识信息往后类推。
示例性的，比如用户在APP1中打开应用界面1，电子设备可将应用界面1的标识信息记为1，当用户继续在该APP1中打开下一个应用界面2，电子设备可将应用界面2的标识信息记为2，以此类推。或者用户在APP1中打开应用界面1，电子设备可将应用界面1的标识信息记为1-1，当用户继续在该APP1中打开下一个应用界面2，电子设备可将应用界面2的标识信息记为1-2，以此类推。
需要说明的是，本申请实施例中应用界面的标识并不是固定不变的，比如，用户打开微信的应用界面时，此时可将微信的应用界面记为“界面1”，如果用户关闭了该界面1，然后再次打开微信的应用界面时，此时微信的应用界面可记为“界面2”。也就是说，当用户关闭某个应用界面再重新打开时，应用界面的标识会发生改变。
步骤303：电子设备根据该消息所属应用界面的标识，获取该消息所属的第一界面所在的位置。
当电子设备接收到新消息之后，可获取新消息对应的应用界面的标识，然后电子设备可根据应用界面的标识获取到该新消息对应的应用界面所在的位置。
为了描述方便，本申请实施例中假设电子设备接收到一条新消息，并且将接收到的该新消息所属的应用界面记为“第一界面”。
作为一种可能的实现方式，第一界面所在的位置可以通过第一界面的坐标来表示。例如，可以通过三维坐标系中的坐标来表示。
步骤304：电子设备检测第一界面所在的位置是否在用户视野范围内。
在一种可能的实现方式中，在步骤304执行之前，电子设备可以获取用户当前的视野范围所在的位置，然后根据第一界面所在的位置和用户当前的视野范围所在的位置，判断第一界面所在的位置是否在用户视野范围内。
以下为了描述方便，可以将第一界面所在的位置记为“第一区域”，将用户当前的视野范围所在的位置记为“第二区域”。参阅图4B所示，为本申请实施例提供的一种应用界面的位置与用户视野范围所在位置关系的示意图。
当应用界面的位置在用户视野范围内时，示例性的，可参阅图4B中的(a)所示，即第一区域属于第二区域的一部分。当应用界面的位置不在用户视野范围内时，示例性的， 可参阅图4B中的(b)所示，即第一区域和第二区域不在一个平面上。
步骤305：若检测到第一界面所在的位置在用户当前的视野范围内，则电子设备将消息在该消息所属的应用界面进行显示。
在一些实施例中，用户当前的视野范围可以为电子设备当前输出的显示区域。也就是说，当第一界面所在的位置在用户当前视野范围内时，第一界面所在的位置位于电子设备当前输出的显示区域内。
当电子设备检测到新消息所属的应用界面在用户视野范围内，即第一区域在第二区域内时，电子设备可直接将接收到的新消息在该消息所属的应用界面中进行显示。示例性的，如图5所示，为本申请实施例提供的一种用户界面示意图。假设用户在AR/VR设备中打开了聊天软件QQ，并且同时打开了多个好友的聊天窗口，例如图5中(a)所示，多个好友的聊天窗口对应的界面分别为界面1-1、界面1-2、界面1-3，如果此时新消息为界面1-2所属的好友发来的消息，则可将消息直接显示在界面1-2中，例如图5中的(b)所示。
可以理解的是，界面1-2所在位置可以理解为第一区域，并且图中仅示意出了应用界面1-2的显示界面，对于应用界面1-1和应用界面1-3的显示界面与应用界面1-2类似，图中没有画出。
步骤306：若检测到第一界面所在的位置不在用户当前的视野范围内，则电子设备将消息与应用界面进行关联。
在一些实施例中，当新消息所属的应用界面不在用户当前的视野范围内时，电子设备可通过通知管理系统，以通知控件的形式将新消息显示在用户当前的视野范围内。示例性的，比如用户正在图5中(a)所示的应用界面1-2中与用户Amy在聊天，此时微信好友发来了一条新消息，则该新消息可以以通知的形式显示在用户当前的视野范围内，例如可显示在应用界面1-2的上方，例如参阅图6所示。
在另一些实施例中，当新消息所属的应用界面不在用户当前的视野范围内时，电子设备可通过该新消息对应的应用自身显示通知。需要说明的是，应用自身显示通知的界面和图6所示的界面类似，区别在于一个是通过通知管理系统控制消息以通知的形式显示，一个是通过应用程序自身来控制消息以通知的形式显示。
本申请实施例中，第一界面所在的位置不在用户当前的视野范围内可包括如下两种情况：
第一种情况：第一界面所在的位置不在电子设备当前输出的显示区域内。
第二种情况：第一界面所在的位置在电子设备当前输出的显示区域内，但是不在用户的眼睛当前注视的区域。
针对第二种情况，VR/AR设备可以获取用户眼睛当前所注视的区域的坐标，然后根据获取到的用户眼睛当前所注视的区域的坐标以及第一界面所在的位置，判断第一界面的位置是否属于用户眼睛当前所注视的区域。
基于上述两种情况，在本申请实施例中，如果第一界面所在的界面不在用户当前的视野范围内，则VR/AR设备可将接收到的新消息与第一界面进行关联，以使得用户能够快速的找到该新消息对应的应用界面。
在本申请实施例中，VR/AR设备可将接收到的新消息与第一界面进行关联时，可通过动画、指针等形式来指示新消息与新消息对应的应用界面的位置关系，以下结合具体示例对新消息与第一界面进行关联的方式进行介绍。
需要说明的是，本申请实施例中的关联形式可以为动态的形式，也可以为静态的形式，本申请对此不作限定。
示例1：VR/AR设备可将以通知控件的形式显示的新消息转化为动画的形式(例如，球形)显示，移动到该新消息所属的应用界面。
假设空间中显示的APP可包括APP1、APP2、APP3，其中，APP1对应的界面为界面1，APP2对应的界面为界面2，APP3对应的界面为界面3。如图7A所示，假设新消息为APP1(微信)对应的消息，此时新消息可以通知控件的形式显示在用户当前的视野范围，比如显示在APP2(QQ)对应的界面2，例如图7A中的(a)所示。然后通知控件可转化为球形，逐渐飞向APP1对应的应用界面，例如图7A中的(b)所示。在该过程中，用户可以通过肉眼直接看到新消息从QQ对应的界面2转化为球形飞向微信对应的界面1，这样能够使得用户直观的看到新消息所属应用界面的位置。
可以理解的是，图7A仅是一种示意性说明，新消息与新消息所属应用界面之间的关联形式包括但不限于上述球形滚动的形式，也可以为其它形态，例如VR/AR设备还可以将以通知控件形式显示的新消息转化为卷轴形，移动到该新消息所属的应用界面，本申请对此不作限定。
进一步的，作为一种可能的实现方式，当新消息以球形的形式飞到界面1之后，用户可点击球形，然后新消息可显示在界面1的聊天窗口内，这样可方便用户查看并处理消息。
作为又一种可能的实现方式，当新消息以球形的形式飞到界面1之后，可自动将消息展示在界面1的聊天窗口内，或者也可以在飞到界面1之后，停留设定时长(例如5s)，然后将新消息显示在界面1的聊天窗口内。当然，上述示例仅是一种示意性说明，本申请对此不作限定。
示例2：VR/AR设备可将新消息与该新消息所属的应用界面以连线的方式进行指示。
假设空间中显示的APP可包括APP1、APP2、APP3，其中，APP1对应的界面为界面1，APP2对应的界面为界面2，APP3对应的界面为界面3。如图7B所示，假设新消息为APP1(微信)对应的消息，此时新消息可以通知控件的形式显示在用户当前的视野范围，例如图7B中的(a)所示。然后VR/AR设备可通过连线将新消息与APP1对应的界面1进行关联，例如可通过图7B中的(b)所示的实线进行连接，这样能够直观的反映出新消息与新消息所属应用界面的指示关系，并且用户可通过肉眼看到新消息与新消息所属的界面1之间的实线。当然，也可以通过虚线进行连接，本申请对此不作限定。
需要说明的是，通过连线的方式进行关联时，连线可以为两端带箭头的连线，也可以为两端均不带箭头的连线，也可以为仅有一端带有箭头的连线，本申请对此不作限定，图7B中以一端带有箭头为例进行示意。
这样一来，用户就可以根据连线找到新消息所属的应用界面的位置，此时如果用户可以点击界面2的通知控件，该新消息可显示在界面1中，便于用户回复该新消息。
示例3：VR/AR设备可以以箭头的形式将新消息指向该新消息所属的应用界面。
继续沿用上面的示例，如图7C所示，假设新消息为APP1(微信)对应的消息，此时新消息可以通知控件的形式显示在用户当前的视野范围，例如图7C中的(a)所示。然后VR/AR设备可通过指针的形式将新消息与APP1对应的界面1进行关联，例如可参阅图7C中的(b)所示，用户可以直观地看到新消息与界面1之间的指针，并且可以根据指针找到新消息所属应用界面的位置。
示例4：VR/AR设备可以以气泡的形式将新消息指向该新消息所属的应用界面。
如图7D所示，假设APP1(微信)对应的应用界面为界面1，APP2(图库)对应的应用界面为界面2，新消息为APP1(微信)对应的消息，此时新消息可以通过如图7D所示的气泡的形式显示在用户当前的视野范围。并且可通过气泡上的箭头指向新消息所属的界面1。用户可以直观地看到新消息与界面1之间的气泡，并且用户可以根据气泡上箭头的方向找到新消息所属应用界面的位置。应理解，应用界面所在的位置不同时，气泡上箭头的方向也会有所变化。
可以理解的是，上述示例仅是示意性说明，将新消息与新消息所属的应用界面进行关联的形式并不限于上述方式，例如，VR/AR设备也可以通过其它的形式将新消息与APP1的应用界面进行关联等，本申请对此不作限定。
另外，关联形式也可以为带有颜色、效果等的关联形式，例如连线可以为红色的连线，气泡可以为彩色的或者带有阴影的等等，本申请对此也不做具体限定。
需要说明的是，图4B、图5、图7A、图7B、图7C以及图7D所示示意图中的坐标仅是为了示意说明，实际空间中并不显示坐标系。
在一种可能的实现方式中，指示方式可以以隐式形式显示，也就是说新消息与新消息所属的应用界面的指示方式的显示时间可以为预设时长，例如1分钟，当时间达到1分钟时，该关联形式可隐藏起来。也就是说，如果用户没有及时查看新消息，之后想要查看新消息时，可点击该新消息对应的通知控件，然后关联形式可再次播放。示例性的，比如VR/AR设备接收到两条新消息，例如，消息1和消息2。其中，消息1所属的应用界面在用户视野范围内，消息2所属的应用界面不在用户视野范围内，此时用户先查看了应用界面在视野范围内的消息1，那么消息2可通过连线的方式连接到消息2所属的应用界面，该连线在1分钟之后可隐藏起来。如果用户在5分钟之后想要查看消息2，则可点击消息2的通知控件，这时消息2与消息2所属的应用界面之间的连线可再次显示出来，以便用户查看。
当然，本申请实施例中也可以不限定新消息与新消息所属的应用界面的指示方式的显示时间，指示方式也可以以显示形式显示，也就是说，指示方式可以一直显示在空间中，本申请对此不作限定。
进一步的，在本申请一些实施例中，VR/AR设备在将新消息与新消息所属的应用界面进行关联时，所选择的关联形式可以是随机的，也可以是按照固定的顺序依次选择的。
作为一种可能的实现方式，电子设备中可预先保存有多种关联形式。示例性的，假设VR/AR设备接收到新消息1，并且该新消息1所属的应用界面不在用户的视野范围内，则可以随机选择预先保存的多种关联形式中的任意一种，例如选择连线的形式将新消息1与所属的应用界面进行关联。接着VR/AR设备接收到新消息2，并且该新消息2所属的应用界面不在用户的视野范围内，则随机选择预先保存的多种关联形式中的任意一种，例如选择指针的形式将新消息2与所属的应用界面进行关联。当然，可以理解的是，VR/AR设备在随机选择关联形式时，针对不同的消息，选择出的关联形式可以相同，也可以不同，例如对于新消息2，VR/AR设备也可以选择通过连线的形式将新消息2与所属的应用界面进行关联。
作为另一种可能的实现方式，VR/AR设备可根据预先保存的多种关联形式，依次将接收到的新消息与新消息所属的应用界面进行关联。假设预先保存的每个关联形式都有一个 对应的编号，例如1、2、3、4…等等。示例性的，比如VR/AR设备接收到新消息1，并且该新消息1所属的应用界面不在用户的视野范围内，则可以选择编号为1的关联形式将新消息1与所属的应用界面进行关联；然后VR/AR设备接收到新消息2，并且该新消息2所属的应用界面不在用户的视野范围内，则选择编号为2的关联形式将新消息2与所属的应用界面进行关联，以此类推。
在本申请另一些实施例中，当VR/AR设备接收到新消息，并且该新消息所属的应用界面不在用户的视野范围内，则VR/AR设备可以提供一个选择界面，以供用户可以根据自己的喜好去选择关联形式。示例性的，参阅图8所示，当VR/AR设备接收到新消息，并且该新消息所属的应用界面不在用户的视野范围内时，可在用户的视野范围内显示图8中所示的界面，该界面上可包括多种关联形式。用户可以根据自己的需求或者喜好等选择关联形式，比如用户选择了实线连接的形式，当选择好关联形式之后，可点击“确认”按钮，然后VR/AR设备可按照用户所选择的关联形式将新消息与新消息所属的应用界面进行关联。
可以理解的是，图8所示的示意图中，用户选择的实线连接的关联形式的选择框用斜线填充。在实际应用中，用户选择的关联形式也可以以其它的形式来显示，比如可以以灰色或者红色等颜色来显示，本申请对此不作限定。
需要说明的是，图8所示的界面可以显示在用户视野范围内的任意位置，例如可以显示在用户视野范围内的任意一个界面的上层，本申请对此不作限定。
在又一些实施例中，VR/AR设备可以根据新消息与新消息所属的应用界面之间的距离，选择不同的关联形式指示新消息与新消息所属的应用界面的位置关系。示例性的，当新消息与新消息所属的应用界面之间的距离较远时，可以选择连线的形式将新消息与新消息所属的应用界面进行关联；当新消息与新消息所属的应用界面之间的距离较近时，可以选择指针的形式将新消息与新消息所属的应用界面进行关联。
上述仅是以电子设备接收到一个新消息为例进行的说明。需要说明的是，当电子设备同时接收到多个新消息，并且多个新消息中的至少一个新消息所属的应用界面不在用户视野范围内时，可以针对不同的消息选择不同的关联形式，这样能够方便用户找到新消息所属的应用界面。
举例来说，VR/AR设备针对消息1可以选择预先存储的多个关联形式中的连线形式将消息1与消息1所属的应用界面进行关联，针对消息2，VR/AR设备可以选择与消息1的关联形式不同的关联形式，例如指针的形式将消息2与消息2所属的应用界面进行关联。
可以理解的是，VR/AR设备也可以选择与消息1的关联形式相同的关联形式将消息2与消息2所属的应用界面进行关联，本申请对此不作限定。
在另一些实施例中，如果是用户选择关联形式，那么可以针对一个消息显示一个选择界面。比如，VR/AR设备接收到三条新消息，则可在用户视野范围内显示三个选择界面。其中，每个选择界面的上方可显示每个选择界面对应的消息来源以及消息内容等，例如可参阅图9A所示的界面。
比如，新消息分别为：
消息1，微信好友小李发来的消息：晚上一起吃饭吧。
消息2，QQ好友张三发来的消息：有没有空呀？
消息3，微信好友小美发来的消息：hi，最近怎么样？
上述三条新消息可以以图9A所示的显示形式显示在三个选择界面的上方。当然，可以理解的是，选择界面也可以为图9B所示的界面，即三条新消息的选择界面显示在一个界面中，该界面上可包括三条新消息的选择框。另外，选择界面的上方显示的内容也可以仅显示消息所属的APP以及发消息的人物，比如“微信小李：晚上一起吃饭吧。”也可以显示为“微信：小李”等，本申请对此不作限定。
需要说明的是，在图9A和图9B所示的示意图中，用户针对不同的消息可以选择相同或不同的关联形式，本申请对此不作限定。
作为又一种示例，如图9C所示，用户可以通过连线的方式选择消息与关联的形式。例如图9C所示的界面中可以包括铅笔901、橡皮檫902、确认按钮903，取消按钮904，用户可以点击铅笔901，然后依次将消息与关联形式进行连线。例如，在图9C中可选择消息1与消息1所属的应用界面用实线连线的方式来指示，选择消息2与消息2所属的应用界面用指针的方式来指示，选择消息3与消息3所属的应用界面用虚线连线的方式来指示。
当连线完成之后，若用户确认不需要修改，可点击确认按钮903。如果用户在连线过程中想要调整选择的关联形式，可以通过橡皮檫902或者点击取消按钮904，重新选择关联形式。
可以理解的是，图8、图9A、图9B、图9C所示示意图中的“……”可以表示其它的关联形式，例如可以为其它形式的动画等，本申请对此不作限定。
需要说明的是，本申请实施例中的界面图仅是一种示意图，在实际产品实现时，界面上显示的按钮、控件等可以显示，也可以不显示，当然也可以显示其他的按钮、控件等，本申请并不限于此。
上述本申请提供的实施例中，从电子设备作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能，电子设备可以包括硬件结构和/或软件模块，以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行，取决于技术方案的特定应用和设计约束条件。
如图10所示，为本申请实施例提供的另一种电子设备的结构示意图，该电子设备可以是具有显示屏的电子设备。参阅图10所示，所述电子设备1000包括：显示屏1001；一个或多个处理器1002；存储器1003；多个应用1004(图中未示出)；以及一个或多个计算机程序1005(图中未示出)，上述各器件可以通过一个或多个通信总线1006连接。
其中，显示屏1001用于显示电子设备中的应用的显示界面等。
其中，存储器1003中存储有一个或多个计算机程序，所述一个或多个计算机程序包括指令；处理器1002调用存储器1003中存储的所述指令，使得电子设备1000执行以下步骤：
接收第一消息；确定所述第一消息所属的第一应用界面标识；根据所述第一应用界面标识，获取所述第一消息所属的第一应用界面所在的第一区域；若确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，则通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，所述第二区域为用户视野范围所在的区域。
在一种可能的设计中，确定所述第一消息所属的第一应用界面标识，包括：获取所述第一消息中携带的标识信息；根据所述第一消息中携带的标识信息，确定所述第一消息所属的第一应用界面标识。
在一种可能的设计中，当所述指令被所述一个或多个处理器1002调用执行时，使得所述电子设备1000还执行以下步骤：将所述第一消息以通知的形式显示在所述第二区域。
在一种可能的设计中，当所述指令被所述一个或多个处理器1002调用执行时，使得所述电子设备1000还执行以下步骤：若确定所述第一区域在第二区域内，则将所述第一消息显示在所述第一消息所属的第一应用界面。
在一种可能的设计中，确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，包括：确定所述第一消息所属的第一应用界面所在的第一区域不在第三区域内，所述第三区域为所述第二区域的第一子区域，所述第三区域为VR设备或AR设备当前的显示区域；或者确定所述第一消息所属的第一应用界面所在的第一区域在第三区域内，但不在第四区域内，所述第四区域为所述第二区域的第二子区域，所述第四区域为用户眼睛当前所注视的区域。
在一种可能的设计中，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：根据所述第一消息与所述第一应用界面之间的距离，在第一集合中确定第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
在一种可能的设计中，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：在第一集合中任意选择一种指示形式作为第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
在一种可能的设计中，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：按照所述第一集合中指示形式的编号顺序，确定第一指示形式；利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。其中，第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中。
在一种可能的设计中，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：在所述第二区域内显示提示信息，所述提示信息用于提示用户在第一集合中选择第一指示形式，所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；利用用户选择的所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
在一种可能的设计中，所述第一指示形式包括如下形式中的任意一种：指针指示、连线指示、动画指示。
在一种可能的设计中，所述第一指示形式以显示形式显示或者以隐式形式显示，所述显示形式为持续显示在空间中的展示形式，所述隐式形式为在空间中显示设定时长后消失的展示形式。
在本申请实施例中，处理器1002可以是通用处理器、数字信号处理器、专用集成电路、现场可编程门阵列或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件，可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件处理器执行完成，或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于存储器1003中，处理器1002读取存储器1003中的程序指令，结合其硬件完 成上述方法的步骤。
在本申请实施例中，存储器1003可以是非易失性存储器，比如硬盘(hard disk drive，HDD)或固态硬盘(solid-state drive，SSD)等，还可以是易失性存储器(volatile memory)，例如RAM。存储器还可以是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质，但不限于此。本申请实施例中的存储器还可以是电路或者其它任意能够实现存储功能的装置，用于存储指令和/或数据。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
基于以上实施例，本申请实施例还提供一种芯片，所述芯片与电子设备中的存储器耦合，执行本申请实施例提供的消息提醒方法；本申请实施例中“耦合”是指两个部件彼此直接或间接地结合。
基于以上实施例，本申请还提供了一种计算机存储介质，所述计算机存储介质中存储有计算机程序，所述计算机程序被计算机执行时，使得所述计算机执行以上实施例提供的消息提醒方法。
本申请实施例中还提供一种计算机程序产品，包括指令，当其在计算机上运行时，使得计算机执行以上实施例提供的消息提醒方法。
本申请实施例是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。

Claims (23)

  1. 一种消息提醒方法，应用于虚拟现实VR设备或增强现实AR设备，其特征在于，包括：
    接收第一消息；
    确定所述第一消息所属的第一应用界面标识；
    根据所述第一应用界面标识，获取所述第一消息所属的第一应用界面所在的第一区域；
    若确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，则通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，所述第二区域为用户视野范围所在的区域。
  2. 如权利要求1所述的方法，其特征在于，所述确定所述第一消息所属的第一应用界面标识，包括：
    获取所述第一消息中携带的标识信息；
    根据所述第一消息中携带的标识信息，确定所述第一消息所属的第一应用界面标识。
  3. 如权利要求1或2所述的方法，其特征在于，所述方法还包括：将所述第一消息以通知的形式显示在所述第二区域。
  4. 如权利要求1-3任一项所述的方法，其特征在于，所述方法还包括：若确定所述第一区域在第二区域内，则将所述第一消息显示在所述第一消息所属的第一应用界面。
  5. 如权利要求1-4任一项所述的方法，其特征在于，确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，包括：
    确定所述第一消息所属的第一应用界面所在的第一区域不在第三区域内，所述第三区域为所述第二区域的第一子区域，所述第三区域为VR设备或AR设备当前的显示区域；或者
    确定所述第一消息所属的第一应用界面所在的第一区域在第三区域内，但不在第四区域内，所述第四区域为所述第二区域的第二子区域，所述第四区域为用户眼睛当前所注视的区域。
  6. 如权利要求1-5任一项所述的方法，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    根据所述第一消息与所述第一应用界面之间的距离，在第一集合中确定第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  7. 如权利要求1-5任一项所述的方法，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    在第一集合中任意选择一种指示形式作为第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  8. 如权利要求1-5任一项所述的方法，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    按照所述第一集合中指示形式的编号顺序，确定第一指示形式；所述第一集合中包括 至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  9. 如权利要求1-5任一项所述的方法，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    在所述第二区域内显示提示信息，所述提示信息用于提示用户在第一集合中选择第一指示形式，所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用用户选择的所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  10. 如权利要求1-9任一项所述的方法，其特征在于，所述第一指示形式包括如下形式中的任意一种：指针指示、连线指示、动画指示。
  11. 如权利要求1-10任一项所述的方法，其特征在于，所述第一指示形式以显示形式显示或者以隐式形式显示，所述显示形式为持续显示在空间中的展示形式，所述隐式形式为在空间中显示设定时长后消失的展示形式。
  12. 一种电子设备，其特征在于，所述电子设备包括显示屏；一个或多个处理器；存储器；多个应用；以及一个或多个计算机程序；
    其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述一个或多个处理器调用执行时，使得所述电子设备执行以下步骤：
    接收第一消息；
    确定所述第一消息所属的第一应用界面标识；
    根据所述第一应用界面标识，获取所述第一消息所属的第一应用界面所在的第一区域；
    若确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，则通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，所述第二区域为用户视野范围所在的区域。
  13. 如权利要求12所述的电子设备，其特征在于，确定所述第一消息所属的第一应用界面标识，包括：
    获取所述第一消息中携带的标识信息；
    根据所述第一消息中携带的标识信息，确定所述第一消息所属的第一应用界面标识。
  14. 如权利要求12或13所述的电子设备，其特征在于，当所述指令被所述一个或多个处理器调用执行时，使得所述电子设备还执行以下步骤：
    将所述第一消息以通知的形式显示在所述第二区域。
  15. 如权利要求12-14任一项所述的电子设备，其特征在于，当所述指令被所述一个或多个处理器调用执行时，使得所述电子设备还执行以下步骤：
    若确定所述第一区域在第二区域内，则将所述第一消息显示在所述第一消息所属的第一应用界面。
  16. 如权利要求12-15任一项所述的电子设备，其特征在于，确定所述第一消息所属的第一应用界面所在的第一区域不在第二区域内，包括：
    确定所述第一消息所属的第一应用界面所在的第一区域不在第三区域内，所述第三区域为所述第二区域的第一子区域，所述第三区域为VR设备或AR设备当前的显示区域； 或者
    确定所述第一消息所属的第一应用界面所在的第一区域在第三区域内，但不在第四区域内，所述第四区域为所述第二区域的第二子区域，所述第四区域为用户眼睛当前所注视的区域。
  17. 如权利要求12-16任一项所述的电子设备，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    根据所述第一消息与所述第一应用界面之间的距离，在第一集合中确定第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  18. 如权利要求12-16任一项所述的电子设备，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    在第一集合中任意选择一种指示形式作为第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  19. 如权利要求12-16任一项所述的电子设备，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    按照所述第一集合中指示形式的编号顺序，确定第一指示形式；所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  20. 如权利要求12-19任一项所述的电子设备，其特征在于，通过第一指示形式指示所述第一消息与所述第一应用界面的方位关系，包括：
    在所述第二区域内显示提示信息，所述提示信息用于提示用户在第一集合中选择第一指示形式，所述第一集合中包括至少一个指示形式，且所述第一集合预先保存在VR设备或AR设备中；
    利用用户选择的所述第一指示形式指示所述第一消息与所述第一应用界面的方位关系。
  21. 如权利要求12-20任一项所述的电子设备，其特征在于，所述第一指示形式包括如下形式中的任意一种：指针指示、连线指示、动画指示。
  22. 如权利要求12-21任一项所述的电子设备，其特征在于，所述第一指示形式以显示形式显示或者以隐式形式显示，所述显示形式为持续显示在空间中的展示形式，所述隐式形式为在空间中显示设定时长后消失的展示形式。
  23. 一种计算机存储介质，其特征在于，包括计算机指令，当所述计算机指令在电子设备上运行时，使得所述电子设备执行如权利要求1-11中任一项所述的消息提醒方法。
PCT/CN2021/119557 2020-09-23 2021-09-22 一种消息提醒方法及电子设备 WO2022063110A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/027,592 US20240007559A1 (en) 2020-09-23 2021-09-22 Message Prompt Method and Electronic Device
EP21871480.6A EP4210308A4 (en) 2020-09-23 2021-09-22 MESSAGE BLOWING METHOD AND ELECTRONIC DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011009447.7A CN114302011A (zh) 2020-09-23 2020-09-23 一种消息提醒方法及电子设备
CN202011009447.7 2020-09-23

Publications (1)

Publication Number Publication Date
WO2022063110A1 true WO2022063110A1 (zh) 2022-03-31

Family

ID=80846238

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/119557 WO2022063110A1 (zh) 2020-09-23 2021-09-22 一种消息提醒方法及电子设备

Country Status (4)

Country Link
US (1) US20240007559A1 (zh)
EP (1) EP4210308A4 (zh)
CN (1) CN114302011A (zh)
WO (1) WO2022063110A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105892667A (zh) * 2016-03-31 2016-08-24 联想(北京)有限公司 一种虚拟现实场景下的信息处理方法和电子设备
CN107133002A (zh) * 2017-03-22 2017-09-05 联想(北京)有限公司 一种信息处理方法及电子设备
CN107368240A (zh) * 2017-06-29 2017-11-21 联想(北京)有限公司 一种信息处理方法及电子设备、存储介质
US20180284950A1 (en) * 2017-03-30 2018-10-04 Lenovo (Beijing) Co., Ltd. Display method and terminal
WO2020047758A1 (zh) * 2018-09-04 2020-03-12 深圳市欢太科技有限公司 消息提示方法及相关产品

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107872556A (zh) * 2016-09-23 2018-04-03 成都理想境界科技有限公司 基于头戴式显示设备的事件提醒方法及装置
CN109979012A (zh) * 2017-12-27 2019-07-05 北京亮亮视野科技有限公司 展示消息通知的方法及装置
US10802894B2 (en) * 2018-03-30 2020-10-13 Inflight VR Software GmbH Method, apparatus, and computer-readable medium for managing notifications delivered to a virtual reality device
CN110602273B (zh) * 2019-08-05 2021-06-08 华为技术有限公司 一种消息显示方法、电子设备及计算机可读存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105892667A (zh) * 2016-03-31 2016-08-24 联想(北京)有限公司 一种虚拟现实场景下的信息处理方法和电子设备
CN107133002A (zh) * 2017-03-22 2017-09-05 联想(北京)有限公司 一种信息处理方法及电子设备
US20180284950A1 (en) * 2017-03-30 2018-10-04 Lenovo (Beijing) Co., Ltd. Display method and terminal
CN107368240A (zh) * 2017-06-29 2017-11-21 联想(北京)有限公司 一种信息处理方法及电子设备、存储介质
WO2020047758A1 (zh) * 2018-09-04 2020-03-12 深圳市欢太科技有限公司 消息提示方法及相关产品

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4210308A4 *

Also Published As

Publication number Publication date
EP4210308A4 (en) 2024-03-27
CN114302011A (zh) 2022-04-08
US20240007559A1 (en) 2024-01-04
EP4210308A1 (en) 2023-07-12

Similar Documents

Publication Publication Date Title
US11394676B2 (en) Media content response in a messaging system
WO2021057830A1 (zh) 一种信息处理方法及电子设备
KR102253891B1 (ko) 미디어 오버레이들에서의 커스터마이즈된 아바타들의 생성 및 디스플레이
KR102317167B1 (ko) 중복 추적 시스템
US10187520B2 (en) Terminal device and content displaying method thereof, server and controlling method thereof
US11671664B2 (en) Media collection generation and privacy mechanisms
WO2020006245A1 (en) Content sharing platform profile generation
CN111133723B (zh) 独立于应用的消息传递系统
CN112639892A (zh) 增强现实拟人化系统
US11032532B2 (en) Electronic device and method for providing virtual device via at least portion of content
KR20210052572A (ko) 협업 공용 사용자 프로필
WO2022152024A1 (zh) 一种微件的显示方法与电子设备
US11468613B2 (en) Annotating an image with a texture fill
US20220308721A1 (en) Message thread prioritization interface
US11128715B1 (en) Physical friend proximity in chat
WO2022166713A1 (zh) 电子设备及其应用的显示方法和介质
WO2021254113A1 (zh) 一种三维界面的控制方法和终端
WO2021052488A1 (zh) 一种信息处理方法及电子设备
US11908489B2 (en) Tap to advance by subtitles
WO2023005751A1 (zh) 渲染方法及电子设备
WO2022063110A1 (zh) 一种消息提醒方法及电子设备
US11317129B1 (en) Targeted content distribution in a messaging system
WO2022068628A1 (zh) 一种界面的分布式显示方法、电子设备及通信系统
WO2023160455A1 (zh) 删除对象的方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21871480

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021871480

Country of ref document: EP

Effective date: 20230405

NENP Non-entry into the national phase

Ref country code: DE