WO2022213743A1 - 用户界面的显示方法、装置、设备及存储介质 - Google Patents

用户界面的显示方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2022213743A1
WO2022213743A1 PCT/CN2022/078423 CN2022078423W WO2022213743A1 WO 2022213743 A1 WO2022213743 A1 WO 2022213743A1 CN 2022078423 W CN2022078423 W CN 2022078423W WO 2022213743 A1 WO2022213743 A1 WO 2022213743A1
Authority
WO
WIPO (PCT)
Prior art keywords
user interface
interface
resource
processor
interface element
Prior art date
Application number
PCT/CN2022/078423
Other languages
English (en)
French (fr)
Inventor
王舜
陈德银
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to EP22783813.3A priority Critical patent/EP4321995A1/en
Publication of WO2022213743A1 publication Critical patent/WO2022213743A1/zh
Priority to US18/377,538 priority patent/US20240045702A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • G06F9/4418Suspend and resume; Hibernate and awake
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/802D [Two Dimensional] animation, e.g. using sprites

Definitions

  • the embodiments of the present application relate to the field of wearable devices, and in particular, to a method, device, device, and storage medium for displaying a user interface.
  • a wearable device is a portable electronic device that can be directly worn or integrated on clothes or accessories.
  • Common wearable devices include smart watches, smart bracelets, smart glasses and so on.
  • the user can use the wearable device to check the time, and use the application installed in the wearable device to realize functions such as sleep quality monitoring, exercise statistics, and notification message viewing.
  • Embodiments of the present application provide a method, apparatus, device, and storage medium for displaying a user interface.
  • the technical solution is as follows:
  • an embodiment of the present application provides a method for displaying a user interface, the method is applied to a wearable device, and the wearable device supports running the first system and the second system;
  • the method includes:
  • the second user interface is displayed by the second system in response to the second system completing the rendering of the second user interface.
  • an embodiment of the present application provides a user interface display device, the device is used in a wearable device, and the wearable device supports running the first system and the second system;
  • the device includes:
  • a first system module configured to display a first user interface through the first system when the first system is in an awake state and the second system is in a dormant state;
  • the first system module is further configured to, in response to a system switching instruction, draw and display a second user interface through the first system, where the second user interface is the user interface of the second system;
  • the second system module is configured to display the second user interface through the second system in response to the completion of the drawing of the second user interface by the second system.
  • an embodiment of the present application provides a wearable device, the wearable device includes a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used by the processor It is executed to realize the display method of the user interface described in the above aspects.
  • an embodiment of the present application provides a computer-readable storage medium, where the storage medium stores at least one instruction, and the at least one instruction is configured to be executed by a processor to implement the user interface described in the foregoing aspects. Display method.
  • an embodiment of the present application provides a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for displaying the user interface provided by the above aspects.
  • FIG. 1 is a schematic diagram of a dual-core communication software framework corresponding to a second processor according to an exemplary embodiment of the present application
  • FIG. 2 is a schematic diagram of a dual-core communication software framework corresponding to a first processor according to an exemplary embodiment of the present application
  • FIG. 3 shows a flowchart of a method for displaying a user interface provided by an exemplary embodiment of the present application
  • FIG. 4 is a schematic diagram of a user interface of a system switching process in a smart watch according to an exemplary embodiment of the present application
  • FIG. 5 shows a flowchart of a method for displaying a user interface provided by another exemplary embodiment of the present application
  • FIG. 6 is a schematic diagram of a second user interface in a smart watch according to an exemplary embodiment of the present application.
  • FIG. 7 shows a flowchart of a user interface resource update process provided by an exemplary embodiment of the present application
  • FIG. 8 is a schematic diagram of a user interface of a system switching process in a smart watch according to an exemplary embodiment of the present application.
  • FIG. 9 is a system interaction sequence diagram of a user interface resource update process shown in an exemplary embodiment of the present application.
  • FIG. 10 shows a structural block diagram of a display device for a user interface provided by another embodiment of the present application.
  • FIG. 11 shows a structural block diagram of a wearable device provided by an exemplary embodiment of the present application.
  • plural refers to two or more.
  • “And/or”, which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone.
  • the character “/” generally indicates that the associated objects are an "or" relationship.
  • a single processor is set in the wearable device, and all system events generated during the operation of the device are processed through the operating system running on the processor, so the processor needs to have strong data processing capabilities. capability and maintain working condition while the equipment is in operation.
  • wearable devices only need to implement some functions that require less processing performance in most cases, for example, for smart watches or smart bracelets, in most cases, smart watches or The smart bracelet only needs to display time and prompt messages. Therefore, keeping the processor in operation for a long time will not improve the performance of the wearable device, but will increase the power consumption of the device, resulting in a shorter battery life of the wearable device.
  • the wearable device is provided with at least a first processor and a second processor with different processing performance and power consumption.
  • the processor is respectively used to run the first system and the second system (ie dual-core dual system), and a system switching mechanism is designed for the dual-core dual system.
  • the first system running on the low-power processor processes events requiring low-performance processing, and keeps the high-power processor in a dormant state (correspondingly, the high-power processor is The second system run by the processor is in a dormant state) to reduce the power consumption of the wearable device while implementing the basic functions of the wearable device; when there is an event requiring high-performance processing (such as starting an application), the Wake up the high power consumption processor and switch the second system to process the event, so as to ensure that the triggered event can be responded to and processed in time and meet the performance requirements of the wearable device.
  • an event requiring high-performance processing such as starting an application
  • the present application introduces a system switching effect pre-display mechanism.
  • the first system run by the low-power processor draws and displays the second user interface; after the high-power processor draws the second user interface, the high-power processor
  • the second system running on the processor receives the user interface display authority and realizes the pre-display of the system switching, thereby improving the startup speed of the visual system switching and reducing the display delay of the user interface during the system switching process.
  • the first processor and the second processor work asynchronously, and the first system and the second system need to implement system communication (or referred to as dual-core communication).
  • the first system is a Real Time Operating System (RTOS) running on a Micro Controller Unit (MCU)
  • the second system is a real-time operating system (RTOS) running on a central processing unit ( The Android operating system on the Central Processing Unit (CPU).
  • RTOS Real Time Operating System
  • MCU Micro Controller Unit
  • RTOS Real-time operating system
  • CPU Central Processing Unit
  • FIG. 1 it shows a dual-core communication software framework of an Android operating system shown in an exemplary embodiment of the present application.
  • the dual-core communication software framework follows the design principles of "low coupling, high reliability, and high reuse", including Kernel (kernel), HIDL (hardware abstraction layer interface description language), Native Service (local service), Framework Service (framework service) , Framework API (framework interface) and APP (application) part of the module development.
  • the APP module includes functional modules such as Launcher (desktop launcher), Setting (setting) and SystemUI (system user interface), and the Framework API module includes MCUManager (MCU management), SensorManager (sensor management), LocationManager (location management), etc.
  • Management module Framework Service module includes MCUManagerService (MCU management service), SystemSensorManager (system sensor management), LocationManagerService (location management service) and other service modules
  • Native Service module includes dccservice (dcc service), Sensorservice (sensor service) and other service modules
  • HIDL modules include Sensor HAL (sensor hardware abstraction layer), GPS HAL (global positioning system hardware abstraction layer) and other modules.
  • the Kernel module includes DCC Transfer Drivers such as dcc_datah, dcc_data, Mcu_sensor, Mcu_gps, and Mcu_factory.
  • the transport layer as the interface layer connecting the upper and lower layers in the dual-core communication software framework, shields the application layer from the transmission details of the communication of the lower layer (data link layer) of the system, and provides a service channel for application scenarios;
  • the application layer as the main body of service provision, responds to people It communicates with the computer and transmits the data generated in the process of human-computer interaction through the transport layer, and responds to external data requests.
  • RTOS is designed using the principle of peer-to-peer. Taking the wearable device as a smart watch as an example, as shown in FIG. 2 , it shows the dual-core communication software framework of RTOS shown in an exemplary embodiment of the present application.
  • the dual-core communication software framework of RTOS is divided into application layer (Application Layer), service layer (Service Layer), framework layer (Framework Layer), hardware abstraction layer (Hardware abstraction layer) and platform layer (PlatformLayer).
  • the application layer includes watch face (dial), Daily Tracker (daily tracking), Message center (message center), Voice around Apps (sound application), Health Apps (health application), Settings (settings) and other application modules; service layer Including Sport&health task (sports health task), System manager task (system management task), AMS (activity management service), AudioService (audio service), Log Service (log service), OFTP Service (Odette file transfer protocol service), BT Service (Bluetooth service), Delegate Service (transfer service), RPC Service (remote call service), sensor Service (sensor service), storage Service (storage service) and other service modules; the framework layer includes Message Pub (message center), UI Framework ( User interface framework), G2D Engine (G2D attention), Audio Middleware (audio middleware), Preference (preference), File system (file system), Algorithms (algorithm), Aios, AsycEvent (in-process asynchronous event) and other framework modules;
  • the hardware abstraction layer includes hardware abstraction modules such as Screen/TP (screen
  • the method is used in a wearable device, and the wearable device supports running the first system and the second system;
  • a second user interface is drawn and displayed by the first system, and the second user interface is the user interface of the second system;
  • the second user interface is displayed by the second system in response to the second system completing the rendering of the second user interface.
  • the second user interface is drawn and displayed by the first system, including:
  • a second user interface is displayed by the first system.
  • the user interface resources include interface element resources corresponding to the interface elements and display location information;
  • the second user interface is drawn by the first system, including:
  • the interface element is displayed at the position of the interface element indicated by the display position information to obtain a second user interface.
  • draw interface elements based on interface element resources including:
  • variable interface element In response to the interface element including the variable interface element, determining the target interface element resource corresponding to the variable interface element based on the current moment, wherein the variable interface element corresponds to at least two interface element resources, and different interface element resources correspond to different display periods;
  • system switching instruction is triggered by a sliding operation
  • a second user interface is displayed by the first system, including:
  • the switching animation from the first user interface to the second user interface is displayed through the first system
  • displaying the second user interface by the second system includes:
  • the second user interface In response to the second user interface being drawn by the second system and the sliding operation ending, the second user interface is displayed by the second system.
  • the method also includes:
  • the user interface resources stored in the first storage space are updated through the first system.
  • sending interface resource update data to the first system through the second system including:
  • the interface resource update data is sent to the first system through the second system, and the interface resource change event includes interface element addition and deletion events, interface element position adjustment events and system settings. At least one of the change events.
  • displaying a second user interface through the second system including:
  • the second user interface is displayed by the second system in response to the second system acquiring the display authority of the graphical user interface.
  • the wearable device is provided with a first processor and a second processor, the power consumption of the second processor is higher than that of the first processor, and the first system is a system run by the first processor , the second system is a system run by the second processor.
  • FIG. 3 shows a flowchart of a method for displaying a user interface of a user interface provided by an exemplary embodiment of the present application.
  • This embodiment uses the method to apply a wearable device, and the wearable device supports running the first Taking the system and the second system as an example, the method may include the following steps.
  • Step 301 when the first system is in an awake state and the second system is in a dormant state, display a first user interface through the first system.
  • the wearable device is provided with a first processor and a second processor, wherein the processing performance of the first processor is lower than the processing performance of the second processor (the processing performance of the first processor power and processing speed are lower than that of the second processor), and the power consumption of the first processor is lower than that of the second processor.
  • the second system (run by the second processor) can process events handled by the first system (run by the first processor), while the first system is not necessarily capable of handling events handled by the second system.
  • the wearable device may also be provided with a single processor, the first system and the second system respectively run on different cores of the processor, wherein the core running the second system has high processing performance processing performance of the core running the first system.
  • the first processor is an MCU
  • the second processor is a CPU
  • the first system is an RTOS
  • the second system is an Android system.
  • the events that the first system can handle include dial display, dial interface switching, notification message display, and other scenarios with low processing performance requirements or weak interaction scenarios; the events that the second system can handle include answering incoming calls, launching applications, etc. , dial editing, function settings and other scenarios that require high processing performance or strong interaction scenarios.
  • the working modes of the wearable device include a performance mode, a hybrid mode and a low power consumption mode, wherein, in the performance mode, both the second processor and the first processor are kept in an awake state (corresponding to , both the first system and the second system are in the wake-up state); in the low power consumption mode, only the first processor remains in the wake-up state (normal working state), while the second processor remains in the off state (that is, the first system is in the wake-up state) state, the second system is off); in hybrid mode, when the first system processes an event, the second processor remains in the dormant state, the second processor is in the standby state, and can switch between the dormant and wake-up states (that is, the first system When one system is in an awake state, the second system can be in either an awake state or a dormant state).
  • the system-related data is cached in the memory (RAM), so that the system-related data can be run at any time.
  • RAM memory
  • the system-related data is stored in the hard disk (ROM). And it is written into memory by the hard disk when it is switched to the wake-up state.
  • wearable devices As an auxiliary electronic device, only have weak interactions with users in most usage scenarios. For example, in most scenarios, the user only lifts the wrist to view the smart watch. Therefore, when the wearable device processes the event through the first system, the second processor is controlled to be in a sleep state (the second system is in a sleep state), thereby reducing the overall power consumption of the wearable device.
  • Step 302 in response to the system switching instruction, draw and display a second user interface through the first system, where the second user interface is the user interface of the second system.
  • the system switching instruction is used to instruct to switch the system running in the foreground, that is, the system running in the foreground needs to be switched from the first system to the second system, rather than simply switching the second system in the dormant state to the wake-up state.
  • the display authority of the GUI of the wearable device will be switched from the first system to the second system.
  • the user when the user needs to use a function that is not available in the first user interface displayed by the first system, the user needs to switch the first system to the second system, and the second user interface displayed by the second system is used. to select the function you want to use.
  • the first system When the first system is in an awake state (the interface of the wearable device is the first user interface displayed by the first system) and the second system is in a dormant state, when a system switching instruction is received, it indicates that the first system needs to be switched When switching to the second system, since the first system does not have the function and capability to process the corresponding event, it is necessary to wake up the second system in the dormant state, so as to process through the second system.
  • the wake-up and display process of the second system takes a certain amount of time (at least 200ms to 300ms), there will be a short-term non-response phenomenon during the system switching process (represented as the time between receiving the system switching command and displaying the switching animation). There is a certain delay between the two systems, and the second system wakes up within the delay time, and completes the drawing and display of the second user interface through the second system), which affects the use experience.
  • the first system in order to reduce the display delay of the second user interface during the system switching process, when a system switching instruction for switching the second system is received during the operation of the first system, the first system first draws the second system's The second user interface is displayed (only responsible for drawing the interface image, not executing the specific functions of the second system under the first system, for example, the second user interface displays application icons, the first system only displays application icons, but the The application icon does not have the function of launching the application).
  • the system switching instruction is an instruction triggered by a shortcut key (such as a physical button set on the wearable device), or an instruction triggered by sliding (such as sliding the display interface of the wearable device with one finger or two fingers) , or an instruction triggered by a click (such as by clicking or double-clicking the display interface of the wearable device);
  • the second user interface may display icons such as sports health icons, instant messaging icons, alarm clock icons, weather icons, voice assistants, etc., and
  • the displayed second user interface may be a static interface or a dynamic interface. This embodiment of the present application does not limit the triggering method of the system switching instruction and the content displayed on the second user interface.
  • the first system Since the first system is in an awake state, the first system can draw and display the second user interface immediately after receiving the system switching instruction, thereby visually improving the system switching speed.
  • the first user interface is gradually replaced by sliding display until the second user interface is completely displayed.
  • the second user interface may also be displayed in a rotary display or split manner, and the embodiment of the present application does not limit the specific display manner of the second user interface.
  • the smart watch is provided with an RTOS (run by the first processor) and an Android system (run by the second processor).
  • the smart watch displays the first user interface 41 through the RTOS, and the Android system is in the dormant state, thereby maintaining low power consumption.
  • the system switching instruction can be triggered by a sliding operation.
  • the RTOS draws and displays the second user interface 42 of the Android system and displays it.
  • Step 303 in response to the second system completing the drawing of the second user interface, display the second user interface through the second system.
  • the system running on the wearable device is switched from the first system to the second system, so that the second user interface is displayed through the second system and corresponding functions are performed, such as,
  • the user enters the communication interface by triggering the instant messaging application on the second user interface. Since the second user interface drawn and displayed by the first system and the second system is consistent, the problem of sudden changes in the screen before and after system switching does not occur, making the system switching process difficult to detect.
  • the first system is still in a wake-up state (low power consumption, less impact on battery life), or the first system is switched to a sleep state, which is not limited in this embodiment.
  • the system switches to the second system in time, so as to avoid the occurrence of the user clicking the icon without
  • the sliding speed of the second user interface is determined according to the time when the second system wakes up and draws the second user interface, so as to ensure that the first user interface draws the first user interface.
  • the second user interface 42 slides and displays from left to right until the first user interface 41 is completely switched to the second user interface 42 , and the second user interface 42 is During the sliding display process of the user interface 42 from left to right, the Android system switches from the sleep state to the wake-up state.
  • the Android system wakes up and the drawing is completed (for example, after 200ms)
  • the running system of the smart watch is switched from the RTOS to the Android system, and the The Android system displays the second user interface 43 .
  • the second system switches back to the sleep state and continues to process events through the first system, so that the wearable device can maintain high performance in a small number of scenarios. (but high power consumption), while maintaining low power consumption (but low performance) in most scenarios, further reducing the power consumption of wearable devices and extending the battery life of wearable devices.
  • the first system if the first system is in the running state and the second system is in the dormant state, if a system switching instruction is received, the first system The system draws and displays the second user interface, and after the second system draws the second user interface, the second user interface is displayed through the second system; using the solution provided by the embodiment of the present application, the second user interface is pre-displayed through the first system
  • the interface can improve the startup speed of the visual system switching, and reduce the display delay of the second system displaying the second user interface during the system switching process.
  • the first system and the second system have corresponding data storage spaces, and since the first system is only responsible for processing simple events, while the second system needs to process complex events, the corresponding The storage space is much larger than the storage space corresponding to the first system.
  • user interface resources corresponding to the second user interface are stored in the storage space corresponding to the first system.
  • the first system is based on the user interface in the storage space. Interface resources for user interface drawing. Exemplary embodiments are used for description below.
  • FIG. 5 shows a flowchart of a method for displaying a user interface provided by another exemplary embodiment of the present application. This embodiment is described by taking the method applied to a wearable device as an example, and the method may include the following steps .
  • Step 501 in the case where the first system is in the wake-up state and the second system is in the dormant state, in response to the system switching instruction, obtain the user interface resources corresponding to the second user interface from the first storage space through the first system, the first system
  • the storage space is the storage space corresponding to the first system.
  • the first system corresponds to a first storage space
  • the first storage space stores user interface resources corresponding to at least one user interface.
  • the user interface resources refer to resources required for drawing a user interface.
  • the user interface may include text resources, picture resources, animation resources, special effects resources, interface layout resources, etc., and the specific content contained in the interface resources is not limited in this embodiment.
  • the first storage space stores user interface resources corresponding to the first user interface of the first system, and user interface resources corresponding to the second user interface corresponding to the second system.
  • the first storage space is stored by the dial resources.
  • the first storage space stores the icon resources corresponding to each application icon.
  • the second user interface may also display desktop pendants and voice assistants. , and corresponding user interface resources are also stored in the first storage space.
  • the first system searches the interface element resource corresponding to the interface element from the first storage space based on the interface element to be drawn.
  • mapping relationship between interface elements and interface element resources in the first storage space is shown in Table 1.
  • interface element UI Element Resources instant messaging icon Interface element resource A Alarm clock icon Interface element resource B weather icon Interface element resource C Sports Health Icons Interface element resource D
  • the first system obtains the interface element resource A corresponding to the interface element "instant messaging icon" from the first storage space.
  • Step 502 in response to the interface element including the variable interface element, determine the target interface element resource corresponding to the variable interface element based on the current moment, wherein the variable interface element corresponds to at least two interface element resources, and different interface element resources correspond to different Show time period.
  • variable interface elements such as time display Widgets and Greetings are variable UI elements.
  • variable interface elements may have different expressions in different time periods, that is, variable interface elements may correspond to multiple interface element resources. Therefore, when drawing variable interface elements, the first system also needs to use other data, such as time data, sensor data (such as pedometer data), etc., so as to ensure the accuracy and consistency of the interface elements in the drawn second user interface, and avoid differences between the interface elements drawn by the first system and the second system, There is an issue where the user interface suddenly changes when the system is switched.
  • the first system determines the target interface element resource from at least two interface element resources corresponding to the variable interface element based on the current moment, wherein, different interface element resources correspond to different display periods, and the display period to which the current moment belongs is the display period corresponding to the target interface element resource.
  • variable interface element is greeting
  • the interface element corresponding to the period from 0:00 to 12:00 is “good morning”
  • the interface element corresponding to the period from 12:00 to 17:00 is “good afternoon”.
  • the interface element corresponding to the period of "17:00 to 24:00" is "Good evening”.
  • the second user interface to be drawn contains greetings (the greetings display text information such as good morning, good afternoon and good evening on the user interface according to the time period), if the current time is ten o'clock, the first The system determines the interface element resource "good morning” corresponding to the time period to which the current moment belongs as the target greeting.
  • Step 503 draw a variable interface element based on the target interface element resource.
  • the first system draws the corresponding interface element according to the determined target interface resource.
  • the first system acquires that the interface resource includes a picture resource corresponding to the application icon and a text resource corresponding to the greeting, so as to render the application icon based on the picture resource and the greeting based on the text resource.
  • Step 504 Display the interface element at the position of the interface element indicated by the display position information to obtain a second user interface.
  • the first system determines the arrangement and layout of each interface element in the second user interface according to the position information of the interface elements contained in the user interface resource, and displays the second user interface.
  • a voice assistant 610 is displayed on the top of the second user interface 600
  • a greeting 611 is displayed in the voice assistant 610
  • the greeting 611 displays different text information according to the current time period
  • application icons such as an instant messaging icon 620 , an alarm clock icon 630 , and a sports health icon 640 are displayed below the second user interface 600 .
  • the second user interface 600 at this time is drawn and displayed by the first system, and the displayed interface elements do not have corresponding functions, that is, when the user clicks the instant messaging icon 620, the user will not respond The communication interface will also not be displayed.
  • Step 505 based on the sliding direction of the sliding operation, display a switching animation from the first user interface to the second user interface through the first system.
  • the first system draws the second user interface, based on the sliding direction of the sliding operation, the first user interface is slid and switched to the second user interface, wherein the sliding direction of the sliding operation is set by the user under the second system.
  • Toggle animations such as toggle, fly in, and split.
  • the second user interface 402 drawn by the first system is switched in a left-right switching manner. It should be noted that this embodiment does not limit the switching animation of the user interface.
  • Step 506 in response to the second system completing the drawing of the second user interface and the end of the sliding operation, displaying the second user interface through the second system.
  • the first user interface is switched to the second user interface.
  • the second system has woken up and drawn all the interface elements included in the second user interface, and the first system is switched to the second user interface.
  • the second user interface is displayed through the second system. Since the interface elements included in the second user interface before and after the system switching are the same, the system switching is realized without the user's perception.
  • the control authority of the interface display is obtained by sending a switching instruction to the first system, and the second system After the system obtains the control authority, the display interface of the wearable device will be controlled by the second system, and the first system can enter a sleep state or a closed state.
  • the wearable device in response to the second system drawing and completing the second user interface, sends a switching instruction to the first system through the second system, and the switching instruction is used to instruct the first system to transfer a graphical user interface (Graphical User Interface, GUI). ) display permission.
  • a graphical user interface Graphical User Interface, GUI
  • the first system needs to transfer the display authority of the graphical user interface to the second system, so that the second system can display the first system to the wearable device during the normal operation of the second system.
  • Two system graphical user interface In a possible implementation manner, after the second system has finished drawing the second user interface, it will send a switching instruction to the first system, instructing the first system to transfer the display authority of the graphical user interface to the second system.
  • the wearable device In response to the second system acquiring the permission to display the graphical user interface, the wearable device displays the second user interface through the second system.
  • the wearable device After the second system obtains the permission to display the graphical user interface, the wearable device will be switched from the first system to the second system, the second user interface will be displayed through the second system, and in the second user interface displayed by the second system, display
  • the interface elements have corresponding functions, such as entering the communication interface by clicking the instant messaging icon.
  • the user interface resources corresponding to the second user interface are stored in the first storage space, so that after the first system receives the system switching instruction, it can be based on the variable interface elements and the fixed interface included in the second user interface.
  • the element accurately acquires the corresponding target interface element resource from the first storage space, and further displays the interface element on the second user interface based on the display position information, which helps to improve the drawing speed and display accuracy of the second user interface.
  • the startup speed of the system switching can be improved visually, and the display delay of the second system displaying the second user interface during the system switching process can be reduced.
  • the display authority of the GUI display is obtained by sending a switching instruction to the first system, so as to ensure that the second system displays the GUI to the wearable device during normal operation.
  • the user interface resources stored in the first storage space also need to be updated accordingly.
  • the second system when the second system is in a wake-up state or restarts, the second system automatically sends interface resource update data to the first system (when there is an interface resource update event), and the first system is based on the interface
  • the resource update data updates the user interface resources stored in the first storage space.
  • the user interface resource update data includes at least the interface element resource corresponding to the interface element to be updated.
  • FIG. 7 shows a flowchart of a user interface resource updating process provided by an exemplary embodiment of the present application.
  • the method may include the following steps.
  • Step 701 when the second system is in an awake state, send interface resource update data to the first system through the second system, and the interface resource update data adopts the data format agreed by the first system and the second system.
  • Interface resource update data, and interface resource change events include at least one of interface element addition and deletion events, interface element position adjustment events, and system setting change events.
  • the system setting change events include system language change, system text font change, system text font size change, system style change, etc., which are not limited in this embodiment.
  • interface resource update data needs to be sent to the first system, so as to ensure the consistency of interface resources corresponding to the second user interface in the first system and the second system sex.
  • the interface resource update data corresponding to the second user interface is encoded into a byte stream according to an agreed protocol, and the byte stream is packaged and sent to a data link through a data link.
  • the interface resource update data adopts the data format agreed by the first system and the second system.
  • the format of the data sent by the second system to the first system is as follows.
  • the first system After receiving the data packet sent by the second system, the first system decodes the data packet according to the protocol agreed with the second system, and obtains user interface resources corresponding to the updated second user interface.
  • Step 702 based on the interface resource update data, update the user interface resources stored in the first storage space through the first system.
  • the first system After receiving the interface resource update data, the first system will associate and store the updated interface element and the updated interface element resource, and in the subsequent system switching process, the first system can perform a second user operation based on the updated interface element resource.
  • the interface is drawn and displayed to ensure that the displayed second user interface is consistent with the user interface of the second system.
  • interface element UI Element Resources instant messaging icon Interface element resource A' Alarm clock icon Interface element resource B' weather icon Interface element resource C Sports Health Icons Interface element resource D
  • the interface element resource A and interface element resource B corresponding to the instant messaging icon and the alarm clock icon are updated, and the first system obtains the updated interface based on the received interface resource update data.
  • Element resource A' and interface element resource B' are updated, and the first system obtains the updated interface based on the received interface resource update data.
  • the first user interface 81 is displayed when the RTOS is in a working state, and when system switching is required, the system switching is performed through a sliding operation, and the first system draws and displays the first user interface based on the updated user interface resources.
  • the second user interface 82, the interface elements displayed in the second user interface 82 are updated from the Chinese state to the English state.
  • the first system sends an update completion notification to the second system, informing the second system that the update of the user interface resources has been completed. If the second system does not receive the update completion notification within the preset time period, it re-sends the update data packet to the first system.
  • the data package updated by the second system to the first system includes interface element resources corresponding to all interface elements in the second user interface.
  • the system language of the wearable device changes At this time, most of the user interface resources stored in the first storage space may be invalid. Therefore, in order to release the first storage space and ensure the accuracy of subsequent user interface resource updates, when receiving the update data package of the first system, the A system will delete the user interface resources in the first storage space, directly decode the received update data package, and obtain the user interface resources corresponding to the updated second user interface package.
  • the Android system sends update data to the first RTOS. package, the update data package contains the user interface resources corresponding to the updated second user interface, when the RTOS receives the data data package, it is determined that the second user interface has changed, that is, the user interface resources included in the first storage space are deleted, Decoding is performed according to the received data packet, and the updated user interface resource is obtained and stored in the first storage space.
  • a notification of completion of the update is sent to the Android system.
  • the second system when the user interface resource is updated, the second system sends the updated user interface resource to the first system by confirming the interface resource change event, and the first system records the user interface stored in the first storage space.
  • the resources are updated to ensure that the second user interface displayed by the first system is consistent with the second user interface displayed by the second system during subsequent system switching, thereby realizing non-perceptual switching.
  • FIG. 10 shows a structural block diagram of a user interface display apparatus provided by an embodiment of the present application.
  • the apparatus can be implemented as all or a part of the wearable device through software, hardware or a combination of the two.
  • the device includes:
  • the first system module 1001 is configured to display the first user interface through the first system when the first system is in an awake state and the second system is in a dormant state;
  • the first system module 1001 is further configured to, in response to a system switching instruction, draw and display a second user interface through the first system, where the second user interface is the user interface of the second system;
  • the second system module 1002 is configured to display the second user interface through the second system in response to the completion of the drawing of the second user interface by the second system.
  • the first system module 1001 is specifically used for:
  • the second user interface is displayed by the first system.
  • the first system module 1001 is specifically configured to: the user interface resources include interface element resources corresponding to interface elements and display position information;
  • the first system module 1001 is specifically used for:
  • the interface element is displayed at the interface element position indicated by the display position information to obtain the second user interface.
  • the first system module 1001 is specifically used for:
  • a target interface element resource corresponding to the variable interface element is determined based on the current moment, wherein the variable interface element corresponds to at least two interface element resources, and different interface elements Resources correspond to different display periods;
  • variable interface element is drawn based on the target interface element resource.
  • the first system module 1001 is specifically configured to: the system switching instruction is triggered by a sliding operation;
  • the first system module 1001 is specifically used for:
  • the second system module 1002 is further configured to:
  • the second user interface is displayed by the second system in response to the second system drawing the second user interface and ending the sliding operation.
  • the second system module 1002 is further configured to:
  • the user interface resource stored in the first storage space is updated by the first system.
  • the second system module 1002 is further used for:
  • the interface resource update data is sent to the first system through the second system, where the interface resource change event includes additions and deletions of interface elements At least one of an event, an interface element position adjustment event, and a system setting change event.
  • the second system module 1002 is further used for:
  • the second user interface is displayed by the second system in response to the second system acquiring the display authority of the graphical user interface.
  • the wearable device is provided with a first processor and a second processor, the power consumption of the second processor is higher than the power consumption of the first processor, and the first system is A system run by the first processor and the second system is a system run by the second processor.
  • the first system if the first system is in the running state and the second system is in the dormant state, if a system switching instruction is received, the first system The system draws and displays the second user interface, and after the second system draws the second user interface, the second user interface is displayed through the second system; using the solution provided by the embodiment of the present application, the second user interface is pre-displayed through the first system
  • the interface can improve the startup speed of the visual system switching, and reduce the display delay of the second system displaying the second user interface during the system switching process.
  • the user interface resources corresponding to the second user interface are stored in the first storage space, so that after the first system receives the system switching instruction, it can be based on the variable interface elements and the fixed interface included in the second user interface.
  • the element accurately acquires the corresponding target interface element resource from the first storage space, and further displays the interface element on the second user interface based on the display position information, which helps to improve the drawing speed and display accuracy of the second user interface.
  • the startup speed of the system switching can be improved visually, and the display delay of the second system displaying the second user interface during the system switching process can be reduced.
  • the display authority of the GUI display is obtained by sending a switching instruction to the first system, so as to ensure that the second system displays the GUI to the wearable device during normal operation.
  • the second system when the user interface resource is updated, the second system sends the updated user interface resource to the first system by confirming the interface resource change event, and the first system updates the user interface stored in the first storage space.
  • the resources are updated to ensure that the second user interface displayed by the first system is consistent with the second user interface displayed by the second system during subsequent system switching, thereby realizing non-perceptual switching.
  • FIG. 11 shows a structural block diagram of a wearable device provided by an exemplary embodiment of the present application.
  • the wearable device in this application may include one or more of the following components: a processor 1110 and a memory 1120 .
  • the processor 1110 includes at least a first processor 1111 and a second processor 1112, wherein the first processor 1111 is used to run the first system, the second processor 1112 is used to run the second system, and the first processor 1111 is used to run the second system.
  • the power consumption is lower than the power consumption of the second processor 1112
  • the performance of the first processor 1111 is lower than that of the second processor 1112 .
  • the processor 1110 uses various interfaces and lines to connect various parts in the entire electronic device, and executes the electronic device by running or executing the instructions, programs, code sets or instruction sets stored in the memory 1120, and calling the data stored in the memory 1120. Various functions of the device and processing data.
  • the processor 1110 may adopt at least one of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA).
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA programmable logic array
  • the processor 1111 can integrate one or more of a central processing unit (Central Processing Unit, CPU), a graphics processor (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU), and a modem, etc.
  • the CPU mainly handles the operating system, user interface and applications;
  • the GPU is used to render and draw the content that needs to be displayed on the touch screen;
  • NPU is used to implement artificial intelligence (AI) functions;
  • the modem is used to process Wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1110, but is implemented by a single chip.
  • the memory 1120 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory, ROM).
  • the storage 1120 includes a non-transitory computer-readable storage medium.
  • Memory 1120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions.
  • the memory 1120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the following various method embodiments; the storage data area may store data (such as audio data, phone book) and the like created according to the use of the wearable device.
  • the wearable device in this embodiment of the present application further includes a communication component 1130 and a display component 1140 .
  • the communication component 1130 may be a Bluetooth component, a WiFi component, a Near Field Communication (NFC) component, etc., for communicating with an external device (server or other terminal device) through a wired or wireless network;
  • the display component 1140 is used for displaying a graphical user interface, and/or receiving user interaction operations.
  • the structure of the wearable device shown in the above drawings does not constitute a limitation on the wearable device, and the wearable device may include more or less than shown in the figure. components, or a combination of certain components, or a different arrangement of components.
  • the wearable device also includes components such as a radio frequency circuit, an input unit, a sensor, an audio circuit, a speaker, a microphone, and a power supply, which will not be repeated here.
  • Embodiments of the present application further provide a computer-readable storage medium, where the storage medium stores at least one instruction, where the at least one instruction is used to be executed by a processor to implement the method for displaying a user interface as described in the foregoing embodiments.
  • Embodiments of the present application provide a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method for displaying the user interface provided by the above embodiments.
  • Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another.
  • a storage medium can be any available medium that can be accessed by a general purpose or special purpose computer.

Abstract

一种用户界面的显示方法、装置、设备及存储介质,属于可穿戴式设备领域。包括:在第一系统处于唤醒状态,且第二系统处于休眠状态的情况下,通过第一系统显示第一用户界面(301);响应于系统切换指令,通过第一系统绘制并显示第二用户界面,第二用户界面为第二系统的用户界面(302);响应于第二系统绘制完成第二用户界面,通过第二系统显示第二用户界面(303)。通过第一系统展示第二用户界面,能够提升视觉上系统切换的启动速度,降低系统切换过程中第二系统显示第二用户界面的显示延迟。

Description

用户界面的显示方法、装置、设备及存储介质
本申请要求于2021年04月06日提交的申请号为202110367131.3、发明名称为“用户界面的显示方法、装置、设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及可穿戴式设备领域,特别涉及一种用户界面的显示方法、装置、设备及存储介质。
背景技术
可穿戴式设备是一种可以直接穿戴或者整合在衣服或配件上的便携式电子设备,常见的可穿戴式设备包括智能手表、智能手环、智能眼镜等等。
以可穿戴式设备为智能手表为例,用户可以使用可穿戴式设备查看时间,使用可穿戴式设备中安装的应用程序实现睡眠质量监测、运动统计以及通知消息查看等功能。
发明内容
本申请实施例提供了一种用户界面的显示方法、装置、设备及存储介质。所述技术方案如下:
一方面,本申请实施例提供了一种用户界面的显示方法,所述方法用于可穿戴式设备,所述可穿戴式设备支持运行第一系统和第二系统;
所述方法包括:
在所述第一系统处于唤醒状态,且所述第二系统处于休眠状态的情况下,通过所述第一系统显示第一用户界面;
响应于系统切换指令,通过所述第一系统绘制并显示第二用户界面,所述第二用户界面为所述第二系统的用户界面;
响应于所述第二系统绘制完成所述第二用户界面,通过所述第二系统显示所述第二用户界面。
另一方面,本申请实施例提供了一种用户界面的显示装置,所述装置用于可穿戴式设备,所述可穿戴式设备支持运行第一系统和第二系统;
所述装置包括:
第一系统模块,用于在所述第一系统处于唤醒状态,且所述第二系统处于休眠状态的情况下,通过所述第一系统显示第一用户界面;
所述第一系统模块,还用于响应于系统切换指令,通过所述第一系统绘制并显示第二用户界面,所述第二用户界面为所述第二系统的用户界面;
第二系统模块,用于响应于所述第二系统绘制完成所述第二用户界面,通过所述第二系统显示所述第二用户界面。
另一方面,本申请实施例提供了一种可穿戴式设备,所述可穿戴式设备包括处理器和存储器;所述存储器存储有至少一条指令,所述至少一条指令用于被所述处理器执行以实现上述方面所述的用户界面的显示方法。
另一方面,本申请实施例提供了一种计算机可读存储介质,所述存储介质存储有至少一条指令,所述至少一条指令用于被处理器执行以实现如上述方面所述的用户界面的显示方法。
另一方面,本申请实施例提供了一种计算机程序产品或计算机程序,该计算机程序产品或计算机程序包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的 处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述方面提供的用户界面的显示方法。
附图说明
图1是本申请一个示例性实施例示出的第二处理器对应双核通信软件框架的示意图;
图2是本申请一个示例性实施例示出的第一处理器对应双核通信软件框架的示意图;
图3示出了本申请一个示例性实施例提供的用户界面的显示方法的流程图;
图4是本申请一个示例性实施例示出的智能手表中系统切换过程的用户界面示意图;
图5示出了本申请另一个示例性实施例提供的用户界面的显示方法的流程图;
图6是本申请一个示例性实施例示出的智能手表中第二用户界面的示意图;
图7示出了本申请一个示例性实施例提供的用户界面资源更新过程的流程图;
图8是本申请一个示例性实施例示出的智能手表中系统切换过程的用户界面示意图;
图9是本申请一个示例性实施例示出的用户界面资源更新过程的系统交互时序图;
图10示出了本申请另一个实施例提供的用户界面的显示装置的结构框图;
图11示出了本申请一个示例性实施例提供的可穿戴式设备的结构方框图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。
在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
相关技术中,可穿戴式设备中设置有单一处理器,并通过运行在处理器上的操作系统,对设备运行过程中产生的所有系统事件进行处理,因此该处理器需要具备较强的数据处理能力,并在设备运行过程中保持工作状态。然而,在日常使用过程中,可穿戴式设备在大多数情况下只需要实现一些对处理性能要求较低的功能,比如,对于智能手表或智能手环来说,大多数情况下,智能手表或智能手环只需要进行时间显示和消息提示。因此,长时间保持处理器处于工作状态并不会提高可穿戴式设备的性能,反而会增加设备功耗,导致可穿戴式设备的续航时间较短。
为了在保证可穿戴式设备性能的同时,降低可穿戴式设备的功耗,在一种可能的实施方式中,可穿戴式设备至少设置具有不同处理性能以及功耗的第一处理器和第二处理器,分别用于运行第一系统和第二系统(即双核双系统),并为双核双系统设计了一套系统切换机制。
可穿戴式设备运行过程中,通过运行在低功耗处理器上的第一系统,对低性能处理需求的事件进行处理,并保持高功耗处理器处于休眠状态(相应的,由高功耗处理器运行的第二系统处于休眠状态),在实现可穿戴式设备基础功能的同时,降低可穿戴式设备的功耗;当存在高性能处理需求的事件时(比如启动应用程序时),通过唤醒高功耗处理器,并切换第二系统对事件进行处理,保证触发的事件能够被及时响应并处理,满足可穿戴式设备的性能需求。
并且,由于高功耗处理器从休眠状态切换为唤醒状态需要耗费一定时间(至少需要200ms至300ms),因此为了降低切换系统过程中系统画面的显示延迟,本申请引入了系统切换效果预展示机制,在高功耗处理器切换唤醒的情况下,由低功耗处理器运行的第一系统绘制并展示第二用户界面;当高功耗处理器绘制完第二用户界面后,再由高功耗处理器运行的第二系统接收用户界面展示权限,实现系统切换的预展示,从而提升视觉上系统切换的启动速度,降低系统切换过程中用户界面的显示延迟。
本申请实施例中,由于第一处理器和第二处理器异步工作,且第一系统和第二系统需要 实现系统通信(或称为双核通信)。在一种可能的应用场景下,第一系统为运行在微控制单元(Micro Controller Unit,MCU)上的实时操作系统(Real Time Operating System,RTOS),且第二系统为运行在中央处理器(Central Processing Unit,CPU)上的安卓(Android)操作系统。
如图1所示,其示出了本申请一个示例性实施例示出的安卓操作系统的双核通信软件框架。该双核通信软件框架遵循“低耦合,高可靠,高复用”的设计原则,包括Kernel(内核)、HIDL(硬件抽象层接口描述语言)、Native Service(本地服务)、Framework Service(框架服务)、Framework API(框架接口)和APP(应用)部分的模块开发。
其中,APP模块包括Launcher(桌面启动器)、Setting(设置)和SystemUI(系统用户界面)等功能模,Framework API模块中包括MCUManager(MCU管理)、SensorManager(传感器管理)、LocationManager(位置管理)等管理模块,Framework Service模块中包括MCUManagerService(MCU管理服务)、SystemSensorManager(系统传感器管理)、LocationManagerService(位置管理服务)等服务模块,Native Service模块包括dccservice(dcc服务)、Sensorservice(传感器服务)等服务模块,HIDL模块包括Sensor HAL(传感器硬件抽象层)、GPS HAL(全球定位系统硬件抽象层)等模块。Kernel模块包括dcc_datah、dcc_data、Mcu_sensor、Mcu_gps、Mcu_factory等DCC Transfer Driver(DCC传输驱动)。
传输层作为双核通信软件框架中衔接上下层的接口层,向应用层屏蔽系统下层(数据链路层)通信的传输细节,为应用场景提供服务通道;应用层作为服务提供的主体,响应于人机交互并通过传输层对人机交互过程中产生的数据进行传输,以及对外部数据请求进行响应。
RTOS采用对等原则进行设计。以可穿戴式设备为智能手表为例,如图2所示,其示出了本申请一个示例性实施例示出的RTOS的双核通信软件框架。
RTOS的双核通信软件框架分为应用层(Application Layer)、服务层(Service Layer)、框架层(Framework Layer)、硬件抽象层(Hardware abstraction layer)和平台层(PlatformLayer)。
其中,应用层包括watch face(表盘)、Daily Tracker(日常追踪)、Message center(消息中心)、Voice around Apps(声音应用)、Health Apps(健康应用)、Settings(设置)等应用模块;服务层包括Sport&health task(运动健康任务)、System manager task(系统管理任务)、AMS(活动管理服务)、AudioService(音频服务)、Log Service(日志服务)、OFTP Service(Odette文件传输协议服务)、BT Service(蓝牙服务)、Delegate Service(转交服务)、RPC Service(远程调用服务)、sensor Service(传感器服务)、storage Service(存储服务)等服务模块;框架层包括Message Pub(消息中心)、UI Framework(用户界面框架)、G2D Engine(G2D殷勤)、Audio Middleware(音频中间件)、Preference(偏好)、File system(文件系统)、Algorithms(算法)、Aios、AsycEvent(进程内异步事件)等框架模块;硬件抽象层包括Screen/TP(屏幕/触控屏)、Audio(音频)、GPS(全球定位系统)、sensors(传感器)、Keypad(键盘)、Motor(马达)等硬件抽象模块;平台层包括板级支持包(Board Support Package,BSP)以及低等级驱动(LOW level Driver),其中,BSP包括Screen/TP、Keys(按键)、GPS、Codec(编码译码器)、sensors、Flash(闪存)、Motor、PSRAM(伪静态随机存储器)等等,低等级驱动包括Uart(通用异步收发传输器)、ADC(模数转换器)、GPIO(通用输入输出)、SPI(串行外设接口)、I2C(集成电路总线)、IOS(输入输出系统)、PCM(脉冲编码调制)、I2S(集成音频总线)、HWTimer(硬件定时器)。
需要说明的是,上述双核通信软件框架仅用于示意性说明,本领域技术人员还可以根据实际需求,对上述框架进行增加、删除或修改,本申请实施例并不对双核通信软件框架的具体结构构成限定。
本申请实施例提供的用户界面显示方法包括:
该方法用于可穿戴式设备,可穿戴式设备支持运行第一系统和第二系统;
在第一系统处于唤醒状态,且第二系统处于休眠状态的情况下,通过第一系统显示第一用户界面;
响应于系统切换指令,通过第一系统绘制并显示第二用户界面,第二用户界面为第二系统的用户界面;
响应于第二系统绘制完成第二用户界面,通过第二系统显示第二用户界面。
可选的,响应于系统切换指令,通过第一系统绘制并显示第二用户界面,包括:
响应于系统切换指令,通过第一系统从第一存储空间获取第二用户界面对应的用户界面资源,第一存储空间为第一系统对应的存储空间;
基于用户界面资源,通过第一系统绘制第二用户界面;
通过第一系统显示第二用户界面。
可选的,用户界面资源中包含界面元素对应的界面元素资源以及显示位置信息;
基于用户界面资源,通过第一系统绘制第二用户界面,包括:
基于界面元素资源绘制界面元素;
将界面元素显示在显示位置信息所指示的界面元素位置,得到第二用户界面。
可选的,基于界面元素资源绘制界面元素,包括:
响应于界面元素中包含可变界面元素,基于当前时刻确定可变界面元素对应的目标界面元素资源,其中,可变界面元素对应至少两种界面元素资源,且不同界面元素资源对应不同显示时段;
基于目标界面元素资源绘制可变界面元素。
可选的,系统切换指令通过滑动操作触发;
通过第一系统显示第二用户界面,包括:
基于滑动操作的滑动方向,通过第一系统显示由第一用户界面切换为第二用户界面的切换动画;
响应于第二系统绘制完成第二用户界面,通过第二系统显示第二用户界面,包括:
响应于第二系统绘制完成第二用户界面且滑动操作结束,通过第二系统显示第二用户界面。
可选的,方法还包括:
在第二系统处于唤醒状态的情况下,通过第二系统向第一系统发送界面资源更新数据,界面资源更新数据采用第一系统与第二系统约定的数据格式;或,
在第二系统重启后,通过第二系统向第一系统发送界面资源更新数据;
基于界面资源更新数据,通过第一系统更新第一存储空间中存储的用户界面资源。
可选的,在第二系统处于唤醒状态的情况下,通过第二系统向第一系统发送界面资源更新数据,包括:
在第二系统处于唤醒状态的情况下,响应于界面资源变更事件,通过第二系统向第一系统发送界面资源更新数据,界面资源变更事件包括界面元素增删事件、界面元素位置调整事件和系统设置变更事件中的至少一种。
可选的,通过第二系统显示第二用户界面,包括:
通过第二系统向第一系统发送切换指令,切换指令用于指示第一系统转移图形用户界面的展示权限;
响应于第二系统获取到图形用户界面的展示权限,通过第二系统显示第二用户界面。
可选的,可穿戴式设备设置有第一处理器和第二处理器,第二处理器的功耗高于第一处理器的功耗,且第一系统是由第一处理器运行的系统,第二系统是由第二处理器运行的系统。
请参考图3,其示出了本申请一个示例性实施例提供的用户界面的用户界面显示方法的流程图,本实施例以该方法应用可穿戴式设备,且可穿戴式设备支持运行第一系统和第二系 统为例进行说明,该方法可以包括如下步骤。
步骤301,在第一系统处于唤醒状态,且第二系统处于休眠状态的情况下,通过第一系统显示第一用户界面。
在一种可能的实施方式中,可穿戴式设备设置有第一处理器和第二处理器,其中,第一处理器的处理性能低于第二处理器的处理性能(第一处理器的处理能力和处理速度均低于第二处理器),且第一处理器的功耗低于第二处理器的功耗。相应的,第二系统(由第二处理器运行)能够处理第一系统(由第一处理器运行)所处理的事件,而第一系统并不一定能够处理第二系统所处理的事件。
在另一种可能的实施方式中,可穿戴式设备也可以设置单一处理器,第一系统和第二系统分别运行在处理器的不同核心上,其中,运行第二系统的核心的处理性能高于运行第一系统的核心的处理性能。
比如,以可穿戴式设备为智能手表为例,第一处理器为MCU,第二处理器为CPU,第一系统为RTOS,第二系统为安卓系统。相应的,第一系统所能处理的事件包括表盘显示、表盘界面切换、通知消息显示等对处理性能要求较低的场景或弱交互场景;第二系统所能处理的事件包括来电接听、启动应用、表盘编辑、功能设置等对处理性能要求较高的场景或强交互场景。
在一种可能的实施方式中,可穿戴式设备的工作模式包括性能模式、混动模式和低功耗模式,其中,性能模式下,第二处理器和第一处理器均保持唤醒状态(相应的,第一系统和第二系统均处于唤醒状态);低功耗模式下,仅第一处理器保持唤醒状态(正常工作状态),而第二处理器保持关闭状态(即第一系统处于唤醒状态,第二系统处于关闭状态);混动模式下,第一系统处理事件时,第二处理器保持休眠状态,第二处理器处于待机状态,可以在休眠和唤醒状态之间切换(即第一系统处于唤醒状态时,第二系统既可以处于唤醒状态,又可以处于休眠状态)。
可选的,唤醒状态下,系统相关数据缓存在内存(RAM)中,以便于随时运行系统相关数据,休眠状态下,处理器大部分硬件模块关闭,系统相关数据存储在硬盘(ROM)中,并在切换为唤醒状态时由硬盘写入内存中。
不同于智能手机一类具有强交互属性的电子设备,可穿戴式设备作为一种辅助性的电子设备,在绝大多数使用场景下与用户之间仅存在弱交互。比如,用户在大部分场景下仅通过智能手表进行抬腕查看时。因此,可穿戴式设备通过第一系统对事件进行处理时,控制第二处理器处于休眠状态(第二系统处于休眠状态),从而降低可穿戴式设备的整体功耗。
步骤302,响应于系统切换指令,通过第一系统绘制并显示第二用户界面,第二用户界面为第二系统的用户界面。
其中,系统切换指令用于指示切换前台运行的系统,即需要将前台运行的系统由第一系统切换为第二系统,而非单纯将处于休眠状态的第二系统切换为唤醒状态,相应的,可穿戴式设备的图形用户界面的展示权限将由第一系统切换为第二系统。
在一些可能的应用场景下,当用户需要使用第一系统显示的第一用户界面中不具备的功能时,用户需要将第一系统切换为第二系统,从第二系统显示的第二用户界面中选择需要使用的功能。
在第一系统处于唤醒状态(可穿戴式设备的界面为第一系统显示的第一用户界面),且第二系统处于休眠状态的情况下,当接收系统切换指令时,表明需要将第一系统切换为第二系统,由于第一系统并不具备处理相应事件的功能和能力,因此需要唤醒处于休眠状态的第二系统,从而通过第二系统进行处理。
然而,由于第二系统的唤醒和显示的过程需要花费一定时间(至少需要200ms至300ms),因此在系统切换的过程中会出现短暂无响应现象(表现为接收到系统切换指令到显示切换动画之间存在一定延迟,第二系统在该延迟时间内唤醒,并通过第二系统完成第二用户界面绘 制显示),影响使用体验。本申请实施例中,为了降低系统切换过程中第二用户界面的显示延迟,当在第一系统运行过程中接收到切换第二系统的系统切换指令时,首先通过第一系统绘制第二系统的第二用户界面并进行显示(仅负责绘制界面图像,并非在第一系统下执行第二系统所具备的特定功能,如第二用户界面显示有应用图标,第一系统只是显示应用图标,但是该应用图标并不具备启动应用的功能)。
可选的,系统切换指令为通过快捷键(比如可穿戴式设备上设置的物理按键)触发的指令,或者通过滑动(比如通过单指或双指滑动可穿戴式设备的显示界面)触发的指令,或者通过点击(比如通过单击或双击可穿戴式设备的显示界面)触发的指令;第二用户界面可以显示有运动健康图标、即时通讯图标、闹钟图标、天气图标、语音助手等图标,且显示的第二用户界面可以为静态界面,也可以是动态界面。本申请实施例并不对系统切换指令的触发方式、第二用户界面显示的内容进行限定。
由于第一系统处于唤醒状态,因此第一系统在接收到系统切换指令后可以立即进行第二用户界面绘制并显示,从而实现视觉上提升系统切换速度。
在一种可能的实施方式中,为了实现界面的平滑切换,当第一系统绘制出第二用户界面后,采用滑动显示的方式逐渐替代第一用户界面,直至完全显示出第二用户界面,可选的,第二用户界面还可以是旋转显示或劈裂方式显示,本申请实施例不对第二用户界面的具体显示方式进行限定。
示意性的,如图4所示,以可穿戴式设备为智能手表为例,智能手表中设置有RTOS(由第一处理器运行)和安卓系统(由第二处理器运行)。第一处理器处于唤醒状态,而第二处理器处理休眠状态时,智能手表通过RTOS显示第一用户界面41,安卓系统处于休眠状态,从而保持较低的功耗。当用户需要将RTOS切换为安卓系统时,可以通过滑动操作触发系统切换指令。相应的,RTOS接收到系统切换指令后,绘制并显示安卓系统的第二用户界面42并进行显示。
步骤303,响应于第二系统绘制完成第二用户界面,通过第二系统显示第二用户界面。
第二系统完成第二用户界面绘制后,可穿戴式设备运行的系统即由第一系统切换为第二系统,从而通过第二系统对第二用户界面进行显示,并执行相应的功能,如,用户需要使用通话功能时,通过触发第二用户界面上的即时通讯应用进入通讯界面。由于第一系统和第二系统绘制并显示的第二用户界面保持一致,因此并不会出现系统切换前后画面突变的问题,使系统切换过程不易被察觉。
可选的,切换至第二系统后,第一系统仍旧在后续处于唤醒状态(低功耗,对续航影响较小),或者第一系统切换为休眠状态,本实施例对此不作限定。
在一种可能的实施方式中,为了确保第一系统绘制并完全显示第二用户界面后,系统及时切换为第二系统,避免出现第一系统完全显示出第二用户界面后,用户点击图标无响应的情况(此时的第二用户界面由第一系统绘制并显示),根据第二系统唤醒并绘制出第二用户界面的时间确定第二用户界面的滑动速度,确保第一用户绘制的第二用户界面完全占据可穿戴式设备的显示界面时,第二系统已绘制出第二用户界面,在用户无感知情况下实现系统切换。
示意性的,如图4所示,RTOS显示第二用户界面42的过程中,第二用户界面42从左向右滑动显示,直至第一用户界面41完全切换为第二用户界面42,第二用户界面42从左向右滑动显示过程中,安卓系统由休眠状态切换为唤醒状态,当安卓系统唤醒并绘制完成后(比如经过200ms),智能手表运行的系统由RTOS切换为安卓系统,并通过安卓系统显示第二用户界面43。
可选的,第二系统完成事件处理后(比如通话结束返回表盘),第二系统重新切换回休眠状态,并继续通过第一系统处理事件,使可穿戴式设备在少部分场景下保持高性能(但是高功耗),而在大多数场景下保持低功耗(但低性能),进一步降低可穿戴式设备的功耗,延长可穿戴式设备的续航时间。
综上所述,本申请实施例中,对于支持双系统的可穿戴式设备,若在第一系统处于运行状态而第二系统处于休眠状态的情况下,接收到系统切换指令,首先由第一系统绘制并显示第二用户界面,并在第二系统绘制完成第二用户界面后,通过第二系统显示第二用户界面;采用本申请实施例提供的方案,通过第一系统预展示第二用户界面,能够提升视觉上系统切换的启动速度,降低系统切换过程中第二系统显示第二用户界面的显示延迟。
在一种可能的实施方式中,第一系统和第二系统各自对应有数据存储空间,且由于第一系统仅负责处理简单事件,而第二系统则需要处理复杂事件,因此第二系统对应的存储空间远大于第一系统对应的存储空间。为了实现通过第一系统绘制并显示第二用户界面,第一系统对应的存储空间中存储第二用户界面对应的用户界面资源,接收到系统切换指令后,第一系统即基于存储空间中的用户界面资源进行用户界面绘制。下面采用示例性的实施例进行说明。
请参考图5,其示出了本申请另一个示例性实施例提供的用户界面的显示方法的流程图,本实施例以该方法应用可穿戴式设备为例进行说明,该方法可以包括如下步骤。
步骤501,在第一系统处于唤醒状态,且第二系统处于休眠状态的情况下,响应于系统切换指令,通过第一系统从第一存储空间获取第二用户界面对应的用户界面资源,第一存储空间为第一系统对应的存储空间。
本申请实施例中,第一系统对应有第一存储空间,第一存储空间中存储有至少一个用户界面所对应的用户界面资源,该用户界面资源指绘制用户界面所需的资源,该用户界面资源可以包括文字资源、图片资源、动画资源、特效资源、界面布局资源等等,本实施例对界面资源中包含的具体内容不做限定。
在一种可能的实施方式中,第一存储空间中存储有第一系统对应第一用户界面的用户界面资源,以及第二系统对应第二用户界面对应的用户界面资源。比如,第一用户界面为手表表盘时,第一存储空间存储由表盘资源,当第二系统中安装有运动健康应用、闹钟应用、即时通讯应用时,在第二用户界面即显示有对应的运动健康图标、闹钟应用图标、即时通讯图标,相应的,第一存储空间中即存储有各个应用图标对应的图标资源,可选的,第二用户界面还可以显示有桌面挂件和语音助手,相应的,在第一存储空间中也存储有对应的用户界面资源。
在一些实施例中,第一系统基于所需绘制的界面元素,从第一存储空间中查找该界面元素对应的界面元素资源。
在一个示意性的例子中,第一存储空间中界面元素与界面元素资源之间的映射关系如表一所示。
表一
界面元素 界面元素资源
即时通讯图标 界面元素资源A
闹钟图标 界面元素资源B
天气图标 界面元素资源C
运动健康图标 界面元素资源D
如表一所示,当第二用户界面显示有即时通讯应用的图标时,第一系统即从第一存储空间中获取界面元素“即时通讯图标”对应的界面元素资源A。
步骤502,响应于界面元素中包含可变界面元素,基于当前时刻确定可变界面元素对应的目标界面元素资源,其中,可变界面元素对应至少两种界面元素资源,且不同界面元素资源对应不同显示时段。
在根据界面元素获取界面元素资源时,除了需要确定界面元素中的固定界面元素外(例如闹钟应用和即时通讯应用的图标都是固定界面元素),还需要确定出可变界面元素(例如时 间显示挂件和问候语是可变界面元素)。
其中,可变界面元素在不同时段内的表现形式可能不同,即可变界面元素可能对应多个界面元素资源,因此在绘制可变界面元素时,第一系统还需要利用到其他数据,比如时间数据,传感器数据(比如计步器数据)等等,从而保证绘制出的第二用户界面中的界面元素的准确性和一致性,避免出现第一系统和第二系统绘制的界面元素出现差异,出现系统切换时用户界面出现突变的问题。
在一种可能的实施方式中,当需要绘制的界面元素包含有可变界面元素时,第一系统基于当前时刻,从可变界面元素对应的至少两种界面元素资源中确定目标界面元素资源,其中,不同界面元素资源对应不同显示时段,且当前时刻所属的显示时段为目标界面元素资源对应的显示时段。
比如,可变界面元素为问候语,0:00至12:00这一时段对应的界面元素为“早上好”,12:00至17:00这一时段对应的界面元素为“下午好”,“17:00至24:00”这一时段对应的界面元素为“晚上好”。
示意性的,当需要绘制的第二用户界面中包含有问候语时(问候语根据时间段在用户界面显示上午好、下午好和晚上好等文字信息),若当前时间为十点,第一系统将当前时刻所属时段对应的界面元素资源“上午好”确定为目标问候语。
步骤503,基于目标界面元素资源绘制可变界面元素。
进一步的,获取到对应的界面资源后,第一系统即根据确定的目标界面资源绘制对应的界面元素。
在一个示例性的例子中,第一系统获取到界面资源中包含应用图标对应图片资源以及问候语对应的文字资源,从而基于图片资源渲染出应用图标,基于文字资源渲染出问候语。
步骤504,将界面元素显示在显示位置信息所指示的界面元素位置,得到第二用户界面。
第一系统根据用户界面资源中包含的界面元素的位置信息确定第二用户界面中各个界面元素的排列布局,并显示出第二用户界面。
在一种可能的实施方式中,如图6所示,第二用户界面600的上方显示有语音助手610,语音助手610中显示有问候语611,问候语611根据当前时间段显示不同的文字信息,第二用户界面600的下方显示有即时通讯图标620、闹钟图标630、运动健康图标640等应用图标。需要说明的是,此时的第二用户界面600是由第一系统绘制并显示出,显示出的界面元素不具备相应的功能,也就是说,当用户点击即时通信图标620后,不会响应也不会展示通讯界面。
步骤505,基于滑动操作的滑动方向,通过第一系统显示由第一用户界面切换为第二用户界面的切换动画。
第一系统绘制出第二用户界面后,基于滑动操作的滑动方向,将第一用户界面滑动切换为第二用户界面,其中滑动操作的滑动方向由用户在第二系统下设定,如采用左右切换、飞入和劈裂等切换动画。
示意性的,如图4所示,第一系统绘制出的第二用户界面402采用左右切换的方式进行切换。需要说明的是,本实施例不对用户界面的切换动画进行限定。
步骤506,响应于第二系统绘制完成第二用户界面且滑动操作结束,通过第二系统显示第二用户界面。
当第二用户界面滑动结束,即由第一用户界面切换为第二用户界面,此时,第二系统已唤醒并绘制出第二用户界面中包含的所有界面元素,将第一系统切换为第二系统,通过第二系统显示第二用户界面,由于系统切换前后的第二用户界面中包含的界面元素相同,因此实现了在用户无感知情况下实现了系统切换。
为了保证系统切换完成后由第二系统控制可穿戴式设备的界面显示,当第二系统绘制完成第二用户界面后,通过向第一系统发送切换指令的方式获取界面显示的控制权限,第二系 统获取到控制权限后,可穿戴式设备的显示界面将由第二系统控制,第一系统可以进入休眠状态或关闭状态。
可选的,响应于第二系统绘制完成第二用户界面,可穿戴式设备通过第二系统向第一系统发送切换指令,切换指令用于指示第一系统转移图形用户界面(Graphical User Interface,GUI)的展示权限。
为了保证第二用户界面的正常使用,在进行系统切换过程中,第一系统需要将图形用户界面的展示权限转移给第二系统,以便第二系统正常运行过程中可以向可穿戴式设备展示第二系统的图形用户界面。在一种可能的实施方式中第二系统绘制完成第二用户界面后,会向第一系统发送切换指令,指示第一系统向第二系统转移图形用户界面的展示权限。
响应于第二系统获取到图形用户界面的展示权限,可穿戴式设备通过第二系统显示第二用户界面。
第二系统获取到图形用户界面的展示权限后,可穿戴式设备将由第一系统切换为第二系统,通过第二系统显示第二用户界面,在第二系统显示的第二用户界面中,显示的界面元素具备相应的功能,如通过点击即时通讯图标进入通讯界面。
本实施例中,通过在第一存储空间中存储第二用户界面对应的用户界面资源,使得第一系统接收到系统切换指令后,能够基于第二用户界面中包含的可变界面元素和固定界面元素从第一存储空间中准确获取对应的目标界面元素资源,进一步的基于显示位置信息在第二用户界面显示界面元素,有助于提高第二用户界面的绘制速度和显示的准确性。
并且,通过第一系统预展示第二用户界面的方式,能够提升视觉上系统切换的启动速度,降低系统切换过程中第二系统显示第二用户界面的显示延迟。
此外,在第二系统完成第二用户界面的绘制后,通过向第一系统发送切换指令获取图形用户界面展的示权限,确保第二系统在正常运行过程中向可穿戴式设备展示图形用户界面。
上述实施例中,由于可穿戴式设备中第二系统的第二用户界面并非保持不变,如调整第二用户界面中界面元素的顺序、添加及删除在第二用户界面显示的界面元素等,因此为了保证切换系统后第二用户界面显示的准确性,第一存储空间中存储的用户界面资源也需要进行相应的更新。在一种可能的实施方式中,在第二系统处于唤醒状态或重启的情况下,第二系统自动向第一系统发送界面资源更新数据(存在界面资源更新事件时),第一系统即基于界面资源更新数据,更新第一存储空间中存储的用户界面资源。其中,该用户界面资源更新数据中至少包括待更新界面元素对应的界面元素资源。
请参考图7,其示出了本申请一个示例性实施例提供的用户界面资源更新过程的流程图,该方法可以包括如下步骤。
步骤701,在第二系统处于唤醒状态的情况下,通过第二系统向第一系统发送界面资源更新数据,界面资源更新数据采用第一系统与第二系统约定的数据格式。
在一种可能的实施方式中,在第二系统处于唤醒状态的情况下,当第二系统检测到界面资源变更事件时,通过连接第一系统和第二系统的数据链路向第一系统发送界面资源更新数据,界面资源变更事件包括界面元素增删事件、界面元素位置调整事件和系统设置变更事件中的至少一种。其中系统设置变更事件包括系统语言变更、系统文字字体变更、系统文字字号变更、系统风格变更等等,本实施例对此不作限定。
在另一种可能的实施方式中,每次第二系统重启后,均需要向第一系统发送界面资源更新数据,以此保证第一系统与第二系统中第二用户界面对应界面资源的一致性。
可选的,当第二系统确定发生界面资源变更事件后,将第二用户界面对应的界面资源更新数据按照约定的协议编码成字节流,并且将字节流打包后通过数据链路发送给第一系统,界面资源更新数据采用第一系统与第二系统约定的数据格式。
在一个示例性的例子中,第二系统向第一系统发送数据的格式如下。
Figure PCTCN2022078423-appb-000001
当第一系统接收到第二系统发送的数据包后,按照与第二系统约定的协议对数据包进行解码,获取更新后第二用户界面对应的用户界面资源。
步骤702,基于界面资源更新数据,通过第一系统更新第一存储空间中存储的用户界面资源。
接收到界面资源更新数据后,第一系统即将更新后的界面元素与更新后的界面元素资源进行关联存储,后续系统切换过程中,第一系统即可基于更新后的界面元素资源进行第二用户界面绘制和显示,保证显示的第二用户界面与第二系统的用户界面保持一致。
结合上述步骤的示例,第一系统基于接收到的数据包更新界面元素资源后,第一存储空间中界面元素与界面元素资源之间的映射关系如表二所示。
表二
界面元素 界面元素资源
即时通讯图标 界面元素资源A’
闹钟图标 界面元素资源B’
天气图标 界面元素资源C
运动健康图标 界面元素资源D
如表二所示,结合上述步骤中的示例,即时通讯图标以及闹钟图标对应的界面元素资源A和界面元素资源B发生更新,第一系统基于接收到的界面资源更新数据,得到更新后的界面元素资源A’和界面元素资源B’。
以语言更新为例,当第二用户界面的显示语言由中文显示更新为英文显示时,将界面元素资源中的中文文本信息更新为英文文本信息。
示意性的,如图8所示,RTOS处于工作状态时显示第一用户界面81,当需要进行系统切换时,通过滑动操作进行系统切换,第一系统基于更新后的用户界面资源绘制并显示第二用户界面82,第二用户界面82中显示的界面元素由中文状态更新为英文状态。
可选的,完成用户界面资源更新后,第一系统向第二系统发送更新完成通知,告知第二系统已完成对用户界面资源的更新。若第二系统在预设时长内未接收到更新完成通知,则重新向第一系统发送更新数据包。
在另一种可能的实施方式中,第二系统向第一系统更新的数据包中包含第二用户界面中所有界面元素对应的界面元素资源,相应的,当可穿戴式设备的系统语言发生变更时,第一存储空间内存储的大部分用户界面资源可能已经无效,因此为了释放第一存储空间,并保证后续用户界面资源更新的准确性,当接收到第一系统的更新数据包时,第一系统将删除第一存储空间中的用户界面资源,直接将接收到的更新数据包进行解码,获取更新后的第二用户界面包对应的用户界面资源。
示意性的,如图9所示,以第一系统为RTOS,第二系统为安卓系统为例,当第二用户界面发生改变,确认发生系统设置变更事件,安卓系统即向第RTOS发送更新数据包,更新数据包中包含更新后的第二用户界面对应的用户界面资源,当RTOS接收到数据数据包时,确定第二用户界面发生改变,即删除第一存储空间中包含的用户界面资源,并根据接收到的数据包进行解码,获取更新后的用户界面资源并存储至第一存储空间,可选的,当RTOS完成更新后,向安卓系统发送完成更新通知。
本实施例中,当用户界面资源更新时,第二系统通过确认界面资源变更事件,从而将更新后的用户界面资源发送至第一系统,由第一系统对第一存储空间中存储的用户界面资源进行更新,确保后续进行系统切换时,第一系统显示的第二用户界面与第二系统显示的第二用户界面保持一致,实现无感知切换。
需要说明的是,上述各个实施例中,仅以双核双系统设备下用户界面的显示过程为例进行说明,在其他可能的应用场景下,单核双系统(比如处理器不同核心上运行不同系统)设备也可以采用本申请实施例提供的方案实现系统切换过程中用户界面的显示,本实施例在此不作赘述。
请参考图10,其示出了本申请一个实施例提供的用户界面显示装置的结构框图。该装置可以通过软件、硬件或者两者的结合实现成为可穿戴式设备的全部或一部分。该装置包括:
第一系统模块1001,用于在第一系统处于唤醒状态,且第二系统处于休眠状态的情况下,通过第一系统显示第一用户界面;
所述第一系统模块1001,还用于响应于系统切换指令,通过所述第一系统绘制并显示第二用户界面,所述第二用户界面为所述第二系统的用户界面;
第二系统模块1002,用于响应于所述第二系统绘制完成所述第二用户界面,通过所述第二系统显示所述第二用户界面。
可选的,所述第一系统模块1001,具体用于:
响应于所述系统切换指令,通过所述第一系统从第一存储空间获取所述第二用户界面对应的用户界面资源,所述第一存储空间为所述第一系统对应的存储空间;
基于所述用户界面资源,通过所述第一系统绘制所述第二用户界面;
通过所述第一系统显示所述第二用户界面。
可选的,所述第一系统模块1001,具体用于:所述用户界面资源中包含界面元素对应的界面元素资源以及显示位置信息;
可选的,所述第一系统模块1001,具体用于:
基于所述界面元素资源绘制所述界面元素;
将所述界面元素显示在所述显示位置信息所指示的界面元素位置,得到所述第二用户界面。
可选的,所述第一系统模块1001,具体用于:
响应于所述界面元素中包含可变界面元素,基于当前时刻确定所述可变界面元素对应的目标界面元素资源,其中,所述可变界面元素对应至少两种界面元素资源,且不同界面元素资源对应不同显示时段;
基于所述目标界面元素资源绘制所述可变界面元素。
可选的,所述第一系统模块1001,具体用于:所述系统切换指令通过滑动操作触发;
可选的,所述第一系统模块1001,具体用于:
基于所述滑动操作的滑动方向,通过所述第一系统显示所述由所述第一用户界面切换为所述第二用户界面的切换动画;
可选的,所述第二系统模块1002,还用于:
响应于所述第二系统绘制完成所述第二用户界面且所述滑动操作结束,通过所述第二系统显示所述第二用户界面。
可选的,所述第二系统模块1002,还用于:
在所述第二系统处于唤醒状态的情况下,通过所述第二系统向所述第一系统发送界面资源更新数据,所述界面资源更新数据采用所述第一系统与所述第二系统约定的数据格式;或,
在所述第二系统重启后,通过所述第二系统向所述第一系统发送界面资源更新数据;
基于所述界面资源更新数据,通过所述第一系统更新所述第一存储空间中存储的所述用户界面资源。
可选的,所述第二系统模块1002,具体还用于:
在所述第二系统处于唤醒状态的情况下,响应于界面资源变更事件,通过所述第二系统向所述第一系统发送所述界面资源更新数据,所述界面资源变更事件包括界面元素增删事件、界面元素位置调整事件和系统设置变更事件中的至少一种。
可选的,所述第二系统模块1002,具体还用于:
通过所述第二系统向所述第一系统发送切换指令,所述切换指令用于指示所述第一系统转移图形用户界面的展示权限;
响应于所述第二系统获取到图形用户界面的展示权限,通过所述第二系统显示所述第二用户界面。
可选的,所述可穿戴式设备设置有第一处理器和第二处理器,所述第二处理器的功耗高于所述第一处理器的功耗,且所述第一系统是由所述第一处理器运行的系统,所述第二系统是由所述第二处理器运行的系统。
综上所述,本申请实施例中,对于支持双系统的可穿戴式设备,若在第一系统处于运行状态而第二系统处于休眠状态的情况下,接收到系统切换指令,首先由第一系统绘制并显示第二用户界面,并在第二系统绘制完成第二用户界面后,通过第二系统显示第二用户界面;采用本申请实施例提供的方案,通过第一系统预展示第二用户界面,能够提升视觉上系统切换的启动速度,降低系统切换过程中第二系统显示第二用户界面的显示延迟。
本实施例中,通过在第一存储空间中存储第二用户界面对应的用户界面资源,使得第一系统接收到系统切换指令后,能够基于第二用户界面中包含的可变界面元素和固定界面元素从第一存储空间中准确获取对应的目标界面元素资源,进一步的基于显示位置信息在第二用户界面显示界面元素,有助于提高第二用户界面的绘制速度和显示的准确性。
并且,通过第一系统预展示第二用户界面的方式,能够提升视觉上系统切换的启动速度,降低系统切换过程中第二系统显示第二用户界面的显示延迟。
此外,在第二系统完成第二用户界面的绘制后,通过向第一系统发送切换指令获取图形用户界面展的示权限,确保第二系统在正常运行过程中向可穿戴式设备展示图形用户界面。
本实施例中,在用户界面资源更新时,第二系统通过确认界面资源变更事件,从而将更新后的用户界面资源发送至第一系统,由第一系统对第一存储空间中存储的用户界面资源进行更新,确保后续进行系统切换时,第一系统显示的第二用户界面与第二系统显示的第二用户界面保持一致,实现无感知切换。
请参考图11,其示出了本申请一个示例性实施例提供的可穿戴式设备的结构方框图。本申请中的可穿戴式设备可以包括一个或多个如下部件:处理器1110和存储器1120。
处理器1110至少包括第一处理器1111和第二处理器1112,其中,第一处理器1111用于运行第一系统,第二处理器1112用于运行第二系统,且第一处理器1111的功耗低于第二处理器1112的功耗,第一处理器1111的性能低于第二处理器1112的性能。处理器1110利用各种接口和线路连接整个电子设备内的各个部分,通过运行或执行存储在存储器1120内的指令、程序、代码集或指令集,以及调用存储在存储器1120内的数据,执行电子设备的各种功能和处理数据。可选地,处理器1110可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器1111可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)、神经网络处理器(Neural-network Processing Unit,NPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责触摸显示屏所需要显示的内容的渲染和绘制;NPU用于实现人工智能(Artificial Intelligence,AI)功能;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器1110中,单独通过一块芯片进行实现。
存储器1120可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory,ROM)。可选地,该存储1120包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器1120可用于存储指令、程序、代码、代码集或指令集。存储器1120可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等;存储数据区可存储根据可穿戴式设备的使用所创建的数据(比如音频数据、电话本)等。
本申请实施例中的可穿戴式设备还包括通信组件1130和显示组件1140。其中,通信组件1130可以为蓝牙组件、WiFi组件、近距离无线通信(Near Field Communication,NFC)组件等等,用于通过有线或无线网络与外部设备(服务器或其他终端设备)进行通信;显示组件1140用于进行图形用户界面展示,和/或,接收用户交互操作。
除此之外,本领域技术人员可以理解,上述附图所示出的可穿戴式设备的结构并不构成对可穿戴式设备的限定,可穿戴式设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。比如,可穿戴式设备中还包括射频电路、输入单元、传感器、音频电路、扬声器、麦克风、电源等部件,在此不再赘述。
本申请实施例还提供了一种计算机可读存储介质,该存储介质存储有至少一条指令,至少一条指令用于被处理器执行以实现如上述实施例所述的用户界面的显示方法。
本申请实施例提供了一种计算机程序产品或计算机程序,该计算机程序产品或计算机程序包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述实施例提供的用户界面的显示方法。
本领域技术人员应该可以意识到,在上述一个或多个示例中,本申请实施例所描述的功能可以用硬件、软件、固件或它们的任意组合来实现。当使用软件实现时,可以将这些功能存储在计算机可读介质中或者作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质,其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是通用或专用计算机能够存取的任何可用介质。
以上所述仅为本申请的可选实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。

Claims (21)

  1. 一种用户界面的显示方法,所述方法用于可穿戴式设备,所述可穿戴式设备支持运行第一系统和第二系统;
    所述方法包括:
    在所述第一系统处于唤醒状态,且所述第二系统处于休眠状态的情况下,通过所述第一系统显示第一用户界面;
    响应于系统切换指令,通过所述第一系统绘制并显示第二用户界面,所述第二用户界面为所述第二系统的用户界面;
    响应于所述第二系统绘制完成所述第二用户界面,通过所述第二系统显示所述第二用户界面。
  2. 根据权利要求1所述的方法,其中,所述响应于系统切换指令,通过所述第一系统绘制并显示第二用户界面,包括:
    响应于所述系统切换指令,通过所述第一系统从第一存储空间获取所述第二用户界面对应的用户界面资源,所述第一存储空间为所述第一系统对应的存储空间;
    基于所述用户界面资源,通过所述第一系统绘制所述第二用户界面;
    通过所述第一系统显示所述第二用户界面。
  3. 根据权利要求2所述的方法,其中,所述用户界面资源中包含界面元素对应的界面元素资源以及显示位置信息;
    所述基于所述用户界面资源,通过所述第一系统绘制所述第二用户界面,包括:
    基于所述界面元素资源绘制所述界面元素;
    将所述界面元素显示在所述显示位置信息所指示的界面元素位置,得到所述第二用户界面。
  4. 根据权利要求3所述的方法,其中,所述基于所述界面元素资源绘制所述界面元素,包括:
    响应于所述界面元素中包含可变界面元素,基于当前时刻确定所述可变界面元素对应的目标界面元素资源,其中,所述可变界面元素对应至少两种界面元素资源,且不同界面元素资源对应不同显示时段;
    基于所述目标界面元素资源绘制所述可变界面元素。
  5. 根据权利要求2所述的方法,其中,所述系统切换指令通过滑动操作触发;
    所述通过所述第一系统显示所述第二用户界面,包括:
    基于所述滑动操作的滑动方向,通过所述第一系统显示所述由所述第一用户界面切换为所述第二用户界面的切换动画;
    所述响应于所述第二系统绘制完成所述第二用户界面,通过所述第二系统显示所述第二用户界面,包括:
    响应于所述第二系统绘制完成所述第二用户界面且所述滑动操作结束,通过所述第二系统显示所述第二用户界面。
  6. 根据权利要求2所述的方法,其中,所述方法还包括:
    在所述第二系统处于唤醒状态的情况下,通过所述第二系统向所述第一系统发送界面资源更新数据,所述界面资源更新数据采用所述第一系统与所述第二系统约定的数据格式;或,
    在所述第二系统重启后,通过所述第二系统向所述第一系统发送界面资源更新数据;
    基于所述界面资源更新数据,通过所述第一系统更新所述第一存储空间中存储的所述用户界面资源。
  7. 根据权利要求6所述的方法,其中,所述在所述第二系统处于唤醒状态的情况下,通过所述第二系统向所述第一系统发送界面资源更新数据,包括:
    在所述第二系统处于唤醒状态的情况下,响应于界面资源变更事件,通过所述第二系统向所述第一系统发送所述界面资源更新数据,所述界面资源变更事件包括界面元素增删事件、界面元素位置调整事件和系统设置变更事件中的至少一种。
  8. 根据权利要求1至7任一所述的方法,其中,所述通过所述第二系统显示所述第二用户界面,包括:
    通过所述第二系统向所述第一系统发送切换指令,所述切换指令用于指示所述第一系统转移图形用户界面的展示权限;
    响应于所述第二系统获取到图形用户界面的展示权限,通过所述第二系统显示所述第二用户界面。
  9. 根据权利要求1至7任一所述的方法,其中,所述可穿戴式设备设置有第一处理器和第二处理器,所述第二处理器的功耗高于所述第一处理器的功耗,且所述第一系统是由所述第一处理器运行的系统,所述第二系统是由所述第二处理器运行的系统。
  10. 一种用户界面的显示装置,所述装置用于可穿戴式设备,所述可穿戴式设备支持运行第一系统和第二系统;
    所述装置包括:
    第一系统模块,用于在所述第一系统处于唤醒状态,且所述第二系统处于休眠状态的情况下,通过所述第一系统显示第一用户界面;
    所述第一系统模块,还用于响应于系统切换指令,通过所述第一系统绘制并显示第二用户界面,所述第二用户界面为所述第二系统的用户界面;
    第二系统模块,用于响应于所述第二系统绘制完成所述第二用户界面,通过所述第二系统显示所述第二用户界面。
  11. 根据权利要求10所述的装置,其中,所述第一系统模块,用于:
    响应于所述系统切换指令,通过所述第一系统从第一存储空间获取所述第二用户界面对应的用户界面资源,所述第一存储空间为所述第一系统对应的存储空间;
    基于所述用户界面资源,通过所述第一系统绘制所述第二用户界面;
    通过所述第一系统显示所述第二用户界面。
  12. 根据权利要求11所述的装置,其中,所述用户界面资源中包含界面元素对应的界面元素资源以及显示位置信息;
    所述第一系统模块,用于:
    基于所述界面元素资源绘制所述界面元素;
    将所述界面元素显示在所述显示位置信息所指示的界面元素位置,得到所述第二用户界面。
  13. 根据权利要求12所述的装置,其中,所述第一系统模块,用于:
    响应于所述界面元素中包含可变界面元素,基于当前时刻确定所述可变界面元素对应的 目标界面元素资源,其中,所述可变界面元素对应至少两种界面元素资源,且不同界面元素资源对应不同显示时段;
    基于所述目标界面元素资源绘制所述可变界面元素。
  14. 根据权利要求11所述的装置,其中,所述系统切换指令通过滑动操作触发;
    所述第一系统模块,用于:
    基于所述滑动操作的滑动方向,通过所述第一系统显示所述由所述第一用户界面切换为所述第二用户界面的切换动画;
    所述第二系统模块,还用于:
    响应于所述第二系统绘制完成所述第二用户界面且所述滑动操作结束,通过所述第二系统显示所述第二用户界面。
  15. 根据权利要求11所述的装置,其中,所述第二系统模块,还用于:
    在所述第二系统处于唤醒状态的情况下,通过所述第二系统向所述第一系统发送界面资源更新数据,所述界面资源更新数据采用所述第一系统与所述第二系统约定的数据格式;或,
    在所述第二系统重启后,通过所述第二系统向所述第一系统发送界面资源更新数据;
    基于所述界面资源更新数据,通过所述第一系统更新所述第一存储空间中存储的所述用户界面资源。
  16. 根据权利要求15所述的装置,其中,所述第二系统模块,还用于:
    在所述第二系统处于唤醒状态的情况下,响应于界面资源变更事件,通过所述第二系统向所述第一系统发送所述界面资源更新数据,所述界面资源变更事件包括界面元素增删事件、界面元素位置调整事件和系统设置变更事件中的至少一种。
  17. 根据权利要求10至16任一所述的装置,其中,所述第二系统模块,还用于:
    通过所述第二系统向所述第一系统发送切换指令,所述切换指令用于指示所述第一系统转移图形用户界面的展示权限;
    响应于所述第二系统获取到图形用户界面的展示权限,通过所述第二系统显示所述第二用户界面。
  18. 根据权利要求10至16任一所述的装置,其中,所述可穿戴式设备设置有第一处理器和第二处理器,所述第二处理器的功耗高于所述第一处理器的功耗,且所述第一系统是由所述第一处理器运行的系统,所述第二系统是由所述第二处理器运行的系统。
  19. 一种可穿戴式设备,所述可穿戴式设备包括处理器和存储器;所述存储器存储有至少一条指令,所述至少一条指令用于被所述处理器执行以实现如权利要求1至9任一所述的用户界面的显示方法。
  20. 一种计算机可读存储介质,所述存储介质存储有至少一条指令,所述至少一条指令用于被处理器执行以实现如权利要求1至9任一所述的用户界面的显示方法。
  21. 一种计算机程序产品或计算机程序,所述计算机程序产品或计算机程序包括计算机指令,所述计算机指令存储在计算机可读存储介质中,处理器从所述计算机可读存储介质读取并执行所述计算机指令,以实现如权利要求1至9任一所述的用户界面的显示方法。
PCT/CN2022/078423 2021-04-06 2022-02-28 用户界面的显示方法、装置、设备及存储介质 WO2022213743A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP22783813.3A EP4321995A1 (en) 2021-04-06 2022-02-28 Display method and apparatus for user interface, and device and storage medium
US18/377,538 US20240045702A1 (en) 2021-04-06 2023-10-06 User interface display method and apparatus, device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110367131.3A CN115167954A (zh) 2021-04-06 2021-04-06 用户界面的显示方法、装置、设备及存储介质
CN202110367131.3 2021-04-06

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/377,538 Continuation US20240045702A1 (en) 2021-04-06 2023-10-06 User interface display method and apparatus, device, and storage medium

Publications (1)

Publication Number Publication Date
WO2022213743A1 true WO2022213743A1 (zh) 2022-10-13

Family

ID=83475991

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/078423 WO2022213743A1 (zh) 2021-04-06 2022-02-28 用户界面的显示方法、装置、设备及存储介质

Country Status (4)

Country Link
US (1) US20240045702A1 (zh)
EP (1) EP4321995A1 (zh)
CN (1) CN115167954A (zh)
WO (1) WO2022213743A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110066888A1 (en) * 2009-09-11 2011-03-17 Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. System and method for testing sleep and wake functions of computer
CN103064645A (zh) * 2011-10-21 2013-04-24 联想(北京)有限公司 显示方法和电子设备
CN107908447A (zh) * 2017-10-31 2018-04-13 北京小鸟看看科技有限公司 应用切换方法、设备及虚拟现实设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110066888A1 (en) * 2009-09-11 2011-03-17 Hong Fu Jin Precision Industry (Shenzhen) Co., Ltd. System and method for testing sleep and wake functions of computer
CN103064645A (zh) * 2011-10-21 2013-04-24 联想(北京)有限公司 显示方法和电子设备
CN107908447A (zh) * 2017-10-31 2018-04-13 北京小鸟看看科技有限公司 应用切换方法、设备及虚拟现实设备

Also Published As

Publication number Publication date
CN115167954A (zh) 2022-10-11
US20240045702A1 (en) 2024-02-08
EP4321995A1 (en) 2024-02-14

Similar Documents

Publication Publication Date Title
KR102148948B1 (ko) 전자 장치의 멀티 태스킹 방법 및 그 전자 장치
US20170215051A1 (en) Remote access to a mobile communication device over a wireless local area network (wlan)
WO2018233631A1 (zh) 一种终端设备的控制方法、存储介质及终端设备
US20230324974A1 (en) Method for system switching, wearable device, and storage medium
WO2021042881A1 (zh) 消息通知方法及电子设备
WO2022218107A1 (zh) 数据传输方法、装置、设备及存储介质
WO2022213743A1 (zh) 用户界面的显示方法、装置、设备及存储介质
WO2023124634A1 (zh) 显示方法、装置、电子设备及存储介质
WO2022252906A1 (zh) 界面显示方法、装置、终端设备及计算机可读存储介质
WO2022213757A1 (zh) 应用界面的显示方法、装置、设备及存储介质
WO2023124554A1 (zh) 应用启动方法、装置、设备及存储介质
WO2023116237A1 (zh) 界面显示方法、装置、设备、存储介质及程序产品
WO2023185152A1 (zh) 来电处理方法、装置、设备及存储介质
WO2023116236A1 (zh) 应用启动方法、装置、设备及存储介质
WO2023124622A1 (zh) 通信连接的维持方法、装置、设备、存储介质及程序产品
WO2024032140A1 (zh) 息屏显示方法、装置、设备及存储介质
WO2022218106A1 (zh) 数据传输方法、装置、设备及存储介质
CN106681845B (zh) 一种管理通讯消息的方法和装置
CN115309252A (zh) 音乐控制界面显示方法、装置、可穿戴式设备及存储介质
WO2023236516A1 (zh) 语音识别方法、装置、设备及存储介质
WO2023138235A1 (zh) 主题切换方法、装置、设备、存储介质及程序产品
US10397390B2 (en) Communication event transfer method and apparatus, communication event processing method and apparatus, and terminal
CN116521283A (zh) 界面显示方法、装置、设备及存储介质
CN110543333B (zh) 针对处理器的休眠处理方法、装置、移动终端和存储介质
WO2023246604A1 (zh) 手写输入方法及终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22783813

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022783813

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022783813

Country of ref document: EP

Effective date: 20231106