WO2022048367A1

WO2022048367A1 - Method and apparatus for displaying multimedia content, and terminal and storage medium

Info

Publication number: WO2022048367A1
Application number: PCT/CN2021/109662
Authority: WO
Inventors: 黄远广
Original assignee: Oppo广东移动通信有限公司
Priority date: 2020-09-01
Filing date: 2021-07-30
Publication date: 2022-03-10
Also published as: CN114115634A

Abstract

Disclosed are a method and apparatus for displaying multimedia content, and a terminal and a storage medium, which belong to the technical field of computers. In the present application, when a terminal device is in a screen-off state, an application processor sleeps and a coprocessor is waken up, and a start icon is displayed on a screen-off display interface; and when the coprocessor detects a target touch-control signal that acts on the start icon, the coprocessor enters a sleep state and the application processor enters a wake-up state, and the application processor controls content corresponding to an application or a process so that same is displayed in a screen. The terminal device can display, in the screen-off state, the start icon by means of the coprocessor, and when the start icon is triggered, the coprocessor is directly returned to the sleep state and the application processor is returned to the wake-up state, and the content corresponding to the start icon is controlled by means of the application processor, so as to be displayed, thereby shortening an operation path of a user, and improving the efficiency of directly displaying, for the user, a relatively complex application in the screen-off state.

Description

Display method, device, terminal and storage medium for multimedia content

This application claims the priority of the Chinese patent application with the application number 202010906201.3 and the invention title "Display Method, Device, Terminal and Storage Medium for Multimedia Content" filed on September 1, 2020, the entire contents of which are incorporated herein by reference Applying.

technical field

The embodiments of the present application relate to the field of computer technologies, and in particular, to a method, device, terminal, and storage medium for displaying multimedia content.

Background technique

With the increase in size and usage time of the touch screen of the mobile terminal, the problem of battery life and energy consumption of the mobile terminal has also become the focus of designers.

In the related art, the mobile terminal can save the energy consumption of the mobile terminal when the screen is off by entering the off-screen display state. When the mobile terminal needs to display the content in the application controlled by the application processor, the mobile terminal first needs to wake up its own application processor. Then, in the bright screen state, the application processor displays the icon of the above application on the desktop of the mobile terminal. The application processor starts the specified application under the operation of the user, and displays the main interface of the application. When the user clicks the content to be displayed, the application processor controls the touch screen to display the content.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a method, device, terminal, and storage medium for displaying multimedia content. The technical solution is as follows:

According to an aspect of the present application, a method for displaying multimedia content is provided, which is applied to a terminal device, where the terminal device includes an application processor and a coprocessor, and the method includes:

In response to the terminal device being in a screen-off display state, the application processor enters a sleep state and the coprocessor enters a wake-up state;

The coprocessor controls to display at least one startup icon on the off-screen display interface, where the startup icon is used to start an application or process, and the application or process displays corresponding content through the application processor in a bright-screen display state;

In response to a target touch signal, the application processor switches back to a wake-up state, and the coprocessor switches back to a sleep state, and the target touch signal is a signal generated when the startup icon is triggered;

The application processor controls to display the content corresponding to the application or the process on the screen.

According to another aspect of the present application, a device for displaying multimedia content is provided, which is applied to a terminal device, where the terminal device includes an application processor and a coprocessor, and the device includes:

a processor control module, configured to instruct the application processor to enter a sleep state and the coprocessor to enter a wake-up state in response to the terminal device being in a screen-off display state;

An icon display module, used to instruct the coprocessor to control to display at least one startup icon on the off-screen display interface, where the startup icon is used to start an application or a process, and the application or process passes the application in a bright-screen display state The processor displays the corresponding content;

An identification acquisition module, configured to instruct the application processor to switch back to the wake-up state and the coprocessor to switch back to the sleep state in response to a target touch signal, the target touch signal being generated when the startup icon is triggered Signal;

The content display module is used to instruct the application processor to control the display of the content corresponding to the application or the process on the screen.

According to another aspect of the present application, a terminal is provided, and the terminal device includes an application processor and a coprocessor;

The coprocessor controls to display at least one startup icon on the off-screen display interface, the startup target is used to start an application or a process, and the application or process displays corresponding content through the application processor in a bright-screen display state;

The coprocessor acquires the identification information of the start icon in response to a target touch signal, the target touch signal being stimulated by a continuous sliding operation from the start icon to the target touch area;

According to another aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, and the instruction is loaded and executed by a processor to realize the multimedia content provided by the implementation of the present application. Display method.

According to one aspect of the present application, there is provided a computer program product comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in the various optional implementations of the display aspect of the multimedia content described above.

Description of drawings

In order to introduce the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application. , for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a schematic interface diagram of a screen-off display interface provided by an embodiment of the present application;

2 is a schematic diagram of a display process of a multimedia content provided by an embodiment of the present application;

3 is a schematic diagram of a display process of another multimedia content provided by an embodiment of the present application;

4 is a structural block diagram of a terminal device provided by an exemplary embodiment of the present application;

5 is a flowchart of a method for displaying multimedia content provided by an exemplary embodiment of the present application;

6 is a flowchart of another method for displaying multimedia content provided by another exemplary embodiment of the present application;

7 is a flowchart of a method for displaying multimedia content provided by an embodiment of the present application;

8 and 9 are interface schematic diagrams of a method for displaying multimedia content provided based on the embodiment shown in FIG. 7;

FIG. 10 is a structural block diagram of an apparatus for displaying multimedia content provided by an exemplary embodiment of the present application.

detailed description

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as recited in the appended claims.

In the description of the present application, it should be understood that the terms "first", "second" and the like are used for descriptive purposes only, and should not be construed as indicating or implying relative importance. In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "connected" and "connected" should be understood in a broad sense, for example, it may be a fixed connection, a detachable connection, or an integrated connection. Ground connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood in specific situations. Also, in the description of the present application, unless otherwise specified, "a plurality" means two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship.

In the embodiment of the present application, the following technical solutions are provided:

A method for displaying multimedia content, which is applied to a terminal device, the terminal device includes an application processor and a coprocessor, and the method includes:

Optionally, the terminal device includes a baseband processor, and the coprocessor controlling the display of at least one startup icon on the off-screen display interface includes:

In response to the baseband processor receiving a push message, waking up the application processor, the push message corresponds to the application or the push message corresponds to the process;

The application processor calls the notification bar display interface to record the push message;

the application processor enters a sleep state;

In response to the notification bar display interface being called, the coprocessor controls to display the startup icon corresponding to the push message in the off-screen display interface.

Optionally, when the startup icon is used to start the application, the application processor switches back to the wake-up state in response to the target touch signal, including:

In response to the target touch signal, the coprocessor obtains the identification information of the startup icon;

In response to the identification information matching a preset target identification, the application processor switches back to the wake-up state;

The application processor controls to display the content corresponding to the application or the process on the screen, including:

The application processor loads the content corresponding to the identification information according to the identification information;

The application processor controls the content corresponding to the identification information to be displayed on the screen.

Optionally, when the startup icon is used to start the process, the application processor is switched back to the wake-up state in response to the target touch signal, and the coprocessor is switched back to the sleep state, including:

In response to the target touch signal, the coprocessor obtains an interrupt signal corresponding to the process;

The coprocessor searches the local storage for a matching startup path according to the interrupt signal;

In response to the presence of the startup path in the local storage that matches the interrupt signal, the application processor switches back to an awake state and the coprocessor switches back to a sleep state.

Optionally, the method further includes:

In response to the target touch signal, the coprocessor displays a corresponding thumbnail icon in the target touch area, where the thumbnail icon is a thumbnail icon of the process startup icon or the application startup icon 's thumbnail icon.

Optionally, the target touch area and/or the area where the startup icon is located is provided with an off-screen fingerprint recognition module.

Optionally, in response to the target touch signal, the application processor is switched back to the wake-up state, and the coprocessor is switched back to the sleep state, including:

In response to the target touch signal, the coprocessor controls the under-screen fingerprint identification module to identify the acquired fingerprint;

In response to the fingerprint matching a preset template, the application processor switches back to the awake state and the coprocessor switches back to the sleep state.

Optionally, the application processor controls content corresponding to the application or the process to be displayed on the screen, including:

In response to a continuous touch signal and the content corresponding to the application or the process is sensitive content, the application processor controls to display the sensitive content corresponding to the application or the process, and the continuous touch signal is the application processor The under-screen fingerprint identification module is controlled to continuously identify a signal that is excited when a fingerprint matching the preset template is continuously identified within the sampling period.

Optionally, the sensitive content is a payment code in a payment application.

The beneficial effects brought by the technical solutions provided in the embodiments of the present application may include:

The method for displaying multimedia content provided by the present application is applied to a terminal device including a coprocessor and an application processor. The terminal device sleeps the application processor and wakes up the coprocessor when the screen is off, and displays a startup icon on the screen-off display interface; when the coprocessor monitors the target touch signal acting on the startup icon, the coprocessor enters the sleep state and The application processor enters the wake-up state, and the application processor controls to display the content corresponding to the application or process on the screen. Because the terminal device can display the startup icon through the coprocessor when the screen is off, and when the startup icon is triggered, directly restore the coprocessor to the sleep state and the application processor to the wake-up state, and control the application processor through the application processor. The content corresponding to the startup icon is displayed, thereby shortening the user's operation path, and improving the efficiency of the user to directly display more complex applications from the screen-off state.

In order to facilitate the understanding of the solutions shown in the embodiments of the present application, several terms appearing in the embodiments of the present application are introduced below.

The off-screen display (English: Always On Display, abbreviation: AOD) state refers to a display state in which information is displayed by the display screen when the terminal device is in the off-screen state. In a possible implementation manner, the terminal device can emit light through pixels with self-luminous capability in the off-screen display mode. Because the terminal device only needs to emit light through the pixels, and most of the pixels in the screen do not emit light. Therefore, the main color of the screen in the off-screen display state is black or the color of the pixel itself when the pixel does not emit light. In this scenario, the screen consumes less energy per unit time and can display corresponding information.

Illustratively, in the off-screen display state, the terminal device can display content such as a calendar, a notification message, a system time, a calculator, a mini-game, a screen saver animation, or a mini-game. The above-mentioned displayed content control logic is relatively simple, and can be directly activated and executed under the control of the coprocessor to display the corresponding content.

On the other hand, in the embodiment of the present application, the terminal device can also display the startup icons of some applications or processes with complex logic in the off-screen display state. When the startup icons of these applications or processes with complex logic are touched (that is, when a target touch signal is generated), the coprocessor cannot process the application or process normally, and the application processor needs to be woken up for processing. Illustratively, the present application provides a method that requires only one operation by a user. In this embodiment, when the application processor is in the dormant state, the coprocessor may display the startup icon of the application or process with complex logic in the off-screen display state. When the coprocessor detects that there is a trigger operation for the startup icon, the coprocessor goes to sleep and the application processor wakes up, and the wakeup application processor displays the content corresponding to the application or process.

In an optional implementation manner, the terminal device can display the application icon in the off-screen display state. The off-screen display interface is a user interface displayed by the terminal device in the off-screen display state.

Screen-off display interface: The background of the screen-off display interface is black or other natural colors when the touch screen does not emit light. Illustratively, the natural color can be dark blue, dark gray or gray.

Optionally, the off-screen display interface is a user interface provided by an operating system run by the coprocessor. Optionally, the operating system run by the coprocessor is an embedded operating system. Optionally, the operating system run by the coprocessor is different from the operating system run by the application processor. In a unit time, the power consumption of the embedded operating system run by the coprocessor to maintain the basic operation is lower than the power consumption of the operating system run by the application processor to maintain the basic operation.

Startup icon: is the icon displayed on the touch screen. Optionally, after the startup icon is triggered, the terminal device starts an application or process corresponding to the startup icon. In a possible implementation manner, the user interface displayed after the startup icon is triggered may be either the main interface of the corresponding application or a designated user interface in the corresponding application. In another possible implementation manner, when the startup icon is triggered, the terminal device may directly enable the function or service corresponding to the icon. For example, when the application corresponding to the launch icon is a flashlight application, the terminal device will directly light the flash when the launch icon is triggered, and continue to illuminate.

Optionally, the application corresponding to the launch icon may be either an application installed through an installation package, or a small program, a quick application, a mini application, or a light application that does not need to be installed.

Please refer to FIG. 1. FIG. 1 is a schematic interface diagram of a screen-off display interface provided by an embodiment of the present application. In FIG. 1 , the terminal device is in an off-screen display state, and an application startup icon and a process startup icon are simultaneously displayed in the off-screen display interface. The first area 110 displays an application startup icon 111 , an application startup icon 112 and an application startup icon 113 . The second area 120 displays a process start icon 121 , a process start icon 122 , a process start icon 123 , a process start icon 124 , a process start icon 125 and a process start icon 126 . The target touch area 130 is displayed with a corresponding indicator icon. In the scene shown in FIG. 1 , the appearance of the indicator icon is formed by superimposing gaps and arcs.

In an optional manner, the launch icon belongs to a shortcut application. A shortcut application is a system gadget or system service provided by the terminal device. For example, the shortcut application is at least one of a flashlight application, a mirror application, a calculator application, a compass application, a clock application, a timer application, a screen saver animation application or a mini-game application, and the like.

In another optional manner, when the application or process corresponding to the startup icon is in a bright-screen display state, the application processor displays the corresponding content.

It should be noted that the functions provided by the shortcut application can be differentiated according to different startup methods. When the shortcut app is logged in through a non-secure authentication method, the shortcut app only provides viewing and use of non-sensitive content. When the shortcut application is logged in through a secure authentication method, the shortcut application provides viewing and use of all content including sensitive applications.

Please refer to FIG. 2 , which is a schematic diagram of a display process of co-processing and directly displaying multimedia content. When the user directly clicks the process start icon 124, the coprocessor in the terminal device will display the user interface 200, in which the user interface 200 can only create new text and save text.

Please refer to FIG. 3 , which is a schematic diagram of a display process of multimedia content provided by an embodiment of the present application. When the user drags the process start icon 124 to the target touch area 130, the coprocessor in the terminal device will verify the obtained user's fingerprint, and when the user's fingerprint matches the preset template, the coprocessor will The browser considers that the user has passed the security verification and displays the user interface 300 . The user interface 300 includes Text 1, Text 2, Text 3, and Text 4 stored in the history, and the user has the right to view the above-mentioned sensitive content. When the user clicks an icon corresponding to any one of text 1, text 2, text 3 or text 4, the terminal device will display the text content corresponding to the clicked icon.

Illustratively, according to the embodiments shown in FIG. 2 and FIG. 3 , under different trigger operations of the user, the note-taking process can provide different content displays. Wherein, as shown in FIG. 3 , when the triggering operation of the process startup icon is in a manner that conforms to security verification, the terminal device will display corresponding sensitive content. As shown in FIG. 2 , when the triggering operation of the process startup icon is not in a manner that conforms to security verification, the terminal device will display other content that does not contain sensitive content.

Exemplarily, the method for displaying multimedia content shown in the embodiments of the present application may be applied to a terminal device, where the terminal device has a touch screen and has a display function of multimedia content. Terminals can include mobile phones, tablet computers, laptop computers, desktop computers, computer all-in-one computers, TVs, smart glasses, smart watches, digital cameras, MP4 playback terminals, MP5 playback terminals, learning machines, point readers, electronic paper books, Electronic dictionary or vehicle terminal, virtual reality (English: Virtual Reality, abbreviation: VR) playback terminal or augmented reality (English: Augmented Reality, abbreviation: AR) playback terminal, etc.

Please refer to FIG. 4. FIG. 4 is a structural block diagram of a terminal device provided by an exemplary embodiment of the present application. As shown in FIG. 4, the terminal device includes a processor 420, a memory 440, and a touch screen 460. The memory At least one instruction is stored in 440, and the instruction is loaded and executed by the processor 420 to implement the method for starting an application in the terminal device according to the various method embodiments of this application.

In this application, the terminal device 400 is an electronic device with a screen-off display function.

Processor 420 may include one or more processing cores. The processor 420 uses various interfaces and lines to connect various parts of the entire terminal device 400, and executes by running or executing the instructions, programs, code sets or instruction sets stored in the memory 440, and calling the data stored in the memory 440. Various functions of the terminal device 400 and processing data. Optionally, the processor 420 may adopt digital signal processing (English: Digital Signal Processing, abbreviation: DSP), field programmable gate array (English: Field-Programmable Gate Array, abbreviation: FPGA), programmable logic array (English: Programmable Logic Array, abbreviation: PLA) in at least one hardware form. The processor 420 may integrate one or a combination of a central processing unit (English: Central Processing Unit, abbreviation: CPU), a graphics processor (English: Graphics Processing Unit, abbreviation: GPU), and a modem. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used for rendering and drawing the content that needs to be displayed on the touch screen; the modem is used for processing wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 420, but is implemented by a single chip.

In this embodiment of the present application, the processor 420 may include an application processor (English: Application Processor, abbreviation: AP) and a coprocessor. In unit time, the power consumption of the coprocessor is less than that of the application processor. In the off-screen display mode, the coprocessor is in a wake-up state, and the coprocessor dominates the control work. At this point, the application processor enters a sleep state. In the off-screen display mode, since the application processor goes to sleep and the coprocessor controls it, the terminal device reduces the power consumption of the terminal device and increases the standby time of the terminal device on the premise of ensuring the normal operation of the terminal device. .

The memory 440 may include random access memory (English: Random Access Memory, abbreviation: RAM), or may include read-only memory (English: Read-Only Memory, abbreviation: ROM). Optionally, the memory 440 includes a non-transitory computer-readable storage medium (English: non-transitory computer-readable storage medium). Memory 440 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 440 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions, etc., used to implement the following method embodiments; the storage data area can store data and the like involved in the following method embodiments.

The touch screen 460 may include a glass cover, a touch sensor and a display assembly. Among them, the touch sensor can be integrated under the glass cover, and the glass cover is used to protect the touch sensor and display components. Optionally, the display components may include pixel display dots. In a possible display manner, the pixel display points may emit light autonomously, which is not shown in this embodiment of the present application. Optionally, the terminal device may emit light autonomously only through the pixel display points.

Please refer to FIG. 5 , which is a flowchart of a method for displaying multimedia content provided by an exemplary embodiment of the present application. The method for displaying multimedia content can be applied to the terminal device shown in FIG. 4 above. In the terminal device, the terminal device includes an application processor and a coprocessor, and the power consumption of the coprocessor per unit time is less than the power consumption of the application processor. In FIG. 5 , the method for displaying multimedia content includes:

Step 510, in response to the terminal device being in a screen-off display state, the application processor enters a sleep state and the coprocessor enters a wake-up state.

In the embodiment of the present application, the terminal device can trigger a sleep instruction instruction when entering the off-screen display state, where the sleep instruction instruction is used to instruct the application processor to enter the sleep state. At the same time, the terminal device can also trigger a wake-up instruction when entering the off-screen display state, where the wake-up instruction is used to instruct the coprocessor to enter the wake-up state.

Optionally, the above-mentioned sleep instruction instruction and the wake-up instruction are the same processor control instruction in actual implementation, and the processor control instruction controls the coprocessor to enter the wake-up state while instructing the application processor to enter the sleep state.

It should be noted that when the terminal device is in the off-screen display state, since the application processor enters the sleep state, the energy consumption of the terminal device per unit time will decrease, effectively prolonging the standby time of the terminal device under the condition of limited power. duration. For example, when the terminal device is a mobile terminal using a battery, and the terminal device is in a screen-off display state, the standby time of the terminal device can be effectively extended.

Step 520, the coprocessor controls to display at least one startup icon on the off-screen display interface, and the startup target is used to start the application or process, and the application or process displays the corresponding content through the application processor in the bright-screen display state.

Step 530 , in response to the target touch signal, the application processor switches back to the wake-up state, and the coprocessor switches back to the sleep state, and the target touch signal is a signal generated when the activation icon is triggered.

In the embodiment of the present application, when the terminal device detects the target touch signal, it means that the startup icon displayed in the off-screen display state is triggered. That is, the activation icon is triggered by a predetermined touch operation. The predetermined touch operation may include at least one touch operation among single-click, double-click, short-press, long-press, light-press, heavy-press, small-area touch, large-area touch, or dragging.

When the startup icon is triggered by a predetermined touch operation, the application processor in the terminal device switches back to the wake-up state, and the coprocessor switches back to the sleep state. That is, when the startup icon is triggered by a predetermined touch operation, the states of the application processor and the coprocessor in the terminal device are interchanged, and the coprocessor is automatically sleeping and the application processor is woken up.

In this example, the co-processor can acquire touch signals acting on the touch screen. When the touch signal used in the touch screen is the target touch signal, the coprocessor will determine the activation icon corresponding to the target touch signal, and obtain the identification information of the activation icon.

It should be noted that, on the one hand, when the startup icon corresponds to an application, the identification information of the startup icon may be either the installation package name of the application corresponding to the startup icon, or the unique name of the application corresponding to the startup icon in the terminal device. logo. On the other hand, when the startup icon corresponds to a process, the identification information of the startup icon may be the startup path of the process, and the startup path may be in the form of a hyperlink.

Optionally, the coprocessor may retain identification information of each startup icon in a storage area controlled by the coprocessor, and the coprocessor obtains the identification information of the startup icon in the storage area.

Illustratively, the target touch area is a touch screen area other than the startup icon in the terminal device. In a possible setting manner, the target touch area may be set at the lower part of the currently displayed user interface for the convenience of the user. If the currently displayed user interface is a vertical screen user interface, the target touch area may be an area close to the short side of the lower side of the screen. If the currently displayed user interface is a landscape user interface, the target touch area may be an area close to the long side of the lower side of the screen.

In a possible implementation manner, the target touch signal is a signal excited by a continuous sliding operation. It should be noted that the target touch signal can also be replaced by other touch signals, for example, a multi-touch signal, a long-press signal, a short-press signal, a light-press signal, a heavy-press signal, a large-area touch signal or a small-area touch signal The touch signal is not limited in this embodiment of the present application.

Step 540, the application processor controls to display the content corresponding to the application or process on the screen.

In this embodiment of the present application, the application processor controls the application to display content corresponding to the application or process on the screen. In a possible way, after the application processor is woken up, the screen is immediately turned on and the application or process is run. After the above application or process is executed, the corresponding content is displayed on the screen immediately.

It should be noted that the applications or processes corresponding to the startup icons shown in this application are all objects that cannot be displayed and processed normally by the coprocessor. In this scenario, in order to enable the terminal device to display the startup icon of the above application or process in the off-screen display state, and to enable the startup icon to be directly triggered and directly display the corresponding content in the off-screen display state. This application designs a set of co-processors and application processors to work together, which can save power and quickly display the functions of applications or processes with complex specified logic, and further improve the display content of the terminal device on the premise of improving the battery life of the terminal device. s efficiency.

To sum up, the method for displaying multimedia content provided by the present application is applicable to a terminal device including a coprocessor and an application processor. The terminal device sleeps the application processor and wakes up the coprocessor when the screen is off. The coprocessor controls the display of the startup icon on the screen off display interface. In response to the target touch signal, the coprocessor enters the sleep state and the application processor Enter the wake-up state, and the application processor controls to display the content corresponding to the application or process on the screen. Because the terminal device can display the startup icon through the coprocessor when the screen is off, and when the startup icon is triggered, directly restore the coprocessor to the sleep state and the application processor to the wake-up state, and control the application processor through the application processor. The content corresponding to the startup icon is displayed, thereby shortening the user's operation path, and improving the efficiency of the user to directly display more complex applications from the screen-off state.

Please refer to FIG. 6, which is a flowchart of another method for displaying multimedia content provided by another exemplary embodiment of the present application. The method for displaying multimedia content can be applied to the terminal shown in FIG. 4 above. In Fig. 6, the display method of this multimedia content includes:

Step 610, in response to the terminal device being in a screen-off display state, the application processor enters a sleep state and the coprocessor enters a wake-up state.

In this embodiment of the present application, the execution process of step 610 is the same as the execution process of step 510, and details are not repeated here.

Step 621, in response to the baseband processor receiving the push message, wake up the application processor, the push message corresponds to the application or the push message corresponds to the process.

In the present application, the terminal device may further include a baseband processor, where the baseband processor is used for processing of transceiving signals. When the terminal device receives the push message through the baseband processor, it can wake up the application processor. It should be noted that the push message is a message sent by the server of the application or the server of the process.

Optionally, the baseband processor can generate a wake-up instruction when receiving the push message, and the wake-up instruction is used to wake up the application processor.

Step 622, the application processor calls the notification bar display interface to record the push message.

In this embodiment, after being woken up, the application processor can call the notification bar display interface. After calling the notification bar display interface, the push message can be obtained. After the application processor acquires the push message, the application device can record the push message.

Step 623, the application processor enters a sleep state.

In this embodiment of the present application, after the application processor completes the above operation of recording the push message, the application processor will enter a sleep state.

Optionally, log each push message as a separate event. The application processor can enter a sleep state after executing the event.

Optionally, the application processor can wait for a specified period of time after finishing recording the push message. The specified duration may be 5 milliseconds, 10 milliseconds, or 15 milliseconds, or other specified durations. The application processor enters the sleep state when there is still no event to be processed after the specified time period.

Step 624 , in response to the notification bar display interface being called, the coprocessor controls to display the start icon corresponding to the push message in the off-screen display interface.

In this embodiment, in response to the notification bar display interface being called, the coprocessor can display the startup icon corresponding to the push message in the off-screen display interface.

In a possible implementation manner, the coprocessor and the application processor are not in an awake state at the same time in the terminal device. That is, when the application processor in the terminal device is in the awake state, the coprocessor is in the sleep state. When the application processor in the terminal device is in a dormant state, the coprocessor is in an awake state.

In another possible implementation, the coprocessor and the application processor are simultaneously awake. That is, when the application processor is in the wake-up state, the co-processor is also in the wake-up state.

Step 631, in response to the target touch signal, the coprocessor obtains the identification information of the startup icon.

In this embodiment of the present application, the identification information of the startup icon may be an installation package name or a UID (English: Unique Identifier, Chinese: Unique Identifier). Alternatively, the identification information of the startup icon may also be other characters capable of identifying the identity of the startup icon, which is not limited in this embodiment of the present application.

Step 632, in response to the identification information matching the preset target identification, the application processor switches back to the wake-up state.

In this embodiment of the present application, the coprocessor can match the identification information with the target identification, and when the identification information matches the target identification, the application processor switches back to the wake-up state.

Step 633, the application processor loads the content corresponding to the identification information according to the identification information.

In this example, the application processor will determine the content to be loaded based on the identification information. For example, if the identification information indicates application A, the application processor will load application A and display the main interface. For another example, if the identification information indicates page a in application A, the application processor will load page a in application A and display the page a. For another example, if the identification information indicates process B, the application processor will load process B and display the page of process B.

Step 641, in response to the target touch signal, the coprocessor obtains the interrupt signal corresponding to the process.

Step 642, the coprocessor searches the local storage for a matching startup path according to the interrupt signal.

It should be noted that the number of each interrupt signal may be pre-stored in the coprocessor. The coprocessor can identify the startup path in local storage by the number of the interrupt signal.

Step 643, in response to the existence of a startup path matching the interrupt signal in the local storage, the application processor switches back to the wake-up state, and the coprocessor switches back to the sleep state.

Step 650, the application processor controls the content corresponding to the identification information to be displayed on the screen.

In a possible manner, the application processor controls the content corresponding to the identification information to be displayed in full screen on the screen.

In another possible manner, the application processor controls the content corresponding to the identification information to be displayed in the form of a floating window on the screen.

To sum up, the method for displaying multimedia content provided in this embodiment can also enable the coprocessor to pre-save the startup path of the process corresponding to the process startup icon. With the cooperation of the coprocessor and the application processor, the terminal device can receive the user's touch operation for the startup icon in the off-screen display state, and wake up the application processor under the action of the operation and simultaneously make the coprocessor When entering the sleep state, the application processor controls the display of the content corresponding to the startup icon, which improves the efficiency of the user to directly display more complex applications from the screen-off state.

Please refer to FIG. 7. FIG. 7 is a flowchart of a method for displaying multimedia content provided by an embodiment of the present application. The embodiment shown in FIG. 7 can be applied to the terminal device shown in FIG. 4. In FIG. 7, the multimedia content Content display methods include:

Step 710, in response to the terminal device being in a screen-off display state, the application processor enters a sleep state and the coprocessor enters a wake-up state.

In this embodiment of the present application, the execution process of step 710 is the same as that of step 510, and details are not repeated here.

Step 720, the coprocessor controls to display at least one startup icon on the off-screen display interface.

In this embodiment of the present application, the execution process of step 720 is the same as that of step 520, and details are not repeated here.

Step 731 , in response to the target touch signal, display a corresponding thumbnail icon in the target touch area.

The thumbnail icon is the thumbnail icon of the process startup icon or the thumbnail icon of the application startup icon.

Please refer to FIG. 8 and FIG. 9 . Both FIG. 8 and FIG. 9 are schematic interface diagrams of a method for displaying multimedia content provided based on the embodiment shown in FIG. 7 .

In FIG. 8 , when the user's finger 140 drags the process start icon 124 to the target touch area 130 , a thumbnail icon of the process start icon 124 will be displayed in the target touch area 130 in the off-screen display interface.

In FIG. 9 , when the user's finger drags the application startup icon 113 to the target touch area 130 , the thumbnail icon of the application startup icon 113 will be displayed in the target touch area 130 in the off-screen display interface.

Step 732, in response to the target touch signal, the coprocessor controls the under-screen fingerprint identification module to identify the acquired fingerprint.

In this application, the coprocessor can control the fingerprint recognition module under the screen to recognize the acquired fingerprint in response to the target touch signal. The acquired fingerprint is the fingerprint collected in the touch area corresponding to the target touch signal. Illustratively, the touch area corresponding to the target touch signal includes the target touch area and/or the area where the activation icon is located.

Step 733 , in response to the fingerprint matching the preset template, wake up the application processor and make the application processor control to display the sensitive content corresponding to the sensitive application or the sensitive process.

As an example, the sensitive application may be at least one of a payment application, a social application, an email application, a photo album application, a wealth management application, a travel application, a shopping application, a ticketing application, a food delivery application, and a map application. Not limited.

Illustratively, the target touch area and/or the area where the startup icon is located is provided with an under-screen fingerprint recognition module.

(1) In the first possible manner, an under-screen fingerprint recognition module is provided in the target touch area.

Illustratively, an off-screen fingerprint recognition module is provided in the target touch area, and the terminal device acquires the user's fingerprint through the off-screen fingerprint recognition module in the target touch area in a screen-off display state. In this scenario, the clarity and accuracy of the fingerprint collected by the terminal device depends on the performance of the under-screen fingerprint recognition module in the target touch area. The under-screen fingerprint identification module may be at least one of an optical fingerprint identification module or an ultrasonic fingerprint identification module.

(2) In the second possible manner, an under-screen fingerprint identification module is provided in the area where the startup icon is located.

Illustratively, an under-screen fingerprint recognition module is provided in the area where the startup icon is located. Taking FIG. 1 as an example, the under-screen fingerprint recognition module may be arranged in the first area 110 or the second area 120 . When the user drags the start icon from the first area 110 or the second area 120 to the target touch area, the under-screen fingerprint recognition module collects the user's fingerprint in the first area 110 or the second area 120 . When the user drags the launch icon to the target touch area, the terminal device confirms that the application or process corresponding to the launch icon needs to be activated to display sensitive content.

(3) In the third possible manner, both the target touch area and the area where the startup icon is located are provided with an under-screen fingerprint recognition module.

Illustratively, the target touch area and the area where the startup icon is located are both provided with an under-screen fingerprint recognition module. The terminal device can obtain the user's fingerprint through the under-screen fingerprint recognition module in any of the above two areas. Due to the large number of areas set by the fingerprint module under the screen, the terminal device can obtain the user's fingerprint with a high success rate.

In this embodiment, when the user's fingerprint matches the preset template, the terminal device will directly display the sensitive content corresponding to the startup icon on the touch screen. For example, if the sensitive content corresponding to the startup icon is the payment code in the payment application, the application processor will control the terminal to display the payment code.

Step 734, in response to the continuous touch signal and the content corresponding to the application or process is sensitive content, wake up the application processor and make the application processor control to display the sensitive content corresponding to the sensitive application or sensitive process.

The continuous touch signal is a signal that is excited when the fingerprint recognition module under the screen is controlled by the coprocessor, and a fingerprint matching the preset template is continuously recognized within the sampling period.

In the embodiment of the present application, when the user's fingerprint matches the preset template, taking the sampling period as an example of 1 second, one sampling period includes 4 sampling moments. When fingerprints matching the preset template are continuously recognized, the terminal device will stimulate a continuous touch signal. Under the action of the continuous touch signal, the application processor controls the terminal device to display the sensitive content corresponding to the sensitive application or the sensitive process.

For example, taking the embodiment shown in FIG. 1 as an example, when the user drags the process start icon 126 to the target touch area 130, when the user's finger continues to press on the target touch area 130, the application processor in the terminal device The terminal device is controlled to display the payment code corresponding to the process start icon 126 on the touch screen.

Illustratively, in response to the fingerprint matching the preset template and interrupting the touch signal, the coprocessor resumes displaying the off-screen display interface, so as to sufficiently protect the sensitive content from leakage. The terminal touch signal is a signal excited when the under-screen fingerprint identification module fails to continuously identify a fingerprint matching the preset template within the sampling period.

In a possible implementation manner, the coprocessor performs matching work on the fingerprint and the preset template, and determines whether the fingerprint and the preset template match.

In another possible implementation, the coprocessor will wake up the application processor and the coprocessor itself will go to sleep. The application processor performs the matching work on the fingerprint and the preset template.

To sum up, the method for displaying multimedia content provided in this embodiment can improve the accuracy and efficiency of fingerprint collection by arranging the fingerprint identification module under the screen at a designated position, thereby facilitating the terminal on the premise of saving energy consumption and being safe. , to quickly display the sensitive content corresponding to the launch icon.

Optionally, the method provided by the embodiment of the present application can also control the sensitive information to be under the monitoring of the user when displayed through continuous identification of the user's fingerprint information, which further improves the security of quickly displaying sensitive content when the screen is off. sex.

The following are apparatus embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

Please refer to FIG. 10 , which is a structural block diagram of an apparatus for displaying multimedia content provided by an exemplary embodiment of the present application. The apparatus for displaying the multimedia content can be implemented by software, hardware or a combination of the two to become all or a part of the terminal device shown in FIG. 1 . The device includes:

a processor control module 1010, configured to instruct the application processor to enter a sleep state and the coprocessor to enter a wake-up state in response to the terminal device being in a screen-off display state;

The icon display module 1020 is used to indicate that the coprocessor controls to display at least one startup icon on the off-screen display interface, and the startup icon is used to start an application or process, and the application or process passes the The application processor displays the corresponding content;

The processor switching module 1030 is configured to instruct the application processor to switch back to the wake-up state and the coprocessor to switch back to the sleep state in response to a target touch signal, the target touch signal being when the startup icon is triggered generated signal;

The content display module 1040 is configured to instruct the application processor to control the display of the content corresponding to the application or the process on the screen.

In an optional embodiment, a baseband processor is further integrated in the terminal device, and the icon display module 1020 is configured to wake up the application processor in response to the baseband processor receiving a push message, and the push The message corresponds to the application or the push message corresponds to the process; the application processor invokes a notification bar display interface to record the push message; the application processor enters a sleep state; in response to the notification bar display interface is called, and the coprocessor controls to display the startup icon corresponding to the push message in the off-screen display interface.

In an optional embodiment, the processor switching module 1030 is configured to, in response to a target touch signal, acquire, by the coprocessor, the identification information of the startup icon; in response to the identification information and a preset If the target identification matches, the application processor switches back to the wake-up state; the content display module 1040 is used for the application processor to load the content corresponding to the identification information according to the identification information; the application processor Control the content corresponding to the identification information to be displayed on the screen. Wherein, the startup icon is used to start the application.

In an optional embodiment, the processor switching module 1030 is configured to, in response to the target touch signal, acquire, by the coprocessor, an interrupt signal corresponding to the process; The interrupt signal queries the local storage for a matching startup path; in response to the presence of the startup path matching the interrupt signal in the local storage, the application processor switches back to the awake state, and the coprocessor switches back to sleep condition.

In an optional embodiment, the apparatus further includes a thumbnail display module, configured to, in response to the target touch signal, display the corresponding thumbnail icon in the target touch area by the coprocessor, The thumbnail icon is the thumbnail icon of the process startup icon or the thumbnail icon of the application startup icon.

In an optional embodiment, the target touch area involved in the device and/or the area where the startup icon is located is provided with an off-screen fingerprint recognition module.

In an optional embodiment, the processor switching module 1030 is configured to, in response to the target touch signal, control the under-screen fingerprint recognition module to recognize the acquired fingerprint by the co-processor; The fingerprint matches the preset template, the application processor switches back to the wake-up state, and the coprocessor switches back to the sleep state.

In an optional embodiment, the content display module 1040 is configured to, in response to a continuous touch signal and the content corresponding to the application or the process is sensitive content, the application processor to control the display of the application or the process. The sensitive content corresponding to the process, the continuous touch signal is a signal excited when the application processor controls the under-screen fingerprint recognition module to continuously recognize fingerprints matching the preset template within the sampling period.

In an optional embodiment, the sensitive content is a payment code in a payment application.

To sum up, the apparatus for displaying multimedia content provided in this embodiment can also enable the coprocessor to pre-save the startup path of the process corresponding to the process startup icon. Since the coprocessor continues to wake up when the terminal device is in the off-screen display state, when the target touch signal appears, the coprocessor can respond to the target touch signal at the first time, and by waking up the application processor in time, The process corresponding to the process startup icon is started according to the startup path, and on the premise of ensuring the security of the sensitive content, the time for the user to view the sensitive content corresponding to the process is shortened.

Optionally, the display device for multimedia content provided in this embodiment can improve the accuracy and efficiency of collecting fingerprints by arranging the fingerprint identification module under the screen at a designated position, thereby facilitating the terminal to save energy and be safe on the premise. to quickly display the sensitive content corresponding to the launch icon.

Optionally, the device provided by the embodiment of the present application can also control the sensitive information to be under the monitoring of the user when displayed through continuous identification of the user's fingerprint information, which further improves the security of rapidly displaying sensitive content when the screen is off. sex.

An embodiment of the present application further provides a terminal device, the terminal device includes an application processor and a co-processor; the application processor enters a sleep state in response to the terminal device being in a screen-off display state; the co-processor The controller enters the wake-up state in response to the terminal device being in the off-screen display state; the coprocessor controls to display at least one startup icon on the off-screen display interface, and the startup target is used to start a sensitive application or a sensitive process, so The sensitive application or sensitive process displays the corresponding content through the application processor in the bright screen display state; the coprocessor responds to the target touch signal to obtain the identification information of the startup icon, and the target touch signal is triggered by the continuous sliding operation from the startup icon to the target touch area; the coprocessor controls and displays the sensitive content corresponding to the sensitive application or the sensitive process according to the identification information.

Embodiments of the present application further provide a computer-readable medium, where the computer-readable medium stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the multimedia content according to the above embodiments. Display method.

It should be noted that when the display device for multimedia content provided by the above embodiments executes the method for displaying multimedia content, only the division of the above-mentioned functional modules is used as an example for illustration. The functional modules of the device are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the multimedia content display device and the multimedia content display method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, etc.

The above descriptions are only exemplary embodiments that can be implemented in the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the within the scope of protection of this application.

Claims

A method for displaying multimedia content, wherein the method is applied to a terminal device, the terminal device includes an application processor and a coprocessor, and the method includes:

In response to the terminal device being in a screen-off display state, the application processor enters a sleep state and the coprocessor enters a wake-up state;

The coprocessor controls to display at least one startup icon on the off-screen display interface, where the startup icon is used to start an application or process, and the application or process displays corresponding content through the application processor in a bright-screen display state;

In response to a target touch signal, the application processor switches back to a wake-up state, and the coprocessor switches back to a sleep state, and the target touch signal is a signal generated when the startup icon is triggered;

The application processor controls to display the content corresponding to the application or the process on the screen.
The method according to claim 1, wherein the terminal device comprises a baseband processor, and the coprocessor controlling the display of at least one startup icon on the off-screen display interface comprises:

In response to the baseband processor receiving a push message, waking up the application processor, the push message corresponds to the application or the push message corresponds to the process;

The application processor calls the notification bar display interface to record the push message;

the application processor enters a sleep state;

In response to the notification bar display interface being called, the coprocessor controls to display the startup icon corresponding to the push message in the off-screen display interface.
The method according to claim 2, when the startup icon is used to start the application, the application processor is switched back to the wake-up state in response to the target touch signal, comprising:

In response to the target touch signal, the coprocessor obtains the identification information of the startup icon;

In response to the identification information matching a preset target identification, the application processor switches back to the wake-up state;

The application processor controls to display the content corresponding to the application or the process on the screen, including:

The application processor loads the content corresponding to the identification information according to the identification information;

The application processor controls the content corresponding to the identification information to be displayed on the screen.
The method according to claim 3, when the start icon is used to start the process, the application processor is switched back to a wake-up state in response to a target touch signal, and the coprocessor is switched back to a sleep state ,include:

In response to the target touch signal, the coprocessor obtains an interrupt signal corresponding to the process;

The coprocessor searches the local storage for a matching startup path according to the interrupt signal;

In response to the presence of the startup path in the local storage that matches the interrupt signal, the application processor switches back to an awake state and the coprocessor switches back to a sleep state.
The method of claim 1, further comprising:

In response to the target touch signal, the coprocessor displays a corresponding thumbnail icon in the target touch area, where the thumbnail icon is a thumbnail icon of the process startup icon or the application startup icon 's thumbnail icon.
According to the method according to any one of claims 1 to 5, the target touch area and/or the area where the startup icon is located is provided with an off-screen fingerprint recognition module.
The method according to claim 6, wherein in response to the target touch signal, the application processor is switched back to the wake-up state, and the coprocessor is switched back to the sleep state, comprising:

In response to the target touch signal, the coprocessor controls the under-screen fingerprint identification module to identify the acquired fingerprint;

In response to the fingerprint matching a preset template, the application processor switches back to the awake state and the coprocessor switches back to the sleep state.
The method according to claim 7, wherein the application processor controls to display content corresponding to the application or the process on the screen, comprising:

In response to a continuous touch signal and the content corresponding to the application or the process is sensitive content, the application processor controls to display the sensitive content corresponding to the application or the process, and the continuous touch signal is the application processor The under-screen fingerprint identification module is controlled to continuously identify a signal that is excited when a fingerprint matching the preset template is continuously identified within the sampling period.
The method of claim 8, the sensitive content is a payment code in a payment application.
An apparatus for displaying multimedia content, which is applied to a terminal device, the terminal device includes an application processor and a coprocessor, and the device includes:

a processor control module, configured to instruct the application processor to enter a sleep state and the coprocessor to enter a wake-up state in response to the terminal device being in a screen-off display state;

An icon display module, used to instruct the coprocessor to control to display at least one startup icon on the off-screen display interface, where the startup icon is used to start an application or a process, and the application or process passes the application in a bright-screen display state The processor displays the corresponding content;

A processor switching module, configured to instruct the application processor to switch back to the wake-up state and the coprocessor to switch back to the sleep state in response to a target touch signal, the target touch signal being generated when the startup icon is triggered signal of;

The content display module is used to instruct the application processor to control the display of the content corresponding to the application or the process on the screen.
The apparatus according to claim 10, wherein the terminal device comprises a baseband processor, and the icon display module is configured to:

In response to the baseband processor receiving a push message, waking up the application processor, the push message corresponds to the application or the push message corresponds to the process;

The application processor calls the notification bar display interface to record the push message;

the application processor enters a sleep state;

In response to the notification bar display interface being called, the coprocessor controls to display the startup icon corresponding to the push message in the off-screen display interface.
The device of claim 11,

The icon display module is used for, in response to a target touch signal, the coprocessor obtains identification information of the startup icon; in response to the identification information matching a preset target identification, the application processor switches back to the wake-up state;

The content display module is used for the application processor to load the content corresponding to the identification information according to the identification information; the application processor controls the content corresponding to the identification information to be displayed on the screen.
The apparatus according to claim 12, the processor switching module for:

When the startup icon is used to start the process, in response to the target touch signal, the coprocessor acquires an interrupt signal corresponding to the process;

The coprocessor searches the local storage for a matching startup path according to the interrupt signal;

In response to the presence of the startup path in the local storage that matches the interrupt signal, the application processor switches back to an awake state and the coprocessor switches back to a sleep state.
The apparatus of claim 10, further comprising an execution module for:

In response to the target touch signal, the coprocessor displays a corresponding thumbnail icon in the target touch area, where the thumbnail icon is a thumbnail icon of the process startup icon or the application startup icon 's thumbnail icon.
The device according to any one of claims 10 to 14, wherein the target touch area and/or the area where the startup icon is located is provided with an off-screen fingerprint recognition module.
The apparatus of claim 15, the processor switching module for:

In response to the target touch signal, the coprocessor controls the under-screen fingerprint identification module to identify the acquired fingerprint;

In response to the fingerprint matching a preset template, the application processor switches back to the awake state and the coprocessor switches back to the sleep state.
The apparatus according to claim 16, the content display module for:

In response to a continuous touch signal and the content corresponding to the application or the process is sensitive content, the application processor controls to display the sensitive content corresponding to the application or the process, and the continuous touch signal is the application processor The under-screen fingerprint identification module is controlled to continuously identify a signal that is excited when a fingerprint matching the preset template is continuously identified within the sampling period.
18. The apparatus of claim 17, the sensitive content is a payment code in a payment application.
A terminal device, wherein the terminal device includes an application processor and a coprocessor;

In response to the terminal device being in a screen-off display state, the application processor enters a sleep state and the coprocessor enters a wake-up state;

The coprocessor controls to display at least one startup icon on the off-screen display interface, the startup target is used to start an application or a process, and the application or process displays corresponding content through the application processor in a bright-screen display state;

In response to a target touch signal, the application processor switches back to a wake-up state, and the coprocessor switches back to a sleep state, and the target touch signal is a signal generated when the startup icon is triggered;

The coprocessor acquires the identification information of the start icon in response to a target touch signal, the target touch signal being stimulated by a continuous sliding operation from the start icon to the target touch area;

The application processor controls to display the content corresponding to the application or the process on the screen.
A computer-readable storage medium, storing program instructions in the storage medium, wherein, when the program instructions are executed by a processor, the method for displaying multimedia content according to any one of claims 1 to 9 is implemented.