CN117809592A

CN117809592A - Display device and layer refresh rate setting method

Info

Publication number: CN117809592A
Application number: CN202311425014.3A
Authority: CN
Inventors: 何灿; 岳顺
Original assignee: Hisense Electronic Technology Shenzhen Co ltd
Current assignee: Hisense Electronic Technology Shenzhen Co ltd
Priority date: 2023-10-30
Filing date: 2023-10-30
Publication date: 2024-04-02

Abstract

Some embodiments of the application provide a display device and a layer refresh rate setting method. The display device may obtain layer refresh rate support information according to system configuration information, where the layer refresh rate support information is used to characterize whether a refresh rate supported by the OSD layer reaches a first refresh rate. The display device sets a refresh rate of the OSD layer according to the layer refresh rate support information. In response to an instruction to generate a UI image, the display device acquires a UI image generation time according to a refresh rate of an OSD layer and generates the UI image according to the UI image generation time. The display device may display the UI image in the OSD layer. The display device can automatically set the refresh rate of the OSD layer according to the system configuration condition so as to improve the picture quality of the UI interface in the OSD layer.

Description

Display device and layer refresh rate setting method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a layer refresh rate setting method.

Background

The display device is a terminal device capable of outputting specific display pictures, along with the rapid development of the display device, the functions of the display device are more and more abundant, the performance is more and more powerful, the bidirectional man-machine interaction function can be realized, and various functions such as video, entertainment and data are integrated, so that the user diversified and personalized requirements are met.

When the display device displays the image, a user interface with rich content can be formed by superposing a plurality of layers. For example, the display layers of the display device may include a video layer and a graphics layer, where the video layer may have a better picture display effect, and may be used to display a picture or a play picture of a video; the graphic layer has a good display response speed, and can be used for displaying operation interfaces of users, including various UI interfaces.

The display device may display images at different refresh rates. When playing video content, the display device can adjust the refresh rate of the display pictures of the video layer according to the frame rate of the video data so as to improve the watching experience of a user. However, for the graphics layer displaying the user control interface, the display device may default to a fixed refresh rate, and the refresh rate of the graphics layer is low, which may result in poor picture quality of the UI interface in the graphics layer, and poor viewing experience for the user.

Disclosure of Invention

The application provides a display device and a layer refresh rate setting method, which are used for solving the problems that in the related art, the display device defaults to set a fixed refresh rate for a graphic layer, the refresh rate of the graphic layer is lower, the picture quality of a UI interface in the graphic layer is poor, and the watching experience of a user is poor.

In a first aspect, some embodiments of the present application provide a display device including a display, an image generation unit, and a controller. Wherein the image generation unit is configured to generate the UI image. The controller is configured to:

acquiring system configuration information of display equipment, and acquiring layer refresh rate supporting information according to the system configuration information, wherein the layer refresh rate supporting information is used for representing whether the refresh rate supported by an OSD layer reaches a first refresh rate or not;

setting the refresh rate of the OSD layer according to the layer refresh rate supporting information;

responding to an instruction for generating the UI image, and acquiring the UI image generation time according to the refresh rate of the OSD layer;

controlling the image generating unit to generate a UI image according to the UI image generating time;

and controlling the display to display the UI image in the OSD layer.

In a second aspect, some embodiments of the present application provide a layer refresh rate setting method, applied to a display device, where the method includes:

and controlling a display to display the UI image in the OSD layer.

According to the technical scheme, some embodiments of the application provide a display device and a layer refresh rate setting method. The display device may obtain layer refresh rate support information according to system configuration information, where the layer refresh rate support information is used to characterize whether a refresh rate supported by the OSD layer reaches a first refresh rate. The display device sets a refresh rate of the OSD layer according to the layer refresh rate support information. In response to an instruction to generate a UI image, the display device acquires a UI image generation time according to a refresh rate of an OSD layer and generates the UI image according to the UI image generation time. The display device may display the UI image in the OSD layer. The display device can automatically set the refresh rate of the OSD layer according to the system configuration condition so as to improve the picture quality of the UI interface in the OSD layer and the viewing experience of a user.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates a schematic diagram of a user interface in some embodiments;

FIG. 6 illustrates a display function block diagram in some embodiments;

FIG. 7 illustrates a schematic diagram of a video layer and a graphics layer in some embodiments;

FIG. 8 illustrates an image refresh rate setting interface in some embodiments;

FIG. 9 illustrates a schematic diagram of graphics layer refresh rate adjustment mode validation information in some embodiments;

FIG. 10 illustrates an interactive flow diagram of components of a display device in some embodiments;

FIG. 11 illustrates a schematic diagram of a refresh rate list in some embodiments.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. May be configured to allow the display device 200 to be communicatively coupled via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), etc.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

The display device 200 may have various functions such as browsing web pages, playing media assets, entertainment games, projecting screens, etc., thereby providing a wide variety of services to users. The user may control the display device 200 to launch a related application program to thereby launch a corresponding function.

In some embodiments, the controller 250 may control the display 260 to display a user interface when the user controls the display device 200 to power on. The user interface may be a specific target image, for example, various media materials obtained from a network signal source, including video, pictures and the like. The user interface may also be some UI interface of the display device, such as a system main interface or the like. FIG. 5 illustrates a schematic diagram of a user interface in some embodiments. As shown in fig. 5, the user interface includes a first navigation bar 500, a second navigation bar 510, a function bar 520, and a content display area 530, the function bar 520 including a plurality of function controls such as "watch record", "my collection", and "my application", etc. Wherein the content displayed in the content display area 530 will change as the selected controls in the first navigation bar 500 and the second navigation bar 510 change. When the application panel page is applied, a user can trigger entering a corresponding application panel by clicking on a My application control to input a display instruction for the application panel page. It should be noted that, the user may also input the selection operation of the function control in other manners to trigger entering into the application panel. For example, control is entered into the application panel page using a voice control function, a search function, or the like.

The user interface may include a plurality of controls, which may be presented in text form, such as the "My applications" control in the figures. This type of control may receive control instructions from a user. The user may enter the corresponding control instructions by clicking on these controls. The control may also be presented in the form of an image, such as control 540 in the figure, in which the image may be presented in the form of a picture, video, or the like. That is, in the user interface, control 540 may display video content directly.

It should be noted that, the user interface including various controls is essentially a system UI interface for displaying an operation interface of a user. The video content displayed by the display device 200 may be displayed after the display device 200 obtains various media data from the network. For UI interfaces and video content, display may be performed in different layers of the display device 200. The UI interface may be displayed by an On-Screen Display (OSD) layer, and the video content may be displayed by a video (video) layer. When the display device 200 displays an image, a user interface having rich contents can be formed by superimposing a plurality of layers.

Based on the system-level relationship of the display device 200, the display device 200 may form a display screen on the display 260 by calling up the layers of resources to control the display 260 to display the user interface. For displaying the user interface, functional modules associated with the display process may be configured within the display device 200. FIG. 6 illustrates a schematic diagram of display functionality in some embodiments, as shown in FIG. 6, the display device 200 may render and display a user interface in real-time through an Image generation (Image Producer) module, an Image rendering (surface render) module, a hardware composition (Hardware Composer, HWC) module, a video process (Video Processing Unit hardware, VPU hardware) module, and a display (screen).

During the display process, peripherals such as a graphics interface (openGLES), a media player, a camera, etc. of the image generation module may be used to generate image content to be displayed, and transfer the image content to the image rendering module. The image rendering module is used for controlling the display 260 to display content, i.e. rendering the image content through a user interaction layer (UI layer) or a video layer (video layer) according to the image content.

To obtain a better display effect, the image content of the UI layer may be rendered by the GPU component, so that a frame of a screen for display is formed at the HWC module. The HWC module may store the frame frames through a frame buffer (frame buffer) and a video buffer (video buffer), and form the picture contents at the corresponding layers through the video process module, respectively. That is, image frames generated by the video playing process form picture contents through a video layer (video plane), and image frames of other image pictures (e.g., UI interface graphics, etc.) form picture contents through a main OSD layer (primary OSD plane). Finally, the display device 200 forms a final picture by a mixing unit (blend) of the video process module, which is displayed on the display 260.

In the above embodiment, in the process of displaying the user interface, the display device 200 may perform superposition display through multiple layers, where different layers have different screen display manners. In some embodiments, the display device 200 may perform a picture display through a video layer and a graphics layer. The video layer can establish a connection relationship with a media player of the image generation module and is used for displaying picture contents generated by the media player through playing media asset data. For example, when the display device 200 plays video assets, the media player may analyze the asset data to form a multi-frame asset screen, and send the multi-frame asset screen to the video layer to form a video playing screen.

The video layer can display pictures based on the content, format, type, decoding specification, picture quality parameters and the like of the media data, so that a good picture display effect is obtained. For example, for a high frame rate video asset of 90Hz, the media player of the display device 200 may obtain 90 frames of display every second directly by decoding the video data and render the 90 frames of display at the video layer. It should be noted that the video layer is not only used for displaying video type media content, but also used for displaying other types of media content. For example, the video layer may also be displayed by a user with a picture detail interface, i.e., the picture-like media asset data may be decoded by the media player to form multiple frames of images of the same content and displayed in the video layer at the display refresh rate of the display 260.

In some embodiments, the display device 200 may further perform image quality processing on the picture content when the video layer displays the picture content, so that the picture content displayed by the video layer better meets the requirements of users. For example, a plurality of image quality mode options including standard, soft, vivid, eye-protecting, etc. may be preset in the operating system of the display device 200. The user can select one of the image quality modes according to viewing needs, and the display apparatus 200 can perform image quality processing on the displayed screen content according to the selected image quality mode. For example, when the user selects the vivid mode, the display device 200 enhances the color saturation and brightness in the picture content, makes the picture content brighter and brighter, and displays the picture frame with the adjusted picture quality through the video layer.

The OSD layer may refresh display some of the image-related information in real time according to the interactive operation process of the display device 200. Such as graphics, text, icons, etc. The OSD layer may also display some specific device status information. For example, OSD may be used to display information such as channel, volume size, brightness contrast, etc. Fig. 7 shows a schematic diagram of a video layer and a graphics layer in some embodiments. As shown in fig. 7, video data is displayed in the video layer, and various controls for controlling the video data, such as a pause key, a play progress bar, a volume control, and the like, are displayed in the OSD layer. The OSD layer may have a higher display level than the video layer, so that graphics and the like displayed by the OSD layer can be displayed on the video playback screen, so that the user performs an interactive operation based on the content displayed by the OSD layer.

Because the OSD layer needs to respond to the user interaction in real time, the dynamic display effect of OSD is better than that of the video layer, so in some embodiments, the picture display process of the display device 200 may be completed by the interaction of the video layer and the OSD layer. For example, in the process that the user clicks a picture icon (thumbnail) on the picture list interface to control the display device 200 to display the clicked picture in a full screen manner, the display device 200 displays the thumbnail icon of the picture through the OSD layer first, and displays a transition animation of the picture in a full screen manner through the OSD layer after the user clicks the thumbnail icon, and after the transition animation is displayed, the display device 200 displays the picture content through the video layer.

For a part of the display apparatus 200 that needs real-time response to the interactive contents, in order to present a better real-time response effect, the display apparatus 200 should shorten the delay between the interactive input time and the screen display result display time. To this end, in some embodiments, the display device 200 may present a real-time display effect by setting an acceleration layer. That is, an extended display layer (external OSD plane) may be additionally provided on the basis of the main OSD layer and the video layer in the video process module of the display apparatus 200. The extended display layer can be configured into different layer characteristics according to specific display effect requirements. For example, the bitmap refresh mode of the extended display layer may be modified, so that the extended display layer is refreshed in real time according to the region, thereby improving the display speed of the graphics, and at this time, the extended display layer may be used as an acceleration layer in a scene with high dynamic display effect.

The display device may display images at different refresh rates. The user may set the image refresh rate of the display. FIG. 8 illustrates an image refresh rate setting interface in some embodiments. As shown in fig. 8, the user may call up an image refresh rate setting interface through the system settings, including a plurality of image refresh rates that the display device is capable of setting, such as 30hz, 40hz, 60hz, and 75hz.

It can also be set as: the image refresh rate is dynamically set along with the frame rate of the video data, so that the refresh rate and the video frame rate are synchronous. For example, if the frame rate of video data is 30 frames, the image refresh rate of the display is set to 30 frames. If the frame rate of the video data is 60 frames, the image refresh rate of the display is set to 60 frames.

It should be noted that there is an upper limit on the image refresh rate of the display, that is, the maximum refresh rate that the display can support, also referred to as the physical refresh rate. The physical refresh rate determines the maximum image refresh rate that the display can display. For video data to be played, if its frame rate is higher than the physical resolution of the display, the display cannot be refresh rate synchronized with the video data. At this time, the image refresh rate may be set by the user himself or a default setting may be adopted.

The physical resolution of the display varies with the configuration of the display device system. The physical refresh rate of the display may reach 120hz or even 144hz. The greater the physical resolution of the display, the higher the image refresh rate that can be set, and the higher the picture quality that can be displayed, the better the viewing experience for the user.

The above-mentioned image refresh rate refers to a refresh rate of a video layer (video layer), which determines the picture quality of video content that can be viewed by a user. However, for a graphic layer (OSD layer) displaying a user manipulation interface, various UI interfaces including a system interface of a display device and a control interface of various application programs may be displayed therein. In view of the display stability of the layers, the display device will default to a fixed refresh rate for the OSD layer rather than being self-adjusting by the user. For example, the display device may set the refresh rate of the OSD layer to 60 frames to ensure normal use by the user. However, as the system is configured to be tall, the physical resolution of the display may far exceed the default refresh rate of the OSD layer. For example, the display physical resolution is 144hz, but the default refresh rate of the OSD layer is 60hz. At this time, the system performance of the display device can support setting the refresh rate of the OSD layer higher. For users, the lower refresh rate of the OSD layer may result in poor picture quality of the UI interface displayed therein, and poor viewing experience for the user.

In order to solve the above problems, the display device provided in the embodiments of the present application may have a function of adjusting a refresh rate of a graphics layer, and may adaptively adjust the refresh rate of the graphics layer according to a current system resource situation of the display device. The display device may be provided with a graphics layer refresh rate adjustment mode. When the OSD layer of the display device has the requirement of displaying the UI interface, the display device can judge whether the higher OSD layer refresh rate can be supported according to the system configuration of the display device, so that the refresh rate of the OSD layer is adaptively set. And dynamically adjusting the refresh rate of the OSD layer according to the video playing condition while the video content is displayed by the display equipment so as to ensure the normal display of the OSD layer and the video layer, thereby improving the use experience of a user.

In some embodiments, the user may send a graphics layer refresh rate adjustment mode instruction to the display device by operating a designated key of the remote control. And pre-binding the corresponding relation between the pattern layer refresh rate adjustment mode instruction and the remote controller key in the actual application process. For example, a graphic layer refresh rate adjustment mode key is set on the remote controller, when the user touches the key, the remote controller sends a graphic layer refresh rate adjustment mode instruction to the controller, and at this time, the controller controls the display device to enter the graphic layer refresh rate adjustment mode.

A graphic layer refresh rate adjustment mode option can also be set in a system UI interface of the display device, and when a user clicks the option, the display device can be controlled to enter or exit the graphic layer refresh rate adjustment mode.

In some embodiments, to prevent the user from triggering the graphics layer refresh rate adjustment mode by mistake, when the controller receives the graphics layer refresh rate adjustment mode command, the controller may control the display to display the graphics layer refresh rate adjustment mode confirmation information, so that the user performs secondary confirmation as to whether to control the display device to enter the graphics layer refresh rate adjustment mode. FIG. 9 illustrates a schematic diagram of graphics layer refresh rate adjustment mode acknowledgement information in some embodiments.

When the display device has a need to display the UI interface in the OSD layer, the refresh rate of the OSD may be automatically set to improve the viewing experience of the user. The UI interface displayed in the OSD layer may be a system interface or a control interface of an application program.

FIG. 10 illustrates an interactive flow diagram of components of a display device in some embodiments, including the steps of:

s101, acquiring system configuration information of display equipment, and acquiring layer refresh rate supporting information according to the system configuration information, wherein the layer refresh rate supporting information is used for representing whether a refresh rate supported by an OSD layer reaches a first refresh rate or not;

S102, setting the refresh rate of the OSD layer according to the layer refresh rate supporting information;

s103, responding to an instruction for generating a UI interface, and acquiring UI image generation time according to the refresh rate of the OSD layer;

s104, controlling the image generation unit to generate a UI image according to the UI image generation time;

s105, controlling the display to display the UI image in the OSD layer.

In some embodiments, the controller may set the refresh rate of the OSD layer according to the system configuration of the display device.

After the display device is started, the controller may first acquire system configuration information of the display device. The system configuration information comprises processing resource parameters, graphic processing parameters and memory bandwidth parameters. The processing resource parameters may include a CPU model number and a CPU frequency. Graphics processing parameters may include GPU model and GPU frequency. The memory bandwidth parameters may include a memory bandwidth model and a memory bandwidth frequency. Table 1 shows system configuration information for a display device in some embodiments.

TABLE 1

Hardware module	Model number	Frequency of
			GPU	G52*MC1	550M
CPU	A55*4	1.3G
			Memory bandwidth	80Mbps	2333MHZ

According to the system configuration shown in table 1, the maximum refresh rate that can be supported by the OSD layer of the corresponding display device is 120hz. Thus, for a display device, when its system configuration can reach the conditions shown in table 1, it is explained that the refresh rate that the OSD layer of the display device can support can also reach 120hz.

The controller may obtain layer refresh rate support information based on the system configuration information. The layer refresh rate supporting information is used for representing whether the refresh rate supported by the OSD layer reaches the first refresh rate. In the embodiment of the present application, the first refresh rate may be set to 120hz.

In some embodiments, the controller may determine whether the system configuration of the display device reaches the condition shown in table 1, so as to obtain the layer refresh rate supporting information of the display device, that is, whether the refresh rate supported by the OSD layer reaches the first refresh rate.

The embodiment of the application sets that: when any system configuration parameter of the display device reaches the degree shown in table 1, it is indicated that the refresh rate supported by the OSD layer of the display device can reach the first refresh rate. Thus, the parameters in table 1 may be set to preset thresholds.

If the processing resource parameter, the graphics processing parameter and the memory bandwidth parameter of the display device are all greater than or equal to the corresponding preset thresholds, namely the processing resource parameter is greater than or equal to the processing resource parameter threshold, the graphics processing parameter is greater than or equal to the graphics processing parameter threshold, and the memory bandwidth parameter is greater than or equal to the memory bandwidth parameter threshold, marking that the refresh rate supported by the graphics layer refresh rate supporting information is the refresh rate supported by the OSD layer to reach the first refresh rate. The processing resource parameter threshold, the graphics processing parameter threshold and the memory bandwidth parameter threshold are parameters in table 1.

Table 2 shows system configuration information for a display device in some embodiments.

TABLE 2

Hardware module	Framework	Frequency of
			GPU	G52*MC2	800M
CPU	A73*4	1.5G
			Memory bandwidth	100Mbps	2333MHZ

As with the system configuration shown in table 2, the CPU model is higher than that in table 1, and the CPU frequency is also higher than that in table 1, i.e., the processing resource parameter of the display device is greater than the preset threshold.

The GPU model is higher than the GPU model in table 1, and the GPU frequency is higher than the GPU frequency in table 1, i.e. the graphics processing parameters of the display device are greater than the preset threshold.

The memory bandwidth model is higher than the memory bandwidth model in table 1, and the memory bandwidth frequency is equal to the memory bandwidth frequency in table 1, i.e. the memory bandwidth parameter of the display device is greater than or equal to the preset threshold.

Accordingly, the OSD layer refresh rate of the display device of the configuration shown in table 2 can reach the first refresh rate.

If at least one of the processing resource parameter, the graphics processing parameter and the memory bandwidth parameter of the display device is smaller than the corresponding preset threshold, that is, the processing resource parameter is smaller than the processing resource parameter threshold, and/or the graphics processing parameter is smaller than the graphics processing parameter threshold, and/or the memory bandwidth parameter is smaller than the memory bandwidth parameter threshold. The layer refresh rate supporting information is marked as the OSD layer supporting a refresh rate not reaching the first refresh rate.

In some embodiments, the controller may set the refresh rate of the OSD layer according to the layer refresh rate support information.

If the layer refresh rate supporting information is that the refresh rate supported by the OSD layer reaches the first refresh rate, the refresh rate of the OSD layer is set as the physical refresh rate of the display.

If the layer refresh rate supporting information is that the refresh rate supported by the OSD layer does not reach the first refresh rate, the refresh rate of the OSD layer is set to the second refresh rate. In this embodiment of the present application, the second refresh rate may be set to 60hz, so as to ensure a normal viewing effect of the UI interface by the user.

The controller may generate the UI image in response to an instruction to generate the UI image. The UI image may be an image of a system interface or a control interface image of an application program.

The display device includes therein an image generation unit that can generate various UI images to display in an OSD layer. After setting the refresh rate of the OSD layer, the controller may control the image generating unit to generate a UI image, thereby acquiring a user interface to be finally displayed.

It should be noted that, not only various controls and text information may be included in the user interface, but also video content as shown at 540 in fig. 5. To this end, the controller may first detect whether there is video content to be displayed in the user interface. If so, the controller also needs to configure the video layer to display the video content.

In some embodiments, media asset data for a target media asset is obtained in response to a target media asset play instruction. It should be noted that, the target media asset playing instruction may be an instruction input by the user, for example, the user may start an application program for playing media assets, and select a certain target media asset to play, where the target media asset playing instruction may be sent by the corresponding application program. The target media asset playing command may also be indicated by the display device system, for example, a media asset recommendation control may be included in the system main interface, as shown in 540 in fig. 5, where video content may be directly played, so that corresponding media asset data needs to be acquired.

The controller may perform decoding on the asset data to obtain video data. The media asset data is provided by the film source, which may include video data and audio data. The controller may perform demultiplexing processing on the media data first, thereby obtaining original video data and audio data. The controller may perform decoding processing on the original video data and audio data, respectively, so as to obtain video data and audio data that can be played.

The display device may further include an image quality processing unit. The controller may control the image quality processing unit to perform image quality processing on the video data, thereby acquiring the media image. The media asset image may be displayed in the video layer.

When both UI image and video content are included in the user interface to be displayed, the controller may combine the two to obtain the final user interface.

In some embodiments, the controller may first acquire the UI image generation time according to the refresh rate of the OSD layer when controlling the image generation unit to generate the UI image. The OSD layer displays multiple frames of UI images at a corresponding refresh rate, and the controller may obtain the generation time of each frame of UI image.

The controller may obtain the image display duration according to the refresh rate of the OSD layer. The refresh rate indicates the number of images displayed in 1 second, and when the refresh rate is 60 frames, the image display duration of each frame of UI image is 1/60 second, and when the refresh rate is 120 frames, the image display duration of each frame of UI image is 1/120 second.

The controller may calculate the image generation interval according to the generation time of the previous frame UI image, the image display duration, and the image request time. The image request time is a first time or a second time.

When one frame of UI image is generated, a corresponding application program transmits an image generation request. For example, for a system interface, a system application controlling the system interface may send an image generation request on a frame-by-frame basis. For a control interface of an application, the application will send an image generation request frame by frame. That is, when a frame of UI image needs to be displayed, the corresponding application program transmits a request for generating the frame of UI image.

In the case where video content is to be included in the end user interface, the UI image and the video content need to be combined, and the application program also sends a request to combine the frame of UI image with the video data. I.e. the application instructs the display device to generate a frame of UI image, both requests may be sent.

In the embodiment of the present application, a time point when the application program transmits a request for generating the current frame UI image is referred to as a first time, and a time point when the application program transmits a request for synthesizing the current frame UI image with the video data is referred to as a second time. It should be noted that, the first time and the second time do not have fixed time sequences, the application may first request to generate the UI image of the current frame, or may first request to combine the UI image of the current frame with the video data. It is possible to set: the image request time is a later point in time of the first time and the second time.

If the first time is earlier than the second time, the image request time is the second time; the image request time is the first time if the first time play is later than the second time.

The controller may calculate the image generation interval according to the following formula: T1+T-T2. Wherein T1 represents the generation time of the last frame UI image, T represents the image display duration, and T2 represents the image request time.

After calculating the image generation interval, the controller may calculate the sum of the generation time of the previous frame UI image and the image generation interval to acquire the generation time of the current frame UI image.

In some embodiments, the controller may control the image generation unit to generate the UI image according to the UI image generation time. A timer may be set in advance, and when the system time reaches the UI image generation time, the controller may send a UI image generation instruction to the image generation unit to instruct the image generation unit to generate the UI image.

The image generation unit may generate UI images including operations of designing UI layout of the images, content drawing, rendering the images, and the like.

The controller may control the display to display the UI image in the OSD layer.

In some embodiments, when video content is present in the user interface, the controller may perform a composition process on the media asset image and the UI image to generate the user interface.

The controller may control the display to display a user interface; the UI image is displayed through an OSD layer, and the media resource image is displayed through a video layer.

It should be noted that, when the display device plays the video content, the system performance is greatly floated, for example, the residual ratio of the memory bandwidth of the display device may be greatly changed, and the system performance may affect the actual refresh rate of the OSD layer. If the refresh rate of the OSD layer is set to a fixed value at all times, problems may occur in the picture of the UI interface. To this end, the display device may dynamically adjust the refresh rate of the OSD layer.

In some embodiments, the controller may detect a video data display state of the display to determine whether video content is displayed in the display.

The controller may obtain video data scale information in the display if video data is being displayed in the display. The controller may update the refresh rate of the OSD layer according to the video data rate information.

The controller may not update the refresh rate of the set OSD layer if the video data is not displayed in the display.

In some embodiments, the controller may update the refresh rate of the OSD layer differently depending on the video content display scale in the display while video data is being displayed in the display.

If the video data proportion information characterizes the display to display the video data in full screen, the controller can continuously detect the playing state of the video data to determine whether the video is played normally.

If the playing state is that the display is playing, at the moment, the display always displays the video data in full screen, namely, the OSD layer does not display the UI interface currently, the controller can detect the memory bandwidth residual duty ratio of the display device and update and set the refresh rate of the OSD layer according to the memory bandwidth residual duty ratio.

If the playing state is stop, the OSD layer has a requirement for displaying a UI interface, for example, the user controls the video to pause playing, and the OSD layer may display a related UI interface, which may include a pause control. The controller may control the image quality processing unit to stop performing the image quality processing on the video data.

The image quality processing unit can influence the system performance, thereby influencing the actual refresh rate of the OSD layer, and the stability of the refresh rate of the OSD layer can be ensured by stopping the operation of the image quality processing unit.

In some embodiments, the controller may first control the image quality processing unit to stop performing the image quality processing on the video data if the video data proportion information characterizes that the display is not full-screen displaying the video data. In a state of non-full screen display, the user interface includes both video data and UI interface images. At this time, the frame rate of the video data is low, and the workflow of the image quality processing unit can be closed, so that the stability of the refresh rate of the OSD layer is improved, and the display stability of the UI interface image is ensured.

The controller may detect a play state of the video data.

If the playing state is that the video data is being played, i.e. the display is not displaying the video data full screen all the time, the controller can detect the remaining memory bandwidth duty ratio of the display device and update and set the refresh rate of the OSD layer according to the remaining memory bandwidth duty ratio.

If the play state is stop play, the controller can update the refresh rate of the OSD layer according to the layer refresh rate supporting information.

In some embodiments, when the refresh rate of the OSD layer is set according to the memory bandwidth remaining duty cycle update, the controller may first obtain the target memory bandwidth duty cycle range corresponding to the memory bandwidth remaining duty cycle based on the preset refresh rate list. FIG. 11 illustrates a schematic diagram of a refresh rate list in some embodiments. As shown in fig. 11, the refresh rate list stores a plurality of memory bandwidth duty ratio ranges and the correspondence relationship between refresh rates. When the memory bandwidth is smaller than 20%, the refresh rate of the OSD layer is updated to be 10hz. When the memory bandwidth is in the range of 20% -30%, the refresh rate of the OSD layer is updated and set to 15hz. When the memory bandwidth is in the range of 30% -40%, the refresh rate of the OSD layer is updated to be 30hz. When the memory bandwidth is in the range of 40% -60%, the refresh rate of the OSD layer is updated to 60hz. When the memory bandwidth is in the range of 60% -70%, the refresh rate of the OSD layer is updated and set to 120hz. When the memory bandwidth is greater than 70%, the OSD layer refresh rate is set to 144hz.

The controller can acquire a target refresh rate corresponding to the target memory bandwidth duty ratio range, and update the refresh rate of the OSD layer to set the target refresh rate.

In some embodiments, the controller controls the display to no longer display video data when the user instructs to turn off the video content. The controller can update the refresh rate of the OSD layer according to the layer refresh rate supporting information of the display device so as to improve the viewing experience of the user.

The embodiment of the application also provides a layer refresh rate setting method, which is applied to the display device and comprises the following steps:

step 101, acquiring system configuration information of a display device, and acquiring layer refresh rate supporting information according to the system configuration information, wherein the layer refresh rate supporting information is used for representing whether a refresh rate supported by an OSD layer reaches a first refresh rate or not;

102, setting the refresh rate of the OSD layer according to the layer refresh rate supporting information;

step 103, responding to an instruction for generating a UI interface, and acquiring UI image generation time according to the refresh rate of the OSD layer;

step 104, controlling the image generating unit to generate a UI image according to the UI image generating time;

and 105, controlling the display to display the UI image in the OSD layer.

In some embodiments, the system configuration information includes processing resource parameters, graphics processing parameters, and memory bandwidth parameters. Acquiring the layer refresh rate supporting information according to the system configuration information, and further comprising:

if the processing resource parameter is greater than or equal to the processing resource parameter threshold, the graphics processing parameter is greater than or equal to the graphics processing parameter threshold, and the memory bandwidth parameter is greater than or equal to the memory bandwidth parameter threshold, marking that the refresh rate supported by the OSD layer reaches a first refresh rate as the refresh rate supported by the graphics layer;

if the processing resource parameter is less than the processing resource parameter threshold, and/or the graphics processing parameter is less than the graphics processing parameter threshold, and/or the memory bandwidth parameter is less than the memory bandwidth parameter threshold, marking the layer refresh rate support information as the refresh rate supported by the OSD layer does not reach the first refresh rate.

In some embodiments, setting the refresh rate of the OSD layer according to the layer refresh rate support information further includes:

if the layer refresh rate supporting information is that the refresh rate supported by the OSD layer reaches the first refresh rate, setting the refresh rate of the OSD layer as the physical refresh rate of the display; if the layer refresh rate supporting information is that the refresh rate supported by the OSD layer does not reach the first refresh rate, the refresh rate of the OSD layer is set to the second refresh rate.

In some embodiments, further comprising:

and responding to the target media asset playing instruction, and acquiring media asset data of the target media asset. Decoding is performed on the media asset data to obtain video data. The control image quality processing unit performs image quality processing on the video data to acquire a media image.

In some embodiments, controlling the display to display the UI image in the OSD layer further comprises:

a composition process is performed on the asset image and the UI image to generate a user interface. Controlling the display to display a user interface; the UI image is displayed through an OSD layer, and the media resource image is displayed through a video layer.

In some embodiments, the UI image generation time is obtained according to a refresh rate of the OSD layer, further comprising:

and acquiring the image display time according to the refresh rate of the OSD layer.

Calculating an image generation interval according to the generation time, the image display time and the image request time of the previous frame of UI image; the image request time is a first time or a second time, wherein the first time is the time for requesting to generate the UI image of the current frame, and the second time is the time for requesting to synthesize the UI image of the current frame with the video data; if the first time is earlier than the second time, the image request time is the second time; if the first time is played later than the second time, the image request time is the first time.

The sum of the generation time of the last frame UI image and the image generation interval is calculated to acquire the generation time of the current frame UI image.

In some embodiments, after controlling the display to display the UI image in the OSD layer, further comprising:

the video data display state of the display is detected. If video data is being displayed in the display, video data proportion information in the display is acquired. And updating and setting the refresh rate of the OSD layer according to the video data proportion information.

In some embodiments, if the video data proportion information characterizes that the display displays video data in full screen, updating the refresh rate of the set OSD layer further comprises:

the play state of the video data is detected. If the playing state is that the display device is playing, detecting the residual memory bandwidth duty ratio of the display device, and updating and setting the refresh rate of the OSD layer according to the residual memory bandwidth duty ratio. If the play state is stop play, the control image quality processing unit stops performing image quality processing on the video data.

In some embodiments, if the video data proportion information characterizes that the display is not full screen displaying video data, updating the refresh rate of the set OSD layer further comprises:

the control image quality processing unit stops performing image quality processing on the video data. The play state of the video data is detected. If the playing state is that the display device is playing, detecting the residual memory bandwidth duty ratio of the display device, and updating and setting the refresh rate of the OSD layer according to the residual memory bandwidth duty ratio. And if the playing state is that the playing is stopped, updating and setting the refresh rate of the OSD layer according to the layer refresh rate supporting information.

In some embodiments, setting the refresh rate of the OSD layer according to the memory bandwidth remaining duty cycle update further includes:

acquiring a target memory bandwidth occupation ratio range corresponding to the memory bandwidth residual occupation ratio based on a preset refresh rate list; the refresh rate list stores the corresponding relation between the bandwidth occupation ratio ranges of a plurality of memories and the refresh rate. And acquiring a target refresh rate corresponding to the target memory bandwidth duty ratio range, and updating and setting the refresh rate of the OSD layer to the target refresh rate.

The same and similar parts of the embodiments in this specification are referred to each other, and are not described herein.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments or some parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display;

an image generation unit configured to generate a UI image;

A controller configured to:

and controlling the display to display the UI image in the OSD layer.

2. The display device of claim 1, wherein the system configuration information includes processing resource parameters, graphics processing parameters, and memory bandwidth parameters; the controller performs obtaining layer refresh rate support information according to the system configuration information, and is further configured to:

if the processing resource parameter is greater than or equal to a processing resource parameter threshold, the graphics processing parameter is greater than or equal to a graphics processing parameter threshold, and the memory bandwidth parameter is greater than or equal to a memory bandwidth parameter threshold, marking the layer refresh rate support information as that the refresh rate supported by the OSD layer reaches a first refresh rate;

And if the processing resource parameter is smaller than the processing resource parameter threshold, and/or the graphics processing parameter is smaller than the graphics processing parameter threshold, and/or the memory bandwidth parameter is smaller than the memory bandwidth parameter threshold, marking the layer refresh rate supporting information as that the refresh rate supported by the OSD layer does not reach the first refresh rate.

3. The display device of claim 1, wherein the controller executing the setting of the refresh rate of the OSD layer according to the layer refresh rate support information is further configured to:

if the layer refresh rate supporting information is that the refresh rate supported by the OSD layer reaches a first refresh rate, setting the refresh rate of the OSD layer as a physical refresh rate of a display;

and if the layer refresh rate supporting information is that the refresh rate supported by the OSD layer does not reach the first refresh rate, setting the refresh rate of the OSD layer to be the second refresh rate.

4. The display device according to claim 1, further comprising: an image quality processing unit; the controller is further configured to:

responding to a target media resource playing instruction, and acquiring media resource data of the target media resource;

decoding the media asset data to obtain video data;

Controlling the image quality processing unit to perform image quality processing on the video data so as to acquire a media image;

the controller performs control of the display to display the UI image in the OSD layer, and is further configured to:

performing a composition process on the media asset image and the UI image to generate a user interface;

controlling the display to display a user interface; and the UI image is displayed through the OSD layer, and the media resource image is displayed through the video layer.

5. The display device of claim 4, wherein the controller performs the obtaining of UI image generation time according to a refresh rate of the OSD layer, further configured to:

acquiring image display time according to the refresh rate of the OSD layer;

calculating an image generation interval according to the generation time of the UI image of the previous frame, the image display duration and the image request time; the image request time is a first time or a second time, the first time is the time for requesting to generate the current frame UI image, and the second time is the time for requesting to synthesize the current frame UI image and the video data; if the first time is earlier than the second time, the image request time is the second time; if the first time is later than the second time, the image request time is the first time;

And calculating the sum of the generation time of the previous frame UI image and the image generation interval to acquire the generation time of the current frame UI image.

6. The display device according to claim 4, wherein the controller, after performing control of the display to display the UI image in the OSD layer, is further configured to:

detecting a video data display state of the display;

if the video data is being displayed in the display, acquiring the video data proportion information in the display;

and updating and setting the refresh rate of the OSD layer according to the video data proportion information.

7. The display device of claim 6, wherein if the video data proportion information characterizes a full screen display of video data by a display, the controller performs an update to set a refresh rate of the OSD layer, further configured to:

detecting the playing state of video data;

if the playing state is in playing, detecting the residual duty ratio of the memory bandwidth of the display equipment, and updating and setting the refresh rate of the OSD layer according to the residual duty ratio of the memory bandwidth;

and if the playing state is to stop playing, controlling the image quality processing unit to stop executing image quality processing on the video data.

8. The display device of claim 6, wherein if the video data proportion information characterizes that the display is not full screen displaying video data, the controller performs an update to set a refresh rate of the OSD layer, further configured to:

controlling the image quality processing unit to stop performing image quality processing on the video data;

detecting the playing state of video data;

and if the playing state is that the playing is stopped, updating and setting the refresh rate of the OSD layer according to the layer refresh rate supporting information.

9. The display device of claim 7 or 8, wherein the controller performs setting a refresh rate of the OSD layer according to the memory bandwidth remaining duty cycle update, further configured to:

acquiring a target memory bandwidth occupation ratio range corresponding to the memory bandwidth residual occupation ratio based on a preset refresh rate list; the refresh rate list stores the corresponding relation between a plurality of memory bandwidth occupation ratio ranges and refresh rates;

and acquiring a target refresh rate corresponding to the target memory bandwidth duty ratio range, and updating and setting the refresh rate of the OSD layer to the target refresh rate.

10. A layer refresh rate setting method applied to a display device, the method comprising:

and controlling a display to display the UI image in the OSD layer.