CN117687584A - Display device and picture display method - Google Patents

Abstract

Some embodiments of the application provide a display device and a picture display method. After the user controls the display device to display the target picture, the display device sends a data acquisition request to the server. The server transmits the picture data and the picture size of the target picture to the display device. The display device performs decoding processing on the picture data to obtain decoded data. When the picture size is detected to be larger than a preset picture size threshold, the display equipment compresses the decoded data to obtain compressed data, renders the compressed data, and displays the first picture to be displayed. For pictures with larger data volume, the display equipment can optimize the pictures, so that the phenomenon that the display equipment cannot normally run is avoided, and the use experience of a user is improved.

Description

Display device and picture display method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a picture display method.

Background

The display device is a terminal device capable of outputting specific display pictures, along with the rapid development of the display device, the functions of the display device are more and more abundant, the performance is more and more powerful, the bidirectional man-machine interaction function can be realized, and various functions such as video, entertainment and data are integrated, so that the user diversified and personalized requirements are met. The user can watch various media and television channels by using the display device, and can play games and video chat by using the display device.

The display device may have a web page access function to access various web pages in the network. A user may access a web page desired to be viewed using a browser application installed in a display device, which may be displayed by the display device for viewing by the user.

However, when a user accesses a web page using a display device, the web page may include a picture with a larger data amount, and such a picture may occupy a system memory of the display device. When the system memory is too high, the display device can close the current webpage or abnormal exit occurs, so that the user can not watch the webpage any more, and even the display device can not respond to the user command any more, and the use experience of the user is poor.

Disclosure of Invention

Some embodiments of the application provide a display device and a picture display method. In the related art, the problem that the use experience of a user is affected due to the fact that the picture with larger data size in the webpage occupies the system memory of the display device greatly and the display device closes the webpage or exits abnormally is solved.

In a first aspect, some embodiments of the present application provide a display device including a display and a controller. Wherein the controller is configured to perform the steps of:

Responding to an instruction input by a user for indicating to display a target picture, and sending a data acquisition request to a server, wherein the data acquisition request is used for acquiring picture data and picture information of the target picture;

receiving picture data and picture information sent by the server, wherein the picture information comprises the picture size of the target picture;

decoding the picture data to obtain decoded data;

based on the fact that the picture size is detected to be larger than a preset picture size threshold, compressing the decoded data to obtain compressed data;

rendering and drawing the compressed data to obtain a first picture to be displayed, and controlling the display to display the first picture to be displayed.

In a second aspect, some embodiments of the present application provide a method for displaying a picture, which is applied to a display device, including:

responding to an instruction input by a user for indicating to display a target picture, and sending a data acquisition request to a server, wherein the data acquisition request is used for acquiring picture data and picture information of the target picture;

receiving picture data and picture information sent by the server, wherein the picture information comprises the picture size of the target picture;

Decoding the picture data to obtain decoded data;

based on the fact that the picture size is detected to be larger than a preset picture size threshold, compressing the decoded data to obtain compressed data;

rendering and drawing the compressed data to obtain a picture to be displayed, and controlling the display to display the picture to be displayed.

According to the technical scheme, some embodiments of the application provide a display device and a picture display method. After the user controls the display device to display the target picture, the display device sends a data acquisition request to the server. And the server sends the picture data and the picture size of the target picture to the display device. The display device performs decoding processing on the picture data to obtain decoded data. When the picture size is detected to be larger than a preset picture size threshold, the display equipment compresses the decoded data to obtain compressed data, renders the compressed data, and displays the first picture to be displayed. For pictures with larger data volume, the display equipment can optimize the pictures, so that the display equipment is prevented from operating normally without evidence, and the use experience of a user is improved.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

FIG. 2 illustrates a hardware configuration block diagram of a control device according to some embodiments;

FIG. 3 illustrates a hardware configuration block diagram of a display device according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device according to some embodiments;

FIG. 5 illustrates a schematic diagram of an application panel in some embodiments;

FIG. 6 illustrates a schematic diagram of a browser page in some embodiments;

FIG. 7 illustrates a media asset introduction page in some embodiments;

FIG. 8 is a schematic diagram illustrating display of picture optimization mode validation information in a display in some embodiments;

FIG. 9 illustrates an interactive flow diagram for components of a display device in some embodiments;

FIG. 10 illustrates a schematic diagram of a browser application in some embodiments;

FIG. 11 illustrates a flow diagram for a display device to download picture data in batches in some embodiments;

FIG. 12 illustrates a schematic diagram of a display setup interface in some embodiments;

FIG. 13 illustrates a schematic diagram of decoding data in some embodiments;

FIG. 14 is a schematic diagram illustrating the setting of a flag for a pixel in some embodiments;

FIG. 15 illustrates a schematic diagram of a target two-dimensional set of pixels in some embodiments;

FIG. 16 is a schematic diagram illustrating interpolation of pixel points using OpenGL scale-up filtering in some embodiments;

fig. 17 is a flow diagram of a method of displaying pictures in some embodiments.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments of the present application, a user interface may be displayed in the display. The user interface may be a specific target image, for example, various media materials obtained from a network signal source, including video, pictures and the like. The user interface may also be some UI interface of the display device, such as a system recommendation page or the like.

In some embodiments, the controller may control the display to display the user interface when the user controls the display device to power on. A "My applications" control may be included in the user interface. The user may trigger entry into the corresponding application panel by clicking on the My application control to enter a display instruction for the application panel page. It should be noted that, the user may also input the selection operation of the function control in other manners to trigger entering into the application panel. For example, control is entered into the application panel page using a voice control function, a search function, or the like.

The display device may have various functions, such as play of media assets, entertainment games, video chat, etc., to provide a variety of services to the user. In order to meet the needs of users, the display device also has a web page access function. A user may access various web pages in a network using a display device. Specifically, a browser Application (APP) may be installed in the display device. After the user opens the browser application by using the display device, the user can access the webpage to be watched by using the browser application, and the display device can further display the webpage resource for the user to watch.

In some embodiments, the user may view through the application panel applications that the display device has installed, i.e., functions supported by the display device. The user may further select one of the applications and open it to implement the functionality of the application. It should be noted that, the application installed in the display device may be a system application or a third party application. And the user controls the display device to realize the corresponding function of the application program by starting the application program. Fig. 5 shows a schematic diagram of an application panel in some embodiments. As shown in fig. 5, the application panel includes three controls, "browser", "cable tv", and "video chat". Wherein the user may control the display device to open the browser application by clicking on the "browser" control. The user can perform corresponding operations in the browser, such as accessing a web page, etc. The user may click on the "cable" control to view some television channels, including various television programs provided by the cable provider, using the display device. The user may click on the "video chat" control to engage in video chat with others using the display device.

In some embodiments, the controller 250 may control the display 260 to directly display the application program interface when the user controls the display device to power on. The application program interface may be the application panel shown in fig. 5, which contains all application programs installed by the display device, such as a browser application program.

In some embodiments, after the user controls the display device to open the browser, the display device may display the browser page. FIG. 6 illustrates a schematic diagram of a browser page in some embodiments. As shown in fig. 6, the browser page includes a plurality of web page controls. The user can select one of the web page controls, so that the display device is controlled to access the web page corresponding to the web page control. Specifically, the controller 250 may detect a user selection operation of a web page control in a browser page. After detecting that the user selects the target web page control, the controller 250 may acquire web page information of a target web page corresponding to the target web page control, thereby controlling the display 260 to display the target web page. The user may access the target web page using the display device.

It should be noted that, when the user accesses the web page using the display device, the web page may include various types of content, such as text content, picture content, and the like. When the display device displays the picture content in the webpage, the picture is downloaded, a part of memory space is separated, and the downloaded picture exists in the part of memory space. However, the data size of the pictures in the web page may be large, and downloading such pictures may occupy the system memory of the display device greatly. Considering that the memory of the display device is limited, when the current memory of the display device is smaller, if the picture to be displayed occupies a larger memory, that is, the browser currently occupies a higher memory of the display device, the display device can forcedly exit from the current webpage, so that the user cannot continue to watch the webpage. Even the display device may crash, and thus cannot respond to any instruction of the user, so that the use experience of the user is poor.

This may also occur when searching for media assets. The user may select a particular asset for viewing, such as movie a, using the display device. The display device may display a media asset introduction page corresponding to the media asset. FIG. 7 illustrates a media asset introduction page in some embodiments. As shown in fig. 7, the media introduction page includes a "start play" option and a "return" option, and the user may further select to play "movie a" or return to the previous interface. The media asset introduction page also includes a media asset introduction and a media asset poster. The media asset poster is also a picture, and a large amount of data may exist. Therefore, the display device may not continue to display the interface after downloading the media asset poster, resulting in the user being unable to view the media asset.

Therefore, the display device provided by the embodiment of the application has a picture optimization function. The display device can determine whether the display device can normally operate after downloading the picture according to the picture information of the picture to be downloaded, such as the picture size, wherein the picture size refers to the memory space occupied by the picture, so as to judge whether the downloaded picture needs to be optimized to avoid the problems of web pages or system breakdown and the like. The display device may be provided with a picture optimization mode. When the display device enters the picture optimization mode, the display device can start a picture optimization function to determine whether the picture to be downloaded needs to be optimized.

In some embodiments, the user may send a picture optimization mode instruction to the display device by operating a designated key of the remote control. And pre-binding the corresponding relation between the picture optimization mode instruction and the remote controller key in the actual application process. For example, a picture optimization mode key is set on the remote controller, when the user touches the key, the remote controller sends a picture optimization mode instruction to the controller 250, and at this time, the controller 250 controls the display device to enter a picture optimization mode. When the user touches the key again, the controller 250 may control the display device to exit the picture optimization mode.

In some embodiments, the picture optimization mode instruction may also be sent to the display device when the user controls the display device using the smart device, for example using a cell phone. In the practical application process, a control can be set in the mobile phone, whether to enter a picture optimization mode can be selected through the control, so that a picture optimization mode instruction is sent to the controller 250, and the controller 250 can control the display device to enter the picture optimization mode.

In some embodiments, a continuous click command may be issued to the mobile phone when the user controls the display device using the mobile phone. The continuous click command refers to: and in a preset period, the number of times of clicking the same area of the touch screen of the mobile phone by the user exceeds a preset threshold value. For example: when the user clicks on a certain area of the mobile phone touch screen for 3 times in 1s, the user is regarded as a continuous click command. After receiving the continuous click command, the mobile phone may send a picture optimization mode command to the display device, so that the controller 250 controls the display device to enter a picture optimization mode.

In some embodiments, when the user controls the display device using the mobile phone, it may also be set to: when detecting that the touch pressure value of a user on a certain area of the touch screen of the mobile phone exceeds a preset pressure threshold, the mobile phone can send a picture optimization mode instruction to the display device.

A picture optimization mode option can also be set in a UI interface of the display device, and when a user clicks the option, the display device can be controlled to enter or exit the picture optimization mode.

In some embodiments, to prevent the user from false triggering the picture optimization mode, when the controller 250 receives the picture optimization mode instruction, the display 260 may be controlled to display the picture optimization mode confirmation information, so that the user performs secondary confirmation whether to control the display device to enter the picture optimization mode. Fig. 8 illustrates a schematic diagram of display of picture optimization mode confirmation information in display 260 in some embodiments.

FIG. 9 illustrates an interactive flow diagram for components of a display device in some embodiments.

In some embodiments, the user may first control the display device to be turned on, i.e., the user may input a power-on instruction to the display device. The display device may then respond to a user's power-on command, and the controller 250 may control the display device to enter a power-on state and may control the display 260 to display a system recommendation page. The system recommendation page may include a plurality of functionality controls, such as a web browsing control, for opening a browser to access various web pages.

If a user selection of a web browsing control is detected, the controller 250 may launch a browser application and control the display 260 to display a browser recommendation page. The browser recommendation page may be a web page recommendation page set by default by the browser, and the user may perform various operations in the web page recommendation page, for example, select a target web page to access, and the controller 250 may control the display 260 to display the target web page. The user may also set a target web page directly as a browser recommendation page, so that the target web page may be directly displayed in the display 260 when the display device starts the browser next time.

For a target web page that the user wants to access, multiple controls may be included, such as a text control for displaying text content, a picture control for displaying picture content, and so forth. For a picture control, the control may be a web page link, and when the user clicks on the picture control, the browser may access the link to cause the display 260 to display the corresponding picture. The picture control may also be in the form of a thumbnail of the picture, and when clicked by the user, the browser may download the original picture to cause the display 260 to display the original picture. Thus, for a certain target picture control in a target web page, the target picture control is used to access the target picture.

If the selection operation of the target picture control by the user is detected, it may be determined that the instruction for displaying the target picture is input by the user, and the controller 250 may download the target picture from the server and determine whether the optimization processing is required for the target picture, so as to ensure the normal operation of the display device.

The controller 250 may control the browser application to download the picture and perform optimization processing on the picture. FIG. 10 illustrates a schematic diagram of a browser application in some embodiments. As shown in fig. 10, the browser application may include a network protocol parsing and downloading module, a decoding module, a compression module, a rendering module, and an output module. The network protocol analysis and downloading module can determine the transmission protocol between the display equipment and the server, so that various data can be downloaded in the server. The decoding module is used for decoding the downloaded data. The compression module may compress the decoded data. The rendering and drawing module can draw the decoded data or the compressed data, so as to obtain the content to be displayed. The output module transmits the content to be displayed to the display 260 for display.

In some embodiments, in response to an instruction to display a target picture entered by a user, the controller 250 may first generate a data acquisition request for acquiring picture data and picture information of the target picture. The controller 250 may transmit the data acquisition request to the server to cause the display device to download the related data of the target picture from the server.

The network protocol analysis and downloading module in the browser application can analyze the network protocol and download data. The controller 250 may control the network protocol parsing and downloading module to be communicatively connected to the server. The network protocol analysis and downloading module can determine a network transmission protocol between the two parties, so that a communication connection request is sent to the server according to the network transmission protocol, and the browser application program is requested to establish communication connection with the server. The network Transport protocol may be a TCP (Transmission Control Protocol ) protocol, which is a connection-oriented, reliable, byte-stream-based Transport layer (Transport layer) communication protocol. After the server-side replies, the browser application may establish a TCP connection with the server. After the connection is established, the processes of the two parties perform read-write operation through the established connection, and the browser application program can further acquire data from the server.

In response to a data acquisition request sent by the display device, the server may send related data of the target picture, such as picture data and picture information, to the display device. The picture information may include a picture size of the target picture and a picture resolution of the target picture.

The controller 250 may perform decoding processing on the picture data based on a decoding module of the browser application to obtain decoded data. The decoding module is used for decoding the picture data, and the specific selected decoding mode can be determined according to the format of the picture data. For example, if the picture data sent by the server is in JPEG format, the decoding module may use a JPEG decoding library to decode the picture data.

In some embodiments, considering that the space occupied by the picture data after decoding is larger than that before decoding, if all the picture data of the target picture are decoded at the same time, the amount of the decoded data may be larger, which may cause the display device to fail to operate normally. Therefore, the downloaded picture data can be decoded in batches in the process of downloading the picture data, and the decoded data can be optimized.

Specifically, when the display device downloads the picture data from the server, the downloading can be performed only after a period of time, that is, the server continuously transmits the picture data to the display device until all the picture data of the target picture are transmitted. The downloading time and downloading rate of the picture data can be determined by the communication protocol of the display device and the server and the network condition. For the picture data of the target picture, all the picture data may include a plurality of picture clip data. That is, the server may divide the complete picture data of the target picture into a plurality of picture segment data, so as to sequentially transmit each picture segment data to the display device. Among all the picture data, the server may set a clip flag for distinguishing the picture clip data to some of the picture data. The server continues to send the picture data to the display device, between every two picture data with a clip marker, which may be considered as one picture clip data.

To ensure that the display device can operate properly, the controller 250 may perform a decoding process on each picture segment data one by one. Specifically, upon receiving the picture data transmitted from the server, the controller 250 may detect whether the picture data includes a clip flag, thereby identifying each picture clip data. If it is detected that the server transmits a complete picture segment data, the controller 250 may perform decoding processing on the picture segment data, thereby obtaining decoded data corresponding to the picture segment data. When decoding a certain picture segment data, the controller 250 will continue to send the next picture segment data to the display device. The controller 250 may save the picture segment data transmitted later by the server into a preset storage area in consideration of the fact that the decoding process takes a certain time. When the controller 250 finishes decoding the last picture segment data, the next picture segment data may be acquired in the storage area to perform decoding.

FIG. 11 illustrates a flow diagram for a display device to download picture data in batches in some embodiments. As shown in fig. 11, the display device may download picture data from a server. When the partial picture data is downloaded, the display device can decode the partial picture data to obtain decoded data after detecting that a complete picture fragment data is downloaded. The display device may also compress the decoded data to obtain compressed data. At this time, the display device has acquired compressed data corresponding to the downloaded complete picture segment data, can continue to download the remaining picture data, and repeat the above processing again after downloading the complete picture segment data again. And obtaining the compressed data corresponding to each picture fragment data until all the picture fragment data are downloaded and processed. The display device may generate a picture to be displayed according to all the compressed data, and control the display 260 to display.

In some embodiments, after obtaining the decoded data, the controller 250 may perform compression processing on the decoded data to reduce the space occupied by the data, thereby implementing optimization of the picture data.

Specifically, the controller 250 may first detect the size of the target picture, so as to determine whether the target picture needs to be optimized. A picture size threshold may be preset, and the picture size threshold may be set by the user, or may be a default threshold set in the display device. The controller 250 may determine whether the picture size of the target picture exceeds the picture size threshold.

If the picture size is larger than a preset picture size threshold, the target picture is larger than the expected memory occupied space, and the target picture needs to be optimized. The controller 250 may perform compression processing on the decoded data to obtain compressed data.

If the picture size is less than or equal to the preset picture size threshold, which indicates that the target picture does not exceed the expected memory space, the controller 250 may not compress the decoded data, but may directly display the original picture.

In some embodiments, the decoded data may be compressed when optimization of the target picture is required. The controller 250 may compress the decoded data based on a compression module of the browser application.

In consideration of the decoding process of sequentially decoding each picture segment data, the controller 250 may perform compression processing on the decoded data after obtaining the decoded data corresponding to one picture segment data. In general, the downloading process of the picture data, the decoding process of the picture clip data, and the compression process of the decoded data may be performed simultaneously. After the compression process of the compression module for a certain decoded data is completed, the decoding module may already obtain the next decoded data, and the controller 250 may continue to control the compression module to compress the next decoded data.

In some embodiments, the controller 250 may first obtain the compression ratio of the decoded data as a parameter of the compression process when performing the compression process on the decoded data.

Specifically, the controller 250 may first obtain the display resolution currently output by the display 260. The display resolution refers to: the resolution of the display 260 to be displayed, i.e. the resolution of the picture to be displayed in the display 260. The controller 250 may display a picture of the resolution according to the display 260 according to the display resolution.

The user may set the display resolution currently output by the display 260 by himself, thereby controlling the display 260 to output different picture effects. The display resolution refers to the precision of the screen display picture, that is, the number of pixels in the picture displayed in the display 260, and is generally expressed as (the number of horizontal pixels×the number of vertical pixels). For example, a resolution of 1920 x 1080 refers to: the number of horizontal pixels of the picture is 1920, and the number of vertical pixels is 1080. Since the dots, lines and planes in the picture are all composed of pixels, the greater the display resolution, the more pixels representing the picture displayed in the display 260, the more information the picture can display, so that the finer the picture, the more clear the picture. In general, the size of the screen of the display 260 may have some effect on the display effect of the picture resolution. In the case where the display resolution is fixed, that is, the resolution displayed by the display 260 is fixed, the smaller the size of the display 260, the clearer the picture. Conversely, when the size of the display 260 is fixed, the higher the resolution at which the display 260 displays, the clearer the picture.

There will be a fixed physical resolution for the display 260. The physical resolution represents the maximum resolution at which the display 260 can output a display. For example, for a display 260 having a resolution of 3840×2160, i.e., the physical resolution of the display 260 is 3840×2160, the maximum resolution at which the display 260 can output a display is 3840×2160. Meanwhile, the display 260 may output a picture with a resolution of 3840×2160 or less, for example, 1920×1080 resolution. The controller 250 may control the display 260 to output pictures of different resolutions within the physical resolution.

The user may find the display 260 setting interface in the system setting UI interface of the display device and set the display resolution of the display 260 in the display 260 setting interface. Fig. 12 illustrates a schematic diagram of a display 260 setup interface in some embodiments. As shown in fig. 12, display 260 setup interfaces include display resolution controls, brightness controls, color temperature controls, contrast controls, and restore factory settings controls. The user may click on a display resolution control and controller 250 controls display 260 to display the resolution. The resolution case includes the current display resolution of the display 260 and all resolutions that can be set. The user may select a target resolution, and the controller 250 updates the resolution of the display 260 to the target resolution.

The controller 250 may calculate a resolution ratio of the display resolution and the picture resolution of the target picture and determine the resolution ratio as a compression ratio of the decoded data. In the embodiment of the present application, the resolution ratio is set to be the width ratio of two resolutions. For example, the picture resolution is 3840×2160, and the display resolution of the display 260 is 1920×1080. The compression ratio is 1080/2160=0.5.

In some embodiments, after the compression ratio is determined, the controller 250 may perform compression processing on the decoded data.

The decoded data is essentially composed of several pixel data, and can be considered as a two-dimensional pixel group composed of several rows of pixels and several columns of pixels. Fig. 13 illustrates a schematic diagram of decoding data in some embodiments. As shown in fig. 13, the data format of the picture data is RGBA format. The two-dimensional pixel point group is in a pixel point format of 10 rows and 10 columns, and comprises 100 pixel points in total.

The controller 250 may traverse all pixels in the decoded data and screen all pixels in the decoded data based on the compression ratio, thereby obtaining the target pixels.

Specifically, the controller 250 may first obtain the selection frequency of the pixel point based on the compression ratio. The controller 250 may calculate the inverse of the compression ratio and determine the inverse of the compression ratio as the selected frequency. For example, if the compression ratio is 0.5, the selection frequency is 2, which means that one of every two is selected.

Based on the selection frequency, the controller 250 may select a target pixel point row and a target pixel point column in the two-dimensional pixel point group. In the two-dimensional pixel group, the controller 250 may set a first flag for a pixel corresponding to the target pixel row and a second flag for a pixel corresponding to the target pixel column.

The controller 250 may screen all the pixels according to the first flag and the second flag. The controller 250 may determine a pixel having both the first and second markers as a target pixel.

Fig. 14 illustrates a schematic diagram of setting a flag for a pixel in some embodiments. As shown in fig. 14, taking the selection frequency of 2 as an example, one is selected between every two target pixel rows, and one is selected between every two target pixel columns, which may be an odd row and an odd column. Therefore, 1, 3, 5, 7, 9 rows can be selected as the target pixel rows in the two-dimensional pixel group, and 1, 3, 5, 7, 9 columns can be selected as the target pixel columns. For pixels in the target pixel row, a first flag, e.g., 1, may be set from the head end of the data. For pixels in the target pixel column, a second flag, e.g., 2, may be set at the end of the data. The pixel where no mark exists is denoted as RGBA, the pixel where only the first mark exists is denoted as 1RGBA, the pixel where only the second mark exists is denoted as RGBA2, and the pixel where both the first mark and the second mark exist is denoted as 1RGBA2.

In some embodiments, the controller 250 may obtain compressed data based on the target pixel point.

Specifically, the controller 250 may obtain the relative positional relationship of all the target pixels in the two-dimensional pixel group. The relative positional relationship refers to: every two target pixel points are adjacent and in a position relationship, for example, the target pixel point A is positioned on the left side of the target pixel point B and is positioned above the target pixel point C.

Based on the relative positional relationship, the controller 250 may combine the target pixels to obtain a target two-dimensional pixel point group. FIG. 15 illustrates a schematic diagram of a target two-dimensional set of pixels in some embodiments. As shown in fig. 15, only the target pixel points are included in the target two-dimensional pixel point group, and the relative positional relationship of each target pixel point is unchanged.

In some embodiments, when the target two-dimensional pixel group is obtained, pixel rows other than all target pixel rows may be deleted in the two-dimensional pixel group, and then pixel columns other than all target pixel columns may be deleted, so as to obtain the target two-dimensional pixel group.

In some embodiments, it is contemplated that the picture resolution of the target picture and the display resolution of the display 260 may differ too much, resulting in a smaller compression ratio. For example, the resolution of the picture is 3840×2160, and the display resolution of the display 260 is 640×360. The compression ratio is 2160/360=1/6. At this time, the selection frequency is 6, that is, one pixel point is selected from each pixel point to be reserved. The too high selection frequency may cause serious deformation of the compressed picture, and a large gap between the compressed picture and the original picture, which affects the use experience of the user. Accordingly, a selection frequency threshold may be preset, and the controller 250 may detect whether the selection frequency exceeds the selection frequency threshold.

If the selection frequency is greater than or equal to a preset selection frequency threshold, the picture deformation degree is smaller, and the target two-dimensional pixel point group can be directly determined to be compressed data.

If the selection frequency is smaller than the preset selection frequency threshold, the picture deformation degree is larger, and the pixel points need to be optimized. At this time, the controller 250 may perform interpolation processing on the pixels in the target two-dimensional pixel group to obtain an interpolated two-dimensional pixel group, and determine the interpolated two-dimensional pixel group as compressed data.

The controller 250 may perform interpolation processing on the pixel points using an OpenGL (Open Graphics Library ) magnification filtering method. The open graphics library OpenGL magnification filtering mode is a cross-language, cross-platform application programming interface for rendering 2D, 3D vector graphics. The interface data structure may include a plurality of primitive geometry, such as point, line segment, and polygon components. The application programming interface of OpenGL defines several functions that can be called by the client program, as well as some named integer constants. For example, the open graphics library OpenGL magnification filtering approach may include texture filtering functions and magnification functions. The principle of use of the texture filtering function may be: in the mapping of an image from a texture image space to a frame buffer image space, the mapping requires reconstruction of the texture image, which causes distortion of the image applied to the polygon, from which it can be determined how to map the texture pixels into pixels. The texture filter function may be provided with filter parameters, e.g. the filter parameters may be zoom-out filter parameters, and the zoom-in function may also be provided with zoom-in parameters.

In order to perform interpolation processing on pixel points without distortion, when the OpenGL amplification filtering method is used, sampling may be performed on two adjacent pixels to generate pixel differences.

Fig. 16 is a schematic diagram illustrating interpolation processing of pixel points using OpenGL magnification filtering in some embodiments. As shown in fig. 16, a and B are two adjacent pixels, and sampling is performed on the two pixels a and B to generate a pixel difference C. After the filtering parameters of the texture filtering function and the amplifying parameters of the amplifying function are determined, linear interpolation calculation can be performed on the two pixels A and B according to the filtering parameters, the amplifying parameters and the pixel difference C. OpenGL supports multiple interpolation modes, and different interpolation modes can be selected for processing according to actual needs. After linear interpolation calculation is performed on the two pixels A and B according to the filtering parameter, the amplifying parameter and the pixel difference C, an inserted pixel between the adjacent pixels A and B can be generated, and then the inserted pixel is inserted into the two pixels A and B, so that new pixel points are added in the image, namely the inserted pixel is added. It will be appreciated that the above is merely an illustration of how two adjacent pixels a and B are generated with intervening pixels between the two adjacent pixels, and that the remaining pixels may be processed in the same manner.

The controller 250 may determine the number of pixel rows and the number of pixel columns to be increased when performing interpolation processing on the pixels in the target two-dimensional pixel group. The controller 250 may calculate the ratio of the number of pixel rows in the two-dimensional pixel group to the selection frequency threshold and the ratio of the number of pixel columns in the two-dimensional pixel group to the selection frequency threshold, respectively. The two ratios are the final pixel row number and pixel column number, respectively. Calculating the difference value between the number of pixel lines and the number of target pixel lines, and taking the difference value as the number of pixel lines to be interpolated in interpolation processing; and calculating the difference value between the number of pixel columns and the number of target pixel columns as the number of pixel columns needing interpolation in interpolation processing. The controller 250 may further perform a difference process on the target two-dimensional pixel set to obtain an interpolated two-dimensional pixel set, and use the interpolated two-dimensional pixel set as compressed data.

In some embodiments, the picture information of the target picture includes position information of all the picture segment data, that is, a position of each picture segment data with respect to the target picture.

The controller 250 may count compressed data corresponding to all picture segment data. Based on the position information of each picture segment data, the controller 250 may render and draw all the compressed data to obtain a first picture to be displayed. The controller 250 may control the display 260 to display the first picture to be displayed. The first picture to be displayed is the optimized target picture.

In some embodiments, if the picture size of the target picture is less than or equal to the preset picture size threshold, it is indicated that the target picture does not exceed the expected memory footprint. However, considering that the display device currently runs a plurality of application programs at the same time, the remaining memory of the system is smaller, and the situation that the display device cannot normally run still is still possibly caused by downloading the target picture.

For this reason, a system memory threshold may be preset, and when the system residual memory of the display device does not reach the system memory threshold, optimization processing is also required for the target picture. The preset system memory threshold may be a number greater than or equal to the picture size threshold.

Specifically, based on detecting that the picture size is less than or equal to a preset picture size threshold, the controller 250 may obtain a current system memory of the display device.

If the current system memory is less than the preset system memory threshold, the controller 250 may compress the decoded data to implement the optimization process for the target picture.

If the current system memory is greater than or equal to the system memory threshold, the controller 250 may not optimize the target picture. The controller 250 may directly render and draw the decoded data to obtain a second picture to be displayed, and control the display 260 to display the second picture to be displayed.

In some embodiments, the display device may also consider the resolution of the target picture to determine whether the resolution of the current display output is capable of adapting to the picture resolution of the target picture.

The controller 250 may calculate a resolution ratio of a picture resolution of the target picture and a display resolution of the display 260. The resolution ratio may be a width ratio of two resolutions. For example, the picture resolution is 3840×2160, and the display resolution of the display 260 is 1920×1080. The resolution ratio is 2160/1080=2.

For a display device, a resolution ratio threshold may be preset, which may be 2. Controller 250 may determine whether the resolution ratio is within a resolution ratio threshold.

If the resolution ratio does not exceed the resolution ratio threshold, then the resolution of the display output is deemed to be able to accommodate the picture resolution of the target picture, at which point the controller 250 may not optimize the target picture.

If the resolution ratio exceeds the resolution ratio threshold, the resolution of the display output is deemed not to be able to accommodate the picture resolution of the target picture, at which point the controller 250 may perform an optimization process on the target picture.

The embodiment of the application also provides a picture display method, as shown in fig. 17, which comprises the following steps:

step 1701, in response to an instruction input by a user to display a target picture, sending a data acquisition request to a server, where the data acquisition request is used to acquire picture data and picture information of the target picture.

Step 1702, receiving picture data and picture information sent by a server, wherein the picture information includes a picture size of a target picture.

And 1703, performing decoding processing on the picture data to obtain decoded data.

Step 1704, based on detecting that the picture size is greater than a preset picture size threshold, compressing the decoded data to obtain compressed data.

And 1705, rendering and drawing the compressed data to obtain a first picture to be displayed, and controlling the display to display the first picture to be displayed.

In some embodiments, the picture data includes a plurality of picture clip data. Decoding the picture data, including:

based on the detection that the server sends a complete picture segment data, decoding the picture segment data to obtain decoded data;

after compressing the decoded data, the method further comprises:

And continuing decoding processing on the next picture segment data until compressed data corresponding to all the picture segment data are obtained.

In some embodiments, the picture information includes location information of the picture clip data. Rendering the compressed data, comprising:

counting compressed data corresponding to all the picture fragment data; and rendering and drawing all the compressed data based on the position information to obtain a first picture to be displayed.

In some embodiments, after decoding the picture data, the method includes:

based on the fact that the picture size is detected to be smaller than or equal to a preset picture size threshold value, acquiring a current system memory of the display device; executing the step of compressing the decoded data based on the detection that the current system memory is smaller than the preset system memory threshold; the preset system memory threshold is larger than or equal to the picture size threshold; and rendering and drawing the decoded data based on the fact that the current system memory is larger than or equal to the system memory threshold value, obtaining a second picture to be displayed, and controlling the display to display the second picture to be displayed.

In some embodiments, compressing the decoded data includes:

Acquiring the compression ratio of the decoded data; traversing all pixel points in the decoded data, and screening all pixel points in the decoded data based on the compression ratio to obtain a target pixel point; compressed data is acquired based on the target pixel point.

In some embodiments, the picture information includes a picture resolution of the target picture. Obtaining a compression ratio of the decoded data, comprising:

acquiring display resolution of display output; a resolution ratio of the display resolution and the picture resolution is calculated, and the resolution ratio is determined as a compression ratio of the decoded data.

In some embodiments, the decoded data includes a two-dimensional group of pixels consisting of rows of pixels and columns of pixels. Filtering all pixels in the decoded data based on the compression ratio, including:

acquiring the selection frequency of the pixel points based on the compression ratio, wherein the selection frequency is the reciprocal of the compression ratio; selecting a target pixel point row and a target pixel point column from the two-dimensional pixel point group based on the selection frequency;

setting a first mark for the pixel points corresponding to the target pixel point row in the two-dimensional pixel point group, and setting a second mark for the pixel points corresponding to the target pixel point column; the pixel point having both the first mark and the second mark is determined as a target pixel point.

In some embodiments, obtaining compressed data based on a target pixel point includes:

acquiring the relative position relation of the target pixel point in the two-dimensional pixel point group; combining the target pixel points according to the relative position relation to obtain a target two-dimensional pixel point group; determining the target two-dimensional pixel point group as compressed data based on the detection that the selection frequency is smaller than or equal to a preset selection frequency threshold value; and carrying out interpolation processing on the pixel points in the target two-dimensional pixel point group based on the fact that the selection frequency is detected to be larger than a preset selection frequency threshold value, obtaining an interpolation two-dimensional pixel point group, and determining the interpolation two-dimensional pixel point group as compressed data.

In some embodiments, before sending the data acquisition request to the server, further comprising:

responding to a starting instruction input by a user, and controlling a display to display a system recommendation page; the system recommended page comprises a web browsing control; based on detection of the selection operation of the user on the web browsing control, controlling the display to display a target web page, wherein the target web page comprises a target picture control, and the target picture control is used for accessing a target picture; and sending a data acquisition request to the server based on detecting the selected operation of the user on the target picture control.

The same and similar parts of the embodiments in this specification are referred to each other, and are not described herein.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments or some parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, characterized by comprising:

a display;

a controller configured to:

responding to an instruction input by a user for indicating to display a target picture, and sending a data acquisition request to a server, wherein the data acquisition request is used for acquiring picture data and picture information of the target picture;

receiving picture data and picture information sent by the server, wherein the picture information comprises the picture size of the target picture;

decoding the picture data to obtain decoded data;

based on the fact that the picture size is detected to be larger than a preset picture size threshold, compressing the decoded data to obtain compressed data;

Rendering and drawing the compressed data to obtain a first picture to be displayed, and controlling the display to display the first picture to be displayed.

2. The display device according to claim 1, wherein the picture data includes a plurality of picture clip data therein; the controller performs decoding processing on the picture data, and is further configured to:

based on the fact that the server sends complete picture fragment data, decoding processing is conducted on the picture fragment data, and decoding data are obtained;

the controller is further configured to, after performing compression processing on the decoded data:

and continuing decoding processing on the next picture segment data until compressed data corresponding to all the picture segment data are obtained.

3. The display device according to claim 2, wherein the picture information includes position information of the picture clip data; the controller performs rendering of the compressed data, and is further configured to:

counting compressed data corresponding to all the picture fragment data;

and rendering and drawing all the compressed data based on the position information to obtain a first picture to be displayed.

4. The display device according to claim 1, wherein after the controller performs the decoding process on the picture data, the controller is further configured to:

based on the fact that the picture size is detected to be smaller than or equal to a preset picture size threshold value, acquiring a current system memory of the display device;

executing the step of compressing the decoded data based on the detection that the current system memory is smaller than a preset system memory threshold; the preset system memory threshold is greater than or equal to the picture size threshold;

and rendering and drawing the decoded data based on the fact that the current system memory is larger than or equal to the system memory threshold value is detected, obtaining a second picture to be displayed, and controlling the display to display the second picture to be displayed.

5. The display device of claim 1, wherein the controller performs a compression process on the decoded data, and is further configured to:

acquiring the compression ratio of the decoded data;

traversing all pixel points in the decoded data, and screening all pixel points in the decoded data based on the compression ratio to obtain a target pixel point;

And obtaining compressed data based on the target pixel point.

6. The display device according to claim 5, wherein the picture information includes a picture resolution of the target picture; the controller performs the obtaining of the compression ratio of the decoded data, and is further configured to:

acquiring the display resolution of the display output;

and calculating a resolution ratio of the display resolution to the picture resolution, and determining the resolution ratio as a compression ratio of the decoded data.

7. The display device of claim 5, wherein the decoded data comprises a two-dimensional group of pixels consisting of rows of pixels and columns of pixels; the controller performs filtering of all pixels in the decoded data based on the compression ratio, and is further configured to:

acquiring the selection frequency of the pixel points based on the compression ratio, wherein the selection frequency is the reciprocal of the compression ratio;

selecting a target pixel point row and a target pixel point column from the two-dimensional pixel point group based on the selection frequency;

in the two-dimensional pixel point group, a first mark is set for the pixel points corresponding to the target pixel point row, and a second mark is set for the pixel points corresponding to the target pixel point column;

And determining the pixel point with the first mark and the second mark as a target pixel point.

8. The display device of claim 7, wherein the controller performs acquiring compressed data based on the target pixel point, further configured to:

acquiring the relative position relation of the target pixel point in the two-dimensional pixel point group;

combining the target pixel points according to the relative position relation to obtain a target two-dimensional pixel point group;

determining the target two-dimensional pixel point group as compressed data based on the fact that the selection frequency is detected to be smaller than or equal to a preset selection frequency threshold value; and carrying out interpolation processing on the pixel points in the target two-dimensional pixel point group based on the fact that the selection frequency is detected to be larger than a preset selection frequency threshold value, obtaining an interpolation two-dimensional pixel point group, and determining the interpolation two-dimensional pixel point group as compressed data.

9. The display device of claim 1, wherein before the controller performs sending the data acquisition request to the server, the controller is further configured to:

responding to a starting instruction input by a user, and controlling a display to display a system recommendation page; the system recommendation page comprises a web browsing control;

Based on detection of the selection operation of the webpage browsing control by the user, controlling a display to display a target webpage, wherein the target webpage comprises a target picture control, and the target picture control is used for accessing the target picture;

and sending a data acquisition request to a server based on detecting the selected operation of the user on the target picture control.

10. A picture display method applied to a display device, the method comprising:

responding to an instruction input by a user for indicating to display a target picture, and sending a data acquisition request to a server, wherein the data acquisition request is used for acquiring picture data and picture information of the target picture;

receiving picture data and picture information sent by the server, wherein the picture information comprises the picture size of the target picture;

decoding the picture data to obtain decoded data;

based on the fact that the picture size is detected to be larger than a preset picture size threshold, compressing the decoded data to obtain compressed data;

rendering and drawing the compressed data to obtain a picture to be displayed, and controlling the display to display the picture to be displayed.