CN115396717B - Display device and display image quality adjusting method - Google Patents

Display device and display image quality adjusting method Download PDF

Info

Publication number
CN115396717B
CN115396717B CN202211017406.1A CN202211017406A CN115396717B CN 115396717 B CN115396717 B CN 115396717B CN 202211017406 A CN202211017406 A CN 202211017406A CN 115396717 B CN115396717 B CN 115396717B
Authority
CN
China
Prior art keywords
picture
image quality
display
region
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211017406.1A
Other languages
Chinese (zh)
Other versions
CN115396717A (en
Inventor
高文文
贾亚洲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202211017406.1A priority Critical patent/CN115396717B/en
Publication of CN115396717A publication Critical patent/CN115396717A/en
Application granted granted Critical
Publication of CN115396717B publication Critical patent/CN115396717B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440227Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by decomposing into layers, e.g. base layer and one or more enhancement layers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4854End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application discloses a display device and a display image quality adjusting method, wherein an area to be optimized is determined through a display interface of an OSD layer, and an initial picture can be determined from the area to be optimized; further, the determination of the intermediate picture can be realized by storing the decoded initial picture into the video layer buffer; in addition, at the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the region to be optimized by transmitting the target picture to an OSD layer buffer memory. The image quality adjustment of the partial area of the display interface of the OSD layer is realized, and the visual experience of a user is improved.

Description

Display device and display image quality adjusting method
Technical Field
The present application relates to the field of display technologies, and in particular, to a display device and a display image quality adjustment method.
Background
The display device refers to a terminal device capable of outputting a specific display screen, such as a smart television, a mobile terminal, a smart advertisement screen, and the like. Taking intelligent electricity as an example, the intelligent television is provided with an open operating system, an open application platform and support function expansion, and various application programs, such as social applications such as traditional video applications and short videos, entertainment applications such as drawing boards and body building, can be installed in the intelligent television according to user needs, so as to meet the needs of diversification and individuation of users.
In the related art, a display device provides a User Interface (UI) for User interaction through an OSD (On SCREEN DISPLAY), and the UI Interface may display areas of different applications or display areas of different controls of the same application; the display area in the UI interface is used for displaying pictures of the graphic interaction information, and the image quality of the pictures of the interaction information is preset by the operating system based on the display equipment.
Therefore, a method for performing image quality processing on a picture of a display area in an OSD layer is needed.
Disclosure of Invention
The application provides display equipment and a display image quality adjusting method, which can be used for solving the technical problem of adjusting the image quality of a picture in a display area in an OSD layer.
In a first aspect, some embodiments of the present application provide a display device comprising a display and a controller configured to:
Determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises a display region;
Storing the decoded initial picture into a video layer cache to determine an intermediate picture, wherein the initial picture is determined from a region to be optimized;
At the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
And transmitting the target picture to an OSD layer buffer memory, and updating the region to be optimized.
In a second aspect, some embodiments of the present application provide a display image quality adjustment method applied to a display device, where the display device includes a display and a controller; the method comprises the following steps:
Determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises a display region;
Storing the decoded initial picture into a video layer cache to determine an intermediate picture, wherein the initial picture is determined from a region to be optimized;
At the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
And transmitting the target picture to an OSD layer buffer memory, and updating the region to be optimized.
Some embodiments of the present application provide a display apparatus and a display image quality adjustment method, where the display image quality adjustment method determines a region to be optimized through a display interface of an OSD layer, and determines an initial picture from the region to be optimized; further, the determination of the intermediate picture can be realized by storing the decoded initial picture into the video layer buffer; in addition, at the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the region to be optimized by transmitting the target picture to an OSD layer buffer memory. And the image quality adjustment is realized for the partial area of the display interface of the OSD layer, so that the visual experience of a user is improved.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 illustrates an operational scenario between a display device and a control apparatus according to some embodiments of the present application;
fig. 2 shows a hardware configuration block diagram of the control apparatus 100 of some embodiments of the present application;
FIG. 3 shows a block diagram of the hardware configuration of a display device 200 according to some embodiments of the application;
FIG. 4 illustrates a software configuration diagram in a display device according to some embodiments of the application;
FIG. 5a illustrates a display interface itself for application selection in some embodiments;
FIG. 5b shows a schematic diagram of an initial picture of the legacy video application control of FIG. 5 a;
FIG. 5c shows a schematic diagram of an initial picture of the short video application control of FIG. 5 a;
FIG. 5d shows a schematic diagram of a target picture of the legacy video application control of FIG. 5 b;
FIG. 5e shows a schematic diagram of an initial picture of the short video application control of FIG. 5 c;
FIG. 5f shows the display interface of the OSD layer of FIG. 5a after applying selected portions of the image quality adjustment;
fig. 6 shows a timing interaction diagram of an OSD layer and a video layer in a display device according to an embodiment of the present application;
fig. 7a shows a timing diagram of determining a target picture in a video layer according to an embodiment of the present application;
Fig. 7b is a schematic diagram of another timing diagram of determining a target picture in a video layer according to an embodiment of the present application;
Fig. 8 is a schematic flow chart of a display image quality adjusting method according to an embodiment of the present application;
Fig. 9a is a schematic flow chart of determining a target picture in a video layer according to an embodiment of the present application;
fig. 9b shows a schematic flow chart of determining a target picture in a video layer according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of exemplary embodiments of the present application more apparent, the technical solutions of exemplary embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is apparent that the described exemplary embodiments are only some embodiments of the present application, not all embodiments.
All other embodiments, which can be made by a person skilled in the art without inventive effort, based on the exemplary embodiments shown in the present application are intended to fall within the scope of the present application. Furthermore, while the present disclosure has been described in terms of an exemplary embodiment or embodiments, it should be understood that each aspect of the disclosure may be separately implemented as a complete solution.
It should be understood that the terms "first," "second," "third," and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate, such as where appropriate, for example, implementations other than those illustrated or described in connection with the embodiments of the application.
Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The display device provided by the embodiment of the application can have various implementation forms, for example, a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.
In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.
In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.
In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.
FIG. 3 shows a block diagram of the hardware configuration of a display device 200 according to some embodiments of the application; as shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.
The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.
The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.
The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).
The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.
The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.
The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.
The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.
The video processor is used for receiving external video signals, and performing video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis and the like according to the standard coding and decoding protocol of the input signals so as to obtain video signals which are directly displayed or played on the display.
By way of example, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
And a graphic processor for generating various graphic objects such as icons, operation menus, and user input instruction display graphics. The graphic processor may include an operator for performing an operation by receiving a user input of various interactive instructions, thereby displaying various objects according to display attributes; and a renderer for generating various objects based on the operator, and displaying the result of rendering on a display.
The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.
A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
FIG. 4 illustrates a software configuration diagram in a display device according to some embodiments of the application; as shown in fig. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (application layer), an application framework layer (Application Framework layer) (framework layer), a An Zhuoyun row layer (Android runtime) and a system library layer (system runtime layer), and a kernel layer, respectively.
In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.
As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an activity manager (ACTIVITY MANAGER) is used to interact with all activities running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a package manager (PACKAGE MANAGER) for retrieving various information about the application packages currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.
In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.
In the system frame of the display apparatus 200, a plurality of display processing levels, such as a Video layer (Video layer), an OSD layer, and the like, are configured. Wherein, the video layer refers to a display level on the display device 200 for presenting a play picture of the streaming media resource when playing the media resource; may also be referred to as an image quality layer of the display device 200, and a playback screen corresponding to the media may be displayed on the image quality layer. The OSD layer refers to a display hierarchy for providing interactive operations for a user, and may also be referred to as a UI layer of the display device 200.
When the display device 200 displays a video picture of a streaming media resource, the video picture can be subjected to image quality processing by adjusting the image quality of the media resource information. The image quality processing may include processing of an image on each frame of the video picture, such as color correction, color tuning, sharpness adjustment, etc., and may also include processing of multi-frame data of the video picture, such as interpolation algorithms, motion compensation, etc. Through image quality processing, the image display quality can be further improved, so that the video watching experience is better under the condition that the same equipment is configured and the video source resource size is not increased.
The video layer can adjust the image quality of the media information to realize the image quality processing of the display picture, and the OSD layer can display the display areas of different applications or the display areas of different controls of the same application; the display device can display the superposition of characters, graphics and images according to the correspondence of each display area and the requirements of application or control functions and the like, and the size, the position and the color information of each display area can be adjusted. When the display device 200 displays an OSD screen, the graphic layers of SurfaceFlinger are overlapped by GPU, so that the whole image is displayed, and the image quality adjusting function of each display area displayed on the OSD layer cannot be realized on the OSD layer.
Fig. 5a illustrates a display interface of application selection in some embodiments, as shown in fig. 5a, a display area of different applications may be displayed on the display interface, which may relate to social applications such as a traditional video application and a short video, entertainment applications such as a drawing board and a body building, etc., in order to highlight a theme and a display effect, the information may be displayed more efficiently by a graphic layout manner, in UI images displayed in each display area by graphic, the dynamic acquisition of pictures used for displaying in an application foreground may be implemented, and in the USD layer, the pictures in the display area cannot be processed in image quality according to requirements, so that there is a larger difference between the display effect and the display effect of a video page.
As shown in fig. 5a, for the display area 501 of the drawing board application a, the display area 502 of the exercise application B, etc., the image quality requirements of the user are not high, while for the display area 503 of the conventional video application C and the display area 504 of the short video application D, when the image quality of the display area is different from that of the media video playing interface, the use experience of the user is affected, and the display effect of the application display area may be inferior to that of the media video.
In order to implement image quality adjustment of a display area in an OSD interface on the display 260, some embodiments of the present application provide a display apparatus and a display image quality adjustment method, in which an area to be optimized is determined in a display interface of an OSD layer; decoding the initial picture determined from the region to be optimized in an OSD layer, sending the intermediate piece decoded by the initial picture to a video layer for cache storage, and adjusting the image quality of the intermediate picture based on preset optimization parameters in the video layer to determine a target picture; and then sending the target picture with the adjusted image quality back to an OSD layer cache, updating the region to be optimized of the UI interface of the display device based on the target picture, realizing the image quality adjustment of part of the display region in the OSD interface of the display device, and improving the use experience of a user.
In order to facilitate further understanding of the technical solutions in some embodiments of the present application, a display device and a display image quality adjustment method are described in detail below in conjunction with some specific embodiments.
Fig. 6 shows a timing interaction diagram of an OSD layer and a video layer in a display device according to an embodiment of the present application; as shown in fig. 6, the display image quality adjusting method in the OSD layer includes the steps of:
And in the OSD layer, S101, determining a region to be optimized in the display interface.
For each display area in the OSD layer display interface, the area to be optimized can be determined through a preset display area, and the area to be optimized is a part of the display area in the display interface, can be a certain display area or a plurality of display areas.
When the OSD layer display interface is the display interface of the application, each application APP displays through the control, the control can at least contain one of pictures and characters, and for most APP controls, the user's visual experience is improved while the user's understanding is improved by overlapping the pictures and the characters.
When the OSD layer display interface is a display interface of each function in the application, each function can be displayed by a control, and the same control at least contains one of pictures or characters.
When the controls are displayed through pictures or picture and text superposition, the display area to be optimized can be determined through the information of the controls and a preset display area, and it is understood that each control can have a specific identification, and the area to be optimized is determined from the identifications corresponding to the controls through the preset display area.
In some embodiments, it may be necessary to optimize a certain type of picture region, where the region to be optimized may be determined by a range of preset resolution, at this time, only all pictures within the range of preset resolution are subjected to subsequent image quality processing, based on which batch image quality processing of the display region may be implemented, and processing efficiency is improved.
The resolution may generally determine the fineness of the details of the picture, and the higher the resolution of the picture, the more pixels are included, and the clearer the picture.
For the two methods for determining the region to be optimized provided above, in some embodiments, the region to be optimized may be determined from each region of the OSD layer display interface by combining the preset display region and the range of the preset resolution, so as to implement targeted batch processing, and improve the accuracy of the scheme. Meanwhile, the defects that the accuracy is high and the pertinence is strong but the flexibility is poor only by using the preset display area can be effectively improved, and the defects that the pertinence is weak only by using the range of the preset resolution can be also effectively improved.
Under the condition of unused application, a proper determination method of the region to be optimized is selected, and a quick and efficient solution can be provided for equipment, however, along with the development of technology, other accurate and flexible determination methods for the selection of the region to be optimized are also possible, and the determination of the region to be optimized can be realized.
For example, the OSD layer display interface shown in fig. 5a, the region to be optimized may be determined in step 101, where the region to be optimized is a display region where the controls corresponding to the conventional video application C and the short video application D are located.
Taking the display device of the Android system as an example, in Android, for interaction with the screen of the device, two most common and important classes are: view class, viewGroup class. View and ViewGroup are upper level classes of the core.
View class: the entire displayed screen may be made up of one or more View objects, with the View class providing the Android initiator with which controllable properties: boundaries (dimensions), layout on screen, layer display order, scrolling, focus, key interactions, gesture interactions. By deriving it, more detailed and specific UI elements can be constructed, for example: buttons, check boxes, single row buttons, and text boxes.
The ViewGroup class is a subclass of View derivation, and the ViewGroup class is used to derive layout container classes that can group and organize View objects in order on the screen. ViewGroup is a layout container, which is typically a collection of UI elements, which may be buttons, text boxes, check boxes, and the like. That is, the UI element may be of any type (including custom new controls derived from the View class).
Wherein DecorView is the top-most View of the whole Window interface, and the measurement, layout, drawing and event distribution of the View are all traversed from DecorView down through the View tree. DecorView as the top View typically contains a vertical LinearLayout inside, with two parts up and down inside this LinearLayout, e.g., a title bar above and a content bar below.
At the OSD layer, S102, the initial picture determined from the region to be optimized is decoded.
The corresponding initial picture, typically a bitmap image of a bitmap, which may be a dot matrix image or a raster image, in the region to be optimized is composed of individual points called pixels (picture elements). The dots may be arranged and dyed differently to form a pattern. The characteristic is that the color change and the fine transition of the color can be represented, and the realistic effect is produced.
Taking a display device of an Android system as an example, android supports bitmap files in three formats: png,. Jpg,. Gif.
If the initial picture determined from the region to be optimized is placed in a drawable catalog, the Android system selects a picture file according to the catalog of the corresponding resolution according to the resolution of the display equipment; if the image is placed under the asset directory, when the resource management framework (ASSET MANAGER) is used for opening or is placed in the memory, the system can read the file of the designated path, and the adaptation process is not stored.
And decoding the determined initial picture, taking the display equipment of the Android system as an example, and leading the decoder to decode by Skia.
In some embodiments, the decoding of software and hardware draws is included when only mainline rendering is considered, regardless of non-mainline rendering.
For decoding of software drawing, an initial picture is generally drawn directly on an OSD layer buffer memory of an OSD layer; in the decoding of the hardware accelerated drawing, under the condition of GPU drawing, an initial picture is uploaded to the GPU to form textures, and then the textures are sampled and rendered to an OSD layer cache of an OSD layer.
For example, the OSD layer display interface shown in fig. 5a, where the area to be optimized is an initial picture corresponding to the display area where the controls corresponding to the conventional video application C and the short video application D are located is shown as initial picture 610 in fig. 5b and initial picture 620 in fig. 5C, respectively, that is, fig. 5b shows a schematic diagram of the initial picture of the conventional video application control in fig. 5a, and fig. 5C shows a schematic diagram of the initial picture of the short video application control in fig. 5 a.
S103, storing the decoded initial picture into a video layer cache, and determining an intermediate picture.
Through step 103, the parsed initial picture is sent from the OSD layer to the video layer, and stored in the video layer buffer, and the initial picture stored in the video layer buffer is recorded as an intermediate picture.
It should be appreciated that, at the OSD layer, the initial picture is decoded into the OSD layer buffer, through steps 102 and 103; transmitting the decoded initial picture from the OSD layer buffer memory to the video layer buffer memory, and determining an intermediate picture;
or decoding the initial picture to an OSD layer buffer memory through a graphic processor of the display device in the OSD layer through the steps 102 and 103; and sending the decoded initial picture from the OSD layer cache to the video layer cache, and determining an intermediate picture.
In some embodiments, the OSD layer buffer may refer to a graphic memory (graphic buffer) for display, and the video layer buffer (video buffer) in the video layer.
And in the video layer, S104, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture.
The image quality adjustment of the intermediate picture is realized in the video layer, the image quality adjustment can be realized by improving hardware parameters by calling a video image quality interface, and a target picture is determined; the image quality parameter of the intermediate picture of the video layer may be changed, and the target picture may be determined based on picture analysis and image quality adjustment of the newly generated image quality parameter.
Fig. 7a shows a timing diagram of determining a target picture in a video layer according to an embodiment of the present application, where initial hardware parameters are obtained as shown in fig. 7 a. And determining target hardware parameters based on the image quality interface of the display equipment and preset optimization parameters. The preset optimization parameters are used for updating the initial hardware parameters.
The target picture determination specifically comprises the following steps:
s141, determining an image quality interface based on an image quality module of the display device.
In some embodiments, the image quality of the intermediate picture may determine the image quality interface that needs to be invoked through the PQ image quality module.
S142, calling a video image quality interface.
In some embodiments, the modification of hardware parameters may be accomplished by invoking a flow interface.
In some embodiments, for modification of hardware parameters, an intermediate hardware parameter is determined based on updating the initial hardware parameter with a preset optimization parameter; the target hardware parameters are determined based on the image quality interface and the intermediate hardware parameters.
And S143, adjusting the image quality of the intermediate image based on the target hardware parameters, and determining the target image.
The original hardware equipment is endowed with new functions to realize the adjustment of the image quality of the intermediate picture, and the target picture is determined.
In some embodiments, the application invokes the flow interface, through the middleware invoked by JNI, and then the middleware invokes the interface provided by the vendor to improve the hardware image quality, thereby realizing the video layer image quality improvement.
Fig. 7b is a schematic diagram of another timing diagram of determining a target picture in a video layer according to an embodiment of the present application, where, as shown in fig. 7b, the target picture determination specifically includes the following steps:
s144, determining the image quality parameters of the video layer based on the preset optimization parameters.
The method comprises the steps of obtaining analysis service of a video layer; and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
It should be appreciated that the image quality parameters of the video layer may be determined by modifying the resolution parameters of the native framework skia, and preset optimization parameters.
And S145, adjusting the image quality of the intermediate image based on the image quality parameters of the video layer, and determining the target image.
And changing the image quality of the intermediate picture through the modified image quality parameter, refreshing the intermediate picture, and obtaining a target picture, wherein the target picture is stored in a video layer cache.
For example, FIG. 5d shows a schematic diagram of a target picture of the legacy video application control of FIG. 5b, FIG. 5e shows a schematic diagram of an initial picture of the short video application control of FIG. 5c, and the target picture 630 of FIG. 5d has an adjusted image quality relative to the initial picture 610 of FIG. 5b, via steps 103 and 104; the target picture 640 of fig. 5e has an adjusted image quality relative to the initial picture 620 of fig. 5 c.
S105, transmitting the target picture to an OSD layer buffer memory, and updating the region to be optimized.
Copying or rendering the target picture in the video layer buffer memory to an OSD layer buffer memory, and analyzing the target picture in the OSD layer; and overlapping the analyzed target image to the region to be optimized.
In some embodiments, by optimizing the target picture of the video buffer image quality data, the OSD layer is required to copy the target picture of the video buffer into the graphic buffer because the OSD layer cannot directly process the video buffer data. Then SurfaceFlinger analyzes the data of the graphic buffer to generate a new image quality improved region to be optimized.
After step 105, the method for adjusting the display image quality of the OSD layer further includes the following steps, and is implemented in the OSD layer:
S106, updating the display interface of the OSD layer based on the updated region to be optimized.
And rendering a display interface of the OSD layer based on the updated region to be optimized, and realizing image quality adjustment of part of the display region of the display interface of the OSD layer.
For example, fig. 5f shows the OSD layer display interface after the image quality adjustment of the selected portion in fig. 5a, the display area to be optimized is obtained on the OSD layer display interface, and after the image quality adjustment of the video layer, the video layer is copied to the OSD layer, and the OSD layer display interface is updated.
The display image quality adjusting method provided in the embodiment of the invention determines the region to be optimized through the display interface of the OSD layer, and determines the initial picture from the region to be optimized; further, the determination of the intermediate picture can be realized by storing the decoded initial picture into the video layer buffer; in addition, at the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the region to be optimized by transmitting the target picture to an OSD layer buffer memory. And the image quality adjustment is realized for the partial area of the display interface of the OSD layer, so that the visual experience of a user is improved.
Fig. 8 is a schematic flow chart of a display image quality adjustment method according to an embodiment of the present application, where the display image quality adjustment method is applied to a display device 200, and the display device 200 includes a display 260 and a controller 250. The controller 250 is configured to perform the steps of:
s201, determining a region to be optimized in a display interface of an OSD layer.
Wherein the region to be optimized at least comprises a display region. The display interface comprises a plurality of display areas, and the area to be optimized can comprise one display area or a plurality of display areas.
In some embodiments, acquiring a preset application partition preset display area; based on a preset application area preset display area periphery, determining an area to be optimized from each area of an OSD layer display interface; the region to be optimized at least comprises one display region.
In some embodiments, a range of preset resolutions is obtained; determining a region to be optimized from each region of the OSD layer display interface based on a range of a preset resolution; the region to be optimized at least comprises one display region.
In some embodiments, obtaining a range of preset application partition preset display areas and preset resolutions; determining a region to be optimized from each region of an OSD layer display interface based on a preset display region of a preset application region and a range of preset resolution; the region to be optimized at least comprises one display region.
And determining an initial picture from the region to be optimized, wherein the initial picture is determined based on the display region.
S202, decoding the initial picture, storing the decoded initial picture into a video layer cache, and determining an intermediate picture.
The decoding of the initial picture in step 202 may be implemented in the OSD layer, specifically as follows:
Decoding the initial picture to an OSD layer buffer memory at the OSD layer; and sending the decoded initial picture from the OSD layer cache to the video layer cache, and determining an intermediate picture.
Or alternatively
Decoding the initial picture to an OSD layer buffer memory through a graphic processor of display equipment in the OSD layer; and sending the decoded initial picture from the OSD layer cache to the video layer cache, and determining an intermediate picture.
In some embodiments, the operation of comparing the initial picture in step 202 may also be implemented in the video layer, where step 202 stores the initial picture in the video layer buffer, and determines the intermediate picture based on the decoding of the initial picture in the video layer buffer.
And S203, adjusting the image quality of the intermediate picture based on preset optimization parameters at the video layer, and determining a target picture.
Fig. 9a shows a schematic flow chart of determining a target picture in a video layer according to an embodiment of the present application, where the schematic flow chart of determining the target picture is based on a hardware implementation, and image quality adjustment is implemented by giving a new application to the hardware, as shown in fig. 9 a. The method specifically comprises the following steps:
S231, calling an image quality interface.
An image quality interface is determined based on an image quality module of the display device. In some embodiments, the image quality of the intermediate picture may determine the image quality interface that needs to be invoked through the PQ image quality module.
In some embodiments, the modification of hardware parameters may be accomplished by invoking a flow interface.
In some embodiments, for modification of hardware parameters, an intermediate hardware parameter is determined based on updating the initial hardware parameter with a preset optimization parameter; the target hardware parameters are determined based on the image quality interface and the intermediate hardware parameters.
S232, modifying the intermediate hardware parameters.
Initial hardware parameters are obtained. Determining intermediate hardware parameters based on an image quality interface of the display device and preset optimization parameters; the preset optimization parameters are used for updating the initial hardware parameters.
S233, determining target hardware parameters based on the intermediate hardware parameters.
The target hardware parameters are determined based on the image quality interface and the intermediate hardware parameters.
S234, adjusting the image quality of the intermediate image based on the target hardware parameters, and determining the target image.
The original hardware equipment is endowed with new functions to realize the adjustment of the image quality of the intermediate picture, and the target picture is determined.
In some embodiments, the application invokes the flow interface, through the middleware invoked by JNI, and then the middleware invokes the interface provided by the vendor to improve the hardware image quality, thereby realizing the video layer image quality improvement.
Fig. 9b is a schematic flow chart of determining a target picture in a video layer according to an embodiment of the present application; as shown in fig. 9b, the target picture determination is schematically implemented based on software to implement image quality adjustment. The method specifically comprises the following steps:
s235, calling a self-packaging interface.
S236, determining the image quality parameters of the video layer based on the preset optimization parameters.
In some embodiments, a resolution service of a video layer is obtained; and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
The method comprises the steps of obtaining analysis service of a video layer; and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
It should be appreciated that the image quality parameters of the video layer may be determined by modifying the resolution parameters of the native framework skia, and preset optimization parameters.
And S237, adjusting the image quality of the intermediate picture based on the image quality parameters of the video layer, and determining the target picture.
And changing the image quality of the intermediate picture through the modified image quality parameter, refreshing the intermediate picture, and obtaining a target picture, wherein the target picture is stored in a video layer cache.
S204, transmitting the target picture to an OSD layer buffer memory, and updating the region to be optimized.
Analyzing a target picture in an OSD layer; and overlapping the analyzed target image to the region to be optimized.
In some embodiments, by optimizing the target picture of the video buffer image quality data, the OSD layer is required to copy the target picture of the video buffer into the graphic buffer because the OSD layer cannot directly process the video buffer data. Then, the central display control SurfaceFlinger analyzes the data of the graphic buffer to generate a new region to be optimized with improved image quality.
After step 204, the method for adjusting the display image quality of the OSD layer further includes the steps of:
s205, updating the display interface of the OSD layer based on the updated region to be optimized.
And rendering a display interface of the OSD layer based on the updated region to be optimized, and realizing image quality adjustment of part of the display region of the display interface of the OSD layer.
The display image quality adjusting method provided by the embodiment of the application determines the region to be optimized through the display interface of the OSD layer, and can determine the initial picture from the region to be optimized; further, the determination of the intermediate picture can be realized by storing the decoded initial picture into the video layer buffer; in addition, at the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the region to be optimized by transmitting the target picture to an OSD layer buffer memory. And the image quality adjustment is realized for the partial area of the display interface of the OSD layer, so that the visual experience of a user is improved.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, characterized by comprising:
a display;
A controller configured to:
Determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises a display region;
Storing the decoded initial picture into a video layer cache to determine an intermediate picture, wherein the initial picture is determined from the region to be optimized;
at a video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
And transmitting the target picture to an OSD layer buffer memory, and updating the region to be optimized.
2. The display device of claim 1, wherein in the step of determining a region to be optimized in a display interface of an OSD layer, the controller is configured to:
Acquiring a preset display area and/or a range of preset resolution;
Determining a region to be optimized from each display region of an OSD layer display interface based on the preset display region and/or the range of the preset resolution;
the initial picture is determined from the region to be optimized, and the controller is configured to:
Based on the display area, an initial picture is determined.
3. The display device according to claim 1, wherein in the step of determining a target picture by performing image quality adjustment on the intermediate picture based on a preset optimization parameter, the controller is configured to:
Acquiring initial hardware parameters;
determining a target hardware parameter based on an image quality interface of the display device and the preset optimization parameter; the preset optimization parameters are used for updating the initial hardware parameters;
and adjusting the image quality of the intermediate picture based on the target hardware parameters, and determining the target picture.
4. A display device according to claim 3, wherein in the step of determining target hardware parameters based on the image quality interface of the display device and the preset optimization parameters, the controller is configured to:
determining the image quality interface based on an image quality module of the display device;
Updating the initial hardware parameters based on the preset optimization parameters, and determining intermediate hardware parameters;
and determining a target hardware parameter based on the image quality interface and the intermediate hardware parameter.
5. The display device according to claim 1, wherein in the step of determining a target picture by performing image quality adjustment on the intermediate picture based on a preset optimization parameter, the controller is configured to:
Determining image quality parameters of the video layer based on the preset optimization parameters;
And adjusting the image quality of the intermediate picture based on the image quality parameters of the video layer, and determining the target picture.
6. The display device of claim 5, wherein in the step of determining the image quality parameter of the video layer based on the preset optimization parameter, the controller is configured to:
acquiring analysis service of the video layer;
And determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
7. The display device of claim 1, wherein the step of decoding the initial picture and storing the decoded initial picture in a video layer buffer, and determining the intermediate picture, the controller is configured to:
Decoding the initial picture to the OSD layer buffer memory in the OSD layer;
transmitting the decoded initial picture from the OSD layer buffer to the video layer buffer, and determining the intermediate picture;
Or alternatively
Decoding the initial picture to the OSD layer buffer memory through a graphic processor of the display device at the OSD layer;
And sending the decoded initial picture from the OSD layer cache to the video layer cache, and determining the intermediate picture.
8. The display device of claim 1, wherein the transmitting the target picture to an OSD layer buffer updates the region to be optimized, the controller configured to:
Analyzing the target picture in the OSD layer;
and overlapping the analyzed target image to the region to be optimized.
9. The display device of claim 1, wherein the transmitting the target picture to an OSD layer buffer, after updating the region to be optimized, the controller is further configured to:
and updating the display interface of the OSD layer based on the updated region to be optimized.
10. A display image quality adjusting method, characterized by comprising:
Determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises a display region;
Storing the decoded initial picture into a video layer cache to determine an intermediate picture, wherein the initial picture is determined from the region to be optimized;
at a video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
And transmitting the target picture to an OSD layer buffer memory, and updating the region to be optimized.
CN202211017406.1A 2022-08-23 2022-08-23 Display device and display image quality adjusting method Active CN115396717B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211017406.1A CN115396717B (en) 2022-08-23 2022-08-23 Display device and display image quality adjusting method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211017406.1A CN115396717B (en) 2022-08-23 2022-08-23 Display device and display image quality adjusting method

Publications (2)

Publication Number Publication Date
CN115396717A CN115396717A (en) 2022-11-25
CN115396717B true CN115396717B (en) 2024-05-17

Family

ID=84120150

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211017406.1A Active CN115396717B (en) 2022-08-23 2022-08-23 Display device and display image quality adjusting method

Country Status (1)

Country Link
CN (1) CN115396717B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980035261A (en) * 1996-11-12 1998-08-05 김광호 Image quality adjusting device and method
KR20100027315A (en) * 2008-09-02 2010-03-11 엘지전자 주식회사 Display apparatus and control method thereof
WO2014141376A1 (en) * 2013-03-12 2014-09-18 Necディスプレイソリューションズ株式会社 Display device and image quality setting method
CN106843666A (en) * 2015-12-04 2017-06-13 小米科技有限责任公司 The method and device of display interface adjustment
CN109685726A (en) * 2018-11-27 2019-04-26 Oppo广东移动通信有限公司 Scene of game processing method, device, electronic equipment and storage medium
CN111080553A (en) * 2019-12-13 2020-04-28 上海展扬通信技术有限公司 Picture optimization processing method, device and equipment and readable storage medium
CN112839252A (en) * 2019-11-25 2021-05-25 青岛海信电器股份有限公司 Display device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980035261A (en) * 1996-11-12 1998-08-05 김광호 Image quality adjusting device and method
KR20100027315A (en) * 2008-09-02 2010-03-11 엘지전자 주식회사 Display apparatus and control method thereof
WO2014141376A1 (en) * 2013-03-12 2014-09-18 Necディスプレイソリューションズ株式会社 Display device and image quality setting method
CN106843666A (en) * 2015-12-04 2017-06-13 小米科技有限责任公司 The method and device of display interface adjustment
CN109685726A (en) * 2018-11-27 2019-04-26 Oppo广东移动通信有限公司 Scene of game processing method, device, electronic equipment and storage medium
CN112839252A (en) * 2019-11-25 2021-05-25 青岛海信电器股份有限公司 Display device
CN111080553A (en) * 2019-12-13 2020-04-28 上海展扬通信技术有限公司 Picture optimization processing method, device and equipment and readable storage medium

Also Published As

Publication number Publication date
CN115396717A (en) 2022-11-25

Similar Documents

Publication Publication Date Title
CN114302190B (en) Display equipment and image quality adjusting method
CN113395558A (en) Display equipment and display picture rotation adaptation method
CN112506400A (en) Page information voice broadcasting method and display device
US11425466B2 (en) Data transmission method and device
US11960674B2 (en) Display method and display apparatus for operation prompt information of input control
CN111897478A (en) Page display method and display equipment
CN113556593B (en) Display device and screen projection method
CN111176603A (en) Image display method for display equipment and display equipment
CN113395556A (en) Display device and method for displaying detail page
CN112203154A (en) Display device
CN112306604B (en) Progress display method and display device for file transmission
CN114095769B (en) Live broadcast low-delay processing method of application-level player and display device
CN111954043A (en) Information bar display method and display equipment
CN113395600A (en) Interface switching method of display equipment and display equipment
CN115396717B (en) Display device and display image quality adjusting method
CN112235621B (en) Display method and display equipment for visual area
CN113556590B (en) Method for detecting effective resolution of screen-projected video stream and display equipment
CN113703705A (en) Display device and list updating method
CN114296664A (en) Auxiliary screen brightness adjusting method and display device
CN112363683A (en) Method for supporting multi-layer display of webpage application and display equipment
CN111787350A (en) Display device and screenshot method in video call
CN113766164B (en) Display equipment and signal source interface display method
CN112135173B (en) Method for improving play-starting code rate of streaming media and display equipment
CN113436564B (en) EPOS display method and display equipment
CN116684674A (en) Subtitle display method and display equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant