CN115396717A - Display device and display image quality adjusting method - Google Patents

Display device and display image quality adjusting method Download PDF

Info

Publication number
CN115396717A
CN115396717A CN202211017406.1A CN202211017406A CN115396717A CN 115396717 A CN115396717 A CN 115396717A CN 202211017406 A CN202211017406 A CN 202211017406A CN 115396717 A CN115396717 A CN 115396717A
Authority
CN
China
Prior art keywords
picture
display
layer
determining
optimized
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211017406.1A
Other languages
Chinese (zh)
Inventor
高文文
贾亚洲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202211017406.1A priority Critical patent/CN115396717A/en
Publication of CN115396717A publication Critical patent/CN115396717A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440227Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by decomposing into layers, e.g. base layer and one or more enhancement layers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4854End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast

Abstract

The application discloses a display device and a display image quality adjusting method, wherein a region to be optimized is determined through a display interface of an OSD layer, and an initial picture can be determined from the region to be optimized; further, the intermediate picture can be determined by decoding the initial picture and storing the decoded initial picture in a video layer for caching; in addition, in the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the area to be optimized by transmitting the target picture to an OSD layer for caching. The image quality of a partial area of a display interface of the OSD layer is adjusted, and the impression experience of a user is improved.

Description

Display device and display image quality adjusting method
Technical Field
The present application relates to the field of display technologies, and in particular, to a display device and a display image quality adjusting method.
Background
The display device refers to a terminal device capable of outputting a specific display picture, such as a smart television, a mobile terminal, a smart advertisement screen, and the like. Taking an intelligent television as an example, the intelligent television has an open operating system, has an open application platform, supports function expansion, and can install various application programs in the intelligent television according to user needs, for example, social applications such as traditional video applications and short videos, and entertainment applications such as drawing boards and fitness applications, so as to meet the diversified and personalized needs of users.
In the related art, a Display device provides a User Interface (UI for short) for a User through an OSD (On Screen Display), and Display areas of different applications or Display areas of different controls of the same application can be displayed On the UI; the display area in the UI is used for displaying pictures of the image-text interaction information, and the picture quality of the pictures of the interaction information is preset by the operating system based on the display equipment.
Therefore, a method for performing image quality processing on a picture in a display area of an OSD layer is needed.
Disclosure of Invention
The application provides a display device and a display image quality adjusting method, which can be used for solving the technical problem of picture image quality adjustment of a display area in an OSD layer.
In a first aspect, some embodiments of the present application provide a display device comprising a display and a controller, the controller configured to:
determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises one display region;
storing the decoded initial picture into a video layer cache, and determining an intermediate picture, wherein the initial picture is determined from a region to be optimized;
on the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
and transmitting the target picture to an OSD layer for caching, and updating the area to be optimized.
In a second aspect, some embodiments of the present application provide a method for adjusting display image quality, which is applied to a display device, where the display device includes a display and a controller; the method comprises the following steps:
determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises one display region;
decoding an initial picture, storing the decoded initial picture in a video layer cache, and determining an intermediate picture, wherein the initial picture is determined from a region to be optimized;
on the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
and transmitting the target picture to an OSD layer for caching, and updating the area to be optimized.
Some embodiments of the present disclosure provide a display device and a display quality adjustment method, wherein the display quality adjustment method determines a region to be optimized through a display interface on an OSD layer, and determines an initial picture from the region to be optimized; further, the intermediate picture can be determined by decoding the initial picture and storing the decoded initial picture in a video layer for caching; in addition, in the video layer, the image quality of the intermediate picture is adjusted based on the preset optimization parameters, so that the target picture can be determined; and updating the area to be optimized by transmitting the target picture to an OSD layer for caching. The image quality of a partial area of a display interface of the OSD layer is adjusted, and the impression experience of a user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 illustrates an operational scenario between a display device and a control apparatus of some embodiments of the present application;
fig. 2 shows a block diagram of a hardware configuration of the control apparatus 100 of some embodiments of the present application;
fig. 3 illustrates a hardware configuration block diagram of a display device 200 of some embodiments of the present application;
FIG. 4 illustrates a software configuration diagram in a display device according to some embodiments of the present application;
FIG. 5a illustrates a display interface for application selection in accordance with certain embodiments;
FIG. 5b is a diagram illustrating an initial picture of the conventional video application control of FIG. 5 a;
FIG. 5c is a schematic diagram illustrating an initial picture of the short video application control of FIG. 5 a;
FIG. 5d is a diagram illustrating a target picture of the conventional video application control of FIG. 5 b;
FIG. 5e shows a schematic diagram of an initial picture of the short video application control of FIG. 5 c;
FIG. 5f is a diagram showing a display interface of the OSD layer of FIG. 5a after applying the selected partial image quality adjustment;
FIG. 6 is a diagram illustrating timing interaction between an OSD layer and a video layer in a display device according to an embodiment of the application;
FIG. 7a is a timing diagram illustrating the determination of a target picture in a video layer according to an embodiment of the present application;
FIG. 7b is a timing diagram illustrating the determination of a target picture in a video layer according to an embodiment of the present application;
fig. 8 is a flowchart illustrating a method for adjusting display quality according to an embodiment of the present disclosure;
fig. 9a is a schematic flowchart illustrating a target picture determination in a video layer according to an embodiment of the present application;
fig. 9b shows another flowchart of determining a target picture in a video layer according to the embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary embodiment or embodiments, it is to be understood that each aspect of the disclosure can independently be implemented as a single unitary embodiment.
It should be understood that the terms "first," "second," "third," and the like in the description and claims of this application and in the foregoing drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.
Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
The display device provided by the embodiment of the present application may have various implementation forms, and for example, the display device may be a television, a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic whiteboard), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, the user may operate the display device 200 through the smart device 300 or the control apparatus 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200.
In some embodiments, a smart device 300 (e.g., a mobile terminal, a tablet, a computer, a laptop, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments, the display device may not receive instructions using the smart device or control device described above, but may receive user control through touch or gestures, or the like.
In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
Fig. 3 illustrates a hardware configuration block diagram of a display device 200 of some embodiments of the present application; as shown in fig. 3, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
In some embodiments the controller comprises a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface.
The display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
A user interface for receiving control signals for controlling the apparatus 100 (e.g., an infrared remote control, etc.).
The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals.
In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.
The video processor is used for receiving external video signals, and performing video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis and the like according to a standard coding and decoding protocol of the input signals to obtain the video signals which are directly displayed or played on the display.
Illustratively, the video processor includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.
And the graphics processor is used for generating various graphic objects, such as icons, operation menus, user input instruction display graphics and the like. The graphic processor may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to the display attributes; and the renderer is used for generating various objects obtained based on the arithmetic unit and displaying the rendering result on the display.
A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
A "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables the conversion of the internal form of information to a form acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
FIG. 4 illustrates a diagram of a software configuration in a display device according to some embodiments of the present application; as shown in fig. 4, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In the system framework of the display device 200, a plurality of display processing levels, such as a Video layer (Video layer), an OSD layer, and the like, are arranged. Wherein, the video layer refers to a display hierarchy used for presenting a playing picture of the streaming media resource on the display device 200 when the media resource is played; which may also be referred to as a picture layer of the display device 200, may display a playback picture corresponding to the media asset on the picture layer. The OSD layer refers to a display hierarchy for providing interactive operations for a user, and may also be referred to as a UI layer of the display apparatus 200.
When displaying the video frames of the streaming media resources, the display device 200 may perform image quality processing on the video frames by adjusting the image quality of the media asset information. The image quality processing may include processing of an image on each frame of a video picture, such as color correction, color adjustment, sharpness adjustment, and the like, and may also include processing of multi-frame data of the video picture, such as frame interpolation algorithm, motion compensation, and the like. Through image quality processing, the image display quality can be further improved, and therefore better film viewing experience is achieved under the condition that the configuration of the same equipment is the same and the size of video source resources is not increased.
The video layer can adjust the image quality of the media information to realize the image quality processing of the display picture, and the OSD layer can display areas of different applications or display areas of different controls of the same application; the superposition of characters, graphics and images can be displayed according to the requirements of each display area corresponding to applications or control functions, and the size, the position and the color information of each display area can be adjusted. When the display device 200 displays the OSD screen, the entire image is displayed by superimposing the layers of the surface flickers through the GPU calculation, but the image quality adjustment function cannot be realized on the OSD layer for each display area displayed on the OSD layer.
Fig. 5a shows a display interface for application selection in some embodiments, as shown in fig. 5a, display areas of different applications are displayed on the display interface, which may relate to social applications such as traditional video applications and short videos, and entertainment applications such as drawing boards and fitness applications, in order to highlight themes and display effects, information display may be more efficient in a graphic layout manner, in UI images displayed in the graphic display areas, images used for foreground display of the applications may be dynamically obtained for implementation, and in a USD layer, image quality processing cannot be performed on the images in the display areas according to requirements, so that the display effect of the images is smaller than that of a video page.
As shown in fig. 5a, for a display area 501 of a palette application a, a display area 502 of a fitness application B, and the like, the requirement of the user on the image quality of the display area is not high, and for a display area 503 of a conventional video application C and a display area 504 of a short video application D, when the image quality of the display area is different from the image quality of a media asset video playing interface, the use experience of the user may be affected, and the display effect of the application display area may be inferior to the display effect of the media asset video.
In order to implement image quality adjustment on a display area in an OSD interface on the display 260, some embodiments of the present application provide a display device and a display image quality adjustment method, where an area to be optimized is determined in a display interface of an OSD layer; decoding the initial picture determined from the region to be optimized on the OSD layer, sending the intermediate piece after the initial picture is decoded to a video layer for cache storage, and performing image quality adjustment on the intermediate picture based on preset optimization parameters on the video layer to determine a target picture; and then sending the target picture with the adjusted picture quality back to an OSD layer cache, updating a region to be optimized of a UI interface of the display equipment based on the target picture, realizing the picture quality adjustment of a part of display regions in the OSD interface of the display equipment, and improving the use experience of a user.
In order to further understand the technical solutions in some embodiments of the present application, the following detailed description is provided for a display device and a display image quality adjusting method in conjunction with some specific embodiments.
FIG. 6 is a diagram illustrating timing interaction between an OSD layer and a video layer in a display device according to an embodiment of the application; as shown in fig. 6, the method for adjusting the display image quality of the OSD layer includes the following steps:
and on the OSD layer, S101, determining a region to be optimized in the display interface.
For each display area in the OSD layer display interface, the area to be optimized can be determined through the preset display area, and the area to be optimized is a partial display area in the display interface, can be a certain display area, and can also be a plurality of display areas.
When OSD layer display interface is the display interface of using, wherein every application APP passes through the demonstration of controlling part, and this controlling part can contain one kind of picture, characters at least, to most APP controlling parts, through adopting the stack of picture and characters, when increasing user's understanding, improve user's visual experience.
When the display interface of the OSD layer is the display interface of each function in the application, each function can be displayed through the control, and the same control at least comprises one of pictures or characters.
When the controls are displayed in a superposed manner through pictures or pictures and texts, the display area to be optimized can be determined through the information of the controls and the preset display area, it should be understood that each control can have a unique identifier, and the area to be optimized is determined from the identifier corresponding to each control through the preset display area.
In some embodiments, a certain type of picture region may need to be optimized, and a region to be optimized may be determined by a preset resolution range, and at this time, only all pictures within the preset resolution range are subjected to subsequent image quality processing, so that batch image quality processing of the display region may be realized, and processing efficiency may be improved.
The resolution generally determines the fineness of the picture details, and the higher the picture resolution, the more pixels are included, the sharper the picture is, of course, the unit of the resolution is also dot per inch, line per inch, pixel per inch, and the like, and for the interface displayed by the display device, the pixels are generally used.
For the two methods for determining the region to be optimized, in some embodiments, the region to be optimized may be determined from each region of the OSD layer display interface by combining the preset display region and the preset resolution range, so as to implement batch processing with pertinence and improve the precision of the scheme. Meanwhile, the defect that only the preset display area is used, although the accuracy is high and the pertinence is strong, the flexibility is poor can be effectively improved, and the defect that only the range of the preset resolution ratio is weak in pertinence can also be effectively improved.
Under different application scenes, a proper method for determining the area to be optimized is selected, and a quick and efficient solution can be provided for equipment.
For example, the OSD layer display interface shown in fig. 5a may determine the region to be optimized through step 101, where the region to be optimized is a display region where the controls corresponding to the conventional video application C and the short video application D are located.
Taking a display device of an Android system as an example, in Android, in order to interact with a screen of the device, two types which are most common and most important are: view class, viewGroup class. View and Viewgroup are the upper classes of the core.
View type: the entire displayed screen may be composed of one or more View objects, which View class provides the Android developer with which controllable attributes: boundary (size), layout on screen, layer display order, scrolling, focus, key interaction, gesture interaction. More detailed and more specific UI elements can be constructed by deriving it, for example: buttons, check boxes, single row buttons, and text boxes.
The ViewGroup class is a subclass derived from View, and is used for deriving a layout container class which can organize and orderly organize View objects on a screen. ViewGroup is a layout container, which is typically a collection of UI elements, which can be buttons, text boxes, check boxes, etc. That is, the UI elements may be of any type (including custom new controls derived from the View class).
The DecorView is the top View of the whole Window interface, and the measurement, layout, drawing and event distribution of the View are all performed by traversing the View tree downwards by the DecorView. DecorView, as a top-level View, typically contains a vertical LinearLayout inside it, which has two sections, i.e., a header section above and a content section below.
At the OSD layer, S102, the initial picture determined from the region to be optimized is decoded.
The corresponding initial picture in the area to be optimized, typically a bitmap image, may be a dot matrix image or a raster image, and is composed of single points called pixels (picture elements). The dots can be arranged and dyed differently to form a pattern. It features that the change of colour and the fine transition of colour can be expressed to generate lifelike effect.
Taking the display device of the Android system as an example, the Android supports bitmap files of three formats: -png,. Jpg,. Gif.
If the picture is placed in a drawable directory from an initial picture determined in the area to be optimized, the Android system selects a picture file from the directory with the corresponding resolution according to the resolution of the display equipment; if the image is placed in the asset directory, when the image is opened by a resource management framework (asset manager), or the image is placed in a memory, the system reads the file of the specified path, and the adaptation process is not stored.
And decoding the determined initial picture, wherein the decoder mainly decodes Skia by taking a display device of an Android system as an example.
In some embodiments, the non-mainline rendering is not considered, and only mainline rendering is considered, including decoding of software renderings and decoding of hardware renderings.
For decoding of software drawing, an initial picture is generally directly drawn on an OSD layer cache of an OSD layer; for the decoding of hardware accelerated drawing, under the condition of GPU drawing, an initial picture is firstly uploaded to a GPU to form texture, and then the texture is rendered to an OSD layer cache of an OSD layer based on texture sampling.
For example, in the OSD layer display interface shown in fig. 5a, the initial pictures corresponding to the display areas where the areas to be optimized are the controls corresponding to the conventional video application C and the short video application D are respectively shown as the initial picture 610 in fig. 5b and the initial picture 620 in fig. 5C, that is, fig. 5b shows a schematic diagram of the initial picture of the conventional video application control in fig. 5a, and fig. 5C shows a schematic diagram of the initial picture of the short video application control in fig. 5 a.
S103, storing the decoded initial picture into a video layer for caching, and determining an intermediate picture.
Through step 103, the parsed initial picture is sent from the OSD layer to the video layer and stored in the video layer cache, and the initial picture stored in the video layer cache is recorded as an intermediate picture.
It should be understood that, through steps 102 and 103, at the OSD layer, the initial picture is decoded to an OSD layer buffer; sending the decoded initial picture from the OSD layer cache to the video layer cache to determine an intermediate picture;
or, through step 102 and step 103, decoding the initial picture to an OSD layer buffer memory through a graphics processor of the display device at the OSD layer; and sending the decoded initial picture from the OSD layer cache to the video layer cache to determine an intermediate picture.
In some embodiments, the OSD layer buffer may refer to a graphics buffer for display, while a video layer buffer (video buffer) in the video layer.
And S104, in the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture.
The image quality adjustment of the intermediate picture is realized on the video layer, the image quality adjustment can be realized by calling a video image quality interface and improving hardware parameters, and a target picture is determined; the target picture may be determined by changing the picture quality parameters of the video layer intermediate picture and performing picture analysis and picture quality adjustment based on the newly generated picture quality parameters.
Fig. 7a is a timing diagram illustrating determination of a target picture in a video layer according to an embodiment of the present application, where as shown in fig. 7a, initial hardware parameters are obtained. And determining target hardware parameters based on the image quality interface of the display equipment and preset optimization parameters. And the preset optimization parameters are used for updating the initial hardware parameters.
The target picture determination specifically comprises the following steps:
and S141, determining an image quality interface based on the image quality module of the display equipment.
In some embodiments, the quality of the intermediate picture may be determined by the PQ quality module that the quality interface needs to be invoked.
And S142, calling a video image quality interface.
In some embodiments, the modification of the hardware parameters may be accomplished by calling a flow interface.
In some embodiments, for the modification of the hardware parameters, updating the initial hardware parameters based on preset optimization parameters, and determining intermediate hardware parameters; and determining target hardware parameters based on the image quality interface and the intermediate hardware parameters.
And S143, carrying out image quality adjustment on the intermediate picture based on the target hardware parameter, and determining the target picture.
And a new function is given to the original hardware equipment to realize the image quality adjustment of the intermediate picture and determine the target picture.
In some embodiments, the application calls the flow interface, the middleware called by the JNI is used, and then the middleware calls the interface provided by the scheme provider to improve the hardware quality, so that the quality of the video layer is improved.
Fig. 7b shows another timing diagram for determining a target picture in a video layer according to an embodiment of the present application, where as shown in fig. 7b, the determining a target picture specifically includes the following steps:
and S144, determining the image quality parameters of the video layer based on the preset optimization parameters.
Acquiring an analysis service of a video layer; and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
It should be understood that the image quality parameters of the video layer can be determined by modifying the parsing parameters of the native framework skia and presetting the optimization parameters.
And S145, adjusting the image quality of the intermediate image based on the image quality parameters of the video layer, and determining the target image.
And changing the image quality of the intermediate picture through the modified image quality parameters to refresh the intermediate picture to obtain a target picture, wherein the target picture is stored in the video layer cache.
For example, fig. 5d shows a schematic diagram of a target picture of the conventional video application control of fig. 5b, fig. 5e shows a schematic diagram of an initial picture of the short video application control of fig. 5c, and through steps 103 and 104, the quality of the target picture 630 of fig. 5d is adjusted relative to the initial picture 610 of fig. 5 b; the target picture 640 of fig. 5e has an adjusted picture quality relative to the initial picture 620 of fig. 5 c.
And S105, transmitting the target picture to an OSD layer for caching, and updating the region to be optimized.
Copying or rendering a target picture in a video layer cache to an OSD layer cache, and analyzing the target picture at the OSD layer; and overlapping the analyzed target picture to the area to be optimized.
In some embodiments, by optimizing the target picture of the video buffer image quality data, the target picture of the video buffer is copied to the graphic buffer because the OSD layer cannot directly process the video buffer data. And then the surfaceFlinger analyzes the data of the graphic buffer to generate a new region to be optimized with improved image quality.
After the step 105, the method for adjusting the displayed image quality of the OSD layer further includes the following steps, and is implemented in the OSD layer:
and S106, updating the display interface of the OSD layer based on the updated region to be optimized.
And rendering the display interface of the OSD layer based on the updated region to be optimized, and realizing image quality adjustment of part of the display region of the display interface of the OSD layer.
For example, fig. 5f shows the display interface of the OSD layer after applying the selected partial image quality adjustment in fig. 5a, a display area to be optimized is acquired on the display interface of the OSD layer, and after performing image quality adjustment on the video layer, the display interface of the OSD layer is copied and updated.
The method for adjusting the display image quality provided by the embodiment determines the area to be optimized through the display interface of the OSD layer, and determines the initial picture from the area to be optimized; further, the intermediate picture can be determined by decoding the initial picture and storing the decoded initial picture in a video layer for caching; in addition, in the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the area to be optimized by transmitting the target picture to an OSD layer for caching. The image quality of a partial area of a display interface of the OSD layer is adjusted, and the impression experience of a user is improved.
Fig. 8 is a flowchart illustrating a display quality adjustment method according to an embodiment of the present disclosure, where the display quality adjustment method is applied to a display apparatus 200, and the display apparatus 200 includes a display 260 and a controller 250. The controller 250 is configured to perform the following steps:
s201, determining a region to be optimized in a display interface of the OSD layer.
Wherein the area to be optimized comprises at least one display area. The display interface comprises a plurality of display areas, and the area to be optimized can comprise one display area or a plurality of display areas.
In some embodiments, a preset application partition preset display area is obtained; determining a region to be optimized from each region of an OSD layer display interface based on a preset application region preset display region enclosure; wherein the area to be optimized comprises at least one display area.
In some embodiments, a range of preset resolutions is obtained; determining a region to be optimized from each region of an OSD layer display interface based on the range of the preset resolution; wherein the area to be optimized comprises at least one display area.
In some embodiments, a preset application partition preset display area and a range of a preset resolution are obtained; determining a region to be optimized from each region of an OSD layer display interface based on a preset application region, a preset display region and a preset resolution range; wherein the area to be optimized comprises at least one display area.
And determining an initial picture from the area to be optimized, wherein the initial picture is determined based on the display area.
S202, the initial picture is decoded and stored in a video layer cache, and an intermediate picture is determined.
The operation of decoding the initial picture in step 202 may be implemented at the OSD layer, which is as follows:
decoding the initial picture to an OSD layer for caching at the OSD layer; and sending the decoded initial picture from the OSD layer cache to the video layer cache to determine an intermediate picture.
Alternatively, the first and second electrodes may be,
decoding the initial picture to an OSD layer cache through a graphic processor of display equipment on an OSD layer; and sending the decoded initial picture from the OSD layer cache to the video layer cache to determine an intermediate picture.
In some embodiments, the operation of comparing the initial picture decoded by step 202 may also be implemented in a video layer, in which case step 202 stores the initial picture in a video layer buffer, and determines an intermediate picture based on the initial picture decoding in the video layer buffer.
S203, in the video layer, adjusting the image quality of the intermediate picture based on the preset optimization parameters, and determining a target picture.
Fig. 9a is a schematic flowchart illustrating a target picture determination process in a video layer according to an embodiment of the present application, and as shown in fig. 9a, the schematic diagram of the target picture determination process is implemented on the basis of hardware, and the image quality adjustment is implemented by giving a new application to the hardware. The method specifically comprises the following steps:
and S231, calling an image quality interface.
And determining a picture quality interface based on a picture quality module of the display device. In some embodiments, the quality of the intermediate picture may be determined by the PQ quality module that the quality interface needs to be invoked.
In some embodiments, the modification of the hardware parameters may be accomplished by calling a flow interface.
In some embodiments, for the modification of the hardware parameters, updating the initial hardware parameters based on preset optimization parameters, and determining intermediate hardware parameters; and determining target hardware parameters based on the image quality interface and the intermediate hardware parameters.
And S232, modifying the intermediate hardware parameters.
Initial hardware parameters are obtained. Determining intermediate hardware parameters based on an image quality interface of the display equipment and preset optimization parameters; and the preset optimization parameters are used for updating the initial hardware parameters.
And S233, determining target hardware parameters based on the intermediate hardware parameters.
And determining target hardware parameters based on the image quality interface and the intermediate hardware parameters.
And S234, adjusting the image quality of the intermediate picture based on the target hardware parameter, and determining the target picture.
And a new function is given to the original hardware equipment to realize the image quality adjustment of the intermediate picture and determine the target picture.
In some embodiments, the application calls the flow interface, the middleware called by the JNI is used, and then the middleware calls the interface provided by the scheme provider to improve the hardware quality, so that the quality of the video layer is improved.
Fig. 9b is a schematic flowchart illustrating a target picture determination in a video layer according to an embodiment of the present application; as shown in fig. 9b, the target picture is determined based on software to realize image quality adjustment. The method specifically comprises the following steps:
and S235, calling a self-packaging interface.
And S236, determining the image quality parameters of the video layer based on the preset optimization parameters.
In some embodiments, a parsing service of a video layer is obtained; and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
Acquiring an analysis service of a video layer; and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
It should be understood that the image quality parameters of the video layer can be determined by modifying the parsing parameters of the native framework skia and presetting the optimization parameters.
And S237, adjusting the image quality of the intermediate picture based on the image quality parameters of the video layer, and determining a target picture.
And changing the image quality of the intermediate picture through the modified image quality parameters to refresh the intermediate picture to obtain a target picture, wherein the target picture is stored in the video layer cache.
And S204, transmitting the target picture to an OSD layer for caching, and updating the region to be optimized.
Analyzing a target picture on an OSD layer; and overlapping the analyzed target picture to the area to be optimized.
In some embodiments, by optimizing the target picture of the video buffer image quality data, the target picture of the video buffer is copied to the graphic buffer because the OSD layer cannot directly process the video buffer data. And then, the center displays and controls the SurfaceFlinger to analyze the data of the graphic buffer, and a new area to be optimized with improved image quality is generated.
After step 204, the method for adjusting the displayed image quality of the OSD layer further includes the following steps:
and S205, updating the display interface of the OSD layer based on the updated region to be optimized.
And rendering the display interface of the OSD layer based on the updated region to be optimized, and realizing image quality adjustment of part of the display region of the display interface of the OSD layer.
The method for adjusting the display image quality determines the area to be optimized through a display interface of an OSD layer, and determines an initial picture from the area to be optimized; further, the initial picture is decoded and then stored in a video layer for caching, so that the intermediate picture can be determined; in addition, in the video layer, the image quality of the intermediate picture is adjusted based on preset optimization parameters, so that the target picture can be determined; and updating the area to be optimized by transmitting the target picture to an OSD layer for caching. The image quality of a partial area of a display interface of the OSD layer is adjusted, and the impression experience of a user is improved.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, comprising:
a display;
a controller configured to:
determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises one display region;
storing an initial picture into a video layer cache after decoding, and determining an intermediate picture, wherein the initial picture is determined from the region to be optimized;
on the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
and transmitting the target picture to an OSD layer for caching, and updating the region to be optimized.
2. The display device according to claim 1, wherein in the step of determining a region to be optimized in a display interface of the OSD layer, the controller is configured to:
acquiring a preset display area and/or a range of preset resolution;
determining a region to be optimized from each display region of an OSD layer display interface based on the preset display region and/or the range of the preset resolution;
the initial picture is determined from the area to be optimized, the controller is configured to:
based on the display area, an initial picture is determined.
3. The display device according to claim 1, wherein in the step of determining the target picture by performing the picture quality adjustment on the intermediate picture based on the preset optimization parameter, the controller is configured to:
acquiring initial hardware parameters;
determining target hardware parameters based on the image quality interface of the display equipment and the preset optimization parameters; the preset optimization parameters are used for updating the initial hardware parameters;
and performing image quality adjustment on the intermediate picture based on the target hardware parameter, and determining the target picture.
4. The display device according to claim 3, wherein in the step of determining target hardware parameters based on the picture quality interface of the display device and the preset optimization parameters, the controller is configured to:
determining the image quality interface based on an image quality module of the display device;
updating the initial hardware parameters based on the preset optimization parameters, and determining intermediate hardware parameters;
and determining target hardware parameters based on the image quality interface and the intermediate hardware parameters.
5. The display device according to claim 1, wherein in the step of determining the target picture by performing the picture quality adjustment on the intermediate picture based on the preset optimization parameter, the controller is configured to:
determining image quality parameters of the video layer based on the preset optimization parameters;
and performing image quality adjustment on the intermediate picture based on the image quality parameters of the video layer, and determining the target picture.
6. The display device according to claim 5, wherein in the step of determining the picture quality parameter of the video layer based on the preset optimization parameter, the controller is configured to:
acquiring the analysis service of the video layer;
and determining the image quality parameters of the video layer based on the analysis service and the preset optimization parameters.
7. The display device according to claim 1, wherein in the step of decoding the initial picture and storing the decoded initial picture in a video layer buffer to determine an intermediate picture, the controller is configured to:
decoding, at the OSD layer, the initial picture to the OSD layer cache;
sending the decoded initial picture from the OSD layer cache to the video layer cache to determine the intermediate picture;
alternatively, the first and second electrodes may be,
decoding the initial picture to the OSD layer cache through a graphic processor of the display device at the OSD layer;
and sending the decoded initial picture from the OSD layer cache to the video layer cache, and determining the intermediate picture.
8. The display device according to claim 1, wherein the transferring the target picture to an OSD layer buffer, updating the region to be optimized, the controller is configured to:
analyzing the target picture on the OSD layer;
and overlapping the analyzed target picture to the area to be optimized.
9. The display device according to claim 1, wherein after the target picture is transferred to an OSD layer buffer and the region to be optimized is updated, the controller is further configured to:
and updating the display interface of the OSD layer based on the updated region to be optimized.
10. A method for adjusting display image quality, comprising:
determining a region to be optimized in a display interface of an OSD layer, wherein the region to be optimized at least comprises one display region;
storing an initial picture into a video layer cache after decoding, and determining an intermediate picture, wherein the initial picture is determined from the region to be optimized;
on the video layer, adjusting the image quality of the intermediate picture based on preset optimization parameters, and determining a target picture;
and transmitting the target picture to an OSD layer for caching, and updating the region to be optimized.
CN202211017406.1A 2022-08-23 2022-08-23 Display device and display image quality adjusting method Pending CN115396717A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211017406.1A CN115396717A (en) 2022-08-23 2022-08-23 Display device and display image quality adjusting method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211017406.1A CN115396717A (en) 2022-08-23 2022-08-23 Display device and display image quality adjusting method

Publications (1)

Publication Number Publication Date
CN115396717A true CN115396717A (en) 2022-11-25

Family

ID=84120150

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211017406.1A Pending CN115396717A (en) 2022-08-23 2022-08-23 Display device and display image quality adjusting method

Country Status (1)

Country Link
CN (1) CN115396717A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980035261A (en) * 1996-11-12 1998-08-05 김광호 Image quality adjusting device and method
KR20100027315A (en) * 2008-09-02 2010-03-11 엘지전자 주식회사 Display apparatus and control method thereof
WO2014141376A1 (en) * 2013-03-12 2014-09-18 Necディスプレイソリューションズ株式会社 Display device and image quality setting method
CN106843666A (en) * 2015-12-04 2017-06-13 小米科技有限责任公司 The method and device of display interface adjustment
CN109685726A (en) * 2018-11-27 2019-04-26 Oppo广东移动通信有限公司 Scene of game processing method, device, electronic equipment and storage medium
CN111080553A (en) * 2019-12-13 2020-04-28 上海展扬通信技术有限公司 Picture optimization processing method, device and equipment and readable storage medium
CN112839252A (en) * 2019-11-25 2021-05-25 青岛海信电器股份有限公司 Display device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980035261A (en) * 1996-11-12 1998-08-05 김광호 Image quality adjusting device and method
KR20100027315A (en) * 2008-09-02 2010-03-11 엘지전자 주식회사 Display apparatus and control method thereof
WO2014141376A1 (en) * 2013-03-12 2014-09-18 Necディスプレイソリューションズ株式会社 Display device and image quality setting method
CN106843666A (en) * 2015-12-04 2017-06-13 小米科技有限责任公司 The method and device of display interface adjustment
CN109685726A (en) * 2018-11-27 2019-04-26 Oppo广东移动通信有限公司 Scene of game processing method, device, electronic equipment and storage medium
CN112839252A (en) * 2019-11-25 2021-05-25 青岛海信电器股份有限公司 Display device
CN111080553A (en) * 2019-12-13 2020-04-28 上海展扬通信技术有限公司 Picture optimization processing method, device and equipment and readable storage medium

Similar Documents

Publication Publication Date Title
CN112533021B (en) Display method and display equipment
CN114302190B (en) Display equipment and image quality adjusting method
CN112506400A (en) Page information voice broadcasting method and display device
CN112580302B (en) Subtitle correction method and display equipment
CN113094142A (en) Page display method and display equipment
CN113542851B (en) Menu refreshing method and display device
CN112954376A (en) Video playing method and display equipment
CN112203154A (en) Display device
CN113453069B (en) Display device and thumbnail generation method
CN113434240B (en) Display method and display device of image mode
CN112363683B (en) Method and display device for supporting multi-layer display by webpage application
CN112235621B (en) Display method and display equipment for visual area
CN112486921B (en) File synchronization method, display device and mobile terminal
CN114710633A (en) Display apparatus and video signal display method
CN113556590B (en) Method for detecting effective resolution of screen-projected video stream and display equipment
CN113992960A (en) Subtitle previewing method on display device and display device
CN115396717A (en) Display device and display image quality adjusting method
CN113703705A (en) Display device and list updating method
CN113015017A (en) Image quality compensation method and display device
CN113766164B (en) Display equipment and signal source interface display method
CN112135173B (en) Method for improving play-starting code rate of streaming media and display equipment
CN113596563B (en) Background color display method and display device
CN113436564B (en) EPOS display method and display equipment
CN112419988B (en) Backlight adjusting method and display device
CN116684674A (en) Subtitle display method and display equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination