CN110767184B - Backlight brightness processing method, system, display device and medium - Google Patents
Backlight brightness processing method, system, display device and medium Download PDFInfo
- Publication number
- CN110767184B CN110767184B CN201911211919.4A CN201911211919A CN110767184B CN 110767184 B CN110767184 B CN 110767184B CN 201911211919 A CN201911211919 A CN 201911211919A CN 110767184 B CN110767184 B CN 110767184B
- Authority
- CN
- China
- Prior art keywords
- image frame
- brightness value
- average brightness
- frame sequence
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
- G09G3/3413—Details of control of colour illumination sources
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
Abstract
The application discloses a backlight brightness processing method, a system, a display device and a medium. The method comprises the following steps: receiving two image frame sequences, wherein the two image frame sequences comprise a first image frame sequence and a second image frame sequence, and each image frame sequence at least comprises a previous image frame and a current image frame which are sequentially adjacent in frame sequence number; according to the continuously changed frame sequence number, a first image frame sequence or a second image frame sequence is alternately selected from two image frame sequences to perform local backlight processing; when local backlight processing is performed each time, if the local backlight processing is not performed on the first image frame sequence, acquiring an average brightness value of a previous image frame included in the first image frame sequence as an average brightness value of a current frame; or, if the local backlight processing is not performed on the second image frame sequence, the average brightness value of the previous image frame included in the second image frame sequence is acquired as the average brightness value of the current frame. Which helps to increase the frame refresh rate.
Description
Technical Field
The present application relates to the field of display technologies, and in particular, to a backlight brightness processing method, a backlight brightness processing system, a display device, and a medium.
Background
Liquid Crystal Display (LCD) devices are widely used in electronic devices such as computer Display devices, notebook computers, mobile phones, and Liquid Crystal televisions, and are still active in the field of virtual reality Display. The liquid crystal display device mainly comprises a liquid crystal display panel and a backlight source, wherein the backlight source provides a light source for the liquid crystal display panel.
Hundreds of Light Emitting diodes (LEDs for short) are used as the backlight source, and the backlight source can be adjusted according to the brightness of the image, so that the brightness value corresponding to the high brightness part in the displayed image reaches the maximum value, and the brightness value corresponding to the synchronous brightness dark part can be reduced or even turned off, so as to obtain the optimal contrast.
Disclosure of Invention
In view of the foregoing drawbacks and deficiencies of the prior art, it is desirable to provide a method, a system, a display device, and a medium for processing backlight brightness, which reduce the time required for backlight processing and improve the frame refresh rate of the output from the software.
In a first aspect, an embodiment of the present application provides a backlight brightness processing method, where the method includes:
receiving two image frame sequences, wherein the two image frame sequences comprise a first image frame sequence and a second image frame sequence, and each image frame sequence at least comprises a previous image frame and a current image frame which are sequentially adjacent in frame sequence number;
according to the continuously changed frame sequence number, a current image frame corresponding to the frame sequence number in a first image frame sequence or a second image frame sequence is alternately selected from the two image frame sequences to be subjected to local backlight processing, wherein when the first image frame sequence is subjected to the local backlight processing, the second image frame sequence is not subjected to the local backlight processing, or when the second image frame sequence is subjected to the local backlight processing, the first image frame sequence is not subjected to the local backlight processing;
when local backlight processing is performed each time, if the local backlight processing is not performed on the first image frame sequence, acquiring an average brightness value of a previous image frame included in the first image frame sequence as an average brightness value of a current image frame; or, if the second image frame sequence is not subjected to the local backlight processing, the average brightness value of the previous image frame included in the second image frame sequence is acquired as the average brightness value of the current image frame.
In a second aspect, an embodiment of the present application provides a backlight brightness processing system, including: the display device comprises a first display screen and a second display screen, the first processing device is in signal connection with the display device,
a first processing device for performing the backlight brightness processing method as described in the first aspect, and synchronously obtaining two average brightness values corresponding to the frame serial number, where the two average brightness values include an average brightness value corresponding to the first display screen and an average brightness value corresponding to the second display screen; the average brightness value corresponding to the first display screen and the image frame corresponding to the average brightness value corresponding to the first display screen are sent to the first display screen of the display device; simultaneously sending the image frames corresponding to the average brightness value corresponding to the second display screen and the average brightness value corresponding to the second display screen of the display device, wherein the image frames corresponding to the average brightness value corresponding to the first display screen and the image frames corresponding to the average brightness value corresponding to the second display screen have the same frame sequence number;
and the display device is used for adjusting the backlight brightness of the first display screen according to the average brightness value corresponding to the first display screen, and simultaneously adjusting the backlight brightness of the second display screen according to the average brightness value corresponding to the second display screen.
In a third aspect, an embodiment of the present application provides a head-mounted display device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the method described in the first aspect when executing the above program.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, the computer program being configured to:
which when executed by a processor implements a method as described in embodiments of the present application.
The backlight brightness processing method, the apparatus, the display device and the medium provided by the embodiment of the application receive two image frame sequences, and alternately select a first image frame sequence or a second image frame sequence from the two image frame sequences to perform local backlight processing according to continuously changing frame sequence numbers, wherein when the local backlight processing is performed on the first image frame sequence, the local backlight processing is not performed on the second image frame sequence, or when the local backlight processing is performed on the second image frame, the local backlight processing is not performed on the first image frame sequence, and when the local backlight processing is performed each time, if the local backlight processing is not performed on the first image frame sequence, an average brightness value of a previous image frame included in the first image frame sequence is obtained as an average brightness value of a current image frame; or if the second image frame is not subjected to the local backlight processing, acquiring the average brightness value of the previous image frame contained in the second image frame as the average brightness value of the current image frame. According to the embodiment of the application, the local backlight processing is carried out on the single preprocessed image, so that the processing time is saved, the speed of outputting the image to the display screen is increased, and the frame refresh rate of the image frame output by the software end is increased.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 is a schematic diagram illustrating an application scenario provided by an embodiment of the present application and including a display device;
fig. 2 is a schematic flowchart illustrating a backlight brightness processing method provided in an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a display flow provided by an embodiment of the present application;
FIG. 4 shows a schematic flow chart of step 103 provided by an embodiment of the present application;
fig. 5 shows an exemplary structure block diagram of a backlight brightness processing system 500 provided in the embodiment of the present application;
FIG. 6 is a timing diagram illustrating a backlight brightness processing method according to an embodiment of the present application and a related art;
fig. 7 shows a schematic structural diagram of a computer system 600 of a display device provided in an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant disclosure and are not limiting of the disclosure. It should be further noted that, for the convenience of description, only the portions relevant to the disclosure are shown in the drawings.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an application scenario provided by an embodiment of the present application and including a display device. As shown in fig. 1, the application scenario may include a display device 1, where the display device 1 includes a display module 11. The display module 11 is used for displaying the received image data.
Further, the display device 1 may further include: an image acquisition module 12 and an image processing module 12.
When the image capturing module 12 captures a video image frame (referred to as an image frame for short), the video image frame is transmitted to the image processing module 13, and the image processing module 13 processes the video image frame and then outputs the processed video image frame to the display module 11.
The application scenario may further include a terminal device 2, and the display device 1 and the terminal device 2 may establish a connection path therebetween in a wireless or wired manner.
The terminal device 2 may be, for example, a smartphone, a tablet computer, a personal computer, a camera device with a processor, a camera, or the like. The terminal device 2 may also include a display module 21, an image capturing module 22, an image processing module 23, etc., wherein the functions of the image capturing module and the image processing module may be the same as those of the display device 1.
Preferably, the display device 1 may be a stand-alone head-mounted display device or an integrated head-mounted display device. The independent head-mounted display device needs to be matched with other processing devices to realize information display. The integrated head-mounted display device can display information through the processing device contained in the integrated head-mounted display device. The display device may be used to implement Virtual Reality (VR) or Augmented Reality (AR). Taking VR glasses as an example of the display device 1, the VR glasses include a first display screen and a second display screen, wherein the first display screen corresponds to a left eye, and the second display screen corresponds to a right eye; or vice versa. First and second are presented herein as distinct representations and are not to be construed as sequential limitations.
When the image capturing module 12 or the image capturing module 22 captures a plurality of video image frames, each video image frame is input into the image processing module 13 or the image processing module 23 one by one. The image processing module in the prior art may include image rendering processing, image inverse distortion processing, Local backlight adjustment processing (Local Dimming), and the like. The image Processing module may be hardware or software, and the image Processing module may include a CPU (Central Processing Unit) or a GPU (Graphic Processing Unit) as an arithmetic device.
Currently, in virtual reality systems, each image frame may need to be processed separately in real time by a local backlight adjustment process. For a high resolution virtual reality system, the time required to process each image frame in real time is very long, and the performance of a processor configured in the virtual reality system is not so high, for example, not as high as the configuration of a processor of a personal computer device, and therefore, a low configuration processor for processing high resolution image data for display may cause a stuck problem.
In order to solve the above problem, an embodiment of the present application provides a backlight brightness processing method. The method can be executed by a backlight brightness processing device, the backlight brightness processing device can be an image processing module in the virtual reality system, and can also be a processing module in other terminal equipment in the virtual reality system, and the other terminal equipment can also be matched with display equipment in the virtual reality system to jointly realize the display of the virtual reality image.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a backlight brightness processing method according to an embodiment of the present disclosure. The method is performed by a backlight brightness processing device. As shown in fig. 1, the method includes:
102, according to continuously changing frame sequence numbers, alternately selecting a current image frame corresponding to the frame sequence number from a first image frame sequence or a second image frame sequence from the two image frame sequences to perform local backlight processing, wherein when the local backlight processing is performed on the first image frame sequence, the local backlight processing is not performed on the second image frame sequence, or when the local backlight processing is performed on the second image frame sequence, the local backlight processing is not performed on the first image frame sequence;
In the above step, when the image frame sequence is received, each of the image frame sequence is preprocessed to obtain two images, wherein one image is provided for a first display screen of the display device, and the other image is provided for a second display screen of the display device. The display device may be, for example, a head mounted display device for virtual reality. The display device comprises a first display screen and a second display screen, wherein the first display screen is a left eye display screen, the second display screen is a right eye display screen, the first display screen can also be a right eye display screen, and the second display screen is a left eye display screen. The display device may further include a display screen, the first display screen representing a first display region, the second display screen identifying a second display region, the first display region may be a left-eye display or a right-eye display, and the second display region may be a right-eye display or a left-eye display corresponding to the first display region.
The preprocessing comprises the steps of sequentially carrying out image rendering processing on each image frame according to the display parameters of the first display screen to obtain a first rendering image; performing image rendering processing on each image frame according to the display parameters of the second display screen to obtain a second rendered image;
sequentially carrying out image anti-distortion processing on the first rendering image according to the distortion degree of the first display screen to obtain a first image; and performing image anti-distortion processing on the second rendering image according to the distortion degree of the second display screen to obtain a second image.
After the preprocessing, determining to perform local backlight processing on one of two images corresponding to each image frame to obtain a first average brightness value. For example, it is determined whether the frame sequence number of each image frame is odd or even. And in the odd number, calculating a first average brightness value of the image frame corresponding to one eye according to a local backlight processing algorithm. For the other eye, the average brightness value of the image frame does not need to be calculated according to a local backlight processing algorithm, but the average brightness value determined by the previous image frame of the current image frame is taken as the reference, and the average brightness value is synchronously output to the display screen module, so that a viewer can see a smooth image scene.
The average brightness values indicated in the embodiments of the present application refer to the result of local backlight processing on the image frame. For example, the average calculation may be performed by the pixel luminance values of the respective intermediate pixels of the determined intermediate local area in the left-eye image frame or the right-eye image frame. The average brightness value of the current image frame is the result of local backlight processing on the current image frame, and the average brightness value of the previous image frame is the result of local backlight processing on the previous image frame.
Wherein step 102 may further refer to fig. 4, fig. 4 shows a schematic flow chart of step 102 provided in an embodiment of the present application.
and 1023, when the number of the image frames is not odd, selecting a current image frame corresponding to the frame serial number in the second image frame sequence from the two image frame sequences to perform local backlight processing, and not performing local backlight processing on the current image frame corresponding to the frame serial number in the first image frame sequence.
In the above embodiment, if the image is an odd frame, the first average brightness value of the left-eye image is calculated according to a local backlight processing algorithm for the left-eye image after the image anti-distortion processing, the local backlight processing is not performed for the right-eye image after the image anti-distortion processing, the immediately previous image frame of the image frame is directly obtained, the second average brightness value of the previous image frame is calculated according to the local backlight processing algorithm, then, the first average brightness value and the current image frame are synchronously output to the left-eye display screen of the display device, and the second average brightness value and the current image frame are output to the right-eye display screen of the display device.
If the image is an even frame, the left-eye image after the image anti-distortion processing is not subjected to local backlight processing, and a fourth average brightness value of the previous image frame is obtained by directly obtaining the previous image frame of the current image frame and calculating according to a local backlight processing algorithm (in order to distinguish the calculation results of the two images of the current frame, the second average brightness value can also be represented); and calculating a third average brightness value of the current image frame for the right eye image subjected to the image anti-distortion processing according to a local backlight processing algorithm (in order to distinguish the calculation results of the two images of the current frame, the first average brightness value can also be represented), synchronously outputting the fourth average brightness value and the current image frame to a left eye display screen of the display device, and outputting the third average brightness value and the current image frame to a right eye display screen of the display device.
When the number of the image frames is odd, the first image frame is selected from the two image frame sequences to be locally backlit, and the second image frame is not locally backlit; if the number of the image frames is not odd, the second image frame is selected from the two image frame sequences to be locally backlit, and meanwhile, the first image frame is not locally backlit.
Assume a first image frame sequence a { n-1 th image frame, nth image frame, n +1 th image frame }, a second image sequence B { n-1 th image frame, nth image frame, n +1 th image frame }, wherein the first image frame sequence a is assumed to be provided to a first display screen corresponding to a left eye and the second image frame sequence B is assumed to be provided to a second display screen corresponding to a right eye. Here, only schematic description is given, and the correspondence between the first image frame sequence and the second image frame sequence and the display screens of the left and right eyes may be set according to requirements. When n is the initial first image frame, the average brightness value corresponding to the n-1 frame may be preset to an initial value. I.e. the display is performed according to the initial backlight brightness. The embodiment of the application indicates the odd-even change relation between the continuously changing frame sequence numbers by n, n-1 and n + 1. That is, when n is an odd number, n-1 represents an even number, and n +1 also represents an even number.
For the nth image frame with odd frame serial number, acquiring a first average brightness value corresponding to the nth image frame contained in the first image frame sequence and a second average brightness value corresponding to the nth image frame contained in the second image frame sequence as follows:
local backlight processing is carried out on the nth image frame in the first image frame sequence to obtain a first average brightness value;
meanwhile, obtaining an average brightness value of an (n-1) th image frame contained in the second image frame sequence according to local backlight processing, and taking the average brightness value as a second average value;
for the (n + 1) th image frame with even frame serial number, acquiring a third average brightness value corresponding to the (n + 1) th image frame included in the first image frame sequence and a fourth average brightness value corresponding to the (n + 1) th image frame included in the second image frame sequence as follows:
local backlight processing is carried out on the (n + 1) th image frame in the second image frame sequence to obtain a fourth average brightness value;
meanwhile, the nth image frame included in the first image frame sequence is obtained and the first average brightness value is obtained according to local backlight processing and is used as the third average brightness value.
After each local backlight processing, the method further comprises:
sending the image frames corresponding to the first average brightness value and the first average brightness value to a first display screen of display equipment, and sending the image frames corresponding to the second average brightness value and the second average brightness value to a second display screen of the display equipment;
and the display equipment adjusts the backlight brightness of the first display screen according to the first average brightness value corresponding to the first display screen, and simultaneously adjusts the backlight brightness of the second display screen according to the second average brightness value corresponding to the second display screen.
Alternatively, the first and second electrodes may be,
and sending the image frames corresponding to the third average brightness value and the third average brightness value to a first display screen of the display device, and sending the image frames corresponding to the fourth average brightness value and the fourth average brightness value to a second display screen of the display device.
And the display equipment adjusts the backlight brightness of the first display screen according to the third average brightness value corresponding to the first display screen, and simultaneously adjusts the backlight brightness of the second display screen according to the fourth average brightness value corresponding to the second display screen.
According to the embodiment of the application, the local backlight brightness processing is carried out on the monocular image of each frame of image in real time, so that the time consumed by calculating the average brightness of the image in real time is saved, the hardware cost is considered, and the software refreshing frame rate is effectively improved.
As shown in fig. 3, fig. 3 shows a schematic display flow provided by an embodiment of the present application. Fig. 3 (a) illustrates a conventional backlight brightness processing method, in which after receiving an image frame, the image frame is sequentially subjected to image rendering and image distortion processing according to a left-eye and right-eye processing sequence (or a right-eye and left-eye processing sequence), then the image frame is sequentially subjected to local backlight processing to obtain an average brightness value, then the image frame is subjected to local backlight processing to obtain another average brightness value, and finally the average brightness value and the image frame are output to a display device.
In fig. 3 (b), the backlight brightness processing method of the present application, after receiving an image frame, sequentially performs image rendering and image distortion processing on the image frame according to a processing order of a left eye and a right eye (or a processing order of a right eye and a left eye), then determines whether a frame serial number of the image frame is an odd number or an even number, calculates an average brightness value of the image frame of the left eye according to a local backlight processing algorithm for the image frame of the left eye if the frame serial number is the odd number, and directly acquires the average brightness value of a previous image frame for the image frame of the right eye without calculation. Then, the average brightness value of the left eye of the current image frame of the left eye and the current image frame are synchronously output to the display screen of the left eye, and the average brightness value of the previous image frame of the right eye and the current image frame are output to the display screen of the right eye.
The display device includes a display panel and a backlight. The backlight may correspond to the entire display panel, and the backlight brightness of all sub-pixels in a pixel of the display panel may be adjusted. For example, the backlight source may include a Light Emitting unit array including a plurality of Light Emitting units arranged in an array, and each Light Emitting unit may be, for example, a Light Emitting Diode (LED), and may be organic or inorganic.
According to the embodiment of the application, the monocular image frames are subjected to local backlight processing, so that the hardware cost is considered, and the frame refresh rate of a software end is improved. Fig. 6 is a timing diagram illustrating a backlight brightness processing method provided by an embodiment of the present application and a related art, and is described below with reference to fig. 6. In the prior art, image rendering of a left eye image and a right eye image is sequentially carried out on a received image frame sequence, image anti-distortion processing of the left eye image and the right eye image is sequentially carried out, local backlight processing is sequentially carried out on the left eye image, and then local backlight processing is carried out on the right eye image, wherein the required time is T0. The time for receiving the Vsync signals by the display screen is shortened, so that more Vsync signals can be received, namely, the frame refresh rate output by the software end is improved, and the performance requirement of a processor for performing local backlight processing on a single image is also reduced, so that the frame refresh rate of the software end can be improved while the hardware cost is considered.
The single eye provided by the embodiment of the application carries out local backlight processing, so that the time for local backlight processing is effectively saved, the speed of outputting images by software is improved, the image frame refresh rate of a software end is improved, only the single eye is subjected to local backlight processing, a common processor can also realize the local backlight processing, and the hardware cost is effectively reduced.
It should be noted that while the operations of the disclosed methods are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Rather, the steps depicted in the flowcharts may change the order of execution. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
The embodiment of the application also provides a backlight brightness processing system. Referring to fig. 5, fig. 5 shows an exemplary structural block diagram of a backlight brightness processing system 500 provided in an embodiment of the present application. The system comprises: a first processing means 501 and a display device 502. Wherein the first processing means 501 is in signal connection with the display device 502. The connection mode can be wired connection or wireless connection.
The first processing device 501, configured to execute the backlight brightness processing method as described in fig. 2, synchronously obtains two average brightness values corresponding to the frame serial number, where the two average brightness values include an average brightness value corresponding to the first display screen and an average brightness value corresponding to the second display screen; the average brightness value corresponding to the first display screen and the image frame corresponding to the average brightness value corresponding to the first display screen are sent to the first display screen of the display device; simultaneously sending the image frames corresponding to the average brightness value corresponding to the second display screen and the average brightness value corresponding to the second display screen of the display device, wherein the image frames corresponding to the average brightness value corresponding to the first display screen and the image frames corresponding to the average brightness value corresponding to the second display screen have the same frame sequence number;
the display device 502 is configured to adjust the backlight brightness of the first display screen according to the average brightness value corresponding to the first display screen, and simultaneously adjust the backlight brightness of the second display screen according to the average brightness value corresponding to the second display screen.
Wherein the first processing means 501 may further comprise:
the image processing device comprises a receiving module, a judging module and a processing module, wherein the receiving module is used for receiving two image frame sequences, each image frame sequence at least comprises a previous image frame and a current image frame which are adjacent in sequence of frame sequence numbers, and the two image frame sequences comprise a first image frame sequence and a second image frame sequence;
the device comprises a selection module, a backlight module and a backlight module, wherein the selection module is used for alternately selecting a first image frame sequence or a second image frame sequence from two image frame sequences to perform local backlight processing according to continuously changing frame sequence numbers, and when the first image frame sequence is subjected to the local backlight processing, the second image frame sequence is not subjected to the local backlight processing, or when the second image frame sequence is subjected to the local backlight processing, the first image frame sequence is not subjected to the local backlight processing;
the device comprises an acquisition module, a backlight module and a backlight module, wherein the acquisition module is used for acquiring the average brightness value of a previous image frame contained in a first image frame sequence as the average brightness value of a current frame if the local backlight processing is not performed on the first image frame sequence when the local backlight processing is performed each time; or, if the local backlight processing is not performed on the second image frame sequence, the average brightness value of the previous image frame included in the second image frame sequence is acquired as the average brightness value of the current frame.
The output module is used for sending the image frames corresponding to the first average brightness value and the first average brightness value to a first display screen of the display device, and sending the image frames corresponding to the second average brightness value and the second average brightness value to a second display screen of the display device; for the nth image frame with the frame sequence number n, the average brightness value corresponding to the nth image frame included in the first image frame sequence is a first average brightness value, and the average brightness value corresponding to the nth image frame included in the second image frame sequence is a second average brightness value or;
sending the image frames corresponding to the third average brightness value and the third average brightness value to a first display screen of the display device, and simultaneously sending the image frames corresponding to the fourth average brightness value and the fourth average brightness value to a second display screen of the display device; for the (n + 1) th image frame with the frame sequence number of n +1, the average brightness value corresponding to the (n + 1) th image frame included in the first image frame sequence is the third average brightness value, and the average brightness value corresponding to the (n + 1) th image frame included in the second image frame sequence is the fourth average brightness value.
Wherein, the selection module may further include:
a determining submodule for determining whether the frame sequence number is an odd number;
a first local backlight processing sub-module, configured to, when the number of the image frames is odd, select a first image frame sequence from the two image frame sequences to perform local backlight processing, and simultaneously perform no local backlight processing on the second image frame sequence; alternatively, the first and second electrodes may be,
and the second local backlight processing sub-module is used for firstly selecting a second image frame sequence from the two image frame sequences to perform local backlight processing when the number of the image frames is not odd, and simultaneously performing no local backlight processing on the first image frame sequence.
The apparatus may further include:
the image rendering module is used for sequentially performing image rendering processing according to the first display parameters to obtain a first rendering image frame sequence; then, image rendering processing is carried out according to the second display parameters to obtain a second rendering image frame sequence;
the anti-distortion processing module is used for sequentially carrying out image anti-distortion processing on the first rendering image sequence according to a first distortion degree to obtain a first image frame sequence in the two image frame sequences; and then carrying out image anti-distortion processing on the second rendering image frame sequence according to a second distortion degree to obtain a second image frame sequence in the two image frame sequences.
It should be understood that the units or modules recited in the first processing device 501 of the system 500 correspond to the various steps in the method described with reference to fig. 2. Thus, the operations and features described above for the method are also applicable to the apparatus 501 and the modules included therein, and are not described again here. The apparatus 501 may be implemented in a browser or other security applications of the electronic device in advance, or may be loaded into the browser or other security applications of the electronic device by downloading or the like. The corresponding modules in the apparatus 501 may cooperate with units in the electronic device to implement the solution of the embodiments of the present application.
The division into several modules or units mentioned in the above detailed description is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Referring to fig. 7, fig. 7 is a schematic structural diagram illustrating a computer system 600 of a display device according to an embodiment of the present disclosure.
As shown in fig. 7, the computer system 600 includes a Central Processing Unit (CPU)601 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the system 600 are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: includes an input portion 606; an output portion 607 including a display such as a Liquid Crystal Display (LCD) and a speaker; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read out therefrom is mounted in the storage section 608 as necessary.
In particular, according to an embodiment of the present disclosure, the process described above with reference to the flow diagrams fig. 2 or 4 may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a machine-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611. The above-described functions defined in the system of the present application are executed when the computer program is executed by the Central Processing Unit (CPU) 601.
It should be noted that the computer readable media shown in the present disclosure may be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The display device further comprises an image acquisition module for acquiring an image frame sequence to be displayed. The image acquisition module may be a camera, which may be a digital camera, a smart phone, a tablet pc camera, a pc camera, or a webcam, and may further include various software and/or hardware with data reading capability, such as real-time reading of image frame data in the storage space.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules described in the embodiments of the present application may be implemented by software or hardware.
As another aspect, the present application also provides a computer-readable storage medium, which may be contained in the display device described in the above embodiments; or may be separate and not incorporated into the display device. The computer readable storage medium stores one or more programs that are used by one or more processors to perform the local backlight processing methods described herein. For example, an all-in-one head mounted display device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, which when executed by the processor implements the method described in fig. 2.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by a person skilled in the art that the scope of the disclosure as referred to in the present application is not limited to the specific combination of features described above, but that synchronization shall also cover other embodiments formed by any combination of features described above or their equivalents without departing from the concept disclosed above. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (10)
1. A backlight brightness processing method is applied to a display device with two display screens, and comprises the following steps:
receiving two image frame sequences, wherein the two image frame sequences comprise a first image frame sequence and a second image frame sequence, and each image frame sequence at least comprises a previous image frame and a current image frame which are sequentially adjacent in frame sequence number;
according to the continuously changed frame sequence number, a current image frame corresponding to the frame sequence number in a first image frame sequence or a second image frame sequence is alternately selected from the two image frame sequences to be locally backlit, wherein when the first image frame sequence is locally backlit, the second image frame sequence is not locally backlit, or when the second image frame sequence is locally backlit, the first image frame sequence is not locally backlit;
when local backlight processing is performed each time, if the first image frame sequence is not subjected to the local backlight processing, acquiring an average brightness value of a previous image frame included in the first image frame sequence as an average brightness value of a current image frame; or, if the second image frame sequence is not subjected to the local backlight processing, acquiring an average brightness value of a previous image frame included in the second image frame sequence as an average brightness value of a current image frame.
2. The backlight brightness processing method according to claim 1, wherein the alternately selecting a current image frame corresponding to the frame sequence number from the first image frame sequence or the second image frame sequence from the two image frame sequences for local backlight processing according to the continuously changing frame sequence number comprises:
determining whether each of the continuously changing frame sequence numbers is an odd number;
when the number of the image frames is odd, selecting a current image frame corresponding to the frame serial number from the two image frame sequences to perform local backlight processing, and simultaneously not performing local backlight processing on the current image frame corresponding to the frame serial number in the second image frame sequence; alternatively, the first and second electrodes may be,
when the number of the image frames is not odd, the current image frame corresponding to the frame serial number in the second image frame sequence is selected from the two image frame sequences to be locally backlit, and meanwhile, the current image frame corresponding to the frame serial number in the first image frame sequence is not locally backlit.
3. The backlight brightness processing method according to claim 2, wherein when the number of the image frames is odd, a current image frame corresponding to the frame serial number in the first image frame sequence is selected from the two image frame sequences to be locally backlit, and no local backlight processing is performed on the current image frame corresponding to the frame serial number in the second image frame sequence; or when the number of the image frames is not odd, selecting a current image frame corresponding to the frame serial number from the two image frame sequences to perform local backlight processing, and simultaneously performing no local backlight processing on the current image frame corresponding to the frame serial number in the first image frame sequence, wherein the method comprises the following steps:
for the nth image frame with the odd frame serial number, acquiring a first average brightness value corresponding to the nth image frame contained in the first image frame sequence and a second average brightness value corresponding to the nth image frame contained in the second image frame sequence as follows:
local backlight processing is carried out on the nth image frame in the first image frame sequence to obtain the first average brightness value;
meanwhile, obtaining an average brightness value of an (n-1) th image frame contained in the second image frame sequence according to local backlight processing, wherein the average brightness value is used as the second average brightness value;
for the (n + 1) th image frame with the even frame serial number, acquiring a third average brightness value corresponding to the (n + 1) th image frame included in the first image frame sequence and a fourth average brightness value corresponding to the (n + 1) th image frame included in the second image frame sequence as follows:
performing local backlight processing on the (n + 1) th image frame in the second image frame sequence to obtain the fourth average brightness value;
meanwhile, the nth image frame included in the first image frame sequence is obtained and the first average brightness value is obtained according to local backlight processing and is used as the third average brightness value.
4. The backlight brightness processing method according to claim 3, wherein after each local backlight processing, the method further comprises:
sending the image frames corresponding to the first average brightness value and the first average brightness value to a first display screen of a display device, and sending the image frames corresponding to the second average brightness value and the second average brightness value to a second display screen of the display device; alternatively, the first and second electrodes may be,
and sending the image frames corresponding to the third average brightness value and the third average brightness value to a first display screen of a display device, and sending the image frames corresponding to the fourth average brightness value and the fourth average brightness value to a second display screen of the display device.
5. The backlight brightness processing method according to claim 1, characterized in that before said receiving two image frame sequences, the method further comprises:
sequentially performing image rendering processing according to the first display parameters to obtain a first rendering image frame sequence; then, image rendering processing is carried out according to the second display parameters to obtain a second rendering image frame sequence;
then, sequentially carrying out image anti-distortion processing on the first rendering image sequence according to a first distortion degree to obtain a first image frame sequence in the two image frame sequences; and then carrying out image anti-distortion processing on the second rendering image frame sequence according to a second distortion degree to obtain a second image frame sequence in the two image frame sequences.
6. A backlight brightness processing system is characterized in that the system comprises a first processing device and a display device, the display device comprises a first display screen and a second display screen, the first processing device is in signal connection with the display device,
the first processing device, configured to perform the backlight brightness processing method according to any one of claims 1 to 5, and synchronously obtain two average brightness values corresponding to a frame sequence number, where the two average brightness values include an average brightness value corresponding to the first display screen and an average brightness value corresponding to the second display screen; the average brightness value corresponding to the first display screen and the image frame corresponding to the average brightness value corresponding to the first display screen are also sent to the first display screen of the display device; simultaneously sending the image frames corresponding to the average brightness value corresponding to the second display screen and the average brightness value corresponding to the second display screen of the display device, wherein the image frames corresponding to the average brightness value corresponding to the first display screen and the image frames corresponding to the average brightness value corresponding to the second display screen have the same frame sequence number;
the display device is used for adjusting the backlight brightness of the first display screen according to the average brightness value corresponding to the first display screen, and adjusting the backlight brightness of the second display screen according to the average brightness value corresponding to the second display screen.
7. The backlight brightness processing system according to claim 6, wherein the display device is a head-mounted display device for implementing virtual reality or augmented reality.
8. A head-mounted display device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1-5 when executing the program.
9. The head-mounted display device of claim 8, wherein the head-mounted display device is configured to implement virtual reality or augmented reality.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, implements the backlight brightness processing method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911211919.4A CN110767184B (en) | 2019-11-28 | 2019-11-28 | Backlight brightness processing method, system, display device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911211919.4A CN110767184B (en) | 2019-11-28 | 2019-11-28 | Backlight brightness processing method, system, display device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110767184A CN110767184A (en) | 2020-02-07 |
| CN110767184B true CN110767184B (en) | 2021-02-12 |
Family
ID=69340517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911211919.4A Active CN110767184B (en) | 2019-11-28 | 2019-11-28 | Backlight brightness processing method, system, display device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110767184B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111161685B (en) * | 2020-02-28 | 2022-02-01 | 京东方科技集团股份有限公司 | Virtual reality display equipment and control method thereof |
| CN113473105A (en) * | 2021-06-01 | 2021-10-01 | 青岛小鸟看看科技有限公司 | Image synchronization method, image display and processing device and image synchronization system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101281732A (en) * | 2008-03-26 | 2008-10-08 | 青岛海信电器股份有限公司 | Liquid crystal display method |
| CN103177699A (en) * | 2011-12-20 | 2013-06-26 | 上海天马微电子有限公司 | Data processing method for field sequence liquid crystal display device |
| CN109194944A (en) * | 2018-10-29 | 2019-01-11 | 京东方科技集团股份有限公司 | Image processing method, apparatus and system, display device |
| CN109509150A (en) * | 2018-11-23 | 2019-03-22 | 京东方科技集团股份有限公司 | Image processing method and device, display device, virtual reality display system |
-
2019
- 2019-11-28 CN CN201911211919.4A patent/CN110767184B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101281732A (en) * | 2008-03-26 | 2008-10-08 | 青岛海信电器股份有限公司 | Liquid crystal display method |
| CN103177699A (en) * | 2011-12-20 | 2013-06-26 | 上海天马微电子有限公司 | Data processing method for field sequence liquid crystal display device |
| CN109194944A (en) * | 2018-10-29 | 2019-01-11 | 京东方科技集团股份有限公司 | Image processing method, apparatus and system, display device |
| CN109509150A (en) * | 2018-11-23 | 2019-03-22 | 京东方科技集团股份有限公司 | Image processing method and device, display device, virtual reality display system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110767184A (en) | 2020-02-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11961431B2 (en) | Display processing circuitry | |
| JP4376764B2 (en) | Stereoscopic image display device | |
| US20100208043A1 (en) | Method and system for creating a 3d effect on a display device | |
| US8803899B2 (en) | Image processing system and image processing method | |
| CN110767184B (en) | Backlight brightness processing method, system, display device and medium | |
| JP2011090079A (en) | Display device, display method and computer program | |
| US20200029057A1 (en) | Systems and methods for correcting color separation in field-sequential displays | |
| US10235586B2 (en) | Image processing system capable of executing operation by recognizing information encoding pattern and image displayed alternately and related method | |
| US10152946B2 (en) | Video display method using visible/visual light communication with stripe patterns having different orientations and color combinations | |
| US9261706B2 (en) | Display device, display method and computer program | |
| CN109725701B (en) | Display panel and device, image processing method and device, and virtual reality system | |
| US8144164B2 (en) | Image display apparatus and method | |
| US9888223B2 (en) | Display processing system, display processing method, and electronic device | |
| US9123090B2 (en) | Image data compression device, image data decompression device, display device, image processing system, image data compression method, and image data decompression method | |
| CN111798805A (en) | Backlight processing system, apparatus, method, backlight driver and storage medium | |
| US20230127083A1 (en) | Optical link system for head mounted display and method of controlling the same | |
| WO2022166712A1 (en) | Image display method, apparatus, readable medium, and electronic device | |
| CN103003866B (en) | Liquid crystal display device | |
| WO2014030496A1 (en) | Liquid crystal display device | |
| JP5932807B2 (en) | 3D display panel, 3D display device using the same, and driving method thereof | |
| US8913077B2 (en) | Image processing apparatus and image processing method | |
| US8963824B2 (en) | Back light unit for stereoscopic display | |
| CN111292677A (en) | Image display processing method and device, computer equipment and storage medium | |
| CN114267277B (en) | Display control method and device, computer readable storage medium and electronic equipment | |
| CN102256160A (en) | Stereo image processing equipment and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |