CN111028792B

CN111028792B - Display control method and device

Info

Publication number: CN111028792B
Application number: CN201911400832.1A
Authority: CN
Inventors: 赵青青; 罗小伟; 林福辉
Original assignee: Purple Light Communication Huizhou Co ltd
Current assignee: Purple Light Communication Huizhou Co ltd
Priority date: 2019-12-30
Filing date: 2019-12-30
Publication date: 2021-05-25
Anticipated expiration: 2039-12-30
Also published as: CN111028792A

Abstract

The disclosure relates to a display control method and device, the method comprising: determining a first backlight parameter of an Nth frame image, wherein the first backlight parameter is used for adjusting the backlight brightness of the display device; adjusting the pixel value of the pixel in the Nth frame of image according to the first backlight parameter to obtain an adjusted Nth frame of image; and adjusting the backlight brightness of the display device according to the first backlight parameter, and displaying the adjusted Nth frame image by using the display device. According to the embodiment of the disclosure, the backlight brightness of the display device is adjusted, and meanwhile, the pixel value of the image is correspondingly adjusted, so that the displayed image meets the requirement of definition, and the user experience is improved.

Description

Display control method and device

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to a display control method and apparatus.

Background

With the development of society and the advancement of technology, watching videos on mobile devices and personal computers has become a main entertainment mode for the public. Power consumption is an important aspect that affects the standby duration of a mobile device, and thus also the user experience. The related evaluation data shows that the display power consumption of the multimedia entertainment equipment accounts for about 50% of the power consumption of the whole equipment, so that the backlight power consumption of the display equipment is an effective way for saving the system power consumption.

The related art generally reduces power consumption by reducing backlight brightness of the display panel, however, when the related art adjusts the backlight, the related art cannot meet the requirement of definition, and often causes phenomena such as sudden over-bright, sudden over-dark or bright-dark flicker, thereby reducing user experience.

Disclosure of Invention

In view of the above, the present disclosure provides a display control method applied to a display device, the method including:

determining a first backlight parameter of an Nth frame image, wherein the first backlight parameter is used for adjusting backlight brightness of the display device, and N is an integer and is not less than 1;

adjusting the pixel value of the pixel in the Nth frame of image according to the first backlight parameter to obtain an adjusted Nth frame of image;

and adjusting the backlight brightness of the display device according to the first backlight parameter, and displaying the adjusted Nth frame image by using the display device.

In a possible embodiment, the determining the first backlight parameter of the nth frame image includes:

determining scene types of the N frame image, wherein the scene types comprise a gradual change scene type and a sudden change scene type, the gradual change scene type represents that the brightness value difference of the N frame image relative to the N-1 frame image is smaller than a scene comparison threshold, and the sudden change scene type represents that the brightness value difference of the N frame image relative to the N-1 frame image is larger than the scene comparison threshold;

determining a second backlight parameter of the Nth frame image;

and when the scene type of the N frame image is the abrupt scene type, taking the second backlight parameter as the first backlight parameter.

In a possible implementation, the determining the scene type of the nth frame image includes:

under the condition that the scene type of the Nth frame image is determined, verifying the scene type of the Nth frame image to determine whether the scene type of the Nth frame image is correct again, wherein the verifying the scene type of the Nth frame image comprises:

when the scene type of the nth frame image is the abrupt scene type, if the absolute value of the difference between the second backlight parameter of the nth-1 frame image and the second backlight parameter of the nth frame image is less than a verification threshold, modifying the scene type of the nth frame image to the gradual scene type, otherwise, keeping the scene type of the nth frame image to be the abrupt scene type.

In a possible embodiment, the determining the second backlight parameter of the nth frame image includes:

determining a set of pixel values from pixel values of all pixels of the nth frame image, wherein the pixel values in the set of pixel values are arranged in order from small to large, each pixel value in the set of pixel values is not the same, and the set of pixel values includes samples of the pixel values of all pixels;

determining pixel values in the set of pixel values that belong to a first range, a second range, and a third range, wherein the first range is a% -b% of the set of pixel values, the second range is b% -c% of the set of pixel values, the third range is c% -100% of the set of pixel values, and a < b < c is less than 100%;

determining a first absolute value of a difference between pixel values corresponding to two boundary points of the first range, a second absolute value of a difference between pixel values corresponding to two boundary points of the second range, and a third absolute value of a difference between pixel values corresponding to two boundary points of the third range, respectively;

and determining the second backlight parameter according to the first absolute value, the second absolute value and the third absolute value.

In a possible embodiment, the determining the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value includes:

when the maximum value of the first absolute value, the second absolute value and the third absolute value is the first absolute value or the second absolute value,

determining the second backlight parameter to be 0.7B-0.9B under the condition that the maximum value is less than or equal to a first maximum value threshold value, wherein B represents a reference backlight parameter; or

And determining that the second backlight parameter is the sum of a backlight threshold and a normalized value of the pixel value mean of all pixel values of the N frame image when the maximum value is larger than the first maximum value threshold.

determining the second backlight parameter according to the maximum pixel value and the pixel value mean of the N-th frame image when the maximum value of the first absolute value, the second absolute value and the third absolute value is the third absolute value,

when the maximum value is smaller than or equal to a second maximum value threshold value, the maximum pixel value and the pixel value mean value of the N frame image are obtained according to all pixels of the N frame image;

and when the maximum value is larger than the second maximum value threshold value, the maximum pixel value and the pixel value mean value of the N frame image are obtained according to partial pixels of all pixels of the N frame image.

In a possible implementation, the determining the first backlight parameter of the nth frame image further includes:

and when the scene type of the N frame image is the gradual change scene type and the second backlight parameter of the N-1 frame image is greater than the second backlight parameter of the N frame image, taking the difference between the first backlight parameter of the N-1 frame image and a preset backlight parameter as the first backlight parameter of the N frame image.

and when the scene type of the N frame image is the gradual change scene type and the second backlight parameter of the N-1 frame image is smaller than the second backlight parameter of the N frame image, taking the sum of the first backlight parameter of the N-1 frame image and a preset backlight parameter as the first backlight parameter of the N frame image.

and when the scene type of the N frame image is the gradual change scene type and the second backlight parameter of the N-1 frame image is equal to the second backlight parameter of the N frame image, taking the first backlight parameter of the N-1 frame image as the first backlight parameter of the N frame image.

In a possible implementation, the adjusting the pixel value of the pixel in the nth frame image according to the first backlight parameter includes:

determining a pixel value adjusting parameter according to the first backlight parameter and a reference backlight parameter of the N frame image, wherein the pixel value adjusting parameter is used for adjusting the pixel value of the N frame image;

and adjusting the pixel value of the N frame image by using the pixel value adjusting parameter.

According to another aspect of the present disclosure, there is provided a display control apparatus applied to a display apparatus, the apparatus including:

the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a first backlight parameter of an Nth frame image, the first backlight parameter is used for adjusting backlight brightness of the display device, and N is an integer and is more than or equal to 1;

the first adjusting module is connected to the determining module and used for adjusting the pixel value of the pixel in the Nth frame image according to the first backlight parameter to obtain an adjusted Nth frame image;

and the second adjusting module is connected to the first adjusting module and used for adjusting the backlight brightness of the display device according to the first backlight parameter and displaying the adjusted Nth frame image by using the display device.

determining a second backlight parameter of the Nth frame image;

According to another aspect of the present disclosure, there is provided a display control apparatus including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the above method.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.

In various aspects of the embodiment of the disclosure, the pixel value of the nth frame image can be adjusted by using the first backlight parameter of the nth frame image, and the backlight brightness of the display device is adjusted, so that the display power consumption of the display device is reduced, energy is saved, and the service life of the device is prolonged.

Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

Fig. 1 illustrates a flowchart of a display control method according to an embodiment of the present disclosure.

Fig. 2 shows a schematic diagram of image adjustment according to an embodiment of the present disclosure.

Fig. 3 illustrates a schematic diagram of a display control method according to an embodiment of the present disclosure.

FIG. 4 shows a schematic diagram of scene type verification according to an embodiment of the present disclosure.

Fig. 5a, 5b, 5c, 5d, 5e show schematic diagrams of image histograms according to an embodiment of the disclosure.

Fig. 6 shows a schematic diagram of a first backlight parameter determination method according to an embodiment of the present disclosure.

Fig. 7 shows a schematic diagram of a piecewise linear compensation approach according to an embodiment of the present disclosure.

Fig. 8 illustrates a block diagram of a display control apparatus according to an embodiment of the present disclosure.

Fig. 9 shows a block diagram of a display control apparatus according to an embodiment of the present disclosure.

Fig. 10 shows a block diagram of a display control apparatus according to an embodiment of the present disclosure.

Detailed Description

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present disclosure.

Referring to fig. 1, fig. 1 is a flowchart illustrating a display control method according to an embodiment of the present disclosure.

The method is applied to a display device and comprises the following steps:

step S11, determining a first backlight parameter of the Nth frame image, wherein the first backlight parameter is used for adjusting the backlight brightness of the display device, and N is an integer and is more than or equal to 1;

step S12, adjusting the pixel value of the pixel in the Nth frame image according to the first backlight parameter to obtain an adjusted Nth frame image;

step S13, adjusting the backlight brightness of the display device according to the first backlight parameter, and displaying the adjusted nth frame image by using the display device.

Through the method, the embodiment of the disclosure can adjust the pixel value of the nth frame image by using the first backlight parameter of the nth frame image, and adjust the backlight brightness of the display device, thereby reducing the display power consumption of the display device, saving energy, and prolonging the service time of the device.

The nth frame of image in the embodiment of the present disclosure may be an image in a video, and power consumption during video display may be significantly reduced by adjusting a pixel value of each frame of image in the video and backlight brightness corresponding to each frame of image.

In one example, the adjusting of the pixel value of the pixel in the nth frame image may be adjusting the pixel value of the whole image or a part of image in the nth frame image.

Referring to fig. 2, fig. 2 is a schematic diagram illustrating an image adjustment according to an embodiment of the disclosure.

As shown in fig. 2, the inventors found that, under a dark backlight luminance, the pixel values of the dark-light image are adjusted to brighten it into a brighter image, and the visual effect is similar or identical to that of increasing the backlight luminance. Therefore, the embodiment of the disclosure realizes reduction of power consumption by adjusting the brightness value of an image and reducing the backlight brightness.

Referring to fig. 3, fig. 3 is a schematic diagram illustrating a display control method according to an embodiment of the disclosure.

In one possible implementation, as shown in fig. 3, the step S11 of determining the first backlight parameter of the nth frame image may include:

step S111, determining a scene type of the N frame image, wherein the scene type includes a gradual change scene type and a sudden change scene type, the gradual change scene type represents that a brightness value difference of the N frame image relative to the N-1 frame image is smaller than a scene comparison threshold, and the sudden change scene type represents that a brightness value difference of the N frame image relative to the N-1 frame image is larger than the scene comparison threshold;

step S112, determining a second backlight parameter of the Nth frame image;

step S113, when the scene type of the nth frame image is the abrupt scene type, taking the second backlight parameter as the first backlight parameter.

By the method, the first backlight parameter can be determined according to different scene types and the second backlight parameter of the image, the first backlight parameter can be ensured to be suitable for the current image frame, when the backlight brightness adjustment and the pixel value adjustment are subsequently carried out by using the first backlight parameter, the power consumption can be reduced, the image quality and the continuity of continuous frame images can be ensured, and the phenomenon of screen flashing can be avoided.

When the scene type of the nth frame image is the abrupt scene type, the backlight parameter (second backlight parameter) estimated for the nth frame image can be used as the backlight parameter (first backlight parameter) for adjusting the nth frame image, and the second backlight parameter estimated for the nth frame image can meet the adjustment requirement based on the characteristics of the abrupt scene type, so that the calculated amount in the abrupt scene is reduced, the adjustment efficiency is improved, and the processing resource overhead is saved.

The manner of obtaining the second backlight parameter of the image will be described in the following.

The embodiment of the disclosure can determine whether the content (brightness) of two adjacent images changes dramatically, so as to divide the image scene type into a sudden change scene type and a gradual change scene type, and in the sudden change scene type, the brightness of two frames of images before and after changes drastically, so that even if the backlight brightness is adjusted greatly (for example, the backlight brightness of a brighter image is adjusted to be low), a user cannot perceive (i.e., the user experience is good), and therefore, in this case, the embodiment of the disclosure can reduce the backlight brightness to reduce the power consumption. In the gradual change scene, the brightness difference between the front frame image and the rear frame image is smaller, so that the amplitude of backlight brightness adjustment can be reduced for the image of the gradual change scene type, and the brightness flicker phenomenon is avoided.

According to the embodiment of the disclosure, different adjustment strategies are adopted for different scene types (gradual change scene and sudden change scene), so that power consumption saving after backlight brightness adjustment can be ensured, visual characteristics of people can be met during video image display, and user experience is improved.

The scene type of the image can be determined by various methods, for example, by a pixel comparison method, an edge change rate method, a histogram comparison method, a scene detection method based on image feature point extraction, and the like. The histogram comparison method will be described below as an example.

The scene type of the image can be determined by the following formula:

where M represents the maximum value of the pixel values in the image, e.g., if the image bit depth is 8 bits, then M is 256; h is_n(i) A histogram statistic value representing a pixel value i in the image of the nth frame (i.e., the number of pixels having a pixel value i in the image).

In one example, differences between each pixel value of the N frame image and the number of pixels corresponding to the corresponding pixel value of the N-1 frame image may be obtained and summed to obtain a luminance value difference of the N frame image relative to the N-1 frame image, where h_n(i)-h_n-1(i) It is possible to represent the difference in the number of pixels of the pixel value i of the nth frame image with respect to the pixel value i of the N-1 st frame image.

In one example, if H (n-1, n) exceeds a set scene comparison threshold, the current frame image may be determined to be of a abrupt scene type, otherwise the current frame image is determined to be of a gradual scene type.

Through the method, the scene type of the N frame image can be quickly determined according to the brightness value difference value of the N frame image relative to the N-1 frame image, the method is simple, operation resources can be saved, and hardware implementation and application are facilitated.

However, as can be seen from the foregoing description, the scene types are different greatly, and if the determination is wrong (for example, the image should be a gradual scene type but is mistakenly determined as a sudden scene), a screen splash phenomenon may occur in the final processed effect.

In a possible implementation manner, the step S111 of determining a scene type of the nth frame image may further include:

Through the method, the scene type of the image can be verified, and the scene type misjudgment situation is corrected when the gradual change scene type is determined to be misjudged as the sudden change scene type according to the difference of the second backlight parameters of the two frames of images. According to the embodiment of the disclosure, the gradual change scene type and the sudden change scene type can be distinguished according to the difference of the second backlight parameters (backlight estimated values) of the two frames before and after, and if the absolute difference value of the backlight estimated values of the current frame and the previous frame is smaller than the verification threshold, the scene type of the Nth frame image is modified into the gradual change scene type, so that the phenomenon of screen flashing can be avoided, and the user experience is improved.

Referring to fig. 4, fig. 4 is a schematic diagram illustrating scene type verification according to an embodiment of the disclosure.

As shown in fig. 4, if the scene type of the current frame image is a sudden change scene, it is determined whether an absolute value of a difference between a second backlight parameter of a previous frame image and the second backlight parameter of the current frame image is smaller than a verification threshold, so as to verify the scene type of the current frame image.

In one example, as shown in fig. 4, if an absolute value of a difference between the second backlight parameter of the N-1 th frame image and the second backlight parameter of the N-th frame image is greater than or equal to a verification threshold, the scene type of the N-th frame image is maintained as the abrupt change scene type, so that, for the image of the abrupt change scene type, the backlight brightness can be reduced, thereby reducing the power consumption.

If the image should be of a sudden change scene type but is erroneously determined to be of a gradual change scene type, since the video display frame rate is fast, even if the quality of the middle image frames is slightly damaged, the final video display effect is not greatly affected, and therefore, in one example, as shown in fig. 4, if the current frame image is of a gradual change scene, the image type of the current frame image is maintained to be of a gradual change scene type.

A method of determining a second backlight parameter (i.e. an estimated backlight parameter) of an image is exemplarily described below.

Continuing to refer to fig. 3, in a possible implementation manner, as shown in fig. 3, the determining the second backlight parameter of the nth frame image in step S112 may include:

In one example, the second backlight parameter may be an estimated backlight value of the image.

By the above method, the embodiment of the present disclosure may determine a pixel value set according to pixel values of all pixels of the nth frame image, determine pixel values belonging to a first range, a second range and a third range in the pixel value set, respectively determine a first absolute value of a difference between pixel values corresponding to two boundary points of the first range, a second absolute value of a difference between pixel values corresponding to two boundary points of the second range and a third absolute value of a difference between pixel values corresponding to two boundary points of the third range, and determine the second backlight parameter according to the first absolute value, the second absolute value and the third absolute value. Through the above method, the embodiment of the disclosure may quickly determine the second backlight parameter of the current frame image.

After the pixel values of the image are divided into a plurality of ranges, the corresponding second backlight parameters can be determined according to different conditions, so that an accurate backlight estimation value (second backlight parameter) is obtained.

The disclosed embodiments may determine the set of pixel values in a number of different ways to determine the second backlight parameter according to the above-described method, e.g., the set of pixel values may be determined by converting the image into the form of an image histogram, the inventors determining the value of the pixel values based on characteristics such as brightness of different images, according to the type of converting different images into image histograms and a large number of experiments, different images are classified in the form of image histograms, thereby determining a second backlight parameter for different types of images, as will be explained below by way of example for determining the second backlight parameter by means of an image histogram, it should be understood, of course, that this disclosure does not limit the specific implementation of obtaining the second backlight parameter to the method by image histogram, in other embodiments, one skilled in the art can select other ways to determine the second backlight parameter according to the needs and practical situations.

In one example, the maximum value of the first absolute value, the second absolute value, and the third absolute value may correspond to different luminance classes of the image in different cases (the maximum value is the first absolute value, the maximum value is the second absolute value, and the maximum value is the third absolute value).

The embodiments of the present disclosure may divide pixel values into different ranges (a first range, a second range, and a third range) according to the brightness of each pixel of an image, determine the absolute value (a first absolute value, a second absolute value, and a third absolute value) of a critical point corresponding to each range, determine the brightness class of the image according to which absolute value is the maximum value among the absolute values of the ranges, set a different second backlight parameter or a different second parameter determination method for different brightness classes, may adapt to different image types, for example, the maximum value is the same as the first absolute value, the second absolute value, and the third absolute value, respectively, may correspond to different image classes, and image histograms of different image classes may be different.

An exemplary description follows.

Referring to fig. 5a, 5b, 5c, 5d, and 5e, fig. 5a, 5b, 5c, 5d, and 5e illustrate diagrams of image histograms according to an embodiment of the disclosure.

In one example, the "determining a set of pixel values from pixel values of all pixels of the nth frame image" may include:

and converting the image of the Nth frame into an image histogram, and determining a pixel value set according to the image histogram.

In one example, as shown in fig. 5a, after converting the image into the image histogram, the image histogram may include the pixel value set (horizontal axis), the horizontal axis of the image histogram includes samples of the pixel values of all the pixels, and the pixel values are arranged in order from small to large, and each pixel value on the horizontal axis is different. The image histogram vertical axis may represent the number of pixels to which each pixel value corresponds.

As shown in fig. 5a, in the image histogram, the horizontal axis represents the pixel values varying from 0 to 255, wherein a pixel value of 0 may represent the darkest and a pixel value of 255 may represent the brightest, and thus the horizontal axis may represent the variation of the luminance from the darkest to the brightest.

In one example, the set of pixel values may be derived from information of the horizontal axis of the image histogram when converting the image to the image histogram. For example, the resulting set of pixel values may include all horizontal-axis values in the histogram having a vertical-axis value other than 0 (i.e., all pixel values having a corresponding number of pixels other than 0)

In one example, the values of a, b and c can be selected according to needs, for example, a can be 30-50, preferably, a can be 40; b can be 50-70, preferably, b can be 60; c can be 70-90, preferably, c can be 80, and by the above arrangement, the disclosure can "determine the pixel values belonging to the first range, the second range and the third range in the pixel value set".

Where the pixel values between a% and b% can be considered as having lower brightness (darker), of course, the brightness of the pixel values between a% and b% is higher than the brightness of the pixel values between 0% and a%. The brightness of pixel values between a% and b% is lower than the brightness of pixel values between b% and c%, which may be considered as medium brightness. The brightness of the pixel values between c% and 100% is higher than the brightness of the pixel values between b% and c%, and the brightness of the pixel values between c% and 100% may be the brightest. The first absolute value, the second absolute value, and the third absolute value respectively reflect the span of pixel values, or the degree of difference, in three intervals, i.e., the lower, the medium, and the higher brightness.

In one example, as shown in fig. 5a, the first range may be denoted diff1, the second range may be denoted diff2, and the third range may be denoted diff 3.

Next, "a first absolute value of a difference between pixel values corresponding to two boundary points in the first range, a second absolute value of a difference between pixel values corresponding to two boundary points in the second range, and a third absolute value of a difference between pixel values corresponding to two boundary points in the third range" will be described with reference to an example of specifying a third absolute value of a difference between pixel values corresponding to two boundary points in the third range diff 3.

In one example, assuming that c% of the minimum boundary points of the third range diff3 correspond to pixel values of 200 and 100% correspond to pixel values of 255, the third absolute value of the difference between the pixel values corresponding to the two boundary points of the third range is 55 (255-200).

Similarly, according to the specific values of a, b and c, the corresponding pixel value sizes can be determined, and therefore, the first absolute value, the second absolute value and the third absolute value can be determined by the above method.

When the first absolute value, the second absolute value, and the third absolute value are obtained, the embodiment of the disclosure may determine the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value, that is, according to different situations, obtain the backlight estimation value of the current frame image.

A possible implementation of determining the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value is exemplarily described below.

In one example, there may be different image histograms when the images belong to different categories, e.g. fig. 5b, 5c, 5d, 5e show four different image categories.

In a possible embodiment, the "determining the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value" may include:

and determining the second backlight parameter to be 0.7B-0.9B when the maximum value is less than or equal to a first maximum value threshold value, wherein B represents a reference backlight parameter, and B can be contained in the video parameter and can be set by a technician.

In one example, the first maximum threshold may be determined as needed, and may be, for example, 60 to 90, and preferably, 80.

In one example, the preferred value of the second backlight parameter is 0.8B.

In one example, if the image histogram of the current frame image is similar to fig. 5B, the maximum value is less than or equal to the first maximum value threshold, in which case the second backlight parameter may be determined to be 0.7B to 0.9B.

The normalization value may be obtained based on the time limit of the related art, and the specific normalization manner is not limited in the present disclosure.

In one example, the backlight threshold may be determined as required, for example, between 0 and 1B, and preferably, the backlight threshold may be 0.5B.

In one example, if the image histogram of the current image is similar to fig. 5c, the maximum value is greater than the first maximum value threshold, in which case the second backlight parameter may be determined as the sum of the backlight threshold and the normalized value of the pixel value mean of all the pixel values of the nth frame image.

In one example, the embodiment of the present disclosure may average all pixel values of the nth frame image and then perform normalization to obtain a normalized value of the pixel value average of all pixel values.

In a possible implementation manner, the determining the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value may further include:

In one example, the second maximum threshold may be selected as desired, for example, from 60 to 90, and preferably, may be 80.

In an example, in a case that the image histogram of the nth frame image is similar to that of fig. 5d, it may be determined that a maximum value of the first absolute value, the second absolute value, and the third absolute value is the third absolute value, and the maximum value is less than or equal to a second maximum value threshold, in which case, the second backlight parameter may be determined according to a maximum pixel value and a pixel value mean value of the nth frame image, where the maximum pixel value and the pixel value mean value of the nth frame image are obtained according to all pixels of the nth frame image.

In one example, in a case that the image histogram of the nth frame image is similar to that in fig. 5e, it may be determined that a maximum value of the first absolute value, the second absolute value, and the third absolute value is the third absolute value, and the maximum value is greater than a second maximum value threshold, in which case, the second backlight parameter may be determined according to a maximum pixel value and a pixel value average value of the nth frame image, where the maximum pixel value and the pixel value average value of the nth frame image are obtained according to a partial pixel of all pixels of the nth frame image.

In one example, some of all the pixels may be, for example, the first f% of the pixels in the horizontal axis of the image histogram, where f may be 93-98, and preferably, f is 95.

By obtaining the maximum pixel value and the mean value of the pixel values by using a part of pixels of all the pixels, and obtaining the second backlight parameter accordingly, the tailing (pixel values 200-255) existing in fig. 5e can be eliminated, so that the estimation of the second backlight parameter is more accurate.

In one example, the "determining the second backlight parameter according to the maximum pixel value and the mean pixel value of the nth frame image" may include:

determining the second backlight parameter by:

min＝max-avg，

corr＝1/2*(min+min²/256)，

BL＝avg+corr，

where max represents a maximum pixel value of the nth frame image, avg represents a mean pixel value of the nth frame image, min represents a difference between the maximum pixel value and the mean pixel value, corr represents a result of a quadratic function with respect to min, and BL is a finally estimated second backlight parameter.

Through the method, the embodiment of the disclosure can determine the pixel values belonging to different pixel value ranges according to the pixel value set of the image to obtain a plurality of absolute values corresponding to the boundary points of the different ranges, and since the maximum value of the plurality of absolute value terminals can represent the category of the image, the category of the image can be determined according to the relationship between the maximum value and the plurality of absolute values, and then the second backlight parameter of the image is determined according to the different image categories.

The method for determining the image scene type, the second backlight parameter and the first backlight parameter under the abrupt scene type according to the embodiment of the present disclosure is described above, and the method for determining the first backlight parameter of the image with the gradual scene type is exemplarily described below.

Referring to fig. 6, fig. 6 is a schematic diagram illustrating a first backlight parameter determining method according to an embodiment of the disclosure.

In one possible embodiment, as shown in fig. 6, if the current frame image (nth frame image) is of the abrupt scene type, the first backlight parameter of the current frame image is set to be the same as the second backlight parameter (i.e., the second backlight parameter is taken as the first backlight parameter).

In a possible implementation, as shown in fig. 6, the step S11 of determining the first backlight parameter of the nth frame image may further include:

It should be noted that the specific size of the preset backlight parameter (step) is not limited in the embodiment of the present disclosure, and may be determined as needed by a person skilled in the art, in an example, the preset backlight parameter may be a maximum allowable backlight difference value at which two front and back needle images in the gradient scene type do not flicker, and a specific value thereof may be set empirically.

Through the method, the embodiment of the disclosure can determine the first backlight parameter of the current frame image according to the magnitude relation between the second backlight parameter of the previous frame image and the second backlight parameter of the current frame image and based on the first backlight parameter of the previous frame image under the condition that the current frame image is of the gradient scene type, thereby being applicable to the characteristics of the gradient scene, being also applicable to different conditions between the previous frame image and the next frame image, obtaining the accurate first backlight parameter, and increasing the environmental adaptability and flexibility.

The method of generating the first backlight parameter is exemplarily described above, and the adjustment of the pixel value is exemplarily described below.

In a possible implementation, the step S13 of adjusting the pixel value of each pixel in the nth frame image according to the first backlight parameter may include:

Through the method, the embodiment of the disclosure can determine the pixel value adjustment parameter according to the first backlight parameter and the reference backlight parameter, so as to adjust the pixel value of the nth frame image.

In one example, the "determining a pixel value adjustment parameter according to the first backlight parameter and a reference backlight parameter of the nth frame image" may include:

determining the pixel value adjustment parameter using the following formula:

wherein k represents the pixel value adjustment parameter, B represents a reference backlight parameter of the nth frame image, BL_reduceRepresents the first backlight parameter and gamma represents a display correction factor of the display device.

By the method, the embodiment of the disclosure can quickly and accurately determine the pixel adjustment parameter by using the first backlight parameter and the reference backlight parameter, and determine the pixel adjustment parameter based on the display correction factor of the real device, so that the embodiment of the disclosure can adapt to the current display device.

The pixel values of the image may be adjusted in various ways, for example, the adjustment way may include a linear compensation way, a curved compensation way, a piecewise linear compensation way, and the like, and the piecewise linear compensation way is exemplarily described below.

Referring to fig. 7, fig. 7 is a schematic diagram illustrating a piecewise linearity compensation method according to an embodiment of the present disclosure.

In one example, the piecewise linear compensation approach shown in FIG. 7 may be established according to the following equation:

pixel value adjustment formula for the first segment: v1 ═ k × p, where V1 denotes the output pixel value of the first segment, k denotes the slope (pixel value adjustment parameter) of the first segment, and p denotes the input pixel value.

Pixel value adjustment formula for the second segment: v2 ═ k1 × p, where V2 denotes the output pixel value of the second segment and k1 denotes the slope of the second segment.

In one example, the disclosed embodiment may determine the segmented pixel value according to the content of the image and/or the backlight parameter of the image, for example, the pixel value of P may be set to be the pixel value of the pixel of pp% of the total number of pixels, 50< pp <100 may be set, and preferably pp may be 75, that is, the pixel value of P may be the pixel value of the pixel corresponding to the 75 th% of all the pixels of the image (for example, the pixel value of the pixel corresponding to 75% may be determined by an image histogram of the image), and by such setting, the disclosed embodiment may determine to consider the determination of the pixel values of the low-luminance region and the high-luminance region, and ensure the accuracy of the pixel value adjustment.

In one example, the slope of the second segment may be determined by the following equation:

where P denotes the input pixel value of the segmentation point, max denotes the maximum input pixel value of the image, and v denotes the output pixel value of the segmentation point.

In case P is selected, the output pixel value v of the segmentation point (P, v) may be determined according to the pixel value adjustment formula of the first segment, i.e. according to the product of the pixel value adjustment parameter and the input pixel value P of the segmentation point, and in case the output pixel value v of the segmentation point is determined, the slope K1 of the second segment may be determined.

In one example, the "adjusting the pixel value of the nth frame image using the pixel value adjustment parameter" may include:

and acquiring a pixel value of each pixel, taking the pixel value of each pixel as an input pixel value, determining an output pixel value by using a pixel value adjustment formula of a first section or a pixel value adjustment formula of a second section, and taking the output pixel value as the pixel value of the pixel of the adjusted N-th frame image.

Through the method, the embodiment of the disclosure can obtain the pixel value of each pixel, the pixel value of each pixel is used as the input pixel value, the pixel value adjustment formula of the first segment or the pixel value adjustment formula of the second segment is used for determining the output pixel value, and the output pixel value is used as the pixel value of the pixel of the adjusted nth frame image, so that the pixel value of the image is adjusted according to the scene and the category of the image, the overexposure phenomenon of a high-brightness area of the image can be prevented, the definition of the adjusted image is high, and the user experience is improved.

In the case of obtaining the adjusted image, the embodiment of the present disclosure may adjust the backlight brightness of the display device, in one example, the display device may include an LCD display panel, and the embodiment of the present disclosure may adjust the backlight brightness of the LCD display panel according to the first backlight parameter.

Of course, the above description is exemplary, and the present disclosure does not limit a specific embodiment of how to adjust the backlight brightness of the display device, and does not limit the type of the display device, and a person skilled in the art may refer to the related art for different types of display devices to adjust the backlight brightness of the display device by using the first backlight parameter.

According to the embodiment of the disclosure, by adaptively adjusting the pixel value of the image and the backlight brightness of the display device, the backlight flicker phenomenon in the display process can be avoided, and the image display effect can be well maintained.

Referring to fig. 8, fig. 8 is a block diagram illustrating a display control apparatus according to an embodiment of the present disclosure.

Applied to a display device, the device comprising:

a determining module 10, configured to determine a first backlight parameter of an nth frame image, where the first backlight parameter is used to adjust backlight brightness of the display device, where N is greater than or equal to 1 and is an integer;

a first adjusting module 20, connected to the determining module 10, configured to adjust a pixel value of a pixel in the nth frame image according to the first backlight parameter, so as to obtain an adjusted nth frame image;

and a second adjusting module 30, connected to the first adjusting module 20, for adjusting the backlight brightness of the display device according to the first backlight parameter, and displaying the adjusted nth frame image by using the display device.

The display control device of the embodiment of the disclosure can adjust the pixel value of the nth frame image by using the first backlight parameter of the nth frame image, and adjust the backlight brightness of the display device, thereby reducing the display power consumption of the display device, saving energy, and prolonging the service life of the device.

determining a second backlight parameter of the Nth frame image;

It should be noted that the display control device is a device corresponding to the display control method, and for a specific introduction, reference is made to the description of the method, which is not repeated herein.

Referring to fig. 9, fig. 9 is a block diagram of a display control apparatus 800 according to an embodiment of the present disclosure. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 9, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804, is also provided that includes computer program instructions executable by the processor 820 of the device 800 to perform the above-described methods.

Referring to fig. 10, fig. 10 is a block diagram of a display control apparatus 1900 according to an embodiment of the disclosure. For example, the apparatus 1900 may be provided as a server. Referring to FIG. 10, the device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by the processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the above-described method.

The device 1900 may also include a power component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to a network, and an input/output (I/O) interface 1958. The device 1900 may operate based on an operating system stored in memory 1932, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.

In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the apparatus 1900 to perform the above-described methods.

The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A display control method is applied to a display device, and the method comprises the following steps:

adjusting the backlight brightness of the display device according to the first backlight parameter, and displaying the adjusted Nth frame image by using the display device;

the determining the first backlight parameter of the nth frame image comprises: determining scene types of the N frame image, wherein the scene types comprise a gradual change scene type and a sudden change scene type, the gradual change scene type represents that the brightness value difference of the N frame image relative to the N-1 frame image is smaller than a scene comparison threshold, and the sudden change scene type represents that the brightness value difference of the N frame image relative to the N-1 frame image is larger than the scene comparison threshold;

determining a second backlight parameter of the Nth frame image; and when the scene type of the N frame image is the abrupt scene type, taking the second backlight parameter as the first backlight parameter.

2. The method of claim 1, wherein the determining the scene type of the nth frame image comprises:

3. The method of claim 1, wherein the determining the second backlight parameter of the nth frame image comprises:

4. The method of claim 3, wherein determining the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value comprises:

5. The method according to claim 3 or 4, wherein the determining the second backlight parameter according to the first absolute value, the second absolute value, and the third absolute value comprises:

6. The method of claim 1, wherein the determining the first backlight parameter for the nth frame image further comprises:

7. The method of claim 1, wherein the determining the first backlight parameter for the nth frame image further comprises:

8. The method of claim 1, wherein the determining the first backlight parameter for the nth frame image further comprises:

9. The method of claim 1, wherein the adjusting the pixel value of the pixel in the nth frame image according to the first backlight parameter comprises:

10. A display control apparatus, applied to a display apparatus, the apparatus comprising:

the second adjusting module is connected to the first adjusting module and used for adjusting the backlight brightness of the display device according to the first backlight parameter and displaying the adjusted Nth frame image by using the display device;

determining a second backlight parameter of the Nth frame image;

11. A display control apparatus, characterized by comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to:

executing the display control method according to any one of claims 1 to 9.

12. A non-transitory computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the display control method of any one of claims 1 to 9.