CN113902624A - Method for processing still image in image - Google Patents
Method for processing still image in image Download PDFInfo
- Publication number
- CN113902624A CN113902624A CN202010576254.3A CN202010576254A CN113902624A CN 113902624 A CN113902624 A CN 113902624A CN 202010576254 A CN202010576254 A CN 202010576254A CN 113902624 A CN113902624 A CN 113902624A
- Authority
- CN
- China
- Prior art keywords
- still image
- image
- index
- luminance
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 124
- 238000012545 processing Methods 0.000 title description 21
- 238000003672 processing method Methods 0.000 claims abstract description 12
- 230000003068 static effect Effects 0.000 abstract description 26
- 238000004364 calculation method Methods 0.000 abstract description 5
- 238000012216 screening Methods 0.000 abstract description 2
- 230000001105 regulatory effect Effects 0.000 abstract 2
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
A processing method for static image in image includes dividing each image frame of a dynamic image into multiple regions, calculating static image index of each region by multiple static image calculation methods, representing judgment basis of each region in each image frame covering a part or all of static image by static image index, screening out region as static image by an index threshold preliminarily, confirming region as static image in each image frame by a time threshold, then regulating image data of region as static image by regulating brightness value of static image region for preventing negative influence of static image on display panel.
Description
Technical Field
The present invention relates to a video processing method, and more particularly, to a video processing method for adjusting brightness of a region of a video where a still image exists.
Background
In a moving image, if there is a fixed image in the moving image, such as an advertisement, a logo (logo) placed in a fixed position in the moving image by a television station, or a pattern that does not move in a specific position, it may affect a display panel under specific conditions, such as a burn mark (burn marks) generated on an organic light-emitting diode (OLED) display.
Therefore, in the prior art, the electronic device using the display which generates the burn-in due to the still image can execute the procedure of generating the image change at regular time to slightly change the position of the whole image frame (frame), and the image is divided into a plurality of areas to adjust the brightness value of each area, thereby avoiding the problem of generating the image at a fixed position.
Disclosure of Invention
In order to prevent the influence of the still image on the specific display panel, the still image in the moving image needs to be determined first, and then the still image can be further processed. The invention provides a processing method of a static image in an image, which comprises the steps of segmenting each image frame of a dynamic image into a plurality of areas, calculating the static image index of each area by a plurality of static image calculation methods, representing the judgment basis that each area in each image frame covers a part or all of the static image by using the static image index, preliminarily screening the area which is the static image by using an index threshold, confirming the area which is the static image in each image frame by using a time threshold, and then adjusting the image data of the area which is judged to be the static image, for example, reducing the brightness value of the static image area, thereby preventing the negative influence of the static image on a display panel.
According to an embodiment of the circuit system for implementing the method of the present invention, the circuit system comprises an image processing circuit, wherein the method for processing the still images in the video is performed, and when the still images of consecutive frames are obtained, the video data thereof can be adjusted to eliminate the negative effects of the still images, and then the adjusted video data is outputted to the display control circuit to be outputted to a driving circuit of a display, and the display plays the video. Preferably, the time threshold is flexibly adjusted according to a frame rate of a display panel to which the circuit system is applied, and the time threshold may represent a number of consecutive image frames in the moving image.
Further, in the method for processing a still image in a video, when calculating the still image index of a pixel or a region, the still image index may be calculated by performing various methods of determining a still image, such as: a luminance clustering method, a previous and next frame luminance difference method, a previous and next frame high frequency difference method, and a hole filling method accumulate scores of still image indexes when any one of a plurality of methods for judging still images is judged as a still image.
Then, the misjudged still image result can be corrected by the characteristics of the previous and next image frames or the adjacent pixels or regions of each pixel or each region, such as the time axis information compensation method and the spatial information compensation method, wherein the misjudged still image is the one with the score subtracted, and the misjudged non-still image is the one with the score added.
Further, when a pixel or a region is judged to be a non-still image, the still image index score of the pixel or the region is zeroed, but a part which cannot be zeroed is also excluded, and the related method adopts a front-and-back frame luminance difference method, a front-and-back frame high frequency difference method, a method of using a luminance value relationship between adjacent pixels or regions, and a method of detecting whether or not a specific object is present.
For a better understanding of the features and technical content of the present invention, reference should be made to the following detailed description of the invention and accompanying drawings, which are provided for purposes of illustration and description only and are not intended to limit the invention.
Drawings
FIG. 1 is a circuit diagram of a circuit system for controlling a display panel and a driving circuit;
FIG. 2 shows a flow diagram of an embodiment of a still image processing method;
FIG. 3 is a schematic view of an image divided into a plurality of regions;
FIG. 4 shows a flow diagram of an embodiment of calculating a still image index;
FIG. 5 is a flowchart illustrating an embodiment of determining a still image based on luminance clustering of a frame;
FIG. 6 is a flowchart illustrating an embodiment of determining a still image according to a difference between the luminance of previous and next frames;
FIG. 7 is a flowchart of an embodiment of determining a still image based on a high frequency representation of a frame;
FIG. 8 is a diagram illustrating an embodiment of determining a still image using neighboring image features;
FIG. 9 is a flowchart showing an example of compensating for a still image index by a time axis information compensation method;
FIG. 10 is a flow chart illustrating an embodiment of compensating a still image index by a spatial information compensation method;
FIG. 11 is a flowchart illustrating an embodiment of resetting a still image index by a difference between previous and next frame luminance;
FIG. 12 is a flow chart illustrating an embodiment of resetting a still image index by a high frequency difference method for previous and subsequent frames;
FIG. 13 is a flowchart of an embodiment of resetting a still image index using spatial information to prevent false positives; and
fig. 14 shows a flowchart of an embodiment of resetting a still image index by detecting a specific object to prevent erroneous determination.
Detailed Description
The following is a description of embodiments of the present invention with reference to specific embodiments, and those skilled in the art will understand the advantages and effects of the present invention from the disclosure of the present application. The invention is capable of other and different embodiments and its several details are capable of modifications and variations in various obvious respects, all without departing from the present invention. It should be noted that the drawings of the present invention are merely schematic illustrations and are not drawn to actual dimensions. The following embodiments will further explain the related art of the present invention in detail, but the disclosure is not intended to limit the scope of the present invention.
It will be understood that, although the terms "first," "second," "third," etc. may be used herein to describe various components or signals, these components or signals should not be limited by these terms. These terms are used primarily to distinguish one element from another element or from one signal to another signal. In addition, the term "or" as used herein should be taken to include any one or combination of more of the associated listed items as the case may be.
To solve the problems that a still image in an image may cause a display panel, such as a burn-in mark on an Organic Light Emitting Diode (OLED) display, or a permanent damage on a display device (e.g., a Cathode Ray Tube (CRT) display) using a specific display technology, or a mark on a Liquid Crystal Display (LCD) with poor quality may be caused by the still image in the image, the present specification discloses an image processing method and a circuit system for adjusting brightness of an area of the image having the still image, wherein the method mainly aims to provide a method for obtaining the still image in a dynamic image, and the circuit system can refer to a circuit module diagram of one embodiment of the circuit system shown in fig. 1.
Fig. 1 shows a circuit system 10 for controlling a display panel 101 and a driving circuit 103, wherein the circuit system 10 receives an image signal 100 from a source, outputs the image signal to the driving circuit 103 after image processing, and finally plays the image signal by the display panel 101. The main circuit components of the circuit system 10 include a display control circuit 105 and an image processing circuit 107.
After receiving the video signal 100, the image processing circuit 107 in the circuit system 10 performs image processing according to the format and resolution of the final display, generates a signal, such as a Low-voltage differential signal (Low-voltage differential signal), which is provided to the display control circuit 105, then performs frequency control by the display control circuit 105, and outputs a digital video signal to the driving circuit 103 of the display in a serial (serial) manner, and then displays the video on the display panel 101 of the display. The processing method of the still image in the video can be executed in the circuit system 10, such as a function implemented as a firmware program of the image processing circuit 107.
Among them, one of the main purposes of the method for processing a still image in an image running in the circuit system 10 is to detect a still image (an image which remains still for a certain period of time) in a continuous image when receiving the image signal 100, and further to adjust the image data, such as the brightness value, of the still image so that the still image displayed for a long time does not generate a bad image on the display panel.
According to the method for processing a still image in a video presented in the present application, reference may be made to the flowchart of the embodiment of the method for processing a still image shown in fig. 2.
The method may be implemented in an image processing circuit, wherein after receiving a moving picture from a picture source, a still picture index (index) is calculated for each picture frame (frame) of the input moving picture, and the still picture index is calculated for each pixel (pixel) or area of the picture, and the still picture index is represented by a fraction of each pixel or each area in each picture frame that is determined to be a still picture. In the process, it is more efficient to divide the image into a plurality of regions (step S201), and then calculate the still image index for each region (step S203), and in this process, it is possible to determine whether there is a still image or not by using the image data of each region, and to eliminate erroneous determination. According to the embodiment, whether the area belongs to the still image or not is judged according to various methods, and if the area belongs to the still image, the still image index of the area is increased, such as adding one to the score.
When obtaining the individual still image indexes of a plurality of areas of each image frame, the method can judge whether each area is a still image or not according to the still image index of each area (step S205), for example, an index threshold is set, and the pixel or area which may be a still image in the image can be preliminarily judged through the index threshold, that is, the pixel or area of which the still image index is greater than or equal to the index threshold in each image frame is preliminarily obtained; a time threshold is set, and the number of consecutive frames can be used as a threshold according to the frame rate/fps of the moving image, so as to determine the pixels or regions of the moving image which are still images. Therefore, if the continuous image has a pixel or area with a still image index greater than the index threshold and the time threshold is continuously reached, the pixel or area is determined to be a still image (yes), i.e., the image data of the area is adjusted (step S207), and then the image is output; otherwise, if the still image index of the area is not greater than or equal to the index threshold, or even if the still image index is greater than the index threshold, the still image index does not reach the set time threshold, it is determined that the area is not a still image (no), and the original image data of each pixel of the area is continuously maintained (step S209).
It should be noted that, when one or more regions in the image are determined to be still images in step S207, each region may be all or a portion of the still image in the entire image frame, and the brightness value of the pixels in each region may be adjusted. Therefore, before the image is output (displayed), the continuous static image in the image can be obtained, and the image data is properly adjusted, so that the negative influence of the static image on the display panel can be effectively avoided.
According to one embodiment of the method for adjusting the brightness value of each region, the system can design a non-still image brightness curve and a still image brightness curve corresponding to the current image frame, because the brightness value of each pixel or each region and the still image index are obtained through the above process, and the brightness adjustment weight of the current region or pixel between the two curves can be calculated by referring to the non-still image brightness curve and the still image brightness curve according to the still image index of the current region (or pixel), the higher the still image index is, the higher the brightness adjustment weight is, the lower the still image index is, and the lower the brightness adjustment weight is. The luminance values are then adjusted according to the weights rather than uniformly dimming the luminance values of the entire still image.
The processing method of the still image in the image described in the above steps calculates the continuous image frame by frame, and then the related circuit system can adjust the brightness of the area determined as the still image in the continuous image, and the problem of forming the burn-in mark on the specific display panel can be effectively avoided by adjusting the brightness of the still image. The definition of the still image may be determined according to the characteristics of the applied display panel, and the time threshold for generating the still image may be set in advance according to the display panel to be applied, that is, the time threshold may be flexibly adjusted according to the characteristics of the display panel to which the circuitry is applied, for example, each display panel and its control circuit generate a display capability with a specific frame rate, and the time threshold for determining the still image in the image may be represented as the number of consecutive image frames.
Further, in the above embodiment, the step S201 provides a more efficient processing method to segment the image into a plurality of regions, which can be shown in fig. 3 as an image schematic diagram segmented into a plurality of regions, when a film file including image data of a plurality of frames is received, the firmware flow in the image processing circuit can segment each image frame into a plurality of regions, for example, fig. 3 shows that one image frame 30 is segmented into a plurality of regions (e.g., "mxn"), each region includes a plurality of pixels (e.g., "pxq"), wherein a continuous plurality of frames of still images 301 are displayed, and the still images 301 may cover a plurality of regions.
According to the method for processing still images in images disclosed in the specification, the method for calculating the still image index proposed in the above embodiment includes determining the index by a plurality of methods for determining still images, and also includes a method for checking for erroneous determination, and the related process may refer to the process of calculating the still image index shown in fig. 4.
In step S401, in each of the image frames divided into a plurality of regions, whether each region in each of the image frames is a still image is determined by using a plurality of methods, such as a luminance clustering method shown in fig. 5, a luminance difference method of the previous and next frames shown in fig. 6, a high-frequency difference method of the previous and next frames shown in fig. 7, and a hole filling method shown in fig. 8. The method of calculating the still image index of each region may be applied to pixels.
Each region in each image frame may be calculated as a still image index, and in step S403, the still image index score of the region is increased, such as by one, for the region determined as a still image in each image frame. Therefore, when a plurality of methods for determining still images are used, if a still image is determined, the still image index scores of the area may be accumulated as a basis for final determination as a still image.
However, it is still possible to make a misjudgment when determining a still image, wherein one of the reasons is that the image is interfered by noise, so that a region with a still image is misjudged, or a region is misjudged to be a non-still image. Therefore, in step S405, the result of misjudging the still image is corrected by the feature of each region or pixel in the preceding and following frames or the region adjacent to each region or pixel. For example, when a certain region is a still image, the still image should be maintained for a period of time, so that the erroneous determination can be eliminated by determining whether the image data (such as brightness and frequency) at the same position of the previous and next frames are consistent or within an error range, that is, setting an error range to screen out the region erroneously determined as the still image or the region erroneously determined as the non-still image. In this step, the still image index is corrected, and the score is subtracted if the still image index is erroneously determined to be a still image, and the score is added if the still image index is erroneously determined to be a non-still image. The method of compensating for the still picture index may refer to a time axis information compensation method shown in fig. 9 and a spatial information compensation method shown in fig. 10.
Then, in step S407, when the still image index of each area of each image frame is calculated, when the index reaches a certain threshold, it is determined as a still image; otherwise, if the index does not reach the threshold, it indicates that the area is not a still image, or is only a small pattern (not image display panel) that is not easily determined as a still image, the still image index of the area can be zeroed. The method for determining whether the still image index is zero can be described with reference to the previous and subsequent frame luminance difference method described in fig. 11, the previous and subsequent frame high frequency difference method described in fig. 12, the method for preventing erroneous determination using spatial information in fig. 13, and the method for detecting a specific object to prevent erroneous determination in fig. 14.
Finally, it can be determined whether the image is a still image according to the still image index accumulated in each region, that is, the image data is modified to eliminate the influence on the display panel.
The following embodiment describes a method of calculating a still image index.
The first embodiment is as follows: luminance clustering method
One of the ways to determine whether the area or pixel in each frame is still image is based on the brightness distribution of the frame, as shown in fig. 5, when receiving the moving image, in addition to directly calculating the still image index of each pixel, it is more efficient to divide the frame into a plurality of areas (step S501) and calculate the brightness value of each area (step S503). The way of calculating the luminance value of each region (or pixel) is to take a red-green-blue color space (RGB color space) as an example, the luminance value can be obtained by the red, green or blue channel value of the pixel of each region; for example, in the case of YUV color space (YUV color space), where 'Y' represents brightness (luminance) and 'U' and 'V' represent chroma (chrominance), the value of 'Y' may be used as the luminance value. When the luminance value of each region is calculated, the luminance value of the region may be taken as the average value of the luminance of the pixels in each region.
After obtaining the multi-region brightness value of each image frame, the brightness distribution of the image frame can be obtained, and the brightness distribution can be grouped, a plurality of regions in each image frame are divided into a plurality of brightness groups according to the brightness value of each region, then the still image in the image can be judged according to the brightness relation (such as the consistency of brightness) of each region of the front and the back image frames, and can be continuously matched with a time threshold, when one or more regions in the continuous image frames have consistent brightness expression, and the region can be judged as the still image when the time threshold (or the number threshold of the continuous image frames) set by the system is reached.
According to the process embodiment of the present invention, the luminance information of each region can be divided into a high luminance group and a low luminance group, for example, a luminance threshold can be set, and a group higher than or equal to the luminance threshold is classified as a high luminance group, and a group lower than the luminance threshold is classified as a low luminance group. Next, the average luminance, the maximum value, and the minimum value of the high luminance group, and the average luminance, the maximum value, and the minimum value of the low luminance group are obtained as references for determining whether or not there is a still image (step S505). Since the neighboring pixels or areas in the still image in the image frame should have the same brightness distribution characteristics, the relationship between the average brightness, the maximum value, and the minimum value, such as the consistency, of the high brightness group and the low brightness group of the neighboring pixels or areas can be referred to as the reference condition for determining whether the image is a still image (step S507).
It is to be noted that the luminance clustering method is used to determine a still image in a moving picture, and since there is a possibility of erroneous determination at this stage in the processing method of a still image in a moving picture, the still image index is used as an index for finally determining whether or not a still image is included, that is, a still image index score of a region in which a still image is determined is increased, the still image indexes are accumulated by a plurality of determination methods, and when the score is accumulated to a certain value, the still image in a moving picture is determined by the final still image index.
Example two: method for difference value of brightness of front and back frames
Another method for determining a still image is shown in fig. 6, which is a flowchart of an embodiment for determining a still image according to a difference between luminance of previous and next frames, because the still image in the video should have the same luminance in the previous and next frames, that is, the difference between the luminance of the still image in the previous and next frames should not be large, a luminance difference threshold may be set, and a smaller luminance difference in the same region of the previous and next frames may be determined as a still image.
Similarly, in addition to the individual processing for each pixel, the image frame may be divided into a plurality of regions, and the following process takes the calculation of the regional still image index (step S601) as an example, and the luminance value of each region is similarly acquired (step S603).
Then, the brightness difference of each area of the consecutive frames is calculated (step S605), and since the still image should have consistent brightness characteristics in the consecutive frames, a brightness difference threshold can be introduced to determine whether the brightness characteristics of the consecutive frames are consistent, and if the brightness difference of the areas is smaller than the brightness difference threshold and the consecutive frames are all the same, the still image can be determined (step S607).
Example three: high-frequency difference method for front and rear frames
In addition to the above-mentioned luminance clustering method or the previous and subsequent frame luminance difference method for determining the still image according to the luminance uniformity of the adjacent or previous and subsequent frames, the still image may be determined by referring to the representation of the images in the frequency domain of the respective regions of the previous and subsequent frames, as shown in fig. 7, which is an embodiment of determining the still image according to the high frequency representation of the image frame.
Similarly, in addition to determining the pixels individually, each image frame in the moving image may be divided into a plurality of regions (step S701), and the image data therein may be converted into a frequency domain, for example, the image may be Fourier transformed into a frequency domain, and then the frequency characteristics of each region may be obtained (step S703).
Then, a high frequency feature is obtained (step S705), and the high frequency image is one of the features forming the still image. It should be noted that, in general, an image edge belongs to a high frequency part and belongs to a part with relatively large change, whereas a low frequency part in the image belongs to a part with relatively small change, so that a still image with large edge change can be found by using high frequency features.
If the region belongs to the still image, the frequency representation of the region in the previous and next image frames should have consistency, so the high frequency representation can be the basis for judging the still image. In this way, the high frequency difference between each region of the previous and subsequent frames is calculated, and a high frequency difference threshold set by a system is compared, and if the high frequency difference between the previous and subsequent frames is smaller than the high frequency difference threshold, which indicates that the high frequency representations of the same region of the consecutive previous and subsequent frames are consistent, it can be preliminarily determined as a still image (step S707).
Example four: method for repairing hole
FIG. 8 is a diagram illustrating an embodiment of determining a still image using neighboring image features. In the illustrated example, when each region is processed by the processing flow, a current region 80 is displayed, the hole filling method is to obtain image features of adjacent directions of the current region 80, for example, obtain image features of a plurality of directions such as top, bottom, left, right, top right, bottom right, top left, bottom left, and the like, such as high frequency features, and set a distance threshold (n), when there is a high frequency change within a distance n of each direction of the current region 80, that is, it is obtained that there is a static boundary, indicating that the current region 80 belongs to a part of a static image, and according to this condition, the static image index score of the current region 80 can be added by one.
According to the method embodiment of the present invention, the still image index scores of each pixel or area may be accumulated by using the above-mentioned methods for determining a still image, so that the higher the score accumulation expressed by the still image index is, the more certain the area is a part or all of the still image, and when the score is accumulated to a certain value, the still image in the video is determined by using the final still image index.
However, when a plurality of still image determination methods are employed, the problem of erroneous determination can be further eliminated, and the following embodiment describes a method of correcting an erroneous determination still image.
The first embodiment is as follows: time axis information compensation method
FIG. 9 is a flow chart showing an embodiment of compensating for a still image index by time-axis information compensation, wherein a moving picture comprises a plurality of frames over time, and whether to compensate for the still image index is determined by using information on the time axis.
In the method, the still image indexes of each area in a plurality of image frames within a period of time are obtained (step S901), and the index thresholds set by the system, that is, the reference thresholds for judging as still images are compared one by one (step S903), at this time, the accumulated times of judging as still images of each area (or pixel) can be obtained, if the times are greater than the times threshold set by the system or a proportional threshold, the still image indexes of the areas under the condition can be compensated (step S905), for example, the still image indexes of the current pixel or area are increased to compensate the condition that a certain frame has misjudgment.
For example, 1 to p frames are acquired over a period of time, wherein a certain area is judged as a still image in k frames, such as judged as a still image by the method of fig. 5 to 8, and if k occupies a certain proportion (k/p) of p and is higher than the above-mentioned proportion threshold, such as 2/3, the still image index is compensated for the pixel or area in the last (p-th) frame.
Example two: spatial information compensation method
Fig. 10 is a flowchart illustrating an embodiment of compensating the still image index by spatial information compensation, which is a method for compensating the still image index by comparing the still image index of the current region (or pixel) with the still image index of the neighboring region. In the method, the still image indexes of a plurality of areas in each image frame are firstly obtained (step S101), when the current area is processed, the still image indexes of the adjacent areas are compared (step S103), and if the indexes are close and reach an index close threshold, the still image indexes of the adjacent areas are all close, namely the still image index of the current area is compensated (step S105).
The following embodiments describe a method of checking the still image index, that is, resetting (reset) its still image index when a non-still image is confirmed by the check.
The first embodiment is as follows: method for difference value of brightness of front and back frames
Referring to fig. 11, a flowchart of an embodiment of resetting a still image index by a difference between luminance values of previous and subsequent frames is shown, and the concept of the method is that if the luminance value of a current region in a previous and subsequent frames is consistent and the difference between the luminance values is not large, the method can be used as one of the determination conditions for determining whether to return the still image index of the region to zero.
In this process, the luminance values of the regions (or pixels) of the consecutive frames are obtained (step S111), then the luminance difference of the same region of the previous and subsequent frames is calculated (step S113), and the luminance difference is compared with a luminance difference threshold (step S115), which may be the threshold used in calculating the still image index as described in fig. 6, and if the luminance difference is greater than the luminance difference threshold, the score of the still image index of the region is reset to zero (step S117).
Example two: high-frequency difference method for front and rear frames
Similarly, the high frequency representation of the previous and subsequent frames can also be used as one of the conditions for checking and confirming the still image, and as shown in fig. 12, an embodiment of the flow chart for resetting the index of the still image by the high frequency difference method of the previous and subsequent frames is provided.
In this flow, the frequency characteristics of each region of the consecutive frames are obtained (step S121), and the high frequency characteristics of the same region (or pixel) of the previous and next frames are obtained to obtain the high frequency difference (step S123), a high frequency difference threshold is compared (step S125), if the high frequency difference threshold is greater than (or equal to) the high frequency difference threshold, it indicates that the previous and next high frequency differences are too large, that is, the high frequency representation of the pixel or region is not consistent with that of the previous and next frames, so that the non-still image can be determined, and the score of the still image index of the region determined as the non-still image can be reset (step S127).
Example three: method for preventing misjudgment by using spatial information
Fig. 13 next shows a flowchart of an embodiment of resetting the still image index by using the spatial information to prevent the false determination, which is a method for checking whether there is a false determination as a non-still image by considering the luminance relationship between the current region and its neighboring region.
First, the brightness value of each region of each image frame is obtained (step S131), and the brightness values of the current region and the neighboring region are compared (step S133), so as to check whether the still image index is reset for the region with similar brightness (step S135). If the brightness value of the current area is similar to that of the neighboring areas, if the current area is improperly regarded as a non-still image, the still image index is not reset; otherwise, the score of the still image index is reset.
Example four: method for preventing misjudgment by detecting specific object
Fig. 14 is a flowchart illustrating another embodiment of resetting a still image index by detecting a specific object to prevent erroneous determination, in which if a specific object is detected in a moving image (step S141), and the area covered by the specific object in each image frame is determined (step S143), it is checked whether the area covered by the specific object resets the still image index (step S145).
Since the specific object is changed in consecutive frames and does not affect the still image index determined originally, when the specific object defined by the system is detected, the specific object may be determined as a non-still image and the still image index of the passing pixel or region is reset, thereby excluding the case of resetting the still image index of the passing pixel or region of the specific object.
The following lists the characteristics of the specific object to be detected, and if the characteristics are all matched, including the area, aspect ratio, shape and brightness of the object, the detection result is determined that the specific object is detected, and the still image index of the covered pixel or area is not adjusted; otherwise, if the conditions are not met, the judgment result is that the specific object is not detected, and the calculation of the still image index is not influenced.
The object features are as follows: area of
The area of the known object is used as one of the conditions for determining whether the object moves through the current pixel or region, that is, if the known object moves through the current pixel or region, the brightness of the previous and subsequent frames changes, and the area of the block with the changed brightness is close to the area of the known object.
Object feature two: aspect ratio
The aspect ratio of the known object is used as one of the conditions for determining whether the object moves through the current pixel or region, that is, if the object moves through the current pixel or region, the aspect ratio of the blocks with brightness changes in the previous and next image frames should be close to the aspect ratio of the known object.
Object features three: shape of
The shape of the known object is used as one of the conditions for determining whether the object moves past the current pixel or region, wherein if the object moves past the current pixel or region, the positions of the blocks with changed brightness of the previous and next image frames should be continuous.
Object features four: brightness of light
The brightness of the known object is used as one of the conditions for judging whether the object moves through the current pixel or area, wherein if the object moves through the area where the current pixel or area is located, the brightness of the related pixels or areas of the previous and next image frames should be close to the brightness of the object.
In summary, according to the processing method of the still image in the image described in the above embodiments, the still image index of each region is calculated by a plurality of still image calculation methods, the still image index represents a determination basis for each region in each image frame as a still image, and the region that is determined as a still image by the index threshold and the time threshold can be used as a reference for adjusting the image data, so that a negative effect of the still image on the display panel can be effectively prevented. In one application, if the method is applied to a control circuit of a specific display panel (e.g., an OLED panel), when a still image in a dynamic image is found, subsequent processing, such as brightness adjustment, may be provided to avoid burn-in caused by playing the same image for a long time by such a panel.
The disclosure is only a preferred embodiment of the invention, and is not intended to limit the scope of the invention, so that all equivalent technical changes made by using the contents of the specification and the drawings are included in the scope of the invention.
[ description of reference ]
101 display panel
103 drive circuit
105 display control circuit
107 image processing circuit
10 circuit system
100 image signal
30 image frame
301 still image
80 current region
Processing flow of still image in video from step S201 to step S209
Procedure for calculating index of still image in steps S401 to S407
Step S501-S507 process for judging still image according to brightness grouping of image frame
Step S601-S607 Process for judging static image according to the difference of the front and rear frame brightness
Process for judging still image according to high-frequency representation of image frame in steps S701-S707
Process for compensating still picture index by time axis information compensation method in steps S901 to S905
Process for compensating still picture index by spatial information compensation method in steps S101-S105
Process for resetting still image index by using luminance difference method of previous and next frames in steps S111-S117
Step S121-S127 process for resetting still image index by using high-frequency difference method of front and rear frames
Process for resetting still image index using spatial information to prevent erroneous determination in steps S131 to S135
Steps S141 to S145 are performed to reset the still image index by detecting a specific object to prevent erroneous judgment
Claims (10)
1. A processing method of a still image in an image is applied to a circuit system, and comprises the following steps:
respectively calculating a still image index for each pixel or each segmented region in each image frame of a dynamic image, wherein the still image index is represented by a fraction of each pixel or each segmented region in each image frame judged as a still image; and
the pixel or area of the still image in each image frame is preliminarily judged by an index threshold, and then the pixel or area of the still image in the dynamic image is judged by a time threshold.
2. The method as claimed in claim 1, wherein the time threshold is flexibly adjusted according to a frame rate of a display panel to which the circuitry is applied, wherein the time threshold represents a number of consecutive frames in the moving image.
3. The method of claim 1, further comprising adjusting the image data of the pixels or regions determined as still images, wherein the adjusted image data is the luminance values of the pixels or regions determined as still images, wherein the weight of the adjusted luminance is calculated according to the still image index of the pixels or regions determined as still images by referring to a non-still image luminance curve and a still image luminance curve, and then the luminance values of the pixels or regions are adjusted according to the weight.
4. The method of any one of claims 1 to 3, wherein the still image index is calculated by performing a plurality of methods of determining a still image when calculating the still image index of a pixel or a region, and a score of the still image index is accumulated when any one of the plurality of methods of determining a still image is determined to be a still image; and correcting the result of misjudging the still image through the characteristics of the front and back image frames or the adjacent pixels or areas of each pixel or each area, wherein when misjudging the still image, the score is subtracted, and when misjudging the still image, the score is increased; and when the pixel or the area is judged to be a non-still image, the still image index score of the pixel or the area is reset to zero.
5. The method of claim 4, wherein one of the methods for determining the still image is a luminance clustering method, and the luminance clustering method determines whether the still image belongs to the still image according to the consistency of the average luminance, the maximum value and the minimum value of the high luminance group and the low luminance group of a plurality of adjacent pixels or areas in the image frame.
6. The method of claim 4, wherein one of the methods for determining the still image is a difference between luminance of previous and next frames, and the difference between the luminance of previous and next frames determines whether the still image belongs to based on whether the luminance difference of each pixel or region in the previous and next frames is less than a luminance difference threshold.
7. The method of claim 4, wherein one of the methods for determining the still image is a hole filling method, and the hole filling method determines whether the still image belongs to according to whether the pixel or the region has a still boundary within a distance of each neighboring direction.
8. The method as claimed in claim 4, wherein one of the methods for correcting misjudged still images is a time axis information compensation method, and if the number of times each pixel or area is judged as a still image within a period of time is higher than a proportional threshold, the still image index of the pixel or area is increased.
9. The method of claim 4, wherein one of the methods for correcting the misjudged still image is a spatial information compensation method, which compares the still image indexes of neighboring pixels or areas, and compensates the still image indexes of the pixels or areas if the still image indexes are similar.
10. The method as claimed in claim 4, wherein whether there is an improper pixel or area determined as a non-still image is determined by determining whether the brightness values of neighboring pixels or areas are similar.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010576254.3A CN113902624A (en) | 2020-06-22 | 2020-06-22 | Method for processing still image in image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010576254.3A CN113902624A (en) | 2020-06-22 | 2020-06-22 | Method for processing still image in image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113902624A true CN113902624A (en) | 2022-01-07 |
Family
ID=79186774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010576254.3A Pending CN113902624A (en) | 2020-06-22 | 2020-06-22 | Method for processing still image in image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113902624A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004356828A (en) * | 2003-05-28 | 2004-12-16 | Matsushita Electric Ind Co Ltd | Video display apparatus |
| CN1641727A (en) * | 2004-01-17 | 2005-07-20 | 深圳创维－Rgb电子有限公司 | Intelligent ghost-eliminating method |
| US20060001601A1 (en) * | 2004-06-25 | 2006-01-05 | Funai Electric Co, Ltd. | Plasma display apparatus |
| CN101308625A (en) * | 2007-05-18 | 2008-11-19 | 索尼株式会社 | Display device, display device drive method, and computer program |
| CN107610060A (en) * | 2017-08-29 | 2018-01-19 | 西安交通大学 | A kind of OLED image calcination ameliorative way and device |
-
2020
- 2020-06-22 CN CN202010576254.3A patent/CN113902624A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004356828A (en) * | 2003-05-28 | 2004-12-16 | Matsushita Electric Ind Co Ltd | Video display apparatus |
| CN1641727A (en) * | 2004-01-17 | 2005-07-20 | 深圳创维－Rgb电子有限公司 | Intelligent ghost-eliminating method |
| US20060001601A1 (en) * | 2004-06-25 | 2006-01-05 | Funai Electric Co, Ltd. | Plasma display apparatus |
| CN101308625A (en) * | 2007-05-18 | 2008-11-19 | 索尼株式会社 | Display device, display device drive method, and computer program |
| CN107610060A (en) * | 2017-08-29 | 2018-01-19 | 西安交通大学 | A kind of OLED image calcination ameliorative way and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI762956B (en) | Method for processing a static pattern in an image | |
| US8929647B2 (en) | Image processing apparatus and control method therefor | |
| US7538821B2 (en) | Display apparatus to detect letter-box boundary and method of displaying image using the same | |
| KR101929001B1 (en) | Method of compensating stain, method of driving display panel having the method of compensating stain and display apparatus for performing the method of driving display panel | |
| CN109147712B (en) | Method and system for improving visual angle color cast of display panel | |
| US10109068B2 (en) | Method of automatic identification and calibration of color and grayscale medical images | |
| US7983506B2 (en) | Method, medium and system processing image signals | |
| US20150242687A1 (en) | Fire detection method and apparatus | |
| US8194978B2 (en) | Method of and apparatus for detecting and adjusting colour values of skin tone pixels | |
| CN109192174B (en) | Driving method and driving device of display panel and display device | |
| CN109903717B (en) | Identification method, compensation method and device for bright spot area of display panel | |
| TWI553604B (en) | Adaptive contrast enhancement apparatus and method | |
| CN112150972B (en) | Image compensation method and device and display device | |
| JP2001229390A (en) | Method and device for changing pixel image into segment | |
| US11030971B2 (en) | Display device and image processing method for color correction based on image type | |
| KR20200026421A (en) | Afterimage compensator, display device having the same, and method for driving display device | |
| KR102622151B1 (en) | Driving controller, display apparatus including the same and method of driving display panel using the same | |
| JP5669599B2 (en) | Image processing apparatus and control method thereof | |
| CN114898706A (en) | Brightness compensation method and device of display screen and computer equipment | |
| KR20220049645A (en) | Afterimage compensating device and display device including the same | |
| CN113902624A (en) | Method for processing still image in image | |
| KR20110079317A (en) | Method of detection and correction of bad pixel | |
| CN114187219A (en) | Moving target shadow real-time elimination method based on red, green and blue double difference | |
| US11100842B2 (en) | Display panel, and method and device for driving display panel | |
| CN105261332A (en) | A method, system and apparatus for dynamic backlight local control liquid crystal display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |