CN114648526A

CN114648526A - Image dead pixel processing method, storage medium, electronic device and system

Info

Publication number: CN114648526A
Application number: CN202210538047.8A
Authority: CN
Inventors: 李群; 杨敏; 陈武; 帅敏
Original assignee: Wuhan Jingce Electronic Group Co Ltd; Wuhan Jingli Electronic Technology Co Ltd
Current assignee: Wuhan Jingce Electronic Group Co Ltd; Wuhan Jingli Electronic Technology Co Ltd
Priority date: 2022-05-18
Filing date: 2022-05-18
Publication date: 2022-06-21

Abstract

The application relates to an image dead pixel processing method, a storage medium, an electronic device and a system, wherein the method comprises the following steps: carrying out image equalization processing on a group of pictures shot in a preset scene to obtain an average value image; comparing the pixel value of each channel of each pixel point of the mean image with the corresponding channel threshold value, finding out a dead pixel, and marking a label of a corresponding type on the dead pixel based on the type of the channel with which the pixel point is judged to be the dead pixel; processing each dead pixel according to a preset rule; wherein, the preset rule comprises: selecting a defective point from defective points of the same type of label as a central point, using the label as a main label, forming a square block by the central point and pixel points around the central point, and if at least one good point exists in the square block, repairing the central point by combining the pixel values of the good points; the good point is a normal pixel point or a bad point, but the label of the good point is different from that of the main label. According to the method and the device, the dead pixel can be repaired, so that the visual effect of the image is improved.

Description

Image dead pixel processing method, storage medium, electronic device and system

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to a method, a storage medium, an electronic device, and a system for processing an image dead pixel.

Background

Due to the current manufacturing process level, the image collected by the image sensor is almost inevitably dead-spotted, and when the image sensor device is used for a long time, more dead spots are generated on the image due to the use of the image sensor. The appearance of dead pixels not only reduces the visual effect of the image, but also loses some important image information.

Therefore, how to detect and process the image dead pixel is a problem which is troublesome in the field of image processing.

Disclosure of Invention

The embodiment of the application provides an image dead pixel processing method, a storage medium, an electronic device and a system, which can repair a dead pixel to improve the visual effect of an image.

In a first aspect, a method for processing an image dead pixel is provided, which includes:

carrying out image equalization processing on a group of pictures shot in a preset scene to obtain an average value image;

comparing the pixel value of each channel of each pixel point of the mean image with the corresponding channel threshold value, finding out a dead pixel, and marking a label of a corresponding type on the dead pixel based on the type of the channel with which the pixel point is judged to be the dead pixel;

processing each dead pixel according to a preset rule;

wherein, the preset rule comprises: selecting a defective point from defective points of the same type of label as a central point, using the label as a main label, forming a square block by the central point and pixel points around the central point, and if at least one good point exists in the square block, repairing the central point by combining the pixel values of the good points; the good points are normal pixel points or dead points, but the labels of the good points are different from those of the main points.

In some embodiments, the preset scene is a dark field, and the dead pixel is a bright point;

or, the preset scene is a bright field, and the dead pixel is a dark dot.

In some embodiments, when the preset scene is a dark field, comparing the pixel value of each channel of each pixel point with the corresponding channel threshold value to find out a dead pixel, including:

comparing the pixel value of each channel of the pixel point with a corresponding channel threshold value;

if the pixel value of at least one channel is larger than the corresponding channel threshold value, the pixel point is a bright point;

otherwise, the pixel is a normal pixel.

In some embodiments, when the preset scene is a bright field, comparing the pixel value of each channel of each pixel point with the corresponding channel threshold value to find out a dead pixel, including:

if the pixel value of at least one channel is smaller than the corresponding channel threshold value, the pixel point is a dark point;

otherwise, the pixel point is a normal pixel point.

In some embodiments, the photograph is a color photograph;

the pixel point comprises an R channel, a G channel and a B channel;

the channel threshold comprises an R channel threshold, a G channel threshold and a B channel threshold;

based on the type of the channel for judging the pixel point as the dead pixel, the dead pixel is labeled with a label of a corresponding type, which comprises the following steps:

if the channel with the pixel point being the dead pixel is judged to be the R channel, a first label is marked on the dead pixel;

if the channel with the pixel point as the dead pixel is judged to be the G channel, a second label is marked on the dead pixel;

and if the channel with the pixel point as the dead pixel is judged to be the B channel, marking a third label on the dead pixel.

In some embodiments, the photograph is a black and white photograph;

the pixel point comprises a Y channel;

the channel threshold comprises a Y channel threshold.

In some embodiments, the repairing the center point by combining the pixel values of the good points includes:

and calculating the pixel value average value of the channel corresponding to the main label of each good point, and taking the average value as the pixel value of the channel corresponding to the main label of the central point.

In a second aspect, a storage medium is provided, the storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing any of the image dead pixel processing methods described above.

In a third aspect, an electronic device is provided, which includes a memory and a processor, where the memory stores a computer program running on the processor, and the processor implements any one of the image dead pixel processing methods when executing the computer program.

In a fourth aspect, an image dead pixel processing system is provided, which includes:

an image processing module to: carrying out image equalization processing on a group of pictures shot in a preset scene to obtain an average image;

a dead pixel determination module for: comparing the channel pixel value of each pixel point of the mean image with the corresponding channel threshold value to find out a dead pixel, and marking a label of a corresponding type on the dead pixel based on the type of the channel of which the pixel point is judged to be the dead pixel;

a dead-spot processing module to: processing each dead pixel according to a preset rule;

The beneficial effect that technical scheme that this application provided brought includes:

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a flowchart of an image dead pixel processing method according to an embodiment of the present disclosure;

fig. 2 is a bright point judgment flowchart provided in the embodiment of the present application;

fig. 3 is a flow chart of dark spot determination provided in the embodiment of the present application;

fig. 4 is a block diagram of an image dead pixel processing system according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

For a clearer understanding of the present application, three names appearing in the present application are now explained:

and (3) dead pixel: the pixel points which do not accord with the corresponding threshold value requirement are just opposite to the normal pixel points.

Pixel point: the method comprises normal pixel points and abnormal pixel points, namely dead pixels, namely, all the pixel points of a photo are normal pixel points except the dead pixels.

Good point: the method comprises normal pixel points and also comprises dead pixels, but the labels of the dead pixels are different from those of the main labels.

Referring to fig. 1, an embodiment of the present application provides an image dead pixel processing method, including the following steps:

101: the method comprises the steps of carrying out image equalization processing on a group of pictures shot in a preset scene to obtain an average value image.

It should be noted that the preset scene may be a dark field or a bright field, and the selection of the dark field or the bright field may be performed according to actual detection requirements.

For example, to detect whether a bright spot exists in the camera, a preset scene may be selected as a dark field, and the detected dead spot is the bright spot.

For another example, to detect whether a dark spot exists in the camera, the preset scene may be selected as a bright field, and the detected dead spot is the dark spot.

It should be noted that, when the camera is used for taking a picture, 10 pictures or more or less pictures may be selected to be taken, and the specific number is determined according to actual detection needs.

The camera is divided into a black-and-white camera and a color camera, and the taken pictures are also distinguished from black-and-white pictures and color pictures.

When a black-and-white camera is used for shooting, the obtained picture is a black-and-white picture, and when a color camera is used for shooting, the obtained picture is a color picture.

The principle of the image equalization processing method is the same whether it is a black-and-white photograph or a color photograph.

If a black and white picture has 10 x 10 pixels, a group of pictures has 15.

Because the pixel point of the black-white picture has one channel, namely the Y channel. When the image equalization processing is performed, the specific method is as follows:

adding Y-channel pixel values of pixel points with coordinates (1, 1) in 15 pictures to calculate an average value, and taking the average value as the Y-channel pixel value of the pixel point with coordinates (1, 1) on an average image; adding Y-channel pixel values of pixel points with coordinates (1, 2) in 15 pictures to calculate an average value, and taking the average value as the Y-channel pixel value of the pixel point with coordinates (1, 2) on an average image; and so on, the black and white mean image can be obtained.

If the color picture has 10 x 10 pixels, a group of pictures has 15.

The pixel points of the color photos have three channels, namely an R channel, a G channel and a B channel. When the image equalization processing is performed, the specific method is as follows:

adding R channel pixel values of pixel points with coordinates of (1, 1) in 15 pictures to calculate a mean value, and taking the mean value as the R channel pixel value of the pixel point with coordinates of (1, 1) on a mean value image; adding the G channel pixel values of the pixel points with the coordinates of (1, 1) in the 15 pictures to calculate an average value, and taking the average value as the G channel pixel value of the pixel point with the coordinates of (1, 1) on an average image; finally, adding the B channel pixel values of the pixel points with the coordinates of (1, 1) in the 15 pictures to calculate the average value, and taking the average value as the B channel pixel value of the pixel point with the coordinates of (1, 1) on the average image; adding R channel pixel values of pixel points with coordinates (1, 2) in 15 pictures to calculate an average value, and taking the average value as the R channel pixel value of the pixel point with coordinates (1, 2) on an average image; adding the G channel pixel values of the pixel points with the coordinates of (1, 2) in the 15 pictures to calculate an average value, and taking the average value as the G channel pixel value of the pixel point with the coordinates of (1, 2) on an average image; finally, adding the B channel pixel values of the pixel points with the coordinates of (1, 2) in the 15 pictures to calculate an average value, and taking the average value as the B channel pixel value of the pixel point with the coordinates of (1, 2) on an average image; and so on, the color mean image can be obtained.

102: and comparing the pixel value of each channel of each pixel point of the mean image with the corresponding channel threshold value to find out the dead pixel, and marking the dead pixel with a label of a corresponding type based on the type of the channel of which the pixel point is judged to be the dead pixel.

Since the preset scene may be a dark field or a bright field, there is a certain difference in judgment when finding out a dead pixel.

For example, as shown in fig. 2, if the preset scene is a dark field, comparing the pixel value of each channel of each pixel point with the corresponding channel threshold value to find out a dead pixel, the method includes the following steps:

201: and comparing the pixel value of each channel of the pixel point with the corresponding channel threshold value, and judging whether the pixel value of at least one channel is greater than the corresponding channel threshold value.

202: if yes, the pixel point is a bright point.

203: otherwise, the pixel point is a normal pixel point.

For another example, referring to fig. 3, if the preset scene is a bright field, comparing the pixel value of each channel of each pixel with the corresponding channel threshold value to find out a dead pixel, including the following steps:

301: and comparing the pixel value of each channel of the pixel point with the corresponding channel threshold value, and judging whether the pixel value of at least one channel is smaller than the corresponding channel threshold value.

302: if yes, the pixel point is a dark point.

303: otherwise, the pixel point is a normal pixel point.

It should be noted that, although both dark field and bright field are compared with the channel threshold, the channel threshold of the dark field is generally different from the channel threshold of the bright field.

The picture has color and black and white, the pixel point of the color picture has three channels of R channel, G channel and B channel, and the pixel point of the black and white picture only has Y channel.

There is a certain difference in the channel threshold.

Specifically, the camera is a black-and-white camera, and when the picture is a black-and-white picture, only one Y-channel threshold, whether a dark spot or a bright spot, is used for size judgment by using the Y-channel pixel value of the pixel point and the Y-channel threshold.

When the camera is a color camera and the picture is a color picture, three channel thresholds are provided, namely an R channel threshold, a G channel threshold and a B channel threshold; whether the pixel is a dark spot or a bright spot, during judgment, the R channel pixel value and the R channel threshold value are subjected to size judgment, the G channel pixel value and the G channel threshold value are subjected to size judgment, and the B channel pixel value and the B channel threshold value are subjected to size judgment.

Similarly, there is a certain difference in labeling.

For black and white photos, only one Y channel is provided, so that only one label is provided when the label is printed, such as recording as a Y label, the label printing is mainly used for distinguishing under the condition of multiple channels, and for black and white photos, the pixel point only has one channel and does not need to be distinguished, so that the label printing is not needed.

However, in the case of a color photograph, since there are three channels, the size of the pixel value is determined, and if there is one that does not meet the requirement, it can be determined as a dead pixel.

Generally, if a pixel point has a pixel value of only one channel that is not satisfactory, the label is unique at this time, for example:

if the channel with the pixel point as the dead pixel is judged to be the R channel, a first label is marked on the dead pixel;

It should be noted that, the forms of the first tag, the second tag, and the third tag may be selected in many ways, for example, for convenience of identification and correspondence with a channel, the first tag is denoted as an R tag, the second tag is denoted as a G tag, and the third tag is denoted as a B tag. For another example, when performing process identification in a computer, the first label may be represented by the numeral 0, the second label may be represented by the numeral 1, and the third label may be represented by the numeral 2.

For ease of understanding, hereinafter in this application, the first label is denoted by the R label, the second label is denoted by the G label, and the third label is denoted by the B label.

However, if the pixel value of more than one channel of a pixel does not meet the requirement, the label is not unique at this time, for example:

and if the channel with the pixel point as the dead pixel is judged to have the R channel and the G channel, marking an R label and a G label on the dead pixel.

And if the channel with the pixel point as the dead pixel is judged to have the R channel and the B channel, marking an R label and a B label on the dead pixel.

And if the channel with the pixel point as the dead pixel is judged to have a B channel and a G channel, marking a B label and a G label on the dead pixel.

And if the channels with the pixel points as the dead points are judged to have the R channel, the G channel and the B channel, marking an R label, a G label and a B label on the dead points.

103: processing each dead pixel according to a preset rule; wherein, the preset rule comprises: selecting a defective point from defective points of the same type of label as a central point, using the label as a main label, forming a square block by the central point and pixel points around the central point, and if at least one good point exists in the square block, repairing the central point by combining the pixel values of the good points; the good point is a normal pixel point or a bad point, but the label of the good point is different from that of the main label.

In step 103, the number of pixels constituting a square is N = (2N + 1)²Wherein n =1, 2, 3. For example, the pixel may be a square of 9 pixels, or a square of 25 pixels. This ensures that the selected bad point is centered.

In step 103, if all the pixel points in the square, including the central point, are dead points, and the labels of the dead points are the same as the main labels, it indicates that the central point is a closed point, and the dead points of the square are connected into a piece and cannot be repaired.

And as long as one good point exists, the central point can be repaired.

It should be noted that in the case of color photographs, there may be a plurality of labels due to the defect. Therefore, in order to smoothly process the dead pixel, the dead pixel is processed according to the type label and then the dead pixel of the type label.

For example, if the center point is marked with the R tag and the G tag, the R channel corresponding to the R tag may be repaired first, and then the G channel corresponding to the G tag may be repaired, or the G channel corresponding to the G tag may be repaired first, and then the R channel corresponding to the R tag may be repaired.

And repairing the center point by combining the pixel values of the good points, specifically comprising the following steps of:

For example, among all the dead spots, there are dead spots marked with R labels, dead spots marked with G labels, and dead spots marked with B labels.

According to the principle that a type label is processed by the dead pixel of the type label, the dead pixel marked with the R label is found out from all the dead pixels, one dead pixel is selected from the dead pixels of the R labels to be used as a central point, the R label is used as a main label, if the central point has the R label, the G label is also provided, and the square block comprises 9 pixel points.

Because the R label of selection this moment, so repair the main label of central point promptly the R passageway that the R label corresponds, assume, among all the other 8 pixel points, 3 pixel points a, B, c are normal pixel points, 1 pixel point d is the dead pixel and has beaten the B label, 1 pixel point e is the dead pixel and has beaten G label and B label, 1 pixel point f is the dead pixel and has beaten the G label, 1 pixel point G is the dead pixel and has beaten the R label, 1 pixel point h is the dead pixel and has beaten R label and G label.

According to the definition of the good points, the following points are found:

3 normal pixel points a, b and c belong to good points.

The 1B-labeled bad spot d belongs to a good spot because the bad spot d does not have an R-label.

Although the bad point e is marked with the G label and the B label, and the central point is marked with the R label and the G label which have a common G label, the central point is selected from the R label at the moment, and the main label is the R label, the label of the bad point e is different from that of the main label.

The 1G-labeled bad spot f belongs to a good spot because bad spot d does not have an R label.

The 1R-labeled bad spot g does not belong to a good spot because it is identical to the main label.

The 1 bad spot h marked with an R-label and a G-label does not belong to a good spot because he has one label that is an R-label, which is the same as the main label, and therefore it does not belong to a good spot.

At this time, the R channel pixel values of the 6 pixels a, b, c, d, e, and f are added to calculate an average value, and the average value is used as the pixel value of the R channel at the center point. Thereby realizing the repair of the dead pixel of the central point.

And after the R label type dead pixel repairing is finished, repairing the G label type dead pixel and the B label type dead pixel according to the principle.

Therefore, when one defective pixel has a plurality of labels, the defective pixel does not belong to a good pixel as long as one of the labels is the same as the main label; and if all the tags are different from the main tag, the bad point belongs to a good point.

Corresponding to the image dead pixel processing method, an embodiment of the present application further provides a storage medium, where a computer program is stored on the storage medium, and the computer program, when executed by a processor, implements the steps of the foregoing embodiments. It should be noted that the storage media of the embodiments of the present application may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-readable storage medium may be, for example but not limited to: an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

Corresponding to the image dead pixel processing method, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program running on the processor, and the processor implements the steps of the above embodiments when executing the computer program. It should be noted that the electronic device includes a memory and a processor, where the memory stores a computer program running on the processor, and the processor executes the computer program to implement the steady moving terminal display method of the foregoing embodiment.

Referring to fig. 4, an embodiment of the present application further provides an image dead pixel processing system, which includes an image processing module, a dead pixel determining module, and a dead pixel processing module.

The image processing module is used for: carrying out image equalization processing on a group of pictures shot in a preset scene to obtain an average image;

the dead pixel judgment module is used for: comparing the pixel value of each channel of each pixel point of the mean image with the corresponding channel threshold value, finding out a dead pixel, and marking a label of a corresponding type on the dead pixel based on the type of the channel with which the pixel point is judged to be the dead pixel;

the dead pixel processing module is used for: processing each dead pixel according to a preset rule;

Therefore, the image dead pixel processing scheme provided by the application can identify and repair the dead pixel so as to improve the visual effect of the image.

In the description of the present application, it should be noted that the terms "upper", "lower", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, which are only for convenience in describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and operate, and thus, should not be construed as limiting the present application. Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.

It is noted that, in the present application, relational terms such as "first" and "second", and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The previous description is only an example of the present application, and is provided to enable any person skilled in the art to understand or implement the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for processing an image dead pixel, comprising:

carrying out image equalization processing on a group of pictures shot in a preset scene to obtain an average image;

processing each dead pixel according to a preset rule;

2. The image dead-spot processing method according to claim 1, characterized in that:

the preset scene is a dark field, and the dead spots are bright spots;

or, the preset scene is a bright field, and the dead pixel is a dark dot.

3. The image dead-spot processing method according to claim 2, characterized in that:

when the preset scene is a dark field, comparing the pixel value of each channel of each pixel point with the corresponding channel threshold value, and finding out dead pixels, the method comprises the following steps:

otherwise, the pixel point is a normal pixel point.

4. The image dead pixel processing method according to claim 2, wherein:

when the preset scene is a bright field, comparing the pixel value of each channel of each pixel point with the corresponding channel threshold value, and finding out dead pixels, the method comprises the following steps:

otherwise, the pixel point is a normal pixel point.

5. The image dead pixel processing method according to claim 1, characterized in that:

the photo is a color photo;

the pixel point comprises an R channel, a G channel and a B channel;

based on the type of the channel with the pixel points as the dead pixels, labeling the dead pixels with labels of corresponding types, comprising the following steps:

6. The image dead pixel processing method according to claim 1, characterized in that:

the photo is a black and white photo;

the pixel point comprises a Y channel;

the channel threshold comprises a Y channel threshold.

7. The image dead-spot processing method according to claim 1, characterized in that:

and (3) repairing the central point by combining the pixel values of the good points, wherein the repairing comprises the following steps:

8. A storage medium having a computer program stored thereon, characterized in that: the computer program, when executed by a processor, implements the image dead pixel processing method of any one of claims 1 to 7.

9. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program that runs on the processor, characterized in that: the processor, when executing the computer program, implements the image dead pixel processing method of any one of claims 1 to 7.

10. An image dead spot processing system, comprising:

a dead pixel determination module for: comparing the pixel value of each channel of each pixel point of the mean image with the corresponding channel threshold value, finding out a dead pixel, and marking a label of a corresponding type on the dead pixel based on the type of the channel with which the pixel point is judged to be the dead pixel;