CN108810320A - Picture quality method for improving and device - Google Patents

Picture quality method for improving and device Download PDF

Info

Publication number
CN108810320A
CN108810320A CN201810558182.2A CN201810558182A CN108810320A CN 108810320 A CN108810320 A CN 108810320A CN 201810558182 A CN201810558182 A CN 201810558182A CN 108810320 A CN108810320 A CN 108810320A
Authority
CN
China
Prior art keywords
noise reduction
pixel
luminance component
histogram
component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810558182.2A
Other languages
Chinese (zh)
Other versions
CN108810320B (en
Inventor
王露
赵瑞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Sensetime Technology Co Ltd
Original Assignee
Shenzhen Sensetime Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Sensetime Technology Co Ltd filed Critical Shenzhen Sensetime Technology Co Ltd
Priority to CN201810558182.2A priority Critical patent/CN108810320B/en
Publication of CN108810320A publication Critical patent/CN108810320A/en
Application granted granted Critical
Publication of CN108810320B publication Critical patent/CN108810320B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/21Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)

Abstract

A kind of picture quality method for improving of offer of the embodiment of the present invention and device.This method includes:Obtain the corresponding noise reduction histogram of luminance component figure of original image;The brightness Distribution value of edge pixel point in noise reduction histogram instruction brightness component map;Noise reduction is carried out to luminance component figure according to noise reduction histogram and obtains noise reduction component map;The correction factor of each pixel in original image is obtained according to noise reduction component map and luminance component figure;According to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to original image.Picture quality method for improving and device provided in an embodiment of the present invention, calculation amount is few, and processing speed is fast.

Description

Picture quality method for improving and device
Technical field
The present invention relates to image processing techniques more particularly to a kind of picture quality method for improving and device.
Background technology
With constantly bringing forth new ideas and fast-developing, important information source of the video image as human knowledge and exploration for science and technology Every subjects and field, such as traffic monitoring, medical helping, nighttime driving, film making are spread all over.But video image It is shooting in transmission process, is inevitably being influenced by shooting environmental, capture apparatus and generate noise, affected and regard The quality of frequency image.Particularly, when carrying out the processing such as contrast enhancing, feature extraction to video image, it can also make noise It is amplified, thus video image denoising is the basis that video image quality is promoted, the noise reduction of video image increasingly becomes image The research hotspot of process field.
To improve video image quality, the method that the performance for improving capture apparatus can be used such as uses big photosensitive element With big lens aperture etc., but this method cost is higher, and image is made an uproar in the case of night or other illumination condition differences Sound reduces degree unobvious.To avoid the above problem, the prior art generally use filter (such as median filter, mean filter Device, Wiener filter etc.) noise reduction process is carried out one by one to the pixel in video image, to reduce picture noise.But it utilizes Filter reduce picture noise method, there are calculation amounts it is larger, algorithm is complex, processor speed is slow the problems such as,
Invention content
A kind of picture quality method for improving of offer of the embodiment of the present invention and device, to solve conventional images increased quality side The problems such as calculation amount present in method is larger, algorithm is complex, processor speed is slow.
In a first aspect, the embodiment of the present invention provides a kind of picture quality method for improving, including:
Obtain the corresponding noise reduction histogram of luminance component figure of original image;The noise reduction histogram indicates the brightness point The brightness Distribution value of edge pixel point in spirogram;
Noise reduction is carried out to the luminance component figure according to the noise reduction histogram and obtains noise reduction component map;
The amendment of each pixel in the original image is obtained according to the noise reduction component map and the luminance component figure Coefficient;
According to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to the original image.
In a kind of feasible embodiment of first aspect, the corresponding drop of luminance component figure for obtaining original image It makes an uproar histogram, including:
Obtain the edge pixel point in the luminance component figure;
According to the brightness value of the edge pixel point, the number of the corresponding edge pixel point of each brightness value is obtained;
According to the number of the corresponding edge pixel point of each brightness value, the noise reduction histogram is obtained.
In a kind of feasible embodiment of first aspect, the edge pixel obtained in the luminance component figure Point, including:
The all pixels point in the luminance component figure is traversed, for any pixel point in the luminance component figure, if The absolute value of the difference of the brightness value of the pixel and the brightness value of neighbor pixel is more than preset difference value, it is determined that the picture Vegetarian refreshments is edge pixel point;
Wherein, the neighbor pixel is to be less than pre-determined distance at a distance from the pixel in the luminance component figure Arbitrary pixel.
It is described according to the noise reduction component map and the luminance component in a kind of feasible embodiment of first aspect Figure obtains the correction factor of each pixel in the original image, including:
According to the second pixel in the brightness value of the first pixel in the noise reduction component map and the luminance component figure Brightness value ratio, obtain third pixel correction factor;
Wherein, the third pixel is any pixel point in the original image, and first pixel is described There is in noise reduction component map with the third pixel pixel of same coordinate;Second pixel is the luminance component There is in figure with the third pixel pixel of same coordinate.
In a kind of feasible embodiment of first aspect, it is described according to the noise reduction histogram to the luminance component Figure carries out noise reduction and obtains noise reduction component map, including:
The normalization histogram for obtaining the noise reduction histogram is obtained according to the normalization histogram and differential matrix Pixel-map vector;
According to luminance component figure described in the pixel-map vector sum, the noise reduction component map is obtained.
In a kind of feasible embodiment of first aspect, the correction factor according to each pixel, to institute It states original image progress noise reduction and obtains the image after noise reduction, including:
According to the correction factor of each pixel, to corresponding each pixel in the chromatic component figure of the original image The value of point is modified, and obtains the chromatic component figure after noise reduction;
According to the luminance component figure after the noise reduction and the chromatic component figure after the noise reduction, the image after noise reduction is obtained.
In a kind of feasible embodiment of first aspect, the correction factor according to each pixel, to institute It states original image progress noise reduction and obtains the image after noise reduction, including:
According to the correction factor of each pixel, respectively to the red component figure of the original image, green component figure The value of corresponding pixel is modified in blue component figure, obtains the image after noise reduction.
In a kind of feasible embodiment of first aspect, the corresponding drop of luminance component figure for obtaining original image It makes an uproar after histogram, the method further includes:
The noise reduction histogram is modified based on logarithmic mapping, obtains correcting histogram;
It is described that noise reduction component map is obtained to luminance component figure progress noise reduction according to the noise reduction histogram, including:
Noise reduction is carried out to the luminance component figure according to the amendment histogram and obtains noise reduction component map.
Second aspect, the embodiment of the present invention also provides a kind of picture quality lifting device, for executing above-mentioned first aspect In picture quality method for improving in any feasible embodiment.Picture quality lifting device, including:
Noise reduction histogram acquisition module, the corresponding noise reduction histogram of luminance component figure for obtaining original image;It is described Noise reduction histogram indicates the brightness Distribution value of the edge pixel point in the luminance component figure;
Noise reduction component map acquisition module carries out noise reduction to the luminance component figure according to the noise reduction histogram and obtains noise reduction Component map;
Correction factor acquisition module, for obtaining the original graph according to the noise reduction component map and the luminance component figure The correction factor of each pixel as in;
Noise reduction module carries out noise reduction to the original image and is dropped for the correction factor according to each pixel Image after making an uproar.
In a kind of feasible embodiment of second aspect,
The noise reduction histogram acquisition module includes:Edge pixel point acquiring unit, edge pixel point number acquiring unit With noise reduction histogram acquiring unit;
The edge pixel point acquiring unit, for obtaining the edge pixel point in the luminance component figure;
The edge pixel point number acquiring unit obtains each described for the brightness value according to the edge pixel point The number of the corresponding edge pixel point of brightness value;
The noise reduction histogram acquiring unit is obtained for the number according to the corresponding edge pixel point of each brightness value Take the noise reduction histogram.
In a kind of feasible embodiment of second aspect, the edge pixel point acquiring unit is specifically used for,
The all pixels point in the luminance component figure is traversed, for any pixel point in the luminance component figure, if The absolute value of the difference of the brightness value of the pixel and the brightness value of neighbor pixel is more than preset difference value, it is determined that the picture Vegetarian refreshments is edge pixel point;
Wherein, the neighbor pixel is to be less than pre-determined distance at a distance from the pixel in the luminance component figure Arbitrary pixel.
In a kind of feasible embodiment of second aspect, the correction factor acquisition module is specifically used for,
According to the second pixel in the brightness value of the first pixel in the noise reduction component map and the luminance component figure Brightness value ratio, obtain third pixel correction factor;
Wherein, the third pixel is any pixel point in the original image, and first pixel is described There is in noise reduction component map with the third pixel pixel of same coordinate;Second pixel is the luminance component There is in figure with the third pixel pixel of same coordinate.
In a kind of feasible embodiment of second aspect, the noise reduction component map acquisition module includes:Pixel-map Vectorial acquiring unit and noise reduction component map acquiring unit;
The pixel-map vector acquiring unit, the normalization histogram for obtaining the noise reduction histogram, according to institute Normalization histogram and differential matrix are stated, pixel-map vector is obtained;
The noise reduction component map acquiring unit, for according to luminance component figure described in the pixel-map vector sum, obtaining The noise reduction component map.
In a kind of feasible embodiment of second aspect, the noise reduction module includes:Scheme after amending unit and noise reduction As acquiring unit;
The amending unit, for the correction factor according to each pixel, to the chromatic component of the original image The value of corresponding each pixel in figure is modified, and obtains the chromatic component figure after noise reduction;
Image acquisition unit after the noise reduction, for according to the luminance component figure after the noise reduction and the color after the noise reduction Component map is spent, the image after noise reduction is obtained.
In a kind of feasible embodiment of second aspect, the noise reduction module is specifically used for,
According to the correction factor of each pixel, respectively to the red component figure of the original image, green component figure The value of corresponding pixel is modified in blue component figure, obtains the image after noise reduction.
In a kind of feasible embodiment of second aspect, described image increased quality device further includes:
Histogram acquisition module is corrected, the noise reduction histogram is modified for being based on logarithmic mapping, is corrected Histogram;
The noise reduction component map acquisition module is specifically used for, and is carried out to the luminance component figure according to the amendment histogram Noise reduction obtains noise reduction component map.
The third aspect, the embodiment of the present invention also provide a kind of electronic equipment, including memory, processor and are stored in Program in reservoir, described program are configured to be executed by processor, and processor realizes above-mentioned first party when executing described program In face the step of picture quality method for improving in any feasible embodiment.
Fourth aspect, the embodiment of the present invention also provide a kind of storage medium, and the storage medium is stored with computer program, The computer program realizes the image matter in any feasible embodiment in above-mentioned first aspect when being executed by processor The step of measuring method for improving.
Picture quality method for improving and device provided in an embodiment of the present invention, including:Obtain the luminance component of original image Scheme corresponding noise reduction histogram;The brightness Distribution value of edge pixel point in noise reduction histogram instruction brightness component map;And according to Noise reduction histogram carries out noise reduction to luminance component figure and obtains noise reduction component map;It is obtained according to noise reduction component map and luminance component figure former The correction factor of each pixel in beginning image;According to the correction factor of each pixel, noise reduction is carried out to original image and is dropped Image after making an uproar.By obtaining the noise reduction histogram of luminance component figure, the noise of image is filtered out, restores to scheme according to noise reduction histogram Picture improves picture quality to obtain the image after noise reduction.Simultaneously as the mode of filtering image noise is straight using noise reduction The mode of square figure avoids and carries out point-by-point noise reduction based on each pixel, reduces calculation amount when image noise reduction, improve figure As the processing speed of noise reduction.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair Some bright embodiments for those of ordinary skill in the art without having to pay creative labor, can be with Obtain other attached drawings according to these attached drawings.
Fig. 1 is the flow diagram for the picture quality method for improving that the embodiment of the present invention one provides;
Fig. 2 is a kind of luminance component figure provided in an embodiment of the present invention;
Fig. 3 is the histogram schematic diagram of luminance component figure shown in Fig. 2;
Fig. 4 is the noise reduction histogram schematic diagram of luminance component figure shown in Fig. 2;
Fig. 5 is the flow diagram of picture quality method for improving provided by Embodiment 2 of the present invention;
Fig. 6 is the flow diagram for the picture quality method for improving that the embodiment of the present invention three provides;
Fig. 7 is the flow diagram for the picture quality method for improving that the embodiment of the present invention four provides;
Fig. 8 is the structural schematic diagram for the picture quality lifting device that the embodiment of the present invention one provides;
Fig. 9 is the structural schematic diagram of picture quality lifting device provided by Embodiment 2 of the present invention;
Figure 10 is the structural schematic diagram for the picture quality lifting device that the embodiment of the present invention three provides;
Figure 11 is the structural schematic diagram for the picture quality lifting device that the embodiment of the present invention four provides;
Figure 12 is the structural schematic diagram for the picture quality lifting device that the embodiment of the present invention five provides;
Figure 13 is the structural schematic diagram for the electronic equipment that the embodiment of the present invention one provides.
Specific implementation mode
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art The every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Technical solution provided by the invention is illustrated with reference to specific embodiment.
On the one hand the embodiment of the present invention provides a kind of picture quality method for improving.Fig. 1 is what the embodiment of the present invention one provided The flow diagram of picture quality method for improving.The present embodiment carries out image noise reduction on the luminance component figure of image, obtains first The noise reduction histogram of the luminance component figure of original image is taken, and then luminance component figure is carried out at noise reduction according to noise reduction histogram Reason, obtains the image after noise reduction.The executive agent of the present embodiment can be computer, software, integrated circuit etc..As shown in Figure 1, Picture quality method for improving includes:
S101, the corresponding noise reduction histogram of luminance component figure for obtaining original image.
Wherein, the brightness Distribution value of the edge pixel point in noise reduction histogram instruction brightness component map.
Illustratively, original image can receive for the image or picture quality lifting device that camera is shot Image.There may be the big problems of noise for original image so that picture quality is relatively low.Particularly, in relatively low illumination item Under part, such as night, the image shot, there are noises it is big, contrast is low, brightness is partially dark the shortcomings of, figure proposed by the present invention Image quality amount method for improving is for solving the problems, such as that original image noise is larger.
Illustratively, image is made of MxN pixel, and M and N are positive integer, and M is the pixel that image includes per a line Number, N be image it is each arrange include pixel number.The format of original image can be YUV color space formats or RGB image format.
When the format of original image is YUV color space formats, the value of each pixel includes tri- points of Y, U, V Amount, Y indicate the brightness (Luminance) of pixel, also referred to as grayscale value.And U and V indicates the coloration of pixel (Chrominance), coloration instruction colors of image and saturation degree.Therefore, original image can be by tri- MxN sizes of Y, U, V Matrix indicates.Wherein, Y[MxN]For the luminance component figure of original image, U[MxN]And V[MxN]For the chromatic component figure of original image.
When the format of original image is RGB image format, the value of each pixel includes tri- components of R, G, B.R tables Show that red (Red) component of pixel, G indicate that green (Green) component of pixel, B indicate the blue (Blue) of pixel Miscellaneous color can be obtained by using the superposition of different ratios between each other in component, tri- components of R, G, B.Therefore, Original image can be indicated by the matrix of tri- MxN sizes of R, G, B.Wherein, R[MxN]For the red component figure of original image, G[MxN]For the green component figure of original image, B[MxN]For the blue component figure of original image.
It in this case, can be first to original graph before the luminance component figure and chromatic component figure for obtaining original image As carrying out format conversion, i.e., the image of rgb format is converted to the image of yuv format, to obtain the brightness point of original image Spirogram and chromatic component figure.Optionally, the formula of format conversion is specific as follows shown:
Y[MxN]=T (1,1) R[MxN]+T(1,2)·G[MxN]+T(1,3)·B[MxN]Formula 1
U[MxN]=T (2,1) R[MxN]+T(2,2)·G[MxN]+T(2,3)·B[MxN]+ 128 formula 2
V[MxN]=T (3,1) R[MxN]+T(3,2)·G[MxN]+T(3,3)·B[MxN]+ 128 formula 3
Wherein, T is the transformation matrix of 3x3.
Optionally, the format of original image can also be the extended formattings such as CMYK, only need to be in the brightness for obtaining original image Before component map and chromatic component figure, the format of original image is detected first, is then adopted according to the format of original image The format of original image is converted with corresponding format conversion formula.
Illustratively, after getting luminance component figure, the noise reduction histogram of luminance component figure is obtained.Specifically, Fig. 2 is A kind of luminance component figure provided in an embodiment of the present invention.Fig. 3 is the histogram schematic diagram of luminance component figure shown in Fig. 2.It is exemplary , histogram provides the value distribution situation of each pixel of image, gives the whole description of all values.Such as Fig. 3 institutes Show, abscissa numerical value represents the value of the pixel in image, and Y value represents each value in the picture Pixel sum.Histogram can be indicated by an one-dimensional vector.In view of each pixel of image value range be [0, 255], which includes 256 elements.
The embodiment of the present invention provides a kind of acquisition methods of noise reduction histogram, during obtaining noise reduction histogram, filter In addition to the noise in luminance component figure.The brightness Distribution value feelings of edge pixel point in noise reduction histogram only instruction brightness component map Condition.Wherein, edge pixel point is the pixel for being more than preset difference value with the brightness value difference of neighbor pixel in luminance component figure Point.Fig. 4 is the noise reduction histogram schematic diagram of luminance component figure shown in Fig. 2.As shown in figure 4, abscissa numerical value represents edge picture The value of vegetarian refreshments, Y value represent edge pixel point sum of each value in luminance component figure.Illustratively, Noise reduction histogram can also be indicated by an one-dimensional vector.It, should in view of the value range of each pixel of image is [0,255] One-dimensional vector includes 256 elements.
S102, noise reduction component map is obtained to luminance component figure progress noise reduction according to noise reduction histogram.
Illustratively, after acquiring noise reduction histogram, luminance component figure is restored according to noise reduction histogram and obtains noise reduction Component map.At this point, due to not including the noise information in luminance component figure in noise reduction histogram, filtered out so as to obtain one The noise reduction component map of noise.
S103, the correction factor that each pixel in original image is obtained according to noise reduction component map and luminance component figure.
Illustratively, for including the original image of MxN pixel, noise reduction component map and luminance component figure equally include MxN pixel, can be according to different values of the pixel at same position in noise reduction component map and luminance component figure, really The fixed correction factor to each pixel.
Optionally, the correction factor for obtaining each pixel in original image is specifically as follows:According in noise reduction component map The ratio of the brightness value of first pixel and the brightness value of the second pixel in luminance component figure obtains repairing for third pixel Positive coefficient.
Wherein, third pixel is any pixel point in original image, and the first pixel is in noise reduction component map with the Three pixels have the pixel of same coordinate;Second pixel is to have same coordinate with third pixel in luminance component figure Pixel.
It illustratively, can be by each picture according to the position of each pixel for including the luminance component figure of MxN pixel Vegetarian refreshments is denoted as f (i, j), wherein the value of i is [0, N-1], and the value of j is [0, M-1].
Illustratively, can be (i, j) by coordinate in noise reduction component map for any pixel point f (i, j) in original image Pixel value and luminance component figure in coordinate be (i, j) pixel value ratio as pixel f's (i, j) Correction factor.
S104, according to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to original image.
It illustratively, can be according to correction factor to each in original image after the correction factor for getting each pixel The value of pixel is modified, and obtains the image after noise reduction.
Illustratively, for by the difference of the format of the image after noise reduction, a kind of possible noise-reduced image acquisition modes are:
S11, according to the correction factor of each pixel, to corresponding each pixel in the chromatic component figure of original image Value is modified, and obtains the chromatic component figure after noise reduction;
S12, according to the chromatic component figure after the luminance component figure and noise reduction after noise reduction, obtain the image after noise reduction.
It illustratively, can be according to the correction factor of each pixel, to color when needing to obtain the noise-reduced image of yuv format Each pixel in degree component map is modified, and obtains the chromatic component figure after noise reduction.According to after noise reduction luminance component figure and Chromatic component figure after noise reduction, you can obtain the image after noise reduction.
Alternatively possible noise-reduced image acquisition modes are:
According to the correction factor of each pixel, respectively to the red component figure of original image, green component figure and blue point The value of corresponding pixel in spirogram is modified, and obtains the image after noise reduction.
Illustratively, when needing to obtain the noise-reduced image of rgb format, can according to the correction factor of each pixel, for The red of each pixel, green, blue component are modified respectively, to obtain the image after noise reduction.
Illustratively, in the image after acquiring noise reduction, can also format conversion be carried out to the image after noise reduction so that The format of image after noise reduction is identical as the format of original image.
Picture quality method for improving provided in an embodiment of the present invention, including:The luminance component figure for obtaining original image corresponds to Noise reduction histogram;The brightness Distribution value of edge pixel point in noise reduction histogram instruction brightness component map;According to noise reduction histogram Figure carries out noise reduction to luminance component figure and obtains noise reduction component map;It is obtained in original image according to noise reduction component map and luminance component figure Each pixel correction factor;According to the correction factor of each pixel, the figure after noise reduction obtains noise reduction is carried out to original image Picture.By the noise reduction histogram of acquisition luminance component figure, the noise of image is filtered out, image is restored according to noise reduction histogram, to The image after noise reduction is obtained, picture quality is improved.Simultaneously as the mode of filtering image noise uses the side of noise reduction histogram Formula avoids and carries out point-by-point noise reduction based on each pixel, reduces calculation amount when image noise reduction, improve image noise reduction Processing speed.
Optionally, on the basis of any of the above-described embodiment, the embodiment of the present invention also provides a kind of picture quality method for improving, The process for obtaining noise reduction histogram is described in detail in the present embodiment.Fig. 5 is picture quality provided by Embodiment 2 of the present invention The flow diagram of method for improving.As shown in figure 5, picture quality method for improving includes:
Edge pixel point in S501, acquisition luminance component figure.
Optionally, the edge pixel point in the methods of edge detection, feature extraction acquisition luminance component figure can be used.
Optionally, to improve the acquisition efficiency of edge pixel point, the present invention provides a kind of edge pixel point detection algorithm.It should Algorithm includes mainly:
The all pixels point in luminance component figure is traversed, for any pixel point in luminance component figure, if pixel The absolute value of the difference of the brightness value of brightness value and neighbor pixel is more than preset difference value, it is determined that pixel is edge pixel Point;
Wherein, neighbor pixel is the arbitrary pixel for being less than pre-determined distance at a distance from pixel in luminance component figure Point.
It illustratively,, can will be each according to the position of each pixel by taking the luminance component figure comprising MxN pixel as an example Pixel is denoted as f (i, j), and the value of f (i, j) is the brightness value of pixel.
When whether judge pixel f (i, j) is edge pixel point, the brightness value of f (i, j) and f (i+p, j+q) may compare Whether difference is more than preset difference value, when the difference of f (i, j) and f (i+p, j+q) is more than preset difference value, then it is assumed that f (i, j) is side Edge pixel.Wherein, f (i+p, j+q) is the neighbor pixel of f (i, j), and the value of p and q can be (± r, ± r), (0, ± R), (± r, 0).Wherein, the value of r can be 1,2,3 equal numerical value.Preset difference value can be illustratively 1,2,3 equal numerical value.
S502, according to the brightness value of edge pixel point, obtain the number of the corresponding edge pixel point of each brightness value.
S503, according to the number of the corresponding edge pixel point of each brightness value, obtain noise reduction histogram.
Illustratively, if the value of f (i, j) is k, after determining that pixel f (i, j) is edge pixel point, by Hk's Value increases by 1.Wherein, k is the abscissa in histogram as shown in Figure 3 and Figure 4, and the value range of k is 0 to 255, HkTo take Value is the number of the edge pixel point of k, also the ordinate in histogram as shown in Figure 3 and Figure 4.By to luminance component Figure carries out point by point scanning, detects whether each pixel is marginal point, after determining that pixel is edge pixel point, changes Hk's Value, to obtain noise reduction histogram.
S504, noise reduction component map is obtained to luminance component figure progress noise reduction according to noise reduction histogram.
S505, the correction factor that each pixel in original image is obtained according to noise reduction component map and luminance component figure.
S506, according to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to original image.
Illustratively, S101, S102, S103 in S504, S505, S506 and embodiment illustrated in fig. 1 in the present embodiment In correlated characteristic it is identical, the present invention repeats no more this.
In picture quality method for improving provided in this embodiment, the edge pixel point in luminance component figure, root are obtained first According to the brightness value of edge pixel point, the number of the corresponding edge pixel point of each brightness value is counted, noise reduction histogram is obtained.The present invention In the picture quality method for improving that embodiment provides, the acquisition methods of noise reduction histogram are simple, and calculation amount is less, processing speed Soon.
Optionally, on the basis of any of the above-described embodiment, the embodiment of the present invention also provides a kind of picture quality method for improving, The process for restoring luminance component figure according to noise reduction histogram is described in detail in the present embodiment.Fig. 6 is the embodiment of the present invention three The flow diagram of the picture quality method for improving of offer.As shown in fig. 6, picture quality method for improving includes:
S601, the corresponding noise reduction histogram of luminance component figure for obtaining original image.
Illustratively, the S601 in the present embodiment is identical as the correlated characteristic in the S101 in embodiment illustrated in fig. 1, this hair It is bright that this is repeated no more.
S602, the normalization histogram for obtaining noise reduction histogram obtain pixel according to normalization histogram and differential matrix Map vector.
Illustratively, after acquiring noise reduction histogram H by the way of in any of the above-described embodiment, to noise reduction histogram Figure H is normalized.Illustratively, formula is specifically usedNoise reduction histogram H is normalized.Wherein, K For the maximum value 255 of pixel value.
Illustratively, normalization histogram is being obtainedAfterwards, according to formulaObtain pixel-map vector X.
Wherein, D is the differential matrix that size is KxK, as follows:
Wherein, pixel-map vector X can be illustratively a column vector for including 256 elements, and X is a mapping Function.+ 1 component X of kth in pixel-map vector XkIndicate the pixel for k by pixel value in the luminance component figure of original image Value be revised as pixel value Xk, by traversing all pixels point in luminance component image, to obtain noise reduction component map.Its In, 0≤k≤K.For example, the 1st component X in pixel-map vector X0It indicates pixel in the luminance component figure of original image The value for the pixel that value is 0 is revised as pixel value X0
S603, according to pixel-map vector sum luminance component figure, obtain noise reduction component map.
Illustratively, after getting pixel-map vector, by the picture that pixel value in the luminance component figure of original image is k It is X that element, which is mapped as pixel value,kPixel.
S604, the correction factor that each pixel in original image is obtained according to noise reduction component map and luminance component figure.
S605, according to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to original image.
Illustratively, S604, S605 in the present embodiment are identical as S102, S103 in embodiment illustrated in fig. 1, the present invention This is repeated no more.
The embodiment of the present invention provides a kind of picture quality method for improving, first according to noise reduction histogram and differential in this method Matrix obtains pixel-map vector;Then after obtaining noise reduction according to the luminance component figure of pixel-map vector sum original image Luminance component figure.Picture quality method for improving algorithm provided in an embodiment of the present invention is simple, and processing speed is very fast.
Optionally, on the basis of the above embodiments, the embodiment of the present invention also provides a kind of picture quality method for improving, this In embodiment after image noise reduction, also noise reduction histogram is modified based on logarithmic mapping, further promotes picture quality. Fig. 7 is the flow diagram for the picture quality method for improving that the embodiment of the present invention four provides.As shown in fig. 7, picture quality is promoted Method includes:
S701, the corresponding noise reduction histogram of luminance component figure for obtaining original image.
Illustratively, the S701 in the present embodiment is identical as the correlated characteristic in the S101 in embodiment illustrated in fig. 1, this hair It is bright that this is repeated no more.
S702, noise reduction histogram is modified based on logarithmic mapping, obtains correcting histogram.
Illustratively, consider that the pixel Distribution value of most of natural images concentrates on relatively narrow section, usually there is image Details is not clear enough, and especially for evening images, the value of pixel all concentrates in low intensity range, and such image is logical Normal visual effect is poor, and the histogram effect of this kind of image is usually that histogram distribution is more concentrated.Therefore histogram can be used The histogram of image is extended by modified method so that the value of each pixel is more distributed in image, is promoted with reaching The purpose of picture quality.
The embodiment of the present invention is modified noise reduction histogram using the logarithmic mapping mode for meeting human-eye visual characteristic, with The dynamic range of expanded images pixel value is to achieve the purpose that enhance image.
Illustratively, the mode of logarithmic mapping can specifically be realized according to formula y=cln (1+x), wherein x is input Value, c is default value, and y is output valve.This method can play enhancing image overall contrast ratio, promote image detail information Effect, enhanced image viewability work well.
Illustratively, the mode of logarithmic mapping specifically can be according to formulaIt realizes, Wherein, HmaxFor maximum value important in H, μ is to correct extent index, and HH indicates to correct histogram, HkIndicate kth+1 in H A component.
S703, noise reduction component map is obtained to luminance component figure progress noise reduction according to amendment histogram.
Illustratively, being obtained in noise reduction component map and embodiment illustrated in fig. 7 based on amendment histogram in the present embodiment Identical based on noise reduction histogram acquisition noise reduction component map principle, the present invention repeats no more this.
S704, the correction factor that each pixel in original image is obtained according to noise reduction component map and luminance component figure.
S705, according to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to original image.
Illustratively, S704, S705 in the present embodiment in embodiment illustrated in fig. 1 S102 and S103 it is identical, this hair It is bright that this is repeated no more.
Increased quality method provided in an embodiment of the present invention is also reflected based on logarithm after based on logarithm to image noise reduction It penetrates and noise reduction histogram is modified, further improve picture quality.
On the other hand the embodiment of the present invention also provides a kind of picture quality lifting device, for executing in above-mentioned Fig. 1 to Fig. 7 There is picture quality method for improving shown in any embodiment same or analogous technique effect, the present invention to repeat no more.
Fig. 8 is the structural schematic diagram for the picture quality lifting device that the embodiment of the present invention one provides.As shown in figure 8, image Increased quality device includes:
Noise reduction histogram acquisition module 801, the corresponding noise reduction histogram of luminance component figure for obtaining original image;Drop The brightness Distribution value of edge pixel point in histogram instruction brightness component map of making an uproar;
Noise reduction component map acquisition module 802 carries out noise reduction to luminance component figure according to noise reduction histogram and obtains noise reduction component Figure;
Correction factor acquisition module 803, it is each in original image for being obtained according to noise reduction component map and luminance component figure The correction factor of pixel;
Noise reduction module 804, for the correction factor according to each pixel, after obtaining noise reduction to original image progress noise reduction Image.
Illustratively, on the basis of embodiment shown in Fig. 8, Fig. 9 is that picture quality provided by Embodiment 2 of the present invention carries Rise the structural schematic diagram of device.As shown in figure 9, noise reduction histogram acquisition module 801 includes:Edge pixel point acquiring unit 8011, edge pixel point number acquiring unit 8012 and noise reduction histogram acquiring unit 8013;
Edge pixel point acquiring unit 8011, for obtaining the edge pixel point in luminance component figure;
Edge pixel point number acquiring unit 8012 obtains each brightness value pair for the brightness value according to edge pixel point The number for the edge pixel point answered;
Noise reduction histogram acquiring unit 8013 obtains drop for the number according to the corresponding edge pixel point of each brightness value It makes an uproar histogram.
Optionally, edge pixel point acquiring unit 8011 is specifically used for, and traverses all pixels point in luminance component figure, right Any pixel point in luminance component figure, if the absolute value of the difference of the brightness value of the brightness value and neighbor pixel of pixel More than preset difference value, it is determined that pixel is edge pixel point;
Wherein, neighbor pixel is the arbitrary pixel for being less than pre-determined distance at a distance from pixel in luminance component figure Point.
Optionally, correction factor acquisition module 803 is specifically used for, according to the brightness value of the first pixel in noise reduction component map With the ratio of the brightness value of the second pixel in luminance component figure, the correction factor of third pixel is obtained;
Wherein, third pixel is any pixel point in original image, and the first pixel is in noise reduction component map with the Three pixels have the pixel of same coordinate;Second pixel is to have same coordinate with third pixel in luminance component figure Pixel.
Illustratively, on the basis of Fig. 8 or embodiment illustrated in fig. 9, Figure 10 is the image that the embodiment of the present invention three provides The structural schematic diagram of increased quality device.As shown in Figure 10, noise reduction component map acquisition module 802 includes:Pixel-map vector obtains Take unit 8021 and noise reduction component map acquiring unit 8022;
Pixel-map vector acquiring unit 8021, the normalization histogram for obtaining noise reduction histogram, according to normalization Histogram and differential matrix obtain pixel-map vector;
Noise reduction component map acquiring unit 8022, for according to pixel-map vector sum luminance component figure, obtaining noise reduction component Figure.
Illustratively, on the basis of Fig. 8 illustrated embodiments any to Figure 10, Figure 11 is what the embodiment of the present invention four provided The structural schematic diagram of picture quality lifting device.As shown in figure 11, noise reduction module 804 includes:After amending unit 8041 and noise reduction Image acquisition unit 8042;
Amending unit 8041, for the correction factor according to each pixel, to pair in the chromatic component figure of original image The value for each pixel answered is modified, and obtains the chromatic component figure after noise reduction;
Image acquisition unit 8042 after noise reduction, for according to the chromatic component after the luminance component figure and noise reduction after noise reduction Figure, obtains the image after noise reduction.
Optionally, noise reduction module 804 can also be specifically used for, according to the correction factor of each pixel, respectively to original image Red component figure, green component figure and the corresponding pixel in blue component figure value be modified, after obtaining noise reduction Image.
Illustratively, in Fig. 8 to Figure 11 on the basis of any illustrated embodiment, Figure 12 is that the embodiment of the present invention five provides Picture quality lifting device structural schematic diagram.As shown in figure 12, picture quality lifting device further includes:
Histogram acquisition module 805 is corrected, the noise reduction histogram is modified for being based on logarithmic mapping, is repaiied Positive histogram;
Corresponding, noise reduction component map acquisition module 802 is specifically used for, and is dropped to luminance component figure according to histogram is corrected It makes an uproar to obtain noise reduction component map.
The embodiment of the present invention also provides a kind of electronic equipment, and Figure 13 is the knot for the electronic equipment that the embodiment of the present invention one provides Structure schematic diagram.As shown in figure 13, electronic equipment includes memory 1301, processor 1302 and is stored in memory 1301 Program, program are configured to be executed by processor 1302, and processor 1302 realizes the image as shown in Fig. 1 to 7 when executing program The step of increased quality method.
The embodiment of the present invention also provides a kind of storage medium, and storage medium is stored with computer program, computer journey It is realized when sequence is executed by processor as shown in Fig. 1 to 7 the step of picture quality method for improving.
The method in device and previous embodiment in the present embodiment be based on two under same inventive concept aspects, Front is described in detail method implementation process, so those skilled in the art can be according to foregoing description clearly The structure and implementation process of the system in this implementation are solved, in order to illustrate the succinct of book, details are not described herein again.
In several embodiments provided by the present invention, it should be understood that disclosed systems, devices and methods, it can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of division of logic function, formula that in actual implementation, there may be another division manner, such as multiple units or component It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be the indirect coupling by some interfaces, device or unit It closes or communicates to connect, can be electrical, machinery or other forms.
Term " first ", " second ", " third " " in description and claims of this specification and above-mentioned attached drawing Four " etc. be for distinguishing similar object, without being used to describe specific sequence or precedence.It should be appreciated that using in this way Data can be interchanged in the appropriate case, so that the embodiments described herein can be in addition to illustrating or describing herein Sequence other than appearance is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that covering is non-exclusive Include to be not necessarily limited to clearly arrange for example, containing the process of series of steps or unit, method, system, product or equipment Those of go out step or unit, but may include not listing clearly or solid for these processes, method, product or equipment The other steps or unit having.
One of ordinary skill in the art will appreciate that:Realize that all or part of step of above-mentioned each method embodiment can lead to The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer read/write memory medium.The journey When being executed, execution includes the steps that above-mentioned each method embodiment to sequence;And storage medium above-mentioned includes:ROM, RAM, magnetic disc or The various media that can store program code such as person's CD.
Finally it should be noted that:The above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extent Present invention has been described in detail with reference to the aforementioned embodiments for pipe, it will be understood by those of ordinary skill in the art that:Its according to So can with technical scheme described in the above embodiments is modified, either to which part or all technical features into Row equivalent replacement;And these modifications or replacements, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution The range of scheme.

Claims (10)

1. a kind of picture quality method for improving, which is characterized in that including:
Obtain the corresponding noise reduction histogram of luminance component figure of original image;The noise reduction histogram indicates the luminance component figure In edge pixel point brightness Distribution value;
Noise reduction is carried out to the luminance component figure according to the noise reduction histogram and obtains noise reduction component map;
The correction factor of each pixel in the original image is obtained according to the noise reduction component map and the luminance component figure;
According to the correction factor of each pixel, the image after noise reduction obtains noise reduction is carried out to the original image.
2. according to the method described in claim 1, it is characterized in that, the corresponding drop of luminance component figure for obtaining original image It makes an uproar histogram, including:
Obtain the edge pixel point in the luminance component figure;
According to the brightness value of the edge pixel point, the number of the corresponding edge pixel point of each brightness value is obtained;
According to the number of the corresponding edge pixel point of each brightness value, the noise reduction histogram is obtained.
3. according to the method described in claim 2, it is characterized in that, the edge pixel obtained in the luminance component figure Point, including:
The all pixels point in the luminance component figure is traversed, for any pixel point in the luminance component figure, if described The absolute value of the difference of the brightness value of pixel and the brightness value of neighbor pixel is more than preset difference value, it is determined that the pixel For edge pixel point;
Wherein, the neighbor pixel is the appointing less than pre-determined distance at a distance from the pixel in the luminance component figure Meaning pixel.
4. according to the method in any one of claims 1 to 3, which is characterized in that the repairing according to each pixel Positive coefficient carries out the image after noise reduction obtains noise reduction to the original image, including:
According to the correction factor of each pixel, to corresponding each pixel in the chromatic component figure of the original image Value is modified, and obtains the chromatic component figure after noise reduction;
According to the luminance component figure after the noise reduction and the chromatic component figure after the noise reduction, the image after noise reduction is obtained.
5. a kind of picture quality lifting device, which is characterized in that including:
Noise reduction histogram acquisition module, the corresponding noise reduction histogram of luminance component figure for obtaining original image;The noise reduction Histogram indicates the brightness Distribution value of the edge pixel point in the luminance component figure;
Noise reduction component map acquisition module carries out noise reduction to the luminance component figure according to the noise reduction histogram and obtains noise reduction component Figure;
Correction factor acquisition module, for being obtained in the original image according to the noise reduction component map and the luminance component figure Each pixel correction factor;
Noise reduction module, for the correction factor according to each pixel, after obtaining noise reduction to original image progress noise reduction Image.
6. device according to claim 5, which is characterized in that the noise reduction histogram acquisition module includes:Edge pixel Point acquiring unit, edge pixel point number acquiring unit and noise reduction histogram acquiring unit;
The edge pixel point acquiring unit, for obtaining the edge pixel point in the luminance component figure;
The edge pixel point number acquiring unit obtains each brightness for the brightness value according to the edge pixel point It is worth the number of corresponding edge pixel point;
The noise reduction histogram acquiring unit obtains institute for the number according to the corresponding edge pixel point of each brightness value State noise reduction histogram.
7. device according to claim 6, which is characterized in that the edge pixel point acquiring unit is specifically used for,
The all pixels point in the luminance component figure is traversed, for any pixel point in the luminance component figure, if described The absolute value of the difference of the brightness value of pixel and the brightness value of neighbor pixel is more than preset difference value, it is determined that the pixel For edge pixel point;
Wherein, the neighbor pixel is the appointing less than pre-determined distance at a distance from the pixel in the luminance component figure Meaning pixel.
8. device according to any one of claims 5 to 7, which is characterized in that the noise reduction module includes:Amending unit With image acquisition unit after noise reduction;
The amending unit, for the correction factor according to each pixel, in the chromatic component figure of the original image The value of corresponding each pixel be modified, obtain the chromatic component figure after noise reduction;
Image acquisition unit after the noise reduction, for according to the luminance component figure after the noise reduction and the coloration after the noise reduction point Spirogram obtains the image after noise reduction.
9. a kind of electronic equipment, it is characterised in that:It is described including memory, processor and program stored in memory Program is configured to be executed by processor, and processor is realized according to any one of claims 1 to 4 when executing described program The step of picture quality method for improving.
10. a kind of storage medium, the storage medium is stored with computer program, it is characterised in that:The computer program quilt The step of processor realizes picture quality method for improving according to any one of claims 1 to 4 when executing.
CN201810558182.2A 2018-06-01 2018-06-01 Image quality improving method and device Active CN108810320B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810558182.2A CN108810320B (en) 2018-06-01 2018-06-01 Image quality improving method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810558182.2A CN108810320B (en) 2018-06-01 2018-06-01 Image quality improving method and device

Publications (2)

Publication Number Publication Date
CN108810320A true CN108810320A (en) 2018-11-13
CN108810320B CN108810320B (en) 2020-11-24

Family

ID=64090231

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810558182.2A Active CN108810320B (en) 2018-06-01 2018-06-01 Image quality improving method and device

Country Status (1)

Country Link
CN (1) CN108810320B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111507923A (en) * 2020-04-21 2020-08-07 浙江大华技术股份有限公司 Method, device, equipment and medium for processing noise of video image

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101308573A (en) * 2008-06-30 2008-11-19 北京中星微电子有限公司 Method and apparatus for eliminating noise
US20090190832A1 (en) * 2008-01-24 2009-07-30 Miyakoshi Ryuichi Image processing device
CN102156964A (en) * 2011-03-31 2011-08-17 杭州海康威视软件有限公司 Color image denoising method and system thereof
CN103186888A (en) * 2011-12-30 2013-07-03 Ge医疗系统环球技术有限公司 Method and device for removing CT (computed tomography) image noises
CN107392864A (en) * 2017-07-01 2017-11-24 南京理工大学 A kind of mixed noise filtering method for removing Gaussian noise and impulsive noise

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090190832A1 (en) * 2008-01-24 2009-07-30 Miyakoshi Ryuichi Image processing device
CN101308573A (en) * 2008-06-30 2008-11-19 北京中星微电子有限公司 Method and apparatus for eliminating noise
CN102156964A (en) * 2011-03-31 2011-08-17 杭州海康威视软件有限公司 Color image denoising method and system thereof
CN103186888A (en) * 2011-12-30 2013-07-03 Ge医疗系统环球技术有限公司 Method and device for removing CT (computed tomography) image noises
CN107392864A (en) * 2017-07-01 2017-11-24 南京理工大学 A kind of mixed noise filtering method for removing Gaussian noise and impulsive noise

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
周奇等: "基于直方图特性的图像去噪方法", 《电子测量技术》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111507923A (en) * 2020-04-21 2020-08-07 浙江大华技术股份有限公司 Method, device, equipment and medium for processing noise of video image
CN111507923B (en) * 2020-04-21 2023-09-12 浙江大华技术股份有限公司 Noise processing method, device, equipment and medium for video image

Also Published As

Publication number Publication date
CN108810320B (en) 2020-11-24

Similar Documents

Publication Publication Date Title
CN110246108B (en) Image processing method, device and computer readable storage medium
CN101675454B (en) Adopt the edge mapping of panchromatic pixels
US8224085B2 (en) Noise reduced color image using panchromatic image
CN106375740B (en) Generate the methods, devices and systems of RGB image
US8254718B2 (en) Multi-channel edge-aware chrominance noise reduction
US7876956B2 (en) Noise reduction of panchromatic and color image
US7844127B2 (en) Edge mapping using panchromatic pixels
CN102722868B (en) Tone mapping method for high dynamic range image
EP3923234B1 (en) Training method and device for an image enhancement model, and storage medium
CN106683080B (en) A kind of retinal fundus images preprocess method
US20080043120A1 (en) Image processing apparatus, image capture apparatus, image output apparatus, and method and program for these apparatus
EP1499110A2 (en) Detecting and correcting red-eye in a digital-image
CN107431760A (en) Camera device, the image processing method of camera device and program
CN109255760A (en) Distorted image correction method and device
CN110430403B (en) Image processing method and device
CN110930301A (en) Image processing method, image processing device, storage medium and electronic equipment
US8488031B2 (en) Chromatic noise reduction method and apparatus
CN110473152A (en) Based on the image enchancing method for improving Retinex algorithm
CN107862672A (en) The method and device of image defogging
CN111105359A (en) Tone mapping method for high dynamic range image
US20140093168A1 (en) Image processing apparatus, image processing method and non-transitory computer readable medium
CN108810320A (en) Picture quality method for improving and device
CN116309116A (en) Low-dim-light image enhancement method and device based on RAW image
Reiter With j: image processing 2: color spaces
CN112714246A (en) Continuous shooting photo obtaining method, intelligent terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant