Background
The image filtering process is a branch of the image enhancement process. The aim of image enhancement is to improve the quality of the picture, such as increasing contrast, removing blur and noise, correcting geometric distortion, etc.; image restoration is a technique that attempts to estimate the original image assuming a model of known blur or noise.
Image enhancement can be classified into a frequency domain method and a spatial domain method according to the method used. The former regards the image as a two-dimensional signal, which is subjected to a two-dimensional fourier transform based signal enhancement. The noise in the graph can be removed by adopting a low-pass filtering (namely only passing low-frequency signals) method; by adopting the high-pass filtering method, high-frequency signals such as edges and the like can be enhanced, so that a blurred picture becomes clear. Representative spatial domain algorithms are local averaging and median filtering (taking intermediate pixel values in local neighborhoods) and the like, which can be used to remove or attenuate noise.
However, in practical use, the image filtering modes are various, including but not limited to median filtering modes (for example, the invention of application publication No. CN115205156a discloses a "distortion-free median filtering boundary filling method and apparatus, electronic device, storage medium", including acquiring a preset dimension image of a preset pixel point; selecting a median filter window with a specified size, sliding the median filter window through a preset dimensional image, wherein the number of pixel points in the median filter window is odd, selecting the pixel points which are overlapped in the median filter window and the preset dimensional image as effective pixel points when the filter window slides to the boundary of the preset dimensional image, wherein the non-overlapped pixel points are used as ineffective pixel points, marking the number of the ineffective pixel points, filling the preset pixel points into an effective pixel point sequence, replacing the ineffective pixel points to obtain a corresponding target filter window, wherein the number of the preset pixel points is the number of the ineffective pixel points, performing median filter processing on the target filter window after boundary filling), adaptively recursion filter mode, statistical ordering filter mode and high-pass filter mode (for example, the invention of application publication number CN112326033A discloses a method for demodulating polarized image high-frequency information by using high-pass filter, and the method comprises the steps of A1, performing space modulation polarization imaging on incident light to obtain an interference image containing polarization information, A2, performing transformation on the image to obtain polarization information represented by Stokes vectors in a frequency domain, performing median filter processing on the target filter window after boundary filling, performing subsequent filter processing on the rest position after Stokes vector processing on the rest position after Stokes is required to obtain high-frequency vectors A low-pass filtering mode (for example, the invention with application publication number CN112949669A discloses a method for estimating Gaussian low-pass filtering parameters in a digital image, which comprises the following steps of 1) carrying out gray level conversion on image information; 2) Performing Gaussian low-pass filtering treatment to obtain a training set; 3) Constructing a convolutional neural network; 4) Optimizing network advanced parameters; 5) Training a convolutional neural network; 6) Classification based on softmax; 7) The gaussian low pass filter parameters are estimated. ) A band pass filtering mode and a gradient sharpening filtering mode. Therefore, when a frame of picture arrives, which filtering mode is selected for the frame of picture can improve the signal to noise ratio of the frame of picture to the greatest extent, and obtain the best quality of picture, which is one of the key problems of people. If all the filtering algorithms try one by one on the frame picture, and quality comparison is performed on each obtained filtering picture, a great deal of time cost and operation cost are required for the task.
Disclosure of Invention
In order to overcome the technical problems in the prior art, the invention provides a picture information filtering effect identification system, which can establish various corresponding filtering effect prediction models for various filtering modes so as to respectively analyze the filtering effect of a new picture frame by adopting various filtering effect prediction models when the new picture frame arrives, thereby selecting a filtering scheme with optimized quality for each picture frame without actual filtering processing and avoiding the complicated and loaded image signal operation and comparison process.
According to an aspect of the present invention, there is provided a picture information filtering effect authentication system, the system including:
the picture analysis mechanism is used for obtaining various picture information of a current picture to be denoised, wherein the various picture information of the current picture to be denoised comprises picture resolution, signal-to-noise ratio before denoising, main noise quantity and picture contrast of the current picture to be denoised;
the content capturing mechanism is connected with the picture analyzing mechanism and is used for acquiring the integral gradient value of the current picture to be denoised;
a mode selection mechanism for selecting a filtering mode from various pre-stored filtering modes for the current picture to be denoised as a current filtering mode;
the network establishing device is connected with the mode selecting mechanism and is used for establishing a corresponding convolution neural network for executing denoising data analysis for the current filtering mode and outputting the convolution neural network as a target neural network, wherein the target neural network takes picture resolution, signal-to-noise ratio before denoising, main noise quantity, picture contrast and integral gradient value of a picture as various input data, and takes the signal-to-noise ratio after denoising after filtering the picture by adopting the current filtering mode as single output data;
the filtering identification device is connected with the network establishing device and is used for acquiring a signal-to-noise ratio after denoising, which is performed by adopting a current filtering mode on a current picture to be denoised, by adopting the target neural network;
wherein selecting a filter mode for the current picture to be denoised from among various filter modes stored in advance as a current filter mode includes: the pre-stored various filtering modes comprise a median filtering mode, an adaptive recursive filtering mode, a statistical ordering filtering mode, a band-pass filtering mode and a gradient sharpening filtering mode;
the method for obtaining the image information of the current image to be denoised comprises the steps of: the main noise quantity is the total number of noise types of which the corresponding noise amplitude in the current picture to be denoised is greater than or equal to a set amplitude threshold value;
the step of obtaining the overall gradient value of the current picture to be denoised comprises the following steps: and acquiring the pixel value gradient of each pixel point in the current picture to be denoised, and taking the intermediate value of each pixel value gradient corresponding to each pixel point in the current picture to be denoised as the integral gradient value of the current picture to be denoised.
The picture information filtering effect identification system has compact logic and intelligent operation. Because various corresponding filtering effect prediction models can be established for various filtering modes, when a new frame of picture arrives, various filtering effect prediction models are adopted for the frame of picture to analyze the filtering effect respectively, and therefore, a filtering scheme with optimized quality can be selected for each frame of picture without actual filtering processing.
Detailed Description
An embodiment of the screen information filtering effect authentication system of the present invention will be described in detail below with reference to the accompanying drawings.
Embodiment A
Fig. 1 is a block diagram showing a structure of a screen information filtering effect authentication system according to an embodiment of the present invention, the system including:
the picture analysis mechanism is used for obtaining various picture information of a current picture to be denoised, wherein the various picture information of the current picture to be denoised comprises picture resolution, signal-to-noise ratio before denoising, main noise quantity and picture contrast of the current picture to be denoised;
the content capturing mechanism is connected with the picture analyzing mechanism and is used for acquiring the integral gradient value of the current picture to be denoised;
a mode selection mechanism for selecting a filtering mode from various pre-stored filtering modes for the current picture to be denoised as a current filtering mode;
the network establishing device is connected with the mode selecting mechanism and is used for establishing a corresponding convolution neural network for executing denoising data analysis for the current filtering mode and outputting the convolution neural network as a target neural network, wherein the target neural network takes picture resolution, signal-to-noise ratio before denoising, main noise quantity, picture contrast and integral gradient value of a picture as various input data, and takes the signal-to-noise ratio after denoising after filtering the picture by adopting the current filtering mode as single output data;
the filtering identification device is connected with the network establishing device and is used for acquiring a signal-to-noise ratio after denoising, which is performed by adopting a current filtering mode on a current picture to be denoised, by adopting the target neural network;
wherein selecting a filter mode for the current picture to be denoised from among various filter modes stored in advance as a current filter mode includes: the pre-stored various filtering modes comprise a median filtering mode, an adaptive recursive filtering mode, a statistical ordering filtering mode, a high-pass filtering mode, a low-pass filtering mode, a band-pass filtering mode and a gradient sharpening filtering mode;
the method for obtaining the image information of the current image to be denoised comprises the steps of: the main noise quantity is the total number of noise types of which the corresponding noise amplitude in the current picture to be denoised is greater than or equal to a set amplitude threshold value;
the step of obtaining the overall gradient value of the current picture to be denoised comprises the following steps: and acquiring the pixel value gradient of each pixel point in the current picture to be denoised, and taking the intermediate value of each pixel value gradient corresponding to each pixel point in the current picture to be denoised as the integral gradient value of the current picture to be denoised.
B embodiment
Fig. 2 is a block diagram showing a structure of a screen information filtering effect authentication system according to an embodiment of the present invention, including:
the picture analysis mechanism is used for obtaining various picture information of a current picture to be denoised, wherein the various picture information of the current picture to be denoised comprises picture resolution, signal-to-noise ratio before denoising, main noise quantity and picture contrast of the current picture to be denoised;
the content capturing mechanism is connected with the picture analyzing mechanism and is used for acquiring the integral gradient value of the current picture to be denoised;
a mode selection mechanism for selecting a filtering mode from various pre-stored filtering modes for the current picture to be denoised as a current filtering mode;
the network establishing device is connected with the mode selecting mechanism and is used for establishing a corresponding convolution neural network for executing denoising data analysis for the current filtering mode and outputting the convolution neural network as a target neural network, wherein the target neural network takes picture resolution, signal-to-noise ratio before denoising, main noise quantity, picture contrast and integral gradient value of a picture as various input data, and takes the signal-to-noise ratio after denoising after filtering the picture by adopting the current filtering mode as single output data;
the filtering identification device is connected with the network establishing device and is used for acquiring a signal-to-noise ratio after denoising, which is performed by adopting a current filtering mode on a current picture to be denoised, by adopting the target neural network;
and the mode storage device is connected with the mode selection mechanism and is used for storing various filtering modes in advance for selection by the mode selection mechanism.
C embodiment
Fig. 3 is a block diagram showing a structure of a screen information filtering effect authentication system according to an embodiment of the present invention, including:
the picture analysis mechanism is used for obtaining various picture information of a current picture to be denoised, wherein the various picture information of the current picture to be denoised comprises picture resolution, signal-to-noise ratio before denoising, main noise quantity and picture contrast of the current picture to be denoised;
the content capturing mechanism is connected with the picture analyzing mechanism and is used for acquiring the integral gradient value of the current picture to be denoised;
a mode selection mechanism for selecting a filtering mode from various pre-stored filtering modes for the current picture to be denoised as a current filtering mode;
the network establishing device is connected with the mode selecting mechanism and is used for establishing a corresponding convolution neural network for executing denoising data analysis for the current filtering mode and outputting the convolution neural network as a target neural network, wherein the target neural network takes picture resolution, signal-to-noise ratio before denoising, main noise quantity, picture contrast and integral gradient value of a picture as various input data, and takes the signal-to-noise ratio after denoising after filtering the picture by adopting the current filtering mode as single output data;
the filtering identification device is connected with the network establishing device and is used for acquiring a signal-to-noise ratio after denoising, which is performed by adopting a current filtering mode on a current picture to be denoised, by adopting the target neural network;
and the network learning device is connected with the filtering identification device and is used for carrying out repeated learning on the convolutional neural network which is established for the current filtering mode and is used for carrying out denoising data analysis, and then the convolutional neural network after the repeated learning is sent to the filtering identification device for use.
Next, a specific configuration of the screen information filtering effect identification system of the present invention will be further described.
In the picture information filtering effect authentication system according to various embodiments of the present invention:
after multiple learning, the convolutional neural network for performing denoising data analysis corresponding to the current filtering mode comprises: the number of times of learning is monotonically and positively correlated with the complexity of the filtering algorithm corresponding to the current filtering mode.
In the picture information filtering effect authentication system according to various embodiments of the present invention:
the step of obtaining the signal-to-noise ratio after denoising after filtering the current picture to be denoised by adopting the current filtering mode by using the target neural network comprises the following steps: and taking the picture resolution, the signal-to-noise ratio before denoising, the main noise quantity, the picture contrast and the overall gradient value of the current picture to be denoised as various input data of the target neural network, and operating the target neural network to obtain the signal-to-noise ratio after denoising of the current picture to be denoised after filtering is performed by adopting the current filtering mode.
In the picture information filtering effect authentication system according to various embodiments of the present invention:
the method for obtaining the pixel value gradient of each pixel point in the current picture to be denoised comprises the following steps of: sequencing the pixel value gradients corresponding to the pixel points in the current picture to be denoised in sequence from small to large in value, and taking the pixel value gradient corresponding to the central sequence number as the whole gradient value of the current picture to be denoised;
the method for sorting the pixel value gradients corresponding to the pixel points in the current picture to be denoised in order from small to large in value, taking the pixel value gradient corresponding to the central sequence number as the whole gradient value of the current picture to be denoised comprises the following steps: when the sequence obtained by sequencing is an even sequence, taking the average value of the gradients of the two pixel values corresponding to the two serial numbers at the central position as the integral gradient value of the current picture to be denoised.
And in a picture information filtering effect authentication system according to various embodiments of the present invention:
the step of obtaining the overall gradient value of the current picture to be denoised comprises the following steps: the method for obtaining the pixel value gradient of each pixel point in the current picture to be denoised comprises the following steps of: determining the pixel value gradient of each pixel point in the current picture to be denoised based on the difference value between the gray value of the pixel point and the representative value of each gray value corresponding to each pixel point in the neighborhood of the pixel point;
the step of obtaining the overall gradient value of the current picture to be denoised comprises the following steps: the method for obtaining the pixel value gradient of each pixel point in the current picture to be denoised comprises the following steps of: determining a pixel value gradient of each pixel point in the current picture to be denoised based on the difference value of the arithmetic average value of the gray value of each pixel point corresponding to each pixel point in the neighborhood of the pixel point;
alternatively, obtaining the overall gradient value of the current picture to be denoised includes: the method for obtaining the pixel value gradient of each pixel point in the current picture to be denoised comprises the following steps of: and determining the pixel value gradient of each pixel point in the current picture to be denoised based on the difference value of the gray value of each pixel point and the intermediate value of each gray value corresponding to each pixel point in the neighborhood of the pixel point.
In addition, in the screen information filtering effect identification system, for each pixel point in the current to-be-denoised screen, determining the pixel value gradient based on the difference value between the gray value and the representative value of each gray value corresponding to each pixel point in the neighborhood of the pixel point comprises: for each pixel point in a current picture to be denoised, each pixel point in the neighborhood of the pixel point refers to a plurality of pixel points covered by a square pixel point window taking the pixel point window as a center in the current picture to be denoised.
The technical points and the technical advantages of the invention are as follows:
1: the method comprises the steps of obtaining various relevant information of a current picture to be denoised by adopting a customized analysis mechanism, wherein the various relevant information comprises main noise quantity and overall gradient values, the main noise quantity is the total number of noise types, the corresponding noise amplitude of which is greater than or equal to a set amplitude threshold value, in the current picture to be denoised, and obtaining the overall gradient values of the current picture to be denoised comprises the following steps: acquiring a pixel value gradient of each pixel point in the current picture to be denoised, and taking a middle value of each pixel value gradient corresponding to each pixel point in the current picture to be denoised as an integral gradient value of the current picture to be denoised, so as to provide key data for prediction of each filtering effect corresponding to the current picture to be denoised in various filtering modes;
2: the method comprises the steps of establishing a corresponding convolution neural network for executing denoising data analysis for each filtering mode and outputting the convolution neural network as a target neural network, wherein the target neural network takes picture resolution, signal-to-noise ratio before denoising, main noise quantity, picture contrast and overall gradient value of a current picture to be denoised as various input data, and takes the signal-to-noise ratio after denoising after filtering the current picture to be denoised by adopting the current filtering mode as single output data, so that reliable evaluation of the filtering effect corresponding to each filtering mode of the current picture to be denoised is realized.
It is evident that various modifications and improvements may be made to the invention by those skilled in the art. Accordingly, it is intended that the present invention encompass all modifications and improvements as fall within the scope of the appended claims and their equivalents.