CN112800981A - Signal processing method and device - Google Patents
Signal processing method and device Download PDFInfo
- Publication number
- CN112800981A CN112800981A CN202110136294.0A CN202110136294A CN112800981A CN 112800981 A CN112800981 A CN 112800981A CN 202110136294 A CN202110136294 A CN 202110136294A CN 112800981 A CN112800981 A CN 112800981A
- Authority
- CN
- China
- Prior art keywords
- gain value
- image
- adjustment
- processing mode
- acquired
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 160
- 230000002159 abnormal effect Effects 0.000 claims abstract description 106
- 230000005856 abnormality Effects 0.000 claims abstract description 60
- 230000003287 optical effect Effects 0.000 claims abstract description 41
- 238000000034 method Methods 0.000 claims description 28
- 230000000694 effects Effects 0.000 abstract description 11
- 230000003044 adaptive effect Effects 0.000 abstract description 4
- 230000008569 process Effects 0.000 description 13
- 238000004880 explosion Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000006872 improvement Effects 0.000 description 5
- 238000011084 recovery Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000012512 characterization method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1347—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/02—Preprocessing
- G06F2218/04—Denoising
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Input (AREA)
Abstract
The application provides a signal processing method and a signal processing device, wherein an acquisition signal for representing image information is acquired, the acquisition signal is processed according to a processing mode to generate an acquisition image, the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor; determining an adjustment gain value based on the abnormal degree of the acquired image with abnormality; and replacing the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value, wherein the effective image in the acquired image generated by processing the acquired signals under the same environment according to the post-adjustment processing mode is larger than the effective image in the acquired image generated by processing the acquired signals under the same environment according to the pre-adjustment processing mode, so that the image restoration effect is improved by the initial gain value adjustment mode, and the adaptive adjusted gain value can be used for replacing the initial gain value based on the abnormal degree of the acquired images.
Description
Technical Field
The present application belongs to the field of data processing technologies, and in particular, to a signal processing method and apparatus.
Background
The image is abnormal due to the shooting environment, the equipment parameters and the like, and the image is influenced by the overexposure phenomenon of the image due to the illumination intensity of the shooting environment. If the image is abnormal, the electronic device for acquiring the image may adjust the device parameters, for example, the intensity of light may be reduced by the overexposure phenomenon of the image, such as adjusting the intensity of a light beam emitted by the electronic device or adding a light shielding plate in the electronic device.
Disclosure of Invention
The application provides a signal processing method and a signal processing device.
In one aspect, the present application provides a signal processing method, including:
acquiring an acquisition signal for representing image information, and processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor;
determining an adjustment gain value based on the abnormal degree of the acquired image;
replacing an initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value; and processing according to the post-adjustment processing mode to obtain the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode.
Optionally, the determining, based on the abnormal degree of the acquired image, an adjustment gain value includes:
if the acquired image has a first abnormal degree, determining the adjustment gain value to a first adjustment gain value;
if the acquired image has a second abnormal degree, determining the adjustment gain value to a second adjustment gain value;
wherein if the first degree of abnormality is greater than the second degree of abnormality, a difference between the first adjusted gain value and the initial gain value is greater than a difference between the second adjusted gain value and the initial gain value.
Optionally, the adjustment gain value is smaller than the initial gain value, and a relationship between a difference value between the adjustment gain value and the initial gain value and the degree of abnormality is a direct relationship between the difference value and the degree of abnormality.
Optionally, the method further includes: and if the acquired image generated based on the adjusted initial gain value is a normal image, restoring the initial gain value of the processing mode.
Optionally, the acquiring the acquisition signal for representing the image information includes:
and if the finger fingerprint input is monitored, acquiring an acquisition signal for representing fingerprint image information by using the optical sensor under the screen, wherein the fingerprint image in the acquisition image generated by processing the acquisition signal according to the processing mode is the effective image.
Optionally, the acquiring of the abnormal degree of the acquired image with abnormality includes:
determining an abnormal area with abnormality in the acquired image; acquiring the area occupied by the abnormal region in the acquired image; determining the abnormal degree according to the area;
or
Acquiring the brightness value of each pixel point in the acquired image; and determining the abnormal degree according to the brightness value of each pixel point and the brightness value of a screen displaying the acquired image.
In another aspect, the present application provides a signal processing apparatus comprising:
the acquisition unit is used for acquiring an acquisition signal for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor;
a determining unit, configured to determine an adjustment gain value based on an abnormal degree of abnormality of the acquired image;
an adjustment unit configured to replace an initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value; and processing according to the post-adjustment processing mode to obtain the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode.
Optionally, the adjustment gain value is smaller than the initial gain value, and a relationship between a difference value between the adjustment gain value and the initial gain value and the degree of abnormality is a direct relationship between the difference value and the degree of abnormality.
Optionally, the apparatus further comprises: and the restoring unit is used for restoring the initial gain value of the processing mode if the acquired image generated based on the adjusted initial gain value is a normal image.
Optionally, the acquiring unit is configured to acquire, by using the off-screen optical sensor, an acquisition signal for representing fingerprint image information if it is monitored that a finger fingerprint is input, where a fingerprint image in an acquisition image generated by processing the acquisition signal according to a processing mode is the effective image.
In yet another aspect, the present application provides an electronic device, comprising: a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the above-mentioned signal processing method.
In still another aspect, the present application provides a storage medium, in which instructions are stored, and when executed, the storage medium implements the signal processing method.
The signal processing method and the signal processing device acquire the acquisition signal for representing the image information, process the acquisition signal according to the processing mode to generate the acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by the optical sensor; determining an adjustment gain value based on the abnormal degree of the acquired image with abnormality; and replacing the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value, wherein the effective image in the acquired image generated by processing the acquired signals under the same environment according to the post-adjustment processing mode is larger than the effective image in the acquired image generated by processing the acquired signals under the same environment according to the pre-adjustment processing mode, so that the abnormity of the acquired image under the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by adjusting the initial gain value. And the adjustment gain value for replacing the initial gain value is determined based on the abnormal degree of the acquired image, which indicates that the adjustment gain values may be different according to different abnormal degrees, so that the adjustment gain value is dynamically adjusted based on the abnormal degree of the acquired image, the initial gain value can be replaced by the adaptive adjustment gain value based on the abnormal degree of the acquired image in different environments, the acquired image in the same environment is restored, and the image restoration effect is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a signal processing method according to an embodiment of the present application;
fig. 2 is a schematic diagram of an application scenario provided in an embodiment of the present application;
fig. 3 is a flowchart of a signal processing method applied in fingerprint acquisition according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a captured image restoration provided by an embodiment of the present application;
FIG. 5 is a schematic diagram of another captured image inpainting provided by an embodiment of the present application;
fig. 6 is a flowchart of another signal processing method provided in the embodiment of the present application;
fig. 7 is a schematic structural diagram of a signal processing apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of another signal processing apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, a flowchart of a signal processing method provided in an embodiment of the present application is shown, which may include the following steps:
101: acquiring an acquisition signal for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor.
The light emitted by the electronic equipment irradiates the screen, one part of the light penetrates through the screen, the part of the light provides illumination for the optical sensor in the process that the optical sensor obtains the acquisition signal, and the optical sensor can obtain the acquisition signal used for representing the image information under the illumination effect.
In the process of acquiring the acquisition signal by the optical sensor, the acquisition of the acquisition signal is influenced by the ambient light of the environment where the optical sensor is located, so that at least a noise signal generated by the ambient light exists in the acquisition signal. Aiming at the noise signals in the collected signals, the influence of the noise signals can be reduced in the process of processing the collected signals according to the processing mode, and the collected images with effective images are generated. For example, the acquisition signal is input to an ADC (Analog-to-Digital Converter), and the ADC performs Analog-to-Digital conversion on the acquisition signal based on an initial gain value in the processing mode to obtain a gray scale map as an acquisition image, where gray scale information in the gray scale map can represent image information.
However, due to the influence of the ambient light of the environment where the optical sensor is located and the factor of the collection object, there is a certain problem in the collected image generated by processing the collected signal based on the initial gain value, for example, the brightness of the ambient light of the environment where the optical sensor is located is too large, so that a white area in the collected image is increased, which indicates that the phenomenon of overexposure of the collected image is serious, and the collected image cannot be used. If the acquisition object is a finger, if the humidity of the finger surface is too low (i.e., the finger is dry), the acquisition image generated based on the initial gain value processing may also be unusable. The reason why the collected image cannot be used is that the collected image has too few effective images, so that the feature data extracted from the collected image is few, and the collected object restored by the extracted feature data has a defect, so that the identification and verification cannot be passed.
For example, in an application scenario, the object is a finger, and the fingerprint is captured by the electronic device shown in fig. 2 for fingerprint identification verification, where the electronic device includes: optical sensor (an optical sensor), ADC and treater under the screen, and have a fingerprint collection region in electronic equipment, the fingerprint collection region is used for monitoring whether has finger fingerprint input, and the acquisition that corresponds is used for the gathering signal of characterization image information includes: if the finger fingerprint input is monitored, acquiring signals for representing fingerprint image information by using the optical sensor under the screen, transmitting the acquired signals to the ADC, and processing the acquired signals by the ADC according to the initial gain value in the processing mode to obtain an acquired image. The collected image is identified and verified through the processor, and if the collected image has an over-explosion phenomenon, the fingerprint image in the collected image is too few, so that the collected image cannot pass the identification and verification of the processor. If the fingerprint image in the acquired image is too few, the fingerprint characteristic data extracted from the acquired image by the processor is few, and the acquired object recovered by the processor based on the fingerprint characteristic data has a defect, such as the fingerprint cannot be recovered or only a part of the fingerprint can be recovered as shown in fig. 2, so that the fingerprint cannot be identified and verified by the processor.
For the above situation, the present embodiment determines the degree of abnormality of the captured image, and adjusts the initial gain value based on the degree of abnormality, so as to reduce the abnormality in the captured image and increase the effective image in the captured image. That is, the adjustment of the initial gain value in the present embodiment satisfies two conditions: one is the presence of an anomaly; and secondly, if the abnormal degree is larger than the abnormal degree corresponding to the initial gain value, the adjustment of the initial gain value is triggered.
The abnormal degree in which the collected image has abnormality includes, but is not limited to, the following ways:
one way is to determine an abnormal region where an abnormality exists in the acquired image; acquiring the area occupied by the abnormal area in the acquired image; and determining the abnormal degree according to the area. The larger the area occupied by the abnormal region in the acquired image is, the larger the abnormal degree is; the abnormal region in the collected image may be, but is not limited to, a white region in the collected image, and the abnormal region is determined by detecting pixel values of pixel points in the collected image, for example, for the white region, the pixel value of the pixel point is (255, 255, 255), and the pixel point with the value of (255, 255, 255) is identified to obtain an area occupied by the abnormal region in the collected image.
The other mode is that the brightness value of each pixel point in the collected image is obtained; and determining the abnormal degree according to the brightness value of each pixel point and the brightness value of a screen for displaying the acquired image. Because the optical sensor acquires signals under the action of light penetrating through the screen in the process of acquiring the signals, the brightness value of the screen has different influences on the brightness value of each pixel point in the acquired image, therefore, a threshold value can be determined according to the brightness value of the screen displaying the acquired image, the abnormal degree is determined according to the comparison result of the brightness value of each pixel point in the acquired image and the threshold value, and if the comparison result is used for representing the difference value between the brightness value of each pixel point and the threshold value and the number of the pixel points with difference, the more the number of the pixel points with difference is, the larger the difference value is, the larger the abnormal degree is determined, and otherwise, the smaller the. The value of the threshold is not limited in this embodiment.
102: and determining an adjustment gain value based on the abnormal degree of the acquired image.
The adjustment gain value may be greater than the initial gain value or less than the initial gain value, for example, a white area in the captured image (the white area is an invalid image in the captured image) is increased due to the over-explosion, and the adjustment gain value is less than the initial gain value to reduce the over-explosion phenomenon, otherwise, the adjustment gain value is greater than the initial gain value.
And the white area in the acquired image is analyzed under different over-explosion conditions, if the white area is larger, the adjustment gain value is smaller, so that the white area in the acquired image can be reduced, therefore, the relation between the difference value between the adjustment gain value and the initial gain value and the abnormal degree is a direct-proportion relation between the difference value and the abnormal degree, if the abnormal degree is larger, the difference value is larger, and the abnormal degree is smaller. If the adjustment gain value is smaller than the initial gain value, the adjustment gain value becomes smaller as the degree of abnormality increases.
Based on the relationship between the adjustment gain value and the degree of abnormality, one way of determining the adjustment gain value may include: if the collected image has a first abnormal degree, determining to adjust the gain value to a first adjustment gain value; if the second abnormal degree exists in the collected image, determining to adjust the gain value to a second adjustment gain value;
if the first abnormal degree is larger than the second abnormal degree, the difference value between the first adjusting gain value and the initial gain value is larger than the difference value between the second adjusting gain value and the initial gain value, and the direct proportion relation between the difference value and the abnormal degree is met. For example, if the initial gain value needs to be decreased, the first adjusted gain value is less than the second adjusted gain value if the first degree of abnormality is greater than the second degree of abnormality.
103: and replacing the initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value so as to improve the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the improvement means that the effective image in the acquired image generated by acquiring the signals under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the processing of the pre-adjustment processing mode.
The same environment is the environment where the optical sensor is located when acquiring the acquisition signal, after the initial gain value is replaced by the adjustment gain value, if the acquisition signal in the environment is acquired again through the optical sensor, the adjustment of the acquisition signal is performed according to the processing mode, the adjustment gain value is used for processing the acquisition signal, so that an effective image in the generated acquisition image is larger than an effective image in the acquisition image generated by processing the same acquisition signal by using the initial gain value, if the occupied area of the effective image is increased or the feature data extracted from the effective image is increased, the possibility of recovering the acquisition object is increased.
And for the acquired image obtained again, if the abnormal degree of the acquired image obtained again indicates to adjust the initial gain value, determining an adjusted gain value based on the abnormal degree of the acquired image obtained again, continuing to adjust the initial gain value by using the adjusted gain value, and realizing dynamic continuous adjustment of the initial gain value based on the abnormal degree of the acquired image.
The following description takes an example of the acquisition of the finger fingerprint by the optical sensor under the screen, and the flow of the method is shown in fig. 3, and may include the following steps:
201: acquiring an acquisition signal for representing fingerprint image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor under a screen, and if the condition that the input of a finger fingerprint is monitored, triggering the optical sensor under the screen to acquire the signal so as to acquire the acquisition signal.
202: the degree of abnormality is determined based on the area occupied in the captured image by the abnormal region in the captured image.
203: if the abnormality degree belongs to the first type abnormality, the adjustment gain value is determined to be a first gain value, the first gain value can be, but is not limited to, the multiplication of the initial gain value and a first numerical value, and the first numerical value is smaller than 1.
204: if the abnormal degree belongs to the second type of abnormality, the adjustment gain value is determined to be the second gain value, the second gain value can be but is not limited to the product of the initial gain value and the second value, the second value is smaller than 1, the abnormal degree of the second type of abnormality is larger than the abnormal degree of the first type of abnormality, and the second value is smaller than the first value, so that the second gain value is smaller than the first gain value.
205: if the abnormal degree belongs to a third type of abnormality, the adjustment gain value is determined to be a third gain value, the third gain value can be obtained by, but not limited to, multiplying the initial gain value by a third numerical value, the third numerical value is smaller than 1, the abnormal degree of the third type of abnormality is larger than the abnormal degree of the second type of abnormality, the third numerical value is smaller than the second numerical value, so that the third gain value is smaller than the second gain value, the first type of abnormality, the second type of abnormality and the third type of abnormality can be divided by two abnormal degrees, and the embodiment is not limited to how to divide the abnormality and the value from the first numerical value to the third numerical value. Besides the initial gain value is multiplied by the numerical value to obtain the adjusted gain value, the adjusted gain value can be obtained by any method of subtraction, addition and the like.
206: and replacing the initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value so as to improve the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the improvement means that the effective image in the acquired image generated by acquiring the signals under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the processing of the pre-adjustment processing mode.
The effect of collecting a fingerprint image by an electronic device and processing the fingerprint image by using each adjustment gain value shown in fig. 3 is described, for example, fig. 4 shows an effect diagram of repairing different adjustment gain values, a collected image is obtained by the electronic device shown in fig. 4, an explosion phenomenon exists in the collected image due to an ambient light problem, and for example, a white area in the collected image in fig. 4 is too much, so that few effective images in the collected image are obtained, and effective feature data cannot be extracted. In this case, the initial gain value is adjusted in the manner shown in fig. 3, so that the effective image in the captured image generated by the captured signal obtained from the same environment is improved, for example, the effective image in the captured image is different due to the initial gain value after different adjustments in fig. 4, and the smaller the initial gain value after adjustment, the more effective images are, and the better the restoration effect is.
If the initial gain value is such that the degree of abnormality is still present and is severe after an adjustment is used, the initial gain value may continue to be adjusted, as shown in FIG. 5. If the abnormal degree of the acquired image is still serious after the first gain value is adopted for adjustment, the adjustment gain value can be continuously determined based on the abnormal degree of the acquired image obtained again, and the initial gain value is continuously adjusted. The initial gain value may be a gain value adopted in the digital-to-analog conversion process of the ADC, and the gain value of the ADC may be dynamically and continuously adjusted in the above manner.
The signal processing method comprises the steps of acquiring an acquisition signal for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor; determining an adjustment gain value based on the abnormal degree of the acquired image with abnormality; and replacing the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value, wherein the effective image in the acquired image generated by processing the acquired signals under the same environment according to the post-adjustment processing mode is larger than the effective image in the acquired image generated by processing the acquired signals under the same environment according to the pre-adjustment processing mode, so that the abnormity of the acquired image under the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by adjusting the initial gain value. And the adjustment gain value for replacing the initial gain value is determined based on the abnormal degree of the acquired image, which indicates that the adjustment gain values may be different according to different abnormal degrees, so that the adjustment gain value is dynamically adjusted based on the abnormal degree of the acquired image, the initial gain value can be replaced by the adaptive adjustment gain value based on the abnormal degree of the acquired image in different environments, the acquired image in the same environment is restored, and the image restoration effect is improved.
Referring to fig. 6, a flow chart of another signal processing method provided in the embodiment of the present application is shown, which may include the following steps:
301: acquiring an acquisition signal for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor.
302: and determining an adjustment gain value based on the abnormal degree of the acquired image.
303: and replacing the initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value so as to improve the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the improvement means that the effective image in the acquired image generated by acquiring the signals under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the processing of the pre-adjustment processing mode.
304: and if the acquired image generated based on the adjusted initial gain value is a normal image, restoring the initial gain value of the processing mode, namely restoring the initial gain value of the processing mode to the original value. This is because the initial gain value of the processing mode is in the original value and can be adapted to various conditions, such as the condition that the adapted captured image has no abnormality and the captured image has abnormality but the abnormal program is smaller than the preset degree, and the adjusted initial gain value is because the environment where the adjusted initial gain value is located has a sudden change, etc., and the adjusted initial gain value is suitable for the environment where the adjustment is located, which means that the adjusted initial gain value is not adapted in most cases, so if the captured image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is recovered.
The acquired image generated based on the adjusted initial gain value is a normal image, and can represent that the acquired image is not abnormal and the acquired image has abnormality but the abnormal program is less than the preset degree, and the acquired object can be effectively recovered under the conditions, so that if the acquired image is not abnormal or the acquired image has abnormality but the abnormal program is less than the preset degree, the acquired image generated based on the adjusted initial gain value is determined to be the normal image. The preset degree is an abnormal degree when the acquired images have differences but the acquired object can be recovered from the feature data extracted from the acquired images, and the value of the preset degree is not limited in this embodiment.
According to the signal processing method, if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is recovered, namely, the initial gain value of the processing mode is recovered to the original value, so that the acquired signal is processed through the initial gain value, and the initial gain value of the processing mode can adapt to various conditions under the original value, so that the processing and recovery requirements of the acquired image under various scenes can be adapted, and the recovery accuracy and efficiency are improved.
In addition to the initial gain value of the recovery processing mode, the embodiment may also adopt other manners, such as after the initial gain value is adjusted for a preset time period, if the acquired image generated based on the adjusted initial gain value is a normal image, recovering the initial gain value of the processing mode; or, if the environment where the optical sensor is located changes, the initial gain value of the processing mode is recovered, where the change of the environment where the optical sensor is located may be, but is not limited to, a change in the intensity of the ambient light being monitored, and the manner of recovering the initial gain value of the processing mode is not limited in this embodiment.
While, for purposes of simplicity of explanation, the foregoing method embodiments have been described as a series of acts or combination of acts, it will be appreciated by those skilled in the art that the present application is not limited by the order of acts or acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
Corresponding to the above method embodiment, an embodiment of the present application further provides a signal processing apparatus, an optional structure of which is shown in fig. 7, and the signal processing apparatus may include: an acquisition unit 10, a determination unit 20 and an adjustment unit 30.
The acquiring unit 10 is configured to acquire an acquisition signal for representing image information, process the acquisition signal according to a processing mode to generate an acquisition image, where the processing mode at least includes an initial gain value, and the acquisition signal is obtained by the optical sensor.
In the process of acquiring the acquisition signal by the optical sensor, the acquisition of the acquisition signal is influenced by the ambient light of the environment where the optical sensor is located, so that at least a noise signal generated by the ambient light exists in the acquisition signal. Aiming at the noise signals in the collected signals, the influence of the noise signals can be reduced in the process of processing the collected signals according to the processing mode, and the collected images with effective images are generated. For example, the acquired signal is input into the ADC, and the ADC performs analog-to-digital conversion on the acquired signal based on the initial gain value in the processing mode to obtain a gray scale map as an acquired image, where gray scale information in the gray scale map can represent image information.
If the optical sensor can be an off-screen optical sensor, the obtaining unit 10 is configured to obtain a captured signal for representing fingerprint image information by using the off-screen optical sensor if a finger fingerprint input is detected, wherein a fingerprint image in the captured image generated by processing the captured signal according to the processing mode is a valid image.
However, due to the influence of the ambient light of the environment where the optical sensor is located and the factor of the acquisition object, there is a problem in the acquired image generated by processing the acquisition signal based on the initial gain value, which affects the use of the acquired image. The abnormal degree in which the collected image has abnormality includes, but is not limited to, the following ways:
one way is to determine an abnormal region where an abnormality exists in the acquired image; acquiring the area occupied by the abnormal area in the acquired image; and determining the abnormal degree according to the area. The other mode is that the brightness value of each pixel point in the collected image is obtained; and determining the abnormal degree according to the brightness value of each pixel point and the brightness value of a screen for displaying the acquired image.
And a determining unit 20 for determining an adjustment gain value based on the abnormal degree of the acquired image. The adjustment gain value may be greater than the initial gain value or less than the initial gain value, for example, a white area in the captured image (the white area is an invalid image in the captured image) is increased due to the over-explosion, and the adjustment gain value is less than the initial gain value to reduce the over-explosion phenomenon, otherwise, the adjustment gain value is greater than the initial gain value. The relation between the difference value and the abnormal degree between the adjustment gain value and the initial gain value is a direct proportion relation between the difference value and the abnormal degree, and if the abnormal degree is larger, the difference value is larger, and the abnormal degree is smaller. If the adjustment gain value is smaller than the initial gain value, the adjustment gain value becomes smaller as the degree of abnormality increases.
Based on the relationship between the adjustment gain value and the degree of abnormality, the determining unit 20 may determine the adjustment gain value in a manner including: if the collected image has a first abnormal degree, determining to adjust the gain value to a first adjustment gain value; if the second abnormal degree exists in the collected image, determining to adjust the gain value to a second adjustment gain value;
if the first abnormal degree is larger than the second abnormal degree, the difference value between the first adjusting gain value and the initial gain value is larger than the difference value between the second adjusting gain value and the initial gain value, and the direct proportion relation between the difference value and the abnormal degree is met. For example, if the initial gain value needs to be decreased, the first adjusted gain value is less than the second adjusted gain value if the first degree of abnormality is greater than the second degree of abnormality.
An adjusting unit 30 for replacing the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value. And processing according to the post-adjustment processing mode to obtain the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode.
The same environment is the environment where the optical sensor is located when acquiring the acquisition signal, after the initial gain value is replaced by the adjustment gain value, if the acquisition signal in the environment is acquired again through the optical sensor, the adjustment of the acquisition signal is performed according to the processing mode, the adjustment gain value is used for processing the acquisition signal, so that an effective image in the generated acquisition image is larger than an effective image in the acquisition image generated by processing the same acquisition signal by using the initial gain value, if the occupied area of the effective image is increased or the feature data extracted from the effective image is increased, the possibility of recovering the acquisition object is increased.
And for the acquired image obtained again, if the abnormal degree of the acquired image obtained again indicates to adjust the initial gain value, determining an adjusted gain value based on the abnormal degree of the acquired image obtained again, continuing to adjust the initial gain value by using the adjusted gain value, and realizing dynamic continuous adjustment of the initial gain value based on the abnormal degree of the acquired image.
The signal processing device acquires an acquisition signal for representing image information, processes the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by the optical sensor. And determining an adjustment gain value based on the abnormal degree of the acquired image. And replacing the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value, wherein the effective image in the acquired image generated by processing the acquired signals under the same environment according to the post-adjustment processing mode is larger than the effective image in the acquired image generated by processing the acquired signals under the same environment according to the pre-adjustment processing mode, so that the abnormity of the acquired image under the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by adjusting the initial gain value. And the adjustment gain value for replacing the initial gain value is determined based on the abnormal degree of the acquired image, which indicates that the adjustment gain values may be different according to different abnormal degrees, so that the adjustment gain value is dynamically adjusted based on the abnormal degree of the acquired image, the initial gain value can be replaced by the adaptive adjustment gain value based on the abnormal degree of the acquired image in different environments, the acquired image in the same environment is restored, and the image restoration effect is improved.
Please refer to fig. 8, which shows an alternative structure of another signal processing apparatus provided in the embodiment of the present application, and may further include: a restoring unit 40, configured to restore the initial gain value of the processing mode, that is, restore the initial gain value of the processing mode to the original value if the captured image generated based on the adjusted initial gain value is a normal image. This is because the initial gain value of the processing mode is in the original value and can be adapted to various conditions, such as the condition that the adapted captured image has no abnormality and the captured image has abnormality but the abnormal program is smaller than the preset degree, and the adjusted initial gain value is because the environment where the adjusted initial gain value is located has a sudden change, etc., and the adjusted initial gain value is suitable for the environment where the adjustment is located, which means that the adjusted initial gain value is not adapted in most cases, so if the captured image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is recovered.
The acquired image generated based on the adjusted initial gain value is a normal image, and can represent that the acquired image is not abnormal and the acquired image has abnormality but the abnormal program is less than the preset degree, and the acquired object can be effectively recovered under the conditions, so that if the acquired image is not abnormal or the acquired image has abnormality but the abnormal program is less than the preset degree, the acquired image generated based on the adjusted initial gain value is determined to be the normal image. The preset degree is an abnormal degree when the acquired images have differences but the acquired object can be recovered from the feature data extracted from the acquired images, and the value of the preset degree is not limited in this embodiment.
According to the signal processing device, if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is recovered, namely, the initial gain value of the processing mode is recovered to the original value, so that the acquired signal is processed through the initial gain value, and the initial gain value of the processing mode can adapt to various conditions under the original value, so that the processing and recovery requirements of the acquired image under various scenes can be adapted, and the recovery accuracy and efficiency are improved.
An embodiment of the present application further provides an electronic device, including: a processor and a memory for storing processor-executable instructions. Wherein the processor is configured to execute the instructions to implement the signal processing method.
The embodiment of the application also provides a storage medium, wherein the storage medium stores instructions, and when the instructions in the storage medium are executed, the signal processing method is realized.
It should be noted that, various embodiments in this specification may be described in a progressive manner, and features described in various embodiments in this specification may be replaced with or combined with each other, each embodiment focuses on differences from other embodiments, and similar parts between various embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. A signal processing method, comprising:
acquiring an acquisition signal for representing image information, and processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor;
determining an adjustment gain value based on the abnormal degree of the acquired image;
replacing an initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value; and processing according to the post-adjustment processing mode to obtain the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode.
2. The method of claim 1, the determining an adjustment gain value based on the degree of abnormality of the captured image having an abnormality comprising:
if the acquired image has a first abnormal degree, determining the adjustment gain value to a first adjustment gain value;
if the acquired image has a second abnormal degree, determining the adjustment gain value to a second adjustment gain value;
wherein if the first degree of abnormality is greater than the second degree of abnormality, a difference between the first adjusted gain value and the initial gain value is greater than a difference between the second adjusted gain value and the initial gain value.
3. The method according to claim 1 or 2, wherein the adjusted gain value is smaller than the initial gain value, and the relation between the difference value between the adjusted gain value and the initial gain value and the degree of abnormality is a direct relation between the difference value and the degree of abnormality.
4. The method of claim 1, further comprising: and if the acquired image generated based on the adjusted initial gain value is a normal image, restoring the initial gain value of the processing mode.
5. The method of claim 1, the acquiring acquisition signals characterizing image information comprising:
and if the finger fingerprint input is monitored, acquiring an acquisition signal for representing fingerprint image information by using the optical sensor under the screen, wherein the fingerprint image in the acquisition image generated by processing the acquisition signal according to the processing mode is the effective image.
6. The method according to claim 1, wherein the acquiring the abnormal degree of the abnormality of the acquired image comprises:
determining an abnormal area with abnormality in the acquired image; acquiring the area occupied by the abnormal region in the acquired image; determining the abnormal degree according to the area;
or
Acquiring the brightness value of each pixel point in the acquired image; and determining the abnormal degree according to the brightness value of each pixel point and the brightness value of a screen displaying the acquired image.
7. A signal processing apparatus comprising:
the acquisition unit is used for acquiring an acquisition signal for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor;
a determining unit, configured to determine an adjustment gain value based on an abnormal degree of abnormality of the acquired image;
an adjustment unit configured to replace an initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value; and processing according to the post-adjustment processing mode to obtain the effective image in the acquired image generated by acquiring the signals under the same environment again, wherein the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signals under the same environment according to the pre-adjustment processing mode.
8. The apparatus of claim 7, the adjusted gain value being less than the initial gain value, and a relationship between a disparity value between the adjusted gain value and the initial gain value and the degree of abnormality being a direct relationship between the disparity value and the degree of abnormality.
9. The apparatus of claim 7, further comprising: and the restoring unit is used for restoring the initial gain value of the processing mode if the acquired image generated based on the adjusted initial gain value is a normal image.
10. The apparatus according to claim 7, wherein the obtaining unit is configured to obtain the captured signal for representing fingerprint image information by using an off-screen optical sensor if a finger fingerprint input is monitored, and wherein the fingerprint image in the captured image generated by processing the captured signal according to the processing mode is the valid image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110136294.0A CN112800981A (en) | 2021-02-01 | 2021-02-01 | Signal processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110136294.0A CN112800981A (en) | 2021-02-01 | 2021-02-01 | Signal processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112800981A true CN112800981A (en) | 2021-05-14 |
Family
ID=75813359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110136294.0A Pending CN112800981A (en) | 2021-02-01 | 2021-02-01 | Signal processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112800981A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114648829A (en) * | 2022-03-14 | 2022-06-21 | 上海齐感电子信息科技有限公司 | Intelligent access control method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060215887A1 (en) * | 2005-03-16 | 2006-09-28 | Sharp Kabushiki Kaisha | Authentication apparatus employing image, method of authentication, authentication program product, and storage medium having the program stored therein |
| KR100724253B1 (en) * | 2005-12-23 | 2007-05-31 | 매그나칩 반도체 유한회사 | Apparatus and method for processing an image to control auto white balance of image sensor |
| JP2011151521A (en) * | 2010-01-20 | 2011-08-04 | Murata Machinery Ltd | Image processor |
| US10621709B1 (en) * | 2017-03-17 | 2020-04-14 | Rockwell Collins, Inc. | Enhancing image quality based on characteristics of a reference region of interest |
-
2021
- 2021-02-01 CN CN202110136294.0A patent/CN112800981A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060215887A1 (en) * | 2005-03-16 | 2006-09-28 | Sharp Kabushiki Kaisha | Authentication apparatus employing image, method of authentication, authentication program product, and storage medium having the program stored therein |
| KR100724253B1 (en) * | 2005-12-23 | 2007-05-31 | 매그나칩 반도체 유한회사 | Apparatus and method for processing an image to control auto white balance of image sensor |
| JP2011151521A (en) * | 2010-01-20 | 2011-08-04 | Murata Machinery Ltd | Image processor |
| US10621709B1 (en) * | 2017-03-17 | 2020-04-14 | Rockwell Collins, Inc. | Enhancing image quality based on characteristics of a reference region of interest |
Non-Patent Citations (1)
| Title |
|---|
| 李友全: "51单片机轻松入门——基于STC15W4K系列(C语言版)(第2版)", vol. 2020, 30 September 2020, 北京航空航天大学出版社, pages: 256 - 257 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114648829A (en) * | 2022-03-14 | 2022-06-21 | 上海齐感电子信息科技有限公司 | Intelligent access control method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Russo | A method for estimation and filtering of Gaussian noise in images | |
| CN110895806A (en) | Method and system for detecting screen display defects | |
| JP5701005B2 (en) | Object detection apparatus, object detection method, surveillance camera system, and program | |
| US4651293A (en) | Image processing system comprising dither screen size selection based on image periodicity | |
| Karaküçük et al. | Adaptive photo-response non-uniformity noise removal against image source attribution | |
| US20180352177A1 (en) | Image-processing device | |
| CA2989188A1 (en) | Method for ir or thermal image enchancement based on scene information for video analysis | |
| US9582868B2 (en) | Image processing apparatus that appropriately performs tone correction in low-illuminance environment, image processing method therefor, and storage medium | |
| DE60139946D1 (en) | PROCESS AND DEVICE FOR IMAGE ERROR CORRECTION AND NOISE FILTERING | |
| JP4689518B2 (en) | Fire detection equipment | |
| US20090324016A1 (en) | Moving target detecting apparatus, moving target detecting method, and computer readable storage medium having stored therein a program causing a computer to function as the moving target detecting apparatus | |
| US9979911B2 (en) | Image processing apparatus, radiation imaging apparatus, image processing method, and storage medium for dark correction | |
| US11350881B2 (en) | Method for suppressing image noise in a video image stream, and associated medical image recording system and computer program product | |
| US9299141B2 (en) | Image analysis apparatus, radiation imaging apparatus, image analysis method, and storage medium | |
| CN112800981A (en) | Signal processing method and device | |
| CN111126147A (en) | Image processing method, device and electronic system | |
| US10755389B2 (en) | Image processing apparatus, image processing method, and medium | |
| CN110542482A (en) | Blind pixel detection method and device and electronic equipment | |
| JP6838651B2 (en) | Image processing equipment, image processing methods and programs | |
| JP6564158B2 (en) | Image processing apparatus, image processing method, and image processing program | |
| CN107862670B (en) | Image restoration method for infrared imaging electric crosstalk | |
| CN112150385B (en) | Infrared image filtering method and device | |
| KR20170043142A (en) | Method and apparatus for detecting water level based on camera in low illumination environment | |
| JP7417426B2 (en) | Anomaly detection device and anomaly detection method | |
| KR101089611B1 (en) | Image target signature detecting device and image target signature detecting method using the device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |