CN112800981B - Signal processing method and device - Google Patents
Signal processing method and device Download PDFInfo
- Publication number
- CN112800981B CN112800981B CN202110136294.0A CN202110136294A CN112800981B CN 112800981 B CN112800981 B CN 112800981B CN 202110136294 A CN202110136294 A CN 202110136294A CN 112800981 B CN112800981 B CN 112800981B
- Authority
- CN
- China
- Prior art keywords
- gain value
- image
- abnormality
- processing mode
- adjustment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/13—Sensors therefor
- G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1347—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/02—Preprocessing
- G06F2218/04—Denoising
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Input (AREA)
Abstract
The application provides a signal processing method and a signal processing device, which are used for obtaining acquisition signals used for representing image information, processing the acquisition signals according to a processing mode to generate acquisition images, wherein the processing mode at least comprises an initial gain value, and the acquisition signals are obtained by an optical sensor; determining an adjustment gain value based on an abnormality degree of an abnormality in the acquired image; based on the adjustment gain value, the initial gain value of the processing mode is replaced by the adjustment gain value, wherein the effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing of the pre-adjustment processing mode, the image restoration effect is improved through the adjustment mode of the initial gain value, and the adaptive adjustment gain value can be used for replacing the initial gain value by different environments based on the abnormal degree of the acquired image.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a signal processing method and apparatus.
Background
The image is abnormal due to the shooting environment, equipment parameters and the like, for example, the image is influenced by overexposure phenomenon due to the illumination intensity of the shooting environment. If the image is abnormal, the electronic device for acquiring the image can adjust device parameters, for example, the illumination intensity can be reduced when the image is over-exposed, such as adjusting the intensity of a light beam emitted by the electronic device or adding a light shielding plate in the electronic device.
Disclosure of Invention
The application provides a signal processing method and device.
In one aspect, the present application provides a signal processing method, including:
Acquiring an acquisition signal used for representing image information, and processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor;
determining an adjustment gain value based on an abnormality degree of abnormality in the acquired image;
Replacing an initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value; the effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing of the pre-adjustment processing mode.
Optionally, the determining the adjustment gain value based on the abnormality degree of the abnormality in the acquired image includes:
if the acquired image has a first abnormal degree, determining the adjustment gain value to a first adjustment gain value;
If the acquired image has a second abnormal degree, determining the adjustment gain value to a second adjustment gain value;
wherein if the first degree of abnormality is greater than the second degree of abnormality, a difference value between the first adjusted gain value and the initial gain value is greater than a difference value between the second adjusted gain value and the initial gain value.
Optionally, the adjustment gain value is smaller than the initial gain value, and the relationship between the difference value between the adjustment gain value and the initial gain value and the abnormality degree is that the difference value and the abnormality degree are in a proportional relationship.
Optionally, the method further comprises: and if the acquired image generated based on the adjusted initial gain value is a normal image, restoring the initial gain value of the processing mode.
Optionally, the acquiring the acquisition signal for characterizing the image information includes:
And if the fingerprint input of the finger is detected, acquiring acquisition signals for representing fingerprint image information by using an under-screen optical sensor, wherein the fingerprint image in the acquisition images generated by processing the acquisition signals according to a processing mode is the effective image.
Optionally, the obtaining manner of the abnormality degree of the abnormality in the acquired image includes:
Determining an abnormal region in the acquired image, wherein the abnormal region is abnormal; acquiring the occupied area of the abnormal region in the acquired image; determining the degree of abnormality from the area;
Or alternatively
Acquiring brightness values of all pixel points in the acquired image; and determining the abnormality degree according to the brightness value of each pixel point and the brightness value of the screen displaying the acquired image.
In another aspect, the present application provides a signal processing apparatus comprising:
the acquisition unit is used for acquiring acquisition signals used for representing image information, processing the acquisition signals according to a processing mode to generate acquisition images, wherein the processing mode at least comprises an initial gain value, and the acquisition signals are obtained by an optical sensor;
a determining unit configured to determine an adjustment gain value based on an abnormality degree of abnormality in the acquired image;
An adjustment unit configured to replace an initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value; the effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing of the pre-adjustment processing mode.
Optionally, the adjustment gain value is smaller than the initial gain value, and the relationship between the difference value between the adjustment gain value and the initial gain value and the abnormality degree is that the difference value and the abnormality degree are in a proportional relationship.
Optionally, the apparatus further includes: and the recovery unit is used for recovering the initial gain value of the processing mode if the acquired image generated based on the adjusted initial gain value is a normal image.
Optionally, the acquiring unit is configured to acquire, by using an on-screen optical sensor, an acquisition signal for characterizing fingerprint image information if a fingerprint input is detected, where a fingerprint image in an acquisition image generated by processing the acquisition signal according to a processing mode is the effective image.
In yet another aspect, the present application provides an electronic device comprising: a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the signal processing method described above.
In still another aspect, the present application provides a storage medium having stored therein instructions that when executed implement the above-described signal processing method.
The signal processing method and the signal processing device acquire the acquisition signals used for representing the image information, process the acquisition signals according to the processing mode to generate the acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signals are acquired by the optical sensor; determining an adjustment gain value based on an abnormality degree of an abnormality in the acquired image; and replacing the initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value, wherein the effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing after adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing before adjustment processing mode, so that the abnormality of the acquired image acquired under the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by an initial gain value adjustment mode. And the adjustment gain value for replacing the initial gain value is determined based on the abnormal degree of the acquired image, so that the adjustment gain values with different abnormal degrees can be different, the adjustment gain value is dynamically adjusted based on the abnormal degree of the acquired image, the different environments can replace the initial gain value by using the adaptive adjustment gain value based on the abnormal degree of the acquired image, the acquired image in the same environment is restored, and the image restoration effect is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a signal processing method according to an embodiment of the present application;
Fig. 2 is a schematic diagram of an application scenario provided in an embodiment of the present application;
FIG. 3 is a flowchart of a signal processing method applied in fingerprint acquisition according to an embodiment of the present application;
FIG. 4 is a schematic illustration of acquired image restoration provided by an embodiment of the present application;
FIG. 5 is a schematic illustration of another acquired image restoration provided by an embodiment of the present application;
FIG. 6 is a flowchart of another signal processing method according to an embodiment of the present application;
Fig. 7 is a schematic structural diagram of a signal processing device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of another signal processing device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1, a flowchart of a signal processing method provided by an embodiment of the present application may include the following steps:
101: acquiring an acquisition signal used for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor.
The light emitted by the electronic equipment irradiates the screen, a part of light penetrates the screen, the light provides illumination for the optical sensor in the process that the optical sensor obtains acquisition signals, and the optical sensor can obtain the acquisition signals used for representing image information under the illumination effect.
In the process that the optical sensor acquires the acquisition signal, the acquisition of the acquisition signal is influenced by the environmental light of the environment where the optical sensor is located, so that at least noise signals generated by the environmental light exist in the acquisition signal. The noise signals in the acquired signals are processed according to the processing mode, the influence of the noise signals can be reduced in the process of processing the acquired signals, and an acquired image with an effective image is generated. For example, the acquisition signal is input to an ADC (Analog-to-Digital Converter ), and the ADC performs Analog-to-digital conversion on the acquisition signal based on an initial gain value in a processing mode, so as to obtain a gray-scale image as an acquisition image, where gray-scale information in the gray-scale image can represent image information.
However, due to the influence of the environmental light of the environment where the optical sensor is located and the factors of the collected object, a certain problem exists in the collected image generated by processing the collected signal based on the initial gain value, for example, the brightness of the environmental light of the environment where the optical sensor is located is too high, so that a white area in the collected image is increased, the over-explosion phenomenon of the collected image is serious, and the collected image cannot be used. If the acquisition object is a finger, the acquired image generated based on the initial gain value processing is likewise rendered unusable if the humidity of the finger surface is too low (i.e., the finger is dry). The reason why the collected image cannot be used is that the collected image has too few effective images, so that the feature data extracted from the collected image is few, and the collected object recovered by the extracted feature data is missing, so that the collected image cannot pass the identification verification.
For example, one application scenario is that the collection object is a finger, and fingerprint identification verification is performed by collecting a fingerprint by the electronic device shown in fig. 2, where the electronic device includes: an off-screen optical sensor (an optical sensor), an ADC and a processor, and having a fingerprint acquisition area in the electronic device, the fingerprint acquisition area being for monitoring whether there is a finger fingerprint input, the corresponding acquisition of acquisition signals for characterizing image information comprising: if the finger fingerprint input is detected, acquiring an acquisition signal used for representing fingerprint image information by using an under-screen optical sensor, transmitting the acquisition signal to an ADC, and processing the acquisition signal according to an initial gain value in a processing mode by the ADC to obtain an acquisition image. The collected image is identified and verified by the processor, if the collected image has an explosion phenomenon, the collected image has too few fingerprint images, so that the collected image cannot be identified and verified by the processor. If the number of fingerprint images in the collected image is too small, the fingerprint feature data extracted from the collected image by the processor is small, and the collected object restored by the processor based on the fingerprint feature data has a defect, such as that the fingerprint cannot be restored or only part of the fingerprint can be restored, as shown in fig. 2, so that the fingerprint cannot pass the identification verification of the processor.
For the above-described case, the present embodiment determines the degree of abnormality in which the acquired image is abnormal, to adjust the initial gain value based on the degree of abnormality, to reduce the abnormality in the acquired image so that the effective image in the acquired image increases. That is, the adjustment of the initial gain value in the present embodiment satisfies two conditions: firstly, abnormality exists; secondly, the degree of abnormality reaches a certain degree, and because the initial gain value has certain redundancy, some degrees of abnormality in the acquired image can be recovered, so if the degree of abnormality is greater than the degree of abnormality corresponding to the initial gain value, the adjustment of the initial gain value is triggered.
The degree of abnormality in which the acquired image is abnormal includes, but is not limited to, the following:
One way is to determine an abnormal region in the acquired image in which an abnormality exists; acquiring the occupied area of an abnormal region in an acquired image; the degree of abnormality is determined from the area. The larger the area occupied by the abnormal region in the acquired image is, the larger the degree of abnormality is; the abnormal region in the acquired image may be, but is not limited to, a white region in the acquired image, the abnormal region is determined by detecting pixel values of pixel points in the acquired image, for example, for the white region, the pixel values of the pixel points are (255, 255, 255), and the pixel points with the values (255, 255, 255) are identified to obtain the occupied area of the abnormal region in the acquired image.
The other way is to acquire the brightness value of each pixel point in the acquired image; and determining the degree of abnormality according to the brightness value of each pixel point and the brightness value of a screen displaying the acquired image. Because the optical sensor collects under the effect of light transmitted through the screen in the process of acquiring the collected signals, the brightness value of the screen has different effects on the brightness value of each pixel point in the collected image, therefore, a threshold value can be determined according to the brightness value of the screen for displaying the collected image, the abnormal degree is determined according to the comparison result of the brightness value of each pixel point in the collected image and the threshold value, for example, the comparison result is used for representing the difference value between the brightness value of each pixel point and the threshold value and the number of the pixel points with the difference, the larger the difference value is, the larger the number of the pixel points with the difference is, and the smaller the abnormal degree is, otherwise. The value of the threshold is not limited in this embodiment.
102: An adjustment gain value is determined based on an abnormality degree of an abnormality in the acquired image.
The adjustment gain value may be greater than the initial gain value or less than the initial gain value, such as when the white area in the captured image (the white area being an invalid image in the captured image) is increased due to an overexplosion, the adjustment gain value is less than the initial gain value to reduce the overexplosion, and otherwise the adjustment gain value is greater than the initial gain value.
And the white area in the acquired image is analyzed under different overexposure conditions, if the white area is larger, the adjustment gain value is smaller, so that the white area in the acquired image can be reduced, and therefore the relationship between the difference value between the adjustment gain value and the initial gain value and the abnormality degree is a proportional relationship between the difference value and the abnormality degree, for example, the larger the abnormality degree is, the larger the difference value is, and the smaller the abnormality degree is, the smaller the difference value is. If the adjusted gain value is less than the initial gain value, the adjusted gain value becomes smaller as the degree of anomaly increases.
Based on the relationship of the adjustment gain value and the degree of anomaly, one way of determining the adjustment gain value may include: if the acquired image has a first abnormal degree, determining an adjustment gain value to a first adjustment gain value; if the acquired image has a second abnormal degree, determining an adjustment gain value to a second adjustment gain value;
If the first abnormality degree is greater than the second abnormality degree, the difference value between the first adjustment gain value and the initial gain value is greater than the difference value between the second adjustment gain value and the initial gain value, and the proportional relation between the difference value and the abnormality degree is satisfied. For example, if the initial gain value needs to be reduced, the first adjusted gain value is less than the second adjusted gain value if the first degree of anomaly is greater than the second degree of anomaly.
103: Based on the adjustment gain value, the initial gain value of the processing mode is replaced by the adjustment gain value so as to improve the effective image in the acquired image generated by acquiring the signal under the same environment again, wherein the improvement means that the effective image in the acquired image generated by acquiring the signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signal under the same environment according to the processing of the pre-adjustment processing mode.
The same environment is the environment where the optical sensor is located when acquiring the acquisition signals, after the initial gain value is replaced by the adjustment gain value, if the acquisition signals under the environment are acquired again through the optical sensor, the acquisition signals are adjusted according to the processing mode by processing the acquisition signals through the adjustment gain value, so that the effective image in the generated acquisition image is larger than the effective image in the acquisition image generated by processing the same acquisition signal through the initial gain value, and the probability of recovering the acquisition object is increased if the occupied area of the effective image is increased or the characteristic data extracted from the effective image is increased.
For the acquired image acquired again, if the abnormality degree of the acquired image acquired again indicates to adjust the initial gain value, the adjustment gain value is determined based on the abnormality degree of the acquired image acquired again, and the initial gain value is continuously adjusted by using the adjustment gain value, so that dynamic continuous adjustment of the initial gain value based on the abnormality degree of the acquired image is realized.
Taking the under-screen optical sensor as an example for fingerprint acquisition, the flow is shown in fig. 3, and the method can comprise the following steps:
201: acquiring an acquisition signal used for representing fingerprint image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, the acquisition signal is acquired by an off-screen optical sensor, and if the off-screen optical sensor is triggered to acquire the signal when the finger fingerprint input is monitored, the acquisition signal is acquired.
202: The degree of abnormality is determined based on the area occupied by the abnormal region in the captured image.
203: If the degree of abnormality belongs to a first type of abnormality, the adjustment gain value is determined to be a first gain value, which may be, but is not limited to, a multiplication of the initial gain value and a first value, and the first value is less than 1.
204: If the degree of abnormality belongs to the second type of abnormality, determining that the adjustment gain value is a second gain value, wherein the second gain value can be obtained by multiplying, but not limited to, an initial gain value and a second value, and the second value is smaller than 1, the degree of abnormality of the second type of abnormality is larger than the degree of abnormality of the first type of abnormality, and the second value is smaller than the first value, so that the second gain value is smaller than the first gain value.
205: If the degree of abnormality belongs to a third type of abnormality, determining that the adjustment gain value is a third gain value, wherein the third gain value may be, but is not limited to, obtained by multiplying an initial gain value and a third value, and the third value is smaller than 1, and the degree of abnormality of the third type of abnormality is greater than the degree of abnormality of the second type of abnormality, and the third value is smaller than the second value, so that the third gain value is smaller than the second gain value, and for the first type of abnormality, the second type of abnormality and the third type of abnormality, the division may be performed by two degrees of abnormality, and the embodiment of how to divide and take the values from the first value to the third value is not limited. And besides the method of multiplying the initial gain value by the numerical value to obtain the adjustment gain value, the adjustment gain value can be obtained by adopting any method such as subtraction, division and the like.
206: Based on the adjustment gain value, the initial gain value of the processing mode is replaced by the adjustment gain value so as to improve the effective image in the acquired image generated by acquiring the signal under the same environment again, wherein the improvement means that the effective image in the acquired image generated by acquiring the signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signal under the same environment according to the processing of the pre-adjustment processing mode.
The effect of collecting the fingerprint image by using one electronic device and processing the fingerprint image by using each adjustment gain value shown in fig. 3 is described, as shown in fig. 4, which shows an effect diagram of repairing different adjustment gain values, a collected image is obtained by using the electronic device shown in fig. 4, and an over-explosion phenomenon exists in the collected image due to the problem of ambient light, as shown in fig. 4, too many white areas in the collected image make the effective images in the collected image less, and effective characteristic data cannot be extracted. In this case, by adjusting the initial gain value in the manner shown in fig. 3, the effective image in the acquired image generated from the acquired signal obtained again from the same environment is improved, for example, the effective image in the acquired image is different by different adjusted initial gain values in fig. 4, and the repair effect is better as the smaller the adjusted initial gain value is, the more effective images are.
If the initial gain value is adjusted such that the degree of abnormality is still present and severe after the use of one adjustment, the initial gain value may be continuously adjusted as shown in fig. 5. If the degree of abnormality of the acquired image is still serious after the adjustment by adopting the first gain value, the adjustment gain value can be continuously determined based on the degree of abnormality of the acquired image obtained again, and the adjustment of the initial gain value can be continuously performed. The initial gain value can be the gain value adopted in the digital-analog conversion process of the ADC, and the gain value of the ADC can be dynamically and continuously adjusted in the mode.
The signal processing method comprises the steps of obtaining an acquisition signal used for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is obtained by an optical sensor; determining an adjustment gain value based on an abnormality degree of an abnormality in the acquired image; and replacing the initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value, wherein the effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing after adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing before adjustment processing mode, so that the abnormality of the acquired image acquired under the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by an initial gain value adjustment mode. And the adjustment gain value for replacing the initial gain value is determined based on the abnormal degree of the acquired image, so that the adjustment gain values with different abnormal degrees can be different, the adjustment gain value is dynamically adjusted based on the abnormal degree of the acquired image, the different environments can replace the initial gain value by using the adaptive adjustment gain value based on the abnormal degree of the acquired image, the acquired image in the same environment is restored, and the image restoration effect is improved.
Referring to fig. 6, a flowchart of another signal processing method provided by an embodiment of the present application may include the following steps:
301: acquiring an acquisition signal used for representing image information, processing the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is acquired by an optical sensor.
302: An adjustment gain value is determined based on an abnormality degree of an abnormality in the acquired image.
303: Based on the adjustment gain value, the initial gain value of the processing mode is replaced by the adjustment gain value so as to improve the effective image in the acquired image generated by acquiring the signal under the same environment again, wherein the improvement means that the effective image in the acquired image generated by acquiring the signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the signal under the same environment according to the processing of the pre-adjustment processing mode.
304: If the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored, i.e., the initial gain value of the processing mode is restored to the original value. This is because the initial gain value of the processing mode is in an original value and can be adapted to various situations, such as a situation that there is no abnormality in adapting the acquired image and there is an abnormality in the acquired image but the abnormality program is smaller than a preset level, and the initial gain value is adjusted because the environment in which it is located is subjected to a sudden change or the like, and the adjusted initial gain value is suitable for the environment in which it is located when it is adjusted, meaning that the adjusted initial gain value is not adapted in most cases, so if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored.
The collected image generated based on the adjusted initial gain value is a normal image, so that the collected image can be characterized that the collected image is not abnormal, the collected image has abnormality but has an abnormality program smaller than a preset degree, and the collected object can be effectively recovered under the conditions, so that if the collected image is not abnormal or the collected image has abnormality but has an abnormality program smaller than the preset degree, the collected image generated based on the adjusted initial gain value is determined to be a normal image. The preset degree is an abnormal degree when the acquired images are different but the characteristic data extracted from the acquired images can recover the acquired object, and the value of the preset degree is not limited in this embodiment.
According to the signal processing method, if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is recovered, namely, the initial gain value of the processing mode is recovered to the original value, so that the acquired signal is processed through the initial gain value, and as the initial gain value of the processing mode is in the original value, multiple conditions can be adapted, so that the processing recovery requirements of the acquired image in multiple scenes can be adapted, and the recovery accuracy and efficiency are improved.
In addition to the above-mentioned recovery of the initial gain value of the processing mode, this embodiment may also employ other modes, such as, after the initial gain value is adjusted for a preset period of time, if the acquired image generated based on the adjusted initial gain value is a normal image, recovering the initial gain value of the processing mode; or if the environment where the optical sensor is located changes, the initial gain value of the processing mode is recovered, where the change of the environment where the optical sensor is located may be, but is not limited to, that the intensity of the ambient light is monitored, and the method of recovering the initial gain value of the processing mode is not limited in this embodiment.
For the foregoing method embodiments, for simplicity of explanation, the methodologies are shown as a series of acts, but one of ordinary skill in the art will appreciate that the present application is not limited by the order of acts, as some steps may, in accordance with the present application, occur in other orders or concurrently. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.
Corresponding to the above method embodiment, the embodiment of the present application further provides a signal processing device, where an optional structure of the signal processing device is shown in fig. 7, and the signal processing device may include: an acquisition unit 10, a determination unit 20 and an adjustment unit 30.
The acquisition unit 10 is configured to acquire an acquisition signal for representing image information, process the acquisition signal according to a processing mode to generate an acquisition image, where the processing mode includes at least an initial gain value, and acquire the acquisition signal by using an optical sensor.
In the process that the optical sensor acquires the acquisition signal, the acquisition of the acquisition signal is influenced by the environmental light of the environment where the optical sensor is located, so that at least noise signals generated by the environmental light exist in the acquisition signal. The noise signals in the acquired signals are processed according to the processing mode, the influence of the noise signals can be reduced in the process of processing the acquired signals, and an acquired image with an effective image is generated. For example, the acquisition signal is input into an ADC, and the ADC performs analog-to-digital conversion on the acquisition signal based on an initial gain value in the processing mode, so as to obtain a gray-scale image as an acquisition image, where gray-scale information in the gray-scale image can represent image information.
For example, the optical sensor may be an off-screen optical sensor, and the obtaining unit 10 is configured to obtain, using the off-screen optical sensor, an acquisition signal for characterizing fingerprint image information if a fingerprint input is detected, wherein a fingerprint image in an acquisition image generated by processing the acquisition signal according to a processing mode is a valid image.
However, due to the influence of the environmental light of the environment where the optical sensor is located and the factors of the collected object, a certain problem exists in the collected image generated by processing the collected signal based on the initial gain value, and the use of the collected image is affected, so that the adjustment of the gain value based on the collected image can be triggered to be determined in the embodiment so as to adjust the initial gain value. The degree of abnormality in which the acquired image is abnormal includes, but is not limited to, the following:
One way is to determine an abnormal region in the acquired image in which an abnormality exists; acquiring the occupied area of an abnormal region in an acquired image; the degree of abnormality is determined from the area. The other way is to acquire the brightness value of each pixel point in the acquired image; and determining the degree of abnormality according to the brightness value of each pixel point and the brightness value of a screen displaying the acquired image.
A determining unit 20 for determining an adjustment gain value based on an abnormality degree of an abnormality in the acquired image. The adjustment gain value may be greater than the initial gain value or less than the initial gain value, such as when the white area in the captured image (the white area being an invalid image in the captured image) is increased due to an overexplosion, the adjustment gain value is less than the initial gain value to reduce the overexplosion, and otherwise the adjustment gain value is greater than the initial gain value. The relationship between the difference value and the abnormality degree between the adjustment gain value and the initial gain value is that the difference value and the abnormality degree are in a direct proportion, for example, the larger the abnormality degree is, the larger the difference value is, and the smaller the abnormality degree is, the smaller the difference value is. If the adjusted gain value is less than the initial gain value, the adjusted gain value becomes smaller as the degree of anomaly increases.
Based on the relationship between the adjustment gain value and the degree of abnormality, one way of determining the adjustment gain value by the determining unit 20 may include: if the acquired image has a first abnormal degree, determining an adjustment gain value to a first adjustment gain value; if the acquired image has a second abnormal degree, determining an adjustment gain value to a second adjustment gain value;
If the first abnormality degree is greater than the second abnormality degree, the difference value between the first adjustment gain value and the initial gain value is greater than the difference value between the second adjustment gain value and the initial gain value, and the proportional relation between the difference value and the abnormality degree is satisfied. For example, if the initial gain value needs to be reduced, the first adjusted gain value is less than the second adjusted gain value if the first degree of anomaly is greater than the second degree of anomaly.
An adjusting unit 30 for replacing the initial gain value of the processing mode with the adjusted gain value based on the adjusted gain value. The effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing of the post-adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing of the pre-adjustment processing mode.
The same environment is the environment where the optical sensor is located when acquiring the acquisition signals, after the initial gain value is replaced by the adjustment gain value, if the acquisition signals under the environment are acquired again through the optical sensor, the acquisition signals are adjusted according to the processing mode by processing the acquisition signals through the adjustment gain value, so that the effective image in the generated acquisition image is larger than the effective image in the acquisition image generated by processing the same acquisition signal through the initial gain value, and the probability of recovering the acquisition object is increased if the occupied area of the effective image is increased or the characteristic data extracted from the effective image is increased.
For the acquired image acquired again, if the abnormality degree of the acquired image acquired again indicates to adjust the initial gain value, the adjustment gain value is determined based on the abnormality degree of the acquired image acquired again, and the initial gain value is continuously adjusted by using the adjustment gain value, so that dynamic continuous adjustment of the initial gain value based on the abnormality degree of the acquired image is realized.
The signal processing device acquires an acquisition signal used for representing image information, processes the acquisition signal according to a processing mode to generate an acquisition image, wherein the processing mode at least comprises an initial gain value, and the acquisition signal is obtained by an optical sensor. An adjustment gain value is determined based on an abnormality degree of an abnormality in the acquired image. And replacing the initial gain value of the processing mode with the adjustment gain value based on the adjustment gain value, wherein the effective image in the acquired image generated by acquiring the acquired signal under the same environment again according to the processing after adjustment processing mode is larger than the effective image in the acquired image generated by acquiring the acquired signal under the same environment according to the processing before adjustment processing mode, so that the abnormality of the acquired image acquired under the same environment is improved by adjusting the initial gain value in the processing mode, and the image restoration effect is improved by an initial gain value adjustment mode. And the adjustment gain value for replacing the initial gain value is determined based on the abnormal degree of the acquired image, so that the adjustment gain values with different abnormal degrees can be different, the adjustment gain value is dynamically adjusted based on the abnormal degree of the acquired image, the different environments can replace the initial gain value by using the adaptive adjustment gain value based on the abnormal degree of the acquired image, the acquired image in the same environment is restored, and the image restoration effect is improved.
Referring to fig. 8, an optional structure of another signal processing apparatus provided in an embodiment of the present application may further include: and a restoring unit 40 for restoring the initial gain value of the processing mode, i.e., restoring the initial gain value of the processing mode to the original value, if the acquired image generated based on the adjusted initial gain value is a normal image. This is because the initial gain value of the processing mode is in an original value and can be adapted to various situations, such as a situation that there is no abnormality in adapting the acquired image and there is an abnormality in the acquired image but the abnormality program is smaller than a preset level, and the initial gain value is adjusted because the environment in which it is located is subjected to a sudden change or the like, and the adjusted initial gain value is suitable for the environment in which it is located when it is adjusted, meaning that the adjusted initial gain value is not adapted in most cases, so if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is restored.
The collected image generated based on the adjusted initial gain value is a normal image, so that the collected image can be characterized that the collected image is not abnormal, the collected image has abnormality but has an abnormality program smaller than a preset degree, and the collected object can be effectively recovered under the conditions, so that if the collected image is not abnormal or the collected image has abnormality but has an abnormality program smaller than the preset degree, the collected image generated based on the adjusted initial gain value is determined to be a normal image. The preset degree is an abnormal degree when the acquired images are different but the characteristic data extracted from the acquired images can recover the acquired object, and the value of the preset degree is not limited in this embodiment.
According to the signal processing device, if the acquired image generated based on the adjusted initial gain value is a normal image, the initial gain value of the processing mode is recovered, namely, the initial gain value of the processing mode is recovered to the original value, so that the acquired signal is processed through the initial gain value, and as the initial gain value of the processing mode is in the original value, multiple conditions can be adapted, so that the processing recovery requirements of the acquired image in multiple scenes can be adapted, and the recovery accuracy and efficiency are improved.
The embodiment of the application also provides electronic equipment, which comprises: a processor and a memory for storing processor-executable instructions. Wherein the processor is configured to execute instructions to implement the above-described signal processing method.
The embodiment of the application also provides a storage medium, wherein the storage medium stores instructions, and the signal processing method is realized when the instructions in the storage medium are executed.
It should be noted that, each embodiment in the present specification may be described in a progressive manner, and features described in each embodiment in the present specification may be replaced or combined with each other, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110136294.0A CN112800981B (en) | 2021-02-01 | 2021-02-01 | Signal processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110136294.0A CN112800981B (en) | 2021-02-01 | 2021-02-01 | Signal processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112800981A CN112800981A (en) | 2021-05-14 |
| CN112800981B true CN112800981B (en) | 2024-11-26 |
Family
ID=75813359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110136294.0A Active CN112800981B (en) | 2021-02-01 | 2021-02-01 | Signal processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112800981B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114648829A (en) * | 2022-03-14 | 2022-06-21 | 上海齐感电子信息科技有限公司 | Intelligent access control method and system |
| CN115797204A (en) * | 2022-11-15 | 2023-03-14 | 珠海全志科技股份有限公司 | Method and device for self-adaptive dark corner correction |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006260054A (en) * | 2005-03-16 | 2006-09-28 | Sharp Corp | Authentication device, authentication method, authentication program for causing computer to execute authentication method, and machine-readable recording medium recording the program |
| KR100724253B1 (en) * | 2005-12-23 | 2007-05-31 | 매그나칩 반도체 유한회사 | Image processing apparatus and method for adjusting automatic white balance of an image sensor |
| JP2011151521A (en) * | 2010-01-20 | 2011-08-04 | Murata Machinery Ltd | Image processor |
| US10621709B1 (en) * | 2017-03-17 | 2020-04-14 | Rockwell Collins, Inc. | Enhancing image quality based on characteristics of a reference region of interest |
-
2021
- 2021-02-01 CN CN202110136294.0A patent/CN112800981B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112800981A (en) | 2021-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6049314B2 (en) | Radiation imaging apparatus and image processing method | |
| Karaküçük et al. | Adaptive photo-response non-uniformity noise removal against image source attribution | |
| JP5679767B2 (en) | Fingerprint authentication apparatus and fingerprint authentication program | |
| US20180352177A1 (en) | Image-processing device | |
| CN112800981B (en) | Signal processing method and device | |
| US9582868B2 (en) | Image processing apparatus that appropriately performs tone correction in low-illuminance environment, image processing method therefor, and storage medium | |
| US20180225522A1 (en) | Ir or thermal image enhancement method based on background information for video analysis | |
| JP2018029237A5 (en) | ||
| CN105828065B (en) | A kind of video pictures overexposure detection method and device | |
| US9979911B2 (en) | Image processing apparatus, radiation imaging apparatus, image processing method, and storage medium for dark correction | |
| JP6246508B2 (en) | Moving body image extraction method and moving body image extraction apparatus | |
| WO2019026513A1 (en) | Image monitoring device, image monitoring method, image monitoring program, and recording medium | |
| JP2019029948A (en) | Image monitoring apparatus, image monitoring method, and image monitoring program | |
| JP4872830B2 (en) | Imaging apparatus, imaging method, image processing apparatus, image processing program, and image processing method | |
| JP4533836B2 (en) | Fluctuating region detection apparatus and method | |
| GB2514301A (en) | Object detection device, object detection method and program | |
| CN111429369B (en) | High dynamic range image generation method, device, electronic device and storage medium | |
| JP3655496B2 (en) | VEHICLE DETECTING DEVICE, VEHICLE DETECTING METHOD, AND COMPUTER-READABLE RECORDING MEDIUM CONTAINING VEHICLE DETECTING PROGRAM | |
| JP5279236B2 (en) | Target imaging detector | |
| JP6838651B2 (en) | Image processing equipment, image processing methods and programs | |
| JP2021111928A (en) | Abnormality detection device and abnormality detection method | |
| JP5137738B2 (en) | Imaging apparatus, control method thereof, and program | |
| Song et al. | A new tone-mapped image quality assessment approach for high dynamic range imaging system | |
| CN117372299A (en) | A scene-adaptive infrared image non-uniform correction method and device | |
| CN114283170A (en) | Light spot extraction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |