CN111539902A - Image processing method, system, equipment and computer readable storage medium - Google Patents
Image processing method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN111539902A CN111539902A CN202010300217.XA CN202010300217A CN111539902A CN 111539902 A CN111539902 A CN 111539902A CN 202010300217 A CN202010300217 A CN 202010300217A CN 111539902 A CN111539902 A CN 111539902A
- Authority
- CN
- China
- Prior art keywords
- image
- detail
- target
- visible light
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
Abstract
The application discloses an image processing method, a system, equipment and a computer readable storage medium, which are used for acquiring a target visible light image and a target infrared image corresponding to a target scene; determining detail information of a target visible light image; determining detail gain of a target visible light image; and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image. According to the method and the device, after the target visible light image and the target infrared image are obtained, the detail information and the detail gain of the target visible light image are determined, and the detail information and the target infrared image are fused based on the detail gain, so that a fused image which is only fused by the detail information of the target visible light image and the target infrared image is obtained, the corresponding relation between infrared temperature information and a palette cannot be changed, the interpretation of the temperature information of the fused image cannot be influenced, and the fusion effect of the infrared image and the visible light image is improved.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image processing method, system, device, and computer-readable storage medium.
Background
With the development of image processing technology, in the process of taking an image of a target scene, in order to make the image reflect information of the target scene in a diversified manner, the taken image can be processed by adopting an image fusion method, i.e. image information of different detectors is combined and displayed.
The infrared image can provide the temperature information of the scene, and the visible light image has rich scene details, so that the infrared image and the visible light image of the target scene can be fused to obtain the fused image fusing the temperature information and the visible light information of the target scene, and a user can conveniently and more accurately and more easily position the specific position of the object with the specific temperature.
However, in the process of fusing the infrared image and the visible light image, the corresponding relationship between the infrared temperature information and the color palette is changed, and the interpretation of the temperature information of the fused image is affected, so that the image fusion effect is poor.
In summary, how to improve the fusion effect of the infrared image and the visible light image is a problem to be solved urgently by those skilled in the art.
Disclosure of Invention
The application aims to provide an image processing method which can solve the technical problem of improving the fusion effect of an infrared image and a visible light image to a certain extent. The application also provides an image processing system, an image processing device and a computer readable storage medium.
In order to achieve the above purpose, the present application provides the following technical solutions:
an image processing method comprising:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of the target visible light image;
determining a detail gain of the target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
Preferably, the fusing the detail information with the target infrared image based on the detail gain to obtain a fused image includes:
acquiring adjustment information input by a user;
and fusing the detail information and the target infrared image based on the detail gain and the adjusting information to obtain the fused image.
Preferably, the determining the detail information of the target visible light image includes:
extracting the target visible light image on a preset image channel to obtain an extracted image;
carrying out low-pass filtering on the extracted image to obtain a filtered image;
determining the detail information based on the extracted image and the filtered image.
Preferably, the determining the detail information based on the extracted image and the filtered image includes:
dividing pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image;
and taking the difference value between the quotient image and 1 as the detail information.
Preferably, the determining the detail gain of the target visible light image includes:
calculating the detail intensity of the target visible light image based on the extracted image;
and taking the reciprocal of the detail intensity as the detail gain.
Preferably, the calculating the detail gain of the target visible light image based on the extracted image includes:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range containing the pixel points.
Preferably, the calculating the detail gain of the target visible light image based on the extracted image includes:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets the preset relation with the preset difference value;
the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in the preset unit; the preset range is a range containing the pixel points.
Preferably, after the taking the inverse of the detail intensity as the detail gain, the method further includes:
and judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
Preferably, the acquiring a target visible light image and a target infrared image corresponding to a target scene includes:
acquiring an initial visible light image and an initial infrared image corresponding to the target scene;
adjusting the initial visible light image to the target visible light image based on preset information, the initial visible light image and the initial infrared image;
adjusting the initial infrared image to be the target infrared image based on preset information, the initial visible light image and the initial infrared image;
the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
An image processing system comprising:
the first acquisition module is used for acquiring a target visible light image and a target infrared image corresponding to a target scene;
the first determining module is used for determining detail information of the target visible light image;
a second determining module, configured to determine a detail gain of the target visible light image;
and the first fusion module is used for fusing the detail information and the target infrared image based on the detail gain to obtain a fusion image.
An image processing apparatus comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image processing method as described in any one of the above when executing the computer program.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the image processing method as set forth in any one of the preceding claims.
The image processing method comprises the steps of obtaining a target visible light image and a target infrared image corresponding to a target scene; determining detail information of a target visible light image; determining detail gain of a target visible light image; and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image. According to the method and the device, after the target visible light image and the target infrared image are obtained, the detail information and the detail gain of the target visible light image are determined, and the detail information and the target infrared image are fused based on the detail gain, so that a fused image which is only fused by the detail information of the target visible light image and the target infrared image is obtained, the corresponding relation between infrared temperature information and a palette cannot be changed, the interpretation of the temperature information of the fused image cannot be influenced, and the fusion effect of the infrared image and the visible light image is improved. The image processing system, the image processing device and the computer readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first flowchart of an image processing method according to an embodiment of the present application;
fig. 2 is a second flowchart of an image processing method according to an embodiment of the present application;
fig. 3 is a third flowchart of an image processing method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an image processing system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 6 is another schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
With the development of image processing technology, in the process of taking an image of a target scene, in order to make the image reflect information of the target scene in a diversified manner, the taken image can be processed by adopting an image fusion method, i.e. image information of different detectors is combined and displayed. The infrared image can provide the temperature information of the scene, and the visible light image has rich scene details, so that the infrared image and the visible light image of the target scene can be fused to obtain the fused image fusing the temperature information and the visible light information of the target scene, and a user can conveniently and more accurately and more easily position the specific position of the object with the specific temperature. However, in the process of fusing the infrared image and the visible light image in the prior art, the temperature data and the color or brightness data of the visible light are fused, so that the corresponding relationship between the infrared temperature information and the color palette is changed, and the interpretation of the temperature information of the fused image is influenced, so that the image fusion effect is poor. The image processing method provided by the application can improve the fusion effect of the infrared image and the visible light image.
Referring to fig. 1, fig. 1 is a first flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S101: and acquiring a target visible light image and a target infrared image corresponding to the target scene.
In practical application, a target visible light image and a target infrared image corresponding to a target scene may be obtained first, the target visible light image refers to an image obtained by shooting the target scene through a visible light system, the target infrared image refers to an image obtained by shooting the target scene through an infrared system, and the target scene may be determined according to actual needs, which is not specifically limited herein.
Step S102: and determining the detail information of the target visible light image.
In practical application, after a target visible light image and a target infrared image are obtained, the detail information of the target visible light image can be determined; the detail information refers to the texture of the image, the edge contour information of the object in the image, and the place where the color change exists in the image.
Step S103: the detail gain of the target visible light image is determined.
In practical application, after the detail information is determined, the detail gain of the target visible light image can be determined; the detail gain is used for balancing the strength of the details, so that the situation that the details are strong is avoided, the situation that the details are weak is avoided, and the details are uniform and fine.
Step S104: and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
In practical application, the detail gain is used for balancing the strength of the details, so that the situation that the details are strong is avoided, the situation that the details are weak is avoided, and the details are uniform and fine, so that after the detail gain is determined, the detail information and the target infrared image can be fused based on the detail gain to obtain a fused image, and the detail information of the target visible light image can be uniformly and finely fused with the target infrared image.
It should be noted that the type of the fused image may be determined by the type of the target infrared image, for example, when the target infrared image is a gray-scale image, the fused image is a gray-scale image with visible light detail enhancement; when the target infrared image is a three-channel color image after pseudo color enhancement, the fused image is a color image with visible light detail enhancement.
The image processing method comprises the steps of obtaining a target visible light image and a target infrared image corresponding to a target scene; determining detail information of a target visible light image; determining detail gain of a target visible light image; and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image. According to the method and the device, after the target visible light image and the target infrared image are obtained, the detail information and the detail gain of the target visible light image are determined, and the detail information and the target infrared image are fused based on the detail gain, so that a fused image which is only fused by the detail information of the target visible light image and the target infrared image is obtained, the corresponding relation between infrared temperature information and a palette cannot be changed, the interpretation of the temperature information of the fused image cannot be influenced, and the fusion effect of the infrared image and the visible light image is improved.
Referring to fig. 2, fig. 2 is a second flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S201: and acquiring a target visible light image and a target infrared image corresponding to the target scene.
Step S202: and extracting the target visible light image on a preset image channel to obtain an extracted image.
In practical application, since the target visible light image is a three-channel color image, and the detail information can be extracted in one of the image channels, such as the green channel, or in three image channels, when the detail information of the target visible light image is determined, the target visible light image can be extracted in the preset image channel to obtain an extracted image. Of course, the extracted image may be extracted from the luminance component of the target visible light image.
It should be noted that if the extracted image is from a single channel of the target visible light image, the obtained detail information is also in a single channel, and at this time, the detail information may be directly fused with the target infrared image, or the detail information may be respectively superimposed on three components of the target infrared image; correspondingly, when the extracted image comes from three channels of the target visible light image, the detail information is also three channels, at this time, the detail information can be directly fused with the target infrared image, and the average value of the three channels of the detail information can also be obtained and fused with the target infrared image.
Step S203: and carrying out low-pass filtering on the extracted image to obtain a filtered image.
In practical application, in order to determine detail information conveniently, after an extracted image is obtained, low-pass filtering can be performed on the extracted image to obtain a filtered image, and since the filtered image after low-pass filtering is obviously different from the extracted image in the position of image details, the detail information can be determined by the extracted image and the filtered image subsequently.
It should be noted that the type of the low-pass filter used for performing the low-pass filtering may be determined according to actual needs, such as an average filter, a gaussian filter, etc., or a combination of these low-pass filters, etc.
Step S204: detail information is determined based on the extracted image and the filtered image.
Step S205: the detail gain of the target visible light image is determined.
Step S206: and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
In practical application, the step of determining the detail information based on the extracted image and the filtered image may specifically be: dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; and taking the difference value of the quotient image and 1 as detail information.
In the process, the difference value between the quotient image and 1 is used as detail information, so that the difference value between the quotient image and 1 is almost equal before and after the local filtering without color or brightness change in the image is divided, the division is equal to 1, and the difference between the division and 1 is equal to 0; the edge part of an object in the image has difference before and after filtering, is not equal to 1 after division, and is not equal to 0 after subtraction with 1; therefore, a value of 0 for the detail information indicates that there is no detail information, and a value of 0 for the detail information indicates that there is detail information.
In a specific application scenario, the detailed information may be obtained by calculating a formula VLdetail ═ VL/VL _ lp-1, a formula VLdetail ═ VL _ lp/VL-1, a formula VLdetail ═ 1-VL _ lp/VL, or a formula VLdetail ═ 1-VL/VL _ lp; where VLdetail represents detail information, VL represents an extracted image, and VL _ lp represents a filtered image.
Referring to fig. 3, fig. 3 is a third flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S301: and acquiring a target visible light image and a target infrared image corresponding to the target scene.
Step S302: and extracting the target visible light image on a preset image channel to obtain an extracted image.
Step S303: and carrying out low-pass filtering on the extracted image to obtain a filtered image.
Step S304: detail information is determined based on the extracted image and the filtered image.
Step S305: and calculating the detail intensity of the target visible light image based on the extracted image.
Step S306: the reciprocal of the detail intensity is taken as the detail gain.
In practical application, the detail intensity is the definition degree of the edge of the object in the image, the detail intensity value is large if the edge of the object in the image is clear, and the detail intensity value is small if the edge of the object in the image is blurred, so that in order to determine the detail gain, the process of determining the detail gain of the target visible light image may specifically be: calculating the detail intensity of the target visible light image based on the extracted image; the reciprocal of the detail intensity is taken as the detail gain.
It should be noted that, since the reciprocal of the detail strength is taken as the detail gain, the detail gain is inversely related to the detail strength, so that the detail gain can balance the strength of the detail, so as not to make the places where the detail is strong stronger and the places where the detail is weak weaker, and finally make the detail more uniform and finer.
Step S307: and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
In practical application, the step of calculating the detail gain of the target visible light image based on the extracted image may specifically be: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range including pixel points. The size of the preset range may be determined according to actual needs, for example, the preset range is a 5X5 area, a 3X3 area, and the like, and the preset range may be an area with a pixel point as a center point.
In practical application, the step of calculating the detail gain of the target visible light image based on the extracted image may specifically be: calculating a detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets a preset relation with a preset difference value; the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
In a specific application scenario, assuming that the preset range is a region of 5X5, when the detail intensity of a pixel point is defined as the variance of the pixel value within the preset range, the formula can be used
Calculating the detail intensity; when the pixel point isWhen the detail intensity is defined by the variance of the pixel value within the preset range, the formula can be used
Calculating to obtain detail intensity; when the detail intensity of the pixel point and the preset difference value meet the definition of the preset relation, and the preset difference value is the difference value between the pixel value and the central point in the preset range, the formula can be used
Calculating the detail intensity and the like. Wherein the content of the first and second substances,
s (m, n) represents the detail intensity of the pixel point with the coordinate (m, n); sigma1And σ2Representing an adjustable variable; sigma2Associated with the preset range, it may be a value of one third of the radius of the preset range; sigma1May be a function of the difference between the maximum and minimum gray levels, e.g. sigma1＝(graymax-graymin)/N，graymaxRepresenting the maximum value of the grayminRepresenting the minimum value of the gray scale, the value of N can be determined as desired, such as 16, etc. Correspondingly, can pass through simultaneously
And calculating to obtain detail gains, wherein G (m, n) represents the detail gains of the pixel points with the coordinates (m, n).
In the image processing method provided by the embodiment of the application, for a uniform region in an image, the detail intensity is close to 0, the detail gain is infinite, and accordingly, noise of the uniform region can be infinitely amplified, so that in order to avoid amplifying the noise of the uniform region, the detail gain of the uniform region in the image can be set to 0, the uniform region in the image has almost no detail information, and therefore enhancement is not needed, after the reciprocal of the detail intensity is taken as the detail gain, whether the value of the detail gain is greater than a preset threshold value can also be judged, if yes, the value of the detail gain is adjusted to 0, and if no, the value of the detail gain is kept unchanged.
In the image processing method provided by the embodiment of the application, in the process of image fusion by a user, the user may need to control the fusion process of the target visible light image and the target infrared image according to the user's own needs, and then based on the detail gain, the detail information and the target infrared image are fused to obtain the process of the fusion image, and the process may be as follows: acquiring adjustment information input by a user; and fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fused image. Assuming that the adjustment information input by the user is represented by D, a fused Image can be obtained by the formula Image _ fusion ═ D × G × VL _ detail + IR, where Image _ fusion represents the fused Image and IR represents the target infrared Image.
In the image processing method provided in the embodiment of the present application, the step of obtaining the target visible light image and the target infrared image corresponding to the target scene may specifically be: acquiring an initial visible light image and an initial infrared image corresponding to a target scene; adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image; adjusting the initial infrared image into a target infrared image based on preset information, the initial visible light image and the initial infrared image; the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
In a specific application scene, the size difference and the resolution difference between the initial visible light image and the initial infrared image can be directly adjusted to a first preset range and a second preset range respectively, and the initial visible light image and the initial infrared image can also be adjusted by means of a third-party image.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an image processing system according to an embodiment of the present disclosure.
An image processing system provided in an embodiment of the present application may include:
a first obtaining module 101, configured to obtain a target visible light image and a target infrared image corresponding to a target scene;
a first determining module 102, configured to determine detail information of a target visible light image;
a second determining module 103, configured to determine a detail gain of the target visible light image;
and the first fusion module 104 is configured to fuse the detail information and the target infrared image based on the detail gain to obtain a fusion image.
In an image processing system provided in an embodiment of the present application, the first fusion module may include:
the first acquisition submodule is used for acquiring the adjustment information input by a user;
and the first fusion submodule is used for fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fusion image.
In an image processing system provided by an embodiment of the present application, the first determining module may include:
the first extraction submodule is used for extracting the target visible light image on a preset image channel to obtain an extracted image;
the first filtering submodule is used for carrying out low-pass filtering on the extracted image to obtain a filtered image;
a first determining sub-module for determining detail information based on the extracted image and the filtered image.
In an image processing system provided by an embodiment of the present application, the first determining sub-module may include:
the first calculation unit is used for dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image;
and the first setting unit is used for taking the difference value between the quotient image and 1 as detail information.
In an image processing system provided by an embodiment of the present application, the second determining module may include:
the first calculation submodule is used for calculating the detail intensity of the target visible light image based on the extracted image;
and the first setting submodule is used for taking the reciprocal of the detail intensity as the detail gain.
In an image processing system provided in an embodiment of the present application, the first computing sub-module may include:
the second calculation unit is used for calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value within the preset range; the preset range is a range including pixel points.
In an image processing system provided in an embodiment of the present application, the first computing sub-module may include:
the third calculating unit is used for calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets the preset relation with the preset difference value;
the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
The image processing system provided in the embodiment of the present application may further include:
and the first judgment sub-module is used for judging whether the value of the detail gain is greater than a preset threshold value after the first setting sub-module takes the reciprocal of the detail intensity as the detail gain, if so, the value of the detail gain is adjusted to be 0, and if not, the value of the detail gain is kept unchanged.
In an image processing system provided in an embodiment of the present application, the first obtaining sub-module may include:
the device comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring an initial visible light image and an initial infrared image corresponding to a target scene;
the first adjusting unit is used for adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image;
the second adjusting unit is used for adjusting the initial infrared image into a target infrared image based on the preset information, the initial visible light image and the initial infrared image;
the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
The application also provides an image processing device and a computer readable storage medium, which have the corresponding effects of the image processing method provided by the embodiment of the application. Referring to fig. 5, fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of a target visible light image;
determining detail gain of a target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring adjustment information input by a user; and fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fused image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: extracting the target visible light image on a preset image channel to obtain an extracted image; carrying out low-pass filtering on the extracted image to obtain a filtered image; detail information is determined based on the extracted image and the filtered image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; and taking the difference value of the quotient image and 1 as detail information.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: calculating the detail intensity of the target visible light image based on the extracted image; the reciprocal of the detail intensity is taken as the detail gain.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range including pixel points.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: calculating a detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets a preset relation with a preset difference value; the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: and after the reciprocal of the detail intensity is taken as the detail gain, judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring an initial visible light image and an initial infrared image corresponding to a target scene; adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image; adjusting the initial infrared image into a target infrared image based on preset information, the initial visible light image and the initial infrared image; the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
Referring to fig. 6, another image processing apparatus provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting externally input commands to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the image processing device and the outside. The display unit 204 may be a display panel, a laser scanning display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of a target visible light image;
determining detail gain of a target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: acquiring adjustment information input by a user; and fusing the detail information and the target infrared image based on the detail gain and the adjustment information to obtain a fused image.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: extracting the target visible light image on a preset image channel to obtain an extracted image; carrying out low-pass filtering on the extracted image to obtain a filtered image; detail information is determined based on the extracted image and the filtered image.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: dividing the pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image; and taking the difference value of the quotient image and 1 as detail information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: calculating the detail intensity of the target visible light image based on the extracted image; the reciprocal of the detail intensity is taken as the detail gain.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: calculating detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range including pixel points.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: calculating a detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets a preset relation with a preset difference value; the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in a preset unit; the preset range is a range including pixel points.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and after the reciprocal of the detail intensity is taken as the detail gain, judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: acquiring an initial visible light image and an initial infrared image corresponding to a target scene; adjusting the initial visible light image into a target visible light image based on preset information, the initial visible light image and the initial infrared image; adjusting the initial infrared image into a target infrared image based on preset information, the initial visible light image and the initial infrared image; the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
The computer-readable storage media to which this application relates include Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in the image processing system, the image processing apparatus, and the computer-readable storage medium provided in the embodiments of the present application, reference is made to detailed descriptions of a corresponding part in the image processing method provided in the embodiments of the present application, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of corresponding technical solutions in the prior art, are not described in detail so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (12)
1. An image processing method, comprising:
acquiring a target visible light image and a target infrared image corresponding to a target scene;
determining detail information of the target visible light image;
determining a detail gain of the target visible light image;
and based on the detail gain, fusing the detail information and the target infrared image to obtain a fused image.
2. The method according to claim 1, wherein said fusing the detail information with the target infrared image based on the detail gain to obtain a fused image comprises:
acquiring adjustment information input by a user;
and fusing the detail information and the target infrared image based on the detail gain and the adjusting information to obtain the fused image.
3. The method of claim 2, wherein the determining the detail information of the target visible light image comprises:
extracting the target visible light image on a preset image channel to obtain an extracted image;
carrying out low-pass filtering on the extracted image to obtain a filtered image;
determining the detail information based on the extracted image and the filtered image.
4. The method of claim 3, wherein the determining the detail information based on the extracted image and the filtered image comprises:
dividing pixel points at the corresponding positions of the extracted image and the filtered image to obtain a quotient image;
and taking the difference value between the quotient image and 1 as the detail information.
5. The method of claim 4, wherein the determining the detail gain of the target visible light image comprises:
calculating the detail intensity of the target visible light image based on the extracted image;
and taking the reciprocal of the detail intensity as the detail gain.
6. The method of claim 5, wherein the calculating the detail gain of the target visible light image based on the extracted image comprises:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point is the variance or standard deviation of the pixel value in the preset range; the preset range is a range containing the pixel points.
7. The method of claim 5, wherein the calculating the detail gain of the target visible light image based on the extracted image comprises:
calculating the detail gain based on the extracted image according to the definition that the detail intensity of the pixel point meets the preset relation with the preset difference value;
the preset difference value is the difference value between a pixel value and a central point in a preset range, or the difference value between the pixel value and a mean value in the preset range, and the mean value is the mean value of the pixel values in the preset unit; the preset range is a range containing the pixel points.
8. The method of claim 5, wherein the taking the inverse of the detail intensity as the detail gain further comprises:
and judging whether the value of the detail gain is larger than a preset threshold value, if so, adjusting the value of the detail gain to be 0, and if not, keeping the value of the detail gain unchanged.
9. The method of any one of claims 1 to 8, wherein the acquiring a target visible light image and a target infrared image corresponding to a target scene comprises:
acquiring an initial visible light image and an initial infrared image corresponding to the target scene;
adjusting the initial visible light image to the target visible light image based on preset information, the initial visible light image and the initial infrared image;
adjusting the initial infrared image to be the target infrared image based on preset information, the initial visible light image and the initial infrared image;
the preset information comprises field angle information, resolution information and relative position information of an infrared system and a visible light system; and the image size difference value of the target visible light image and the target infrared image is within a first preset range, and the resolution difference value of the target visible light image and the target infrared image is within a second preset range.
10. An image processing system, comprising:
the first acquisition module is used for acquiring a target visible light image and a target infrared image corresponding to a target scene;
the first determining module is used for determining detail information of the target visible light image;
a second determining module, configured to determine a detail gain of the target visible light image;
and the first fusion module is used for fusing the detail information and the target infrared image based on the detail gain to obtain a fusion image.
11. An image processing apparatus characterized by comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image processing method according to any one of claims 1 to 9 when executing the computer program.
12. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the image processing method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010300217.XA CN111539902B (en) | 2020-04-16 | 2020-04-16 | Image processing method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010300217.XA CN111539902B (en) | 2020-04-16 | 2020-04-16 | Image processing method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111539902A true CN111539902A (en) | 2020-08-14 |
| CN111539902B CN111539902B (en) | 2023-03-28 |
Family
ID=71979953
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010300217.XA Active CN111539902B (en) | 2020-04-16 | 2020-04-16 | Image processing method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111539902B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111968068A (en) * | 2020-08-18 | 2020-11-20 | 杭州海康微影传感科技有限公司 | Thermal imaging image processing method and device |
| CN112767291A (en) * | 2021-01-04 | 2021-05-07 | 浙江大华技术股份有限公司 | Visible light image and infrared image fusion method and device and readable storage medium |
| CN113284128A (en) * | 2021-06-11 | 2021-08-20 | 中国南方电网有限责任公司超高压输电公司天生桥局 | Image fusion display method and device based on power equipment and computer equipment |
| CN113610738A (en) * | 2021-08-06 | 2021-11-05 | 烟台艾睿光电科技有限公司 | Image processing method, device, equipment and computer readable storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105069768A (en) * | 2015-08-05 | 2015-11-18 | 武汉高德红外股份有限公司 | Visible-light image and infrared image fusion processing system and fusion method |
| CN106960428A (en) * | 2016-01-12 | 2017-07-18 | 浙江大立科技股份有限公司 | Visible ray and infrared double-waveband image co-registration Enhancement Method |
| CN107194906A (en) * | 2017-05-22 | 2017-09-22 | 阜阳师范学院 | A kind of image processing method merged based on warp wavelet and system |
| CN107784642A (en) * | 2016-08-26 | 2018-03-09 | 北京航空航天大学 | A kind of infrared video and visible light video method for self-adaption amalgamation |
| CN108765358A (en) * | 2018-05-22 | 2018-11-06 | 烟台艾睿光电科技有限公司 | The double light fusion methods and plug-in type thermal imager system of visible light and infrared light |
| CN110047059A (en) * | 2019-04-10 | 2019-07-23 | 北京旷视科技有限公司 | Image processing method, device, electronic equipment and readable storage medium storing program for executing |
| CN110136183A (en) * | 2018-02-09 | 2019-08-16 | 华为技术有限公司 | A kind of method and relevant device of image procossing |
| CN110189286A (en) * | 2019-05-30 | 2019-08-30 | 兰州交通大学 | A kind of infrared and visible light image fusion method based on ResNet |
| CN110223265A (en) * | 2019-05-05 | 2019-09-10 | 中国地质大学（武汉） | The significant image interfusion method of target and system decomposed based on multi-scale transform |
| CN110415202A (en) * | 2019-07-31 | 2019-11-05 | 浙江大华技术股份有限公司 | A kind of image interfusion method, device, electronic equipment and storage medium |
| CN110930311A (en) * | 2018-09-19 | 2020-03-27 | 杭州萤石软件有限公司 | Method and device for improving signal-to-noise ratio of infrared image and visible light image fusion |
-
2020
- 2020-04-16 CN CN202010300217.XA patent/CN111539902B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105069768A (en) * | 2015-08-05 | 2015-11-18 | 武汉高德红外股份有限公司 | Visible-light image and infrared image fusion processing system and fusion method |
| US20180227509A1 (en) * | 2015-08-05 | 2018-08-09 | Wuhan Guide Infrared Co., Ltd. | Visible light image and infrared image fusion processing system and fusion method |
| CN106960428A (en) * | 2016-01-12 | 2017-07-18 | 浙江大立科技股份有限公司 | Visible ray and infrared double-waveband image co-registration Enhancement Method |
| CN107784642A (en) * | 2016-08-26 | 2018-03-09 | 北京航空航天大学 | A kind of infrared video and visible light video method for self-adaption amalgamation |
| CN107194906A (en) * | 2017-05-22 | 2017-09-22 | 阜阳师范学院 | A kind of image processing method merged based on warp wavelet and system |
| CN110136183A (en) * | 2018-02-09 | 2019-08-16 | 华为技术有限公司 | A kind of method and relevant device of image procossing |
| CN108765358A (en) * | 2018-05-22 | 2018-11-06 | 烟台艾睿光电科技有限公司 | The double light fusion methods and plug-in type thermal imager system of visible light and infrared light |
| CN110930311A (en) * | 2018-09-19 | 2020-03-27 | 杭州萤石软件有限公司 | Method and device for improving signal-to-noise ratio of infrared image and visible light image fusion |
| CN110047059A (en) * | 2019-04-10 | 2019-07-23 | 北京旷视科技有限公司 | Image processing method, device, electronic equipment and readable storage medium storing program for executing |
| CN110223265A (en) * | 2019-05-05 | 2019-09-10 | 中国地质大学（武汉） | The significant image interfusion method of target and system decomposed based on multi-scale transform |
| CN110189286A (en) * | 2019-05-30 | 2019-08-30 | 兰州交通大学 | A kind of infrared and visible light image fusion method based on ResNet |
| CN110415202A (en) * | 2019-07-31 | 2019-11-05 | 浙江大华技术股份有限公司 | A kind of image interfusion method, device, electronic equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| CHUONG T. NGUYEN等: "Linear adaptive infrared image fusion", 《2014 SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION》 * |
| 周渝人等: "基于对比度增强的红外与可见光图像融合", 《中国激光》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111968068A (en) * | 2020-08-18 | 2020-11-20 | 杭州海康微影传感科技有限公司 | Thermal imaging image processing method and device |
| CN112767291A (en) * | 2021-01-04 | 2021-05-07 | 浙江大华技术股份有限公司 | Visible light image and infrared image fusion method and device and readable storage medium |
| CN113284128A (en) * | 2021-06-11 | 2021-08-20 | 中国南方电网有限责任公司超高压输电公司天生桥局 | Image fusion display method and device based on power equipment and computer equipment |
| CN113610738A (en) * | 2021-08-06 | 2021-11-05 | 烟台艾睿光电科技有限公司 | Image processing method, device, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111539902B (en) | 2023-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111539902B (en) | Image processing method, system, equipment and computer readable storage medium | |
| CN109272459B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US11113795B2 (en) | Image edge processing method, electronic device, and computer readable storage medium | |
| US20190197735A1 (en) | Method and apparatus for image processing, and robot using the same | |
| CN107403421B (en) | Image defogging method, storage medium and terminal equipment | |
| CN111107333B (en) | Brightness correction method, system, equipment and computer readable storage medium | |
| CN109727215B (en) | Image processing method, device, terminal equipment and storage medium | |
| CN108234858B (en) | Image blurring processing method and device, storage medium and electronic equipment | |
| CN109817170B (en) | Pixel compensation method and device and terminal equipment | |
| WO2015085790A1 (en) | Image processing method and apparatus | |
| CN109727216B (en) | Image processing method, device, terminal equipment and storage medium | |
| CN109934785B (en) | Image sharpening method and device | |
| CN111739041B (en) | Image frame clipping method, device and equipment | |
| CN110084204B (en) | Image processing method and device based on target object posture and electronic equipment | |
| CN112218065B (en) | Image white balance method, system, terminal device and storage medium | |
| CN110648296A (en) | Pupil color correction method, correction device, terminal device and storage medium | |
| CN111626967A (en) | Image enhancement method, image enhancement device, computer device and readable storage medium | |
| CN111383178A (en) | Image enhancement method and device and terminal equipment | |
| CN115082350A (en) | Stroboscopic image processing method and device, electronic device and readable storage medium | |
| US9319666B1 (en) | Detecting control points for camera calibration | |
| CN112446830A (en) | Image color edge processing method and device, storage medium and electronic equipment | |
| CN110738712B (en) | Geometric pattern reconstruction method, device, equipment and storage medium | |
| US20220360707A1 (en) | Photographing method, photographing device, storage medium and electronic device | |
| US20210158487A1 (en) | Image processing apparatus, image processing method, and non-transitory computer-readable medium | |
| CN111915497B (en) | Image black-and-white enhancement method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |