CN113596341A - Image shooting method, image processing device and electronic equipment - Google Patents
Image shooting method, image processing device and electronic equipment Download PDFInfo
- Publication number
- CN113596341A CN113596341A CN202110658640.1A CN202110658640A CN113596341A CN 113596341 A CN113596341 A CN 113596341A CN 202110658640 A CN202110658640 A CN 202110658640A CN 113596341 A CN113596341 A CN 113596341A
- Authority
- CN
- China
- Prior art keywords
- visible light
- infrared
- image
- images
- registered
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 84
- 238000012545 processing Methods 0.000 title claims abstract description 28
- 239000011159 matrix material Substances 0.000 claims abstract description 50
- 238000001514 detection method Methods 0.000 claims description 33
- 230000004927 fusion Effects 0.000 claims description 15
- 238000010606 normalization Methods 0.000 claims description 15
- 238000003672 processing method Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 12
- 238000013507 mapping Methods 0.000 claims description 6
- 230000007797 corrosion Effects 0.000 claims description 4
- 238000005260 corrosion Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 13
- 238000003384 imaging method Methods 0.000 abstract description 11
- 230000008569 process Effects 0.000 description 32
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000005286 illumination Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000005282 brightening Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000010339 dilation Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000003628 erosive effect Effects 0.000 description 1
- 238000005530 etching Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The application provides an image shooting method, an image processing device, an electronic device and a computer readable storage medium, wherein the image shooting method comprises the following steps: collecting visible light images corresponding to a plurality of different exposure values of a shot object through a first camera; acquiring a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values respectively through a second camera; registering the plurality of infrared images to obtain an offset matrix; registering the visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images; and fusing the plurality of registered visible light images to obtain a fused image. By implementing the method and the device, the visible light images can be registered through the offset matrix of the infrared images, the problem that accurate registration is difficult due to overlarge brightness difference between images with different exposure values is solved, the registration speed and precision of the images with different exposures are improved, and the imaging effect of the multi-exposure images is improved.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image capturing method, an image processing apparatus, an electronic device, and a computer-readable storage medium.
Background
With the development of mobile terminal technology, the quality requirements of users on photographing become higher and higher, and night scene photographing is also paid attention and loved by many users as a bright spot function.
The strategy frequently used in the existing super night scene algorithm is to fuse images with different exposure values in the same scene, so as to realize the brightening of an underexposed area and the darkening operation of an overexposed area, and further obtain a high dynamic range image comprising more dynamic ranges and image details. However, because the brightness difference between images with different exposure values is large, and some factors such as overexposure and underexposure areas exist, image details are easily lost in the fusion process, and accurate registration is difficult to achieve.
Disclosure of Invention
An object of the embodiments of the present application is to provide an image capturing method, an image processing apparatus, an electronic device, and a computer-readable storage medium, which can achieve accurate registration between images corresponding to different exposure values, and can perform registration on a visible light image through an offset matrix of an infrared image, thereby solving the problem that accurate registration is difficult due to too large brightness difference between images of different exposure values, improving the speed and precision of registration of images of different exposure values, and improving the imaging effect of a multi-exposure image.
In a first aspect, an embodiment of the present application provides an image capturing method, where the method includes:
collecting visible light images corresponding to a plurality of different exposure values of a shot object through a first camera;
acquiring a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values respectively through a second camera;
registering the plurality of infrared images to obtain an offset matrix;
registering the visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and fusing the plurality of registered visible light images to obtain a fused image.
In the implementation process, the infrared images corresponding to the different exposure values are registered to obtain the offset matrix, and the visible light images corresponding to the different exposure values are registered according to the offset matrix, so that the registration precision between the images corresponding to the different exposure values can be improved by utilizing the characteristic that the infrared images are accurately imaged in a low-illumination environment, the problem that the images with different exposure values are difficult to accurately register due to overlarge brightness difference is solved, the registration speed and precision of the images with different exposure values are improved, and the imaging effect of the multi-exposure images is improved.
Further, the step of fusing the plurality of registered visible light images to obtain a fused image includes:
acquiring weights of a plurality of the registered visible light images;
normalizing the plurality of weights;
and fusing the plurality of registered visible light images according to the plurality of weights after normalization processing to obtain a fused image.
In the implementation process, the weight of the visible light image is normalized, and the visible light image is fused according to the weight after the normalization to obtain the fused image, so that the imaging effect and the imaging quality of the fused image can be effectively improved.
Further, after the step of registering the plurality of infrared images, the method further includes:
obtaining a plurality of registered infrared images;
carrying out ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask;
obtaining at least one visible light ghost mask corresponding to at least one infrared ghost mask;
the step of fusing the plurality of registered visible light images to obtain a fused image includes:
and fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image.
In the implementation process, the characteristic that the infrared image is accurately imaged in a low-illumination environment is utilized, the registered infrared image is subjected to ghost detection to obtain an infrared ghost mask, then a visible light ghost mask is obtained according to the infrared ghost mask, and finally the registered visible light image is fused according to the visible light ghost mask to obtain a fused image. The method can improve the accuracy of ghost detection between different exposure value images, and solve the problem that in the prior art, a ghost area is difficult to judge due to overlarge brightness difference between different exposure value images, so that relatively obvious ghosts appear in the fused image easily.
Further, the plurality of different exposure values includes a reference exposure value and at least one auxiliary exposure value; the step of performing ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask includes:
and carrying out ghost detection between the reference infrared image corresponding to the reference exposure value in the registered infrared image and the auxiliary infrared image corresponding to the at least one auxiliary exposure value to obtain at least one infrared ghost mask.
In the implementation process, through carrying out ghost detection on the auxiliary infrared image corresponding to one or more auxiliary exposure values and the reference infrared image corresponding to the reference exposure value, one or more infrared ghost masks can be obtained, ghost detection of the auxiliary infrared images corresponding to different exposure values can be realized, and efficiency and accuracy of ghost detection are improved.
Further, the step of performing ghost detection between the reference infrared image corresponding to the reference exposure value in the registered infrared image and the auxiliary infrared image corresponding to the at least one auxiliary exposure value to obtain at least one infrared ghost mask includes:
establishing at least one initial ghost mask corresponding to the auxiliary infrared image;
acquiring a difference value between a pixel value corresponding to at least one auxiliary infrared image and a pixel value corresponding to the reference infrared image; or acquiring a difference value between gradient information corresponding to at least one auxiliary infrared image and gradient information corresponding to the reference infrared image;
generating pixel value marking information according to the difference value;
and marking the initial ghost mask according to the pixel value marking information to obtain at least one infrared ghost mask.
In the implementation process, the auxiliary infrared image is mapped by establishing the initial ghost mask, and the infrared ghost mask is obtained according to the information difference between the auxiliary infrared image and the reference infrared image, so that the effectiveness and the accuracy of ghost detection can be improved.
Further, after the step of establishing at least one initial ghost mask corresponding to the auxiliary infrared image, the method further includes:
initializing the initial ghost mask.
In the implementation process, the pixel mark of the initial ghost mask is initialized, so that a new infrared ghost mask is generated conveniently in the subsequent process, and the accuracy of ghost detection is improved.
Further, the step of fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image includes:
acquiring weights of a plurality of the registered visible light images;
resetting the weights according to at least one visible light ghost mask to obtain a plurality of reset weights;
normalizing the weights after the plurality of resets;
and fusing the plurality of registered visible light images according to the plurality of weights after normalization processing to obtain a fused image.
In the implementation process, the weight of the registered visible light image is reset through the visible light ghost mask, then normalization processing is carried out to obtain a fused image, and the introduction of the visible light ghost mask can further improve the imaging effect of the image.
Further, before the step of resetting the weights according to at least one of the visible light ghost masks to obtain the multiple reset weights, the method further includes:
and performing expansion and corrosion treatment on at least one visible light ghost mask.
In the implementation process, the visible light ghost mask can be processed through the operations of enlarging the ghost area and reducing the ghost area in the image morphology, so that the surface of the visible light ghost mask is smoother, and the effect is better.
Further, mapping at least one infrared ghost mask according to calibration information between the first camera and the second camera to obtain at least one visible light ghost mask.
In the implementation process, the infrared ghost mask is mapped to the space of the visible light camera according to the calibrated matrix information to obtain the visible light ghost mask, so that the mapping efficiency and the conversion accuracy can be improved.
In a second aspect, an embodiment of the present application further provides an image capturing apparatus, including:
the first acquisition module is used for acquiring visible light images corresponding to a plurality of different exposure values of the shot object through the first camera;
the second acquisition module is used for acquiring a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values through a second camera;
the registration module is used for registering the plurality of infrared images to obtain an offset matrix; registering a plurality of visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and the fusion module is used for fusing the plurality of registered visible light images to obtain a fused image.
In the implementation process, the infrared images corresponding to the different exposure values are registered to obtain the offset matrix, and the visible light images corresponding to the different exposure values are registered according to the offset matrix, so that the registration precision between the images corresponding to the different exposure values can be improved by utilizing the characteristic that the infrared images are accurately imaged in a low-illumination environment, the problem that the images with different exposure values are difficult to accurately register due to overlarge brightness difference is solved, the registration speed and precision of the images with different exposure values are improved, and the imaging effect of the multi-exposure images is improved.
In a third aspect, an embodiment of the present application further provides an image processing method, where the method includes:
receiving visible light images corresponding to a plurality of different exposure values acquired by a first camera for a shooting object;
receiving a plurality of infrared images which correspond to the visible light images corresponding to the different exposure values and are acquired by a second camera;
registering the plurality of infrared images to obtain an offset matrix;
registering the plurality of visible light images with different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and fusing the plurality of registered visible light images to obtain a fused image.
In a fourth aspect, an embodiment of the present application further provides an image processing apparatus, including:
the receiving module is used for receiving visible light images corresponding to a plurality of different exposure values acquired by the first camera for the shot object; receiving a plurality of infrared images which correspond to the visible light images corresponding to the different exposure values and are acquired by a second camera;
the registration module is used for registering the plurality of infrared images to obtain an offset matrix; registering the plurality of visible light images with different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and the fusion module is used for fusing the plurality of registered visible light images to obtain a fused image.
In a fifth aspect, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the memory is used to store a computer program, and the processor runs the computer program to make the electronic device execute the image capturing method according to the first aspect and the image processing method according to the third aspect.
In a sixth aspect, the present application further provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the image capturing method according to the first aspect and the image processing method according to the third aspect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic flowchart of an embodiment of an image capturing method provided in the present application;
FIG. 2 is a schematic flowchart of another embodiment of an image capturing method provided in the present application;
fig. 3 is a schematic structural diagram of an image capturing apparatus according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of an image processing method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Example one
Referring to fig. 1, the image capturing method in the embodiment of the present application is applicable to, but not limited to, a mobile terminal.
The image shooting method of the embodiment of the application comprises the following steps:
s11, collecting visible light images corresponding to a plurality of different exposure values of the shooting object through a first camera;
s12, collecting a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values through a second camera;
s13, registering the infrared images to obtain an offset matrix;
s14, registering the visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and S15, fusing the plurality of visible light images after registration to obtain a fused image.
In a specific implementation, visible light images corresponding to a plurality of different exposure values of a shooting object are collected through a first camera, in this embodiment, it is assumed that the collected EV combinations are EV +, EV0 and EV-, and visible light images corresponding to EV +, EV0 and EV-are collected respectively, it should be noted that the EV combinations may be free combinations such as EV0, EV +, EV2+, EV-, or combinations of EV0 and EV +, which will not be described herein; similarly, when the visible light image is collected, a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values are collected through the second camera, and the infrared images and the visible light images of the different exposure values correspond to each other one by one. In this application embodiment, first camera is the visible light camera, and the second camera is infrared camera, and the synchronous collection image of visible light camera and infrared camera.
In specific implementation, when the visible light camera collects a plurality of visible light images (such as EV + visible light images, EV0 visible light images and EV-visible light images) with different exposure values, the infrared camera synchronously collects infrared images (such as EV + infrared images, EV0 infrared images and EV-infrared images) corresponding to the different exposure values, and parameters of the infrared camera are not changed in the collection process. (this process ensures very significant differences in brightness between the EV + visible image, EV0 visible image, EV-visible image, and no significant differences in brightness between the EV + infrared image, EV0 infrared image, EV-infrared image.)
In the process of registering a plurality of infrared images and obtaining an offset matrix, because the brightness of the plurality of infrared images is not obviously different, the registering method of the infrared images is not particularly limited in this embodiment, and for example, any one of a traditional optical flow algorithm, an image block-based optical flow algorithm (meshflow) and a feature point matching algorithm can be used for registering a plurality of infrared images with different exposure values to obtain the offset matrix, so that a more accurate result can be obtained. In general, an EV + infrared image (EV + _ infrared) and an EV-infrared image (EV-infrared) are registered with the EV0 infrared image (EV0_ infrared) as a reference frame, and offset matrices (offsets) of the EV + infrared image and the EV-infrared image with respect to the EV0 infrared image are obtained, respectively. It should be noted that, in this embodiment, it is optional to use the EV0 infrared image as the reference frame, and in general, the image exposure effect corresponding to EV0 is good, and the image exposure effect can be used as the reference frame for registration.
And registering the visible light images corresponding to different exposure values according to the offset matrix (offset) obtained by registration to obtain a plurality of registered visible light images. In a specific implementation, the size of the offset matrix (offset) is consistent with the size of the infrared image and the size of the visible light image to be registered, and each value in the offset matrix is an offset of a pixel position corresponding to the visible light image to be registered, for example: for a certain pixel i, its position is (x)i,yi) The offset matrix (offset) has an offset amount of (delta _ x)i,delta_yi) Its new position is (x)i+delta_xi,yi+delta_yi) And after the coordinates of all the pixels are transformed, the visible light image after registration is obtained. Similarly, the visible light images corresponding to the different exposure values can be registered according to the offset matrix of the infrared image corresponding to the exposure value, and the correspondence of the different exposure values is obtainedThe registered visible light image of (1).
Further, S15 includes:
acquiring weights of a plurality of registered visible light images;
normalizing the plurality of weights;
and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
In particular, according to the formula
Calculating weights (e.g., w +, w0, w-) for the plurality of registered visible light images, wherein wiAnd (3) fusion weight, wherein a is a scaling coefficient (0-1), and i is the pixel value of each pixel point in the EV + visible light image, the EV0 visible light image and the EV-visible light image.
According to sumwNormalizing the weights of the plurality of registered visible light images by (w +) + (w0) + (w-), wherein w + - (w +/sum)w，w0＝w0/sumw，w-＝w-/sumw。
Fusing the plurality of registered visible light images according to result ═ (w +) (EV +) + (w0) (EV0) + (w-) (EV-), so as to obtain fused images; wherein result is the output fused image.
The method embodiment can be applied to terminal devices such as mobile terminals, tablets, cameras and the like, and is not limited in the application. Specifically, the infrared images corresponding to a plurality of different exposure values are registered to obtain an offset matrix, and the visible light images corresponding to a plurality of different exposure values are registered according to the offset matrix, so that the registration precision between the images corresponding to different exposure values can be improved by utilizing the characteristic that the infrared images are accurately imaged in a low-illumination environment, the problem that the images with different exposure values are difficult to accurately register due to overlarge brightness difference is solved, the registration speed and precision of the images with different exposure values are improved, and the imaging effect of the multi-exposure images is improved. The weight of the visible light image is normalized, and the visible light image is fused according to the weight after the normalization to obtain a fused image, so that the imaging effect and the imaging quality of the fused image can be effectively improved.
In addition, in this application embodiment, infrared camera can image out accurate environmental information under the low light level environment, and this characteristic makes infrared camera wide application in the security protection field. For a visible light camera, the ability to take a picture in a low-light environment is greatly limited, and an underexposed image is usually obtained. By utilizing the characteristic of the infrared camera, the infrared image is used for guiding the visible image to carry out multi-exposure fusion, the registration precision during fusion of different exposure images is improved, and thus a fused image with better imaging effect is obtained.
Example two
The present application also provides another image capturing method, as shown in fig. 2, the method including:
s21, collecting visible light images corresponding to a plurality of different exposure values of the shooting object through a first camera;
s22, collecting a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values through a second camera;
s23, registering the infrared images to obtain an offset matrix and a plurality of registered infrared images;
s24, carrying out ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask;
s25, obtaining at least one visible light ghost mask corresponding to the at least one infrared ghost mask;
s26, registering the visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and S27, fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image.
In this embodiment, the manner of acquiring the images in S21 and S22 may refer to the description related to the first embodiment, and is not described herein again.
In S23, the plurality of infrared images are registered, and the plurality of registered infrared images are obtained simultaneously in the process of obtaining the offset matrix.
In a specific implementation, the plurality of different exposure values includes a base exposure value and at least one auxiliary exposure value; the selection mode of the base exposure value corresponds to the selection of the reference frame in the registration process, other different exposure values are auxiliary exposure values, and the corresponding image is an auxiliary infrared image. S24 further includes: and carrying out ghost detection between the reference infrared image corresponding to the reference exposure value in the registered infrared image and the auxiliary infrared image corresponding to the at least one auxiliary exposure value to obtain at least one infrared ghost mask. It should be noted that, in the present application, the at least one auxiliary exposure value may be one or more, and the principle of the one or more auxiliary exposure values in the image acquisition, registration, ghost detection, and the like is the same, and the embodiments of the present application include, but are not limited to, the at least one auxiliary exposure value.
Specifically, the ghost detection process includes:
establishing at least one initial ghost mask corresponding to the auxiliary infrared image;
acquiring a difference value between a pixel value corresponding to at least one auxiliary infrared image and a pixel value corresponding to a reference infrared image; or acquiring a difference value between the gradient information corresponding to the at least one auxiliary infrared image and the gradient information corresponding to the reference infrared image;
generating pixel value marking information according to the difference value;
and marking the initial ghost mask according to the pixel value marking information to obtain at least one infrared ghost mask.
In the above process, the size of the established initial ghost mask is consistent with that of the auxiliary infrared image and the reference infrared image, and meanwhile, a plurality of initial ghost masks corresponding to the auxiliary infrared images with different exposure values need to be established for ghost detection. In this embodiment, the initial ghost mask is typically a binarized image having gray scale values of 0-255. Optionally, after the initial ghost mask is established, the initial ghost mask may be initialized. Specifically, the pixel mark of the initial ghost mask is initialized (reset to 0) so as to facilitate the subsequent generation of a new infrared ghost mask, and the accuracy of ghost detection is improved.
In this embodiment, if the pixel value is a value corresponding to a certain pixel point of the image, the value of the certain pixel point in the auxiliary infrared image is obtained, and the value of the pixel point corresponding to the pixel point in the auxiliary infrared image in the reference infrared image is obtained; the gray scale information refers to the gray scale change in a certain neighborhood of each pixel in the image, and the gradient information corresponding to the at least one auxiliary infrared image acquired in this embodiment corresponds to the gradient information corresponding to the reference infrared image, which will not be described herein.
Further, the process of generating the pixel value flag information according to the difference value includes:
and judging whether the difference value is larger than a set threshold value (thresh), and generating pixel value marking information corresponding to the pixel point according to the judgment result. It should be noted that the set threshold in this embodiment can be adjusted according to actual conditions, and is usually in the range of [0-100 ].
When the difference value is larger than a set threshold value, marking the pixel point in the initial ghost mask corresponding to the auxiliary infrared image as 1 according to the pixel value marking information corresponding to the pixel point; when the difference value is less than or equal to the set threshold value, marking the pixel point in the initial ghost mask corresponding to the auxiliary infrared image as 0; an infrared ghost mask is generated that includes the indicia.
Similarly, an EV combination (EV0, EV +, EV-,) is taken as an example, the EV0 infrared image is a reference infrared image, the EV + infrared image and the EV-infrared image are auxiliary infrared images, and initial ghost masks corresponding to the auxiliary infrared images (EV +, EV-) are created. Here, an EV + infrared image and an EV-infrared image are described as examples.
Acquiring a difference (diff _ infra ═ abs (EV0_ infra-EV + _ infra)) between a pixel value corresponding to the EV0 infrared image (EV0_ infra) and a pixel value corresponding to the EV + infrared image (EV0+ _ infra); judging whether the difference value is larger than a set threshold value (thresh +), if so, marking the pixel point in the initial ghost mask corresponding to the EV + infrared image (EV0+ _ infra) as 1; if not, marking as 0; wherein, the mark is 1, the pixel point is a ghost, and the mark is 0, the pixel point is not a ghost; an EV + IR ghost mask (mask + _ infrared) containing the above-mentioned markers is generated.
Meanwhile, a difference (diff _ included-abs (EV0_ included-EV _ included)) between a pixel value corresponding to the EV0 infrared image (EV0_ included) and a pixel value corresponding to the EV-infrared image (EV0_ included) is acquired; judging whether the difference value is larger than a set threshold value (thresh-), if so, marking the pixel point in the initial ghost mask corresponding to the EV-infrared image (EV0- _ not) as 1; if not, marking as 0; wherein, the mark is 1, the pixel point is a ghost, and the mark is 0, the pixel point is not a ghost; an EV-infrared ghost mask (mask-not) containing the above-mentioned marker is generated.
After the infrared ghosting mask is generated, at least one visible light ghosting mask corresponding to the at least one infrared ghosting mask is obtained. Further, mapping is carried out on at least one infrared ghost mask according to calibration information between the first camera and the second camera, and at least one visible light ghost mask is obtained. In specific implementation, calibration information between the visible light camera and the infrared camera is obtained according to physical positions of the visible light camera and the infrared camera, specifically, the calibration information is matrix information calibrated between the visible light camera and the infrared camera, and the infrared ghost mask is mapped to a space of the visible light camera according to the calibrated matrix information to obtain the visible ghost mask; the mapping process is specifically a coordinate transformation process, and the infrared ghost mask is subjected to coordinate transformation according to the calibration information to obtain the visible light ghost mask.
Thus, in the above example, EV + visible light ghost mask (mask +) corresponding to EV + infrared ghost mask (mask + _ hidden), EV-visible light ghost mask (mask-) corresponding to EV-infrared ghost mask (mask-) can be obtained
Further, S27 includes:
acquiring weights of a plurality of registered visible light images;
resetting the weights according to at least one visible light ghost mask to obtain a plurality of reset weights;
normalizing the multiple reset weights;
and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
The processes and principles of obtaining, normalizing, and fusing the weights of the multiple registered visible light images can be described in the first embodiment. It should be particularly noted that, after the weights of the plurality of registered visible light images are obtained, the weights of the corresponding visible light images can be reset according to the visible light ghost mask. Taking weight processing on the EV + visible light image and the EV-visible light image as an example, resetting the weight (w +) of a pixel point of the EV + visible light image according to a ghost mask (mask +) of the EV + visible light image, namely resetting the weight of a corresponding pixel point in the w + to 0 if the median of the ghost mask (mask +) is 1, and keeping the values of other pixel points unchanged; and resetting the weight (w-) of the pixel point of the EV-visible light image according to the ghost mask (mask + -) of the EV-visible light image, namely resetting the weight of the corresponding pixel point in the w-to 0 if the median value of the ghost mask (mask-) is 1, and keeping the values of other pixel points unchanged.
Further, before the plurality of weights are reset according to the at least one visible light ghost mask to obtain a plurality of reset weights, the at least one visible light ghost mask may be expanded and eroded. In the present application, the dilation process is an operation of enlarging a ghost area in image morphology, and the erosion process is an operation of reducing a ghost area in image morphology. The corrosion can corrode the edge of the image, and the function is to kick and remove 'burrs' of the edge of the target; the expansion can enlarge the edge of the image and can be used for filling out the edge of the target or the inner pit; the expansion and corrosion treatment make the surface of the visible light ghost mask smoother and the effect is better.
In the embodiment, the characteristic that the infrared image is accurately imaged in a low-illumination environment is utilized to perform ghost detection on the registered infrared image to obtain an infrared ghost mask, then a visible light ghost mask is obtained according to the infrared ghost mask, and finally the registered visible light image is fused according to the visible light ghost mask to obtain a fused image. The method can improve the accuracy of ghost detection between different exposure value images, and solve the problem that in the prior art, a ghost area is difficult to judge due to overlarge brightness difference between different exposure value images, so that relatively obvious ghosts appear in the fused image easily.
EXAMPLE III
The embodiment of the application also provides an image shooting device which can be a mobile terminal, a flat panel, a camera and other terminal equipment. As shown in fig. 3, the image capturing apparatus according to the embodiment of the present application includes:
the first acquisition module 31 is configured to acquire visible light images corresponding to a plurality of different exposure values of the photographic object through a first camera;
the second acquisition module 32 is configured to acquire, by using the second camera, a plurality of infrared images corresponding to the visible light images corresponding to the plurality of different exposure values, respectively;
a registration module 33, configured to register the multiple infrared images to obtain an offset matrix; registering a plurality of visible light images corresponding to a plurality of different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and the fusion module 34 is configured to fuse the plurality of registered visible light images to obtain a fusion image.
Further, the fusion module 34 is further configured to obtain weights of the plurality of registered visible light images; normalizing the plurality of weights; and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
Further, the registration module 33 is further configured to register the multiple infrared images, and obtain multiple registered infrared images simultaneously in the process of obtaining the offset matrix. The device also includes:
the ghost detection module is used for carrying out ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask; at least one visible light ghosting mask corresponding to the at least one infrared ghosting mask is obtained.
The ghost detection module is also used for establishing at least one initial ghost mask corresponding to the auxiliary infrared image; acquiring a difference value between a pixel value corresponding to at least one auxiliary infrared image and a pixel value corresponding to a reference infrared image; or acquiring a difference value between the gradient information corresponding to the at least one auxiliary infrared image and the gradient information corresponding to the reference infrared image; generating pixel value marking information according to the difference value; and marking the initial ghost mask according to the pixel value marking information to obtain at least one infrared ghost mask.
Further, the fusion module 34 is further configured to obtain weights of the plurality of registered visible light images; resetting the weights according to at least one visible light ghost mask to obtain a plurality of reset weights; normalizing the multiple reset weights; and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
The functional implementation of each functional module in the image capturing apparatus of this embodiment can be referred to the description of the image capturing method in the first and second embodiments.
Example four
As shown in fig. 4, an embodiment of the present application further provides an image processing method, where the method includes:
s41, receiving visible light images corresponding to a plurality of different exposure values collected by the first camera for the shooting object;
s42, receiving a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values respectively and collected by the second camera;
s43, registering the infrared images to obtain an offset matrix;
s44, registering a plurality of visible light images with different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and S45, fusing the plurality of visible light images after registration to obtain a fused image.
Further, S45 includes:
acquiring weights of a plurality of registered visible light images;
normalizing the plurality of weights;
and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
In S43, the plurality of infrared images are registered, and the plurality of registered infrared images are obtained simultaneously in the process of obtaining the offset matrix.
The processing method further comprises the following steps:
carrying out ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask;
obtaining at least one visible light ghost mask corresponding to the at least one infrared ghost mask;
s45 further includes:
and fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image.
The plurality of different exposure values include a reference exposure value and at least one auxiliary exposure value; the step of performing ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask includes:
and carrying out ghost detection between the reference infrared image corresponding to the reference exposure value in the registered infrared image and the auxiliary infrared image corresponding to the at least one auxiliary exposure value to obtain at least one infrared ghost mask.
Further, the step of performing ghost detection between the reference infrared image corresponding to the reference exposure value and the auxiliary infrared image corresponding to the at least one auxiliary exposure value in the registered infrared image to obtain at least one infrared ghost mask includes:
establishing at least one initial ghost mask corresponding to the auxiliary infrared image;
acquiring a difference value between a pixel value corresponding to at least one auxiliary infrared image and a pixel value corresponding to a reference infrared image; or acquiring a difference value between the gradient information corresponding to the at least one auxiliary infrared image and the gradient information corresponding to the reference infrared image;
generating pixel value marking information according to the difference value;
and marking the initial ghost mask according to the pixel value marking information to obtain at least one infrared ghost mask.
After the step of establishing at least one initial ghost mask corresponding to the auxiliary infrared image, the method further comprises the following steps:
the initial ghost mask is initialized.
Further, the step of fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image includes:
acquiring weights of a plurality of registered visible light images;
resetting the weights according to at least one visible light ghost mask to obtain a plurality of reset weights;
normalizing the multiple reset weights;
and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
Before the step of resetting the weights according to at least one visible light ghost mask to obtain the multiple reset weights, the method further includes:
the at least one visible light ghost mask is subjected to an expansion and etching process.
Further, the step of obtaining at least one visible light ghost mask corresponding to the at least one infrared ghost mask includes:
and mapping the at least one infrared ghost mask according to the calibration information between the first camera and the second camera to obtain at least one visible light ghost mask.
In specific implementation, the processing method may be applied to a terminal device, and may also be applied to a server, and for other process implementations of the processing method, reference may be made to the relevant description of the first embodiment and the second embodiment.
EXAMPLE five
An embodiment of the present application further provides an image processing apparatus, as shown in fig. 5, the apparatus includes:
a receiving module 51, configured to receive visible light images corresponding to a plurality of different exposure values acquired by the first camera for the photographic object; receiving a plurality of infrared images which correspond to the visible light images corresponding to the different exposure values and are acquired by a second camera;
a registration module 52, configured to register the multiple infrared images to obtain an offset matrix; registering the visible light images with different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and a fusion module 53, configured to fuse the multiple registered visible light images to obtain a fusion image.
Further, the fusion module 53 is further configured to obtain weights of the plurality of registered visible light images; normalizing the plurality of weights; and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
Further, the registration module 52 is further configured to register the multiple infrared images, and obtain multiple registered infrared images simultaneously in the process of obtaining the offset matrix. The device also includes:
the ghost detection module is used for carrying out ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask; at least one visible light ghosting mask corresponding to the at least one infrared ghosting mask is obtained.
The ghost detection module is also used for establishing at least one initial ghost mask corresponding to the auxiliary infrared image; acquiring a difference value between a pixel value corresponding to at least one auxiliary infrared image and a pixel value corresponding to a reference infrared image; or acquiring a difference value between the gradient information corresponding to the at least one auxiliary infrared image and the gradient information corresponding to the reference infrared image; generating pixel value marking information according to the difference value; and marking the initial ghost mask according to the pixel value marking information to obtain at least one infrared ghost mask.
Further, the fusion module 53 is further configured to obtain weights of the plurality of registered visible light images; resetting the weights according to at least one visible light ghost mask to obtain a plurality of reset weights; normalizing the multiple reset weights; and fusing the plurality of registered visible light images according to the plurality of weights after the normalization processing to obtain a fused image.
The image processing apparatus of the embodiment of the present application may be a terminal device, or may be a remote device having an image processing capability, such as a server. The functional implementation of each functional module of the processing device can be referred to the description of the image processing in the image capturing method in the first and second embodiments.
EXAMPLE six
The embodiment of the application provides an electronic device, which comprises a memory and a processor, wherein the memory is used for storing a computer program, and the processor runs the computer program to enable the electronic device to execute the image shooting method in the first embodiment and the image processing method in the second embodiment.
Alternatively, the electronic device may be a server.
In addition, the embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and the computer program realizes the image capturing method according to the first embodiment or the second embodiment and the image processing method according to the fourth embodiment when being executed by a processor.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (14)
1. An image capturing method, characterized in that the method comprises:
collecting visible light images corresponding to a plurality of different exposure values of a shot object through a first camera;
acquiring a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values respectively through a second camera;
registering the plurality of infrared images to obtain an offset matrix;
registering the visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and fusing the plurality of registered visible light images to obtain a fused image.
2. The image capturing method according to claim 1, wherein the step of fusing the plurality of registered visible light images to obtain a fused image includes:
acquiring weights of a plurality of the registered visible light images;
normalizing the plurality of weights;
and fusing the plurality of registered visible light images according to the plurality of weights after normalization processing to obtain a fused image.
3. The image capturing method according to claim 1, further comprising, after the step of registering the plurality of infrared images:
obtaining a plurality of registered infrared images;
carrying out ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask;
obtaining at least one visible light ghost mask corresponding to at least one infrared ghost mask;
the step of fusing the plurality of registered visible light images to obtain a fused image includes:
and fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image.
4. The image photographing method according to claim 3, wherein the plurality of different exposure values include a reference exposure value and at least one auxiliary exposure value; the step of performing ghost detection on the plurality of registered infrared images to obtain at least one infrared ghost mask includes:
and carrying out ghost detection between the reference infrared image corresponding to the reference exposure value in the registered infrared image and the auxiliary infrared image corresponding to the at least one auxiliary exposure value to obtain at least one infrared ghost mask.
5. The image capturing method according to claim 4, wherein the step of performing ghost detection between the reference infrared image corresponding to the reference exposure value and the auxiliary infrared image corresponding to the at least one auxiliary exposure value in the registered infrared images to obtain the at least one infrared ghost mask includes:
establishing at least one initial ghost mask corresponding to the auxiliary infrared image;
acquiring a difference value between a pixel value corresponding to at least one auxiliary infrared image and a pixel value corresponding to the reference infrared image; or acquiring a difference value between gradient information corresponding to at least one auxiliary infrared image and gradient information corresponding to the reference infrared image;
generating pixel value marking information according to the difference value;
and marking the initial ghost mask according to the pixel value marking information to obtain at least one infrared ghost mask.
6. The image capture method of claim 5, further comprising, after the step of establishing at least one initial ghost mask corresponding to the auxiliary infrared image:
initializing the initial ghost mask.
7. The image capturing method according to any one of claims 3 to 6, wherein the step of fusing the plurality of registered visible light images according to at least one visible light ghost mask to obtain a fused image includes:
acquiring weights of a plurality of the registered visible light images;
resetting the weights according to at least one visible light ghost mask to obtain a plurality of reset weights;
normalizing the weights after the plurality of resets;
and fusing the plurality of registered visible light images according to the plurality of weights after normalization processing to obtain a fused image.
8. The image capturing method according to claim 7, wherein before the step of obtaining a plurality of the reset weights by resetting the plurality of the weights according to at least one of the visible light ghost masks, the method further comprises:
and performing expansion and corrosion treatment on at least one visible light ghost mask.
9. The image capturing method according to any one of claims 3 to 8, wherein the step of obtaining at least one visible light ghost mask corresponding to at least one of the infrared ghost masks comprises:
and mapping at least one infrared ghost mask according to the calibration information between the first camera and the second camera to obtain at least one visible light ghost mask.
10. An image capturing apparatus, characterized in that the apparatus comprises:
the first acquisition module is used for acquiring visible light images corresponding to a plurality of different exposure values of the shot object through the first camera;
the second acquisition module is used for acquiring a plurality of infrared images corresponding to the visible light images corresponding to the different exposure values through a second camera;
the registration module is used for registering the plurality of infrared images to obtain an offset matrix; registering a plurality of visible light images corresponding to the different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and the fusion module is used for fusing the plurality of registered visible light images to obtain a fused image.
11. An image processing method, characterized in that the method comprises:
receiving visible light images corresponding to a plurality of different exposure values acquired by a first camera for a shooting object;
receiving a plurality of infrared images which correspond to the visible light images corresponding to the different exposure values and are acquired by a second camera;
registering the plurality of infrared images to obtain an offset matrix;
registering the plurality of visible light images with different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and fusing the plurality of registered visible light images to obtain a fused image.
12. An image processing apparatus, characterized in that the apparatus comprises:
the receiving module is used for receiving visible light images corresponding to a plurality of different exposure values acquired by the first camera for the shot object; receiving a plurality of infrared images which correspond to the visible light images corresponding to the different exposure values and are acquired by a second camera;
the registration module is used for registering the plurality of infrared images to obtain an offset matrix; registering the plurality of visible light images with different exposure values according to the offset matrix to obtain a plurality of registered visible light images;
and the fusion module is used for fusing the plurality of registered visible light images to obtain a fused image.
13. An electronic device, comprising a memory for storing a computer program and a processor for executing the computer program to cause the electronic device to execute the image capturing method according to any one of claims 1 to 9 or the image processing method according to claim 11.
14. A computer-readable storage medium, characterized in that it stores a computer program which, when executed by a processor, implements the image capturing method according to any one of claims 1 to 9 or the image processing method according to claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110658640.1A CN113596341B (en) | 2021-06-11 | 2021-06-11 | Image shooting method, image processing device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110658640.1A CN113596341B (en) | 2021-06-11 | 2021-06-11 | Image shooting method, image processing device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113596341A true CN113596341A (en) | 2021-11-02 |
| CN113596341B CN113596341B (en) | 2024-04-05 |
Family
ID=78243732
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110658640.1A Active CN113596341B (en) | 2021-06-11 | 2021-06-11 | Image shooting method, image processing device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113596341B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004029372A (en) * | 2002-06-26 | 2004-01-29 | Nikon Corp | Mask, method for measuring imaging property, exposure method and method for manufacturing device |
| WO2005053966A1 (en) * | 2003-12-04 | 2005-06-16 | IBF Indústria Brasileira de Filmes Ltda. | Positive working thermal imaging assembly, method for the manufacture thereof and lithographic printing plate |
| CN101888487A (en) * | 2010-06-02 | 2010-11-17 | 中国科学院深圳先进技术研究院 | High dynamic range video imaging system and image generating method |
| CN104202538A (en) * | 2014-09-10 | 2014-12-10 | 浙江广播电视集团 | Double-registration method for different-exposure images in wide dynamic camera |
| CN106713744A (en) * | 2016-11-28 | 2017-05-24 | 努比亚技术有限公司 | Method and apparatus for realizing light painting photography, and shooting device |
| WO2018137267A1 (en) * | 2017-01-25 | 2018-08-02 | 华为技术有限公司 | Image processing method and terminal apparatus |
| US20180227509A1 (en) * | 2015-08-05 | 2018-08-09 | Wuhan Guide Infrared Co., Ltd. | Visible light image and infrared image fusion processing system and fusion method |
| CN108550104A (en) * | 2018-02-28 | 2018-09-18 | 北京集光通达科技股份有限公司 | Method for registering images, device |
| CN109348116A (en) * | 2018-11-28 | 2019-02-15 | 国网电力科学研究院武汉南瑞有限责任公司 | Single channel visible light merges monitoring system with infrared image acquisition |
| CN110177221A (en) * | 2019-06-25 | 2019-08-27 | 维沃移动通信有限公司 | The image pickup method and device of high dynamic range images |
| CN112102380A (en) * | 2020-09-11 | 2020-12-18 | 北京华捷艾米科技有限公司 | Registration method and related device for infrared image and visible light image |
| CN112215875A (en) * | 2020-09-04 | 2021-01-12 | 北京迈格威科技有限公司 | Image processing method, device and electronic system |
| CN112257713A (en) * | 2020-11-12 | 2021-01-22 | Oppo广东移动通信有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN112561973A (en) * | 2020-12-23 | 2021-03-26 | 维沃移动通信有限公司 | Method and device for training image registration model and electronic equipment |
-
2021
- 2021-06-11 CN CN202110658640.1A patent/CN113596341B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004029372A (en) * | 2002-06-26 | 2004-01-29 | Nikon Corp | Mask, method for measuring imaging property, exposure method and method for manufacturing device |
| WO2005053966A1 (en) * | 2003-12-04 | 2005-06-16 | IBF Indústria Brasileira de Filmes Ltda. | Positive working thermal imaging assembly, method for the manufacture thereof and lithographic printing plate |
| CN101888487A (en) * | 2010-06-02 | 2010-11-17 | 中国科学院深圳先进技术研究院 | High dynamic range video imaging system and image generating method |
| CN104202538A (en) * | 2014-09-10 | 2014-12-10 | 浙江广播电视集团 | Double-registration method for different-exposure images in wide dynamic camera |
| US20180227509A1 (en) * | 2015-08-05 | 2018-08-09 | Wuhan Guide Infrared Co., Ltd. | Visible light image and infrared image fusion processing system and fusion method |
| CN106713744A (en) * | 2016-11-28 | 2017-05-24 | 努比亚技术有限公司 | Method and apparatus for realizing light painting photography, and shooting device |
| WO2018137267A1 (en) * | 2017-01-25 | 2018-08-02 | 华为技术有限公司 | Image processing method and terminal apparatus |
| CN108550104A (en) * | 2018-02-28 | 2018-09-18 | 北京集光通达科技股份有限公司 | Method for registering images, device |
| CN109348116A (en) * | 2018-11-28 | 2019-02-15 | 国网电力科学研究院武汉南瑞有限责任公司 | Single channel visible light merges monitoring system with infrared image acquisition |
| CN110177221A (en) * | 2019-06-25 | 2019-08-27 | 维沃移动通信有限公司 | The image pickup method and device of high dynamic range images |
| CN112215875A (en) * | 2020-09-04 | 2021-01-12 | 北京迈格威科技有限公司 | Image processing method, device and electronic system |
| CN112102380A (en) * | 2020-09-11 | 2020-12-18 | 北京华捷艾米科技有限公司 | Registration method and related device for infrared image and visible light image |
| CN112257713A (en) * | 2020-11-12 | 2021-01-22 | Oppo广东移动通信有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN112561973A (en) * | 2020-12-23 | 2021-03-26 | 维沃移动通信有限公司 | Method and device for training image registration model and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 廉蔺: "基于边缘最优映射的红外和可见光图像自动配准算法", 《自动化学报》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113596341B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Gallo et al. | Artifact-free high dynamic range imaging | |
| CN110717942B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| KR101699919B1 (en) | High dynamic range image creation apparatus of removaling ghost blur by using multi exposure fusion and method of the same | |
| JP4846259B2 (en) | Brightness correction | |
| EP1924966B1 (en) | Adaptive exposure control | |
| CN113992861B (en) | Image processing method and image processing device | |
| CN110992272B (en) | Dark light image enhancement method, device, equipment and medium based on deep learning | |
| CN108234858B (en) | Image blurring processing method and device, storage medium and electronic equipment | |
| JP2005295567A (en) | Digital camera with luminance correction | |
| TWI496105B (en) | Image synthesis device and computer program for image synthesis | |
| CN113206949B (en) | Semi-direct monocular vision SLAM method based on entropy weighted image gradient | |
| CN111161136B (en) | Image blurring method, image blurring device, equipment and storage device | |
| WO2022193288A1 (en) | Image processing method and apparatus, and computer readable storage medium | |
| CN110956661A (en) | Method for calculating dynamic pose of visible light and infrared camera based on bidirectional homography matrix | |
| WO2021139635A1 (en) | Method and apparatus for generating super night scene image, and electronic device and storage medium | |
| CN113313661A (en) | Image fusion method and device, electronic equipment and computer readable storage medium | |
| CN106846249A (en) | A kind of panoramic video joining method | |
| Vijay et al. | Non-uniform deblurring in HDR image reconstruction | |
| CN112215875A (en) | Image processing method, device and electronic system | |
| CN106469435B (en) | Image processing method, device and equipment | |
| CN114155285B (en) | Image registration method based on gray histogram | |
| CN113159229B (en) | Image fusion method, electronic equipment and related products | |
| CN113673474A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN113596341B (en) | Image shooting method, image processing device and electronic equipment | |
| Dasari et al. | A joint visual-inertial image registration for mobile HDR imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |