CN114009005A - Infrared image processing method, electronic device and computer readable storage medium - Google Patents
Infrared image processing method, electronic device and computer readable storage medium Download PDFInfo
- Publication number
- CN114009005A CN114009005A CN202080042493.9A CN202080042493A CN114009005A CN 114009005 A CN114009005 A CN 114009005A CN 202080042493 A CN202080042493 A CN 202080042493A CN 114009005 A CN114009005 A CN 114009005A
- Authority
- CN
- China
- Prior art keywords
- image
- infrared
- infrared image
- pixel
- shake
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 54
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 10
- 230000001131 transforming effect Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 19
- 239000011159 matrix material Substances 0.000 claims description 16
- 230000009466 transformation Effects 0.000 claims description 11
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims description 8
- 238000005259 measurement Methods 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 4
- 238000009499 grossing Methods 0.000 claims description 4
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000004861 thermometry Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 4
- 238000009529 body temperature measurement Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 4
- 238000003786 synthesis reaction Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 238000001931 thermography Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001156002 Anthonomus pomorum Species 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Radiation Pyrometers (AREA)
Abstract
An infrared image processing method, an electronic device, and a computer-readable storage medium, the method comprising: acquiring a plurality of infrared images shot by a shooting device on a continuous time sequence due to shake; determining one of the plurality of infrared images as a reference infrared image; determining the offset of each pixel of other infrared images except the reference infrared image relative to each pixel of the reference image; transforming the other infrared images according to the offset; and synthesizing the other transformed infrared images with the reference infrared image to generate a target infrared image. The invention can acquire the infrared image with high resolution.
Description
The present application relates to the field of image processing technologies, and in particular, to an infrared image processing method, an electronic device, and a computer-readable storage medium.
With the development of the technology, the infrared thermal imaging technology has been widely applied to the life of people. If the surface temperature of the object exceeds absolute zero, electromagnetic waves are radiated, the radiation intensity and the wavelength distribution characteristic of the electromagnetic waves are changed along with the temperature change, and the electromagnetic waves with the wavelength between 0.75 μm and 1000 μm are called as infrared rays. The infrared thermal imaging technology is to use the photoelectric technology to detect the infrared specific wave band signal of the object heat radiation, then convert the signal into the image and graph for the human visual discrimination, and further calculate the temperature value. Infrared thermography techniques have been used to enable humans to overcome visual barriers, whereby one can "see" the temperature profile of the surface of an object.
At present, infrared cameras for acquiring infrared images are also becoming popular. With the development of the technology, people have higher and higher requirements on the accuracy of temperature measurement by using infrared images. Generally, the higher the resolution of an acquired infrared image is, the more information is reflected in the infrared image, correspondingly, the obtained temperature value is also more accurate, and in order to acquire the infrared image with high resolution, a sensor in an infrared camera is generally designed to be larger, so that the number of photosensitive units of the sensor is increased, the corresponding number of pixels is also increased, but the cost for increasing the sensor is high, the size of the infrared camera is also increased, and the infrared camera is inconvenient to carry, so that the use experience of a user is not facilitated.
Disclosure of Invention
In view of the above, an object of the present application is to provide an infrared image processing method, an electronic device and a computer readable storage medium.
In a first aspect, an embodiment of the present application provides an infrared image processing method, including:
acquiring a plurality of infrared images shot by a shooting device on a continuous time sequence due to shake;
determining one of the plurality of infrared images as a reference infrared image;
determining the offset of each pixel of other infrared images except the reference infrared image relative to each pixel of the reference image;
transforming the other infrared images according to the offset;
and synthesizing the other transformed infrared images with the reference infrared image to generate a target infrared image.
In a second aspect, an embodiment of the present application provides an electronic device, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor invokes the executable instructions, which when executed, perform:
acquiring a plurality of infrared images shot by a shooting device on a continuous time sequence due to shake;
determining one of the plurality of infrared images as a reference infrared image;
determining the offset of each pixel of other infrared images except the reference infrared image relative to each pixel of the reference image;
transforming the other infrared images according to the offset;
and synthesizing the other transformed infrared images with the reference infrared image to generate a target infrared image.
In a third aspect, the present application provides a computer-readable storage medium, on which computer instructions are stored, and when executed by a processor, the computer instructions implement the method of the first aspect.
According to the infrared image processing method, the electronic device and the computer-readable storage medium, a plurality of infrared images shot by a shooting device on a continuous time sequence due to jitter are obtained, pixels among different infrared images may generate slight offset due to the jitter of the shooting device, and the infrared images are processed and synthesized to obtain a target infrared image with high resolution.
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of another application scenario provided by an embodiment of the present application;
fig. 3 is a schematic flowchart of an infrared image processing method according to an embodiment of the present application;
fig. 4 is a schematic flowchart of a second infrared image processing method according to an embodiment of the present application;
fig. 5 is a schematic flowchart of a third infrared image processing method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a second electronic device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a third electronic device according to an embodiment of the present application.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
In view of the problems in the related art, embodiments of the present application provide an infrared image processing method, which can acquire a plurality of infrared images captured by a capturing device in a continuous time sequence due to jitter, and acquire a target infrared image with high resolution by processing and combining the plurality of infrared images. According to the embodiment of the application, the target infrared image with high resolution can be acquired without acquiring a sensor with larger size, and hardware expenditure cost is saved.
The infrared image processing method can be applied to the fields of human body temperature measurement, industrial equipment detection, rescue scenes, security inspection, power equipment maintenance diagnosis, railway inspection and the like.
In an exemplary application scenario, referring to fig. 1, a camera 10 may be mounted on a movable platform 11 (e.g., an unmanned aerial vehicle, a movable robot, etc.), the camera 10 may be a device with anti-shake performance lower than a preset threshold, the movable platform 11 may carry the camera 10 to perform shooting, and during a movement of the movable platform 11, the camera 10 may shake along with the movement of the movable platform 11, which is implemented in this embodiment to obtain a target infrared image with high resolution. As one implementation manner, the movable platform 11 may acquire a plurality of infrared images captured by the capturing device 10 in a continuous time sequence due to shaking, acquire a target infrared image with high resolution by processing and combining the plurality of infrared images, and then the movable platform 11 stores the target infrared image or transmits the target infrared image to a control terminal 20 (such as a mobile phone, a computer, a personal tablet, a remote controller with a screen, and the like) of the movable platform 11. As another implementation manner, the movable platform 11 may transmit a plurality of infrared images captured by the capturing device 10 in a continuous time sequence due to shaking to the control terminal 20 of the movable platform 11, so that the control terminal 20 may process and combine the plurality of infrared images to obtain a target infrared image with high resolution. Wherein the movable platform includes, but is not limited to, an unmanned aerial vehicle, an unmanned ship, a movable robot, or a handheld pan and tilt head, etc.
In another exemplary application scenario, referring to fig. 2, the photographing apparatus 10 is a handheld device, and when a user holds the handheld device to photograph, the handheld device may shake due to shaking of a human hand, which is used in this embodiment to obtain a target infrared image with high resolution. As an implementation manner, the photographing apparatus 10 transmits a plurality of infrared images photographed on a continuous time sequence due to the occurrence of jitter to a terminal (such as a mobile phone, a computer, a personal tablet, etc.) or a server connected to the terminal, so that the terminal or the server can process and combine the plurality of infrared images to obtain a target infrared image with high resolution. Of course, the imaging apparatus 10 itself may process and combine a plurality of consecutive images generated by the shake to obtain a target infrared image with a higher resolution. The obtained target infrared image can be used for measuring the temperature of the human body and the like.
It should be noted that fig. 2 is only an example of a handheld camera 10, and in practical applications, a user may directly hold the camera (e.g., a camera) to perform shooting, in which case the shake may be generated by the user or generated by the camera itself; alternatively, the photographing device (e.g., camera) may be mounted on a handle/handheld pan/tilt head that is held by a user to control the camera to take a photograph, i.e., the camera and the handle/handheld pan/tilt head are independent, in which case the above-mentioned shake may be generated by the user or generated by the handle/handheld pan/tilt head or generated by the camera; or, the shooting device is a handle/handheld pan/tilt, and the handle/handheld pan/tilt is provided with a camera, that is, the camera and the handle/handheld pan/tilt are integrated, so that the user can directly hold the handle/handheld pan/tilt to control the camera to shoot, in this case, the shake can be generated by the user or generated by the handle/handheld pan/tilt, optionally, the handle/handheld pan/tilt can also be provided with a display screen, and the shot image can be displayed.
Referring to fig. 3, an embodiment of the present application provides an infrared image processing method, which may be performed by an electronic device, where the electronic device includes but is not limited to a camera, a mobile platform with the camera, such as an unmanned aerial vehicle, a mobile robot, an unmanned vehicle, or an unmanned ship, a terminal, such as a mobile phone, a computer, a remote controller, a personal tablet, or a Personal Digital Assistant (PDA), and a server or a cloud server. The method comprises the following steps:
in step S101, a plurality of infrared images captured by the imaging device over a continuous time series due to the occurrence of shake are acquired.
In step S102, one of the plurality of infrared images is determined as a reference infrared image.
In step S103, the shift amount of each pixel of the infrared image other than the reference infrared image with respect to each pixel of the reference image is determined.
In step S104, the other infrared images are transformed according to the offset.
In step S105, the other converted infrared image and the reference infrared image are synthesized to generate a target infrared image.
In one embodiment, an acceleration sensor and/or an angular velocity sensor (and/or a sensor indicating either or both) such as an IMU sensor (inertial measurement unit) may be mounted on the camera, and whether the camera shakes or the degree of shaking of the camera is detected from measured acceleration data and/or angular velocity data. The shooting device can be a handheld device or a shooting device with the anti-shake performance lower than a preset threshold value.
In the case that the photographing apparatus is a handheld device, when a user holds the photographing apparatus, since a human body cannot be completely stationary, a hand may shake randomly, and correspondingly, the photographing apparatus held by the user may shake randomly, that is, the shake may be generated when the user holds the photographing apparatus to photograph.
When the shooting device is a device with anti-shake performance lower than a preset threshold, the shooting device cannot maintain the same stable state as that in a static state in a moving condition or a condition that the shooting device is carried by a moving movable platform, but shakes to some extent due to inertia or other reasons, that is, the shakes are generated when the shooting device is carried by the moving movable platform for shooting, or the shakes are generated when the shooting device is in motion.
In step S101, the shake of the camera only generates very slight movement, and the difference caused by the slight movement may not be sensed by the human eyes in normal vision, in other words, the target objects (human bodies, objects, a certain area, etc.) shot by the camera in a continuous time sequence are basically the same.
The shooting device can generate sub-pixel level pixel values due to shaking, that is, the electronic device can find the sub-pixel level pixel values in a plurality of infrared images shot by the shooting device due to shaking.
In one embodiment, the camera may generate sub-pixel level pixel values due to random dithering or a predetermined degree of dithering. In one example, the camera is a handheld device, and the shake of the human body holding the camera is an unpredictable random shake process, the camera may generate sub-pixel level pixel values due to the random shake. In one example, the photographing apparatus is a device with anti-shake performance lower than a preset threshold, and when the photographing apparatus moves at a preset speed or the movable platform moves with the photographing apparatus at the preset speed, if other factors are not considered, the photographing apparatus may generate a preset degree of shake, and the photographing apparatus may generate a sub-pixel level pixel value due to the preset degree of shake. In one example, a preset shaking device is installed on the shooting device, and the shaking device can drive the shooting device to shake to a preset degree.
Further, the sub-pixel level pixel value may be determined according to a shake amount of the photographing device; the shake amount may be a shake amount of the shooting device when random shake occurs, or may be a shake amount of the shooting device when shake of a preset degree occurs; that is, the shake amount is determined according to the photographing apparatus when random shake occurs; or the shake amount is determined according to the preset shake of the shooting device. When the shooting device generates random jitter, the jitter degree of the random jitter cannot be estimated, so that the shooting device can generate sub-pixel level pixel values due to the random jitter; when the shooting device generates a preset degree of jitter, because the preset degree of jitter can be controlled manually or by a device, in order to enable the shooting device to generate a sub-pixel level pixel value due to the preset degree of jitter, and the sub-pixel level pixel value is a value between any two pixel values, it can be determined that the jitter amount includes a non-integral multiple of a pixel pitch, so that the sub-pixel level pixel value between any two pixel values can be found from a shot infrared image.
In an embodiment, in a case that the shake degree of the capturing device can be controlled, a preset resolution of the target infrared image to be generated may be preset, and then the electronic device may determine, according to the preset resolution of the target infrared image to be generated, the number of infrared images captured by the capturing device when a preset degree of shake occurs and/or (and/or indicate both or one of them) the shake amount of the capturing device corresponding to each frame of infrared image, so that the capturing device may be controlled to capture images according to the determined shake amount of the capturing device corresponding to each frame of infrared image or the number of infrared images to be captured, and further, the target infrared image with the preset resolution is obtained by the infrared image processing method of this embodiment. In the embodiment, the target infrared image with the preset resolution meeting the user requirements can be generated according to the actual needs of the user, and the use experience of the user is favorably improved.
It is understood that when the number of infrared images is different and/or the shake amount of the camera corresponding to each infrared image is different, and the sub-pixel level pixel values found in the infrared images are different, the resolution of the generated target infrared image is also different.
The shooting device shoots a plurality of infrared images on a continuous time sequence due to shaking, namely each infrared image is shot by the shooting device at different shaking positions, and fine offset can be generated between pixels in different infrared images due to the shaking of the shooting device, namely, the shaking amount of the shooting device is directly related to the offset amount between the pixels in the plurality of infrared images shot by the shooting device due to shaking, and the offset amount between the pixels in the plurality of infrared images is different due to different shaking amounts. In this embodiment, the electronic device may acquire a plurality of infrared images captured by the capturing device in a continuous time sequence due to shaking, and then synthesize the plurality of infrared images for which sub-pixel level pixel values can be found, so as to acquire a target infrared image with a high resolution.
Wherein the infrared image may be an unprocessed image (raw image) captured by the capturing device; alternatively, to further improve the accuracy of the subsequent processing, the infrared image may be a preprocessed image, where the preprocessing includes, but is not limited to, a correction process (e.g., sensor response rate correction, offset correction), a noise removal process, or a dead pixel removal process.
It can be understood that, the number of the infrared images is not limited in any way in the embodiment of the present application, and may be specifically selected according to an actual application scenario. For step S102, after acquiring the plurality of infrared images, the electronic device may determine one of the plurality of infrared images as a reference infrared image, so as to determine an offset of pixels in other infrared images by using the reference infrared image as a reference, thereby achieving alignment of the pixels in the plurality of infrared images.
Wherein the electronic device may determine the reference infrared image by any one of the following implementations:
in a first implementation manner, the electronic device may randomly select one of the plurality of infrared images as the reference infrared image.
In a second implementation manner, the electronic device may acquire image information of each infrared image, and determine the reference infrared image from the plurality of infrared images according to the image information. The image information may be used to reflect the sharpness of the infrared image, including but not limited to: signal-to-noise ratio, image gradient, local variance, or Mean Square Error (MSE), and the electronic device may use one of the infrared images with the most image information as the reference infrared image. For example, the larger the signal-to-noise ratio of the infrared image is, the smaller the noise mixed in the image signal is, the higher the definition of the infrared image is, and the electronic device may select the infrared image with the largest signal-to-noise ratio as the reference infrared image. In this embodiment, the infrared image having the largest image information is used as the reference infrared image, and when the offset of the pixel in the other infrared image is determined by using the reference infrared image as the reference object, the determination result is more accurate.
It can be understood that, in the embodiment of the present application, a specific manner of acquiring the image information is not limited at all, and may be specifically selected according to an actual application scenario, for example, when the image information is image gradient information, the image gradient information of the infrared image may be acquired through a Brenner gradient function, a Tenengrad gradient function, a Laplacian gradient function, an energy gradient function, or the like.
In a third implementation manner, considering that the infrared image is used to obtain a temperature value of a photographed target object, a temperature range in which a user focuses on is different for different target objects, for example, a normal human body temperature range is between 35 ℃ and 37.7 ℃, a temperature range in which a user focuses on may be between 33 ℃ and 40 ℃, and a temperature value outside 33 ℃ and 40 ℃ may not be content of interest to the user, the electronic device may determine one of the infrared images as the reference infrared image according to one or more temperature ranges in which the user is interested.
In particular, the electronic device may obtain one or more temperature ranges of interest to the user, and in one example, the electronic device may provide an interactive interface on which input controls, such as an input box or a selection button, are displayed, and the one or more temperature ranges of interest to the user may be input by the user on the input controls of the interactive interface; after acquiring one or more temperature ranges in which a user is interested, for each of the infrared images, the electronic device determines a target pixel corresponding to the one or more temperature ranges, in one example, the electronic device may determine a corresponding target pixel according to a pre-stored correspondence relationship and the one or more temperature ranges, where the correspondence relationship indicates a mapping relationship between different temperature values and different pixel values; then, the electronic device may obtain image information of the infrared image according to the target pixel, and determine the reference infrared image from the plurality of infrared images according to the image information. In the embodiment, the reference infrared image is determined according to the temperature range in which the user is interested, so that the reference infrared image which best meets the user requirements is ensured to be obtained, and the personalized requirements of the user are met. Wherein the image information includes, but is not limited to: signal-to-noise ratio, image gradient, local variance, or Mean Square Error (MSE), and the electronic device may use one of the infrared images with the most image information as the reference infrared image. In this embodiment, the infrared image having the largest image information is used as the reference infrared image, and when the offset of the pixel in the other infrared image is determined by using the reference infrared image as the reference object, the determination result is more accurate.
In a fourth implementation manner, the electronic device may identify a target area where a preset shooting object is located in the infrared image, and then determine one of the plurality of infrared images as the reference infrared image according to the target area. Specifically, the electronic device may obtain image information of the infrared image according to pixels corresponding to the target area, and determine the reference infrared image from the plurality of infrared images according to the image information. In one example, the infrared image having the most image information may be used as a reference infrared image, and when the reference infrared image is used as a reference object to determine the shift of the pixel in the other infrared images, the determination result is more accurate.
In a fifth implementation manner, the electronic device obtains information of a currently-photographed object, and then obtains a temperature range of the object according to the information of the object and a preset temperature correspondence, where the preset temperature correspondence indicates different temperature ranges corresponding to different objects, and then the electronic device may determine one of the infrared images as the reference infrared image according to the temperature range of the object. Specifically, for each infrared image, the electronic device may determine a target pixel corresponding to a temperature range of the photographic subject, and then the electronic device may acquire image information of the infrared image according to the target pixel and determine the reference infrared image from the plurality of infrared images according to the image information. In one example, the infrared image having the most image information may be used as a reference infrared image, and when the reference infrared image is used as a reference object to determine the shift of the pixel in the other infrared images, the determination result is more accurate.
After determining the reference infrared image, in step S103, the electronic device may determine an offset amount of each pixel of the infrared images other than the reference infrared image with respect to each pixel of the reference image. The offset comprises an angular offset and/or a distance offset, and the distance offset comprises a horizontal distance offset and a vertical distance offset.
In one implementation, an IMU sensor is installed on the camera, and when the camera shakes, the IMU sensor shakes together, so that measurement data of the IMU sensor can be used to represent a shake amount of the camera, and an offset between pixels of the infrared image is also generated due to the shake of the camera, so that an offset amount of each pixel of the other infrared image with respect to each pixel of the reference image can be determined according to the measurement data of the IMU sensor. In this embodiment, the offset of the pixel in the other infrared image is determined by the measurement data of the IMU sensor, and the determination result is more accurate.
In another implementation manner, the electronic device may acquire alignment relationships between the other infrared images and the reference image, and then determine, using the alignment relationships, offsets of pixels of the other infrared images other than the reference infrared image with respect to pixels of the reference image; wherein the alignment relationship may be embodied by an affine transformation matrix, a homography matrix, and/or a motion vector between the other infrared image and the reference image, and the electronic device may determine an offset amount of each pixel of the other infrared image except for the reference infrared image with respect to each pixel of the reference image using the affine transformation matrix, the homography matrix, and/or the motion vector. In this embodiment, the offset of the pixels in the other infrared images is determined by the alignment relationship between the other infrared images and the reference image, so that the hardware expenditure cost can be effectively reduced while an accurate determination result is ensured.
Next, in step S104, after determining the offset of each pixel of the other infrared images except for the reference infrared image with respect to each pixel of the reference image, the electronic device transforms the other infrared images according to the offset, so as to realize registration of the other infrared images with the reference infrared image; finally, in step S105, the electronic device synthesizes the other converted infrared images with the reference infrared image, and generates a target infrared image. The above-mentioned reference is that the plurality of infrared images are obtained by shooting when the shooting device generates shake, the shake of the shooting device only generates very slight movement, the shooting device can generate sub-pixel level pixel values due to the shake, and after the other infrared images are transformed according to the offset, the transformed other infrared images can obtain the sub-pixel level pixel values between pixels, so that the transformed other infrared images and the reference infrared image can be synthesized to obtain a target infrared image with high resolution, and such target infrared image can be used for measuring temperature, thereby obtaining a more accurate temperature measurement result.
Further, the electronic device may perform one or more operations of contrast stretching, image enhancement, or pseudo color mapping on the target infrared image to obtain a processed target infrared image; in this embodiment, the image quality of the target infrared image is improved through the above operation, so that the processed target infrared image has a better display effect, and the processed target infrared image can be used for viewing and aiming.
In order to further improve the accuracy of the acquired target infrared image, referring to fig. 4, an embodiment of the present application further provides a second infrared image processing method, which can be executed by the electronic device, where the method includes:
in step S201, a plurality of infrared images captured by the imaging device over a continuous time series due to the occurrence of shake are acquired. Similar to step S101, the description is omitted here.
In step S202, one of the plurality of infrared images is determined as a reference infrared image. Similar to step S102, the description is omitted here.
In step S203, image enhancement processing is performed on each of the plurality of infrared images, and an enhanced infrared image is acquired.
In step S204, the shift amount of each pixel of the enhanced other infrared image with respect to each pixel of the enhanced reference infrared image is determined.
In step S205, the other infrared images are transformed according to the offset.
In step S206, the other converted infrared image and the reference infrared image are synthesized to generate a target infrared image.
In an embodiment, in order to obtain a more accurate offset result, the electronic device first performs image enhancement processing on each of the plurality of infrared images to obtain an enhanced infrared image, where the image enhancement processing includes, but is not limited to, at least one of the following operations: global contrast stretching, local contrast stretching, smoothing processing, or sharpening processing. In this embodiment, by performing image enhancement processing on the infrared image, useful information in the infrared image can be enhanced, overall or local characteristics in the infrared image are further emphasized, the information amount of the infrared image is enriched, and the discrimination effect of the infrared image can be enhanced.
On the basis, the electronic equipment determines the offset of each pixel of the other enhanced infrared images relative to each pixel of the reference enhanced infrared image on the plurality of enhanced infrared images. The above-mentioned we mention that the information content of the enhanced infrared image is rich, and the useful information in the infrared image is also enhanced, so that the offset between the pixels can be determined more accurately on the enhanced infrared image.
In addition, considering that the image enhancement process is also a distortion process, if the synthesis is performed on the enhanced infrared image, some image information may be lost, so that the temperature information reflected by the synthesized target infrared image is not accurate, on the other hand, the image enhancement modes between the infrared images may be different, and if the synthesis is performed on the enhanced infrared image, a non-uniform image enhancement mode may also bring a certain error, so in this embodiment, the other infrared image (the non-enhanced infrared image) is transformed according to the offset, and finally the transformed other infrared image (the non-enhanced infrared image) is synthesized with the reference infrared image (the non-enhanced infrared image) to generate the target infrared image, so that while the target infrared image with high resolution is obtained, certain image information is also guaranteed not to be lost, meanwhile, errors caused by non-uniform image enhancement modes are avoided, accuracy of the target infrared image is guaranteed, the target infrared image obtained in the method can be used for measuring temperature, and therefore a more accurate temperature measuring result is obtained.
Further, the electronic device may perform one or more operations of contrast stretching, image enhancement, or pseudo color mapping on the target infrared image to obtain a processed target infrared image; in this embodiment, the image quality of the target infrared image is improved through the above operation, so that the processed target infrared image has a better display effect, and the processed target infrared image can be used for viewing and aiming.
Correspondingly, referring to fig. 5, an embodiment of the present application further provides a third infrared image processing method, which may be executed by the electronic device, where the method includes:
in step S301, a plurality of infrared images captured by the imaging device over a continuous time series due to the occurrence of shake are acquired. Similar to step S201, the description is omitted here.
In step S302, one of the plurality of infrared images is determined as a reference infrared image. Similar to step S202, the description is omitted here.
In step S303, image enhancement processing is performed on each of the plurality of infrared images, and an enhanced infrared image is acquired. Similar to step S203, the description is omitted here.
In step S304, the shift amount of each pixel of the enhanced other infrared image with respect to each pixel of the enhanced reference infrared image is determined. Similar to step S204, the description is omitted here.
In step S305, the enhanced other infrared images are transformed according to the offset, and an alignment image is obtained.
In step S306, the alignment image and the enhanced reference infrared image are synthesized to generate a target infrared image for viewing.
In this embodiment, after determining the offset amount of each pixel of the other enhanced infrared images relative to each pixel of the reference enhanced infrared image, in addition to performing transformation and subsequent synthesis processing on the non-enhanced infrared image to obtain a target infrared image for temperature measurement, the electronic device may further perform transformation on the other enhanced infrared images according to the offset amount to obtain an aligned image, and then synthesize the aligned image and the reference enhanced infrared image to generate a target infrared image for viewing and aiming. As mentioned above, since the image enhancement process is a distortion process, the present embodiment performs transformation and synthesis processing on the enhanced target infrared image, and although the obtained target infrared image cannot be used for measuring temperature, since the image quality of the infrared image is improved by the image enhancement process, a better display effect can be obtained, and the target infrared image obtained in the present embodiment can be used for observing and aiming.
Accordingly, referring to fig. 6, an embodiment of the present application further provides an electronic device 40, where the electronic device 40 includes, but is not limited to, a camera, a mobile platform carrying the camera, such as an unmanned aerial vehicle, a mobile robot, an unmanned vehicle, or an unmanned ship, a terminal, such as a mobile phone, a computer, a remote controller, a personal tablet, or a Personal Digital Assistant (PDA), and a server or a cloud server. The electronic device 40 includes: a processor 41; a memory 42 for storing instructions executable by the processor 41.
Wherein the processor 41 calls the executable instructions, and when the executable instructions are executed, the executable instructions are used for executing: acquiring a plurality of infrared images shot by a shooting device on a continuous time sequence due to shake; determining one of the plurality of infrared images as a reference infrared image; determining the offset of each pixel of other infrared images except the reference infrared image relative to each pixel of the reference image; transforming the other infrared images according to the offset; and synthesizing the other transformed infrared images with the reference infrared image to generate a target infrared image.
The Processor 41 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 42 stores a computer program of executable instructions of the infrared image processing method, and the memory 42 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the electronic apparatus 40 may cooperate with a network storage device that performs a storage function of the memory 42 through a network connection. The storage 42 may be an internal storage unit of the electronic device 40, such as a hard disk or a memory of the electronic device 40. The memory 42 may also be an external storage device of the electronic device 40, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the electronic device 40. Further, the memory 42 may also include both internal storage units of the electronic device 40 and external storage devices. The memory 42 is used for storing computer programs and other programs and data required by the device. The memory 42 may also be used to temporarily store data that has been output or is to be output.
The various embodiments described herein may be implemented using a computer-readable medium such as computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, and an electronic unit designed to perform the functions described herein. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in memory and executed by the controller.
In one embodiment, the shooting device is a handheld device, and the shake is generated when a user holds the shooting device for shooting; or the shooting device is a device with anti-shake performance lower than a preset threshold, the shake is generated when the moving movable platform carries the shooting device to shoot, or the shake is generated when the moving shooting device shoots.
In one embodiment, the capture device may generate sub-pixel level pixel values due to dithering.
In one embodiment, the sub-pixel level pixel values are determined according to a shake amount of the camera.
The jitter amount is determined according to the random jitter of the shooting device; or the shake amount is determined according to the preset shake of the shooting device.
In one embodiment, when the shooting device shakes by a preset degree, the shake amount comprises a movement amount which is not an integral multiple of a pixel pitch.
In one embodiment, the processor is further configured to: and determining the number of the infrared images shot by the shooting device when the shooting device shakes to a preset degree and/or the shake amount of the shooting device corresponding to each frame of infrared image according to the preset resolution of the target infrared image to be generated.
In an embodiment, the target infrared image is generated with different resolutions according to different numbers of infrared images and/or different amounts of shake of the photographing device corresponding to each frame of infrared image. In one embodiment, the processor 41 is further configured to: respectively carrying out image enhancement processing on the plurality of infrared images to obtain enhanced infrared images; the offset of each pixel of the enhanced other infrared image relative to each pixel of the enhanced reference infrared image is determined.
In an embodiment, when performing the image enhancement processing, the processor is configured to perform at least one of the following operations on the plurality of infrared images: global contrast stretching, local contrast stretching, smoothing processing, or sharpening processing.
In one embodiment, the target infrared image is used for thermometry.
In one embodiment, the processor 41 is further configured to: performing one or more of contrast stretching, image enhancement processing or pseudo-color mapping on the target infrared image to obtain an enhanced target infrared image; and the processed and enhanced target infrared image is used for observing and aiming.
In one embodiment, the processor 41 is further configured to: converting the other enhanced infrared images according to the offset to obtain aligned images; and synthesizing the alignment image and the enhanced reference infrared image to generate a target infrared image for observing and aiming.
In an embodiment, the offset comprises an angular offset and/or a distance offset.
In an embodiment, when determining the reference infrared image, the processor 41 is specifically configured to: and acquiring image information of each infrared image, and determining the reference infrared image from the plurality of infrared images according to the image information.
In an embodiment, when determining the reference infrared image, the processor 41 is specifically configured to: acquiring one or more temperature ranges of interest to a user; for each infrared image, determining target pixels corresponding to the one or more temperature ranges, and acquiring image information of the infrared image according to the target pixels; and determining the reference infrared image from the plurality of infrared images according to the image information.
In an embodiment, the image information comprises at least one of: signal to noise ratio, image gradient, or local variance.
In an embodiment, the reference infrared image is an image with the most image information among the plurality of infrared images.
In one embodiment, an IMU sensor is installed on the shooting device;
the offset of each pixel of the further infrared image relative to each pixel of the reference image is determined from measurement data mounted to the IMU sensor.
In an embodiment, the processor 41 is specifically configured to: acquiring an affine transformation matrix, a homography matrix and/or a motion vector between the other infrared images and the reference image respectively; determining an offset of each pixel of the infrared image other than the reference infrared image with respect to each pixel of the reference image using the affine transformation matrix, the homography matrix, and/or the motion vector.
In one embodiment, the infrared image is a preprocessed image; the pre-processing comprises at least one of the following operations: a rectification process, a noise removal, or a dead pixel removal.
In one embodiment, the electronic device is the camera; alternatively, referring to fig. 7, the shooting device 43 is installed in the electronic device 40; alternatively, referring to fig. 8, the electronic device 40 further includes a communication module 44, and the communication module 44 is configured to receive a plurality of infrared images captured by the capturing device. For the apparatus embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment for relevant points.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as a memory comprising instructions, executable by a processor of an electronic device to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Wherein the instructions in the storage medium, when executed by the processor, enable the electronic device to perform the aforementioned infrared image processing method.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The method and apparatus provided by the embodiments of the present application are described in detail above, and the principle and the embodiments of the present application are explained herein by applying specific examples, and the description of the embodiments above is only used to help understand the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (42)
- An infrared image processing method is characterized by comprising the following steps:acquiring a plurality of infrared images shot by a shooting device on a continuous time sequence due to shaking;determining one of the plurality of infrared images as a reference infrared image;determining the offset of each pixel of other infrared images except the reference infrared image relative to each pixel of the reference image;transforming the other infrared images according to the offset;and synthesizing the other transformed infrared images with the reference infrared image to generate a target infrared image.
- The method according to claim 1, wherein the camera is a handheld device, and the shake is generated by a user while holding the camera for shooting; alternatively, the first and second electrodes may be,the shooting device is a device with anti-shake performance lower than a preset threshold, wherein shake is generated when the moving movable platform carries the shooting device to shoot, or shake is generated when the moving shooting device shoots.
- The method of claim 1 or 2, wherein the camera generates sub-pixel level pixel values due to dithering.
- The method of claim 3, wherein the sub-pixel level pixel values are determined based on an amount of shake of the camera;the jitter amount is determined according to the random jitter of the shooting device; or the shake amount is determined according to the preset shake of the shooting device.
- The method of claim 4, wherein the amount of shake comprises a movement amount that is a non-integer multiple of a pixel pitch when a preset degree of shake occurs in the camera.
- The method of claim 5, further comprising:and determining the number of the infrared images shot by the shooting device when the shooting device shakes to a preset degree and/or the shake amount of the shooting device corresponding to each frame of infrared image according to the preset resolution of the target infrared image to be generated.
- The method of claim 5 or 6, wherein the target IR picture is generated with a different resolution by varying the number of IR pictures and/or the amount of shake of the camera for each IR picture.
- The method according to any one of claims 1 to 7, before determining the amount of positional shift of each pixel of the infrared image other than the reference infrared image with respect to each pixel of the reference infrared image, further comprising:respectively carrying out image enhancement processing on the plurality of infrared images to obtain enhanced infrared images;the determining offset of each pixel of the infrared images except the reference infrared image relative to each pixel of the reference infrared image comprises:the offset of each pixel of the enhanced other infrared image relative to each pixel of the enhanced reference infrared image is determined.
- The method according to claim 8, wherein the performing image enhancement processing on the plurality of infrared images respectively comprises:respectively performing at least one of the following operations on the plurality of infrared images: global contrast stretching, local contrast stretching, smoothing processing, or sharpening processing.
- The method of any one of claims 1 to 9, wherein the target infrared image is used for thermometry.
- The method of any one of claims 1 to 10, further comprising:performing one or more of contrast stretching, image enhancement or pseudo-color mapping on the target infrared image to obtain a processed target infrared image; and the processed target infrared image is used for observing and aiming.
- The method of claim 8, wherein transforming the other infrared images according to the offset further comprises:converting the other enhanced infrared images according to the offset to obtain aligned images;the synthesizing the other transformed infrared images with the reference infrared image further includes:and synthesizing the alignment image and the enhanced reference infrared image to generate a target infrared image for observing and aiming.
- The method of claim 1, wherein the offset comprises an angular offset and/or a distance offset.
- The method of claim 1, wherein determining one of the plurality of infrared images as a reference infrared image comprises:and acquiring image information of each infrared image, and determining the reference infrared image from the plurality of infrared images according to the image information.
- The method of claim 1, wherein determining one of the plurality of infrared images as a reference infrared image comprises:acquiring one or more temperature ranges of interest to a user;for each infrared image, determining target pixels corresponding to the one or more temperature ranges, and acquiring image information of the infrared image according to the target pixels;and determining the reference infrared image from the plurality of infrared images according to the image information.
- The method according to claim 14 or 15, characterized in that the image information comprises at least one of the following: signal to noise ratio, image gradient, or local variance.
- The method of claim 16, wherein the reference infrared image is an image with the most image information among the plurality of infrared images.
- The method of claim 1, wherein the camera has an IMU sensor mounted thereon;the offset of each pixel of the other infrared image relative to each pixel of the reference image is determined from the measurement data of the IMU sensor.
- The method of claim 1, wherein determining an offset of each pixel of the infrared image other than the reference infrared image relative to each pixel of the reference image comprises:acquiring an affine transformation matrix, a homography matrix and/or a motion vector between the other infrared images and the reference image respectively;determining an offset of each pixel of the infrared image other than the reference infrared image with respect to each pixel of the reference image using the affine transformation matrix, the homography matrix, and/or the motion vector.
- The method of claim 1, wherein the infrared image is a pre-processed image;the pre-processing comprises at least one of the following operations: a rectification process, a noise removal, or a dead pixel removal.
- An electronic device, comprising:a processor;a memory for storing processor-executable instructions;wherein the processor invokes the executable instructions, which when executed, perform:acquiring a plurality of infrared images shot by a shooting device on a continuous time sequence due to shaking;determining one of the plurality of infrared images as a reference infrared image;determining the offset of each pixel of other infrared images except the reference infrared image relative to each pixel of the reference image;transforming the other infrared images according to the offset;and synthesizing the other transformed infrared images with the reference infrared image to generate a target infrared image.
- The apparatus of claim 21, wherein the camera is a handheld device, and the shake is generated by a user while holding the camera for shooting; alternatively, the first and second electrodes may be,the shooting device is a device with anti-shake performance lower than a preset threshold, wherein shake is generated when the moving movable platform carries the shooting device to shoot, or shake is generated when the moving shooting device shoots.
- The apparatus of claim 21 or 22, wherein the camera generates sub-pixel level pixel values due to dithering.
- The apparatus of claim 23, wherein the sub-pixel level pixel values are determined based on an amount of shake of the camera;the jitter amount is determined according to the random jitter of the shooting device; or the shake amount is determined according to the preset shake of the shooting device.
- The apparatus of claim 24, wherein the amount of shake includes a movement amount that is a non-integer multiple of a pixel pitch when a preset degree of shake occurs in the camera.
- The device of claim 25, wherein the processor is further configured to: and determining the number of the infrared images shot by the shooting device when the shooting device shakes to a preset degree and/or the shake amount of the shooting device corresponding to each frame of infrared image according to the preset resolution of the target infrared image to be generated.
- The apparatus of claim 25 or 26, wherein the target ir picture is generated with a different resolution by varying the number of ir pictures and/or the amount of shake of the camera per ir picture.
- The apparatus according to any one of claims 21 to 27, wherein the processor is further configured to: respectively carrying out image enhancement processing on the plurality of infrared images to obtain enhanced infrared images; the offset of each pixel of the enhanced other infrared image relative to each pixel of the enhanced reference infrared image is determined.
- The apparatus of claim 28, wherein the processor, in performing image enhancement processing, is configured to perform at least one of the following on the plurality of infrared images: global contrast stretching, local contrast stretching, smoothing processing, or sharpening processing.
- The apparatus of any one of claims 21 to 29, wherein the infrared image of the target is used for thermometry.
- The apparatus according to any one of claims 21 to 30, wherein the processor is further configured to: performing one or more of contrast stretching, image enhancement processing or pseudo-color mapping on the target infrared image to obtain an enhanced target infrared image; and the processed and enhanced target infrared image is used for observing and aiming.
- The device of claim 28, wherein the processor is further configured to: converting the other enhanced infrared images according to the offset to obtain aligned images; and synthesizing the alignment image and the enhanced reference infrared image to generate a target infrared image for observing and aiming.
- The apparatus of claim 21, wherein the offset comprises an angular offset and/or a distance offset.
- The device of claim 21, wherein in determining the reference infrared image, the processor is specifically configured to: and acquiring image information of each infrared image, and determining the reference infrared image from the plurality of infrared images according to the image information.
- The device of claim 21, wherein in determining the reference infrared image, the processor is specifically configured to: acquiring one or more temperature ranges of interest to a user; for each infrared image, determining target pixels corresponding to the one or more temperature ranges, and acquiring image information of the infrared image according to the target pixels; and determining the reference infrared image from the plurality of infrared images according to the image information.
- The apparatus according to claim 34 or 35, characterized in that the image information comprises at least one of: signal to noise ratio, image gradient, or local variance.
- The apparatus of claim 36, wherein the reference infrared image is an image with the most image information among the plurality of infrared images.
- The apparatus of claim 21, wherein the camera has an IMU sensor mounted thereon;the offset of each pixel of the further infrared image relative to each pixel of the reference image is determined from measurement data mounted to the IMU sensor.
- The device of claim 21, wherein the processor is specifically configured to: acquiring an affine transformation matrix, a homography matrix and/or a motion vector between the other infrared images and the reference image respectively; determining an offset of each pixel of the infrared image other than the reference infrared image with respect to each pixel of the reference image using the affine transformation matrix, the homography matrix, and/or the motion vector.
- The apparatus of claim 21, wherein the infrared image is a pre-processed image; the pre-processing comprises at least one of the following operations: a rectification process, a noise removal, or a dead pixel removal.
- The apparatus of claim 21, wherein the electronic device is the camera; or the shooting device is installed in the electronic equipment; or, the electronic device further comprises a communication module, and the communication module is used for receiving the plurality of infrared images shot by the shooting device.
- A computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the method of any one of claims 1 to 20.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/098889 WO2022000176A1 (en) | 2020-06-29 | 2020-06-29 | Infrared image processing method, electronic device, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114009005A true CN114009005A (en) | 2022-02-01 |
Family
ID=79317358
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080042493.9A Pending CN114009005A (en) | 2020-06-29 | 2020-06-29 | Infrared image processing method, electronic device and computer readable storage medium |
| CN202080048259.7A Pending CN114072837A (en) | 2020-06-29 | 2020-11-27 | Infrared image processing method, device, equipment and storage medium |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080048259.7A Pending CN114072837A (en) | 2020-06-29 | 2020-11-27 | Infrared image processing method, device, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN114009005A (en) |
| WO (2) | WO2022000176A1 (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW569617B (en) * | 2001-12-31 | 2004-01-01 | Rung-Sen Jang | Image synthesizing method of multi-lens array CCD camera |
| JP2007036750A (en) * | 2005-07-27 | 2007-02-08 | Sharp Corp | Imaging apparatus |
| CN104320596A (en) * | 2014-09-30 | 2015-01-28 | 北京智谷技术服务有限公司 | Obtaining method and obtaining apparatus of super-resolution image |
| CN106713737A (en) * | 2015-11-17 | 2017-05-24 | 纬创资通股份有限公司 | Electronic device and image processing method |
| CN109963082A (en) * | 2019-03-26 | 2019-07-02 | Oppo广东移动通信有限公司 | Image capturing method, device, electronic equipment, computer readable storage medium |
| CN110035206A (en) * | 2019-03-26 | 2019-07-19 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment, computer readable storage medium |
| CN110728644A (en) * | 2019-10-11 | 2020-01-24 | 厦门美图之家科技有限公司 | Image generation method and device, electronic equipment and readable storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546665A (en) * | 2012-07-11 | 2014-01-29 | 北京博雅华录视听技术研究院有限公司 | Method for enhancing image definition on basis of multiple cameras |
| CN103217221B (en) * | 2013-03-22 | 2015-03-11 | 北京航空航天大学 | Air-cooling condenser radiating surface temperature field measuring method based on image stitching |
| TWI530909B (en) * | 2013-12-31 | 2016-04-21 | 財團法人工業技術研究院 | System and method for image composition |
| US9665927B2 (en) * | 2015-06-03 | 2017-05-30 | Samsung Electronics Co., Ltd. | Method and apparatus of multi-frame super resolution robust to local and global motion |
| CN105046676A (en) * | 2015-08-27 | 2015-11-11 | 上海斐讯数据通信技术有限公司 | Image fusion method and equipment based on intelligent terminal |
| CN108900766A (en) * | 2018-06-15 | 2018-11-27 | 北京华捷艾米科技有限公司 | A kind of panorama camera of the automatic enhancement device of panoramic picture and method and the application device |
-
2020
- 2020-06-29 WO PCT/CN2020/098889 patent/WO2022000176A1/en active Application Filing
- 2020-06-29 CN CN202080042493.9A patent/CN114009005A/en active Pending
- 2020-11-27 CN CN202080048259.7A patent/CN114072837A/en active Pending
- 2020-11-27 WO PCT/CN2020/132407 patent/WO2022000974A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW569617B (en) * | 2001-12-31 | 2004-01-01 | Rung-Sen Jang | Image synthesizing method of multi-lens array CCD camera |
| JP2007036750A (en) * | 2005-07-27 | 2007-02-08 | Sharp Corp | Imaging apparatus |
| CN104320596A (en) * | 2014-09-30 | 2015-01-28 | 北京智谷技术服务有限公司 | Obtaining method and obtaining apparatus of super-resolution image |
| CN106713737A (en) * | 2015-11-17 | 2017-05-24 | 纬创资通股份有限公司 | Electronic device and image processing method |
| CN109963082A (en) * | 2019-03-26 | 2019-07-02 | Oppo广东移动通信有限公司 | Image capturing method, device, electronic equipment, computer readable storage medium |
| CN110035206A (en) * | 2019-03-26 | 2019-07-19 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment, computer readable storage medium |
| CN110728644A (en) * | 2019-10-11 | 2020-01-24 | 厦门美图之家科技有限公司 | Image generation method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114072837A (en) | 2022-02-18 |
| WO2022000974A1 (en) | 2022-01-06 |
| WO2022000176A1 (en) | 2022-01-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109194876B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN111147741B (en) | Focusing processing-based anti-shake method and device, electronic equipment and storage medium | |
| US8009197B2 (en) | Systems and method for de-blurring motion blurred images | |
| US8417059B2 (en) | Image processing device, image processing method, and program | |
| CN110166695B (en) | Camera anti-shake method and device, electronic equipment and computer readable storage medium | |
| CN109544620B (en) | Image processing method and apparatus, computer-readable storage medium, and electronic device | |
| JP5843454B2 (en) | Image processing apparatus, image processing method, and program | |
| CN110536057A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN109194877A (en) | Image compensation method and device, computer readable storage medium and electronic equipment | |
| US9811909B2 (en) | Image processing apparatus, distance measuring apparatus, imaging apparatus, and image processing method | |
| CN113875219B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN109598764A (en) | Camera calibration method and device, electronic equipment, computer readable storage medium | |
| JP6656035B2 (en) | Image processing apparatus, imaging apparatus, and control method for image processing apparatus | |
| US11895396B2 (en) | Imaging plan presentation apparatus and method for updating and re-generating an imaging plan | |
| WO2021168804A1 (en) | Image processing method, image processing apparatus and image processing system | |
| JP2017168982A (en) | Imaging apparatus, and control method and program for imaging apparatus | |
| EP2648157A1 (en) | Method and device for transforming an image | |
| CN109660718A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| KR102592745B1 (en) | Posture estimating apparatus, posture estimating method and computer program stored in recording medium | |
| CN109671028A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| KR102131369B1 (en) | Method and apparatus for composing images of celestial bodies | |
| JP2006203504A (en) | Image pickup device | |
| CN114009005A (en) | Infrared image processing method, electronic device and computer readable storage medium | |
| JP2015095670A (en) | Imaging apparatus, control method thereof and control program | |
| Cormier et al. | Measurement and protocol for evaluating video and still stabilization systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220201 |
|
| WD01 | Invention patent application deemed withdrawn after publication |