CN115552457A - Method and apparatus for noise reduction, and computer usable medium storing software for implementing the method - Google Patents
Method and apparatus for noise reduction, and computer usable medium storing software for implementing the method Download PDFInfo
- Publication number
- CN115552457A CN115552457A CN202080100621.0A CN202080100621A CN115552457A CN 115552457 A CN115552457 A CN 115552457A CN 202080100621 A CN202080100621 A CN 202080100621A CN 115552457 A CN115552457 A CN 115552457A
- Authority
- CN
- China
- Prior art keywords
- image frame
- reference image
- tile
- texture score
- frames
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000009467 reduction Effects 0.000 title description 10
- 230000004927 fusion Effects 0.000 claims abstract description 28
- 230000004044 response Effects 0.000 claims description 7
- 230000006870 function Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/40—Analysis of texture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The present invention provides a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, comprising: sequentially acquiring a current image frame and at least one previous image frame, setting one of the current image frame and the at least one previous image frame as a reference image frame, aligning image frames other than the reference image frame with the reference image frame, calculating a texture score in each tile of the reference image frame, fusing the image frames other than the reference image frame with the reference image frame by adjusting a fusion coefficient according to the calculated texture score, and outputting a noise-reduced reference image frame.
Description
Technical Field
The present invention relates generally to the field of image processing technology, and more particularly, to a method and apparatus for reducing noise in image frames, and a computer usable medium storing software for implementing the method.
Background
In recent years, color imaging devices have been developed and widely used in apparatuses such as mobile phones, digital cameras, and the like. With the advancement of high-speed/large-capacity data communication, a high-speed processor or high color quality is required.
As one of techniques for reducing noise in an image frame, a Multiple Frame Noise Reduction (MFNR) method has been used, and one example of the MFNR method is disclosed in WO2015/172366 A1. However, this approach always requires multiple cameras to reduce noise. Therefore, the hardware burden is considerable and not cost-effective.
Although there are other noise reduction methods, it is difficult to actually improve the noise reduction effect and prevent the loss of texture due to blurring, ghosting, and the like.
Disclosure of Invention
The present invention is directed to solving at least one of the above technical problems. Accordingly, the present invention is required to provide a method and apparatus for reducing noise in a moving image photographing mode or a still image photographing mode, and a computer usable medium storing software that causes a computer to implement the method of reducing noise.
According to one aspect of the invention, a method for reducing noise in an image frame may comprise:
sequentially acquiring a current image frame and at least one previous image frame;
setting one image frame of the current image frame and the at least one previous image frame as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
In some embodiments, the texture score in each tile of the reference image frame may be calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
In some embodiments, in response to fusing a current image frame other than the reference image frame to the reference image frame, a fusion coefficient is adjusted according to the calculated texture score by taking into account a state of an imaged scene.
According to an aspect of the present invention, a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode may include:
simultaneously acquiring at least two current image frames;
setting one of the current image frames as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference current image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
According to an aspect of the present invention, an apparatus for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode may include:
at least one camera unit configured to sequentially acquire a current image frame and at least one previous image frame;
a processor configured to input the current image frame and the at least one previous image frame, set one of the current image frame and the at least one previous image frame as a reference image frame, align image frames other than the reference image frame with the reference image frame, calculate a texture score in each tile of the reference image frame, fuse the image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score, and output a noise-reduced reference image frame; and
a display unit configured to display the noise-reduced reference image frame.
According to an aspect of the present invention, an apparatus for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode may include:
at least two camera units, each of which is respectively configured to simultaneously acquire a current image frame, for a total of at least two of the current image frames;
a processor configured to input the at least two current image frames, set one of the current image frames as a reference image frame, align image frames other than the reference image frame with the reference image frame, calculate a texture score in each tile of the reference image frame, fuse the image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score, and output a noise-reduced reference image frame; and
a display unit configured to display the noise-reduced reference image frame.
According to an aspect of the present invention, a computer usable medium storing software for causing a computer to implement a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode may include:
sequentially acquiring a current image frame and at least one previous image frame;
setting one of the current image frame and the at least one previous image frame as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
According to one aspect of the present invention, a computer-usable medium storing software for causing a computer to implement a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, the method comprising:
simultaneously acquiring at least two current image frames;
setting one of the current image frames as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
Drawings
These and/or other aspects and advantages of embodiments of the present invention will become apparent and more readily appreciated from the following description, taken with reference to the accompanying drawings, in which:
fig. 1 is a block diagram schematically showing a circuit configuration of an apparatus for reducing noise in a moving image capturing mode or a still image capturing mode according to a first embodiment of the present invention;
fig. 2A is a photograph of an example of a previous image frame in a night scene in a moving image photographing mode or a still image photographing mode;
fig. 2B is a photograph of an example of a current image frame in a night scene in a moving image capturing mode or a still image capturing mode;
fig. 3 is an explanatory diagram showing an example of texture score mapping of the current image frame (t);
fig. 4 is a flowchart illustrating a method for reducing noise in a moving image photographing mode or a still image photographing mode according to a second embodiment of the present invention;
fig. 5 is a block diagram schematically showing a circuit configuration of an apparatus for reducing noise in a moving image capturing mode or a still image capturing mode according to a third embodiment of the present invention; and
fig. 6 is a flowchart illustrating a method for reducing noise in a moving image photographing mode or a still image photographing mode according to a fourth embodiment of the present invention.
Detailed Description
Embodiments of the invention will be described in detail and examples of embodiments will be shown in the accompanying drawings. Throughout the specification, the same or similar elements and elements having the same or similar functions are denoted by the same reference numerals. The embodiments described herein with reference to the drawings are illustrative and are intended to be illustrative of the invention, but should not be construed as limiting the invention.
Referring to fig. 1, an apparatus 10 for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode according to a first embodiment of the present invention includes at least one camera unit 11, a processor 12, a display unit 13, and a memory 14.
The camera unit 11 sequentially acquires at least two image frames, i.e., a current image frame (t) and at least one previous image frame (t-1. The number of previous image frames is not limited. In the capture mode, two or more previous image frames (t-1, t-2, \8230; t-m, where m is an integer, and m ≧ 2) are preferably acquired to effectively reduce noise.
A night scene or an indoor dark scene is a typical example, and in this case, it is difficult not only to achieve noise reduction but also to prevent texture loss due to blurring, ghosting, and the like. If the noise is excessively reduced, texture (especially texture registered for bright images surrounded by dark background) is lost due to blurring, ghosting, etc., and image artifacts are created. If the noise reduction is too little, the noise will be noticeable, especially in dark backgrounds.
Fig. 2A shows a previous image frame (t-1), and fig. 2B shows a current image frame (t) in a night scene sequentially acquired by the camera unit 11.
Returning to fig. 1, the processor 12 inputs a current image frame (n) and at least one previous image frame (n-1) acquired by the camera unit 11 in a moving image photographing mode or a still image photographing mode.
The processor 12 sets one of a current image frame (n) and at least one previous image frame (n-1) as a reference image frame.
The processor 12 aligns image frames other than the reference image frame with the reference image frame, specifically, aligns image registration included in the image frames other than the reference image frame with image registration included in the reference image frame (corresponding to registration in the image frames other than the reference image frame).
The processor 12 also calculates a texture score in each tile of the reference image frame using the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
Using the above calculation, a texture score in each small block of the reference image frame can be obtained with a relatively low amount of calculation.
Fig. 3 is a graph showing an example of texture score mapping of a reference image frame, although it is not necessary to map the calculated texture score during an actual noise reduction process. In other words, the figure shows an example of a mapping for calculating texture scores (from 0 to 60), and the vertical and horizontal axes correspond to the size of the image frame.
By comparing fig. 3 with fig. 2A or 2B, it is clear that the texture score corresponds to the brightness (light intensity value) of the image registration in the image frame of fig. 2A or 2B. A high texture score corresponds to bright image registration (e.g., tree or moon) and a low texture score corresponds to a dark and flat background.
Returning to fig. 1, the processor 12 further fuses the image frames other than the reference image frame to the reference image frame by adjusting the fusion coefficient.
The fusion coefficient is adjusted according to the calculated texture score. Specifically, in the case where the calculated texture score is high, the noise component is relatively insignificant. Texture loss should be avoided and the quality of the output image should not be degraded. Therefore, the fusion coefficient is set to a low value. The noise reduction is not applied excessively, and therefore the influence of the image frames other than the reference image frame on the reference image frame is relatively small.
In contrast, in the case where the calculated texture score is low, since the noise component is significant, it is possible to greatly reduce noise and set the fusion coefficient to a large value. The image frames other than the reference image frame have a relatively strong influence on the reference image frame.
The processor 12 outputs the noise-reduced reference image frame, and the display unit 13 receives the noise-reduced reference image frame and displays it on its screen.
As a result, according to the texture score, not only improvement of the noise reduction effect but also prevention of texture loss due to blurring, ghosting, and the like can be achieved with a relatively low calculation amount.
Further, when adjusting the fusion coefficient, it is preferable to consider the state of the imaging scene, such as a night scene, an indoor scene, an outdoor scene, a close-up shooting mode, a portrait shooting mode, a landscape shooting mode, and the like.
A method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode according to a second embodiment of the present invention includes the following steps shown in fig. 4.
In step S11, a current image frame (t) and at least one previous image frame (t-1) are sequentially acquired.
In step S12, one of the current image frame (t) and the at least one previous image frame (t-1) is set as a reference image frame.
In step S13, image frames other than the reference image frame are aligned with the reference image frame.
In step S14, a texture score in each patch of the reference image frame is calculated.
In step S15, image frames other than the reference image frame are fused to the reference image frame by adjusting the fusion coefficient based on the calculated texture score.
In step S16, the noise-reduced reference image frame is output.
As shown in fig. 1, in the circuit configuration of the apparatus for noise reduction according to the above-described first embodiment, one camera unit 11 is included. However, the number of camera units is not limited, and two or more camera units may be included.
As shown in fig. 5, the apparatus for reducing noise in a moving image photographing mode or a still image photographing mode according to the third embodiment of the present invention includes two or more camera units 21-1, 21-2, \ 8230;, 21-m (where m is an integer, and m ≧ 2), a processor 22, a display unit 23, and a memory 24. These plurality of camera units 21-1, 21-2, \ 8230;, 21-m differ from each other in terms of, for example, focal length, angle of view, or sensor type. More specifically, the camera unit 21-1 may include a color sensor, and the camera unit 21-2 may include a monochrome sensor. The color sensor acquires color information and brightness information. The monochrome sensor obtains luminance information with higher sensitivity than the color sensor.
At least two of the camera units acquire at least two current image frames simultaneously. For example, the camera unit 21-1 acquires the current image frame at the same time the camera unit 21-2 acquires the current image frame.
The processor 22 inputs at least two current image frames. For example, the processor 22 inputs a current image frame acquired by the camera unit 21-1 and a current image frame acquired by the camera unit 21-2. The processor 22 sets one of the at least two current image frames as a reference image frame. The processor 22 aligns image frames other than the reference image frame with the reference image frame.
The processor 22 calculates a texture score in each tile of the reference image frame using the equation described above.
The processor 22 fuses the image frames other than the reference image frame to the reference image frame by adjusting the fusion coefficient.
The processor 22 outputs the noise-reduced reference image frame. The display unit 23 receives the noise-reduced reference image frame and displays it on its screen.
A method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode according to a fourth embodiment of the present invention includes the following steps shown in fig. 6.
At step S21, at least two current image frames are acquired simultaneously.
In step S22, one of the at least two current image frames is set as a reference image frame.
In step S23, image frames other than the reference image frame are aligned with the reference image frame.
In step S24, a texture score in each tile of the reference image frame is calculated using the above equation.
In step S25, image frames other than the reference image frame are fused to the reference image frame by adjusting a fusion coefficient according to the calculated texture score.
In step S26, the noise-reduced reference image frame is output.
A computer-usable medium according to a fourth embodiment of the present invention is a medium storing software for causing a computer to implement a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, and the method includes the above-described steps shown in fig. 4. Further, a computer-usable medium according to a fourth embodiment of the present invention is a medium storing software for causing a computer to implement a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, and the method includes the above-described steps shown in fig. 6.
In the description of embodiments of the present invention, it should be understood that terms such as "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," and "counterclockwise" should be construed to refer to a direction or position as depicted or shown in the drawing under discussion. These relative terms are used only to simplify the description of the present invention and do not indicate or imply that the referenced devices or elements must have a particular orientation or must be constructed or operated in a particular orientation. Accordingly, these terms should not be construed to limit the present invention.
Moreover, terms such as "first" and "second" are used herein for descriptive purposes and are not intended to indicate or imply relative importance or significance or to imply a number of indicated technical features. Thus, features defined as "first" and "second" may include one or more of such features. In the description of the present invention, "a plurality" means "two or more" unless otherwise specified.
In the description of the embodiments of the present invention, unless specified or limited otherwise, the terms "mounted," "connected," "coupled," and the like are used broadly and can be, for example, a fixed connection, a detachable connection, or an integral connection; mechanical or electrical connections are also possible; or may be a direct connection or an indirect connection through intervening structures; or an internal communication of two elements as would be understood by one skilled in the art depending on the particular situation.
In embodiments of the present invention, unless specified or limited otherwise, a structure in which a first feature is "above" or "below" a second feature may include an embodiment in which the first feature is in direct contact with the second feature, and may also include an embodiment in which the first feature and the second feature are not in direct contact with each other, but are in contact with additional features formed therebetween. Furthermore, a first feature "on," "over," or "top" a second feature may include embodiments in which the first feature is orthogonally or obliquely "on," "above," or "top" the second feature, or simply means that the first feature is taller in height than the second feature, while a first feature "under," "below," or "bottom" the second feature may include embodiments in which the first feature is orthogonally or obliquely "under," "below," or "bottom" the second feature, or simply means that the first feature is taller in height than the second feature.
In the foregoing description, various embodiments and examples have been provided to enable different configurations of the present invention. Certain elements and arrangements are described above to simplify the present disclosure. However, these elements and arrangements are merely exemplary and are not intended to limit the present invention. Furthermore, reference numerals and/or reference letters may be repeated in various examples of the invention. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations. Further, examples of different processes and materials are provided in the present invention. However, it will be appreciated by those skilled in the art that other processes and/or materials may be applied.
Reference in the specification to "an embodiment," "some embodiments," "an example embodiment," "an example," "a specific example" or "some examples" means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. Thus, the appearances of the foregoing phrases or examples throughout this specification are not necessarily referring to the same embodiment or example of the invention. Furthermore, the particular features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.
Any process or method described in flow diagrams or otherwise described herein may be understood as including one or more modules, segments, or portions of executable instruction code for implementing specific logical functions or steps in the process, and the scope of the preferred embodiments of the present invention includes other embodiments in which functions may be implemented in sequences other than those illustrated or discussed, including substantially the same sequence or in reverse.
The logic and/or steps described otherwise herein or shown in flowcharts, e.g., a particular sequence of executable instructions for implementing logical functions, may be embodied in any computer-readable medium for use by an instruction execution system, apparatus, or device (e.g., a computer-based system, processor-containing system, or other system, apparatus, or device that can fetch the instructions from the instruction execution system, or used in conjunction with the instruction execution system, apparatus, or device. In connection with the present specification, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples of the computer readable medium include, but are not limited to: an electronic connection (electronic device) having one or more wires, a portable computer case (magnetic device), a Random Access Memory (RAM), a Read Only Memory (ROM), an erasable programmable read only memory (EPROM or flash memory), an optical fiber device, and a portable Compact Disc Read Only Memory (CDROM). Further, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the paper or other suitable medium can be optically scanned, then edited, decrypted or otherwise processed in other suitable ways as necessary to electronically obtain the program, which can then be stored in a computer memory, for example.
It should be understood that each of the portions of the present invention can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, also in another embodiment, the steps or methods may be implemented by one or a combination of the following techniques known in the art: a discrete logic circuit having a logic gate circuit for realizing a logic function of a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps of the above-described exemplary methods of the present invention may be implemented by program command-related hardware. The program may be stored in a computer readable storage medium and when run on a computer comprises one or a combination of the steps in a method embodiment of the invention.
Furthermore, each functional unit of the embodiments of the present invention may be integrated in a processing module, or these units may exist as separate physical units, or two or more units are integrated in a processing module. The integrated module can be realized in a hardware form, and can also be realized in a software functional module form. When the integrated module is implemented in the form of a software functional module and sold or used as a separate product, the integrated module may be stored in a computer-readable storage medium.
The storage medium may be a read-only memory, a magnetic disk, a CD, etc.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that these embodiments are illustrative and should not be construed as limiting the present invention, and that changes, modifications, substitutions and alterations can be made in the embodiments without departing from the scope of the present invention.
Claims (18)
1. A method for reducing noise in an image frame in a moving image capturing mode or a still image capturing mode, the method comprising:
sequentially acquiring a current image frame and at least one previous image frame;
setting one image frame of the current image frame and the at least one previous image frame as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
2. The method of claim 1, wherein the texture score in each tile of the reference image frame is calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
3. The method according to claim 1 or 2, wherein in response to fusing a current image frame other than the reference image frame to the reference image frame, a fusion coefficient is adjusted according to the calculated texture score by taking into account a state of an imaged scene.
4. A method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, the method comprising:
simultaneously acquiring at least two current image frames;
setting one of the current image frames as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
5. The method according to claim 4, wherein the texture score in each tile of the reference image frame is calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
6. The method according to claim 4 or 5, wherein in response to fusing a current image frame other than the reference image frame to the reference image frame, a fusion coefficient is adjusted according to the calculated texture score by taking into account a state of an imaged scene.
7. An apparatus for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, the apparatus comprising:
at least one camera unit configured to sequentially acquire a current image frame and at least one previous image frame;
a processor configured to input the current image frame and the at least one previous image frame, set one of the current image frame and the at least one previous image frame as a reference image frame, align image frames other than the reference image frame with the reference image frame, calculate a texture score in each tile of the reference image frame, fuse the image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score, and output a noise-reduced reference image frame; and
a display unit configured to display the noise-reduced reference image frame.
8. The apparatus of claim 7, wherein the texture score in each tile of the reference image frame is calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
9. The apparatus according to claim 7 or 8, wherein in response to fusing a current image frame other than the reference image frame to the reference image frame, a fusion coefficient is adjusted according to the calculated texture score by considering a state of an imaged scene.
10. An apparatus for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, the apparatus comprising:
at least two camera units, wherein each of the at least two cameras is configured to simultaneously acquire a current image frame, for a total of at least two of the current image frames;
a processor configured to input the at least two current image frames, set one of the current image frames as a reference image frame, align image frames other than the reference image frame with the reference image frame, calculate a texture score in each tile of the reference image frame, fuse the image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score, and output a noise-reduced reference image frame; and
a display unit configured to display the noise-reduced reference image frame.
11. The apparatus of claim 10, wherein the texture score in each tile of the reference image frame is calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
12. The apparatus according to claim 10 or 11, wherein in response to fusing a current image frame other than the reference image frame to the reference current image frame, the fusion coefficient is adjusted according to the calculated texture score by taking into account a state of the imaged scene.
13. A computer-usable medium storing software for causing a computer to implement a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, the method comprising:
sequentially acquiring a current image frame and at least one previous image frame;
setting one image frame of the current image frame and the at least one previous image frame as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
14. The computer usable medium of claim 13, wherein the texture score in each tile of the reference image frame is calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
15. The computer-usable medium as claimed in claim 13 or 14, wherein, in response to fusing a current image frame other than the reference image frame to the reference frame, the fusion coefficient is adjusted according to the calculated texture score by considering a state of the imaged scene.
16. A computer-usable medium storing software for causing a computer to implement a method for reducing noise in an image frame in a moving image photographing mode or a still image photographing mode, the method comprising:
simultaneously acquiring at least two current image frames;
setting one of the current image frames as a reference image frame;
aligning image frames other than the reference image frame with the reference image frame;
calculating a texture score in each tile of the reference image frame;
fusing image frames other than the reference image frame to the reference image frame by adjusting a fusion coefficient according to the calculated texture score; and
and outputting the noise-reduced reference image frame.
17. The computer usable medium of claim 16, wherein the texture score in each tile of the reference image frame is calculated according to the following equation:
n is the number of pixels in each tile;
xi is the light intensity value of each pixel in each small block;
abs (x) is the absolute value of x.
18. The computer-usable medium as claimed in claim 16 or 17, wherein, in response to fusing a current image frame other than the reference image frame to the reference image frame, the fusion coefficient is adjusted according to the calculated texture score by taking into account a state of the imaged scene.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/088732 WO2021223094A1 (en) | 2020-05-06 | 2020-05-06 | Method and apparatus for reducing noise, and computer usable medium storing software for implementing the method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115552457A true CN115552457A (en) | 2022-12-30 |
Family
ID=78467740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080100621.0A Pending CN115552457A (en) | 2020-05-06 | 2020-05-06 | Method and apparatus for noise reduction, and computer usable medium storing software for implementing the method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115552457A (en) |
| WO (1) | WO2021223094A1 (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170019616A1 (en) * | 2014-05-15 | 2017-01-19 | Huawei Technologies Co., Ltd. | Multi-frame noise reduction method, and terminal |
| CN110189285A (en) * | 2019-05-28 | 2019-08-30 | 北京迈格威科技有限公司 | A kind of frames fusion method and device |
| CN110246101A (en) * | 2019-06-13 | 2019-09-17 | Oppo广东移动通信有限公司 | Image processing method and device |
| CN110264420A (en) * | 2019-06-13 | 2019-09-20 | Oppo广东移动通信有限公司 | Image processing method and device based on multiple image |
| CN111028190A (en) * | 2019-12-09 | 2020-04-17 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN111028189A (en) * | 2019-12-09 | 2020-04-17 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110751608B (en) * | 2019-10-23 | 2022-08-16 | 北京迈格威科技有限公司 | Night scene high dynamic range image fusion method and device and electronic equipment |
-
2020
- 2020-05-06 WO PCT/CN2020/088732 patent/WO2021223094A1/en active Application Filing
- 2020-05-06 CN CN202080100621.0A patent/CN115552457A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170019616A1 (en) * | 2014-05-15 | 2017-01-19 | Huawei Technologies Co., Ltd. | Multi-frame noise reduction method, and terminal |
| CN110189285A (en) * | 2019-05-28 | 2019-08-30 | 北京迈格威科技有限公司 | A kind of frames fusion method and device |
| CN110246101A (en) * | 2019-06-13 | 2019-09-17 | Oppo广东移动通信有限公司 | Image processing method and device |
| CN110264420A (en) * | 2019-06-13 | 2019-09-20 | Oppo广东移动通信有限公司 | Image processing method and device based on multiple image |
| CN111028190A (en) * | 2019-12-09 | 2020-04-17 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN111028189A (en) * | 2019-12-09 | 2020-04-17 | Oppo广东移动通信有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021223094A1 (en) | 2021-11-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111028189B (en) | Image processing method, device, storage medium and electronic equipment | |
| KR102293443B1 (en) | Image processing method and mobile terminal using dual camera | |
| JP6911202B2 (en) | Imaging control method and imaging device | |
| CN102892008B (en) | Dual image capture processes | |
| CN110602467B (en) | Image noise reduction method and device, storage medium and electronic equipment | |
| CN111028190A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20140218550A1 (en) | Image capturing device and image processing method thereof | |
| KR20120068655A (en) | Method and camera device for capturing iris or subject of good quality with one bandpass filter passing both visible ray and near infra red ray | |
| CN102065224B (en) | Image capture apparatus and image capturing method | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| JP2007019973A (en) | Imaging device and imaging method | |
| JP5728498B2 (en) | Imaging apparatus and light emission amount control method thereof | |
| US8855416B2 (en) | Image processing method and image processing apparatus | |
| JP2011103558A (en) | Imaging device, imaging method, and imaging program | |
| CN110740266B (en) | Image frame selection method and device, storage medium and electronic equipment | |
| CN110717871A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US6940556B1 (en) | Electronic still camera and information recording appartus | |
| JP2020039118A (en) | Image processing apparatus and control method thereof | |
| US11798143B2 (en) | Image processing apparatus and control method thereof | |
| US20100007766A1 (en) | Camera device and image processing method | |
| JP4167200B2 (en) | Signal processing apparatus, signal processing method, and digital camera | |
| US20110187903A1 (en) | Digital photographing apparatus for correcting image distortion and image distortion correcting method thereof | |
| JP5387341B2 (en) | Imaging device | |
| US11044396B2 (en) | Image processing apparatus for calculating a composite ratio of each area based on a contrast value of images, control method of image processing apparatus, and computer-readable storage medium | |
| CN116508326A (en) | Tone mapping method and apparatus, computer usable medium storing software for implementing the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |