CN111091506A - Image processing method and device, storage medium and electronic equipment - Google Patents
Image processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN111091506A CN111091506A CN201911214525.4A CN201911214525A CN111091506A CN 111091506 A CN111091506 A CN 111091506A CN 201911214525 A CN201911214525 A CN 201911214525A CN 111091506 A CN111091506 A CN 111091506A
- Authority
- CN
- China
- Prior art keywords
- image
- resolution
- frames
- images
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 18
- 230000004927 fusion Effects 0.000 claims abstract description 35
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000000034 method Methods 0.000 claims abstract description 28
- 238000004590 computer program Methods 0.000 claims description 9
- 210000000746 body region Anatomy 0.000 claims description 8
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000003321 amplification Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003707 image sharpening Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 206010034972 Photosensitivity reaction Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000036211 photosensitivity Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The disclosure provides an image processing method and device, electronic equipment and a storage medium, and relates to the technical field of image processing. The method comprises the following steps: the method comprises the steps of acquiring a first image and a plurality of frames of second images, wherein the resolution of the first image is different from that of each second image. And determining a third image with the same resolution as the first image according to the plurality of frames of the second images. And carrying out image fusion on the first image and the third image based on the obtained focusing area to obtain a fused image. The image quality can be improved, and meanwhile, the signal to noise ratio of the image is improved.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image processing method, an image processing apparatus, an electronic device, and a computer-readable storage medium.
Background
When capturing an image, a user often desires better detail of the captured image. Currently, the image can be subjected to detail enhancement through a hardware module or a software algorithm of the image acquisition device. However, the above method causes an increase in noise of the image and a decrease in the overall image quality of the image.
Disclosure of Invention
An object of the present disclosure is to provide an image processing method, an image processing apparatus, an electronic device, and a computer-readable storage medium, which overcome, to some extent, the problems of increased noise and decreased overall image quality when performing detail enhancement processing on an image due to the limitations and disadvantages of the related art.
According to a first aspect of the present disclosure, there is provided an image processing method including:
acquiring a first image and a plurality of frames of second images, wherein the resolution of the first image is different from the resolution of each second image;
determining a third image with the same resolution as the first image according to the plurality of frames of second images;
and carrying out image fusion on the first image and the third image based on the obtained focusing area to obtain a fused image.
According to a second aspect of the present disclosure, there is provided an image processing apparatus comprising:
the device comprises an image acquisition module, a processing module and a processing module, wherein the image acquisition module is used for acquiring a first image and a plurality of frames of second images, and the resolution of the first image is different from that of each second image;
the image preprocessing module is used for determining a third image with the same resolution as the first image according to the multiple frames of second images;
and the image fusion module is used for carrying out image fusion on the first image and the third image based on the acquired focusing area to obtain a fused image.
According to a third aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the above-described image processing method via execution of the executable instructions.
According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described image processing method.
Exemplary embodiments of the present disclosure may have some or all of the following benefits:
in the image processing method provided by an exemplary embodiment of the present disclosure, a first image and multiple frames of second images with different resolutions are obtained, and the multiple frames of second images are fused to generate a third image, so as to achieve the purpose of reducing noise. And performing image fusion on the first image and the third image based on the focusing area, so that the focusing area has better details, and other areas have higher signal-to-noise ratio. Compared with the method for directly obtaining an image with higher resolution, the method for obtaining the image with the higher resolution can make up the defect of lower signal-to-noise ratio while improving the image quality, and therefore the shooting experience of a user is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
FIG. 1 illustrates a schematic structural diagram of a computer system suitable for use with an electronic device embodying embodiments of the present disclosure;
FIG. 2 shows a flow chart of an image processing method of an embodiment of the present disclosure;
FIG. 3 illustrates a schematic diagram of a focus region and a body region in a first image according to an embodiment of the disclosure;
fig. 4 shows a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
FIG. 1 illustrates a schematic structural diagram of a computer system suitable for use in implementing an electronic device of an embodiment of the present disclosure.
It should be noted that the computer system 100 of the electronic device shown in fig. 1 is only an example, and should not bring any limitation to the functions and the scope of the application of the embodiments of the present disclosure.
As shown in fig. 1, the computer system 100 includes a central processing unit 101 that can perform various appropriate actions and processes according to a program stored in a read only memory 102 or a program loaded from a storage section 108 into a random access memory 103. In the random access memory 103, various programs and data necessary for system operation are also stored. The central processing unit 101, the read only memory 102, and the random access memory 103 are connected to each other via a bus 104. An input/output interface 105 is also connected to the bus 104.
The following components are connected to the input/output interface 105: an input portion 106 including a keyboard, a mouse, and the like; an output section 107 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 108 including a hard disk and the like; and a communication section 109 including a network interface card such as a local area network card, a modem, or the like. The communication section 109 performs communication processing via a network such as the internet. The driver 110 is also connected to the input/output interface 105 as necessary. A removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 110 as necessary, so that a computer program read out therefrom is mounted into the storage section 108 as necessary.
In particular, the processes described below with reference to the flowcharts may be implemented as computer software programs, according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 109, and/or installed from the removable medium 111. The computer program, when executed by the central processing unit 101, performs the various functions defined in the methods and apparatus of the present application.
It should be noted that the computer readable media shown in the present disclosure may be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, radio frequency, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by an electronic device, cause the electronic device to implement the method as described in the embodiments below. For example, the electronic device may implement the various steps shown in fig. 2, and so on.
The technical solution of the embodiment of the present disclosure is explained in detail below:
when an image is shot, an area which is actually interested by a user often exists in the image, such as a human face when a person image is shot and a foreground of a landscape when the image has front and back depth of field, and the user often wants a shot subject to have better details. At present, the image details of the existing camera system are enhanced by mainly using a hardware module or a software algorithm of the camera system to shoot one or more frames of images with the same resolution, and then the images are subjected to denoising, sharpening and fusion processing in different degrees from the center to the peripheral area respectively to obtain the details enhanced images. However, this method cannot highlight the subject well, and also causes noise enhancement in the non-subject region, which affects the overall image quality of the image.
In order to solve the above problem, the present disclosure provides an image processing method, an image processing apparatus, an electronic device, and a computer-readable storage medium, which can improve the image quality of an image and the signal-to-noise ratio of the image when performing image detail enhancement processing. The image processing method of the embodiment of the disclosure can be applied to image acquisition equipment, can be terminal equipment such as a smart phone, a tablet personal computer and the like, and can also be a camera and the like.
Referring to fig. 2, fig. 2 shows a flowchart of an image processing method according to an embodiment of the disclosure, which may include the following steps:
step S210, a first image and a plurality of frames of second images are obtained, wherein the resolution of the first image is different from the resolution of each second image.
Step S220 is to determine a third image with the same resolution as the first image according to the plurality of frames of the second image.
And step S230, carrying out image fusion on the first image and the third image based on the acquired focusing area to obtain a fused image.
In the image processing method of the embodiment of the disclosure, the first image and the multiple frames of second images with different resolutions are obtained, and the multiple frames of second images are fused to generate a third image, so as to achieve the purpose of noise reduction. And performing image fusion on the first image and the third image based on the focusing area, so that the focusing area has better details, and other areas have higher signal-to-noise ratio. Compared with the method of directly obtaining an image with higher resolution, the method can improve the image quality of the image and make up the defect of lower signal-to-noise ratio, thereby improving the shooting experience of a user.
The image processing method according to the embodiment of the present disclosure is described in more detail below.
In step S210, a first image and a plurality of frames of second images are acquired.
In the embodiments of the present disclosure, the resolutions of the first image and the second image are different, and the resolutions between the plurality of frames of the second image are the same. The resolution of the first image may be greater than the resolution of each of the second images, or may be less than the resolution of each of the second images. For example, the first image is an image of 6400 ten thousand pixels, and the second image is an image of 1600 ten thousand pixels.
Images with different resolutions can be shot by the same camera or different cameras. In an implementation manner of the present disclosure, if the image capturing device has only one camera, for example, the first camera may be set up in a related manner, so that the first camera first captures a first image of one frame, and then continuously captures a plurality of second images with different resolutions from the first image. Of course, the time difference between the shooting of the first image and the shooting of the second images of a plurality of frames is shorter, and the contents in the first image and the second images of a plurality of frames are the same. The image acquisition equipment can acquire a first image shot by the first camera and a plurality of frames of second images continuously shot by the first camera, and perform detail enhancement processing according to the first image and the plurality of frames of second images.
In yet another implementation manner of the present disclosure, if the image capturing apparatus has two cameras, for example, a first camera and a second camera, the image capturing apparatus may further acquire a first image captured by the first camera and a plurality of frames of second images continuously captured by the second camera, respectively. Wherein, first camera and second camera can shoot simultaneously.
In step S220, a third image having the same resolution as the first image is determined from the plurality of frames of the second image.
Specifically, when the resolution of the first image is greater than the resolution of each of the second images, the resolution of the second image is lower, and the second image has better photosensitivity and higher signal-to-noise ratio. The noise points in the images are arranged in disorder, that is, after a plurality of frames of images are continuously shot, the noise points at the same position can be red noise points, green noise points, white noise points or even no noise points, so that the comparison and screening conditions are provided, and the noise points are screened out. And finally, carrying out color guessing and pixel replacement processing to achieve the effect of removing noise. Therefore, in order to improve the signal-to-noise ratio of the finally output fusion image, the embodiment of the disclosure can perform multi-frame denoising processing on the multi-frame second image, so as to achieve the purpose of denoising. After the multi-frame denoising processing is performed on the multi-frame second image, one frame of image with less noise can be output. Due to multi-frame denoising, the output image detail is relatively less.
Because the second image and the first image have different resolutions, after the multi-frame denoising processing, the super-resolution processing can be performed on the output image with less noise, and a third image with the same resolution as the first image is obtained. The super-resolution processing is to improve the resolution of the image by a hardware or software method, that is, to obtain a high-resolution image from a low-resolution image.
In step S230, the first image and the third image are subjected to image fusion based on the acquired focusing area, so as to obtain a fused image.
In the embodiment of the disclosure, the first image may be sharpened, and the image sharpening is to compensate the contour of the image and enhance the edge and the gray jump of the image, so that the image becomes clear. Image sharpening is to highlight edges, contours, or features of some linear target elements of a terrain on an image. And then, denoising to obtain a sharpened and denoised image. For example, denoising can be performed by a filtering method to reduce noise of the image.
When image fusion is performed, the sharpened and denoised image and the third image can be subjected to image fusion based on the obtained focusing area. That is, different processes may be performed according to different regions. The focus area is generally an area highlighted in the image, and for example, when a person is photographed, the focus area may be a human face, when a landscape having a front-back depth of field is photographed, the focus area may be a subject depth of field range, and the like. Thus, the in-focus area may show more image detail and the areas outside the in-focus area may not show more detail.
Specifically, for a pixel point in the focusing region, the pixel value of the pixel point in the sharpened and denoised image may be used as the pixel value of the pixel point in the fused image; and aiming at the pixel points in other areas except the focusing area, taking the pixel value of the pixel point in the third image as the pixel value of the pixel point in the fusion image. In this way, the in-focus area may show more detail, and other areas may have a higher signal-to-noise ratio. Of course, the focusing area and the adjacent areas of other areas can be smoothed, so that the fused image has a better display effect.
In one implementation of the present disclosure, the obtained focusing area may be further scaled up to obtain a main area. Firstly, the coordinates (x, y, dx, dy) of the focusing area can be obtained, and then outward expansion is performed according to the coordinates in a certain proportion, so that a main body area (x, y, a × dx, b × dy) with a large range is obtained. Where x and y are respectively coordinates of any vertex of the focusing area, such as an upper left vertex, a lower left vertex, and the like, and dx and dy are respectively the width and height of the focusing area. a and b are respectively a transverse amplification factor and a longitudinal amplification factor, and a and b are both larger than 1. a and b may be empirically preset values, e.g., 1.1 and 1.2, respectively; the value may be a value dynamically changing according to different focus regions, and is not limited herein. Of course, when the focusing area is expanded, the focusing area may also be expanded to the periphery according to the central point of the focusing area, or expanded in other manners, which is not limited in this disclosure.
After the body region is determined, the first image and the third image may be subjected to image fusion according to the body region, so as to obtain a fused image. Similarly, for a pixel point in the main body region, the pixel value of the pixel point in the first image can be used as the pixel value of the pixel point in the fusion image; and aiming at the pixel points in other regions except the main region, taking the pixel value of the pixel point in the third image as the pixel value of the pixel point in the fusion image. The main area is obtained by amplifying the focusing area, so that the area which is interested by the user in the finally obtained fusion image and the adjacent area of the area which is interested by the user have more details, and the integral image quality and definition are ensured.
According to the image processing method, the first image with the higher resolution can be used in the main body region, and the definition and noise conditions of other regions except the main body region are not considered, so that an image with the optimal definition details of the main body is obtained. The second image with lower resolution may not be used for the subject region, thus ensuring that other regions have lower noise. And for the whole image, the proportion of other areas except the main area is large, the defect of low signal-to-noise ratio of the first image can be overcome by the large-sense brightness and multi-frame denoising of the second image with low resolution, and the noise points of other areas in the finally output fusion image are effectively removed, so that an image with good main definition details and less noise points of other parts can be obtained, and the integral image quality and definition are ensured.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
Further, in the present exemplary embodiment, there is also provided an image processing apparatus 400, as shown in fig. 4, including:
an image obtaining module 410, configured to obtain a first image and multiple frames of second images, where a resolution of the first image is different from a resolution of each of the second images;
the image preprocessing module 420 is configured to determine, according to the multiple frames of second images, a third image with the same resolution as the first image;
and an image fusion module 430, configured to perform image fusion on the first image and the third image based on the obtained focusing area, so as to obtain a fused image.
Optionally, the image preprocessing module is specifically configured to perform multi-frame denoising and super-resolution processing on the multiple frames of second images when the resolution of the first image is greater than the resolution of each of the second images, so as to obtain a third image with the same resolution as the first image.
Optionally, the image fusion module includes:
the area amplification unit is used for amplifying the acquired focusing area in proportion to obtain a main area;
and the fusion unit is used for carrying out image fusion on the first image and the third image according to the main body area to obtain a fusion image.
Optionally, the fusion unit is specifically configured to, for a pixel point in the main body region, use a pixel value of the pixel point in the first image as a pixel value of the pixel point in the fusion image; and aiming at the pixel points in other regions except the main region, taking the pixel value of the pixel point in the third image as the pixel value of the pixel point in the fusion image.
Optionally, the image processing apparatus according to the embodiment of the present disclosure further includes:
the sharpening and denoising module is used for carrying out sharpening processing and denoising processing on the first image to obtain a sharpened and denoised image;
and the image fusion module is specifically used for carrying out image fusion on the sharpened and denoised image and the third image based on the obtained focusing area.
Optionally, the image obtaining module is specifically configured to obtain a first image captured by the first camera and multiple frames of second images continuously captured by the first camera.
Optionally, the image obtaining module is specifically configured to obtain a first image captured by the first camera and a plurality of frames of second images captured by the second camera continuously, respectively.
The details of each module or unit in the above device have been described in detail in the corresponding image processing method, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. An image processing method, characterized in that the method comprises:
acquiring a first image and a plurality of frames of second images, wherein the resolution of the first image is different from the resolution of each second image;
determining a third image with the same resolution as the first image according to the plurality of frames of second images;
and carrying out image fusion on the first image and the third image based on the obtained focusing area to obtain a fused image.
2. The method according to claim 1, wherein determining a third image having a resolution equal to the first image resolution from the plurality of frames of second images comprises:
and when the resolution of the first image is greater than that of each second image, performing multi-frame denoising and super-resolution processing on the multi-frame second images to obtain a third image with the same resolution as the first image.
3. The method according to claim 1, wherein the image fusing the first image and the third image based on the obtained focusing area to obtain a fused image comprises:
amplifying the acquired focusing area in proportion to obtain a main body area;
and carrying out image fusion on the first image and the third image according to the main body area to obtain a fused image.
4. The method according to claim 3, wherein the image fusing the first image and the third image according to the subject region to obtain a fused image comprises:
regarding a pixel point in the main body region, taking the pixel value of the pixel point in the first image as the pixel value of the pixel point in the fusion image;
and regarding the pixel points in other areas except the main area, taking the pixel value of the pixel point in the third image as the pixel value of the pixel point in the fusion image.
5. The method of claim 1, further comprising:
carrying out sharpening processing and denoising processing on the first image to obtain a sharpened and denoised image;
the image fusing the first image and the third image based on the obtained focusing area comprises:
and carrying out image fusion on the sharpened and denoised image and the third image based on the obtained focusing area.
6. The method of claim 1, wherein the acquiring the first image and the plurality of frames of the second image comprises:
the method comprises the steps of obtaining a first image shot by a first camera and a plurality of frames of second images continuously shot by the first camera.
7. The method of claim 1, wherein the acquiring the first image and the plurality of frames of the second image comprises:
and respectively acquiring a first image shot by the first camera and a plurality of frames of second images continuously shot by the second camera.
8. An image processing apparatus, characterized in that the apparatus comprises:
the device comprises an image acquisition module, a processing module and a processing module, wherein the image acquisition module is used for acquiring a first image and a plurality of frames of second images, and the resolution of the first image is different from that of each second image;
the image preprocessing module is used for determining a third image with the same resolution as the first image according to the multiple frames of second images;
and the image fusion module is used for carrying out image fusion on the first image and the third image based on the acquired focusing area to obtain a fused image.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 7.
10. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-7 via execution of the executable instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911214525.4A CN111091506A (en) | 2019-12-02 | 2019-12-02 | Image processing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911214525.4A CN111091506A (en) | 2019-12-02 | 2019-12-02 | Image processing method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111091506A true CN111091506A (en) | 2020-05-01 |
Family
ID=70393930
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911214525.4A Pending CN111091506A (en) | 2019-12-02 | 2019-12-02 | Image processing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111091506A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112001869A (en) * | 2020-08-05 | 2020-11-27 | 苏州浪潮智能科技有限公司 | Method and equipment for improving signal-to-noise ratio |
| CN114827482A (en) * | 2021-01-28 | 2022-07-29 | 北京字节跳动网络技术有限公司 | Image brightness adjusting method and device, electronic equipment and medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764908A (en) * | 2008-12-08 | 2010-06-30 | 新奥特（北京）视频技术有限公司 | Method capable of effectively eliminating noise point in grayscale images |
| CN106254722A (en) * | 2016-07-15 | 2016-12-21 | 北京邮电大学 | A kind of video super-resolution method for reconstructing and device |
| CN106791416A (en) * | 2016-12-29 | 2017-05-31 | 努比亚技术有限公司 | A kind of background blurring image pickup method and terminal |
| CN107610077A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN109863742A (en) * | 2017-01-25 | 2019-06-07 | 华为技术有限公司 | Image processing method and terminal device |
| CN110139028A (en) * | 2019-03-25 | 2019-08-16 | 华为技术有限公司 | A kind of method and head-mounted display apparatus of image procossing |
| CN110189285A (en) * | 2019-05-28 | 2019-08-30 | 北京迈格威科技有限公司 | A kind of frames fusion method and device |
| CN110428366A (en) * | 2019-07-26 | 2019-11-08 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment, computer readable storage medium |
-
2019
- 2019-12-02 CN CN201911214525.4A patent/CN111091506A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764908A (en) * | 2008-12-08 | 2010-06-30 | 新奥特（北京）视频技术有限公司 | Method capable of effectively eliminating noise point in grayscale images |
| CN106254722A (en) * | 2016-07-15 | 2016-12-21 | 北京邮电大学 | A kind of video super-resolution method for reconstructing and device |
| CN106791416A (en) * | 2016-12-29 | 2017-05-31 | 努比亚技术有限公司 | A kind of background blurring image pickup method and terminal |
| CN109863742A (en) * | 2017-01-25 | 2019-06-07 | 华为技术有限公司 | Image processing method and terminal device |
| CN107610077A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN110139028A (en) * | 2019-03-25 | 2019-08-16 | 华为技术有限公司 | A kind of method and head-mounted display apparatus of image procossing |
| CN110189285A (en) * | 2019-05-28 | 2019-08-30 | 北京迈格威科技有限公司 | A kind of frames fusion method and device |
| CN110428366A (en) * | 2019-07-26 | 2019-11-08 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment, computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| LI HUAFENG等: "Fractional differential and variational method for image fusion and super-resolution", 《NEUROCOMPUTING》 * |
| 张学典等: "显著性分析在对焦图像融合方面的应用", 《光电工程》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112001869A (en) * | 2020-08-05 | 2020-11-27 | 苏州浪潮智能科技有限公司 | Method and equipment for improving signal-to-noise ratio |
| CN114827482A (en) * | 2021-01-28 | 2022-07-29 | 北京字节跳动网络技术有限公司 | Image brightness adjusting method and device, electronic equipment and medium |
| CN114827482B (en) * | 2021-01-28 | 2023-11-03 | 抖音视界有限公司 | Image brightness adjusting method and device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111353948B (en) | Image noise reduction method, device and equipment | |
| CN110163237B (en) | Model training and image processing method, device, medium and electronic equipment | |
| CN110675404B (en) | Image processing method, image processing apparatus, storage medium, and terminal device | |
| JP6469678B2 (en) | System and method for correcting image artifacts | |
| EP3076364B1 (en) | Image filtering based on image gradients | |
| CN107749944A (en) | A kind of image pickup method and device | |
| CN108230333B (en) | Image processing method, image processing apparatus, computer program, storage medium, and electronic device | |
| US20150348234A1 (en) | Method for image enhancement, image processing apparatus and computer readable medium using the same | |
| CN110855957B (en) | Image processing method and device, storage medium and electronic equipment | |
| DE102020200310A1 (en) | Method and system for reducing haze for image processing | |
| CN112770042B (en) | Image processing method and device, computer readable medium, wireless communication terminal | |
| CN111951172A (en) | Image optimization method, device, equipment and storage medium | |
| CN111583138A (en) | Video enhancement method and device, electronic equipment and storage medium | |
| CN111091506A (en) | Image processing method and device, storage medium and electronic equipment | |
| CN110942427A (en) | Image noise reduction method and device, equipment and storage medium | |
| CN113962859A (en) | Panorama generation method, device, equipment and medium | |
| CN111311481A (en) | Background blurring method and device, terminal equipment and storage medium | |
| JP2013041565A (en) | Image processor, image display device, image processing method, computer program, and recording medium | |
| CN110838088B (en) | Multi-frame noise reduction method and device based on deep learning and terminal equipment | |
| CN112419161B (en) | Image processing method and device, storage medium and electronic equipment | |
| CN105338221A (en) | Image processing method and electronic equipment | |
| CN110136085B (en) | Image noise reduction method and device | |
| CN113014745B (en) | Video image noise reduction method and device, storage medium and electronic equipment | |
| CN115526796A (en) | Image processing method, device, equipment and storage medium | |
| CN113395434B (en) | Preview image blurring method, storage medium and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200501 |