CN115272155A - Image synthesis method, image synthesis device, computer equipment and storage medium - Google Patents
Image synthesis method, image synthesis device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN115272155A CN115272155A CN202211021685.9A CN202211021685A CN115272155A CN 115272155 A CN115272155 A CN 115272155A CN 202211021685 A CN202211021685 A CN 202211021685A CN 115272155 A CN115272155 A CN 115272155A
- Authority
- CN
- China
- Prior art keywords
- image
- synthesized
- area
- images
- exposure
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 27
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 27
- 238000001308 synthesis method Methods 0.000 title claims abstract description 17
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000004590 computer program Methods 0.000 claims abstract description 30
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 7
- 230000035945 sensitivity Effects 0.000 claims description 29
- 238000012545 processing Methods 0.000 claims description 16
- 230000004927 fusion Effects 0.000 claims description 15
- 230000008569 process Effects 0.000 description 11
- 239000002131 composite material Substances 0.000 description 5
- 238000009499 grossing Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20208—High dynamic range [HDR] image processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本申请涉及图像处理技术领域,特别是涉及一种图像合成方法、装置、计算机设备、存储介质和计算机程序产品。The present application relates to the technical field of image processing, in particular to an image synthesis method, device, computer equipment, storage medium and computer program product.
背景技术Background technique
随着计算机技术的发展,人们已经可以通过手机和相机等移动设备进行图像拍摄,HDR(High dynamic range,高动态范围)图像的拍摄已经成为主流,HDR图像是由多帧图像合成后得到的图像。多帧图像中会存在一帧或多帧中存在移动物体的图像,目前对多帧图像的合成方式通常是按照亮度高的一帧图像为基准,进行多帧图像的合成。然而,由于多帧图像中会存在的移动的物体的情况,并且这些存在移动物体的图像会与其他图像存在亮度差异,直接合成会导致图像中存在鬼影的现象,导致图像合成的清晰度下降。With the development of computer technology, people have been able to shoot images through mobile devices such as mobile phones and cameras. The shooting of HDR (High dynamic range, high dynamic range) images has become the mainstream. HDR images are images obtained by synthesizing multiple frames of images. . There may be images of moving objects in one or more frames in multiple frames of images. The current method of synthesizing multiple frames of images is usually to synthesize multiple frames of images based on a frame of image with high brightness. However, due to the presence of moving objects in multiple frames of images, and the brightness difference between these images with moving objects and other images, direct synthesis will lead to ghosting in the image, resulting in a decrease in the clarity of image synthesis .
因此,目前的图像合成方法存在合成清晰度不高的缺陷。Therefore, the current image synthesis method has the defect that the synthesis definition is not high.
发明内容Contents of the invention
基于此,有必要针对上述技术问题,提供一种能够提高图像合成的清晰度的图像合成方法、装置、计算机设备、计算机可读存储介质和计算机程序产品。Based on this, it is necessary to provide an image synthesis method, device, computer equipment, computer readable storage medium and computer program product capable of improving the definition of image synthesis in order to address the above technical problems.
第一方面,本申请提供了一种图像合成方法,所述方法包括:In a first aspect, the present application provides an image synthesis method, the method comprising:
获取相同对象的一组待合成图像;所述一组待合成图像中包括第一曝光等级的一帧第一待合成图像以及第二曝光等级的至少两帧第二待合成图像;所述第一曝光等级小于所述第二曝光等级;所述至少两帧第二待合成图像中包含不同曝光时长的图像,且其中一帧图像与所述第一待合成图像的图像结构一致;Acquire a group of images to be synthesized of the same object; the group of images to be synthesized includes one frame of the first image to be synthesized at the first exposure level and at least two frames of the second image to be synthesized at the second exposure level; the first The exposure level is lower than the second exposure level; the at least two frames of second images to be synthesized include images with different exposure durations, and one of the frames of images is consistent with the image structure of the first image to be synthesized;
融合所述至少两帧第二待合成图像得到高亮度图像,确定所述高亮度图像中的过曝区域;fusing the at least two frames of second images to be synthesized to obtain a high-brightness image, and determining an overexposed area in the high-brightness image;
根据所述至少两帧第二待合成图像的对比结果,确定所述高亮度图像的过曝区域中的非移动区域;所述非移动区域不存在移动物体;According to the comparison result of the at least two frames of the second image to be synthesized, determine a non-moving area in the overexposed area of the high-brightness image; no moving object exists in the non-moving area;
根据所述第一待合成图像与所述过曝区域中的非移动区域的匹配结果,确定所述第一待合成图像中的待合成区域;Determining a region to be synthesized in the first image to be synthesized according to a matching result of the first image to be synthesized and a non-moving area in the overexposed area;
将所述高亮度图像的过曝区域中的非移动区域替换为所述待合成区域的图像,根据替换后的高亮度图像,得到所述相同对象的合成后的图像。The non-moving area in the overexposed area of the high-brightness image is replaced with the image of the area to be combined, and a combined image of the same object is obtained according to the replaced high-brightness image.
在其中一个实施例中,所述获取相同对象的一组待合成图像,包括:In one of the embodiments, the acquisition of a group of images to be synthesized of the same object includes:
获取针对目标对象的第一曝光时长的第一原始图像,基于第一曝光等级和第二曝光等级分别处理所述第一原始图像,得到第一曝光等级下的第一感光度与第一曝光时长的第一待合成图像,以及第二曝光等级下的第一感光度与第一曝光时长的短曝光图像;Acquiring a first original image with a first exposure duration of the target object, processing the first original image based on the first exposure level and the second exposure level respectively, to obtain a first sensitivity and a first exposure duration at the first exposure level The first image to be synthesized, and the short-exposure image of the first sensitivity and the first exposure time under the second exposure level;
获取针对所述目标对象的第二曝光时长的至少一帧第二原始图像,基于第二曝光等级处理所述至少一帧第二原始图像,得到第二曝光等级下的第二感光度与第二曝光时长的至少一帧长曝光图像;所述第一感光度大于所述第二感光度;所述短曝光图像与所述长曝光图像亮度一致;Acquiring at least one frame of the second original image for the second exposure time of the target object, processing the at least one frame of the second original image based on the second exposure level, and obtaining the second sensitivity and the second exposure level at the second exposure level. At least one frame of long-exposure images with an exposure duration; the first sensitivity is greater than the second sensitivity; the brightness of the short-exposure image is consistent with that of the long-exposure image;
根据所述第一待合成图像、所述短曝光图像与所述至少一帧长曝光图像,得到所述一组待合成图像。The group of images to be combined is obtained according to the first image to be combined, the short exposure image and the at least one frame of long exposure image.
在其中一个实施例中,所述融合所述至少两帧第二待合成图像得到高亮度图像,包括:In one of the embodiments, the fusing of the at least two frames of second images to be synthesized to obtain a high-brightness image includes:
确定所述至少两帧第二待合成图像中的非过曝区域,并根据所述至少两帧第二待合成图像的对比结果,确定所述非过曝区域中的移动区域;所述移动区域存在移动物体;Determine the non-overexposed area in the at least two frames of the second image to be synthesized, and determine the moving area in the non-overexposed area according to the comparison result of the at least two frames of the second image to be synthesized; the moving area presence of moving objects;
将所述非过曝区域中的移动区域的图像替换为所述短曝光图像中对应区域的图像;replacing the image of the moving area in the non-overexposed area with the image of the corresponding area in the short exposure image;
将所述非过曝区域中的非移动区域的图像替换为所述长曝光图像中对应区域的图像;所述非过曝区域中的非移动区域不存在移动物体;replacing the image of the non-moving area in the non-overexposed area with the image of the corresponding area in the long exposure image; there is no moving object in the non-moving area in the non-overexposed area;
根据替换后的所述非过曝区域中的移动区域的图像和所述非过曝区域中的非移动区域的图像的融合结果,得到融合后的高亮度图像。According to the fusion result of the replaced image of the moving area in the non-overexposure area and the image of the non-moving area in the non-overexposure area, a fused high-brightness image is obtained.
在其中一个实施例中,所述根据所述至少两帧第二待合成图像的对比结果,确定所述高亮度图像的过曝区域中的非移动区域,包括:In one of the embodiments, the determining the non-moving area in the overexposed area of the high-brightness image according to the comparison result of the at least two frames of the second image to be synthesized includes:
获取所述至少两帧第二待合成图像中的过曝区域的图像的像素重合度;Acquiring the pixel coincidence degree of the image of the overexposed area in the at least two frames of the second image to be synthesized;
根据所述短曝光图像的过曝区域的图像与所述长曝光图像的过曝区域的图像的像素重合度大于预设重合度阈值的区域,确定所述高亮度图像的过曝区域中的非移动区域。According to the area where the pixel coincidence degree of the image of the overexposure area of the short exposure image and the image of the overexposure area of the long exposure image is greater than a preset coincidence degree threshold, determine the non-exposed area in the overexposure area of the high brightness image. mobile area.
在其中一个实施例中,所述根据所述第一待合成图像与所述过曝区域中的非移动区域的匹配结果,确定所述第一待合成图像中的待合成区域,包括:In one of the embodiments, the determining the area to be synthesized in the first image to be synthesized according to the matching result of the first image to be synthesized and the non-moving area in the overexposed area includes:
将所述第一待合成图像与所述过曝区域中的非移动区域匹配,得到所述第一待合成图像中的非移动区域;matching the first image to be synthesized with the non-moving area in the overexposed area to obtain the non-moving area in the first image to be synthesized;
根据所述第一待合成图像中的非移动区域得到待合成区域。Obtaining the area to be synthesized according to the non-moving area in the first image to be synthesized.
在其中一个实施例中,所述确定高亮度图像中的过曝区域,包括:In one of the embodiments, the determining the overexposure area in the high-brightness image includes:
获取融合后的高亮度图像中亮度大于预设亮度阈值的区域,得到所述高亮度图像中的过曝区域。Acquiring areas in the fused high-brightness image whose brightness is greater than a preset brightness threshold, to obtain an overexposed area in the high-brightness image.
在其中一个实施例中,所述根据替换后的高亮度图像,得到所述相同对象的合成后的图像,包括:In one of the embodiments, the obtaining the synthesized image of the same object according to the replaced high-brightness image includes:
对替换后的高亮度图像进行锐化、亮度调整和平滑去噪中的至少一种处理,得到图像清晰度大于预设清晰度阈值的所述相同对象的合成后的图像。At least one of sharpening, brightness adjustment, and smoothing and denoising is performed on the replaced high-brightness image to obtain a composite image of the same object whose image definition is greater than a preset definition threshold.
第二方面,本申请提供了一种图像合成装置,所述装置包括:In a second aspect, the present application provides an image synthesis device, the device comprising:
获取模块,用于获取相同对象的一组待合成图像;所述一组待合成图像中包括第一曝光等级的一帧第一待合成图像以及第二曝光等级的至少两帧第二待合成图像;所述第一曝光等级小于所述第二曝光等级;所述至少两帧第二待合成图像中包含不同曝光时长的图像,且其中一帧图像与所述第一待合成图像的图像结构一致;An acquisition module, configured to acquire a group of images to be synthesized of the same object; the group of images to be synthesized includes one frame of the first image to be synthesized at the first exposure level and at least two frames of the second image to be synthesized at the second exposure level ; The first exposure level is smaller than the second exposure level; The at least two frames of the second image to be synthesized include images with different exposure durations, and one frame of the image is consistent with the image structure of the first image to be synthesized ;
融合模块,用于融合所述至少两帧第二待合成图像得到高亮度图像,确定所述高亮度图像中的过曝区域;A fusion module, configured to fuse the at least two frames of the second images to be synthesized to obtain a high-brightness image, and determine an overexposed area in the high-brightness image;
第一确定模块,用于根据所述至少两帧第二待合成图像的对比结果,确定所述高亮度图像的过曝区域中的非移动区域;所述非移动区域不存在移动物体;The first determination module is configured to determine a non-moving area in the overexposed area of the high-brightness image according to the comparison result of the at least two frames of the second image to be synthesized; there is no moving object in the non-moving area;
第二确定模块,用于根据所述第一待合成图像与所述过曝区域中的非移动区域的匹配结果,确定所述第一待合成图像中的待合成区域;The second determination module is configured to determine the area to be synthesized in the first image to be synthesized according to the matching result of the first image to be synthesized and the non-moving area in the overexposed area;
合成模块,用于将所述高亮度图像的过曝区域中的非移动区域替换为所述待合成区域的图像,根据替换后的高亮度图像,得到所述相同对象的合成后的图像。A synthesis module, configured to replace the non-moving area in the overexposed area of the high-brightness image with the image of the area to be combined, and obtain a combined image of the same object according to the replaced high-brightness image.
第三方面,本申请提供了一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现上述的方法的步骤。In a third aspect, the present application provides a computer device, including a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.
第四方面,本申请提供了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述的方法的步骤。In a fourth aspect, the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above method are implemented.
第五方面,本申请提供了一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现上述的方法的步骤。In a fifth aspect, the present application provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.
上述图像合成方法、装置、计算机设备、存储介质和计算机程序产品,通过获取相同对象的一组包括一帧低曝光等级的第一待合成图像以及至少两帧高曝光等级的第二待合成图像,并融合高曝光等级的至少两帧待合成图像,确定融合后的高亮度图像中的过曝区域,并根据至少两帧第二待合成图像的对比结果确定高亮度图像的过曝区域中的非移动区域,基于该非移动区域确定第一待合成图像中的待合成区域,将高亮度图像的过曝区域中的非移动区域替换为待合成区域的图像,基于替换后的高亮度图像,得到相同对象的合成后的图像。相较于传统的按照亮度高的一帧图像为基准进行多帧图像的合成的方式,本方案通过在合成时将过曝区的非运动区替换为低曝光等级的图像,过曝区的运动区则不替换,防止合成图像中出现鬼影现象,提高图像清晰度。The image synthesis method, device, computer equipment, storage medium, and computer program product described above, by acquiring a group of the same object including one frame of the first image to be synthesized at a low exposure level and at least two frames of the second image to be synthesized at a high exposure level, And fusing at least two frames of images to be synthesized with high exposure levels, determining the overexposed area in the fused high brightness image, and determining the non The moving area, based on the non-moving area, determines the area to be synthesized in the first image to be synthesized, replaces the non-moving area in the overexposed area of the high-brightness image with the image of the area to be synthesized, and based on the replaced high-brightness image, obtains A composited image of the same object. Compared with the traditional way of synthesizing multiple frames of images based on one frame of high brightness image, this scheme replaces the non-moving area of the over-exposed area with an image of low exposure level during synthesis, and the motion of the over-exposed area Areas are not replaced to prevent ghosting in composite images and improve image clarity.
附图说明Description of drawings
图1为一个实施例中图像合成方法的流程示意图;Fig. 1 is a schematic flow chart of an image synthesis method in an embodiment;
图2为一个实施例中待合成图像获取步骤的流程示意图;Fig. 2 is a schematic flow chart of the step of acquiring images to be synthesized in one embodiment;
图3为一个实施例中融合步骤的流程示意图;Fig. 3 is a schematic flow chart of the fusion step in an embodiment;
图4为一个实施例中图像合成装置的结构框图;Fig. 4 is a structural block diagram of an image synthesis device in an embodiment;
图5为一个实施例中计算机设备的内部结构图。Figure 5 is an internal block diagram of a computer device in one embodiment.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.
在一个实施例中,如图1所示,提供了一种图像合成方法,本实施例以该方法应用于终端进行举例说明,可以理解的是,该方法也可以应用于服务器,还可以应用于包括终端和服务器的系统,并通过终端和服务器的交互实现,包括以下步骤:In one embodiment, as shown in FIG. 1 , an image synthesis method is provided. In this embodiment, the method is applied to a terminal for illustration. It can be understood that the method can also be applied to a server, or to a A system including a terminal and a server, and realized through interaction between the terminal and the server, includes the following steps:
步骤S202,获取相同对象的一组待合成图像;一组待合成图像中包括第一曝光等级的一帧第一待合成图像以及第二曝光等级的至少两帧第二待合成图像;第一曝光等级小于第二曝光等级;至少两帧第二待合成图像中包含不同曝光时长的图像,且其中一帧图像与第一待合成图像的图像结构一致。Step S202, acquiring a group of images to be synthesized of the same object; a group of images to be synthesized includes one frame of the first image to be synthesized at the first exposure level and at least two frames of the second image to be synthesized at the second exposure level; the first exposure The level is smaller than the second exposure level; at least two frames of the second image to be synthesized include images with different exposure time lengths, and one frame of the image is consistent with the image structure of the first image to be synthesized.
其中,待合成图像可以是需要进行合成的图像,该合成过程可以是一种HDR图像的合成,即终端可以获取一组待合成图像,并将一组待合成图像合成为一种HDR图像。其中,上述获取的一组待合成图像可以是针对相同对象的图像,例如终端利用设置在终端中的图像采集设备,对相同对象进行一次拍摄,可以得到本次拍摄的多张图像,作为一组待合成图像。其中,一组待合成图像中包括至少三帧图像,并且至少三帧图像中存在曝光等级不同的图像。例如上述一组待合成图像中可以包含在第一曝光等级下的一帧第一待合成图像以及在第二曝光等级下的至少两帧第二待合成图像。其中第一曝光等级小于第二曝光等级,即上述第一待合成图像的曝光等级小于第二待合成图像的曝光等级,从而上述第一待合成图像的亮度小于第二待合成图像的亮度。具体地,第一曝光等级可以被称为ev-,第二曝光等级可以被称为ev0;其中ev值称曝光值,它反映的是光圈大小和快门速度的组合,为准确得到适宜主体正确表现的准确曝光,需要结合曝光值和曝光补偿量,曝光补偿量均用+3、+2、+1、0、-1、-2、-3、等加以表示,“+”表示在测光所定曝光量的基础上增加曝光,“-”表示减少曝光,相应的数字为补偿曝光的级数,例如ev-可以表示负曝光等级,ev0可以表示第0级曝光等级。Wherein, the images to be synthesized may be images that need to be synthesized, and the synthesis process may be a synthesis of HDR images, that is, the terminal may obtain a group of images to be synthesized, and synthesize a group of images to be synthesized into an HDR image. Wherein, the above-mentioned acquired group of images to be synthesized may be images for the same object. For example, the terminal uses the image acquisition device set in the terminal to shoot the same object once, and can obtain multiple images taken this time as a group of images. Image to be synthesized. Wherein, a group of images to be synthesized includes at least three frames of images, and there are images with different exposure levels in the at least three frames of images. For example, the above group of images to be combined may include one frame of the first image to be combined under the first exposure level and at least two frames of the second image to be combined under the second exposure level. Wherein the first exposure level is lower than the second exposure level, that is, the exposure level of the first image to be combined is lower than the exposure level of the second image to be combined, so that the brightness of the first image to be combined is lower than the brightness of the second image to be combined. Specifically, the first exposure level can be called ev-, and the second exposure level can be called ev0; where the ev value is called the exposure value, which reflects the combination of aperture size and shutter speed. Accurate exposure needs to be combined with exposure value and exposure compensation amount. Exposure compensation amount is represented by +3, +2, +1, 0, -1, -2, -3, etc. Increase the exposure based on the exposure amount, "-" means reduce the exposure, and the corresponding number is the level of compensation exposure. For example, ev- can indicate a negative exposure level, and ev0 can indicate a 0th exposure level.
其中,上述一组待合成图像中还可以包括有不同曝光时长的图像,例如一组待合成图像中可以同时包括有短曝光时长的待合成图像和长曝光时长的待合成图像。具体地,上述第一曝光等级的第一待合成图像可以是短曝光的图像,上述第二曝光等级的第二待合成图像中存在短曝光的图像和长曝光的图像。并且,上述至少两帧第二待合成图像中的其中一帧图像与第一待合成图像的图像结构一致。具体可以是上述短曝光的第二待合成图像,终端可以同源产生上述第一待合成图像与上述短曝光第二待合成图像,即第一待合成图像与短曝光第二待合成图像来自同一原始图像,终端通过不同图像处理过程分别得到上述第一待合成图像和短曝光第二待合成图像,使得第一待合成图像与短曝光第二待合成图像的图像内容和图像的结构一致。Wherein, the aforementioned group of images to be synthesized may also include images with different exposure durations, for example, a group of images to be synthesized may include images to be synthesized with a short exposure duration and images to be synthesized with a long exposure duration. Specifically, the first image to be combined at the first exposure level may be a short-exposure image, and the second image to be combined at the second exposure level includes a short-exposure image and a long-exposure image. Moreover, one of the at least two frames of the second image to be synthesized is consistent with the image structure of the first image to be synthesized. Specifically, it may be the second short-exposure image to be synthesized, and the terminal may generate the above-mentioned first image to be synthesized and the above-mentioned short-exposure second image to be synthesized from the same source, that is, the first image to be synthesized and the second short-exposure image to be synthesized come from the same For the original image, the terminal respectively obtains the first image to be synthesized and the second short-exposure image to be synthesized through different image processing processes, so that the image content and image structure of the first image to be synthesized and the second short-exposure image to be synthesized are consistent.
步骤S204,融合至少两帧第二待合成图像得到高亮度图像,确定高亮度图像中的过曝区域。Step S204, fusing at least two frames of second images to be synthesized to obtain a high-brightness image, and determining an overexposed area in the high-brightness image.
其中,终端获取到上述一组待合成图像后,可以首先将上述至少两帧第二待合成图像进行合成,即终端可以将上述ev0曝光等级的至少两帧第二待合成图像进行融合,由于ev0代表的曝光等级的亮度大于ev-曝光等级,因此上述融合至少两帧第二待合成图像后,得到的可以是高亮度图像。其中,上述至少两帧第二待合成图像中每帧第二待合成图像的亮度可以是一致的。上述融合过程可以是针对第二待合成图像中的非过曝区域进行的合成,例如终端在非过曝区域中的移动区域使用短曝光第二待合成图像中该区域的图像,使移动物体尽量静止,在非过曝区域中的非移动区域使用长曝光第二待合成图像中该区域的图像,使画质尽量清晰。Wherein, after the terminal obtains the aforementioned group of images to be synthesized, it may first synthesize the above-mentioned at least two frames of the second images to be synthesized, that is, the terminal may fuse at least two frames of the second images to be synthesized at the exposure level of ev0. The brightness of the represented exposure level is greater than the ev-exposure level, so after the fusion of at least two frames of the second image to be synthesized, a high-brightness image may be obtained. Wherein, the brightness of each frame of the second image to be synthesized in the at least two frames of the second image to be synthesized may be consistent. The above fusion process may be performed on the non-overexposed area in the second image to be synthesized. For example, the mobile area of the terminal in the non-overexposed area uses the image of this area in the second image to be synthesized to make the moving object as far as possible. Still, in the non-moving area in the non-overexposed area, use the image of this area in the second image to be synthesized by long exposure to make the image quality as clear as possible.
终端针对非过曝区域融合上述至少两帧第二待合成图像后,可以对第二待合成图像中的过曝区域进行相应处理。终端可以首先确定高亮度图像中的过曝区域。例如,在一个实施例中,确定高亮度图像中的过曝区域,包括:获取融合后的高亮度图像中亮度大于预设亮度阈值的区域,得到高亮度图像中的过曝区域。本实施例中,终端可以通过上述高亮度图像的画面中各个区域的亮度大小,确定该区域是否为过曝区域。例如,终端可以将融合后的高亮度图像中各个像素的亮度与预设亮度阈值比较,从而终端可以得到高亮度图像中亮度大于预设亮度阈值的区域,终端可以将这些亮度大于预设亮度阈值的区域作为高亮度图像中的过曝区域。After the terminal fuses the at least two frames of the second image to be synthesized with respect to the non-overexposed area, it may perform corresponding processing on the overexposed area in the second image to be synthesized. The terminal may first determine the overexposed area in the high-brightness image. For example, in one embodiment, determining the overexposed area in the high-brightness image includes: obtaining an area in the fused high-brightness image whose brightness is greater than a preset brightness threshold, to obtain the overexposed area in the high-brightness image. In this embodiment, the terminal may determine whether the area is an overexposed area according to the brightness of each area in the high-brightness image. For example, the terminal can compare the brightness of each pixel in the fused high-brightness image with a preset brightness threshold, so that the terminal can obtain the areas in the high-brightness image whose brightness is greater than the preset brightness threshold, and the terminal can compare the brightness of these pixels with the brightness greater than the preset brightness threshold The area of the image is regarded as the overexposed area in the high-brightness image.
步骤S206,根据至少两帧第二待合成图像的对比结果,确定高亮度图像的过曝区域中的非移动区域;非移动区域不存在移动物体。Step S206, according to the comparison result of at least two frames of the second image to be synthesized, determine the non-moving area in the overexposed area of the high-brightness image; no moving object exists in the non-moving area.
其中,上述第二待合成图像可以是亮度相对于第一待合成图像较高的图像。并且上述至少两帧第二待合成图像的亮度可以一致。从而终端可以将至少两帧第二待合成图像进行对比,基于该对比的对比结果,确定高亮度图像中的过曝区域中的非移动区域。其中,非移动区域代表该区域中不存在移动的物体,即不存在运动模糊的状态。其中,上述至少两帧第二待合成图像中存在短曝光图像和长曝光图像,由于上述至少两帧第二待合成图像中的短曝光图像的亮度和长曝光图像的亮度一致,并且待合成图像均是针对相同对象的,因此终端可以通过将上述短曝光图像和长曝光图像进行对比,终端检测到短曝光图像和长曝光图像之间图像不一致的区域时,可以认为该区域存在运动物体,终端可以将这些存在运动物体的区域作为移动区域,进而终端可以将短曝光图像和长曝光图像中图像一致的区域作为非移动区域,表示该区域中不存在移动物体。从而可以通过将对比结果映射回上述高亮度图像,得到高亮度图像中过曝区域中的非移动区域。Wherein, the second image to be combined may be an image with higher brightness than the first image to be combined. And the brightness of the at least two frames of the second images to be synthesized may be consistent. Therefore, the terminal can compare at least two frames of the second image to be synthesized, and determine the non-moving region in the overexposed region in the high-brightness image based on the comparison result of the comparison. Wherein, the non-moving area represents that there is no moving object in this area, that is, a state where there is no motion blur. Wherein, there are short-exposure images and long-exposure images in the above-mentioned at least two frames of the second images to be synthesized, since the brightness of the short-exposure images in the above-mentioned at least two frames of the second images to be synthesized is consistent with the brightness of the long-exposure images, and the images to be synthesized They are all for the same object, so the terminal can compare the above short exposure image with the long exposure image, and when the terminal detects an image inconsistency between the short exposure image and the long exposure image, it can consider that there is a moving object in the area, and the terminal These areas where moving objects exist may be regarded as moving areas, and furthermore, the terminal may regard areas where images in the short-exposure image and the long-exposure image are the same as non-moving areas, indicating that there is no moving object in this area. Therefore, the non-moving area in the overexposed area in the high-brightness image can be obtained by mapping the comparison result back to the above-mentioned high-brightness image.
步骤S208,根据第一待合成图像与过曝区域中的非移动区域的匹配结果,确定第一待合成图像中的待合成区域。Step S208, according to the matching result of the first image to be synthesized and the non-moving area in the overexposed area, determine the area to be synthesized in the first image to be synthesized.
其中,过曝区域中的非移动区域可以是终端通过将上述至少两帧第二待合成图像中的短曝光图像和长曝光图像进行对比后,得到的高亮度图像中过曝区域中的非移动区域。其中,上述第一待合成图像与上述短曝光图像是基于同一张原始图像经过不同处理得到的图像,因此第一待合成图像与上述短曝光图像的图像内容和结构一致。从而终端基于短曝光图像和长曝光图像确定出的过曝区域中的非移动区域,可以与第一待合成图像中的非移动区域一致。终端可以将上述高亮度图像的过曝区域中的非移动区域与第一待合成图像进行匹配,例如可以是基于过曝区域中的非移动区域在高亮度图像中的位置进行的匹配,从而终端可以根据该匹配结果,确定第一待合成图像中的待合成区域。其中,待合成区域中的图像可以是用于进行图像替换的图像。Wherein, the non-moving area in the over-exposed area may be the non-moving area in the over-exposed area in the high-brightness image obtained by the terminal after comparing the short-exposure image and the long-exposure image in the at least two frames of the second image to be synthesized. area. Wherein, the first image to be synthesized and the short-exposure image are images obtained through different processes based on the same original image, so the image content and structure of the first image to be synthesized and the short-exposure image are consistent. Therefore, the non-moving area in the over-exposed area determined by the terminal based on the short-exposure image and the long-exposure image may be consistent with the non-moving area in the first image to be synthesized. The terminal may match the non-moving area in the overexposed area of the above-mentioned high-brightness image with the first image to be synthesized, for example, the matching may be based on the position of the non-moving area in the over-exposed area in the high-brightness image, so that the terminal The area to be combined in the first image to be combined may be determined according to the matching result. Wherein, the images in the area to be synthesized may be images used for image replacement.
步骤S210,将高亮度图像的过曝区域中的非移动区域替换为待合成区域的图像,根据替换后的高亮度图像,得到相同对象的合成后的图像。Step S210, replacing the non-moving area in the overexposed area of the high-brightness image with the image of the area to be combined, and obtaining a combined image of the same object according to the replaced high-brightness image.
其中,终端确定出第一待合成图像中的待合成区域后,可以将上述高亮度图像的过曝区域中的非移动区域替换为待合成区域的图像,上述第一待合成图像可以是亮度较低的图像,即不存在过曝现象的图像,终端将上述高亮度图像的过曝区域中非移动区域中的图像替换为待合成区域的图像后,可以去除被替换的区域的过曝状态,提高图像的清晰度。Wherein, after the terminal determines the area to be synthesized in the first image to be synthesized, it may replace the non-moving area in the overexposed area of the high-brightness image with an image of the area to be synthesized, and the first image to be synthesized may be a For a low-level image, that is, an image without overexposure, after the terminal replaces the image in the non-moving area in the overexposed area of the above-mentioned high-brightness image with the image of the area to be synthesized, the overexposure state of the replaced area can be removed. Improve image clarity.
终端将上述高亮度图像的过曝区域中的非移动区域替换为待合成区域的图像后,可以基于替换后的高亮度图像,得到对上述相同对象的合成后的图像。其中,终端可以对替换后的高亮度图像进行后处理,提高替换后的高亮度图像的通透度和清晰度。例如,在一个实施例中,根据替换后的高亮度图像,得到所述相同对象的合成后的图像,包括:对替换后的高亮度图像进行锐化、亮度调整和平滑去噪中的至少一种处理,得到图像清晰度大于预设清晰度阈值的所述相同对象的合成后的图像。本实施例中,终端可以对替换后的高亮度图像进行相应调整,提高图像通透度和亮度。例如,终端可以对替换后的高亮度图像进行锐化、亮度调整和平滑去噪中的至少一种处理,使得终端可以提高上述替换后的高亮度图像的通透度和清晰度。终端对上述替换后的高亮度图像进行上述调整后,可以得到基于上述一组待合成图像得到的合成后的图像,由于在过曝区域的非移动区域使用ev-曝光等级的第一待合成图像中对应区域的图像进行替换,对于过曝区域中的移动区域则维持过曝,保证了合成后的图像不会因为运动物体和静止物体的重叠和产生重影的现象。After the terminal replaces the non-moving area in the overexposed area of the high-brightness image with the image of the area to be combined, it can obtain the combined image of the same object based on the replaced high-brightness image. Wherein, the terminal may post-process the replaced high-brightness image to improve the transparency and clarity of the replaced high-brightness image. For example, in one embodiment, obtaining a composite image of the same object according to the replaced high-brightness image includes: performing at least one of sharpening, brightness adjustment, and smoothing and denoising on the replaced high-brightness image A processing is performed to obtain a synthesized image of the same object whose image sharpness is greater than a preset sharpness threshold. In this embodiment, the terminal may adjust the replaced high-brightness image accordingly to improve the transparency and brightness of the image. For example, the terminal may perform at least one of sharpening, brightness adjustment, and smoothing and denoising processing on the replaced high-brightness image, so that the terminal may improve the transparency and clarity of the replaced high-brightness image. After the terminal performs the above adjustments on the replaced high-brightness image, a synthesized image based on the above group of images to be synthesized can be obtained. Since the first image to be synthesized using ev-exposure level is used in the non-moving area of the overexposed area Replace the image in the corresponding area, and maintain the overexposure for the moving area in the overexposed area, so as to ensure that the synthesized image will not cause ghosting due to the overlapping of moving objects and stationary objects.
上述图像合成方法中,通过获取相同对象的一组包括一帧低曝光等级的第一待合成图像以及至少两帧高曝光等级的第二待合成图像,并融合高曝光等级的至少两帧待合成图像,确定融合后的高亮度图像中的过曝区域,并根据至少两帧第二待合成图像的对比结果确定高亮度图像的过曝区域中的非移动区域,基于该非移动区域确定第一待合成图像中的待合成区域,将高亮度图像的过曝区域中的非移动区域替换为待合成区域的图像,基于替换后的高亮度图像,得到相同对象的合成后的图像。相较于传统的按照亮度高的一帧图像为基准进行多帧图像的合成的方式,本方案通过在合成时将过曝区的非运动区替换为低曝光等级的图像,过曝区的运动区则不替换,防止合成图像中出现鬼影现象,提高图像清晰度。In the above image synthesis method, by acquiring a group of the same object including one frame of the first image to be synthesized with a low exposure level and at least two frames of the second image to be synthesized with a high exposure level, and fusing at least two frames of the high exposure level to be synthesized image, determine the overexposed area in the fused high-brightness image, and determine the non-moving area in the over-exposed area of the high-brightness image according to the comparison results of at least two frames of the second image to be synthesized, and determine the first based on the non-moving area For the area to be synthesized in the image to be synthesized, replace the non-moving area in the overexposed area of the high-brightness image with the image of the area to be synthesized, and obtain a synthesized image of the same object based on the replaced high-brightness image. Compared with the traditional way of synthesizing multiple frames of images based on one frame of high brightness image, this scheme replaces the non-moving area of the over-exposed area with an image of low exposure level during synthesis, and the motion of the over-exposed area Areas are not replaced to prevent ghosting in composite images and improve image clarity.
在一个实施例中,如图2所示,图2为一个实施例中待合成图像获取步骤的流程示意图。上述获取相同对象的一组待合成图像,包括:步骤S302:获取针对目标对象的第一曝光时长的第一原始图像,基于第一曝光等级和第二曝光等级分别处理第一原始图像,得到第一曝光等级下的第一感光度与第一曝光时长的第一待合成图像,以及第二曝光等级下的第一感光度与第一曝光时长的短曝光图像;步骤S304:获取针对目标对象的第二曝光时长的至少一帧第二原始图像,基于第二曝光等级处理至少一帧第二原始图像,得到第二曝光等级下的第二感光度与第二曝光时长的至少一帧长曝光图像;第一感光度大于第二感光度;短曝光图像与长曝光图像亮度一致;步骤S306:根据第一待合成图像、短曝光图像与至少一帧长曝光图像,得到一组待合成图像。In one embodiment, as shown in FIG. 2 , FIG. 2 is a schematic flowchart of a step of acquiring images to be synthesized in one embodiment. The above-mentioned acquisition of a group of images to be synthesized of the same object includes: Step S302: Acquire the first original image of the first exposure time for the target object, process the first original image based on the first exposure level and the second exposure level respectively, and obtain the second The first image to be synthesized with the first sensitivity and the first exposure time at an exposure level, and the short-exposure image with the first sensitivity and the first exposure time at the second exposure level; Step S304: Acquire the target object At least one frame of the second original image of the second exposure time, at least one frame of the second original image is processed based on the second exposure level to obtain at least one frame of long-exposure image of the second sensitivity and the second exposure time under the second exposure level ; the first sensitivity is greater than the second sensitivity; the brightness of the short-exposure image is consistent with that of the long-exposure image; Step S306: Obtain a group of images to be synthesized according to the first image to be synthesized, the short-exposure image and at least one frame of the long-exposure image.
本实施例中,终端可以通过图像采集设备获取对相同对象的一组待合成图像。例如终端通过摄像头对相同对象拍摄多帧图像,得到一组待合成图像。终端获取的上述一组待合成图像中,可以存在拍摄参数不同的多帧图像。其中,上述相同对象可以是目标对象。终端可以获取第一曝光时长下的针对目标对象第一原始图像。并获取第二曝光时长下的针对上述目标对象的至少一帧第二原始图像。其中,上述第一曝光时长小于上述第二曝光时长,上述第一原始图像和第二原始图像均可以是一种raw格式图像,raw格式图像包含创建一个可视图像所必须的相机传感器数据信息。终端可以对上述原始图像进行相应的处理流程,得到第一待合成图像和第二待合成图像。具体地,上述处理可以是对raw格式图像的ISP(Image Signal Processor,图像信号处理)处理,主要作用是对前端图像传感器输出的信号做后期处理,终端通过ISP处理,可以在不同的光学条件下都能较好的还原现场细节。In this embodiment, the terminal can acquire a group of images to be synthesized for the same object through an image acquisition device. For example, the terminal captures multiple frames of images of the same object through the camera to obtain a group of images to be synthesized. In the aforementioned group of images to be combined acquired by the terminal, there may be multiple frames of images with different shooting parameters. Wherein, the above-mentioned same object may be the target object. The terminal may acquire the first original image of the target object under the first exposure duration. And acquire at least one frame of second original image for the above-mentioned target object under the second exposure duration. Wherein, the above-mentioned first exposure duration is shorter than the above-mentioned second exposure duration, and both the above-mentioned first original image and the second original image may be a raw format image, and the raw format image contains camera sensor data information necessary for creating a visible image. The terminal may perform a corresponding processing flow on the above original images to obtain the first image to be combined and the second image to be combined. Specifically, the above-mentioned processing may be ISP (Image Signal Processor, image signal processing) processing of raw format images, and its main function is to perform post-processing on the signal output by the front-end image sensor. Can better restore the details of the scene.
对于上述第一原始图像,终端可以对第一原始图像进行不同的ISP处理,得到不同曝光等级下的多张待合成图像。其中,上述第一原始图像有对应的第一曝光时长和第一感光度(ISO)。终端可以基于第一曝光等级处理上述第一原始图像,从而终端可以得到在第一曝光等级下的第一感光度与第一曝光时长的第一待合成图像;终端还可以基于第二曝光等级处理上述第一原始图像,从而终端可以得到在第二曝光等级下的第一感光度与第一曝光时长的短曝光图像。即终端可以基于一张第一原始图像,通过不同处理得到不同曝光等级的待合成图像。具体地,上述第一待合成图像可以是ev-曝光等级的图像,上述短曝光图像可以是ev0曝光等级的图像,第一待合成图像和短曝光图像的曝光时长和感光度可以相同。即第一待合成图像和短曝光图像可以同源产生,使得第一待合成图像与短曝光图像的图像内容和图像结构一致,便于后续确定待合成区域。For the above-mentioned first original image, the terminal may perform different ISP processing on the first original image to obtain multiple images to be synthesized under different exposure levels. Wherein, the above-mentioned first original image has a corresponding first exposure time and first sensitivity (ISO). The terminal can process the above-mentioned first original image based on the first exposure level, so that the terminal can obtain the first image to be synthesized with the first sensitivity and the first exposure time under the first exposure level; the terminal can also process the first original image based on the second exposure level The above-mentioned first original image, so that the terminal can obtain a short-exposure image with the first sensitivity and the first exposure time under the second exposure level. That is, the terminal may obtain images to be synthesized with different exposure levels through different processes based on a first original image. Specifically, the first image to be synthesized may be an image of ev-exposure level, the short-exposure image may be an image of ev0 exposure level, and the exposure duration and sensitivity of the first image to be synthesized and the short-exposure image may be the same. That is, the first image to be synthesized and the short-exposure image can be generated from the same source, so that the image content and image structure of the first image to be synthesized and the short-exposure image are consistent, which facilitates subsequent determination of the region to be synthesized.
对于第二原始图像,终端可以基于第二曝光等级处理至少一帧第二原始图像,得到第二曝光等级下的第二感光度与第二曝光时长的至少一帧长曝光图像。由于第二原始图像的曝光时长较长,因此可能存在因为物体移动而产生的移动区域。其中,为了使上述短曝光图像与长曝光图像的亮度一致,终端可以令第一感光度大于上述第二感光度,从而终端可以基于较短的曝光时间和较大的第一感光度得到短曝光图像,并基于较长的曝光时间和较小的第二感光度得到长曝光图像,以便后续将亮度一致的短曝光图像和长曝光图像进行对比,确定移动区域。其中,上述至少一帧长曝光图像可以是与上述短曝光图像相同曝光等级的图像,例如均为ev0曝光等级,从而终端可以得到相同亮度的短曝光图像和长曝光图像的组合。具体地,终端在图像合成时,可以获取一张ev-的第一待合成图像与N张ev0的第二待合成图像,其中N≥2。上述N张ev0中可以包括短曝光时长并且高ISO的待合成图像,还可以包括长曝光时长并且低ISO的待合成图像,使得上述N张ev0的第二待合成图像的亮度一致。并且ev-的第一待合成图像与短曝光时长的ev0的第二待合成图像的图像内容和图像结构一致。终端获取上述第一待合成图像、短曝光图像和长曝光图像后,可以基于这些图像,得到上述的对相同对象的一组待合成图像,则一组待合成图像中至少包含三帧图像。For the second original image, the terminal may process at least one frame of the second original image based on the second exposure level to obtain at least one frame of long-exposure image with a second sensitivity and a second exposure time under the second exposure level. Since the exposure time of the second original image is longer, there may be a moving area caused by the moving object. Wherein, in order to make the brightness of the short-exposure image consistent with the brightness of the long-exposure image, the terminal can make the first sensitivity greater than the second sensitivity, so that the terminal can obtain a short exposure based on a shorter exposure time and a larger first sensitivity. image, and obtain a long-exposure image based on a longer exposure time and a smaller second sensitivity, so that the short-exposure image with consistent brightness can be compared with the long-exposure image to determine the moving area. Wherein, the above at least one frame of the long exposure image may be an image of the same exposure level as the above short exposure image, for example, both are at the exposure level of ev0, so that the terminal can obtain a combination of the short exposure image and the long exposure image with the same brightness. Specifically, when combining images, the terminal may acquire one ev- first image to be combined and N ev0 second images to be combined, where N≥2. The above N ev0s may include images to be combined with short exposure time and high ISO, and may also include images to be combined with long exposure time and low ISO, so that the brightness of the second images to be combined in the above N ev0s is consistent. And the image content and image structure of the first image to be synthesized of ev- is consistent with the second image to be synthesized of ev0 with a short exposure time. After acquiring the first image to be synthesized, the short exposure image and the long exposure image, the terminal may obtain the above-mentioned group of images to be synthesized for the same object based on these images, and a group of images to be synthesized includes at least three frames of images.
通过本实施例,终端可以基于相同的原始图像得到不同曝光等级下的图像内容和结构一致的多张待合成图像,从而终端可以基于对高亮度的待合成图像的移动区域的判断,即可对应回低亮度的待合成图像的移动区域,提高了图像合成的准确度。并且终端通过生成亮度一致的短曝光图像和长曝光图像,通过短曝光图像和长曝光图像的对比,确定图像中的移动区域,进而能够基于移动区域进行图像合成,提高了图像合成的清晰度。Through this embodiment, based on the same original image, the terminal can obtain multiple images to be synthesized with consistent image content and structure under different exposure levels, so that the terminal can correspond to The moving area of the image to be synthesized with low brightness is returned to improve the accuracy of image synthesis. Moreover, the terminal generates a short-exposure image and a long-exposure image with consistent brightness, and compares the short-exposure image and the long-exposure image to determine the moving area in the image, and then can perform image synthesis based on the moving area, improving the clarity of image synthesis.
在一个实施例中,如图3所示,图3为一个实施例中融合步骤的流程示意图。上述融合至少两帧第二待合成图像得到高亮度图像,包括:步骤S402:确定至少两帧第二待合成图像中的非过曝区域,并根据至少两帧第二待合成图像的对比结果,确定非过曝区域中的移动区域;移动区域存在移动物体;步骤S404:将非过曝区域中的移动区域的图像替换为短曝光图像中对应区域的图像;步骤S406:将非过曝区域中的非移动区域的图像替换为长曝光图像中对应区域的图像;非过曝区域中的非移动区域不存在移动物体;步骤S408:根据替换后的非过曝区域中的移动区域的图像和非过曝区域中的非移动区域的图像的融合结果,得到融合后的高亮度图像。In one embodiment, as shown in FIG. 3 , FIG. 3 is a schematic flowchart of the fusion step in one embodiment. The above fusion of at least two frames of the second images to be synthesized to obtain a high-brightness image includes: step S402: determining the non-overexposed areas in the at least two frames of the second images to be synthesized, and according to the comparison results of the at least two frames of the second images to be synthesized, Determine the moving area in the non-overexposed area; there is a moving object in the moving area; step S404: replace the image of the moving area in the non-overexposed area with the image of the corresponding area in the short exposure image; step S406: replace the image in the non-overexposed area The image of the non-moving area is replaced with the image of the corresponding area in the long exposure image; there is no moving object in the non-moving area in the non-overexposed area; Step S408: According to the image and the non-moving area in the non-overexposed area after replacement The fusion result of the image of the non-moving area in the over-exposed area is obtained to obtain a fused high-brightness image.
本实施例中,终端可以对上述处于第二曝光等级的至少两帧第二待合成图像进行融合,得到高亮度图像。例如,终端可以首先确定上述至少两帧第二待合成图像中的非过曝区域,具体地,终端可以通过检测各个第二待合成图像中各个像素点的亮度,将亮度低于预设亮度阈值的区域作为非过曝区域。终端还可以根据至少两帧第二待合成图像的对比结果,确定非过曝区域中的移动区域。其中,移动区域表示该区域内存在移动物体,产生了运动模糊的区域。具体地,终端可以将上述至少两帧第二待合成图像进行对比,获取像素重合度,并将非过曝区域中像素重合度低于预设重合度阈值的区域作为非过曝区域中的移动区域,终端确定了非过曝区域中的移动区域后,非过曝区域中的其他区域即可以确定为非移动区域。In this embodiment, the terminal may fuse at least two frames of the second images to be synthesized at the second exposure level to obtain a high-brightness image. For example, the terminal may first determine the non-overexposed areas in the above-mentioned at least two frames of the second images to be synthesized. Specifically, the terminal may detect the brightness of each pixel in each of the second images to be synthesized, and reduce the brightness to a value lower than the preset brightness threshold. The area is regarded as the non-overexposed area. The terminal may also determine the moving area in the non-overexposed area according to the comparison result of at least two frames of the second image to be synthesized. Wherein, the moving area indicates that there is a moving object in the area, and a motion blurred area is generated. Specifically, the terminal may compare the at least two frames of the second images to be combined to obtain the pixel coincidence degree, and use the region in the non-overexposure area whose pixel coincidence degree is lower than the preset coincidence degree threshold as the movement in the non-overexposure area. area, after the terminal determines the moving area in the non-overexposure area, other areas in the non-overexposure area can be determined as non-moving areas.
上述至少两帧第二待合成图像中包括短一帧曝光图像和至少一帧长曝光图像,终端可以以短曝光图像为参考帧,将非过曝区域中的移动区域的图像替换为短曝光图像中对应区域的图像,并将非过曝区域中的非移动区域的图像替换为长曝光图像中对应区域的图像。具体地,以ev0曝光等级的短曝光图像为参考帧时,对于图像中的非过曝区域,若存在移动区域则终端可以在该位置使用短曝光图像中对应区域的图像,确保运动中的物体是被冻结且清楚呈现的状态;而非过曝区域中其余非移动区域可以使用长曝光图像中对应区域的图像,确保画质清晰。终端确定上述第二待合成图像中各个区域的替换图像,可以根据非过曝区域中移动区域的图像和非过曝区域中非移动区域的图像的融合结果,得到融合后的高亮度图像。The at least two frames of the second image to be synthesized include a short-frame exposure image and at least one long-exposure image, and the terminal may use the short-exposure image as a reference frame to replace the image of the moving area in the non-overexposed area with the short-exposure image The image of the corresponding area in the image, and the image of the non-moving area in the non-overexposed area is replaced by the image of the corresponding area in the long exposure image. Specifically, when the short-exposure image with the exposure level of ev0 is used as the reference frame, for the non-overexposed area in the image, if there is a moving area, the terminal can use the image of the corresponding area in the short-exposure image at this position to ensure that objects in motion It is frozen and clearly presented; the remaining non-moving areas in the non-overexposed area can use the image of the corresponding area in the long-exposure image to ensure clear quality. The terminal determines replacement images for each area in the second image to be synthesized, and can obtain a fused high-brightness image according to the fusion result of the image of the moving area in the non-overexposed area and the image of the non-moving area in the non-overexposed area.
通过本实施例,终端可以在第二待合成图像中非过曝区域中的移动区域使用短曝光图像中对应区域的图像,在非过曝区域中的非移动区域使用长曝光图像中对应区域的图像,从而提高了融合后的高亮度图像的清晰度,进而提高最终合成后的图像的清晰度。Through this embodiment, the terminal can use the image of the corresponding area in the short exposure image for the moving area in the non-overexposed area of the second image to be synthesized, and use the image of the corresponding area in the long exposure image for the non-moving area in the non-overexposed area. image, thereby improving the definition of the fused high-brightness image, and further improving the definition of the final composite image.
在一个实施例中,根据至少两帧第二待合成图像的对比结果,确定高亮度图像的过曝区域中的非移动区域,包括:获取至少两帧第二待合成图像中的过曝区域的图像的像素重合度;根据短曝光图像的过曝区域的图像与长曝光图像的过曝区域的图像的像素重合度大于预设重合度阈值的区域,确定高亮度图像的过曝区域中的非移动区域。In one embodiment, according to the comparison results of at least two frames of the second image to be synthesized, determining the non-moving area in the overexposed area of the high-brightness image includes: acquiring the at least two frames of the overexposed area in the second image to be synthesized The pixel coincidence degree of the image; according to the pixel coincidence degree of the image of the overexposure region of the short exposure image and the image of the overexposure region of the long exposure image is greater than the preset coincidence degree threshold, determine the non- mobile area.
本实施例中,终端可以通过对比确定上述至少两帧第二待合成图像中过曝区域中的非移动区域。例如,终端可以将上述至少两帧第二待合成图像进行像素对比,并获取上述至少两帧第二待合成图像中过曝区域的图像的像素重合度,终端可以获取上述短曝光图像中过曝区域的图像与长曝光图像中过曝区域的图像的像素重合度待遇预设重合度阈值的区域,并根据这些区域确定高亮度图像中过曝区域中的非移动区域。具体地,上述至少两帧第二待合成图像中包括短曝光图像和长曝光图像,且短曝光图像和长曝光图像的亮度一致,因此基于短曝光图像和长曝光图像确定出的过曝区域会与融合后的高亮度图像的过曝区域一致。因此终端可以通过短曝光图像和长曝光图像的对比,确定上述过曝区域中的非移动区域,而过曝区域中的其他区域则被确定为过曝区域中的移动区域。其中移动区域表示该区域中存在移动物体,非移动区域表示该区域中不存在移动物体。In this embodiment, the terminal may determine the non-moving area in the overexposed area in the at least two frames of the second image to be synthesized by comparison. For example, the terminal may compare the pixels of the at least two frames of the second images to be synthesized, and acquire the pixel coincidence degree of the overexposed area in the at least two frames of the second images to be synthesized, and the terminal may acquire the overexposure The pixel coincidence degree of the image of the region and the image of the overexposed region in the long exposure image is treated with a preset coincidence degree threshold, and the non-moving region in the overexposed region in the high brightness image is determined according to these regions. Specifically, the above-mentioned at least two frames of second images to be synthesized include a short-exposure image and a long-exposure image, and the brightness of the short-exposure image and the long-exposure image are consistent, so the overexposure area determined based on the short-exposure image and the long-exposure image will be Consistent with the overexposed area of the fused high-brightness image. Therefore, the terminal can determine the non-moving area in the above-mentioned over-exposure area by comparing the short-exposure image and the long-exposure image, while other areas in the over-exposure area are determined as moving areas in the over-exposure area. The moving area indicates that there is a moving object in the area, and the non-moving area indicates that there is no moving object in the area.
通过本实施例,终端可以基于图像的像素重合度确定高亮度图像中过曝区域的非移动区域。从而终端可以基于非移动区域进行图像替换,提高图像合成的清晰度。Through this embodiment, the terminal can determine the non-moving area of the overexposed area in the high-brightness image based on the pixel overlap of the image. Therefore, the terminal can perform image replacement based on the non-moving area, thereby improving the clarity of image synthesis.
在一个实施例中,根据第一待合成图像与过曝区域中的非移动区域的匹配结果,确定第一待合成图像中的待合成区域,包括:将第一待合成图像与过曝区域中的非移动区域匹配,得到第一待合成图像中的非移动区域;根据第一待合成图像中的非移动区域得到待合成区域。In one embodiment, according to the matching result of the first image to be synthesized and the non-moving area in the overexposed area, determining the area to be synthesized in the first image to be synthesized includes: combining the first image to be synthesized with the non-moving area in the overexposed area The non-moving area in the first image to be synthesized is matched to obtain the non-moving area in the first image to be synthesized; the area to be synthesized is obtained according to the non-moving area in the first image to be synthesized.
本实施例中,终端可以通过将上述确定的过曝区域中的非移动区域对应回第一待合成图像,确定第一待合成图像中用于替换这些过曝区域中的非移动区域的待合成区域。由于上述第一待合成图像与上述短曝光图像的来源于同一原始图像,其图像结构和图像内容一致,则终端基于上述短曝光图像确定出的过曝区域中的非移动区域,可以与第一待合成图像对应。终端可以将上述第一待合成图像与上述确定的过曝区域中的非移动区域进行匹配,得到第一待合成图像中的非移动区域,从而终端可以基于第一待合成图像中的非移动区域得到待合成区域。其中,待合成区域中的图像可以用于替换高亮度图像中过曝区域的非移动区域的图像,具体地,由于上述识别出了过曝区域中的移动区域和非移动区域,终端在高亮度图像中的过曝区域想要采用ev-帧的图像时,可以根据该位置是否属于移动区域决定是否使用,从而ev-帧图像能够准确还原至合成后的图像中,避免产生重影。In this embodiment, the terminal may determine the non-moving areas in the first image to be combined to replace the non-moving areas in the over-exposed areas by corresponding the determined non-moving areas in the over-exposed areas back to the first image to be combined. area. Since the first image to be synthesized and the short-exposure image are derived from the same original image, and their image structure and image content are consistent, the non-moving area in the over-exposed area determined by the terminal based on the short-exposure image can be compared with the first corresponding to the image to be synthesized. The terminal may match the first image to be synthesized with the determined non-moving area in the overexposed area to obtain the non-moving area in the first image to be synthesized, so that the terminal may base on the non-moving area in the first image to be synthesized Get the area to be synthesized. Wherein, the image in the area to be synthesized can be used to replace the image in the non-moving area of the overexposed area in the high-brightness image. When you want to use the ev-frame image for the overexposed area in the image, you can decide whether to use it according to whether the position belongs to the moving area, so that the ev-frame image can be accurately restored to the synthesized image to avoid ghosting.
通过本实施例,终端可以通过识别高亮度图像中过曝区域的移动区域和非移动区域,并基于短曝光图像和第一待合成图像的对应关系,在第一待合成图像中确定与上述过曝区域中非移动区域的位置对应的待合成区域,从而终端可以基于待合成区域中的图像实现图像合成,提高了图像合成的清晰度。Through this embodiment, the terminal can identify the moving area and the non-moving area of the overexposed area in the high-brightness image, and based on the corresponding relationship between the short-exposure image and the first image to be combined, determine in the first image to be combined that the above The location of the non-moving area in the exposure area corresponds to the area to be combined, so that the terminal can implement image synthesis based on the images in the area to be combined, which improves the clarity of image synthesis.
应该理解的是,虽然如上所述的各实施例所涉及的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,如上所述的各实施例所涉及的流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the steps in the flow charts involved in the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flow charts involved in the above-mentioned embodiments may include multiple steps or stages, and these steps or stages are not necessarily executed at the same time, but may be performed at different times For execution, the execution order of these steps or stages is not necessarily performed sequentially, but may be executed in turn or alternately with other steps or at least a part of steps or stages in other steps.
基于同样的发明构思,本申请实施例还提供了一种用于实现上述所涉及的图像合成方法的图像合成装置。该装置所提供的解决问题的实现方案与上述方法中所记载的实现方案相似,故下面所提供的一个或多个图像合成装置实施例中的具体限定可以参见上文中对于图像合成方法的限定,在此不再赘述。Based on the same inventive concept, an embodiment of the present application further provides an image synthesis device for implementing the above-mentioned image synthesis method. The solution to the problem provided by the device is similar to the implementation described in the above method, so the specific limitations in one or more embodiments of the image synthesis device provided below can refer to the definition of the image synthesis method above, I won't repeat them here.
在一个实施例中,如图4所示,提供了一种图像合成装置,包括:获取模块500、融合模块502、第一确定模块504、第二确定模块506和合成模块508,其中:In one embodiment, as shown in FIG. 4 , an image synthesis device is provided, including: an
获取模块500,用于获取相同对象的一组待合成图像;一组待合成图像中包括第一曝光等级的一帧第一待合成图像以及第二曝光等级的至少两帧第二待合成图像;第一曝光等级小于第二曝光等级;至少两帧第二待合成图像中包含不同曝光时长的图像,且其中一帧图像与第一待合成图像的图像结构一致。The acquiring
融合模块502,用于融合至少两帧第二待合成图像得到高亮度图像,确定高亮度图像中的过曝区域。The
第一确定模块504,用于根据至少两帧第二待合成图像的对比结果,确定高亮度图像的过曝区域中的非移动区域;非移动区域不存在移动物体。The
第二确定模块506,用于根据第一待合成图像与过曝区域中的非移动区域的匹配结果,确定第一待合成图像中的待合成区域。The
合成模块508,用于将高亮度图像的过曝区域中的非移动区域替换为待合成区域的图像,根据替换后的高亮度图像,得到相同对象的合成后的图像。The
在一个实施例中,上述获取模块500,具体用于获取针对目标对象的第一曝光时长的第一原始图像,基于第一曝光等级和第二曝光等级分别处理第一原始图像,得到第一曝光等级下的第一感光度与第一曝光时长的第一待合成图像,以及第二曝光等级下的第一感光度与第一曝光时长的短曝光图像;获取针对目标对象的第二曝光时长的至少一帧第二原始图像,基于第二曝光等级处理至少一帧第二原始图像,得到第二曝光等级下的第二感光度与第二曝光时长的至少一帧长曝光图像;第一感光度大于第二感光度;短曝光图像与长曝光图像亮度一致;根据第一待合成图像、短曝光图像与至少一帧长曝光图像,得到一组待合成图像。In one embodiment, the
在一个实施例中,上述融合模块502,具体用于确定至少两帧第二待合成图像中的非过曝区域,并根据至少两帧第二待合成图像的对比结果,确定非过曝区域中的移动区域;移动区域存在移动物体;将非过曝区域中的移动区域的图像替换为短曝光图像中对应区域的图像;将非过曝区域中的非移动区域的图像替换为长曝光图像中对应区域的图像;非过曝区域中的非移动区域不存在移动物体;根据替换后的非过曝区域中的移动区域的图像和非过曝区域中的非移动区域的图像的融合结果,得到融合后的高亮度图像。In one embodiment, the
在一个实施例中,上述第一确定模块504,具体用于获取至少两帧第二待合成图像中的过曝区域的图像的像素重合度;根据短曝光图像的过曝区域的图像与长曝光图像的过曝区域的图像的像素重合度大于预设重合度阈值的区域,确定高亮度图像的过曝区域中的非移动区域。In one embodiment, the above-mentioned
在一个实施例中,上述第二确定模块506,具体用于将第一待合成图像与过曝区域中的非移动区域匹配,得到第一待合成图像中的非移动区域;根据第一待合成图像中的非移动区域得到待合成区域。In one embodiment, the above-mentioned
在一个实施例中,上述融合模块502,具体用于获取融合后的高亮度图像中亮度大于预设亮度阈值的区域,得到高亮度图像中的过曝区域。In one embodiment, the above-mentioned
在一个实施例中,上述合成模块508,具体用于对替换后的高亮度图像进行锐化、亮度调整和平滑去噪中的至少一种处理,得到图像清晰度大于预设清晰度阈值的相同对象的合成后的图像。In one embodiment, the
上述图像合成装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。Each module in the above-mentioned image synthesizing device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.
在一个实施例中,提供了一种计算机设备,该计算机设备可以是终端,其内部结构图可以如图5所示。该计算机设备包括通过系统总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的通信接口用于与外部的终端进行有线或无线方式的通信,无线方式可通过WIFI、移动蜂窝网络、NFC(近场通信)或其他技术实现。该计算机程序被处理器执行时以实现一种图像合成方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure may be as shown in FIG. 5 . The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, mobile cellular network, NFC (Near Field Communication) or other technologies. When the computer program is executed by a processor, an image synthesis method is realized. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the casing of the computer device , and can also be an external keyboard, touchpad, or mouse.
本领域技术人员可以理解,图5中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in Figure 5 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation to the computer equipment on which the solution of this application is applied. The specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
在一个实施例中,提供了一种计算机设备,包括存储器和处理器,存储器中存储有计算机程序,该处理器执行计算机程序时实现上述的图像合成方法。In one embodiment, a computer device is provided, including a memory and a processor, where a computer program is stored in the memory, and the processor implements the above image synthesis method when executing the computer program.
在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现上述的图像合成方法。In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the above image synthesis method is implemented.
在一个实施例中,提供了一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现上述的图像合成方法。In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the above image synthesis method is realized.
需要说明的是,本申请所涉及的用户信息(包括但不限于用户设备信息、用户个人信息等)和数据(包括但不限于用于分析的数据、存储的数据、展示的数据等),均为经用户授权或者经过各方充分授权的信息和数据。It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all Information and data authorized by the user or fully authorized by all parties.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-OnlyMemory,ROM)、磁带、软盘、闪存、光存储器、高密度嵌入式非易失性存储器、阻变存储器(ReRAM)、磁变存储器(Magnetoresistive Random Access Memory,MRAM)、铁电存储器(Ferroelectric Random Access Memory,FRAM)、相变存储器(Phase Change Memory,PCM)、石墨烯存储器等。易失性存储器可包括随机存取存储器(Random Access Memory,RAM)或外部高速缓冲存储器等。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static Random Access Memory,SRAM)或动态随机存取存储器(Dynamic RandomAccess Memory,DRAM)等。本申请所提供的各实施例中所涉及的数据库可包括关系型数据库和非关系型数据库中至少一种。非关系型数据库可包括基于区块链的分布式数据库等,不限于此。本申请所提供的各实施例中所涉及的处理器可为通用处理器、中央处理器、图形处理器、数字信号处理器、可编程逻辑器、基于量子计算的数据处理逻辑器等,不限于此。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the computer programs can be stored in a non-volatile computer-readable memory In the medium, when the computer program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any reference to storage, database or other media used in the various embodiments provided in the present application may include at least one of non-volatile and volatile storage. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive variable memory (ReRAM), magnetic variable memory (Magnetoresistive Random Access Memory, MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (Phase Change Memory, PCM), graphene memory, etc. The volatile memory may include random access memory (Random Access Memory, RAM) or external cache memory. As an illustration and not a limitation, the RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM). The databases involved in the various embodiments provided in this application may include at least one of a relational database and a non-relational database. The non-relational database may include a blockchain-based distributed database, etc., but is not limited thereto. The processors involved in the various embodiments provided by this application can be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, data processing logic devices based on quantum computing, etc., and are not limited to this.
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be determined by the appended claims.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211021685.9A CN115272155A (en) | 2022-08-24 | 2022-08-24 | Image synthesis method, image synthesis device, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211021685.9A CN115272155A (en) | 2022-08-24 | 2022-08-24 | Image synthesis method, image synthesis device, computer equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115272155A true CN115272155A (en) | 2022-11-01 |
Family
ID=83754111
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211021685.9A Pending CN115272155A (en) | 2022-08-24 | 2022-08-24 | Image synthesis method, image synthesis device, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115272155A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116055891A (en) * | 2023-01-03 | 2023-05-02 | 维沃移动通信有限公司 | Image processing method and device |
CN117278865A (en) * | 2023-11-16 | 2023-12-22 | 荣耀终端有限公司 | Image processing method and related device |
-
2022
- 2022-08-24 CN CN202211021685.9A patent/CN115272155A/en active Pending
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116055891A (en) * | 2023-01-03 | 2023-05-02 | 维沃移动通信有限公司 | Image processing method and device |
CN117278865A (en) * | 2023-11-16 | 2023-12-22 | 荣耀终端有限公司 | Image processing method and related device |
CN117278865B (en) * | 2023-11-16 | 2025-04-01 | 荣耀终端股份有限公司 | Image processing method and related device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108012080B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
CN106060249B (en) | A kind of photographing anti-shake method and mobile terminal | |
CN102905058B (en) | Apparatus and method for generating high dynamic range images with ghost blur removed | |
CN102779334B (en) | Correction method and device of multi-exposure motion image | |
CN111915505B (en) | Image processing methods, devices, electronic equipment and storage media | |
CN115272155A (en) | Image synthesis method, image synthesis device, computer equipment and storage medium | |
WO2015014286A1 (en) | Method and apparatus for generating high dynamic range image | |
CN108198152A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
CN113439286B (en) | Processing image data in composite images | |
CN112215875A (en) | Image processing method, device and electronic system | |
CN114092562A (en) | Noise model calibration method, image denoising method, device, equipment and medium | |
CN110689496A (en) | Method and device for determining noise reduction model, electronic equipment and computer storage medium | |
CN111080571A (en) | Camera shielding state detection method and device, terminal and storage medium | |
CN115049572A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
CN109005363A (en) | Imaging control method, imaging control device, electronic device and storage medium | |
CN108513062A (en) | Terminal control method and device, readable storage medium and computer equipment | |
CN114422721B (en) | Imaging method, device, electronic device and storage medium | |
CN114972137B (en) | Image processing method, terminal and storage medium | |
CN114972100B (en) | Noise model estimation method and device, image processing method and device | |
CN114630056A (en) | Image generation method, apparatus, electronic device, and readable storage medium | |
CN113112452A (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
CN117830120A (en) | Image fusion method, device, computer equipment and computer readable storage medium | |
CN117876237A (en) | Image processing method, apparatus, electronic device, and computer-readable storage medium | |
CN108804656A (en) | Information processing method and device, electronic equipment, computer readable storage medium | |
CN117408896A (en) | Image generation method, device, electronic device and computer-readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20230807 Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Room F, 11/F, Beihai Center, 338 Hennessy Road, Wan Chai District, 810100 Hong Kong, China Applicant before: Sonar sky Information Consulting Co.,Ltd. |