WO2018040751A1 - 图像生成装置及方法、图像处理设备及存储介质 - Google Patents

图像生成装置及方法、图像处理设备及存储介质 Download PDF

Info

Publication number
WO2018040751A1
WO2018040751A1 PCT/CN2017/092539 CN2017092539W WO2018040751A1 WO 2018040751 A1 WO2018040751 A1 WO 2018040751A1 CN 2017092539 W CN2017092539 W CN 2017092539W WO 2018040751 A1 WO2018040751 A1 WO 2018040751A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
pixel
black
information
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/092539
Other languages
English (en)
French (fr)
Inventor
戴向东
王猛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201610753013.5A external-priority patent/CN106355569A/zh
Priority claimed from CN201610750445.0A external-priority patent/CN106447641A/zh
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Publication of WO2018040751A1 publication Critical patent/WO2018040751A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction

Definitions

  • the present invention relates to the field of information technology, and in particular, to an image generating apparatus and method, an image processing apparatus, and a storage medium.
  • embodiments of the present invention are directed to providing an image generating apparatus and method, an image processing apparatus, and a storage medium, which can obtain a high quality image by using a method of image fusion.
  • a first aspect of the embodiments of the present invention provides an image generating apparatus, including:
  • the parsing unit is configured to parse the K images including the same acquisition object to obtain a first image information value; the K is an integer less than 2;
  • a determining unit configured to determine an area contrast and a region gradient value of a region where each pixel in each of the images is located based on the first image information value
  • a first acquiring unit configured to multiply the area contrast by the area gradient value to obtain a fusion parameter of each pixel
  • a calculating unit configured to calculate a fusion weight value of each pixel in the K image based on the fusion parameter
  • a second acquiring unit configured to obtain the second image information value based on the fusion weight and the first image information value of the K image corresponding pixel
  • a generating unit configured to generate a fused image of the K images according to the second image value.
  • a second aspect of the embodiments of the present invention provides an image generating method, including:
  • a fused image of the K images is generated based on the second image information value.
  • a third aspect of the embodiments of the present invention provides another image generating method, including:
  • An embodiment of the present invention provides another image generating apparatus, including:
  • a third acquiring unit configured to acquire a black and white image and a color image of the same collection object
  • a fourth acquiring unit configured to perform image processing on the black and white image and the color image, respectively, to obtain black and white image information of the black and white image and color image information of the color image;
  • a weight determining unit configured to determine, according to the black and white image information and the color image information, a fusion weight of the black and white image and the color image;
  • the merging unit is configured to fuse the black and white image information and the color image according to the fusion weight to generate a fused image.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to implement the one or more image generation methods.
  • a memory for storing computer executable instructions
  • a processor coupled to the memory and configured to execute the computer executable instructions to implement the one or more image generation methods.
  • the image generating apparatus and method, the image processing apparatus and the computer storage medium provided by the embodiments of the present invention obtain image information values by analyzing multiple images, and then use the processing of image information values to obtain fusion weights, and fuse multiple images.
  • a fused image that can contain the advantages of multiple images is obtained, and the fused image thus obtained can satisfy the high image quality required by the user, high image information, high color saturation, and low distortion.
  • FIG. 1 is a schematic flowchart of an image generating method according to an embodiment of the present invention.
  • FIG. 2a is a schematic diagram of an original image according to an embodiment of the present invention.
  • Figure 2b is a schematic diagram of the first wavelet decomposition of the original image shown in Figure 2a;
  • FIG. 2c is a schematic diagram of the 2nd wavelet decomposition of the original image shown in FIG. 2a;
  • FIG. 2d is a schematic diagram of 3 times wavelet decomposition of the original image shown in FIG. 2a;
  • FIG. 3 is a schematic flowchart diagram of another image generating method according to an embodiment of the present disclosure.
  • FIG. 4 is a schematic structural diagram of an image generating apparatus according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic structural diagram of a communication system according to an embodiment of the present invention.
  • Figure 7a is a schematic diagram of the effect of a black and white image
  • Figure 7b is a schematic view showing the effect of the color image corresponding to Figure 7a;
  • Figure 8 is a schematic view showing the fusion effect of the images shown in Figures 7a and 7b;
  • FIG. 9 is a schematic diagram showing the effect of the fused image after the black and white image and the color image are fused.
  • this embodiment provides an image generating method, including:
  • Step S110 Parsing K images including the same acquisition object to obtain a first image information value; the K is an integer less than 2;
  • Step S120 determining, according to the first image information value, a region contrast and a region gradient value of a region where each pixel in each image is located;
  • Step S130 Multiplying the area contrast by the area gradient value to obtain a fusion parameter of each pixel
  • Step S140 Calculate a fusion weight value of each pixel in the K image based on the fusion parameter
  • Step S150 Acquire a second image information value based on the fusion weight and the first image information value of the K image corresponding pixel.
  • Step S160 Generate a fused image of the K images according to the second image information value.
  • the embodiment provides an image generation method, which uses multiple images to capture the same collection object. Multiple images are image-analyzed to obtain first image information.
  • the first image information herein may include various information values such as luminance information, color information, and the like.
  • step S110 the following first image information value may be obtained by parsing each of the images
  • RGB and YUV images are clearly separated so that brightness and color information can be processed separately.
  • the conversion formula for RGB and YUV images is as follows:
  • the R represents a red color value
  • the B represents a blue color value
  • the G represents a green color value
  • wavelet decomposition can be performed on each of the above images.
  • a wavelet decomposition coefficient is obtained; the wavelet decomposition coefficient may be referred to as a first wavelet decomposition coefficient, which is a component of the first image information value.
  • the second wavelet decomposition coefficient for generating the fused image can be obtained, and finally, the fused image can be obtained by inverse image transformation using the second wavelet decomposition coefficient.
  • Wavelet decomposition is to extract image information of different dimensions from the image, for example, luminance information and color information; specific values of luminance information and color information can be represented by wavelet decomposition coefficients.
  • wavelet decomposition has no information loss and redundant information in the decomposition process; the image can be decomposed into a combination of average image and detail image, which respectively represent different structures of the image, so it is easy to extract the structural information and detail information of the original image.
  • wavelet decomposition also has a fast algorithm, and usually two-dimensional wavelet decomposition can provide a selective image that matches the direction of the human visual system.
  • FIG. 2a is the original image
  • FIG. 2b is the first wavelet decomposition image
  • FIG. 2c is the second wavelet decomposition image obtained by wavelet decomposition again in the first wavelet decomposition image
  • FIG. 2d is the third decomposition image obtained on the second wavelet decomposition image. Subwavelet decomposition image.
  • the processing of the image is not limited to wavelet decomposition, and the first image information value may be obtained directly by other methods of brightness extraction and color extraction, for example, obtaining A letter image information value such as a luminance value, a color value, and a gradation value of each pixel is taken.
  • the area contrast and the area gradient value will be calculated based on the first image information value in step S120.
  • wavelet decomposition coefficients capable of characterizing image information in different images are obtained based on wavelet decomposition, and respective image region contrasts and region gradient values are calculated.
  • the area where the pixel A is located may extend N and M respectively in the two vertical directions with the pixel A as the center, and obtain an area A including N*M pixels; the area A is where the pixel A is located. region.
  • the region contrast and region gradient values will be obtained using various algorithms in this embodiment.
  • the region gradient value here is the gradient between the gray values of the individual pixels in the region.
  • the product of the area contrast and the area gradient value is calculated in step S130 to obtain a fusion parameter.
  • the fusion parameter is used as the dependent variable, and the fusion weight corresponding to each pixel when each image is in multiple images is calculated.
  • a second image information value eg, a second wavelet decomposition coefficient
  • the first image information value eg, the first wavelet decomposition coefficient
  • the second image according to the fused image The information value (for example, the second wavelet decomposition coefficient) is inversely transformed, and finally a fused image is obtained.
  • pixel-by-pixel fusion of a plurality of images can be performed.
  • wavelet decomposition coefficients of each pixel in each image are extracted by wavelet decomposition, and pixel-by-pixel fusion can be realized by performing the above steps S120 to S160.
  • the fused image is generated by extracting image information in a plurality of images, at least part of the image information or image features of the plurality of images will be retained, so that a fused image of high picture quality can be obtained.
  • the high picture quality here may include high definition, small image distortion, and the like.
  • the K images may be different types of images of the same acquisition object.
  • the K images may include black and white images, color images, infrared images, and the like. In this way, the fused image can be combined with the image advantages of different images to form a high-quality image with various advantages; and the method provided by the embodiment, It is easy to implement.
  • the step S120 may include:
  • the i, j is the coordinates of the pixel p; the CL i, j is the regional contrast of the region where the pixel p is located; the p(i, j) is the first image information value of the pixel p; the m (i, j) an average value of the first image information values of the pixels of the region where the pixel p is located; the N is the number of pixels in the first dimension of the region where the pixel p is located; and the M is the pixel p The number of pixels in the second dimension of the region; the first dimension is perpendicular to the second dimension.
  • the N*M is the total number of pixels in the area where the pixel p is located. Generally, the p is the central pixel of the area where the pixel is located.
  • the area contrast can be easily calculated using the above formula.
  • step S120 may further include:
  • both A1 and A2 are operators that perform convolution operations, and all correspond to a matrix.
  • the matrix size of the convolution operator determines the dimension of the horizontal and vertical coordinates of the convolution operation.
  • An alternative 3*3 convolution operator is provided below.
  • the step S140 may include:
  • the WM(i, j, s) is a fusion parameter WM(i, j) of a pixel having coordinates (i, j) in the sth image; the WM (i, j, k) is the kth image.
  • the adjustment factor of the image is greater than the adjustment factor of other images, and the adjustment factor may be an addition factor.
  • Factor or multiplication factor After the addition factor is introduced into a, it can be profitable Calculate the full fusion weight using the following formula:
  • the fusion weight can be calculated using the following formula.
  • the step S160 may include:
  • the F(i,j) is a second wavelet decomposition coefficient of a pixel of coordinates (i,j); the kwave k (i,j) is a first pixel of a pixel of the image k with coordinates (i,j) Wavelet decomposition coefficient; the W(i, j, k) is the fusion weight of the pixel of the image k with the coordinates (i, j).
  • the formula for determining the second image information value is not limited to the above formula.
  • the first image information value is the first wavelet decomposition coefficient
  • the second image information value may be a second wavelet decomposition coefficient.
  • the human eye has different sensitivity to light of different wavelengths. Therefore, after wavelet decomposition, on the one hand, for the sake of simple calculation, a relatively simple formula (ie, a functional relationship) can be appropriately adopted in a frequency band with low sensitivity of the human eye. Processing, even if some of the image information is lost, the human eye can not detect it, so as to reduce the calculation and storage resources; the other party needs to retain more image information in the frequency band more sensitive to the human eye, and may adopt a more complicated function relationship. For better results.
  • the step S150 may include:
  • the formula for determining the second image information value is not limited to the above formula.
  • FIG. 3 is a schematic diagram of a process for performing image fusion using different fusion rules in different frequency bands by using the image generation method provided in this embodiment.
  • the source image A and the source image B may be any two of the K images, and are respectively subjected to wavelet decomposition to obtain high frequency subband coefficients and low frequency subband coefficients, respectively.
  • the high frequency sub-band coefficient and the low frequency sub-band coefficient are the previous wavelet decomposition coefficients.
  • the high frequency subband coefficients of the two source images are obtained by using the high frequency fusion rule and the high frequency fusion weight to obtain the high frequency subband coefficients of the fused image; the low frequency subbands of the two source images are subjected to the low frequency subband rule and the low frequency. Fusion weights are combined to obtain low frequency subband coefficients.
  • the fused image is then finally obtained by inversely changing.
  • the high frequency sub-band here may be a frequency whose frequency is greater than a certain frequency threshold, and the low frequency sub-band may be a frequency whose frequency is lower than the frequency threshold.
  • the high frequency fusion weight and the low frequency fusion weight are all one of the aforementioned fusion weights.
  • the second image information value After the second image information value is obtained, the image can be converted by using the following formula to obtain a fused image.
  • the second image information may include information such as Y, V, and U.
  • a method for generating a fused image by combining a black and white image and a color image including:
  • S100 Acquire a color image and a black and white image, and preprocess.
  • step S100 since the black and white image has only luminance information and no color information, the black and white and the color image are fused, and the luminance information needs to be fused.
  • the colors of the fused image are all derived from the color image, so it is necessary to convert the color RGB image into a YUV image.
  • the YUV format clearly separates the brightness information (Y channel) and color (UV channel) of the image so that the brightness and color information can be processed separately.
  • the black and white image and the color image are fused, and a fused image having high image quality with high brightness, high contrast and color at the same time is obtained.
  • the step S110 may include:
  • the step S120 may include:
  • the step S130 may include:
  • the step S140 may include:
  • the step S160 may include:
  • the step S110 may include: extracting first brightness information of the black and white image; extracting second brightness information and color information of the color image; the step S1460 may include: utilizing the fusion right The value is processed by the first brightness information and the second brightness information preset function to obtain third brightness information of the fused image; and the fused image is generated by combining the third brightness information and the color information.
  • the step S110 may further include: performing wavelet decomposition on the black and white image and the color image respectively, obtaining a first wavelet decomposition coefficient of the luminance information of the black and white image, and brightness information of the color image.
  • the second wavelet decomposition coefficient; the step S160 may further include: performing function calculation on the first wavelet decomposition parameter and the second wavelet decomposition parameter in combination with the fusion weight value and a preset function processing to obtain a third Wavelet decomposition coefficient; image inverse processing is performed by using the third wavelet decomposition coefficient to generate the fused image.
  • the step S160 may include: in the first frequency band, combining the first wavelet decomposition parameter and the second wavelet decomposition parameter by using a first functional relationship in combination with the fusion weight, to obtain a first frequency band. a third wavelet decomposition; in the second frequency band, combining the first wavelet decomposition parameter and the second wavelet decomposition parameter by using a second functional relationship in combination with the fusion weight to obtain a third wavelet decomposition of the second frequency band; A functional relationship is different from the second functional relationship; wherein the first frequency band and the second frequency band are frequency bands of different sensitivity levels of the human eye.
  • Fig. 7a is a display effect diagram of a black and white image
  • Fig. 7b is a black and white effect diagram corresponding to a color image.
  • Wavelet decomposition is performed on the black and white image and the color image, respectively, and the high frequency subband coefficient and the low frequency subband coefficient are obtained respectively.
  • the high frequency sub-band coefficient and the low frequency sub-band coefficient are the previous wavelet decomposition coefficients.
  • the high frequency subband coefficients of the two source images are obtained by using the high frequency fusion rule and the high frequency fusion weight to obtain the high frequency subband coefficients of the fused image; the low frequency subbands of the two source images are subjected to the low frequency subband rule and the low frequency. Fusion weights are combined to obtain low frequency subband coefficients.
  • the fused image is then finally obtained by inversely changing.
  • the high frequency sub-band here may be a frequency whose frequency is greater than a certain frequency threshold
  • the low frequency sub-band may be a frequency whose frequency is lower than the frequency threshold.
  • the high frequency fusion weight and the low frequency fusion weight are all one of the aforementioned fusion weights.
  • Figure 9 shows the effect of the fused image after the fusion of the black and white image and the color image, apparently better than the images of Figures 7a and 7b.
  • the embodiment provides an image generating apparatus, including:
  • the parsing unit 310 is configured to parse the K images including the same acquisition object to obtain a first image information value; the K is an integer less than 2;
  • the determining unit 320 is configured to determine, according to the first image information value, a region contrast and a region gradient value of a region where each pixel in each image is located;
  • the first obtaining unit 330 is configured to multiply the area contrast by the area gradient value to obtain a fusion parameter of each pixel;
  • the calculating unit 340 is configured to calculate a fusion weight value of each pixel in the K image based on the fusion parameter;
  • the second obtaining unit 350 is configured to obtain the second image information value based on the fusion weight and the first image information value of the K image corresponding pixel.
  • the generating unit 360 is configured to generate a fused image of the K images according to the second image value.
  • the image generating device provided by the embodiment of the present invention may be a structure in various electronic devices.
  • the electronic device may include various mobile terminals such as a mobile phone, a tablet computer, a wearable device, and the like, and may also be various fixed terminals that cannot be moved.
  • the parsing unit 310, the determining unit 320, the first obtaining unit 330, the calculating unit 340, the second obtaining unit 350, and the generating unit 360 may all correspond to a processor or a processing circuit in the electronic device.
  • the processor may include a central processing unit CPU, a microprocessor MCU, a digital signal processor DSP, a programmable array PLC or an application processor AP, and the like.
  • the processing circuit can include an application specific integrated circuit ASIC.
  • the processor or processing circuitry can perform the above functions by executing predetermined instructions.
  • the calculating unit 340 and the determining unit 320 and the first obtaining unit 330 and the second obtaining unit 350 and the like may also correspond to a calculator or a processor having a computing function, etc., and may calculate the required units of each unit by using a function of a plurality of columns.
  • the information is, for example, the area contrast or the area gradient value or the like.
  • the image generating apparatus of the embodiment can generate a plurality of fused images with higher image quality by acquiring a plurality of images including the same collection object, thereby reducing requirements on the acquisition hardware, reducing hardware costs, and improving the image. quality.
  • the determining unit 320 is configured to calculate the area contrast using the following formula
  • the i, j is the coordinates of the pixel p; the CL i, j is the regional contrast of the region where the pixel p is located; the p(i, j) is the first image information value of the pixel p; the m (i, j) an average value of image information values of respective pixels of the region where the pixel p is located; the N is the number of pixels in the first dimension of the region where the pixel p is located; and the M is the region where the pixel p is located The number of pixels in the second dimension; the first dimension is perpendicular to the second dimension.
  • the determining unit 320 in this embodiment may correspond to a calculator or a processor having a computing function. Through the above calculation, the contrast of the region can be easily obtained.
  • the determining unit 320 is further configured to calculate the region gradient value by using the following formula
  • the i, j is a coordinate of the pixel p; the I is a first image information value of a region where the pixel p is located in the first image; a gradient value in the x direction of the region where the pixel p is located; a gradient value in the y direction of the region where the pixel p is located; the GL i,j is a region gradient value of a region where the pixel p is located; the A1 is a first convolution operator; and the A2 is a second Convolution operator.
  • the determining unit 320 in this embodiment may correspond to a calculator or a processor having a computing function, and the region gradient value can be obtained simply by the above calculation.
  • the calculating unit 340 is configured to calculate the fusion weight using the following formula
  • the WM(i, j, s) is a fusion parameter WM(i, j) of a pixel having coordinates (i, j) in the sth image; the WM (i, j, k) is the kth image.
  • the above calculation unit only provides a method for calculating the fusion weight.
  • the second obtaining unit 350 is configured to calculate the second image information value by using a formula
  • the F(i,j) is a second image information value of a pixel of coordinates (i,j); the kwave k (i,j) is a first pixel of a pixel of the image k with coordinates (i,j)
  • the image information value; the W(i, j, k) is the let-and-weight of the pixel whose coordinates are (i, j) in the image k.
  • the second obtaining unit 350 in the embodiment can obtain the second image information value according to the first image information value of the corresponding pixel of the plurality of images by using the above formula (ie, the function relationship), and has the characteristics of being simple and convenient.
  • This pixel-by-pixel fusion method has the characteristics of good fusion effect.
  • the formula for determining the second image information value is not limited to the above formula.
  • the parsing unit 310 is configured to perform image processing on the black and white image and the color image of the same collection object, and obtain black and white image information of the black and white image and color image information of the color image; 320. For determining, according to the black and white image information, a region contrast and a region gradient value of a region where each pixel in the black and white image is located, and based on the color image information, a region contrast and a region of a region where each pixel is located in the color image.
  • the first obtaining unit 330 is configured to multiply the area contrast by the area gradient value to acquire the fusion parameters of each pixel in the black and white image and the color image respectively; 340, specifically for calculating, according to the fusion parameter, a fusion weight of each pixel of the black and white image and the color image; the generating unit 360 is specifically configured to: according to the fusion weight, the black and white image information and The color image is fused to generate a fused image.
  • the parsing unit 310 is configured to extract first brightness information of the black and white image; extract second brightness information and color information of the color image; and the generating unit 360 is configured to utilize the fusion right
  • the value is processed by the first brightness information and the second brightness information preset function to obtain third brightness information of the fused image; and the fused image is generated by combining the third brightness information and the color information.
  • the parsing unit 310 is specifically configured to respectively perform the black and white image and the color
  • the image is subjected to wavelet decomposition to obtain a first wavelet decomposition coefficient of the luminance information of the black and white image, and a second wavelet decomposition coefficient of the luminance information of the color image.
  • the generating unit 360 is specifically configured to combine the fusion weight And performing a function calculation on the first wavelet decomposition parameter and the second wavelet decomposition parameter to obtain a third wavelet decomposition coefficient; performing image inverse processing on the third wavelet decomposition coefficient to generate the fusion image.
  • the generating unit 360 is configured to: in the first frequency band, combine the first wavelet decomposition parameter and the second wavelet decomposition parameter with a first functional relationship in combination with the fusion weight to obtain a first frequency band. a third wavelet decomposition; in the second frequency band, combining the first wavelet decomposition parameter and the second wavelet decomposition parameter by using a second functional relationship in combination with the fusion weight to obtain a third wavelet decomposition of the second frequency band;
  • the first functional relationship is different from the second functional relationship; wherein the first frequency band and the second frequency band are frequency bands of different sensitivity levels of the human eye.
  • An embodiment of the present invention further provides another image generating apparatus, including:
  • a third acquiring unit configured to acquire a black and white image and a color image of the same collection object
  • a fourth acquiring unit configured to perform image processing on the black and white image and the color image, respectively, to obtain black and white image information of the black and white image and color image information of the color image;
  • a weight determining unit configured to determine, according to the black and white image information and the color image information, a fusion weight of the black and white image and the color image;
  • the merging unit is configured to fuse the black and white image information and the color image according to the fusion weight to generate a fused image.
  • the determining unit is specifically configured to determine, according to the black and white image information, a region contrast and a region gradient value of a region where each pixel in the black and white image is located, and based on the color image information, where the pixel is located in the color image a region contrast and a region gradient value; multiplying the region contrast by the region gradient value, respectively acquiring the fusion parameters of each pixel in the black and white image and the color image; and calculating the black and white separately based on the fusion parameter The blending weight of each pixel of the image and color image.
  • the fourth acquiring unit is configured to extract first brightness information of the black and white image; and extract second brightness information and color information of the color image;
  • the merging unit is configured to process the first brightness information and the second brightness information preset function by using the fusion weight to obtain third brightness information of the fused image; combining the third brightness information and the The color information is generated to generate the fused image.
  • the fourth acquiring unit is configured to perform wavelet decomposition on the black and white image and the color image, respectively, to obtain a first wavelet decomposition coefficient of the luminance information of the black and white image, and brightness of the color image.
  • Second wavelet decomposition coefficient of information is configured to perform wavelet decomposition on the black and white image and the color image, respectively, to obtain a first wavelet decomposition coefficient of the luminance information of the black and white image, and brightness of the color image.
  • the merging unit is configured to perform a function calculation on the first wavelet decomposition parameter and the second wavelet decomposition parameter to obtain a third wavelet decomposition coefficient according to the fusion weight value and a preset function processing, and use the third wavelet
  • the decomposition coefficient is subjected to image inverse processing to generate the fused image.
  • the merging unit is configured to: in the first frequency band, combine the first wavelet decomposition parameter and the second wavelet decomposition parameter by using a first functional relationship in combination with the fusion weight value to obtain a first frequency band a third wavelet decomposition; in the second frequency band, combining the first wavelet decomposition parameter and the second wavelet decomposition parameter by using a second functional relationship in combination with the fusion weight to obtain a third wavelet decomposition of the second frequency band; A functional relationship is different from the second functional relationship; wherein the first frequency band and the second frequency band are frequency bands of different sensitivity levels of the human eye.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the one or more image generation methods.
  • the computer storage medium may be a variety of storage media such as an optical disk, a mobile hard disk, a magnetic tape, or a random storage medium, and may be a non-transitory storage medium.
  • the embodiment further provides an image processing device, which may be a mobile terminal such as a mobile phone or a tablet computer, or a fixed terminal such as a desktop computer having an image processing function.
  • the image processing device includes: a memory for storing computer executable instructions;
  • a processor coupled to the memory, configured to execute the computer executable instructions, capable of the one or more image generation methods.
  • the processor can be coupled to the memory via an integrated circuit bus or the like for reading computer executable instructions within the memory.
  • the computer executable instructions in the embodiments of the present invention may be computer programs or the like written in various languages.
  • a mobile terminal including the aforementioned image generating apparatus is provided below.
  • a mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings.
  • suffixes such as “module”, “component” or “unit” for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, “module” and “component” can be used in combination.
  • the mobile terminal can be implemented in various forms.
  • the terminals described in the present invention may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), navigation devices, and the like.
  • Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • PDAs personal digital assistants
  • PADs tablet computers
  • PMPs portable multimedia players
  • Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like.
  • the terminal is a mobile terminal.
  • configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • FIG. 5 is a schematic diagram showing the hardware structure of a mobile terminal 100 that implements various embodiments of the present invention.
  • the mobile terminal 100 may include a wireless communication unit 110, an audio/video (A/V) input unit 120, and a user input unit 130.
  • Figure 5 illustrates a mobile terminal 100 having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal 100 will be described in detail below.
  • Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network.
  • the wireless communication unit 110 can include At least one of the broadcast receiving module 111, the mobile communication module 112, the wireless internet module 113, the short-range communication module 114, and the location information module 115 is included.
  • the broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel.
  • the broadcast channel can include a satellite channel and/or a terrestrial channel.
  • the broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal.
  • the broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like.
  • the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal.
  • the broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112.
  • the broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like.
  • the broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems.
  • the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H)
  • MediaFLO forward link media
  • the digital broadcasting system of the @ ) data broadcasting system, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives digital broadcasting.
  • the broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system.
  • the broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of
  • the mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server.
  • a base station e.g., an access point, a Node B, etc.
  • Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.
  • the wireless internet module 113 supports wireless internet access of the mobile terminal 100.
  • the wireless internet module 113 can be internally or externally coupled to the terminal. Included in the wireless internet module 113 Wireless Internet access technologies may include wireless local area network (WLAN), wireless compatibility authentication (Wi-Fi), wireless broadband (Wibro), global microwave interconnection access (Wimax), high speed downlink packet access (HSDPA), etc. Wait.
  • WLAN wireless local area network
  • Wi-Fi wireless compatibility authentication
  • Wibro wireless broadband
  • Wimax global microwave interconnection access
  • HSDPA high speed downlink packet access
  • the short range communication module 114 is a module for supporting short range communication.
  • Some examples of short-range communication technology include Bluetooth TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. TM.
  • the location information module 115 is a module for checking or acquiring location information of the mobile terminal 100.
  • a typical example of the location information module 115 is a Global Positioning System (GPS) module.
  • GPS Global Positioning System
  • the GPS module calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude.
  • the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module can calculate the speed information by continuously calculating the current position information in real time.
  • the A/V input unit 120 is for receiving an audio or video signal.
  • the A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode.
  • the processed image frame can be displayed on the display unit 151.
  • the image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal 100.
  • the microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data.
  • the processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode.
  • the microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.
  • the user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal 100.
  • the user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc.
  • a touch screen can be formed.
  • the sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal.
  • the sensing unit 140 can sense whether the slide type phone is turned on or off.
  • the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.
  • the interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100.
  • the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port (a typical example is a universal serial bus USB port), for connection having The port of the device that identifies the module, the audio input/output (I/O) port, the video I/O port, the headphone port, and so on.
  • the identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like.
  • the device having the identification module (hereinafter referred to as "identification device”) may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device.
  • the interface unit 170 can be configured to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal 100 and externally Data is transferred between devices.
  • input eg, data information, power, etc.
  • the interface unit 170 can be used as a A path through which power is supplied from the cradle to the mobile terminal 100 or may be used as a path through which various command signals input from the cradle are transmitted to the mobile terminal 100.
  • Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal 100 is accurately mounted on the base.
  • Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner.
  • the output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
  • the display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.
  • UI user interface
  • GUI graphical user interface
  • the display unit 151 can function as an input device and an output device.
  • the display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • OLED organic light emitting diode
  • a flexible display a three-dimensional (3D) display, and the like.
  • 3D three-dimensional
  • Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like.
  • TOLED Transparent Organic Light Emitting Diode
  • the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) ).
  • the touch screen can be used to detect touch input pressure as well as touch input position and touch input area.
  • the audio output module 152 can be wireless when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like.
  • the audio data received by the letter unit 110 or stored in the memory 160 converts the audio signal and outputs it as sound.
  • the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100.
  • the audio output module 152 can include a speaker, a buzzer, and the like.
  • the alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.
  • the memory 160 may store a software program or the like that performs processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, and the like) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.
  • the memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like.
  • the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
  • the controller 180 typically controls the overall operation of the mobile terminal 100.
  • the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like.
  • control The coder 180 may include a multimedia module 181 for reproducing or playing back multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be configured to be separate from the controller 180.
  • the controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
  • the power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.
  • the various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof.
  • the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle.
  • implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation.
  • the software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by
  • the mobile terminal 100 has been described in terms of its function.
  • the slide type mobile terminal 100 in various types of mobile terminals 100 such as a folding type, a bar type, a swing type, a slide type mobile terminal 100, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal 100, and is not limited to the slide type mobile terminal 100.
  • the mobile terminal 100 as shown in FIG. 5 can be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system in which the mobile terminal 100 according to the present invention can operate will now be described with reference to FIG.
  • Such communication systems may use different air interfaces and/or physical layers.
  • the air interfaces used by the system include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), Global Mobile. Communication system (GSM) and so on.
  • FDMA Frequency Division Multiple Access
  • TDMA Time Division Multiple Access
  • CDMA Code Division Multiple Access
  • UMTS Universal Mobile Telecommunications System
  • LTE Long Term Evolution
  • GSM Global Mobile. Communication system
  • the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
  • the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280.
  • the MSC 280 is configured to interface with a public switched telephone network (PSTN) 290.
  • PSTN public switched telephone network
  • the MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line.
  • the backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in Figure 6 can include multiple BSCs 2750.
  • Each BS 270 can serve one or more partitions (or regions), with each partition covered by a multi-directional antenna or an antenna pointing in a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).
  • BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology.
  • BTS Base Transceiver Subsystem
  • the term "base station” can be used to generally mean a single BSC 275 and at least one BS 270.
  • a base station can also be referred to as a "cell station.”
  • each partition of a particular BS 270 may be referred to as multiple cellular stations.
  • a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system.
  • a broadcast receiving module 111 as shown in FIG. 5 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295.
  • several satellites 300 are shown, for example, a Global Positioning System (GPS) satellite 300 can be employed.
  • GPS Global Positioning System
  • the satellite 300 helps locate at least one of the plurality of mobile terminals 100.
  • a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites.
  • the GPS module 115 as shown in Figure 5 is typically configured to cooperate with the satellite 300 to obtain the desired positioning information. Instead of GPS tracking techniques or in addition to GPS tracking techniques, other techniques that can track the location of the mobile terminal 100 can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.
  • BS 270 receives reverse link signals from various mobile terminals 100.
  • Mobile terminal 100 typically participates in calls, messaging, and other types of communications.
  • Each reverse link signal received by a particular base station 270 is processed within a particular BS 270.
  • the obtained data is forwarded to the relevant BSC 275.
  • the BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270.
  • the BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290.
  • PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.
  • the mobile communication module 112 of the wireless communication unit 110 in the mobile terminal accesses the mobile based on necessary data (including user identification information and authentication information) of the mobile communication network (such as 2G/3G/4G mobile communication network) built in the mobile terminal.
  • the communication network transmits mobile communication data (including uplink mobile communication data and downlink mobile communication data) for services such as web browsing and network multimedia playback of the mobile terminal user.
  • the wireless internet module 113 of the wireless communication unit 110 implements a function of a wireless hotspot by operating a related protocol function of a wireless hotspot, and the wireless hotspot supports access of a plurality of mobile terminals (any mobile terminal other than the mobile terminal) by multiplexing the mobile communication module.
  • the mobile communication connection between the mobile communication network and the mobile communication network transmits mobile communication data (including uplink mobile communication data and downlink mobile communication data) for the mobile terminal user's web browsing, network multimedia playback, etc., since the mobile terminal is substantially complex
  • the mobile communication data is transmitted by the mobile communication connection between the mobile terminal and the communication network, so the traffic of the mobile communication data consumed by the mobile terminal is calculated by the communication network side.
  • the fee entity counts the communication fee of the mobile terminal, thereby consuming the data traffic of the mobile communication data included in the communication tariff used by the mobile terminal for contracting.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the above integration
  • the unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the image generation solution provided by the embodiments of the present invention can be applied to various electronic devices such as mobile terminals.
  • the cameras of the devices cannot provide high-image acquisition images, the images of the high image quality can be provided through the fusion of multiple images. Therefore, the final output image is characterized by high definition, rich image information, and low distortion, which has an active effect in the industry.
  • the image generation scheme provided by the embodiment can be portable by computer executable instructions such as a computer program, and the device can be easily realized by running the instructions, thereby having strong industrial achievability;
  • the image generation scheme provided by the example has strong industrial applicability.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

一种图像生成装置及方法,装置包括:解析单元,用于解析包括同一采集对象的K张图像,得到第一图像信息值;K为不小于2的整数;确定单元,用于基于第一图像信息值,确定各图像中各像素所在区域的区域对比度及区域梯度值;第一获取单元,用于将区域对比度与区域梯度值相乘,获取各像素的融合参数;计算单元,用于基于融合参数,计算K张图像中各像素的融合权值;第二获取单元,用于基于融合权值及K张图像对应像素的第一图像信息值,获得第二图像信息值;生成单元,用于根据第二图像值,生成K张图像的融合图像。还提供了一种图像处理设备及计算机存储介质。

Description

图像生成装置及方法、图像处理设备及存储介质
本申请基于申请号为201610750445.0及201610753013.5的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本发明涉及信息技术领域,尤其涉及一种图像生成装置及方法、图像处理设备及存储介质。
背景技术
随着信息技术的发展,人们对采集的图像质量要求越来越高。有时候,不管如何调整图像采集参数,采集出的图像还是因为硬件结构的限制、采集环境的限制,无法获得高质量的图像。
发明内容
有鉴于此,本发明实施例期望提供一种图像生成装置及方法、图像处理设备及存储介质,可利用图像融合的方法,获得高质量的图像。
为达到上述目的,本发明的技术方案是这样实现的:
本发明实施例第一方面提供一种图像生成装置,包括:
解析单元,配置为解析包括同一采集对象的K张图像,得到第一图像信息值;所述K为小于2的整数;
确定单元,配置为基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值;
第一获取单元,配置为将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数;
计算单元,配置为基于所述融合参数,计算所述K张图像中各像素的融合权值;
第二获取单元,配置为基于所述融合权值及所述K张图像对应像素的第一图像信息值,获得所述第二图像信息值;
生成单元,配置为根据所述第二图像值,生成所述K张图像的融合图像。
本发明实施例第二方面提供一种图像生成方法,包括:
解析包括同一采集对象的K张图像,得到第一图像信息值;所述K为小于2的整数;
基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值;
将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数;
基于所述融合参数,计算所述K张图像中各像素的融合权值;
基于所述融合权值及所述K张图像对应像素的第一图像信息值,获得所述第二图像信息值;
根据所述第二图像信息值,生成所述K张图像的融合图像。
本发明实施例第三方面提供另一种图像生成方法,包括:
获取同一采集对象的黑白图像和彩色图像;
分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
结合所述黑白图像信息和所述彩色图像信息,确定所述黑白图像和所述彩色图像的融合权值;
根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
本发明实施例提供另一种图像生成装置,包括:
第三获取单元,配置为获取同一采集对象的黑白图像和彩色图像;
第四获取单元,配置为分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
权值确定单元,配置为于结合所述黑白图像信息和所述彩色图像信息,确定所述黑白图像和所述彩色图像的融合权值;
融合单元,配置为根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
本发明实施例还提供一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于实现前述一个或多个图像生成方法。
本发明实施例提供的一种图像处理设备,包括:
存储器,用于存储计算机可执行指令;
处理器,与所述存储器连接,配置为执行所述计算机可执行指令,能够实现前述一个或多个图像生成方法。
本发明实施例提供的图像生成装置及方法、图像处理设备及计算机存储介质,利用多张图像的解析,得到图像信息值,再利用图像信息值的处理得到融合权值,将多张图像进行融合,从而将得到可以包含多张图像优点的融合图像,这样得到的融合图像可以满足用户需要的高清晰度、图像信息丰富、色彩饱和度高及失真小的高画质要求。
附图说明
图1为本发明实施例提供的一种图像生成方法的流程示意图;
图2a为本发明实施例提供的一幅原始图像的示意图;
图2b为图2a所示原始图像的1次小波分解示意图;
图2c为图2a所示原始图像的2次小波分解示意图;
图2d为图2a所示原始图像的3次小波分解示意图;
图3为本发明实施例提供的另一种图像生成方法的流程示意图;
图4为本发明实施例提供的一种图像生成装置的结构示意图;
图5为本发明实施例提供的一种移动终端的结构示意图;
图6为本发明实施例提供的一种通信系统的结构示意图;
图7a为黑白图像的效果示意图;
图7b为图7a对应的彩色图像的效果示意图;
图8为图7a和图7b所示图像的融合效果示意图;
图9为黑白图像和彩色图像融合之后的融合图像的效果示意图。
具体实施方式
以下结合说明书附图及具体实施例对本发明的技术方案做进一步的详细阐述。
如图1所示,本实施例提供一种图像生成方法,包括:
步骤S110:解析包括同一采集对象的K张图像,得到第一图像信息值;所述K为小于2的整数;
步骤S120:基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值;
步骤S130:将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数;
步骤S140:基于所述融合参数,计算所述K张图像中各像素的融合权值;
步骤S150:基于所述融合权值及所述K张图像对应像素的第一图像信息值,获取第二图像信息值;
步骤S160:根据所述第二图像信息值,生成所述K张图像的融合图像。
本实施例提供了一种图像生成方法,利用多张拍摄了同一采集对象的 多张图像进行图像解析,得到第一图像信息。这里的第一图像信息可包括亮度信息、色彩信息等各种信息值。
例如,在步骤S110中可以通过解析各所述图像得到以下第一图像信息值;
亮度信息(Y通道)和色彩(UV通道)清晰分离出来,这样可以单独处理亮度和色彩信息。RGB与YUV图像的转换公式如下:
Y=0.299*R+0.587*G+0.114*B
U=-0.147*R-0.289*G+0.436*B=0.492*(B-Y)
V=0.615*R-0.515*G-0.100*B=0.877*(R-Y)
所述R表示红色的色彩值,所述B表示蓝色的色彩值;所述G表示绿色的色彩值。
在本实施例中可以对上述各张图像进行小波分解。得到小波分解系数;该小波分解系数可称为第一小波分解系数,为所述第一图像信息值的组成部分。利用第一小波分解系数,可以的得到生成融合图像的第二小波分解系数,最后可以利用第二小波分解系数通过图像逆变换得到融合图像。小波分解是将从图像中提取不同维度的图像信息,例如,亮度信息和色彩信息;亮度信息和色彩信息的具体值可以用小波分解系数来表示。小波分解的固有特性在分解过程中没有信息损失和冗余信息;能够把图像分解成平均图像和细节图像的组合,分别代表了图像的不同结构,因此容易提取原始图像的结构信息和细节信息。此外小波分解还具有快速算法,且通常二维小波分解可提供了与人类视觉系统方向相吻合的选择性图像。
图2a为原始图像;图2b为1次小波分解图像;图2c为在1次小波分解图像再次小波分解得到的2次小波分解图像;图2d为在2次小波分解图像上再次分解得到的3次小波分解图像。
当然在具体实现时,对图像进行处理不限于小波分解,还可以直接通过亮度提取、色彩提取的其他方式,获取所述第一图像信息值,例如,获 取各个像素的亮度值、色彩值以及灰度值等信图像信息值。
在步骤S120中将基于第一图像信息值,计算出区域对比度和区域梯度值。例如,在步骤S120中将基于小波分解得到能够表征不同图像中图像信息的小波分解系数,计算各个图像区域对比度和区域梯度值。
在本实施例中像素A所在区域可为以像素A为中心向外两个垂直方向分别延伸N和M,得到一个包括N*M个像素的区域A;区域A即为所述像素A所在的区域。
在本实施例中将利用各种算法得到所述区域对比度和区域梯度值。这里的区域梯度值为该区域内各个像素的灰度值之间的梯度。
在步骤S130中将计算区域对比度和区域梯度值的乘积,得到融合参数。
由于是多张图像进行融合,在本实施例中会以融合参数为因变量,计算得到每一张图像在多张图像时,各个像素对应的融合权值。
再基于融合权值及各种图像中的第一图像信息值(例如第一小波分解系数),得到融合图像的第二图像信息值(例如第二小波分解系数);根据融合图像的第二图像信息值(例如,第二小波分解系数),进行图形逆变换,最终将得到融合图像。
在本实施例中可以进行多张图像的逐像素融合,例如,通过小波分解提取每一张图像中每一个像素的小波分解系数,再通过执行上述步骤S120至步骤S160可以实现逐像素融合。
由于融合图像是提取了多张图像中的图像信息生成的,将保留多张图像的至少部分图像信息或图像特点,故可得到一张高画面质量的融合图像。这里的高画面质量可包括高清晰度,图像失真小等。所述K张图像可为同一采集对象的不同类型图像。例如,所述K张图像可包括黑白图像、彩色图像以及红外图像等。这样的话,可以结合融合图像将结合不同图像的图像优点,形成一张具有多种优点的高画质的图像;且本实施例提供的方法, 具有实现简便的特点。
在一些实施例中,所述步骤S120可包括:
利用如下公式计算所述区域对比度;
Figure PCTCN2017092539-appb-000001
Figure PCTCN2017092539-appb-000002
所述i,j为像素p的坐标;所述CLi,j为像素p所在区域的区域对比度;所述p(i,j)为像素p的第一图像信息值;所述m(i,j)为所述像素p所在区域的各像素的第一图像信息值的平均值;所述N为所述像素p所在区域的第一维度上的像素个数;所述M为所述像素p所在区域的第二维度上的像素个数;所述第一维度垂直于所述第二维度。
所述N*M为所述像素p所在区域的总像素个数,通常所述p为该像素所在区域的中心像素。
在本实施例中,利用上述公式可以简便的计算出所述区域对比度。
进一步地,所述步骤S120还可包括:
利用如下公式计算所述区域梯度值;
Figure PCTCN2017092539-appb-000003
Figure PCTCN2017092539-appb-000004
所述i,j为像素p的坐标;所述I为第I图像中所述像素p所在区域的图像信息矩阵;所述图像信息矩阵由所述像素p所在区域内各像素的第一图像信息值组成;
所述
Figure PCTCN2017092539-appb-000005
为所述像素p所在区域在x方向上的梯度值;所述
Figure PCTCN2017092539-appb-000006
为所述像素p所在区域在y方向上的梯度值;所述GLi,j为所述像素p所在区域的区域梯度值;所述A1为第一卷积算子;所述A2为第二卷积算子。
例如所述A1和A2都为进行卷积运算的算子,都对应的是矩阵。所述卷积算子的矩阵大小决定关于卷积运算的横纵坐标的维度。以下提供另种3*3的卷积算子。
所述
Figure PCTCN2017092539-appb-000007
所述
Figure PCTCN2017092539-appb-000008
在本实施例中所述卷积算子还可为5.5或7.7的。值得注意的是,通常在做卷积运算时,所述I为与所述卷积算子同行列数矩阵。例如,所述卷积算子为3.*3的矩阵,则所述I也为3*3的矩阵。
在一些实施例中,所述步骤S140可包括:
利用如下公式计算所述融合权值;
Figure PCTCN2017092539-appb-000009
所述WM(i,j,s)为第s张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述WM(i,j,k)为第k张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述W(i,j,s)第s张图像中坐标为(i,j)的像素的融合权值。
所述
Figure PCTCN2017092539-appb-000010
为各张图像中坐标为(i,j)的像素的融合参数的和;所述W(i,j,s)即为每一张图像中坐标为(i,j)的像素在上述和中所占的比值,即为所述融合权值。
显然利用上述方法计算融合权值,具有实现简便的特点。在具体的实现过程中,可以根据图像融合特点,例如,想突出体现某一张图像的图像特点,还可以引入调整因子,该图像的调整因子大于其他图像的调整因子,该调整因子可为加法因子或乘法因子。所述加法因子引入a之后,可以利 用如下公式计算全融合权重:
Figure PCTCN2017092539-appb-000011
Figure PCTCN2017092539-appb-000012
乘法因子b引入之后,可以利用如下公式计算融合权重。
Figure PCTCN2017092539-appb-000013
总之,计算所述融合权值的方法不止一个。
在一些实施例中,
所述步骤S160可包括:
利用如下公式计算所述第二图像信息值,例如第二小波分解系数;
Figure PCTCN2017092539-appb-000014
所述F(i,j)为坐标为(i,j)的像素的第二小波分解系数;所述kwavek(i,j)为图像k中坐标为(i,j)的像素的第一小波分解系数;所述W(i,j,k)为图像k中坐标为(i,j)的像素的所述融合权值。
但是在具体的实现过程中,确定所述第二图像信息值的公式不限于上述公式。当所述第一图像信息值为第一小波分解系数时,所述第二图像信息值可为第二小波分解系数。人眼实质上对不同波长的光是有不同的敏感度的,故通过小波分解之后,一方面为了计算简便,在人眼敏感度低的频段可以适当的采用较为简单的公式(即函数关系)进行处理,即便丢失部分图像信息人眼无法察觉,以减少计算和存储资源;另一方需要在人眼比较敏感的频段,尽可能的保留更多的图像信息,可能会采用较为复杂的函数关系,以获得更好的效果。
故在具体的实现过程中,所述步骤S150可包括:
获取不同频段的函数关系;
在不同频段利用不同的函数关系,对所述第一图像信息值进行处理获 得不同频段的第二图像信息值。
但是在具体的实现过程中,确定所述第二图像信息值的公式不限于上述公式。
每一个小波分解系数都有其对应的频率,故首先将确定这些小波分解系数所在的频段,确定函数关系,并最终计算所述第二小波分解系数。这样的话,一方面可以保持较好的图像效果,另一方面尽可能的简化计算。所述不同的函数关系,可认为不同的融合规则。图3所示,为利用本实施例提供的图像生成方法,进行不同频段采用不同融合规则进行图像融合的流程示意图。
源图像A和源图像B可为前述K张图像中的任意两张,分别进行小波分解,分别获得高频子带系数和低频子带系数。这里的高频子带系数和低频子带系数都是前面的小波分解系数。然后两个源图像的将高频子带系数利用高频融合规则,及高频融合权值得到融合图像的高频子带系数;将两个源图像的低频子带利用低频子带规则及低频融合权值融合得到低频子带系数。然后通过逆变化最终得到融合图像。这里的高频子带可为频率大于某一个频率阈值的频率,低频子带可为频率低于频率阈值的频率。这里的高频融合权值和低频融合权值均为前述融合权值的一种。
在得到所述第二图像信息值之后,可以利用如下公式进行图像你转换,从而得到融合图像。其中,所述第二图像信息可包括Y、V及U等信息。
R=Y+1.140*V
G=Y-0.394*U-0.581*V
B=Y+2.032*U
得到了融合图像各个像素R、G及B值以后,显然就等于得到融合图像。
以下结合前述任意所述图像生成方法的技术方案,提供一个融合黑白图像和彩色图像生成融合图像的方法,包括:
S100:获取彩色图像和黑白图像,并预处理。
S200:将彩色图像和黑白图像分别进行小波分解,得到对应于所述第一图像信息值的第一小波分解系数
S300:计算低频融合权值数以及高频融合权值。
S400:根据融合权值对彩色图像和黑白图像进行融合,获取融合图像。
在步骤S100中,由于黑白图像只有亮度信息,没有彩色信息,黑白与彩色图像融合是,需要对亮度信息进行融合,融合图像的色彩全部来源于彩色图像,因此需要将彩色RGB图像转换为YUV图像,YUV格式将图像的亮度信息(Y通道)和色彩(UV通道)清晰分离出来,这样可以单独处理亮度和色彩信息。
利用前述实施例计算出融合权值,将黑白图像和彩色图像进行融合,将得到具有同时兼具黑白图像高亮度、高对比,同时具有色彩的高画质的融合图像。
所述步骤S110可包括:
分别对同一采集对象的黑白图像和彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
所述步骤S120可包括:
基于所述黑白图像信息,确定所述黑白图像中各像素所在区域的区域对比度及区域梯度值,基于所述彩色图像信息,所述彩色图像中各像素所在区域的区域对比度及区域梯度值;
所述步骤S130可包括:
将所述区域对比度与所述区域梯度值相乘,分别获取所述黑白图像及所述彩色图像中各像素的融合参数;
所述步骤S140可包括:
基于所述融合参数,分别计算所述黑白图像和彩色图像各像素的融合 权值;
所述步骤S160可包括:
根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
在一些实施例中,所述步骤S110可包括:提取所述黑白图像的第一亮度信息;提取所述彩色图像的第二亮度信息及色彩信息;所述步骤S1460可包括:利用所述融合权值对所述第一亮度信息和所述第二亮度信息预设函数处理,得到融合图像的第三亮度信息;结合所述第三亮度信息及所述色彩信息,生成所述融合图像。
可选地,所述步骤S110还可包括:分别对所述黑白图像和所述彩色图像进行小波分解,获得所述黑白图像的亮度信息的第一小波分解系数,及所述彩色图像的亮度信息的第二小波分解系数;所述步骤S160还可包括:结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数;利用第三小波分解系数进行图像逆处理,生成所述融合图像。
可选地,所述步骤S160可包括:在第一频段,结合所述融合权值采用第一函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第一频段的第三小波分解;在第二频段,结合所述融合权值采用第二函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第二频段的第三小波分解;所述第一函数关系与所述第二函数关系不同;其中,所述第一频段和所述第二频段为人眼不同敏感程度的频段。
图7a为黑白图像的显示效果图,图7b为彩色图像对应的黑白效果图。通过观察可以发现,黑白图像在圆框区域内部的对比度较好,图像细节清晰,可以清楚的看清里面的英文单词,而彩色图像的细节则比较模糊,无法分辨红框里面的英文单词。融合图像就是需要保留场景中的清晰细节信 息。有鉴于此,如图8所示,小波分解之后,分别对高频子带和低频子带进行处理,需要将这些相对清晰的细节的系数保留下来。对黑白图像和彩色图像分别进行小波分解,分别获得高频子带系数和低频子带系数。这里的高频子带系数和低频子带系数都是前面的小波分解系数。然后两个源图像的将高频子带系数利用高频融合规则,及高频融合权值得到融合图像的高频子带系数;将两个源图像的低频子带利用低频子带规则及低频融合权值融合得到低频子带系数。然后通过逆变化最终得到融合图像。这里的高频子带可为频率大于某一个频率阈值的频率,低频子带可为频率低于频率阈值的频率。这里的高频融合权值和低频融合权值均为前述融合权值的一种。图9给出了黑白图像和彩色图像融合之后的融合图像的效果,显然相对于图7a和图7b的图像效果都好。
如图4所示,本实施例提供一种图像生成装置,包括:
解析单元310,配置为解析包括同一采集对象的K张图像,得到第一图像信息值;所述K为小于2的整数;
确定单元320,配置为基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值;
第一获取单元330,配置为将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数;
计算单元340,配置为基于所述融合参数,计算所述K张图像中各像素的融合权值;
第二获取单元350,配置为基于所述融合权值及所述K张图像对应像素的第一图像信息值,获得所述第二图像信息值;
生成单元360,配置为根据所述第二图像值,生成所述K张图像的融合图像。
本发明实施例提供的所述图像生成装置可为各种电子设备中的结构, 所述电子设备可包括手机、平板电脑、可穿戴式设备等各种移动终端,还可以是各种不能移动的固定终端。
在本实施例中解析单元310、确定单元320、第一获取单元330、计算单元340、第二获取单元350及生成单元360都可以对应于电子设备中的处理器或处理电路。所述处理器可包括中央处理器CPU、微处理器MCU、数字信号处理器DSP、可编程阵列PLC或应用处理器AP等。所述处理电路可包括专用集成电路ASIC。
所述处理器或处理电路可通过执行预定指令完成上述功能。所述计算单元340及确定单元320和第一获取单元330及第二获取单元350等还可以对应于计算器或具有计算功能的处理器等,可以通过一些列的函数计算得到各个单元所需的信息,例如是,所述区域对比度或区域梯度值等。
本实施例所述的图像生成装置可通过获取多张包括同一采集对象的多张图像,可以生成该采集对象图像质量更高的融合图像,以减少对采集硬件的要求,降低硬件成本并提升图像质量。
在一些实施例中,所述确定单元320,配置为利用如下公式计算所述区域对比度;
Figure PCTCN2017092539-appb-000015
Figure PCTCN2017092539-appb-000016
所述i,j为像素p的坐标;所述CLi,j为像素p所在区域的区域对比度;所述p(i,j)为像素p的第一图像信息值;所述m(i,j)为所述像素p所在区域的各像素的图像信息值的平均值;所述N为所述像素p所在区域的第一维度上的像素个数;所述M为所述像素p所在区域的第二维度上的像素个数;所述第一维度垂直于所述第二维度。
本实施例所述确定单元320可对应于计算器或具有计算功能的处理器, 通过上述计算,可以简便的得到所述区域对比度。
在一些实施例中,所述确定单元320,还配置为利用如下公式计算所述区域梯度值;
Figure PCTCN2017092539-appb-000017
Figure PCTCN2017092539-appb-000018
所述i,j为像素p的坐标;所述I为第I图像中所述像素p所在区域的第一图像信息值;所述
Figure PCTCN2017092539-appb-000019
为所述像素p所在区域在x方向上的梯度值;所述
Figure PCTCN2017092539-appb-000020
为所述像素p所在区域在y方向上的梯度值;所述GLi,j为所述像素p所在区域的区域梯度值;所述A1为第一卷积算子;所述A2为第二卷积算子。
本实施例所述确定单元320可对应于计算器或具有计算功能的处理器,通过上述计算,可以简便的得到所述区域梯度值。
在某些实施例中,所述计算单元340,配置为利用如下公式计算所述融合权值;
Figure PCTCN2017092539-appb-000021
所述WM(i,j,s)为第s张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述WM(i,j,k)为第k张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述W(i,j,s)第s张图像中坐标为(i,j)的像素的融合权值。
以上计算单元仅是提供了一种计算所述融合权值的方法,在具体实现时,还有其他的计算公式,例如,可以参见前述实施例的对应部分,再次就不在一一举例,
在一些实施例中,所述第二获取单元350,配置为利用如下公式计算所述第二图像信息值;
Figure PCTCN2017092539-appb-000022
所述F(i,j)为坐标为(i,j)的像素的第二图像信息值;所述kwavek(i,j)为图像k中坐标为(i,j)的像素的第一图像信息值;所述W(i,j,k)为图像k中坐标为(i,j)的像素的所述让那个和权值。
本实施例所述第二获取单元350利用上述公式(即函数关系)可以简便的根据多张图像对应像素的第一图像信息值,获得第二图像信息值,具有实现简便的特点,于此同时采用这种逐像素的融合方法,具有融合效果好的特点。
但是在具体的实现过程中,确定所述第二图像信息值的公式不限于上述公式。
可选地,所述解析单元310,用于分别对同一采集对象的黑白图像和彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;所述确定单元320,用于基于所述黑白图像信息,确定所述黑白图像中各像素所在区域的区域对比度及区域梯度值,基于所述彩色图像信息,所述彩色图像中各像素所在区域的区域对比度及区域梯度值;所述第一获取单元330,具体用于将所述区域对比度与所述区域梯度值相乘,分别获取所述黑白图像及所述彩色图像中各像素的融合参数;所述计算单元340,具体用于基于所述融合参数,分别计算所述黑白图像和彩色图像各像素的融合权值;所述生成单元360,具体用于根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
可选地,所述解析单元310,配置为提取所述黑白图像的第一亮度信息;提取所述彩色图像的第二亮度信息及色彩信息;所述生成单元360,配置为利用所述融合权值对所述第一亮度信息和所述第二亮度信息预设函数处理,得到融合图像的第三亮度信息;结合所述第三亮度信息及所述色彩信息,生成所述融合图像。
可选地,所述解析单元310,具体用于分别对所述黑白图像和所述彩色 图像进行小波分解,获得所述黑白图像的亮度信息的第一小波分解系数,及所述彩色图像的亮度信息的第二小波分解系数;所述生成单元360,具体用于结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数;利用第三小波分解系数进行图像逆处理,生成所述融合图像。
可选地,所述生成单元360,具体用于在第一频段,结合所述融合权值采用第一函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第一频段的第三小波分解;在第二频段,结合所述融合权值采用第二函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第二频段的第三小波分解;所述第一函数关系与所述第二函数关系不同;其中,所述第一频段和所述第二频段为人眼不同敏感程度的频段。
本发明实施例还提供另一种图像生成装置,包括:
第三获取单元,配置为获取同一采集对象的黑白图像和彩色图像;
第四获取单元,配置为分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
权值确定单元,配置为于结合所述黑白图像信息和所述彩色图像信息,确定所述黑白图像和所述彩色图像的融合权值;
融合单元,配置为根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
所述确定单元,具体用于基于所述黑白图像信息,确定所述黑白图像中各像素所在区域的区域对比度及区域梯度值,基于所述彩色图像信息,所述彩色图像中各像素所在区域的区域对比度及区域梯度值;将所述区域对比度与所述区域梯度值相乘,分别获取所述黑白图像及所述彩色图像中各像素的融合参数;基于所述融合参数,分别计算所述黑白图像和彩色图像各像素的融合权值。
可选地,所述第四获取单元,配置为提取所述黑白图像的第一亮度信息;提取所述彩色图像的第二亮度信息及色彩信息;
所述融合单元,配置为利用所述融合权值对所述第一亮度信息和所述第二亮度信息预设函数处理,得到融合图像的第三亮度信息;结合所述第三亮度信息及所述色彩信息,生成所述融合图像。
可选地,所述第四获取单元,配置为分别对所述黑白图像和所述彩色图像进行小波分解,获得所述黑白图像的亮度信息的第一小波分解系数,及所述彩色图像的亮度信息的第二小波分解系数;
所述融合单元,配置为结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数;利用第三小波分解系数进行图像逆处理,生成所述融合图像。
可选地,所述融合单元,配置为在第一频段,结合所述融合权值采用第一函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第一频段的第三小波分解;在第二频段,结合所述融合权值采用第二函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第二频段的第三小波分解;所述第一函数关系与所述第二函数关系不同;其中,所述第一频段和所述第二频段为人眼不同敏感程度的频段。
本发明实施例还提供一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于执行前述一个或多个图像生成方法。
所述计算机存储介质可为光盘、移动硬盘、磁带或随机存储介质等各种存储介质,可选为非瞬间存储介质。
本实施例还提供一种图像处理设备,可为手机、平板电脑等移动终端,还可以是具有图像处理功能的台式电脑等固定终端。所述图像处理设备包括:存储器,用于存储计算机可执行指令;
处理器,与所述存储器连接,配置为执行所述计算机可执行指令,能够前述一个或多个图像生成方法。
所述处理器可通过集成电路总线等与所述存储器连接,用于读取存储器内的计算机可执行指令。
本发明实施例中所述计算机可执行指令可为各种语言编写的计算机程序等。
以下提供一种包括前述图像生成装置的移动终端。现在将参考附图描述实现本发明各个实施例的移动终端。在后续的描述中,使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明,其本身并没有特定的意义。因此,“模块”与“部件”可以混合地使用。
移动终端可以以各种形式来实施。例如,本发明中描述的终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、个人数字助理(PDA)、平板电脑(PAD)、便携式多媒体播放器(PMP)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面,假设终端是移动终端。然而,本领域技术人员将理解的是,除了特别用于移动目的的元件之外,根据本发明的实施方式的构造也能够应用于固定类型的终端。
图5为实现本发明各个实施例的移动终端100的硬件结构示意,如图5所示,移动终端100可以包括无线通信单元110、音频/视频(A/V)输入单元120、用户输入单元130、感测单元140、输出单元150、存储器160、接口单元170、控制器180和电源单元190等等。图5示出了具有各种组件的移动终端100,但是应理解的是,并不要求实施所有示出的组件。可以替代地实施更多或更少的组件。将在下面详细描述移动终端100的元件。
无线通信单元110通常包括一个或多个组件,其允许移动终端100与无线通信系统或网络之间的无线电通信。例如,无线通信单元110可以包 括广播接收模块111、移动通信模块112、无线互联网模块113、短程通信模块114和位置信息模块115中的至少一个。
广播接收模块111经由广播信道从外部广播管理服务器接收广播信号和/或广播相关信息。广播信道可以包括卫星信道和/或地面信道。广播管理服务器可以是生成并发送广播信号和/或广播相关信息的服务器或者接收之前生成的广播信号和/或广播相关信息并且将其发送给终端的服务器。广播信号可以包括TV广播信号、无线电广播信号、数据广播信号等等。而且,广播信号可以进一步包括与TV或无线电广播信号组合的广播信号。广播相关信息也可以经由移动通信网络提供,并且在该情况下,广播相关信息可以由移动通信模块112来接收。广播信号可以以各种形式存在,例如,其可以以数字多媒体广播(DMB)的电子节目指南(EPG)、数字视频广播手持(DVB-H)的电子服务指南(ESG)等等的形式而存在。广播接收模块111可以通过使用各种类型的广播系统接收信号广播。特别地,广播接收模块111可以通过使用诸如多媒体广播-地面(DMB-T)、数字多媒体广播-卫星(DMB-S)、数字视频广播-手持(DVB-H),前向链路媒体(MediaFLO@)的数据广播系统、地面数字广播综合服务(ISDB-T)等等的数字广播系统接收数字广播。广播接收模块111可以被构造为适合提供广播信号的各种广播系统以及上述数字广播系统。经由广播接收模块111接收的广播信号和/或广播相关信息可以存储在存储器160(或者其它类型的存储介质)中。
移动通信模块112将无线电信号发送到基站(例如,接入点、节点B等等)、外部终端以及服务器中的至少一个和/或从其接收无线电信号。这样的无线电信号可以包括语音通话信号、视频通话信号、或者根据文本和/或多媒体消息发送和/或接收的各种类型的数据。
无线互联网模块113支持移动终端100的无线互联网接入。无线互联网模块113可以内部或外部地耦接到终端。无线互联网模块113所涉及的 无线互联网接入技术可以包括无线局域网(WLAN)、无线相容性认证(Wi-Fi)、无线宽带(Wibro)、全球微波互联接入(Wimax)、高速下行链路分组接入(HSDPA)等等。
短程通信模块114是用于支持短程通信的模块。短程通信技术的一些示例包括蓝牙TM、射频识别(RFID)、红外数据协会(IrDA)、超宽带(UWB)、紫蜂TM等等。
位置信息模块115是用于检查或获取移动终端100的位置信息的模块。位置信息模块115的典型示例是全球定位系统(GPS)模块。根据当前的技术,GPS模块计算来自三个或更多卫星的距离信息和准确的时间信息并且对于计算的信息应用三角测量法,从而根据经度、纬度和高度准确地计算三维当前位置信息。当前,用于计算位置和时间信息的方法使用三颗卫星并且通过使用另外的一颗卫星校正计算出的位置和时间信息的误差。此外,GPS模块能够通过实时地连续计算当前位置信息来计算速度信息。
A/V输入单元120用于接收音频或视频信号。A/V输入单元120可以包括相机121和麦克风122,相机121对在视频捕获模式或图像捕获模式中由图像捕获装置获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元151上。经相机121处理后的图像帧可以存储在存储器160(或其它存储介质)中或者经由无线通信单元110进行发送,可以根据移动终端100的构造提供两个或更多相机121。麦克风122可以在电话通话模式、记录模式、语音识别模式等等运行模式中经由麦克风接收声音(音频数据),并且能够将这样的声音处理为音频数据。处理后的音频(语音)数据可以在电话通话模式的情况下转换为可经由移动通信模块112发送到移动通信基站的格式输出。麦克风122可以实施各种类型的噪声消除(或抑制)算法以消除(或抑制)在接收和发送音频信号的过程中产生的噪声或者干扰。
用户输入单元130可以根据用户输入的命令生成键输入数据以控制移动终端100的各种操作。用户输入单元130允许用户输入各种类型的信息,并且可以包括键盘、锅仔片、触摸板(例如,检测由于被接触而导致的电阻、压力、电容等等的变化的触敏组件)、滚轮、摇杆等等。特别地,当触摸板以层的形式叠加在显示单元151上时,可以形成触摸屏。
感测单元140检测移动终端100的当前状态,(例如,移动终端100的打开或关闭状态)、移动终端100的位置、用户对于移动终端100的接触(即,触摸输入)的有无、移动终端100的取向、移动终端100的加速或减速移动和方向等等,并且生成用于控制移动终端100的操作的命令或信号。例如,当移动终端100实施为滑动型移动电话时,感测单元140可以感测该滑动型电话是打开还是关闭。另外,感测单元140能够检测电源单元190是否提供电力或者接口单元170是否与外部装置耦接。
接口单元170用作至少一个外部装置与移动终端100连接可以通过的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口(典型示例是通用串行总线USB端口)、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。识别模块可以是存储用于验证用户使用移动终端100的各种信息并且可以包括用户识别模块(UIM)、客户识别模块(SIM)、通用客户识别模块(USIM)等等。另外,具有识别模块的装置(下面称为“识别装置”)可以采取智能卡的形式,因此,识别装置可以经由端口或其它连接装置与移动终端100连接。
接口单元170可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到移动终端100内的一个或多个元件或者可以用于在移动终端100和外部装置之间传输数据。
另外,当移动终端100与外部底座连接时,接口单元170可以用作允 许通过其将电力从底座提供到移动终端100的路径或者可以用作允许从底座输入的各种命令信号通过其传输到移动终端100的路径。从底座输入的各种命令信号或电力可以用作用于识别移动终端100是否准确地安装在底座上的信号。
输出单元150被构造为以视觉、音频和/或触觉方式提供输出信号(例如,音频信号、视频信号、警报信号、振动信号等等)。输出单元150可以包括显示单元151、音频输出模块152、警报单元153等等。
显示单元151可以显示在移动终端100中处理的信息。例如,当移动终端100处于电话通话模式时,显示单元151可以显示与通话或其它通信(例如,文本消息收发、多媒体文件下载等等)相关的用户界面(UI)或图形用户界面(GUI)。当移动终端100处于视频通话模式或者图像捕获模式时,显示单元151可以显示捕获的图像和/或接收的图像、示出视频或图像以及相关功能的UI或GUI等等。
同时,当显示单元151和触摸板以层的形式彼此叠加以形成触摸屏时,显示单元151可以用作输入装置和输出装置。显示单元151可以包括液晶显示器(LCD)、薄膜晶体管LCD(TFT-LCD)、有机发光二极管(OLED)显示器、柔性显示器、三维(3D)显示器等等中的至少一种。这些显示器中的一些可以被构造为透明状以允许用户从外部观看,这可以称为透明显示器,典型的透明显示器可以例如为TOLED(透明有机发光二极管)显示器等等。根据特定想要的实施方式,移动终端100可以包括两个或更多显示单元(或其它显示装置),例如,移动终端100可以包括外部显示单元(未示出)和内部显示单元(未示出)。触摸屏可用于检测触摸输入压力以及触摸输入位置和触摸输入面积。
音频输出模块152可以在移动终端100处于呼叫信号接收模式、通话模式、记录模式、语音识别模式、广播接收模式等等模式下时,将无线通 信单元110接收的或者在存储器160中存储的音频数据转换音频信号并且输出为声音。而且,音频输出模块152可以提供与移动终端100执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出模块152可以包括扬声器、蜂鸣器等等。
警报单元153可以提供输出以将事件的发生通知给移动终端100。典型的事件可以包括呼叫接收、消息接收、键信号输入、触摸输入等等。除了音频或视频输出之外,警报单元153可以以不同的方式提供输出以通知事件的发生。例如,警报单元153可以以振动的形式提供输出,当接收到呼叫、消息或一些其它进入通信(incoming communication)时,警报单元153可以提供触觉输出(即,振动)以将其通知给用户。通过提供这样的触觉输出,即使在用户的移动电话处于用户的口袋中时,用户也能够识别出各种事件的发生。警报单元153也可以经由显示单元151或音频输出模块152提供通知事件的发生的输出。
存储器160可以存储由控制器180执行的处理和控制操作的软件程序等等,或者可以暂时地存储已经输出或将要输出的数据(例如,电话簿、消息、静态图像、视频等等)。而且,存储器160可以存储关于当触摸施加到触摸屏时输出的各种方式的振动和音频信号的数据。
存储器160可以包括至少一种类型的存储介质,所述存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等等。而且,移动终端100可以与通过网络连接执行存储器160的存储功能的网络存储装置协作。
控制器180通常控制移动终端100的总体操作。例如,控制器180执行与语音通话、数据通信、视频通话等等相关的控制和处理。另外,控制 器180可以包括用于再现或回放多媒体数据的多媒体模块181,多媒体模块181可以构造在控制器180内,或者可以构造为与控制器180分离。控制器180可以执行模式识别处理,以将在触摸屏上执行的手写输入或者图片绘制输入识别为字符或图像。
电源单元190在控制器180的控制下接收外部电力或内部电力并且提供操作各元件和组件所需的适当的电力。
这里描述的各种实施方式可以以使用例如计算机软件、硬件或其任何组合的计算机可读介质来实施。对于硬件实施,这里描述的实施方式可以通过使用特定用途集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理装置(DSPD)、可编程逻辑装置(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、被设计为执行这里描述的功能的电子单元中的至少一种来实施,在一些情况下,这样的实施方式可以在控制器180中实施。对于软件实施,诸如过程或功能的实施方式可以与允许执行至少一种功能或操作的单独的软件模块来实施。软件代码可以由以任何适当的编程语言编写的软件应用程序(或程序)来实施,软件代码可以存储在存储器160中并且由控制器180执行。
至此,已经按照其功能描述了移动终端100。下面,为了简要起见,将描述诸如折叠型、直板型、摆动型、滑动型移动终端100等等的各种类型的移动终端100中的滑动型移动终端100作为示例。因此,本发明能够应用于任何类型的移动终端100,并且不限于滑动型移动终端100。
如图5中所示的移动终端100可以被构造为利用经由帧或分组发送数据的诸如有线和无线通信系统以及基于卫星的通信系统来操作。
现在将参考图6描述其中根据本发明的移动终端100能够操作的通信系统。
这样的通信系统可以使用不同的空中接口和/或物理层。例如,由通信 系统使用的空中接口包括例如频分多址(FDMA)、时分多址(TDMA)、码分多址(CDMA)和通用移动通信系统(UMTS)(特别地,长期演进(LTE))、全球移动通信系统(GSM)等等。作为非限制性示例,下面的描述涉及CDMA通信系统,但是这样的教导同样适用于其它类型的系统。
参考图6,CDMA无线通信系统可以包括多个移动终端100、多个基站(BS)270、基站控制器(BSC)275和移动交换中心(MSC)280。MSC 280被构造为与公共电话交换网络(PSTN)290形成接口。MSC 280还被构造为与可以经由回程线路耦接到基站270的BSC 275形成接口。回程线路可以根据若干己知的接口中的任一种来构造,所述接口包括例如E1/T1、ATM、IP、PPP、帧中继、HDSL、ADSL或xDSL。将理解的是,如图6中所示的系统可以包括多个BSC 2750。
每个BS 270可以服务一个或多个分区(或区域),由多向天线或指向特定方向的天线覆盖的每个分区放射状地远离BS 270。或者,每个分区可以由用于分集接收的两个或更多天线覆盖。每个BS 270可以被构造为支持多个频率分配,并且每个频率分配具有特定频谱(例如,1.25MHz,5MHz等等)。
分区与频率分配的交叉可以被称为CDMA信道。BS 270也可以被称为基站收发器子系统(BTS)或者其它等效术语。在这样的情况下,术语“基站”可以用于笼统地表示单个BSC 275和至少一个BS 270。基站也可以被称为“蜂窝站”。或者,特定BS 270的各分区可以被称为多个蜂窝站。
如图6中所示,广播发射器(BT)295将广播信号发送给在系统内操作的移动终端100。如图5中所示的广播接收模块111被设置在移动终端100处以接收由BT295发送的广播信号。在图6中,示出了几个卫星300,例如可以采用全球定位系统(GPS)卫星300。卫星300帮助定位多个移动终端100中的至少一个。
在图6中,描绘了多个卫星300,但是理解的是,可以利用任何数目的卫星获得有用的定位信息。如图5中所示的GPS模块115通常被构造为与卫星300配合以获得想要的定位信息。替代GPS跟踪技术或者在GPS跟踪技术之外,可以使用可以跟踪移动终端100的位置的其它技术。另外,至少一个GPS卫星300可以选择性地或者额外地处理卫星DMB传输。
作为无线通信系统的一个典型操作,BS 270接收来自各种移动终端100的反向链路信号。移动终端100通常参与通话、消息收发和其它类型的通信。特定基站270接收的每个反向链路信号被在特定BS 270内进行处理。获得的数据被转发给相关的BSC 275。BSC提供通话资源分配和包括BS 270之间的软切换过程的协调的移动管理功能。BSC275还将接收到的数据路由到MSC 280,其提供用于与PSTN 290形成接口的额外的路由服务。类似地,PSTN 290与MSC 280形成接口,MSC与BSC 275形成接口,并且BSC 275相应地控制BS 270以将正向链路信号发送到移动终端100。
移动终端中无线通信单元110的移动通信模块112基于移动终端内置的接入移动通信网络(如2G/3G/4G等移动通信网络)的必要数据(包括用户识别信息和鉴权信息)接入移动通信网络为移动终端用户的网页浏览、网络多媒体播放等业务传输移动通信数据(包括上行的移动通信数据和下行的移动通信数据)。
无线通信单元110的无线互联网模块113通过运行无线热点的相关协议功能而实现无线热点的功能,无线热点支持多个移动终端(移动终端之外的任意移动终端)接入,通过复用移动通信模块112与移动通信网络之间的移动通信连接为移动终端用户的网页浏览、网络多媒体播放等业务传输移动通信数据(包括上行的移动通信数据和下行的移动通信数据),由于移动终端实质上是复用移动终端与通信网络之间的移动通信连接传输移动通信数据的,因此移动终端消耗的移动通信数据的流量由通信网络侧的计 费实体计入移动终端的通信资费,从而消耗移动终端签约使用的通信资费中包括的移动通信数据的数据流量。
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。
另外,在本发明各实施例中的各功能单元可以全部集成在一个处理模块中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,凡按照本发明原理所作的修改,都应当理解为落入本发明的保护范围。
工业实用性
本发明实施例提供的图像生成方案,可以应用于移动终端等各种电子设备中,当这些设备的摄像头无法提供高图像的采集图像时,可以通过多张图像的融合提供高图像质量的图像,从而使得最终输出的图像是高清晰度,图像信息丰富的,及失真度小等特点,从而在工业上产生了积极作用。与此同时,本实施例提供的图像生成方案,可以通过计算机程序等计算机可执行指令的便携,设备通过运行这些指令就能够简便的实现,从而具有很强的工业可实现性;故本发明实施例提供的图像生成方案具有很强的工业实用性。

Claims (26)

  1. 一种图像生成装置,包括:
    解析单元,配置为解析包括同一采集对象的K张图像,得到第一图像信息值;所述K为小于2的整数;
    确定单元,配置为基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值;
    第一获取单元,配置为将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数;
    计算单元,配置为基于所述融合参数,计算所述K张图像中各像素的融合权值;
    第二获取单元,配置为基于所述融合权值及所述K张图像对应像素的第一图像信息值,获得所述第二图像信息值;
    生成单元,配置为根据所述第二图像值,生成所述K张图像的融合图像。
  2. 根据权利要求1所述的装置,其中,
    所述确定单元,配置为利用如下公式计算所述区域对比度;
    Figure PCTCN2017092539-appb-100001
    Figure PCTCN2017092539-appb-100002
    所述i,j为像素p的坐标;所述CLi,j为像素p所在区域的区域对比度;所述p(i,j)为像素p的第一图像信息值;所述m(i,j)为所述像素p所在区域的各像素的图像信息值的平均值;所述N为所述像素p所在区域的第一维度上的像素个数;所述M为所述像素p所在区域的第二维度上的像素个数;所述第一维度垂直于所述第二维度。
  3. 根据权利要求1或2所述的装置,其中,
    所述确定单元,还配置为利用如下公式计算所述区域梯度值;
    Figure PCTCN2017092539-appb-100003
    Figure PCTCN2017092539-appb-100004
    所述i,j为像素p的坐标;所述I为第I图像中所述像素p所在区域的第一图像信息值;所述
    Figure PCTCN2017092539-appb-100005
    为所述像素p所在区域在x方向上的梯度值;所述
    Figure PCTCN2017092539-appb-100006
    为所述像素p所在区域在y方向上的梯度值;所述GLi,j为所述像素p所在区域的区域梯度值;所述A1为第一卷积算子;所述A2为第二卷积算子。
  4. 根据权利要求1或2所述的装置,其中,
    所述计算单元,配置为利用如下公式计算所述融合权值;
    Figure PCTCN2017092539-appb-100007
    所述WM(i,j,s)为第s张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述WM(i,j,k)为第k张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述W(i,j,s)第s张图像中坐标为(i,j)的像素的融合权值。
  5. 根据权利要求1或2所述的装置,其中,
    所述第二获取单元,配置为利用如下公式计算所述第二图像信息值;
    Figure PCTCN2017092539-appb-100008
    所述F(i,j)为坐标为(i,j)的像素的第二图像信息值;所述kwavek(i,j)为图像k中坐标为(i,j)的像素的第一图像信息值;所述W(i,j,k)为图像k中坐标为(i,j)的像素的所述让那个和权值。
  6. 根据权利要求1或2所述的装置,其中,
    所述解析单元,配置为分别对同一采集对象的黑白图像和彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图 像信息;
    所述确定单元,配置为基于所述黑白图像信息,确定所述黑白图像中各像素所在区域的区域对比度及区域梯度值,基于所述彩色图像信息,所述彩色图像中各像素所在区域的区域对比度及区域梯度值;
    所述第一获取单元,配置为将所述区域对比度与所述区域梯度值相乘,分别获取所述黑白图像及所述彩色图像中各像素的融合参数;
    所述计算单元,配置为基于所述融合参数,分别计算所述黑白图像和彩色图像各像素的融合权值;
    所述生成单元,配置为根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
  7. 根据权利要求6所述的装置,其中,
    所述解析单元,配置为于提取所述黑白图像的第一亮度信息;提取所述彩色图像的第二亮度信息及色彩信息;
    所述生成单元,配置为利用所述融合权值对所述第一亮度信息和所述第二亮度信息预设函数处理,得到融合图像的第三亮度信息;结合所述第三亮度信息及所述色彩信息,生成所述融合图像。
  8. 根据权利要求6所述的装置,其中,
    所述解析单元,配置为分别对所述黑白图像和所述彩色图像进行小波分解,获得所述黑白图像的亮度信息的第一小波分解系数,及所述彩色图像的亮度信息的第二小波分解系数;
    所述生成单元,配置为结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数;利用第三小波分解系数进行图像逆处理,生成所述融合图像。
  9. 根据权利要求8所述的装置,其中,
    所述生成单元,配置为在第一频段,结合所述融合权值采用第一函数 关系对所述第一小波分解参数和所述第二小波分解参数,得到第一频段的第三小波分解;
    在第二频段,结合所述融合权值采用第二函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第二频段的第三小波分解;
    所述第一函数关系与所述第二函数关系不同;其中,所述第一频段和所述第二频段为人眼不同敏感程度的频段。
  10. 一种图像生成方法,包括:
    解析包括同一采集对象的K张图像,得到第一图像信息值;所述K为小于2的整数;
    基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值;
    将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数;
    基于所述融合参数,计算所述K张图像中各像素的融合权值;
    基于所述融合权值及所述K张图像对应像素的第一图像信息值,获得所述第二图像信息值;
    根据所述第二图像信息值,生成所述K张图像的融合图像。
  11. 根据权利要求10所述的方法,其中,
    所述基于各像素的所述第一图像信息值,确定各像素所在区域的区域对比度及区域梯度值,包括:
    利用如下公式计算所述区域对比度;
    Figure PCTCN2017092539-appb-100009
    Figure PCTCN2017092539-appb-100010
    所述i,j为像素p的坐标;所述CLi,j为像素p所在区域的区域对比度;所述p(i,j)为像素p的第一图像信息值;所述m(i,j)为所述像素p所在区域的各 像素的图像信息值的平均值;所述N为所述像素p所在区域的第一维度上的像素个数;所述M为所述像素p所在区域的第二维度上的像素个数;所述第一维度垂直于所述第二维度。
  12. 根据权利要求10或11所述的方法,其中,
    所述基于各像素的所述第一图像信息值,确定各像素所在区域的区域对比度及区域梯度值,还包括:
    利用如下公式计算所述区域梯度值;
    Figure PCTCN2017092539-appb-100011
    Figure PCTCN2017092539-appb-100012
    所述i,j为像素p的坐标;所述I为图像中所述像素p所在区域的图像信息矩阵;所述图像信息矩阵由所述像素p所在区域内各像素的第一图像信息值组成;所述
    Figure PCTCN2017092539-appb-100013
    为所述像素p所在区域在x方向上的梯度值;所述
    Figure PCTCN2017092539-appb-100014
    为所述像素p所在区域在y方向上的梯度值;所述GLi,j为所述像素p所在区域的区域梯度值;所述A1为第一卷积算子;所述A2为第二卷积算子。
  13. 根据权利要求10或11所述的方法,其中,
    所述基于所述融合参数,计算所述K张图像中各像素的融合权值,包括:
    利用如下公式计算所述融合权值;
    Figure PCTCN2017092539-appb-100015
    所述WM(i,j,s)为第s张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述WM(i,j,k)为第k张图像中坐标为(i,j)的像素的融合参数WM(i,j);所述W(i,j,s)第s张图像中坐标为(i,j)的像素的融合权值。
  14. 根据权利要求10或11所述的方法,其中,
    所述基于所述融合权值及所述K张图像对应像素的图像信息值,获得第二图像信息值,包括:
    利用如下公式计算所述第二图像信息值;
    Figure PCTCN2017092539-appb-100016
    所述F(i,j)为坐标为(i,j)的像素的第二图像信息值;所述kwavek(i,j)为图像k中坐标为(i,j)的像素的第一图像信息值;所述W(i,j,k)为图像k中坐标为(i,j)的像素的所述让那个和权值。
  15. 根据权利要求10或11所述的方法,其中,
    所述解析包括同一采集对象的K张图像,得到第一图像信息值,包括:
    分别对同一采集对象的黑白图像和彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
    所述基于所述第一图像信息值,确定各所述图像中各像素所在区域的区域对比度及区域梯度值,包括:
    基于所述黑白图像信息,确定所述黑白图像中各像素所在区域的区域对比度及区域梯度值,基于所述彩色图像信息,所述彩色图像中各像素所在区域的区域对比度及区域梯度值;
    所述将所述区域对比度与所述区域梯度值相乘,获取各像素的融合参数,包括:
    将所述区域对比度与所述区域梯度值相乘,分别获取所述黑白图像及所述彩色图像中各像素的融合参数;
    所述基于所述融合参数,计算所述K张图像中各像素的融合权值,包括:
    基于所述融合参数,分别计算所述黑白图像和彩色图像各像素的融合权值;
    所述根据所述第二图像信息值,生成所述K张图像的融合图像,包括:
    根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
  16. 根据权利要求15所述的方法,其中,
    所述分别对同一采集对象的黑白图像和彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息,包括:
    提取所述黑白图像的第一亮度信息;提取所述彩色图像的第二亮度信息及色彩信息;
    所述根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像,包括:
    利用所述融合权值对所述第一亮度信息和所述第二亮度信息预设函数处理,得到融合图像的第三亮度信息;结合所述第三亮度信息及所述色彩信息,生成所述融合图像。
  17. 根据权利要求15所述的装置,其中,
    所述分别对同一采集对象的黑白图像和彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息,包括:
    分别对所述黑白图像和所述彩色图像进行小波分解,获得所述黑白图像的亮度信息的第一小波分解系数,及所述彩色图像的亮度信息的第二小波分解系数;
    所述根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像,包括:
    结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数;利用第三小波分解系数进行图像逆处理,生成所述融合图像。
  18. 根据权利要求17所述的方法,其中,
    所述结合所述融合权值及预设函数处理,对所述第一小波分解参数和 所述第二小波分解参数进行函数计算,得到第三小波分解系数;利用第三小波分解系数进行图像逆处理,生成所述融合图像,包括:
    在第一频段,结合所述融合权值采用第一函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第一频段的第三小波分解;
    在第二频段,结合所述融合权值采用第二函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第二频段的第三小波分解;
    所述第一函数关系与所述第二函数关系不同;其中,所述第一频段和所述第二频段为人眼不同敏感程度的频段。
  19. 一种图像生成方法,包括:
    获取同一采集对象的黑白图像和彩色图像;
    分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
    结合所述黑白图像信息和所述彩色图像信息,确定所述黑白图像和所述彩色图像的融合权值;
    根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
  20. 根据权利要求19所述的方法,其中,
    所述结合所述黑白图像信息和所述彩色图像信息,确定所述黑白图像和所述彩色图像的融合权值,包括:
    基于所述黑白图像信息,确定所述黑白图像中各像素所在区域的区域对比度及区域梯度值,基于所述彩色图像信息,所述彩色图像中各像素所在区域的区域对比度及区域梯度值;
    将所述区域对比度与所述区域梯度值相乘,分别获取所述黑白图像及所述彩色图像中各像素的融合参数;
    基于所述融合参数,分别计算所述黑白图像和彩色图像各像素的融合 权值。
  21. 根据权利要求20所述的方法,其中,
    所述分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息,包括:
    提取所述黑白图像的第一亮度信息;
    提取所述彩色图像的第二亮度信息及色彩信息;
    所述根据所述融合取值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像,包括:
    利用所述融合权值对所述第一亮度信息和所述第二亮度信息预设函数处理,得到融合图像的第三亮度信息;
    结合所述第三亮度信息及所述色彩信息,生成所述融合图像。
  22. 根据权利要求19、20或21所述的方法,其中,
    所述分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息,包括:
    分别对所述黑白图像和所述彩色图像进行小波分解,获得所述黑白图像的亮度信息的第一小波分解系数,及所述彩色图像的亮度信息的第二小波分解系数;
    所述根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像,包括:
    结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数;
    利用第三小波分解系数进行图像逆处理,生成所述融合图像。
  23. 根据权利要求22所述的方法,其中,
    所述结合所述融合权值及预设函数处理,对所述第一小波分解参数和所述第二小波分解参数进行函数计算,得到第三小波分解系数,包括:
    在第一频段,结合所述融合权值采用第一函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第一频段的第三小波分解;
    在第二频段,结合所述融合权值采用第二函数关系对所述第一小波分解参数和所述第二小波分解参数,得到第二频段的第三小波分解;
    所述第一函数关系与所述第二函数关系不同;其中,所述第一频段和所述第二频段为人眼不同敏感程度的频段。
  24. 一种图像生成装置,包括:
    第三获取单元,配置为获取同一采集对象的黑白图像和彩色图像;
    第四获取单元,配置为分别对所述黑白图像和所述彩色图像进行图像处理,获取所述黑白图像的黑白图像信息及所述彩色图像的彩色图像信息;
    权值确定单元,配置为于结合所述黑白图像信息和所述彩色图像信息,确定所述黑白图像和所述彩色图像的融合权值;
    融合单元,配置为根据所述融合权值,将所述黑白图像信息和所述彩色图像进行融合,生成融合图像。
  25. 一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于执行权利要求10至23任一项所述的方法。
  26. 一种图像处理设备,包括:
    存储器,用于存储计算机可执行指令;
    处理器,与所述存储器连接,配置为执行所述计算机可执行指令,能够实现权利要求10至23任一项所述的方法。
PCT/CN2017/092539 2016-08-29 2017-07-11 图像生成装置及方法、图像处理设备及存储介质 Ceased WO2018040751A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201610753013.5A CN106355569A (zh) 2016-08-29 2016-08-29 图像生成装置及方法
CN201610750445.0A CN106447641A (zh) 2016-08-29 2016-08-29 图像生成装置及方法
CN201610753013.5 2016-08-29
CN201610750445.0 2016-08-29

Publications (1)

Publication Number Publication Date
WO2018040751A1 true WO2018040751A1 (zh) 2018-03-08

Family

ID=61299987

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/092539 Ceased WO2018040751A1 (zh) 2016-08-29 2017-07-11 图像生成装置及方法、图像处理设备及存储介质

Country Status (1)

Country Link
WO (1) WO2018040751A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111563552A (zh) * 2020-05-06 2020-08-21 浙江大华技术股份有限公司 图像融合方法以及相关设备、装置
US20220036590A1 (en) * 2020-07-29 2022-02-03 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method and apparatus, and storage medium
WO2022182293A1 (en) * 2021-02-24 2022-09-01 Agency For Science, Technology And Research Method and system for image stitching
CN115439386A (zh) * 2022-09-06 2022-12-06 维沃移动通信有限公司 图像融合方法、装置、电子设备和存储介质
CN115661272A (zh) * 2022-11-14 2023-01-31 天地伟业技术有限公司 一种摄像机红外视频着色方法、装置及电子设备
CN116664464A (zh) * 2023-05-29 2023-08-29 广州市奥威亚电子科技有限公司 图像处理方法、装置、设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103714659A (zh) * 2013-12-26 2014-04-09 苏州清研微视电子科技有限公司 基于双光谱融合的疲劳驾驶识别系统
US20150262332A1 (en) * 2014-03-13 2015-09-17 Samsung Electronics Co., Ltd. Image processing method and electronic device supporting the same
CN105744159A (zh) * 2016-02-15 2016-07-06 努比亚技术有限公司 一种图像合成方法及装置
CN105827965A (zh) * 2016-03-25 2016-08-03 维沃移动通信有限公司 一种基于移动终端的图像处理方法及移动终端
CN106355569A (zh) * 2016-08-29 2017-01-25 努比亚技术有限公司 图像生成装置及方法
CN106447641A (zh) * 2016-08-29 2017-02-22 努比亚技术有限公司 图像生成装置及方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103714659A (zh) * 2013-12-26 2014-04-09 苏州清研微视电子科技有限公司 基于双光谱融合的疲劳驾驶识别系统
US20150262332A1 (en) * 2014-03-13 2015-09-17 Samsung Electronics Co., Ltd. Image processing method and electronic device supporting the same
CN105744159A (zh) * 2016-02-15 2016-07-06 努比亚技术有限公司 一种图像合成方法及装置
CN105827965A (zh) * 2016-03-25 2016-08-03 维沃移动通信有限公司 一种基于移动终端的图像处理方法及移动终端
CN106355569A (zh) * 2016-08-29 2017-01-25 努比亚技术有限公司 图像生成装置及方法
CN106447641A (zh) * 2016-08-29 2017-02-22 努比亚技术有限公司 图像生成装置及方法

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111563552A (zh) * 2020-05-06 2020-08-21 浙江大华技术股份有限公司 图像融合方法以及相关设备、装置
US20220036590A1 (en) * 2020-07-29 2022-02-03 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method and apparatus, and storage medium
US11900637B2 (en) * 2020-07-29 2024-02-13 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method and apparatus, and storage medium
WO2022182293A1 (en) * 2021-02-24 2022-09-01 Agency For Science, Technology And Research Method and system for image stitching
CN115439386A (zh) * 2022-09-06 2022-12-06 维沃移动通信有限公司 图像融合方法、装置、电子设备和存储介质
CN115661272A (zh) * 2022-11-14 2023-01-31 天地伟业技术有限公司 一种摄像机红外视频着色方法、装置及电子设备
CN116664464A (zh) * 2023-05-29 2023-08-29 广州市奥威亚电子科技有限公司 图像处理方法、装置、设备及存储介质

Similar Documents

Publication Publication Date Title
CN106454121B (zh) 双摄像头拍照方法及装置
US8780258B2 (en) Mobile terminal and method for generating an out-of-focus image
CN105744159A (zh) 一种图像合成方法及装置
WO2018019124A1 (zh) 一种图像处理方法及电子设备、存储介质
CN105303543A (zh) 图像增强方法及移动终端
WO2017050115A1 (zh) 一种图像合成方法和装置
CN105956999B (zh) 缩略图生成装置和方法
CN106534619A (zh) 一种调整对焦区域的方法、装置和终端
CN106097284B (zh) 一种夜景图像的处理方法和移动终端
WO2017166886A1 (zh) 一种图像处理系统和方法
WO2017020836A1 (zh) 一种虚化处理深度图像的装置和方法
CN105160628B (zh) 一种获取rgb数据的方法和装置
WO2017071476A1 (zh) 一种图像合成方法和装置、存储介质
CN106447641A (zh) 图像生成装置及方法
CN105979237A (zh) 一种图像处理方法及装置
WO2017071475A1 (zh) 一种图像处理方法及终端、存储介质
CN107018331A (zh) 一种基于双摄像头的成像方法及移动终端
CN106686451A (zh) 终端及视频播放控制方法
WO2017071542A1 (zh) 图像处理方法及装置
CN105897564A (zh) 一种照片分享装置和方法
WO2018076938A1 (zh) 图像处理装置及方法和计算机存储介质
WO2017071499A1 (zh) 图像锐化方法及移动终端
CN106056552A (zh) 一种图像处理方法及移动终端
WO2017071572A1 (zh) 一种信息处理方法及装置、终端、存储介质
CN106373110A (zh) 一种图像融合的方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17845054

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.08.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17845054

Country of ref document: EP

Kind code of ref document: A1