WO2016061757A1 - 基于双摄像头模组的图像生成方法及双摄像头模组 - Google Patents

基于双摄像头模组的图像生成方法及双摄像头模组 Download PDF

Info

Publication number
WO2016061757A1
WO2016061757A1 PCT/CN2014/089154 CN2014089154W WO2016061757A1 WO 2016061757 A1 WO2016061757 A1 WO 2016061757A1 CN 2014089154 W CN2014089154 W CN 2014089154W WO 2016061757 A1 WO2016061757 A1 WO 2016061757A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
camera
signal
pixel size
single pixel
Prior art date
Application number
PCT/CN2014/089154
Other languages
English (en)
French (fr)
Inventor
陈能
王强
Original Assignee
宇龙计算机通信科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宇龙计算机通信科技(深圳)有限公司 filed Critical 宇龙计算机通信科技(深圳)有限公司
Priority to CN201480079290.1A priority Critical patent/CN106464795A/zh
Priority to PCT/CN2014/089154 priority patent/WO2016061757A1/zh
Priority to EP14904333.3A priority patent/EP3148177A4/en
Publication of WO2016061757A1 publication Critical patent/WO2016061757A1/zh
Priority to US15/385,269 priority patent/US10212339B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/77Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase

Definitions

  • the present invention relates to the field of image generation and processing technologies, and in particular, to an image generation method based on a dual camera module and a dual camera module.
  • the design of the existing camera module is usually based on a camera.
  • the drawbacks of the single camera module in image display are obviously exposed. come out.
  • the resolution of the camera is required to be higher, if the module height of the camera module is not increased, the single pixel size becomes smaller, and the image quality will be deteriorated, for example, the noise is severe.
  • the single pixel size refers to the size of each pixel, and the larger the light, the better the light sensitivity and the less the color noise. If the image quality is maintained, the module height of the camera module will inevitably increase, and the user experience will be greatly reduced.
  • the current 8M (mega) resolution camera needs to be above 5 mm (mm) in the module height.
  • 13M and higher resolution have gradually occupied the mainstream market, but the coordination between the resolution, image quality and module height of the existing camera module is difficult to achieve.
  • the existing camera module also has a dual camera design, but it only has a certain improvement in resolution, and the image quality has not improved.
  • an object of the present invention is to provide an image generation method based on a dual camera module and a dual camera module, which combines the advantages of the two cameras to reduce color noise and brightness noise of the image, thereby improving image quality and Image brightness and detail.
  • the present invention provides an image generation method based on a dual camera module including a first camera of a large single pixel size and a second camera of high resolution, the method comprising the steps Have:
  • the first camera generates a first image
  • the second camera generates a second image
  • the first image and the second image are combined to generate a third image.
  • the first camera is a low resolution and large single pixel size camera
  • the second camera is a high resolution and small single pixel size camera.
  • the resolution of the first camera is lower than or equal to a predetermined first resolution threshold, and the single pixel size of the first camera is greater than or equal to a predetermined first single a pixel size threshold; the resolution of the second camera is higher than or equal to a predetermined second resolution threshold, and the single pixel size of the second camera is less than or equal to a predetermined second single pixel size threshold.
  • the first resolution threshold is the same as or different from the second resolution threshold; the first single pixel size threshold is the same as the second single pixel size threshold or not the same.
  • the first resolution threshold is 8 megabytes
  • the second resolution threshold is 13 megabytes
  • the first single pixel size threshold is 1.5*1.5 square micrometers.
  • the two single pixel size threshold is 1.4*1.4 square micron.
  • the step of synthesizing the first image and the second image to generate a third image includes:
  • the first color signal and the second brightness signal are combined to generate the third image.
  • the step of synthesizing the first image and the second image to generate a third image includes:
  • the first color signal and the third brightness signal are combined to generate the third image.
  • the step of synthesizing the first image and the second image to generate a third image includes:
  • the third color signal and the third brightness signal are combined to generate the third image.
  • the step of synthesizing the first image and the second image to generate a third image includes:
  • the first camera is a color camera
  • the second camera is a black and white camera
  • the invention also provides a dual camera module, comprising:
  • a first camera which is a large single pixel size camera, and the first camera is used to generate a first image
  • a second camera which is a high resolution camera, and the second camera is used to generate a second image
  • an image synthesis module configured to perform a synthesis process on the first image and the second image to generate a third image.
  • the first camera is a low resolution and large single pixel size camera
  • the second camera is a high resolution and small single pixel size camera.
  • the resolution of the first camera is lower than or equal to a predetermined first resolution threshold, and the single pixel size of the first camera is greater than or equal to a predetermined first single pixel size.
  • a threshold the resolution of the second camera is higher than or equal to a predetermined second resolution threshold, and the single pixel size of the second camera is less than or equal to a predetermined second single pixel size threshold.
  • the first resolution threshold is the same as or different from the second resolution threshold; the first single pixel size threshold is the same as the second single pixel size threshold or Not the same.
  • the first resolution threshold is 8 megabytes
  • the second resolution threshold is 13 megabytes
  • the first single pixel size threshold is 1.5*1.5 square micrometers
  • the second single pixel size threshold is 1.4*1.4 square microns.
  • the image synthesizing module further includes:
  • a first extraction submodule configured to extract a first color signal in the first image, and extract a second brightness signal in the second image
  • a first synthesis submodule configured to perform a synthesis process on the first color signal and the second brightness signal to generate the third image.
  • the image synthesizing module further includes:
  • a second extraction submodule configured to extract a first color signal and a first brightness signal in the first image, and extract a second brightness signal in the second image
  • a second synthesis sub-module configured to synthesize the first luminance signal and the second luminance signal into a third luminance signal, and perform synthesis processing on the first color signal and the third luminance signal to generate The third image.
  • the image synthesizing module further includes:
  • a third extraction submodule configured to extract a first color signal and a first brightness signal in the first image And extracting a second color signal and a second brightness signal in the second image;
  • a third synthesis sub-module configured to synthesize the first color signal and the second color signal into a third color signal, and synthesize the first brightness signal and the second brightness signal into a third a luminance signal; and synthesizing the third color signal and the third luminance signal to generate the third image.
  • the image synthesizing module further includes:
  • a fourth extraction sub-module configured to extract a first color signal in the first image, and extract a second color signal and a second brightness signal in the second image;
  • a fourth synthesis submodule configured to synthesize the first color signal and the second color signal into a third color signal, and synthesize the third color signal and the second brightness signal to generate The third image.
  • the first camera is a color camera
  • the second camera is a black and white camera
  • the invention can compensate for the deficiencies of the single camera module by the dual camera module, which comprises a first camera with a large single pixel size and a second camera with a high resolution, the first camera with a large single pixel size.
  • the dual camera module which comprises a first camera with a large single pixel size and a second camera with a high resolution, the first camera with a large single pixel size.
  • Acquiring the first image reduces color noise, so the image quality is better;
  • the second image obtained by the high-resolution second camera can reduce the brightness noise, so the brightness and detail performance is better; then the first image and The second image is subjected to a synthesis process to generate a third image.
  • the present invention reduces image color noise and luminance noise by combining different types of dual cameras, combining the advantages of the two cameras, thereby improving image quality and image brightness and detail.
  • the first camera is a low resolution and large single pixel size camera
  • the second camera is a high resolution and small single pixel size camera.
  • the dual camera module of the invention can further optimize the color noise and brightness noise of the image without increasing the height of the module, thereby improving the image quality; or the dual camera module of the invention can reduce the image quality without reducing the image quality.
  • the module height is further reduced to meet the needs of the terminal device becoming thinner and thinner.
  • FIG. 1 is a schematic structural view of a dual camera module of the present invention
  • FIG. 2 is a schematic structural view of a preferred dual camera module of the present invention
  • FIG. 3 is a flowchart of an image generation method based on a dual camera module of the present invention
  • FIG. 4 is a flowchart of an image generation method based on a dual camera module in the first embodiment of the present invention
  • FIG. 5 is a flowchart of an image generation method based on a dual camera module in a second embodiment of the present invention.
  • FIG. 6 is a flowchart of an image generation method based on a dual camera module in a third embodiment of the present invention.
  • FIG. 7 is a flow chart of an image generation method based on a dual camera module in a fourth embodiment of the present invention.
  • the dual camera module 100 can be applied to a device terminal such as a mobile phone, a tablet computer, a digital camera, etc., and the dual camera module 100 includes a first camera 10, The second camera 20 and the image synthesis module 30, wherein:
  • the first camera 10 is a camera with a large single pixel size, and the first camera 10 is used to generate a first image.
  • the single pixel size refers to the area of a single pixel.
  • the single pixel size of the first camera is greater than or equal to a predetermined first single pixel size threshold, that is, the camera of the large single pixel size refers to a camera whose single pixel size is greater than or equal to the first single pixel size threshold.
  • a camera with a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 (square micrometer) is generally recognized as a camera with a large single pixel size.
  • the first single pixel size threshold is not limited to 1.5*1.5 ⁇ m 2 , and it will follow in the future. Camera technology continues to evolve and is constantly changing.
  • the first camera 10 collects the optical signal to generate the first image. Since the first camera 10 uses a larger single pixel size, a better optical signal can be obtained, the color noise can be reduced, and the image quality is better
  • the second camera 20 is a high resolution camera, and the second camera 20 is used to generate a second image.
  • the resolution refers to the number of pixels (pixels) included in a unit of inch.
  • the resolution of the second camera is higher than or equal to a predetermined second resolution threshold, that is, the high resolution camera refers to a camera whose resolution is higher than or equal to the second resolution threshold.
  • a camera with a resolution greater than or equal to 8M is generally recognized as a high-resolution camera.
  • the second resolution threshold is not limited to 8M, and it will change continuously in the future as the camera technology continues to advance.
  • the second camera 20 collects the optical signal to generate the second image. Since the second camera 20 uses a high-resolution camera, the sensitivity can be improved, the brightness of the image is smaller, and the brightness and detail are better.
  • the image synthesis module 30 is configured to perform a synthesis process on the first image and the second image to generate a third image.
  • the image content of the first image, the second image, and the third image are almost the same, but the third image may combine the advantages of the first image and the second image, that is, not only color noise but also image quality is better; Brightness noise is small, and brightness and detail perform better.
  • the first camera 10 is a low resolution and large single pixel size camera.
  • the second camera 20 is a high resolution and small single pixel size camera.
  • the first camera 10 collects the optical signal to generate the first image. Since the first camera 10 uses a larger single pixel size, a better optical signal can be obtained, the color noise can be reduced, and the image quality is better. At the same time, since the resolution of the first camera 10 is low, the module height of the dual camera module 100 may not be increased.
  • the second camera 20 collects the optical signal to generate the second image. Since the second camera 20 uses a high-resolution camera, the sensitivity can be improved, the brightness of the image is smaller, and the brightness and detail are better. At the same time due to the single pixel of the first camera 10 The size is small, so the module height of the dual camera module 100 can be increased. More preferably, the first camera 10 is a color camera and the second camera 20 is a black and white camera.
  • the resolution of the first camera 10 is lower than or equal to a predetermined first resolution threshold, and the single pixel size of the first camera 10 is greater than or equal to a predetermined first single pixel size threshold.
  • the resolution of the second camera 20 is higher than or equal to a predetermined second resolution threshold, and the single pixel size of the second camera 20 is less than or equal to a predetermined second single pixel size threshold.
  • the first resolution threshold is the same as or different from the second resolution threshold; the first single pixel size threshold is the same as or different from the second single pixel size threshold.
  • the first resolution threshold is 8M (mega), that is, the resolution of the camera is lower than or equal to 8M, and the second resolution is 13M, that is, the resolution of the camera is higher than or Equal to 13M is the high resolution;
  • the first single pixel size threshold is 1.5*1.5 ⁇ m 2 , that is, the single pixel size of the camera is greater than or equal to 1.5*1.5 ⁇ m 2, which is a large single pixel size;
  • the second single pixel size threshold is 1.4*1.4 ⁇ m 2 , that is, the single pixel size of the camera is a small single pixel size if it is less than or equal to 1.4*1.4 ⁇ m 2 .
  • the preferred design principle of the dual camera module 100 of the present invention is: if the resolution of the camera is lower, the size of the single pixel is larger, the color noise is less, the brightness and noise are more, and the color signal of the output is larger. Preferably. If the resolution of the camera is higher, the size of the single pixel is smaller, the color noise is more, the brightness is less, and the brightness signal of the output is better. Therefore, by combining the two types of cameras, the present invention can further optimize the color noise and brightness noise of the image without increasing the module height of the camera module, thereby improving image quality and image brightness and detail.
  • the hardware aspect of the dual camera module 100 of the present invention requires the use of two camera circuit designs, similar to the circuits of other dual cameras. What the software needs to do is to write the driver of the dual camera, and after acquiring the data of the two cameras, the image synthesis algorithm is used to obtain a higher resolution image, so that when the image is enlarged, the image details are lost less, and the display is displayed. More delicate. After the combination of the two, if the dual camera module 100 uses the conventional module height, the benefits include: 1. reducing the color noise signal; 2. improving the brightness and detail of the camera; 3. outputting a larger resolution. Of course, the dual camera module 100 can also reduce the module height while maintaining the same image quality as other cameras of the same resolution.
  • the dual camera module 100 can be applied to a device terminal such as a mobile phone, a tablet computer, a digital camera, and the like, and the dual camera module 100 includes a first camera 10 .
  • the first camera 10 is a low resolution and large single pixel size camera, and the first camera is used to generate a first image.
  • the first camera 10 is a color camera.
  • the second camera 20 is a high resolution and small single pixel size camera, and the second camera is used to generate a second image.
  • the second camera 20 is a black and white camera.
  • the resolution of the first camera 10 is lower than or equal to a predetermined first resolution threshold, and the single pixel size of the first camera 10 is greater than or equal to a predetermined first single pixel size threshold.
  • the resolution of the second camera 20 is higher than or equal to a predetermined second resolution threshold, and the single pixel size of the second camera 20 is less than or equal to a predetermined second single pixel size threshold.
  • the first resolution threshold is the same as or different from the second resolution threshold.
  • the first single pixel size threshold is the same as or different from the second single pixel size threshold.
  • the first resolution threshold is 8M (mega), that is, the resolution of the camera is lower than or equal to 8M, and the second resolution is 13M, that is, the resolution of the camera is higher than or Equal to 13M is the high resolution;
  • the first single pixel size threshold is 1.5*1.5 ⁇ m 2 , that is, the single pixel size of the camera is greater than or equal to 1.5*1.5 ⁇ m 2, which is a large single pixel size;
  • the second single pixel size threshold is 1.4*1.4 ⁇ m 2 , that is, the single pixel size of the camera is a small single pixel size if it is less than or equal to 1.4*1.4 ⁇ m 2 .
  • the image synthesis module 30 is configured to perform a synthesis process on the first image and the second image to generate a third image.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution lower than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 . In this way, the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • the second camera 20 is a high-resolution and small single-pixel black-and-white camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution black-and-white camera output, the image brightness noise is smaller, and the brightness and detail performance are better.
  • the second camera 20 outputs only the luminance signal when turned on, and does not output the color signal.
  • the image synthesis module 30 further includes:
  • the first extraction sub-module 31 is configured to extract a first color signal in the first image and extract a second brightness signal in the second image.
  • the first luminance signal in the first image is not extracted here because the quality of the first luminance signal is poor, so it is directly ignored.
  • the first synthesis sub-module 32 is configured to perform a synthesis process on the first color signal and the second brightness signal to generate a third image.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution lower than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 .
  • the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • the second camera 20 is a high-resolution and small single-pixel black-and-white camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1, 4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution black-and-white camera output, the image brightness noise is smaller, and the brightness and detail performance are better.
  • the second camera 20 outputs only the luminance signal when turned on, and does not output the color signal.
  • the image synthesis module 30 further includes:
  • the second extraction sub-module 33 is configured to extract a first color signal and a first brightness signal in the first image, and extract a second brightness signal in the second image.
  • the second synthesizing sub-module 34 is configured to synthesize the first luma signal and the second luma signal into a third luma signal, and synthesize the first color signal and the third luma signal to generate a third image. Since the quality of the first luminance signal is poor, the second luminance signal after the synthesis processing is dominated by the second luminance signal.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution lower than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 . In this way, the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • the second camera 20 is a high-resolution and small single-pixel color color camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution camera output, the image brightness noise is smaller, and the brightness and detail performance is better.
  • the second camera 20 simultaneously outputs a luminance signal and a color signal when turned on.
  • the image synthesis module 30 further includes:
  • the third extraction sub-module 35 is configured to extract a first color signal and a first brightness signal in the first image, and extract a second color signal and a second brightness signal in the second image.
  • the third combining sub-module 36 is configured to synthesize the first color signal and the second color signal into a third color signal, and synthesize the first brightness signal and the second brightness signal into a third brightness signal. And combining the third color signal and the third brightness signal to generate a third image. Because the quality of the second color signal is poor, the third color signal after the synthesis process is dominated by the first color signal. Since the quality of the first luminance signal is poor, the second luminance signal after the synthesis processing is dominated by the second luminance signal.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution lower than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 . In this way, the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • the second camera 20 is a high-resolution and small single-pixel color color camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution camera output, the image brightness noise is smaller, and the brightness and detail performance is better.
  • the second camera 20 simultaneously outputs a luminance signal and a color signal when turned on.
  • the image synthesis module 30 further includes:
  • the fourth extraction sub-module 37 is configured to extract a first color signal in the first image, and extract a second color signal and a second brightness signal in the second image.
  • the first luminance signal in the first image is not extracted here because the quality of the first luminance signal is poor, so it is directly ignored.
  • the fourth synthesis sub-module 38 is configured to combine the first color signal and the second color signal into a third color signal, and synthesize the third color signal and the second brightness signal to generate a third image. Because the quality of the second color signal is poor, the third color signal after the synthesis process is dominated by the first color signal.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • the invention can be matched with different types of cameras, optimizes the problem of color noise, brightness noise and the like which cannot be solved under the weak light of the image, and synthesizes a higher resolution image, which is significantly improved in image quality and image size.
  • the height of the module can be reduced, the thickness of the terminal device such as a mobile phone can be reduced, and the feel and texture of the terminal device can be improved.
  • FIG. 3 is a flow chart of an image generation method based on the dual camera module of the present invention, which can be implemented by the dual camera module 100 shown in FIG. 1 or FIG. 2, the dual camera module 100 including a large single pixel size.
  • step S301 the first camera 10 generates a first image.
  • the single pixel size refers to the area of a single pixel.
  • the single pixel size of the first camera is greater than or equal to a predetermined first single pixel size threshold, that is, the camera of the large single pixel size refers to a camera whose single pixel size is greater than or equal to the first single pixel size threshold.
  • a camera with a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 (square micrometer) is generally recognized as a camera with a large single pixel size.
  • the first single pixel size threshold is not limited to 1.5*1.5 ⁇ m 2 , and it will follow in the future. Camera technology continues to evolve and is constantly changing.
  • the first camera 10 collects the optical signal to generate the first image. Since the first camera 10 uses a larger single pixel size, a better optical signal can be obtained, the color noise can be reduced, and the image quality is better.
  • step S302 the second camera 20 generates a second image.
  • the resolution refers to the number of pixels (pixels) included in a unit of inch.
  • the resolution of the second camera is higher than or equal to a predetermined second resolution threshold, that is, the high resolution camera refers to a camera whose resolution is higher than or equal to the second resolution threshold.
  • a camera with a resolution greater than or equal to 8M is generally recognized as a high-resolution camera.
  • the second resolution threshold is not limited to 8M, and it will change continuously in the future as the camera technology continues to advance.
  • the second camera 20 collects the optical signal to generate the second image. Since the second camera 20 uses a high-resolution camera, the sensitivity can be improved, the brightness of the image is smaller, and the brightness and detail are better.
  • Step S303 the first image and the second image are combined to generate a third image.
  • the image content of the first image, the second image, and the third image are almost the same, but the third image may combine the advantages of the first image and the second image, that is, not only color noise but also image quality is better; Brightness noise is small, and brightness and detail perform better.
  • the first camera 10 is a low resolution and large single pixel size camera.
  • the second camera 20 is a high resolution and small single pixel size camera.
  • the first camera 10 collects the optical signal to generate the first image. Since the first camera 10 uses a larger single pixel size, a better optical signal can be obtained, the color noise can be reduced, and the image quality is better. At the same time, since the resolution of the first camera 10 is low, the module height of the dual camera module 100 may not be increased.
  • the second camera 20 collects the optical signal to generate the second image. Since the second camera 20 uses a high-resolution camera, the sensitivity can be improved, the brightness of the image is smaller, and the brightness and detail are better. At the same time, since the single pixel size of the first camera 10 is small, the module height of the dual camera module 100 can be eliminated. More preferably, the first camera 10 is a color camera and the second camera 20 is a black and white camera.
  • the resolution of the first camera 10 is lower than or equal to a predetermined first resolution threshold, and the single pixel size of the first camera 10 is greater than or equal to a predetermined first single pixel size threshold.
  • the resolution of the second camera 20 is higher than or equal to a predetermined second resolution threshold, and the single pixel size of the second camera 20 is less than or equal to a predetermined second single pixel size threshold.
  • the first resolution threshold is the same as or different from the second resolution threshold.
  • the first single pixel size threshold is the same as or different from the second single pixel size threshold.
  • the first resolution threshold is 8M (mega), that is, the resolution of the camera is lower than or equal to 8M, and the second resolution is 13M, that is, the resolution of the camera is higher than or Equal to 13M is the high resolution;
  • the first single pixel size threshold is 1.5*1.5 ⁇ m 2 , that is, the single pixel size of the camera is greater than or equal to 1.5*1.5 ⁇ m 2, which is a large single pixel size;
  • the second single pixel size threshold is 1.4*1.4 ⁇ m 2 , that is, the single pixel size of the camera is a small single pixel size if it is less than or equal to 1.4*1.4 ⁇ m 2 .
  • the invention considers using a dual camera to compensate for the shortage of a single camera, and solves the image quality problem by matching a camera with a large single pixel size (preferably 1.5 ⁇ m*1.5 ⁇ m and above) and a black and white camera, and mainly optimizes the color noise of the image and Brightness noise, optimized image quality, and improved picture quality, even if the picture is enlarged, it can give the user a good picture quality display.
  • FIG. 4 is a flowchart of an image generation method based on a dual camera module in the first embodiment of the present invention, which can be implemented by the dual camera module 100 shown in FIG. 2, the dual camera module 100 including low resolution. And a first camera 10 having a large single pixel size, and a second camera 20 having a high resolution and a small single pixel size, the method comprising the steps of:
  • step S401 the first camera 10 generates a first image.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution of less than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 .
  • the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • step S402 the second camera 20 generates a second image.
  • the second camera 20 is a high resolution and small single pixel size black and white camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution black-and-white camera output, the image brightness noise is smaller, and the brightness and detail performance are better.
  • the second camera 20 outputs only the luminance signal when turned on, and does not output the color signal.
  • Step S403 extracting a first color signal in the first image.
  • the first luminance signal in the first image is not extracted here because the quality of the first luminance signal is poor, so it is directly ignored.
  • Step S404 extracting a second brightness signal in the second image.
  • Step S405 synthesizing the first color signal and the second brightness signal to generate a third image.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • FIG. 5 is a flowchart of an image generation method based on a dual camera module according to a second embodiment of the present invention, which can be implemented by the dual camera module 100 shown in FIG. 2, and the dual camera module 100 includes a low resolution. And a first camera 10 having a large single pixel size, and a second camera 20 having a high resolution and a small single pixel size, the method comprising the steps of:
  • step S501 the first camera 10 generates a first image.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution of less than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 .
  • the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • step S502 the second camera 20 generates a second image.
  • the second camera 20 is a high resolution and small single pixel size black and white camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution black-and-white camera output, the image brightness noise is smaller, and the brightness and detail performance are better.
  • the second camera 20 outputs only the luminance signal when turned on, and does not output the color signal.
  • Step S503 extracting a first color signal and a first brightness signal in the first image.
  • Step S504 extracting a second brightness signal in the second image.
  • Step S505 synthesizing the first brightness signal and the second brightness signal into a third brightness signal.
  • the second luminance signal after the synthesis processing is dominated by the second luminance signal.
  • Step S506 synthesizing the first color signal and the third brightness signal to generate a third image.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • FIG. 6 is a flowchart of an image generation method based on a dual camera module according to a third embodiment of the present invention, which can be implemented by the dual camera module 100 shown in FIG. 2, the dual camera module 100 including low resolution. And a first camera 10 having a large single pixel size, and a second camera 20 having a high resolution and a small single pixel size, the method comprising the steps of:
  • step S601 the first camera 10 generates a first image.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution of less than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 .
  • the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • step S602 the second camera 20 generates a second image.
  • the second camera 20 is a high resolution and small single pixel size color camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution camera output, the image brightness noise is smaller, and the brightness and detail performance is better.
  • the second camera 20 simultaneously outputs a luminance signal and a color signal when turned on.
  • Step S603 extracting a first color signal and a first brightness signal in the first image.
  • Step S604 extracting a second color signal and a second brightness signal in the second image.
  • Step S605 synthesizing the first color signal and the second color signal into a third color signal.
  • the third color signal after the synthesis process is dominated by the first color signal.
  • Step S606 synthesizing the first luminance signal and the second luminance signal into a third luminance signal.
  • the second luminance signal after the synthesis processing is dominated by the second luminance signal.
  • Step S607 performing a synthesis process on the third color signal and the third brightness signal to generate a third image.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • FIG. 7 is a flowchart of an image generation method based on a dual camera module according to a fourth embodiment of the present invention, which can be implemented by the dual camera module 100 shown in FIG. 2, and the dual camera module 100 includes a low resolution. And a first camera 10 having a large single pixel size, and a second camera 20 having a high resolution and a small single pixel size, the method comprising the steps of:
  • step S701 the first camera 10 generates a first image.
  • the first camera 10 is a low resolution and large single pixel size color camera having a resolution of less than or less than 8M and a single pixel size greater than or equal to 1.5*1.5 ⁇ m 2 .
  • the first camera 10 can obtain a better optical signal, reduce color noise, and have better image quality when acquiring an optical signal due to the use of a larger single pixel size.
  • the first camera 10 simultaneously outputs a luminance signal and a color signal when turned on.
  • step S702 the second camera 20 generates a second image.
  • the second camera 20 is a high resolution and small single pixel size color camera having a resolution of 13M to 20M and a single pixel size of less than or equal to 1.4*1.4 ⁇ m 2 .
  • the second camera 20 can increase the sensitivity by using a high-resolution camera output, the image brightness noise is smaller, and the brightness and detail performance is better.
  • the second camera 20 simultaneously outputs a luminance signal and a color signal when turned on.
  • Step S703 extracting a first color signal in the first image.
  • the first luminance signal in the first image is not extracted here because the quality of the first luminance signal is poor, so it is directly ignored.
  • Step S704 extracting a second color signal and a second brightness signal in the second image.
  • Step S705 synthesizing the first color signal and the second color signal into a third color signal.
  • the third color signal after the synthesis process is dominated by the first color signal.
  • Step S706 synthesizing the third color signal and the second brightness signal to generate a third image.
  • the third image may combine the advantages of the first image and the second image, that is, not only the color noise can be reduced, but the image quality is better; and the brightness noise is small, and the brightness and the detail performance are better.
  • the application scenarios of the present invention include:
  • the dual camera module of the invention When the module height is constant, the dual camera module of the invention is used, and when the user takes a picture in a weak light environment, the captured image is brighter and more delicate, and the color noise and brightness noise of a single module of the same type are compared. less.
  • the dual camera module of the invention can reduce the height of the module, and make the terminal device such as the mobile phone thinner and thinner, and improve the feel and texture of the terminal device.
  • the present invention can compensate for the deficiencies of the single camera module by using a dual camera module including a first camera with a large single pixel size and a second camera with a high resolution, through a large single pixel.
  • the first image obtained by the first camera of the size can reduce the color noise, so the image quality is better;
  • the second image obtained by the second camera with high resolution can reduce the brightness noise, so the brightness and the detail performance are better;
  • the first image and the second image are combined to generate a third image.
  • the present invention reduces image color noise and luminance noise by combining different types of dual cameras, combining the advantages of the two cameras, thereby improving image quality and image brightness and detail.
  • the first camera is a low resolution and large single pixel size camera
  • the second camera is a high resolution and small single pixel size camera.
  • the dual camera module of the invention can further optimize the color noise and brightness noise of the image without increasing the height of the module, thereby improving the image quality; or the dual camera module of the invention can reduce the image quality without reducing the image quality.
  • the module height is further reduced to meet the needs of the terminal device becoming thinner and thinner.

Abstract

一种基于双摄像头模组的图像生成方法,所述双摄像头模组包括大单像素尺寸的第一摄像头,以及高分辨率的第二摄像头,所述方法包括步骤有:所述第一摄像头生成第一图像;所述第二摄像头生成第二图像;将所述第一图像和所述第二图像进行合成处理以生成第三图像。相应地,还提供一种双摄像头模组。借此,可结合两种摄像头的优点来降低图像的彩色噪点和亮度噪点,从而提升图像质量以及图像亮度和细节。

Description

基于双摄像头模组的图像生成方法及双摄像头模组 技术领域
本发明涉及图像生成和处理技术领域,尤其涉及一种基于双摄像头模组的图像生成方法及双摄像头模组。
背景技术
现有摄像头模组设计通常以一个摄像头(sensor)为主,但用户随着对摄像头模组的高度、分辨率、图像质量要求越来越高,单摄像头模组在图像显示时的弊端明显暴露出来。当要求摄像头的分辨率越高,如果不增加摄像头模组的模组高度,则单像素尺寸变小,图像质量将会变差,例如噪点严重。单像素尺寸是指每个像素点的大小,其越大则感光越好,并且彩色噪点越少。如果保持图像质量,摄像头模组的模组高度必然会增加,又会大大降低用户体验,例如当前8M(兆)分辨率的摄像头,在模组高度需要在5mm(毫米)以上。而现在摄像头模组的分辨率越来越高,13M及更高分辨率的已逐渐占据主流市场,但现有摄像头模组在分辨率、图像质量和模组高度之间的协调难以达到期望。另外,现有摄像头模组也存在使用双摄像头的设计,但是其仅仅在分辨率上有一定的提升,图像质量方面仍然没有改善。
综上可知,现有技术在实际使用上显然存在不便与缺陷,所以有必要加以改进。
发明内容
针对上述的缺陷,本发明的目的在于提供一种基于双摄像头模组的图像生成方法及双摄像头模组,其结合两种摄像头的优点来降低图像的彩色噪点和亮度噪点,从而提升图像质量以及图像亮度和细节。
为了实现上述目的,本发明提供一种基于双摄像头模组的图像生成方法,所述双摄像头模组包括大单像素尺寸的第一摄像头,以及高分辨率的第二摄像头,所述方法包括步骤有:
所述第一摄像头生成第一图像;
所述第二摄像头生成第二图像;
将所述第一图像和所述第二图像进行合成处理以生成第三图像。
根据本发明所述的图像生成方法,所述第一摄像头为低分辨率且大单像素尺寸的摄像头;所述第二摄像头为高分辨率且小单像素尺寸的摄像头。
根据本发明所述的图像生成方法,所述第一摄像头的分辨率低于或等于预定的第一分辨率阈值,所述第一摄像头的单像素尺寸大于或等于预定的第一单 像素尺寸阈值;所述第二摄像头的分辨率高于或等于预定的第二分辨率阈值,所述第二摄像头的单像素尺寸小于或等于预定的第二单像素尺寸阈值。
根据本发明所述的图像生成方法,所述第一分辨率阈值与所述第二分辨率阈值相同或不相同;所述第一单像素尺寸阈值与所述第二单像素尺寸阈值相同或不相同。
根据本发明所述的图像生成方法,所述第一分辨率阈值为8兆,所述第二分辨率阈值为13兆,所述第一单像素尺寸阈值为1.5*1.5平方微米,所述第二单像素尺寸阈值为1.4*1.4平方微米。
根据本发明所述的图像生成方法,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
提取所述第一图像中的第一色彩信号;
提取所述第二图像中的第二亮度信号;
将所述第一色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的图像生成方法,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
提取所述第一图像中的第一色彩信号和第一亮度信号;
提取所述第二图像中的第二亮度信号;
将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号;
将所述第一色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的图像生成方法,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
提取所述第一图像中的第一色彩信号和第一亮度信号;
提取所述第二图像中的第二色彩信号和第二亮度信号;
将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号;
将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号;
将所述第三色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的图像生成方法,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
提取所述第一图像中的第一色彩信号;
提取所述第二图像中的第二色彩信号和第二亮度信号;
将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号;
将所述第三色彩信号和所述第二亮度信号进行合成处理以生成所述第三图 像。
根据本发明所述的图像生成方法,所述第一摄像头为彩色摄像头,所述第二摄像头为黑白摄像头。
本发明还提供一种双摄像头模组,包括有:
第一摄像头,为大单像素尺寸的摄像头,并且所述第一摄像头用于生成第一图像;
第二摄像头,为高分辨率的摄像头,并且所述第二摄像头用于生成第二图像;
图像合成模块,用于将所述第一图像和所述第二图像进行合成处理以生成第三图像。
根据本发明所述的双摄像头模组,所述第一摄像头为低分辨率且大单像素尺寸的摄像头;所述第二摄像头为高分辨率且小单像素尺寸的摄像头。
根据本发明所述的双摄像头模组,所述第一摄像头的分辨率低于或等于预定的第一分辨率阈值,所述第一摄像头的单像素尺寸大于或等于预定的第一单像素尺寸阈值;所述第二摄像头的分辨率高于或等于预定的第二分辨率阈值,所述第二摄像头的单像素尺寸小于或等于预定的第二单像素尺寸阈值。
根据本发明所述的双摄像头模组,所述第一分辨率阈值与所述第二分辨率阈值相同或不相同;所述第一单像素尺寸阈值与所述第二单像素尺寸阈值相同或不相同。
根据本发明所述的双摄像头模组,所述第一分辨率阈值为8兆,所述第二分辨率阈值为13兆,所述第一单像素尺寸阈值为1.5*1.5平方微米,所述第二单像素尺寸阈值为1.4*1.4平方微米。
根据本发明所述的双摄像头模组,所述图像合成模块进一步包括:
第一提取子模块,用于提取所述第一图像中的第一色彩信号,以及提取所述第二图像中的第二亮度信号;
第一合成子模块,用于将所述第一色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的双摄像头模组,所述图像合成模块进一步包括:
第二提取子模块,用于提取所述第一图像中的第一色彩信号和第一亮度信号,以及提取所述第二图像中的第二亮度信号;
第二合成子模块,用于将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号,并将所述第一色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的双摄像头模组,所述图像合成模块进一步包括:
第三提取子模块,用于提取所述第一图像中的第一色彩信号和第一亮度信 号,以及提取所述第二图像中的第二色彩信号和第二亮度信号;
第三合成子模块,用于将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号,以及将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号;并且将所述第三色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的双摄像头模组,所述图像合成模块进一步包括:
第四提取子模块,用于提取所述第一图像中的第一色彩信号,以及提取所述第二图像中的第二色彩信号和第二亮度信号;
第四合成子模块,用于将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号,以及将所述第三色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
根据本发明所述的双摄像头模组,所述第一摄像头为彩色摄像头,所述第二摄像头为黑白摄像头。
本发明可通过双摄像头模组来弥补单摄像头模组的不足,所述双摄像头模组包括大单像素尺寸的第一摄像头以及高分辨率的第二摄像头,通过大单像素尺寸的第一摄像头获取的第一图像,可降低彩色噪点,因此图像质量更好;通过高分辨率的第二摄像头获取的第二图像,可降低亮度噪点,因此亮度和细节表现更好;再将第一图像和第二图像进行合成处理以生成第三图像。借此,本发明通过搭配不同类型的双摄像头,结合两种摄像头的优点来降低图像的彩色噪点和亮度噪点,从而提升图像质量以及图像亮度和细节。优选的是,第一摄像头为低分辨率且大单像素尺寸的摄像头;第二摄像头为高分辨率且小单像素尺寸的摄像头。本发明双摄像头模组可在不增加模组高度的基础上,进一步优化图像的彩色噪点和亮度噪点,进而提升图像质量;或者,本发明双摄像头模组可在不降低图像质量的前提下,进一步降低模组高度,以符合终端设备越做越薄的需求。
附图说明
图1是本发明双摄像头模组的结构示意图;
图2是本发明优选双摄像头模组的结构示意图;
图3是本发明基于双摄像头模组的图像生成方法的流程图;
图4是本发明第一实施例中基于双摄像头模组的图像生成方法的流程图;
图5是本发明第二实施例中基于双摄像头模组的图像生成方法的流程图;
图6是本发明第三实施例中基于双摄像头模组的图像生成方法的流程图;
图7是本发明第四实施例中基于双摄像头模组的图像生成方法的流程图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。
图1是本发明双摄像头模组的结构示意图,所述双摄像头模组100可应用于手机、平板电脑、数码相机等设备终端中,并且所述双摄像头模组100包括有第一摄像头10、第二摄像头20以及图像合成模块30,其中:
所述第一摄像头10,为大单像素尺寸的摄像头,并且第一摄像头10用于生成第一图像。所述单像素尺寸是指单像素的面积。所述第一摄像头的单像素尺寸大于或等于预定的第一单像素尺寸阈值,即所述大单像素尺寸的摄像头是指单像素尺寸大于或等于第一单像素尺寸阈值的摄像头。目前一般将单像素尺寸大于或等于1.5*1.5μm2(平方微米)的摄像头认定为大单像素尺寸的摄像头,当然第一单像素尺寸阈值并不限于1.5*1.5μm2,其将来会随着摄像头技术不断进步而不断改变。第一摄像头10采集光信号生成第一图像,由于第一摄像头10使用更大的单像素尺寸,因此可得到更好的光信号,可降低彩色噪点,图像质量更好。
所述第二摄像头20,为高分辨率的摄像头,并且第二摄像头20用于生成第二图像。所述分辨率是指单位英寸中所包含的像素(pixel)点数。所述第二摄像头的分辨率高于或等于预定的第二分辨率阈值,即所述高分辨率的摄像头是指分辨率高于或等于第二分辨率阈值的摄像头。目前一般将分辨率大于或等于8M的摄像头认定为高分辨率的摄像头,当然第二分辨率阈值并不限于8M,其将来会随着摄像头技术不断进步而不断改变。第二摄像头20采集光信号生成第二图像,由于第二摄像头20采用高分辨率摄像头,因此可提高感光度,图像的亮度噪点会更小,亮度和细节表现更好。
所述图像合成模块30,用于将第一图像和第二图像进行合成处理以生成第三图像。所述第一图像、第二图像和第三图像的图像内容几乎相同,但所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
优选的是,所述第一摄像头10为低分辨率且大单像素尺寸的摄像头。第二摄像头20为高分辨率且小单像素尺寸的摄像头。第一摄像头10采集光信号生成第一图像,由于第一摄像头10使用更大的单像素尺寸,因此可得到更好的光信号,可降低彩色噪点,图像质量更好。同时由于第一摄像头10的分辨率低,因此双摄像头模组100的模组高度可以不用增加。第二摄像头20采集光信号生成第二图像,由于第二摄像头20采用高分辨率摄像头,因此可提高感光度,图像的亮度噪点会更小,亮度和细节表现更好。同时由于第一摄像头10的单像素 尺寸小,因此双摄像头模组100的模组高度可以不用增加。更好的是,第一摄像头10为彩色摄像头,第二摄像头20为和黑白摄像头。
优选的是,第一摄像头10的分辨率低于或等于预定的第一分辨率阈值,第一摄像头10的单像素尺寸大于或等于预定的第一单像素尺寸阈值。第二摄像头20的分辨率高于或等于预定的第二分辨率阈值,第二摄像头20的单像素尺寸小于或等于预定的第二单像素尺寸阈值。所述第一分辨率阈值与第二分辨率阈值相同或不相同;第一单像素尺寸阈值与第二单像素尺寸阈值相同或不相同。更好的是,第一分辨率阈值为8M(兆),即摄像头的分辨率若低于或等于8M则为低分辨率;第二分辨率阈值为13M,即摄像头的分辨率若高于或等于13M则为高分辨率;第一单像素尺寸阈值为1.5*1.5μm2,即摄像头的单像素尺寸若大于或等于1.5*1.5μm2则为大单像素尺寸;第二单像素尺寸阈值为1.4*1.4μm2,即摄像头的单像素尺寸若小于或等于1.4*1.4μm2则为小单像素尺寸。
本发明双摄像头模组100的优选设计原理是:如果摄像头的分辨率越低,在模组高度不变前提下,则单像素尺寸越大,彩色噪点少,亮度噪点多,其输出的色彩信号较佳。如果摄像头的分辨率越高,在模组高度不变前提下,则单像素尺寸越小,彩色噪点多,亮度噪点少,其输出的亮度信号较佳。因此,本发明通过搭配这两种类型的摄像头,在不增加摄像头模组的模组高度的基础上,可进一步优化图像的彩色噪点和亮度噪点,进而提升图像质量以及图像亮度和细节。
本发明双摄像头模组100硬件方面需要使用两个摄像头电路设计,和其他双摄像头的电路类似。软件方面需要做的就是编写双摄像头的驱动,并在获取两个摄像头的数据之后,采用图像合成算法,得到更高的分辨率图像,这样,在放大图片的时候,图像细节丢失更少,显示更加细腻。二者结合后,如果双摄像头模组100使用常规模组高度,好处包括:1、降低彩色噪点信号;2、提高摄像头亮度和细节;3、输出更大的分辨率。当然,双摄像头模组100也可降低模组高度,却能保持和其他同分辨率的摄像头一样的图像质量。
图2是本发明优选双摄像头模组的结构示意图,所述双摄像头模组100可应用于手机、平板电脑、数码相机等设备终端中,并且所述双摄像头模组100包括有第一摄像头10、第二摄像头20以及图像合成模块30,其中:
所述第一摄像头10,为低分辨率且大单像素尺寸的摄像头,并且第一摄像头用于生成第一图像。优选的是,第一摄像头10为彩色摄像头。
所述第二摄像头20,为高分辨率且小单像素尺寸的摄像头,并且第二摄像头用于生成第二图像。优选的是,第二摄像头20为黑白摄像头。
优选的是,第一摄像头10的分辨率低于或等于预定的第一分辨率阈值,第一摄像头10的单像素尺寸大于或等于预定的第一单像素尺寸阈值。第二摄像头 20的分辨率高于或等于预定的第二分辨率阈值,第二摄像头20的单像素尺寸小于或等于预定的第二单像素尺寸阈值。所述第一分辨率阈值与第二分辨率阈值相同或不相同。第一单像素尺寸阈值与第二单像素尺寸阈值相同或不相同。更好的是,第一分辨率阈值为8M(兆),即摄像头的分辨率若低于或等于8M则为低分辨率;第二分辨率阈值为13M,即摄像头的分辨率若高于或等于13M则为高分辨率;第一单像素尺寸阈值为1.5*1.5μm2,即摄像头的单像素尺寸若大于或等于1.5*1.5μm2则为大单像素尺寸;第二单像素尺寸阈值为1.4*1.4μm2,即摄像头的单像素尺寸若小于或等于1.4*1.4μm2则为小单像素尺寸。
所述图像合成模块30,用于将第一图像和第二图像进行合成处理以生成第三图像。
在本发明第一实施例中,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。第二摄像头20为高分辨率且小单像素尺寸的黑白摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的黑白摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时只输出亮度信号,不输出色彩信号。
所述图像合成模块30进一步包括:
第一提取子模块31,用于提取第一图像中的第一色彩信号,以及提取第二图像中的第二亮度信号。这里不提取第一图像中的第一亮度信号,因为第一亮度信号的质量较差,所以直接忽略。
第一合成子模块32,用于将第一色彩信号和第二亮度信号进行合成处理以生成第三图像。所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
在本发明第二实施例中,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。第二摄像头20为高分辨率且小单像素尺寸的黑白摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1,4μm2。这样,第二摄像头20由于使用高分辨率的黑白摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时只输出亮度信号,不输出色彩信号。
所述图像合成模块30进一步包括:
第二提取子模块33,用于提取第一图像中的第一色彩信号和第一亮度信号,以及提取第二图像中的第二亮度信号。
第二合成子模块34,用于将第一亮度信号和第二亮度信号合成处理为第三亮度信号,并将第一色彩信号和第三亮度信号进行合成处理以生成第三图像。因为第一亮度信号的质量较差,所以合成处理后的第三亮度信号中以第二亮度信号为主。所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
在本发明第三实施例中,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。第二摄像头20为高分辨率且小单像素尺寸的彩色摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时同时输出亮度信号和色彩信号。
所述图像合成模块30进一步包括:
第三提取子模块35,用于提取第一图像中的第一色彩信号和第一亮度信号,以及提取第二图像中的第二色彩信号和第二亮度信号。
第三合成子模块36,用于将第一色彩信号和第二色彩信号合成处理为第三色彩信号,以及将第一亮度信号和第二亮度信号合成处理为第三亮度信号。并且将第三色彩信号和第三亮度信号进行合成处理以生成第三图像。因为第二色彩信号的质量较差,所以合成处理后的第三色彩信号中以第一色彩信号为主。因为第一亮度信号的质量较差,所以合成处理后的第三亮度信号中以第二亮度信号为主。所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
在本发明第四实施例中,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。第二摄像头20为高分辨率且小单像素尺寸的彩色摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时同时输出亮度信号和色彩信号。
所述图像合成模块30进一步包括:
第四提取子模块37,用于提取第一图像中的第一色彩信号,以及提取第二图像中的第二色彩信号和第二亮度信号。这里不提取第一图像中的第一亮度信号,因为第一亮度信号的质量较差,所以直接忽略。
第四合成子模块38,用于将第一色彩信号和第二色彩信号合成处理为第三色彩信号,以及将第三色彩信号和第二亮度信号进行合成处理以生成第三图像。因为第二色彩信号的质量较差,所以合成处理后的第三色彩信号中以第一色彩信号为主。所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
本发明可搭配不同类型的摄像头,优化解决图像在弱光下无法解决的彩色噪点、亮度噪点等问题,并合成得到更高分辨率的图像,在图像质量和图像大小方面得到显著提升。在保持正常的摄像头效果时,能够降低模组高度,减小手机等终端设备的厚度,提升终端设备手感和质感。
图3是本发明基于双摄像头模组的图像生成方法的流程图,其可通过如图1或图2所示的双摄像头模组100实现,所述双摄像头模组100包括大单像素尺寸的第一摄像头10以及高分辨率的第二摄像头20,所述方法包括步骤有:
步骤S301,第一摄像头10生成第一图像。
所述单像素尺寸是指单像素的面积。所述第一摄像头的单像素尺寸大于或等于预定的第一单像素尺寸阈值,即所述大单像素尺寸的摄像头是指单像素尺寸大于或等于第一单像素尺寸阈值的摄像头。目前一般将单像素尺寸大于或等于1.5*1.5μm2(平方微米)的摄像头认定为大单像素尺寸的摄像头,当然第一单像素尺寸阈值并不限于1.5*1.5μm2,其将来会随着摄像头技术不断进步而不断改变。第一摄像头10采集光信号生成第一图像,由于第一摄像头10使用更大的单像素尺寸,因此可得到更好的光信号,可降低彩色噪点,图像质量更好。
步骤S302,第二摄像头20生成第二图像。
所述分辨率是指单位英寸中所包含的像素(pixel)点数。所述第二摄像头的分辨率高于或等于预定的第二分辨率阈值,即所述高分辨率的摄像头是指分辨率高于或等于第二分辨率阈值的摄像头。目前一般将分辨率大于或等于8M的摄像头认定为高分辨率的摄像头,当然第二分辨率阈值并不限于8M,其将来会随着摄像头技术不断进步而不断改变。第二摄像头20采集光信号生成第二图像,由于第二摄像头20采用高分辨率摄像头,因此可提高感光度,图像的亮度噪点会更小,亮度和细节表现更好。
步骤S303,将第一图像和第二图像进行合成处理以生成第三图像。
所述第一图像、第二图像和第三图像的图像内容几乎相同,但所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
优选的是,所述第一摄像头10为低分辨率且大单像素尺寸的摄像头。第二摄像头20为高分辨率且小单像素尺寸的摄像头。第一摄像头10采集光信号生成第一图像,由于第一摄像头10使用更大的单像素尺寸,因此可得到更好的光信号,可降低彩色噪点,图像质量更好。同时由于第一摄像头10的分辨率低,因此双摄像头模组100的模组高度可以不用增加。第二摄像头20采集光信号生成第二图像,由于第二摄像头20采用高分辨率摄像头,因此可提高感光度,图像的亮度噪点会更小,亮度和细节表现更好。同时由于第一摄像头10的单像素尺寸小,因此双摄像头模组100的模组高度可以不用增加。更好的是,第一摄像头10为彩色摄像头,第二摄像头20为和黑白摄像头。
优选的是,第一摄像头10的分辨率低于或等于预定的第一分辨率阈值,第一摄像头10的单像素尺寸大于或等于预定的第一单像素尺寸阈值。第二摄像头20的分辨率高于或等于预定的第二分辨率阈值,第二摄像头20的单像素尺寸小于或等于预定的第二单像素尺寸阈值。所述第一分辨率阈值与第二分辨率阈值相同或不相同。第一单像素尺寸阈值与第二单像素尺寸阈值相同或不相同。更好的是,第一分辨率阈值为8M(兆),即摄像头的分辨率若低于或等于8M则为低分辨率;第二分辨率阈值为13M,即摄像头的分辨率若高于或等于13M则为高分辨率;第一单像素尺寸阈值为1.5*1.5μm2,即摄像头的单像素尺寸若大于或等于1.5*1.5μm2则为大单像素尺寸;第二单像素尺寸阈值为1.4*1.4μm2,即摄像头的单像素尺寸若小于或等于1.4*1.4μm2则为小单像素尺寸。
本发明考虑使用双摄像头来弥补单摄像头的不足,通过搭配较大单像素尺寸(优选1.5μm*1.5μm及以上)的摄像头和黑白摄像头,解决图像的成像质量问题,主要优化图像的彩色噪点和亮度噪点,优化图像质量,提高画面质感,即使放大图片也能给用户很好的画质显示。
图4是本发明第一实施例中基于双摄像头模组的图像生成方法的流程图,其可通过如图2所示的双摄像头模组100实现,所述双摄像头模组100包括低分辨率且大单像素尺寸的第一摄像头10,以及高分辨率且小单像素尺寸的第二摄像头20,所述方法包括步骤有:
步骤S401,第一摄像头10生成第一图像。
优选的是,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。
步骤S402,第二摄像头20生成第二图像。
优选的是,第二摄像头20为高分辨率且小单像素尺寸的黑白摄像头,其分 辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的黑白摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时只输出亮度信号,不输出色彩信号。
步骤S403,提取第一图像中的第一色彩信号。
这里不提取第一图像中的第一亮度信号,因为第一亮度信号的质量较差,所以直接忽略。
步骤S404,提取第二图像中的第二亮度信号。
步骤S405,将第一色彩信号和第二亮度信号进行合成处理以生成第三图像。
所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
图5是本发明第二实施例中基于双摄像头模组的图像生成方法的流程图,其可通过如图2所示的双摄像头模组100实现,所述双摄像头模组100包括低分辨率且大单像素尺寸的第一摄像头10,以及高分辨率且小单像素尺寸的第二摄像头20,所述方法包括步骤有:
步骤S501,第一摄像头10生成第一图像。
优选的是,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。
步骤S502,第二摄像头20生成第二图像。
优选的是,第二摄像头20为高分辨率且小单像素尺寸的黑白摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的黑白摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时只输出亮度信号,不输出色彩信号。
步骤S503,提取第一图像中的第一色彩信号和第一亮度信号。
步骤S504,提取第二图像中的第二亮度信号。
步骤S505,将第一亮度信号和第二亮度信号合成处理为第三亮度信号。
因为第一亮度信号的质量较差,所以合成处理后的第三亮度信号中以第二亮度信号为主。
步骤S506,将第一色彩信号和第三亮度信号进行合成处理以生成第三图像。
所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
图6是本发明第三实施例中基于双摄像头模组的图像生成方法的流程图,其可通过如图2所示的双摄像头模组100实现,所述双摄像头模组100包括低分辨率且大单像素尺寸的第一摄像头10,以及高分辨率且小单像素尺寸的第二摄像头20,所述方法包括步骤有:
步骤S601,第一摄像头10生成第一图像。
优选的是,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信号。
步骤S602,第二摄像头20生成第二图像。
优选的是,第二摄像头20为高分辨率且小单像素尺寸的彩色摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时同时输出亮度信号和色彩信号。
步骤S603,提取第一图像中的第一色彩信号和第一亮度信号。
步骤S604,提取第二图像中的第二色彩信号和第二亮度信号。
步骤S605,将第一色彩信号和第二色彩信号合成处理为第三色彩信号。
因为第二色彩信号的质量较差,所以合成处理后的第三色彩信号中以第一色彩信号为主。
步骤S606,将第一亮度信号和第二亮度信号合成处理为第三亮度信号。
因为第一亮度信号的质量较差,所以合成处理后的第三亮度信号中以第二亮度信号为主。
步骤S607,将第三色彩信号和第三亮度信号进行合成处理以生成第三图像。
所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
图7是本发明第四实施例中基于双摄像头模组的图像生成方法的流程图,其可通过如图2所示的双摄像头模组100实现,所述双摄像头模组100包括低分辨率且大单像素尺寸的第一摄像头10,以及高分辨率且小单像素尺寸的第二摄像头20,所述方法包括步骤有:
步骤S701,第一摄像头10生成第一图像。
优选的是,第一摄像头10为低分辨率且大单像素尺寸的彩色摄像头,其分辨率低于或小于8M,其单像素尺寸大于或等于1.5*1.5μm2。这样,第一摄像头10由于使用更大的单像素尺寸,在采集光信号时,可得到更好的光信号,降低彩色噪点,图像质量更好。第一摄像头10在打开时同时输出亮度信号和色彩信 号。
步骤S702,第二摄像头20生成第二图像。
优选的是,第二摄像头20为高分辨率且小单像素尺寸的彩色摄像头,其分辨率为13M~20M,其单像素尺寸小于或等于1.4*1.4μm2。这样,第二摄像头20由于使用高分辨率的摄像头输出,可提高感光度,图像亮度噪点会更小,亮度和细节表现更好。第二摄像头20在打开时同时输出亮度信号和色彩信号。
步骤S703,提取第一图像中的第一色彩信号。
这里不提取第一图像中的第一亮度信号,因为第一亮度信号的质量较差,所以直接忽略。
步骤S704,提取第二图像中的第二色彩信号和第二亮度信号。
步骤S705,将第一色彩信号和第二色彩信号合成处理为第三色彩信号。
因为第二色彩信号的质量较差,所以合成处理后的第三色彩信号中以第一色彩信号为主。
步骤S706,将第三色彩信号和第二亮度信号进行合成处理以生成第三图像。
所述第三图像可以结合第一图像和第二图像的优点,即不仅可降低彩色噪点,图像质量更好;而且亮度噪点小,亮度和细节表现更好。
本发明应用场景包括有:
1、在模组高度不变情况下,使用本发明双摄像头模组,当用户在光线弱的环境下拍照,拍出的图像更加明亮细腻,相对于同类型的单个模组彩色噪点和亮度噪点更少。
2、在不降低成像质量的前提下,使用本发明双摄像头模组,可降低模组高度,让手机等终端设备越做越薄,提升终端设备手感和质感。
综上所述,本发明可通过双摄像头模组来弥补单摄像头模组的不足,所述双摄像头模组包括大单像素尺寸的第一摄像头以及高分辨率的第二摄像头,通过大单像素尺寸的第一摄像头获取的第一图像,可降低彩色噪点,因此图像质量更好;通过高分辨率的第二摄像头获取的第二图像,可降低亮度噪点,因此亮度和细节表现更好;再将第一图像和第二图像进行合成处理以生成第三图像。借此,本发明通过搭配不同类型的双摄像头,结合两种摄像头的优点来降低图像的彩色噪点和亮度噪点,从而提升图像质量以及图像亮度和细节。优选的是,第一摄像头为低分辨率且大单像素尺寸的摄像头;第二摄像头为高分辨率且小单像素尺寸的摄像头。本发明双摄像头模组可在不增加模组高度的基础上,进一步优化图像的彩色噪点和亮度噪点,进而提升图像质量;或者,本发明双摄像头模组可在不降低图像质量的前提下,进一步降低模组高度,以符合终端设备越做越薄的需求。
当然,本发明还可有其它多种实施例,在不背离本发明精神及其实质的情 况下,熟悉本领域的技术人员当可根据本发明作出各种相应的改变和变形,但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。

Claims (20)

  1. 一种基于双摄像头模组的图像生成方法,其特征在于,所述双摄像头模组包括大单像素尺寸的第一摄像头,以及高分辨率的第二摄像头,所述方法包括步骤有:
    所述第一摄像头生成第一图像;
    所述第二摄像头生成第二图像;
    将所述第一图像和所述第二图像进行合成处理以生成第三图像。
  2. 根据权利要求1所述的图像生成方法,其特征在于,所述第一摄像头为低分辨率且大单像素尺寸的摄像头;所述第二摄像头为高分辨率且小单像素尺寸的摄像头。
  3. 根据权利要求2所述的图像生成方法,其特征在于,所述第一摄像头的分辨率低于或等于预定的第一分辨率阈值,所述第一摄像头的单像素尺寸大于或等于预定的第一单像素尺寸阈值;所述第二摄像头的分辨率高于或等于预定的第二分辨率阈值,所述第二摄像头的单像素尺寸小于或等于预定的第二单像素尺寸阈值。
  4. 根据权利要求3所述的图像生成方法,其特征在于,所述第一分辨率阈值与所述第二分辨率阈值相同或不相同;所述第一单像素尺寸阈值与所述第二单像素尺寸阈值相同或不相同。
  5. 根据权利要求4所述的图像生成方法,其特征在于,所述第一分辨率阈值为8兆,所述第二分辨率阈值为13兆,所述第一单像素尺寸阈值为1.5*1.5平方微米,所述第二单像素尺寸阈值为1.4*1.4平方微米。
  6. 根据权利要求2所述的图像生成方法,其特征在于,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
    提取所述第一图像中的第一色彩信号;
    提取所述第二图像中的第二亮度信号;
    将所述第一色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
  7. 根据权利要求2所述的图像生成方法,其特征在于,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
    提取所述第一图像中的第一色彩信号和第一亮度信号;
    提取所述第二图像中的第二亮度信号;
    将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号;
    将所述第一色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
  8. 根据权利要求2所述的图像生成方法,其特征在于,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
    提取所述第一图像中的第一色彩信号和第一亮度信号;
    提取所述第二图像中的第二色彩信号和第二亮度信号;
    将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号;
    将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号;
    将所述第三色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
  9. 根据权利要求2所述的图像生成方法,其特征在于,所述将第一图像和所述第二图像进行合成处理以生成第三图像的步骤包括:
    提取所述第一图像中的第一色彩信号;
    提取所述第二图像中的第二色彩信号和第二亮度信号;
    将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号;
    将所述第三色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
  10. 根据权利要求2~7任一项所述的图像生成方法,其特征在于,所述第一摄像头为彩色摄像头,所述第二摄像头为黑白摄像头。
  11. 一种双摄像头模组,其特征在于,包括有:
    第一摄像头,为大单像素尺寸的摄像头,并且所述第一摄像头用于生成第一图像;
    第二摄像头,为高分辨率的摄像头,并且所述第二摄像头用于生成第二图像;
    图像合成模块,用于将所述第一图像和所述第二图像进行合成处理以生成第三图像。
  12. 根据权利要求1所述的双摄像头模组,其特征在于,所述第一摄像头为低分辨率且大单像素尺寸的摄像头;所述第二摄像头为高分辨率且小单像素尺寸的摄像头。
  13. 根据权利要求12所述的双摄像头模组,其特征在于,所述第一摄像头的分辨率低于或等于预定的第一分辨率阈值,所述第一摄像头的单像素尺寸大于或等于预定的第一单像素尺寸阈值;所述第二摄像头的分辨率高于或等于预定的第二分辨率阈值,所述第二摄像头的单像素尺寸小于或等于预定的第二单像素尺寸阈值。
  14. 根据权利要求13所述的双摄像头模组,其特征在于,所述第一分辨率阈值与所述第二分辨率阈值相同或不相同;所述第一单像素尺寸阈值与所述第二单像素尺寸阈值相同或不相同。
  15. 根据权利要求14所述的双摄像头模组,其特征在于,所述第一分辨率阈值为8兆,所述第二分辨率阈值为13兆,所述第一单像素尺寸阈值为1.5*1.5平方微米,所述第二单像素尺寸阈值为1.4*1.4平方微米。
  16. 根据权利要求12所述的双摄像头模组,其特征在于,所述图像合成模块进一步包括:
    第一提取子模块,用于提取所述第一图像中的第一色彩信号,以及提取所述第二图像中的第二亮度信号;
    第一合成子模块,用于将所述第一色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
  17. 根据权利要求12所述的双摄像头模组,其特征在于,所述图像合成模块进一步包括:
    第二提取子模块,用于提取所述第一图像中的第一色彩信号和第一亮度信号,以及提取所述第二图像中的第二亮度信号;
    第二合成子模块,用于将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号,并将所述第一色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
  18. 根据权利要求12所述的双摄像头模组,其特征在于,所述图像合成模块进一步包括:
    第三提取子模块,用于提取所述第一图像中的第一色彩信号和第一亮度信号,以及提取所述第二图像中的第二色彩信号和第二亮度信号;
    第三合成子模块,用于将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号,以及将所述第一亮度信号和所述第二亮度信号合成处理为第三亮度信号;并且将所述第三色彩信号和所述第三亮度信号进行合成处理以生成所述第三图像。
  19. 根据权利要求12所述的双摄像头模组,其特征在于,所述图像合成模块进一步包括:
    第四提取子模块,用于提取所述第一图像中的第一色彩信号,以及提取所述第二图像中的第二色彩信号和第二亮度信号;
    第四合成子模块,用于将所述第一色彩信号和所述第二色彩信号合成处理为第三色彩信号,以及将所述第三色彩信号和所述第二亮度信号进行合成处理以生成所述第三图像。
  20. 根据权利要求12~17任一项所述的双摄像头模组,其特征在于,所述第一摄像头为彩色摄像头,所述第二摄像头为黑白摄像头。
PCT/CN2014/089154 2014-10-22 2014-10-22 基于双摄像头模组的图像生成方法及双摄像头模组 WO2016061757A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201480079290.1A CN106464795A (zh) 2014-10-22 2014-10-22 基于双摄像头模组的图像生成方法及双摄像头模组
PCT/CN2014/089154 WO2016061757A1 (zh) 2014-10-22 2014-10-22 基于双摄像头模组的图像生成方法及双摄像头模组
EP14904333.3A EP3148177A4 (en) 2014-10-22 2014-10-22 Image generation method based on dual camera module and dual camera module
US15/385,269 US10212339B2 (en) 2014-10-22 2016-12-20 Image generation method based on dual camera module and dual camera apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/089154 WO2016061757A1 (zh) 2014-10-22 2014-10-22 基于双摄像头模组的图像生成方法及双摄像头模组

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/385,269 Continuation US10212339B2 (en) 2014-10-22 2016-12-20 Image generation method based on dual camera module and dual camera apparatus

Publications (1)

Publication Number Publication Date
WO2016061757A1 true WO2016061757A1 (zh) 2016-04-28

Family

ID=55760049

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/089154 WO2016061757A1 (zh) 2014-10-22 2014-10-22 基于双摄像头模组的图像生成方法及双摄像头模组

Country Status (4)

Country Link
US (1) US10212339B2 (zh)
EP (1) EP3148177A4 (zh)
CN (1) CN106464795A (zh)
WO (1) WO2016061757A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017067481A1 (zh) * 2015-10-23 2017-04-27 努比亚技术有限公司 一种移动终端及其处理图像的方法
CN106780330A (zh) * 2016-12-08 2017-05-31 中国人民解放军国防科学技术大学 一种基于彩色与黑白双摄像头的超分辨率重建方法
CN107707819A (zh) * 2017-09-29 2018-02-16 北京小米移动软件有限公司 图像拍摄方法、装置及存储介质
WO2018072267A1 (zh) * 2016-10-17 2018-04-26 华为技术有限公司 用于终端拍照的方法及终端

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014199338A2 (en) * 2013-06-13 2014-12-18 Corephotonics Ltd. Dual aperture zoom digital camera
JP6711612B2 (ja) * 2015-12-21 2020-06-17 キヤノン株式会社 画像処理装置、画像処理方法、および撮像装置
US10701256B2 (en) 2016-06-12 2020-06-30 Apple Inc. Switchover control techniques for dual-sensor camera system
US10165194B1 (en) * 2016-12-16 2018-12-25 Amazon Technologies, Inc. Multi-sensor camera system
US11300521B2 (en) 2017-06-14 2022-04-12 Camtek Ltd. Automatic defect classification
US11076083B2 (en) * 2019-11-19 2021-07-27 Lumileds Llc Multi-color flash with image post-processing
US11361460B2 (en) 2019-11-19 2022-06-14 Lumileds Llc Multi-color flash with image post-processing
US11605153B1 (en) * 2022-01-03 2023-03-14 Microsoft Technology Licensing, Llc Generate super-resolution images from sparse color information
US11676250B1 (en) * 2022-01-03 2023-06-13 Microsoft Technology Licensing, Llc Use motion data to generate higher resolution images

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100283863A1 (en) * 2009-05-11 2010-11-11 Sony Corporation Imaging device
CN103024272A (zh) * 2012-12-14 2013-04-03 广东欧珀移动通信有限公司 移动终端的双摄像头控制装置、方法、系统以及移动终端
CN103780840A (zh) * 2014-01-21 2014-05-07 上海果壳电子有限公司 一种高品质成像的双摄像成像装置及其方法
CN104010135A (zh) * 2013-02-26 2014-08-27 三星电子株式会社 拍摄图像的设备和方法

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3697675A (en) * 1970-12-23 1972-10-10 Terry D Beard Stereoscopic television system
US5045932A (en) * 1989-06-29 1991-09-03 Eastman Kodak Company Method and apparatus for generating a high definition electronic signal from a line scan of a color original
US5852502A (en) * 1996-05-31 1998-12-22 American Digital Imaging, Inc. Apparatus and method for digital camera and recorder having a high resolution color composite image output
CA2264777A1 (en) * 1996-09-30 1998-04-09 Karl L. Chase Reduced cost high resolution color camera
US6614471B1 (en) * 1999-05-10 2003-09-02 Banctec, Inc. Luminance correction for color scanning using a measured and derived luminance value
JP3807721B2 (ja) * 2000-02-21 2006-08-09 シャープ株式会社 画像合成装置
WO2004001667A2 (en) * 2002-06-21 2003-12-31 The Trustees Of Columbia University In The City Of New York Systems and methods for de-blurring motion blurred images
JP2007028408A (ja) * 2005-07-20 2007-02-01 Fuji Xerox Co Ltd 画像処理装置
US7855752B2 (en) * 2006-07-31 2010-12-21 Hewlett-Packard Development Company, L.P. Method and system for producing seamless composite images having non-uniform resolution from a multi-imager system
US7667762B2 (en) * 2006-08-01 2010-02-23 Lifesize Communications, Inc. Dual sensor video camera
US20100201831A1 (en) * 2009-02-10 2010-08-12 Weinstein Larry R Digital camera with asymmetrically configured sensors
US8749635B2 (en) * 2009-06-03 2014-06-10 Flir Systems, Inc. Infrared camera systems and methods for dual sensor applications
US20110115954A1 (en) * 2009-11-19 2011-05-19 Eastman Kodak Company Sparse color pixel array with pixel substitutes
JP5545016B2 (ja) * 2010-05-12 2014-07-09 ソニー株式会社 撮像装置
JP2011239259A (ja) * 2010-05-12 2011-11-24 Sony Corp 画像処理装置、画像処理方法及びプログラム
US9930316B2 (en) * 2013-08-16 2018-03-27 University Of New Brunswick Camera imaging systems and methods
EP2630802B1 (en) * 2010-10-22 2019-12-04 University of New Brunswick Camera imaging systems and methods
JP5816015B2 (ja) * 2011-07-15 2015-11-17 株式会社東芝 固体撮像装置及びカメラモジュール
CN102263904B (zh) * 2011-08-17 2013-06-26 华为终端有限公司 双摄像头的控制方法、系统及具有双摄像头的电子设备
US8970706B2 (en) * 2011-09-22 2015-03-03 Basil Henry Scott Dual pixel pitch imaging array with extended dynamic range
CN102722080B (zh) * 2012-06-27 2015-11-18 杭州南湾科技有限公司 一种基于多镜头拍摄的多用途立体摄像方法
CN105556944B (zh) * 2012-11-28 2019-03-08 核心光电有限公司 多孔径成像系统和方法
US9706116B2 (en) * 2013-10-31 2017-07-11 Ricoh Co., Ltd. Plenoptic color imaging system with enhanced resolution
WO2016041079A1 (en) * 2014-09-16 2016-03-24 University Of New Brunswick Optical sensor systems and image processing methods for remote sensing
US9319585B1 (en) * 2014-12-18 2016-04-19 Omnivision Technologies, Inc. High resolution array camera
JP2017098863A (ja) * 2015-11-27 2017-06-01 ソニー株式会社 情報処理装置、および情報処理方法、並びにプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100283863A1 (en) * 2009-05-11 2010-11-11 Sony Corporation Imaging device
CN103024272A (zh) * 2012-12-14 2013-04-03 广东欧珀移动通信有限公司 移动终端的双摄像头控制装置、方法、系统以及移动终端
CN104010135A (zh) * 2013-02-26 2014-08-27 三星电子株式会社 拍摄图像的设备和方法
CN103780840A (zh) * 2014-01-21 2014-05-07 上海果壳电子有限公司 一种高品质成像的双摄像成像装置及其方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3148177A4 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017067481A1 (zh) * 2015-10-23 2017-04-27 努比亚技术有限公司 一种移动终端及其处理图像的方法
WO2018072267A1 (zh) * 2016-10-17 2018-04-26 华为技术有限公司 用于终端拍照的方法及终端
US10827140B2 (en) 2016-10-17 2020-11-03 Huawei Technologies Co., Ltd. Photographing method for terminal and terminal
CN106780330A (zh) * 2016-12-08 2017-05-31 中国人民解放军国防科学技术大学 一种基于彩色与黑白双摄像头的超分辨率重建方法
CN107707819A (zh) * 2017-09-29 2018-02-16 北京小米移动软件有限公司 图像拍摄方法、装置及存储介质
CN107707819B (zh) * 2017-09-29 2021-04-13 北京小米移动软件有限公司 图像拍摄方法、装置及存储介质

Also Published As

Publication number Publication date
EP3148177A1 (en) 2017-03-29
CN106464795A (zh) 2017-02-22
US20170099435A1 (en) 2017-04-06
US10212339B2 (en) 2019-02-19
EP3148177A4 (en) 2018-01-24

Similar Documents

Publication Publication Date Title
WO2016061757A1 (zh) 基于双摄像头模组的图像生成方法及双摄像头模组
US11496696B2 (en) Digital photographing apparatus including a plurality of optical systems for acquiring images under different conditions and method of operating the same
JP5450739B2 (ja) 画像処理装置及び画像表示装置
EP3067746B1 (en) Photographing method for dual-camera device and dual-camera device
US20140071245A1 (en) System and method for enhanced stereo imaging
US20160065862A1 (en) Image Enhancement Based on Combining Images from a Single Camera
JP2019030007A (ja) 複数のカメラを用いて映像を取得するための電子装置及びこれを用いた映像処理方法
US20130039568A1 (en) Image processing apparatus, image processing method, and recording medium
US10616502B2 (en) Camera preview
JP7249766B2 (ja) 情報処理装置、システム、情報処理装置の制御方法、及び、プログラム
KR20190082080A (ko) 피처 매칭을 이용하는 멀티-카메라 프로세서
CN108419009B (zh) 图像清晰度增强方法和装置
US10572764B1 (en) Adaptive stereo rendering to reduce motion sickness
WO2023160617A9 (zh) 视频插帧处理方法、视频插帧处理装置和可读存储介质
JP2023169254A (ja) 撮像素子、撮像素子の作動方法、プログラム、及び撮像システム
WO2021092887A1 (en) Display shade compensation for cameras
CN109309784B (zh) 移动终端
US9288397B2 (en) Imaging device, method for processing image, and program product for processing image
US10282633B2 (en) Cross-asset media analysis and processing
US11451743B2 (en) Control of image output
KR101879813B1 (ko) 눈 맞춤 가능한 영상 촬영 핸드폰
WO2023097576A1 (en) Segmentation with monocular depth estimation
US20230336682A1 (en) Image processing apparatus, method of controlling image processing apparatus, and program storage
KR20140102900A (ko) 휴대 단말기의 영상 캡쳐 장치 및 방법
TW202403676A (zh) 中央凹感測

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14904333

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2014904333

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014904333

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE