WO2015149583A1

WO2015149583A1 - Terminal and terminal shooting method

Info

Publication number: WO2015149583A1
Application number: PCT/CN2015/071992
Authority: WO
Inventors: 肖立锋
Original assignee: 宇龙计算机通信科技(深圳)有限公司
Priority date: 2014-03-31
Filing date: 2015-01-30
Publication date: 2015-10-08
Also published as: CN103888672A

Abstract

Provided in the present invention are a terminal and a terminal shooting method. The terminal comprises a shooting module, a control module and a synthesis module, wherein the shooting module comprises a plurality of cameras, and the plurality of cameras are low-resolution cameras and used for shooting the same scene; the control module is used for controlling the shooting module to conduct synchronous shooting, so as to obtain a plurality of low-resolution pictures; the synthesis module is used for synthesizing the plurality of low-resolution pictures shot by the shooting module at a certain moment into a high-resolution picture. By implementing the present invention, the pictures of the same scene are collected and synthesized into a high-resolution picture by means of mutual cooperation of the plurality of low-resolution cameras; in this way, the shooting effect of a high-resolution camera can be achieved without increasing the thickness of camera modules. Solved is the problem in the prior art that the thickness of camera modules increases when the shooting resolution of the terminal is provided, and user experience is improved.

Description

Terminal and terminal shooting method

The present application claims priority to Chinese Patent Application No. 201410126743.3, filed on March 31, 2014, the entire disclosure of which is incorporated herein by reference. .

Technical field

The present invention relates to the field of terminal photography, and in particular to a terminal and a terminal shooting method for reducing the thickness of a camera module.

Background technique

As the performance requirements of the terminal such as the mobile phone become higher and higher, the resolution of the camera set on the mobile phone is also larger and larger, and the resolution of the camera needs to increase the thickness of the camera module; the increase of the thickness of the camera module will result in an increase in the thickness of the camera module. The overall thickness of the mobile phone or the thickness of the part of the mobile phone camera increases, which is inconsistent with the user's demand for thinning the mobile phone, which will also reduce the user experience.

Therefore, how to provide a terminal that can provide a camera imaging resolution without increasing the thickness of the camera module is a technical problem to be solved by those skilled in the art.

Summary of the invention

The present invention provides a terminal and terminal photographing method to solve the problem of increasing the thickness of the camera module caused by providing the camera imaging resolution in the prior art.

The present invention provides a terminal. In one embodiment, the terminal includes a camera module, a control module, and a synthesis module. The camera module includes a plurality of cameras, the plurality of cameras are low-resolution cameras, and the plurality of cameras are used for shooting. The same scene; the control module is used to control the camera module to synchronously capture and obtain multiple low-resolution photos; the synthesis module is used to capture multiple low scores of the camera module at a certain moment. Resolution photo synthesis of high resolution photos.

Further, the synthesizing module in the above embodiment is specifically configured to synthesize a plurality of low-resolution photos into a high-resolution photo by using an image super-resolution reconstruction technique.

Further, the terminal in the above embodiment further includes a display module, and the display module is configured to display a high resolution photo.

Further, the terminal in the above embodiment further includes a storage module, and the storage module is configured to store a high resolution photo.

Further, the plurality of cameras in the above embodiment are placed side by side, and at least two of the plurality of cameras are in contact with each other.

Further, at least two of the plurality of cameras in the above embodiment have the same resolution.

Further, at least two of the plurality of cameras in the above embodiment adopt different Bayer structures.

The present invention provides a terminal photographing method for the terminal provided by the present invention. In one embodiment, the method for photographing the terminal includes: controlling the camera module to synchronously capture, acquiring multiple low-resolution photos; and positioning the camera module at a certain Combine multiple low-resolution photos taken at any time to synthesize high-resolution photos.

Further, the terminal photographing method in the above embodiment further includes: displaying a high resolution photo.

Further, the method for photographing the terminal in the above embodiment further includes: storing a high resolution photo.

The beneficial effects of the invention:

The terminal and the terminal photographing method provided by the invention provide a plurality of low-resolution cameras in the terminal, and use the low-resolution cameras to simultaneously capture the same scene, obtain a plurality of low-resolution photos, and then utilize the low Resolution of photos to synthesize high resolution photos, while synthetic high The resolution photo is a high-resolution photo of the same scene, that is, the invention cooperates with multiple low-resolution cameras to collect photos and synthesize high-resolution photos of the same scene, so that the high-resolution camera can be achieved. The shooting effect does not increase the thickness of the camera module, and solves the problem that the thickness of the camera module is increased when the terminal imaging resolution is provided in the prior art, and the user experience is enhanced.

DRAWINGS

1 is a schematic diagram of functional modules of a terminal according to a first embodiment of the present invention;

2 is a flowchart of a terminal imaging method according to a second embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a camera module according to a third embodiment of the present invention.

detailed description

The invention will now be further illustrated by way of specific embodiments in conjunction with the accompanying drawings.

The core idea of the invention is to replace the high-resolution camera by a plurality of low-resolution cameras, so that the thickness of the camera module is reduced under the premise that the resolution of the picture taken by the terminal is unchanged, so that the terminal such as a mobile phone It is possible to maximize the imaging resolution without the product thickness limitation. The terminal involved in the present invention includes a smart device such as a mobile phone or a tablet. The shooting involved in the present invention is not limited to photographing, video, and the like. The following is an example of photographing, and the video is synthesized by chronologically. That is, the present invention is equally applicable to video shooting.

First embodiment:

FIG. 1 is a schematic diagram of a functional module of a terminal according to a first embodiment of the present invention. As shown in FIG. 1 , in the embodiment, the terminal 1 includes a camera module 11 , a control module 12 , and a synthesizing module 13 .

The camera module 11 includes a plurality of cameras, and the plurality of cameras are low-resolution cameras. The plurality of cameras are used to capture the same scene. Specifically, the camera module 11 is a camera module part in a terminal such as a mobile phone, and multiple external scenes are performed. Image sampling (such as taking pictures, recording video, etc.), the thickness of the camera module 11 often depends on the thickness of its internal camera, and the thickness of the camera is proportional to the resolution of the camera, that is, the thickness of the camera module 11 and the resolution of the cameras within it. The ratio is proportional, therefore, in the present invention, replacing the high resolution camera with a low resolution camera reduces the thickness of the camera module 11;

The control module 12 is configured to control the camera module 11 to synchronously capture and acquire a plurality of low-resolution photos. Specifically, the terminal can take a picture or record by using a camera. Therefore, the terminal also has a camera mode and a video mode, and then, when the terminal is in the camera mode, The control module 12 controls the camera module 11 to synchronously capture the same scene to obtain multiple low-resolution photos (for example, each camera obtains a photo), and when the terminal is in the recording mode, the control module 12 controls the camera module 11 to sequentially access the same scene. Simultaneous shooting, obtaining multiple sets of low-resolution photos (a set of multiple low-resolution photos engraved with the same scene at the same time);

The synthesizing module 13 is configured to synthesize high-resolution photos of the plurality of low-resolution photos taken by the camera module at a certain moment; specifically, when the terminal is in the photographing mode, the synthesizing module 13 obtains the photographing module 11 for simultaneous shooting of the same scene. The plurality of low-resolution photos are combined to generate a high-resolution photo of the scene at the moment, and when the terminal is in the recording mode, the synthesizing module 13 sequentially captures the plurality of groups acquired by the camera module 11 in the same scene. Low-resolution photos are combined into a variety of high-resolution photos, which are processed in chronological order to produce high-resolution video.

The embodiment shown in FIG. 1 cooperates with a plurality of low-resolution cameras to collect photos and synthesize high-resolution photos of the same scene, so that the high-resolution camera can be achieved without increasing the thickness of the camera module. .

In some embodiments, the synthesizing module 13 is specifically configured to synthesize a plurality of low-resolution photos into a high-resolution photo by using an image super-resolution reconstruction technique; specifically, the synthesizing module 13 may adopt an image super-resolution reconstruction technique (Super Resolution) The image synthesis algorithm combines two images, within the acceptable range of image resolution, the dual 8MP pixel resolution image can synthesize 13MP pixel resolution image, and the dual 13MP pixel resolution image can synthesize 20MP pixel resolution image; The working mechanism of the synthesizing module 13 can adopt the existing image synthesizing process, and details are not described herein again.

In some embodiments, the terminal shown in FIG. 1 further includes a display module, and the display module is configured to display a high-resolution photo. Specifically, the display module is configured to display the high-resolution image synthesized by the synthesis module to the user for selection by the user. Whether to save, etc., the display module can also display the low-resolution image before synthesis of the composite module to the user, so that the user can select to save the low-resolution image and/or the high-resolution image according to actual needs.

In some embodiments, the terminal shown in FIG. 1 further includes a storage module, where the storage module is configured to store a high-resolution photo. Specifically, the storage module is configured to store the high-resolution image synthesized by the synthesis module for subsequent use by the user. The storage module can also store the low-resolution images before the synthesis of the composite module at the same time, so that the user can select other low-resolution images and/or high-resolution images for other operations according to actual needs, such as using low resolution when sending multimedia messages. Rate images, use high-resolution images when making covers.

In some embodiments, the plurality of cameras in the camera module 11 shown in FIG. 1 are placed side by side, at least two of the plurality of cameras are in contact; and the plurality of cameras are placed side by side such that the captured photos and scenes are The objects are at the same angle, so that the data of each pixel in the synthesized high-resolution photo does not conflict, and the synthesis effect is better; and when the two cameras are in direct contact with each other, the overlapping area of the two photos taken is It can be maximized, so that the pixel data of the overlapping area in the synthesized high-resolution photo is maximized, and the synthesis effect is also better.

In some embodiments, at least two of the plurality of cameras in the camera module 11 shown in FIG. 1 have the same resolution; the images collected by the camera of the same resolution are simple in synthesizing the algorithm, then The consumption of power to the terminal is also not obvious, and the user experience can be further enhanced.

In some embodiments, at least two of the plurality of cameras in the camera module 11 shown in FIG. 1 adopt different Bayer structures; specifically, the existing Bayer structure mainly includes a conventional RGB Bayer structure and an emerging one. RCCB Bayer structure, a method for synthesizing two photos taken by RGB Bayer structure, which has been described in the prior art, will not be described herein; preferably, in this embodiment, a camera is still a traditional RGB Bayer The structure is used to restore the pixel color, and the other camera adopts the RCCB structure to increase the amount of light incident, thereby improving the signal-to-noise ratio. This camera is used to restore the brightness of the scene, that is, the traditional camera is used to restore the scene. RGB color, RCCB sensor is used to restore the brightness information of the scene Y component, and the two images are processed by the synthesis algorithm. When the higher resolution image is synthesized, the signal to noise ratio is also improved. Further, if a camera is traditional The RGB Bayer structure is used to restore the color space of the scene, and the other camera does not use the Bayer structure at all, directly let each pixel The point receives the light of all ambient light. The data of this camera is used to restore the brightness to maximize the signal-to-noise ratio. The two algorithms are processed by software algorithm to synthesize higher resolution images and further improve. The signal to noise ratio.

Second embodiment:

FIG. 2 is a flowchart of a terminal imaging method according to a second embodiment of the present invention. As shown in FIG. 2, in the embodiment, the terminal imaging method provided by the present invention includes the following steps:

S201: controlling the camera module to synchronously capture and obtain a plurality of low-resolution photos;

S202: synthesize a plurality of low-resolution photos taken by the camera module at a certain moment to synthesize a high-resolution photo sheet.

In some embodiments, the terminal imaging method illustrated in FIG. 2 further includes displaying a high resolution photo after step S202.

In some embodiments, the terminal imaging method illustrated in FIG. 2 further includes, after step S202, storing a high resolution photo.

Third embodiment:

FIG. 3 is a schematic structural diagram of a camera module according to a third embodiment of the present invention. In this embodiment, a camera module in a terminal adopts a dual camera setting manner, and the two cameras are placed side by side and are in contact with each other, that is, two camera centers. The distance between the points is also the sum of the radii of the two cameras. Thus, the embodiment can realize the replacement of the high-resolution camera by using a plurality of low-resolution cameras, and the imaging effect is better, and the specific reference FIG. 3 Shown as follows:

After the two low-resolution cameras are placed side by side, the thickness of the camera module is determined by the camera with the highest resolution. If the resolutions of the two cameras are the same as shown in Figure 3, then the thickness of the camera module is one. The thickness of a low resolution camera that is less thick than a single high resolution camera;

If only the overlapping area is used as the effective area (that is, only the data in the overlapping area is synthesized), and the two low resolutions are in contact with each other, the overlapping area of the captured photos is larger, and the effective area is larger. This can provide users with a better camera angle and so on.

In summary, through the implementation of the present invention, at least the following beneficial effects exist:

Set up multiple low-resolution cameras in the terminal, and use these low-resolution cameras to simultaneously capture the same scene, acquire multiple low-resolution photos, and then use these low-resolution photos to synthesize high-resolution photos. , and the high-resolution photos after synthesis are the high resolution of the same scene. The photograph, that is, the invention cooperates with a plurality of low-resolution cameras to collect photos and synthesize high-resolution photos of the same scene, so that the high-resolution camera can be achieved without increasing the camera module. The thickness solves the problem that the thickness of the camera module is increased when the terminal imaging resolution is provided in the prior art, and the user experience is enhanced;

Further, using a plurality of Bayer-structured cameras enables at least one camera in the camera module to use an RCCB structure or no Bayer structure to enhance the signal-to-noise ratio of the synthesized high-resolution photos;

Further, at least two cameras in the camera module have the same resolution, which simplifies the image synthesis algorithm and reduces power consumption.

The above is only a specific embodiment of the present invention, and is not intended to limit the present invention in any way. Any simple modification, equivalent change, combination or modification of the above embodiments in accordance with the technical spirit of the present invention is still in the present invention. The scope of protection of the technical solution of the invention.

Claims

A terminal, comprising: a camera module, a control module and a synthesis module; wherein

The camera module includes a plurality of cameras, the plurality of cameras are low-resolution cameras, and the plurality of cameras are used to capture the same scene;

The control module is configured to control the camera module to synchronously capture and acquire a plurality of low-resolution photos;

The synthesizing module is configured to synthesize high-resolution photos of a plurality of low-resolution photos taken by the camera module at a certain moment.
The terminal according to claim 1, wherein the synthesizing module is specifically configured to synthesize the plurality of low-resolution photos into a high-resolution photo by using an image super-resolution reconstruction technique.
The terminal according to claim 1, wherein the terminal further comprises a display module, and the display module is configured to display the high resolution photo.
The terminal according to claim 1, wherein the terminal further comprises a storage module, and the storage module is configured to store the high resolution photo.
The terminal according to any one of claims 1 to 4, wherein the plurality of cameras are placed side by side, and at least two of the plurality of cameras are in contact.
The terminal according to any one of claims 1 to 4, wherein at least two of the plurality of cameras have the same resolution.
The terminal according to any one of claims 1 to 4, characterized in that at least two of the plurality of cameras employ different Bayer structures.
A terminal photographing method, characterized in that, for the terminal according to any one of claims 1 to 7, the terminal photographing method comprises:

Controlling the camera module to synchronously capture and obtain a plurality of low-resolution photos;

A plurality of low-resolution photographs taken by the camera module at a certain moment are combined into a high-resolution photograph.
The terminal photographing method according to claim 8, wherein the terminal photographing method further comprises: displaying the high resolution photograph.
The terminal photographing method according to claim 8 or 9, wherein the terminal photographing method further comprises: storing the high resolution photograph.