WO2019006762A1

WO2019006762A1 - Image capturing apparatus and method

Info

Publication number: WO2019006762A1
Application number: PCT/CN2017/092286
Authority: WO
Inventors: 罗巍; 陈刚; 杜成; 朱聪超; 唐忠伟; 唐玮; 敖欢欢
Original assignee: 华为技术有限公司
Priority date: 2017-07-07
Filing date: 2017-07-07
Publication date: 2019-01-10
Also published as: CN109923850B; CN109923850A

Abstract

Disclosed are an image capturing apparatus and method. The apparatus comprises: a wide-angle colour camera, a wide-angle black-and-white camera, a telephoto camera, a processor and a memory, wherein the wide-angle colour camera, the wide-angle black-and-white camera and the telephoto camera are arranged on the same side of a housing of the image capturing apparatus; the angles of view of the wide-angle black-and-white camera and the wide-angle colour camera are the same, and the angle of view of the telephoto camera is smaller than the angle of view of the wide-angle colour camera; the memory is used to store a static or dynamic image, captured by at least one of the wide-angle colour camera, the wide-angle black-and-white camera and the telephoto camera, of an object to be photographed; and the processor is used to process the static or dynamic image, so as to obtain an image of the object to be photographed.

Description

Image capturing device and method

Technical field

The present application relates to the field of image processing technologies, and in particular, to an image capturing device and method.

Background technique

In order to improve the photographing effect, the industry proposes to set a dual camera in the image capturing device, and use the difference between the image information captured by the two cameras to complement the image information, thereby improving the quality of the captured image. Especially for mobile phone manufacturers, dual camera systems are becoming more and more popular, and are gradually becoming the standard for all mobile phones.

However, in reality, the image capturing device currently equipped with a dual camera simply combines the images acquired by the two cameras when capturing an image. In this way, it is impossible to take higher quality images in various scenes. For example, the image capturing device is configured with a wide-angle and telephoto dual camera, and the image capturing device respectively acquires two images through the two cameras, and then fuses the two images to obtain a final captured image. Since the wide-angle camera has a large field of view, it is suitable for close-range shooting. The telephoto camera has a small field of view and is suitable for long-range shooting. The final image obtained by the fusion of the two images obtained by the two cameras whose field of view angles are not matched has a poor stereoscopic effect and poor image quality.

It can be seen that even in the current image capturing device, even if a dual camera is disposed, it is still impossible to obtain a high quality image in various scenes.

Summary of the invention

The application provides an image capture device and method for improving image capture quality.

In a first aspect, the present application provides an image capture device. The image capturing device comprises: a wide-angle color camera, a wide-angle black-and-white camera, a telephoto camera, a processor and a memory; wherein the wide-angle color camera, the wide-angle black-and-white camera and the telephoto camera are disposed on the same side of the housing of the image capturing device; The field of view of the camera and the wide-angle color camera are the same, the field of view of the telephoto camera is smaller than the field of view of the wide-angle color camera; and the memory is used to store at least one of the wide-angle color camera, the wide-angle black-and-white camera, or the telephoto camera. A static or moving image of the object is taken; the processor is configured to process the static or dynamic image to obtain an image of the object to be photographed.

In the present application, the image capturing device has three cameras, which are a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera. Each of the three cameras has advantages. For example, the wide-angle black-and-white camera has a large field of view, which is suitable for shooting close-ups. With strong ability to capture the details of the object to be photographed, the wide-angle color camera has a larger field of view, which is suitable for shooting close-ups and has a strong ability to capture the color information of the object to be photographed, while the telephoto camera has a larger field of view. Small, suitable for shooting distant views. The image capturing device can take advantage of the advantages of the three cameras to obtain an image of a better-quality object to be photographed under different scenes (such as close-up, distant view, etc.), thereby improving image capturing quality.

In one possible design, the wide-angle color camera is located between the wide-angle black and white camera and the telephoto camera.

In the present application, since the wide angle color camera has a large field of view and a color image can be obtained, the image capturing device can use the wide-angle color camera as the main camera, and the other two cameras can serve as the auxiliary camera. When the wide-angle color camera is set between the wide-angle black-and-white camera and the telephoto camera, the wide-angle color camera can capture more information about the object to be photographed in the main field of view.

In one possible design, the telephoto camera is a telephoto color camera.

In the present application, since the telephoto camera is suitable for shooting distant scenes, if the telephoto camera is a telephoto color camera, the image capturing device can obtain color information of the distant scene. And the three cameras in the image capture device can be switched between. For example, when switching from a close-up to a distant view, since the telephoto camera is suitable for shooting a distant view, the image capturing device can be switched from a wide-angle color camera and a wide-angle black-and-white camera to a telephoto camera. Since the telephoto camera is a color camera, the image change after switching can be ensured. It won't be awkward.

In one possible design, the telephoto camera is a built-in camera, the wide-angle color camera and the wide-angle black-and-white camera are disposed on the external components of the image capture device, and the external accessories are rotatably connected to the frame of the image capture device, and the external accessories are The angle formed between the display screens of the image capture device is any angle between 0 and 360 degrees.

In the present application, a wide-angle color camera and a wide-angle black-and-white camera among the three cameras provided in the image capturing device may be disposed on an external component of the image capturing device. When the external accessory is rotated, the wide-angle color camera and the wide-angle black-and-white camera rotate simultaneously. Taking the image capture device as a mobile phone as an example, if the user wants to take a self-portrait with the mobile phone, the rotating external accessory is facing the user, that is, through the wide-angle color camera and the wide-angle black-and-white camera, a self-portrait image with higher quality has been obtained.

In a second aspect, the present application provides an image capturing method, which can be implemented by a device including a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto color camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same angle of view, And the field of view of the telephoto color camera is smaller than the field of view of the wide-angle color camera, the resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the telephoto color camera; the method includes: receiving a zoom instruction, the zoom instruction is used to The current preview image of the device is scaled; if the scaling ratio corresponding to the zoom instruction is less than or equal to the preset ratio, the wide-angle color camera and the wide-angle black-and-white camera respectively acquire the image captured by the captured object; and output an image of the object to be photographed, wherein, The image of the captured object is obtained by fusing the image captured by the wide-angle color camera and the wide-angle black-and-white camera; or if the zoom ratio corresponding to the zoom ratio is greater than the preset ratio, obtaining the wide-angle black-and-white camera and the telephoto color camera simultaneously capturing the image captured by the captured object ; An output image of an object to be photographed, wherein the image of the object to be photographed after the camera wide angle and telephoto white color camera captured image obtained by fusion.

Generally, in the process of gradually increasing the zoom ratio, that is, the user gradually enlarges the preview image, the sharpness of the image gradually decreases, and the user can obviously feel that the enlarged image is blurred. In the present application, the image capturing device may select different cameras from among the three cameras to capture images of the object to be photographed according to different scaling ratios. When the zoom ratio is small, the image capturing device captures an image of the object to be photographed by the wide-angle color camera and the wide-angle black-and-white camera. When the zoom ratio is large, the image capturing device captures the object to be photographed through the wide-angle black-and-white camera and the telephoto color camera. Image, because the wide-angle black-and-white camera has a large resolution, so in the process of gradually increasing the zoom ratio, although the wide-angle color camera is switched to a focal-focus color camera, the resolution can be ensured not to decrease.

In a possible design, before acquiring the image captured by the object to be photographed, the method further comprises: determining a brightness value of a scene in which the object to be photographed is located; and controlling the wide-angle color camera and the wide-angle black according to the brightness value respectively Each camera in the white camera and the telephoto color camera captures an image of the corresponding number of frames.

In the present application, the image capturing device can determine the image of how many frames each camera captures by the brightness value of the scene where the object to be photographed is located. For example, when the scene is bright, each camera can capture images with fewer frames, and the scene is compared. When dark, each camera can capture images with more frames.

In a possible design, each camera captures an image of the corresponding number of frames according to the brightness value, including: if the brightness value is greater than the first preset brightness value, controlling each camera to capture the P frame image; or if the brightness value is less than Equal to the second preset brightness value, controlling each camera to capture the Q frame image; wherein, the second preset brightness value is less than the first preset brightness value, P, Q are positive integers, and P is greater than Q.

In one possible design, before outputting the image of the object to be photographed, the method further comprises: determining depth information of the scene in which the object to be photographed is located; and processing the obtained image captured by the object to be photographed according to the depth information.

In the present application, the image capturing device can process the obtained image captured by the object to be photographed according to the depth information of the scene in which the object to be photographed is located, thereby improving the stereoscopic and layered feeling of the image.

In a third aspect, the present application provides an image capturing method, which can be implemented by a device including a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto black-and-white camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same angle of view, The field of view of the telephoto black and white camera is smaller than the field of view of the wide-angle color camera. The resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the telephoto color camera. The method includes: receiving a zoom instruction, and the zoom instruction is used to preview the current image of the device. If the zoom ratio corresponding to the zoom instruction is less than or equal to the preset ratio, the wide-angle color camera and the wide-angle black-and-white camera respectively acquire the image captured by the captured object; and output an image of the object to be photographed, wherein the image of the object to be photographed is The image captured by the wide-angle color camera and the wide-angle black-and-white camera is merged; or if the zoom ratio corresponding to the zoom ratio is greater than the preset ratio, the wide-angle color camera and the telephoto black-and-white camera are simultaneously taken to the image captured by the captured object; Subject image, wherein, to obtain the image of an object to be photographed is fused color camera wide angle and telephoto camera to capture monochrome images.

Generally, in the process of gradually increasing the zoom ratio, that is, the user gradually enlarges the preview image, the sharpness of the image gradually decreases, and the user can obviously feel that the enlarged image is blurred. In the present application, the image capturing device may select an appropriate camera from among the three cameras to capture an image of the object to be photographed according to different scaling ratios. When the zoom ratio is small, the image capturing device captures the image of the object to be photographed by the wide-angle color camera and the wide-angle black-and-white camera. When the zoom ratio is large, the image capturing device captures the object to be photographed through the wide-angle color camera and the telephoto black-and-white camera. Image, because the wide-angle black-and-white camera has a large resolution, so in the process of gradually increasing the zoom ratio, although the wide-angle black-and-white camera is switched to the black-and-white camera, the resolution is not reduced.

In a possible design, before acquiring the image captured by the object to be photographed, the method further comprises: determining a brightness value of the scene where the object to be photographed is located; and controlling the wide-angle color camera, the wide-angle black and white camera, and the telephoto black and white according to the brightness value respectively. Each camera in the camera captures an image of the corresponding number of frames.

In the present application, the image capturing device can determine the image of how many frames each camera captures by the brightness value of the scene in which the object to be photographed is located. For example, when the scene is bright, each camera can capture images of fewer frames. When the scene is dark, each camera can capture images with more frames.

In a possible design, before outputting the image of the object to be photographed, the method further comprises: determining depth information of the scene in which the object to be photographed is located; and processing the obtained image captured by the object to be photographed according to the depth information .

In a fourth aspect, the present application provides an image capturing method, which can be implemented by a device including a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto black-and-white camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same angle of view, And the field of view of the telephoto black and white camera is smaller than the angle of view of the wide-angle color camera, the method includes: determining a scene in which the object to be photographed is located; if the scene is a distant view, acquiring a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera respectively The image captured by the object to be photographed; the depth information of the scene is determined according to the first image acquired by the wide-angle color camera and the second image captured by the wide-angle black and white camera; and the first pre-capture image is processed according to the depth information to obtain an image of the object to be photographed; The first pre-captured image is obtained by fusing the first image, the second image, and the third image captured by the telephoto camera.

In the present application, the image capturing device includes three cameras: a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera. Each of the three cameras has advantages. For example, the wide-angle black-and-white camera is suitable for capturing close-ups and capturing the details of the object to be photographed. The strong, wide-angle color camera is suitable for shooting close-ups and has the ability to capture color information of objects to be photographed, while the telephoto camera is suitable for shooting distant scenes. Since the angle of view of the wide-angle color camera and the wide-angle black-and-white camera are the same, the image capturing device can obtain the depth information of the scene based on the two cameras, and then process the first pre-shot image according to the depth information, so that the final image to be captured is obtained. The image of the object has a strong sense of three-dimensionality.

In a possible design, the method further comprises: if the scene is a close-up, acquiring a wide-angle color camera and a wide-angle black-and-white camera respectively to simultaneously capture an image captured by the captured object; the third image acquired by the wide-angle color camera and the wide-angle black-and-white camera. The four images determine the depth information of the scene; the second pre-capture image is processed according to the scene depth information to obtain an image of the object to be photographed; and the second pre-capture image is obtained by fusing the third image and the fourth image.

In the present application, if the scene is a close-up, the image capturing device can acquire an image captured by the wide-angle color camera and the wide-angle black-and-white camera at the same time as the object to be photographed. Since the wide-angle black-and-white camera captures images, the ability to capture detailed information of the object to be photographed is strong. The wide-angle color camera has a strong ability to capture the color information of the object to be photographed when the image is captured. Therefore, the image capturing device combines the images acquired by the wide-angle color camera and the wide-angle black-and-white camera to obtain a higher quality image of the object to be photographed.

In a possible design, before acquiring the image captured by the object to be photographed, the method further comprises: determining a brightness value of the scene; and separately controlling the wide-angle color camera, the wide-angle black-and-white camera, and the long-focus camera according to the brightness value. Each camera in the head captures an image of the corresponding number of frames.

In a possible design, according to the brightness value, each camera is separately controlled to collect an image of the corresponding number of frames, including if the brightness value is greater than the first preset brightness value, then each camera is controlled to acquire a P frame image; or if the brightness value is less than And equal to the second preset brightness value, controlling each camera to collect the Q frame image; wherein, the second preset brightness value is less than the first preset brightness value, P, Q are positive integers, and P is greater than Q.

In a fifth aspect, the present application provides an image capture device. The image capture device has the function of implementing the image capture device in the method design of the second aspect described above. These functions can be implemented in hardware or in software by executing the corresponding software. The hardware or software includes one or more units corresponding to the functions described above.

In one possible design, the specific structure of the image capture device may include an input unit, a processing unit, and an output unit. These units may perform the respective functions of the methods provided by any of the possible aspects of the second aspect or the second aspect described above.

In a sixth aspect, the present application provides an image capture device. The image capture device has the function of implementing the image capture device in the method design of the third aspect described above. These functions can be implemented in hardware or in software by executing the corresponding software. The hardware or software includes one or more units corresponding to the functions described above.

In one possible design, the specific structure of the image capture device may include an input unit, a processing unit, and an output unit. These units may perform the respective functions of the methods provided by any of the possible aspects of the third aspect or the third aspect described above.

In a seventh aspect, the present application provides an image capture device. The image capture device has the function of implementing the image capture device in the method design of the fourth aspect described above. These functions can be implemented in hardware or in software by executing the corresponding software. The hardware or software includes one or more units corresponding to the functions described above.

In one possible design, the specific structure of the image capture device may include a processing unit and an output unit. These units may perform the respective functions of the methods provided by any of the possible designs of the fourth aspect or the fourth aspect described above.

In an eighth aspect, the present application also provides an image capture device. The image capture device has the function of implementing the image capture device in the method design of the third aspect described above. These features can be implemented in hardware. The image capture device includes a memory for storing computer executable program code, a processor coupled to the memory. Wherein the program code stored in the memory comprises instructions which, when executed by the processor, cause the image capture device to perform the method performed by the image capture device in any one of the possible aspects of the third aspect or the third aspect above .

In a ninth aspect, the present application also provides an image capture device. The image capture device has the function of implementing the image capture device in the method design of the fourth aspect described above. These features can be implemented in hardware. The image capture device includes a memory for storing computer executable program code, a processor coupled to the memory. Wherein the program code stored in the memory comprises instructions which, when executed by the processor, cause the image capture device to perform the image capture device executed in any one of the possible aspects of the fourth aspect or the fourth aspect described above method.

In a tenth aspect, the application further provides an image capture device. The image capture device has the function of implementing the image capture device in the method design of the fifth aspect described above. These features can be implemented in hardware. The image capture device includes a memory for storing computer executable program code, a processor coupled to the memory. Wherein the program code stored in the memory comprises instructions which, when executed by the processor, cause the image capture device to perform the method performed by the image capture device in any one of the possible aspects of the fifth aspect or the fifth aspect above .

In an eleventh aspect, the present application further provides a computer readable storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the image capture method of the second aspect described above.

In a twelfth aspect, the present application further provides a computer readable storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the image capture method of the above third aspect.

In a thirteenth aspect, the present application further provides a computer readable storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the image capture method of the above fourth aspect.

In a fourteenth aspect, the present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the image capture method of the second aspect described above.

In a fifteenth aspect, the present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the image capture method of the third aspect above.

In a sixteenth aspect, the present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the image capture method of the fourth aspect described above.

In the present application, the image capturing device has three cameras: a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera. Each of the three cameras has advantages. For example, the wide-angle black-and-white camera has a larger field of view, which is suitable for shooting close-ups and has stronger The ability to capture the details of the object to be photographed, the angle of view of the wide-angle color camera is larger for shooting close-ups and has a stronger ability to capture the color information of the object to be photographed, while the telephoto camera has a smaller field of view for shooting . The image capturing device can take advantage of the advantages of the three cameras to obtain an image of a better-quality object to be photographed under different scenes (such as close-up, distant view, etc.), thereby improving image capturing quality.

DRAWINGS

1 is a block diagram of an image capture device provided by the present application;

2 is a flowchart of an image capturing method provided by the present application;

FIG. 3 is a flowchart of another image capturing method provided by the present application; FIG.

4 is a sorting manner between three cameras in the image capturing device provided by the present application;

FIG. 5 is a schematic structural diagram of an image capturing device provided by the present application; FIG.

FIG. 6 is a schematic structural diagram of another image capturing apparatus provided by the present application; FIG.

FIG. 7 is a schematic structural diagram of another image capturing device provided by the present application.

Detailed ways

The technical solutions provided by the present application will be clearly and completely described below in conjunction with the drawings in the present application.

Hereinafter, some of the terms in the present application will be explained to be understood by those skilled in the art.

(1) The scene can be understood as the object and the environment in which the object is located. Generally, the environment in which the object is located can be large or small, for example, the environment in which the object is located can be broad, such as mountains, sky, and the like. Of course, the environment in which the object is located can also be narrow, such as a room, or a simple desk. Therefore, in order to enable the image capturing device to understand and describe the scene like a human, the scene recognition capability is also an important reference indicator for whether the image capturing device is intelligent.

(2) The preview image is an image that the image capturing device presents on the shooting preview interface before the image is captured. The user views the shooting effect through the preview image. If the user is satisfied with the shooting effect of the preview image, the user can click the “shooting” button to capture the image.

(3) The angle of view is an important performance parameter of the image capture device. The field of view is used to indicate the maximum range of angles that the image capture device can capture during the capture of the image. If the object to be photographed is within this angle range, the object to be photographed is captured by the image capturing device and presented in the preview image. If the object to be photographed is outside this range of angles, the photographed device will not be captured by the image capture device, ie will not be presented in the preview image.

Generally, the larger the angle of view of the image capturing device, the larger the shooting range and the shorter the focal length. The smaller the angle of view of the image capturing device, the smaller the shooting range and the longer the focal length.

In the present application, the term "field of view" may also be referred to as a "field of view" or "field of view". That is to say, the name of the "angle of view" is not limited herein, as long as the concept is as above.

(4) Scene depth, used to describe a parameter of the scene. The depth of the scene can be understood as the distance between the image capturing device and the object to be photographed. The depth of the scene can be represented by a depth map, and each pixel value in the depth map can reflect the distance between the object to be photographed and the image capturing device. The closer the image capturing device is to the image capturing device, the smaller the pixel value is, and the farther away from the image capturing device, the larger the pixel value.

In the present application, "scene depth" may also be referred to as "depth of field" or "image depth". That is to say, the name of the "scene depth" is not limited in this paper, as long as the concept is as above.

(5) Zoom shooting, that is, the image capturing device changes the focal length during the process of capturing an image. For example, when a user captures a distant object through the image capturing device, the object in the preview image displayed by the image capturing device is necessarily displayed smaller. To zoom in on the object in the preview image without changing the position of the user, you can select zoom shooting.

Generally, zoom shooting includes optical zoom shooting and digital zoom shooting. Both of these methods can change the size of the object in the preview image displayed by the image capture device.

(6) Resolution is an important performance parameter of the image capture device. Popularly speaking, resolution can be understood as the ability to distinguish the details of the original. For example, if the original object is a piece of paper, which is covered with many lines, the image captured by the image capturing device can resolve 100 lines, and the image captured by the image capturing device with weak resolution is only Can recognize 10 lines. The greater the resolution of the image capturing device, the stronger the ability of the image capturing device to restore the details of the object to be photographed after capturing the image of the object to be photographed, for example, the user wants to enlarge the captured image, and the image is enlarged. Higher degrees.

Generally, the resolution is related to pixels, resolution, etc., and the image capturing device with higher pixel or resolution has stronger resolution, and if it is a black-and-white image capturing device, because it captures the details of the object to be photographed. The ability is strong, and the resolution of the black-and-white image capturing device is usually greater than that of the color image capturing device.

(7) The term "and/or" in this document is merely an association relationship describing an associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, and A and B exist simultaneously. There are three cases of B alone. In addition, the character "/" in this article, unless otherwise specified, generally indicates that the contextual object is an "or" relationship. In the description of the present application, the terms "first", "second" and the like are used for the purpose of distinguishing the description, and are not to be construed as indicating or implying relative importance, nor in the order of indication or suggestion.

The process of image capture by the current image capture device is described below.

In order to improve the photographing effect, the industry proposes to set a dual camera in the image capturing device, and use the difference between the image information acquired by the two cameras to complement the image information, thereby improving the quality of the final captured image. However, when the image capturing device equipped with the dual camera captures an image, only the image information acquired by the two cameras is simply superimposed. In this way, it is impossible to take higher quality images in various scenes. For example, the image capture device is configured with two cameras, one being a wide-angle camera and the other being a telephoto camera. The image capturing device acquires two images by the two cameras, and then fuses the image information of the two images to obtain the final captured image. However, since the wide-angle camera has a large field of view, it is suitable for close-range shooting, and the telephoto camera has a small field of view, which is suitable for long-range shooting. Therefore, the current dual-camera image capturing device can take into account the shooting of different scenes, but the field of view of the two cameras does not match, resulting in a poor stereoscopic image and poor image quality. For example, in the two images obtained by the image capturing apparatus of such a dual camera, there are portions where the angles of view overlap, and portions where the angles of view do not coincide. If the two images are directly merged, the portion of the final captured image in which the angle of view coincides is high, and the portion of the non-coincident portion has low definition, so that the definition of the central portion and the surrounding portion of the entire image is inconsistent. Moreover, the two images obtained by the camera with the mismatched field of view cannot obtain the depth map of the larger field of view, so that the entire image cannot be processed based on the depth map, resulting in poor stereoscopic image quality and image quality. Poor.

It can be seen that even in the current image capturing device, even if a dual camera is disposed, it is still impossible to capture a high quality image in various scenes.

In order to solve the technical problem, the present application provides a new image capturing device. The image capturing device has three cameras, which are a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera. The image capturing device can obtain the image of the object to be photographed with better quality by using the advantages of the three cameras, thereby improving the obtained image capturing device. The quality of the image. The system architecture of the image capture device of the present application will first be described in detail below. The image capture device herein may be a cell phone, a tablet (PAD), or a camera. Take an image capture device, specifically a mobile phone, as an example. Please refer to FIG. 1. FIG. 1 shows the system architecture of the mobile phone 100.

As shown in FIG. 1, the mobile phone 100 includes a wide-angle color camera 110, a wide-angle black-and-white camera 120 and a telephoto camera 130, a processor 140, a display screen 150, a memory 160, and a power source 170. The wide-angle color camera 110, the wide-angle black-and-white camera 120, and the telephoto camera 130 are used to collect images of objects to be photographed, respectively. The processor 140 can be used to process images. Display 150 can be used to display an image. The memory 160 can be used to store images. Power source 170 can be used to power handset 100. The process of the user taking an image through the mobile phone 100 is as follows:

The user triggers at least one of the wide-angle color camera 110, the wide-angle black-and-white camera 120, and the telephoto camera 130 in the mobile phone 100 to capture an image of the object to be photographed, and transmits the acquired image to the processor 140. The processor 140 processes the image acquired by the at least one image header and processes the image to obtain a preview image, and the preview image may be an image captured by one of the cameras, for example, an image acquired by the wide-angle color camera 110. The processor 140 transmits the preview image to the display screen 150 for display so that the user can pass the display screen 150. See the preview image before shooting. Specifically, the preview image can be displayed through the display panel 151 in the display screen 150. The user can input a shooting instruction through the touch panel 152 in the display screen 150, so that the mobile phone 100 cooperates with the wide-angle color camera 110, the wide-angle black-and-white camera 120, and the telephoto camera 130 to photograph the object to be photographed.

Please refer to FIG. 2 , which is a flowchart of an image capturing method according to an embodiment of the present application. In the following description, the method is applied to the mobile phone shown in FIG. 1 as an example. The process of this method is described as follows:

S201: Determine a scene in which the object to be photographed is located.

As mentioned earlier, the scene can be understood as the environment in which the object is located, and the environment in which the object is located can be large or small. Therefore, one possible implementation manner of S101 is that the image capturing device determines the scene in which the object to be photographed is located by detecting the distance between the object to be photographed and the image capturing device.

Therefore, in the present application, the image capturing device can set a standard distance range in advance. When the distance between the image capturing device and the object to be photographed is greater than the maximum value within the standard distance range, it is determined that the scene in which the object to be photographed is located is a distant view. When the distance between the image capturing device and the object to be photographed is within the standard distance range, it is determined that the scene in which the object to be photographed is located is a medium scene. When the distance between the image capturing device and the object to be photographed is smaller than the minimum value within the standard distance range, it is determined that the scene in which the object to be photographed is located is a close-up.

Of course, there may be other ways for S201, which is not specifically limited in this application.

S202: Select at least one camera suitable for the scene from among the three cameras included in the image capturing device according to the scene.

The following describes the two implementations of S202.

In the first mode, the image capturing device selects at least one camera suitable for capturing the scene according to the scene and the angle of view of the three cameras.

As mentioned above, the image capturing device can divide the scene in which the object to be photographed is divided into a close view, a medium view, and a distant view. Then in the first way, there are three situations. In the first case, when the scene in which the object to be photographed is in close-up, the image capturing device selects a camera suitable for capturing the scene. In the second case, when the scene in which the object to be photographed is in the foreground, the image capturing device selects a camera suitable for capturing the scene. In the third case, when the scene in which the object to be photographed is in the middle scene, the image capturing device selects a camera suitable for capturing the scene.

As mentioned above, the larger the field of view of the camera, the more suitable for shooting close-up, that is, when shooting a close-up view through a camera with a large angle of view, the quality of the final captured image is better. Conversely, the smaller the field of view of the camera, the better it is for shooting distant views. That is, when a distant view is taken by a camera with a small angle of view, the quality of the final captured image is good. Therefore, the image capturing device can reverse the camera that needs to adopt the angle of view by the scene in which the object to be photographed is located.

Therefore, for the first case, the scene in which the object to be photographed is located is a close-up view. The image capturing device can select a camera with a large angle of view. In the second case, the scene in which the object to be photographed is located is a medium shot. The image capture device can select a camera with a moderate angle of view. In the third case, the scene in which the object to be photographed is located is a distant view. The image capturing device can select a camera with a small angle of view.

In the present application, the image capturing device may set a preset range of angle of view in advance. When the field of view of the camera is greater than the maximum value of the preset field of view, the camera has a larger field of view and is suitable for close-up shooting. When the field of view of the camera is less than the minimum value within the range of the preset field of view, the camera's field of view is considered to be small, suitable for long-range shooting. When the camera's field of view is within this preset field of view, the camera's field of view is considered moderate and suitable for mid-range shooting.

Therefore, when the scene in which the object to be photographed is located is a close-up, the image capturing device can select a camera with a larger angle of view to shoot. For example, since the wide-angle color camera has a large angle of view, a color image can be obtained. Therefore, the image capturing device can directly select a wide-angle color camera for shooting, which is simple and easy to implement. Of course, the image capture device can also select a wide-angle color camera and a wide-angle black and white camera to simultaneously shoot. This approach helps to improve the quality of the final captured image. This is because the wide-angle black-and-white camera has a strong ability to capture detailed information of an object to be photographed when capturing an image. The wide-angle color camera has a strong ability to capture the color information of the object to be photographed when the image is captured. Therefore, the image capturing device combines the images acquired by the wide-angle color camera and the wide-angle black-and-white camera to obtain a higher quality of the captured image.

When the scene in which the object to be photographed is located is a distant view, the image capturing device may select a camera with a small angle of view to shoot. For example, since the telephoto camera has a small field of view, if the third camera is a telephoto color camera, the image capturing device can directly select a telephoto color camera for shooting, which is simple and easy to implement. If the third camera is a telephoto black and white camera, the image capturing device can directly select the wide-angle color camera and the telephoto black-and-white camera to simultaneously shoot. Of course, the image capture device can also select three cameras to shoot at the same time. This method helps to improve the quality of the final captured image, the specific reasons will be introduced later.

In the second mode, the image capturing device selects at least one camera suitable for capturing the scene according to the brightness of the scene and the format of the camera.

Taking the first camera as the Quadra format as an example, when the scene brightness is low, the wide-angle color camera and the wide-angle black-and-white camera can be directly used for shooting. This is because the wide-angle color camera has a strong ability to capture color information and brightness information of an object to be photographed. The wide-angle black and white camera has a strong ability to capture detailed information of the object to be photographed. The image acquired by the two cameras is fused to obtain the brightness information, color information, sharpness, and the like of the finally captured image. When the scene brightness is high, the image capture device can change the Quadra format of the wide-angle color camera into the Bayer format by the Remosaic algorithm, and then use the wide-angle color camera and the wide-angle black-and-white camera to shoot.

It should be noted that if the camera is in the Quadra format, the four pixels in the image captured by the camera correspond to one brightness value, so the brightness value of the image is increased by 4 times, that is, the brightness value of the image is large. If the camera is in the Bayer format, one pixel in the image captured by the camera corresponds to a brightness value, and the brightness value in the image is small.

Therefore, when the brightness of the scene is low, in order to ensure that the final captured image has sufficient brightness, the Quadra format can be used to increase the brightness value of the final captured image. If the brightness of the scene is high, then the first camera can capture images with sufficient brightness values in the Bayer format. Therefore, the Quadra format can be converted to the Bayer format.

As a possible implementation manner, the manner in which the first camera is converted from the Quadra format to the Bayer format may be a Remosaic algorithm, that is, 4 pixels are converted from the original 1 luminance value to 4 luminance values, and the other 3 pixel points are used. The brightness value is complemented by the difference reconstruction.

In actual operation, the image capturing device may adopt any one of the above two methods according to actual conditions. Of course, the two methods can also be combined, and the present application does not specifically limit this.

S203: Acquire an image acquired by at least one camera at the same time on the object to be photographed, and process the acquired image to obtain an image of the object to be photographed.

Taking at least one camera specifically as three cameras as an example, the process of S203 can be specifically implemented in two steps. In the first step, the three cameras simultaneously acquire images of the object to be photographed; in the second step, the image capturing device will have three The image captured by the camera is processed to obtain an image of the object to be photographed. These two steps are separated below.

In the first step, the image capture device can determine the number of frames of the image captured by each of the three cameras. One possible implementation manner is that the image capturing device separately controls each camera to collect an image of the corresponding number of frames according to the brightness of the scene in which the object to be photographed is located.

For example, when the brightness of the scene is low, the image capture device can control each camera to capture images of more frames. When the brightness of the scene is large, the image capturing device can control each camera to capture images of fewer frames.

This is because the brightness of the scene in which the object to be photographed is located can affect the signal-to-noise ratio of the image captured by the camera. If the brightness of the scene is low, the signal-to-noise ratio of the acquired image is relatively low, that is, the ratio of the effective signal to the noise in the acquired image is low, and the noise occupies a large component. At this time, in order to obtain a sufficient effective signal, the image capturing device can control the camera to capture images of more frames. If the brightness of the scene is large, the signal-to-noise of the acquired image is relatively large, that is, the ratio of the effective signal to the noise in the acquired image is large, that is, the composition of the noise is small. At this time, sufficient effective information can be obtained without collecting more images, so the image capturing device can control the camera to acquire fewer frame images.

Of course, the image capturing device may determine the number of frames of each camera to collect images by other means, which is not specifically limited in the present application.

After the image capturing device determines the number of frames of images acquired by each camera, each camera acquires an image of the corresponding number of frames.

In the second step, the image capture device can preprocess the images acquired by each camera separately. The preprocessing process is as follows:

The image capturing device can perform noise reduction processing on the image acquired by each camera, and fuse all the frame images after the noise reduction processing to obtain an image with relatively high signal to noise ratio. In this way, each camera will correspond to an image with a relatively high signal to noise ratio. Then, the image capturing device can re-merge the image corresponding to each camera to initially obtain an image of the object to be photographed, and the image can directly be used as the image of the final object to be photographed.

Of course, in order to improve the quality of the image of the final object to be photographed, the image capturing device may further process the image of the object to be photographed which is initially obtained. For example, the image capturing device may perform image enhancement processing on the initially obtained image of the object to be photographed according to the scene depth information to improve the quality of the image of the final object to be photographed.

In the present application, the image fusion method may be various, such as a wavelet variation fusion method, a pyramid variation fusion method, and the like, which is not specifically limited in the present application.

In the present application, the manner in which the image capturing device determines the depth information of the scene may be various. For example, the image capturing device may determine two cameras having equal fields of view among the three cameras, such as a wide-angle color camera and a wide-angle black-and-white camera, and then the image capturing device determines the depth information of the scene by the parallax of the images acquired by the two cameras. There are of course other implementations, which are not specifically limited in this application.

The image capturing device may perform image enhancement processing on the image of the object to be photographed which is initially obtained according to the scene depth information. For example, the image capturing device may perform image enhancement processing of contrast and sharpness only on the image of the initially obtained object to be photographed according to the scene depth information, so as to improve the stereoscopic and layered feeling of the image of the final object to be photographed. For example, the image capturing device may perform image enhancement processing only on the foreground of the image of the object to be photographed, such as the sharpness of the portrait, according to the scene depth information, and does not process the sharpness of the background, or performs image blurring processing, similar to Personalized shooting is achieved when the user takes a picture with a large aperture. For another example, the image capturing device may further obtain a preliminary image to be taken according to the depth information of the scene. Image sharpening is performed on the sharpness of the area selected by the user on the image of the object, and no processing or image blurring processing is performed on other areas, which is similar to the effect of focusing after the user takes a picture first, thereby realizing personalized shooting.

S204. Output an image of the object to be photographed.

After the image capturing device obtains the image of the object to be photographed, the image of the object to be photographed may be output, for example, displayed on a display screen of the image capturing device or the like. Of course, there may be other implementation manners, which are not specifically limited in this application.

In the embodiment shown in FIG. 2, the image capturing device does not change the focal length during the process of capturing an image, that is, the image capturing device performs normal 1x shooting. Another embodiment will be described below. In the following embodiments, the image capturing device performs zoom shooting.

Please refer to FIG. 3 , which is a flowchart of another image capturing method provided by the present application. The process of this method is described as follows:

S301: Receive a zoom instruction, where the zoom instruction is used to indicate that the preview image currently displayed by the image capturing device is scaled.

In this application, the manner in which different image capture devices receive zoom instructions may vary. For example, for a smartphone with a touch screen, the user can input a zoom instruction by performing a zoom operation on a preview image displayed on the touch screen, or can input a zoom instruction or the like through a volume key. For digital cameras, the user can adjust the zoom ring to input a zoom command to zoom in on the preview image. Of course, the image capture device may have other manners of receiving the zoom instruction, which is not specifically limited in this application.

S302: Select at least one camera suitable for the zoom ratio from among three cameras included in the image capturing device according to a scaling ratio corresponding to the zoom instruction.

If the image capturing device inputs the zooming instruction by the user's zooming operation on the preview image, the user zooms in on the preview image to a greater extent, and the zoom ratio is larger. The user zooms in on the preview image to a lesser extent, and the zoom ratio is smaller. Similarly, if the image capture device inputs the zoom command by adjusting the zoom ring by the user, the larger the amplitude of the zoom ring is adjusted by the user, the larger the zoom ratio is, and the smaller the amplitude of the zoom ring is adjusted by the user, the smaller the zoom ratio is.

It should be noted that there is a certain relationship between the zoom magnification and the zoom ratio. For example, when the user shoots an object 10 meters away from the user through the mobile phone, the object in the preview image will be displayed relatively small at this time, and if the user enlarges the preview image by 2 times, the user does not move at the position where the user is located. Next, it is equivalent to the effect that the user himself/herself moves to a position 5 meters away from the object, that is, equivalent to the user reducing the focal length by a factor of two. It can be seen that the zoom ratio in this paper can also be understood as the zoom magnification.

As a possible implementation manner, the image capturing device may select a camera suitable for the zoom ratio according to the zoom ratio and the resolution of the three cameras.

When designing the image capture device, the designer can pre-design the resolution relationship between the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto color camera. For example, the resolution of a wide-angle color camera is smaller than the resolution of a wide-angle black-and-white camera, and the resolution of a wide-angle black-and-white camera is greater than or equal to the resolution of a telephoto color camera.

As mentioned above, the resolution of the camera has a certain correlation with the resolution of the camera, so the resolution relationship between the three cameras can also be reflected indirectly through the resolution relationship. The resolution of the wide-angle color camera is Wa*Ha, the resolution of the wide-angle black-and-white camera is Wb*Hb, and the resolution of the telephoto camera is Wc*Hc. Where H is the height direction and W is the width direction. Wa is less than or equal to Wb. When the resolution of the wide-angle black and white camera and the telephoto camera satisfies Wb*S=Wc*F ₀ , the resolution of the telephoto camera is greater than or equal to the resolution of the wide-angle black and white camera. Among them, S can be understood as the resolution enhancement factor introduced by the image capturing device when processing the wide-angle black-and-white camera according to the super-resolution technique (the manner of determining the S will be described later). Since the telephoto camera can be a telephoto black and white camera or a telephoto color camera, the following two cases are introduced.

In the first case, the image capturing device has three cameras, which are a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto color camera.

In the present application, the image capturing device may preset a scaling factor F ₀ . The image capture device can compare the scale (F) corresponding to the indented zoom instruction with a preset zoom ratio (F ₀ ). There are three cases of comparison results, that is, F is greater than F ₀ , equal to F _{0 ,} or less than F ₀ .

The following describes an implementation manner in which the image capturing device determines the scaling factor F ₀ . For example, the angle of view of the wide-angle color camera is α, the angle of view of the wide-angle black and white camera is α, and the angle of view of the telephoto camera is β, α>β. . Then the pre-stored scaling F ₀ can be obtained by the following formula:

In this case, the telephoto camera is specifically a telephoto color camera, so when F is less than or equal to F ₀ , the image capturing device selects a wide-angle color camera and a wide-angle black-and-white camera to capture an image of the object to be photographed. When F is greater than F ₀ , the image capturing device selects a wide-angle black and white camera and a telephoto color camera to capture an image of the object to be photographed.

This is because, in this case, the resolution of the wide-angle black-and-white camera is greater than the resolution of the telephoto color camera. For example, both have the same horizontal resolution and vertical resolution, but in the diagonal direction, the resolution of the wide-angle black-and-white camera is greater than the resolution of the telephoto color camera. Therefore, when the zoom ratio input by the user is small, the image capturing device performs shooting through the wide-angle color camera and the wide-angle black-and-white camera. When the user gradually increases the zoom ratio, the image capturing device can switch the wide-angle color camera to the telephoto color camera, that is, the wide-angle black-and-white camera and the telephoto color camera, because the resolution of the wide-angle black-and-white camera is large, even if the user The preview image is "zoomed in" to a larger extent, and the sharpness of the image is better.

In the second case, the image capturing device has three cameras, which are a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto black-and-white camera.

In this case, the telephoto camera is specifically a telephoto black and white camera, and when F is less than or equal to F ₀ , the image capturing device performs shooting through a wide-angle color camera and a wide-angle black and white camera. When F is greater than F ₀ , the image capturing device performs shooting through the wide-angle color camera and the telephoto black-and-white camera.

This is because, in this case, the resolution of the wide-angle black-and-white camera is equal to the resolution of the telephoto color camera. Therefore, if the zoom ratio input by the user is small, the image capturing device shoots through the wide-angle color camera and the wide-angle black-and-white camera. When the user gradually increases the zoom ratio, the image capturing device can switch the wide-angle black-and-white camera to the telephoto black-and-white camera, that is, the wide-angle color camera and the telephoto black-and-white camera, because the resolution of the wide-angle black-and-white camera is equal to that of the telephoto color camera. Resolution, so even if the user "zooms in" the preview image to a large extent, the sharpness of the image will not jump.

It should be noted that the wide-angle color camera may be in the Bayer format or the Quadra format. Taking the wide-angle color camera as the Quadra format as an example, if you use a wide-angle color camera to capture images under zoom shooting, you can consider adjusting the format of the wide-angle color camera according to the brightness value of the scene.

For example, when the scene brightness is low, you can directly use the wide-angle color camera in Quadra format. In When the scene brightness is high, the image capture device can change the Quadra format of the wide-angle color camera into the Bayer format by the Remosaic algorithm, and then use the wide-angle color camera to shoot.

One possible way for the image capture device to determine S is described below.

Usually, after an image is captured by a certain camera, the image has an initial value of resolution. The initial value of the resolution of the image tends to be low, so the image capture device can increase the initial value of the resolution of the image. However, it cannot be improved without limitation, so the image capturing device can only increase the resolution of the image to an optimum value by super-resolution technology. S can be understood as the difference between the optimum value and the initial value.

S303: Acquire at least one camera to simultaneously treat an image acquired by the captured object, and process the acquired image to obtain an image of the object to be photographed.

S303 can be implemented in two steps. In the first step, each camera captures an image of the object to be photographed; in the second step, the image capturing device processes the image acquired by each camera to obtain an image of the object to be photographed. These two steps are similar to the two steps of S203 in the aforementioned embodiment shown in FIG. The only difference is that in the second step here, the process of cropping the image of the object to be photographed by the image capturing device is increased.

This is because the user expects to "magnify" the smaller object displayed in the image, and the enlarged image is actually a part of the image before "zooming in", so in order to capture the object after "zooming", image capturing The device may crop the object to be photographed to obtain a captured image of the object that the user desires to "zoom in".

Taking the image capturing device to select and select the wide-angle color camera and the wide-angle black-and-white camera to capture the image of the object to be photographed, the image capturing device may crop the first image captured by the wide-angle color camera and the second image captured by the wide-angle black-and-white camera. Here are two possible ways to crop.

In the first mode, the image capturing device can reduce the length and width of the first image or the second image by F times. Here, F is the scaling determined by the aforementioned image capturing device according to the scaling instruction.

For example, the size of the first image before being cropped is: length L ₁ , width H ₁ , and the size of the first image after cropping is: length L ₁ /F, width H ₁ /F. The size of the second image before being cropped is: length L ₂ , width H ₂ , and the size of the second image after cropping is: length L ₂ /F, width H ₂ /F. This method is suitable for the case where the resolution between the wide-angle color camera and the wide-angle black-and-white camera is the same.

In the second mode, the image capturing device can reduce the length and width of the first image or the second image by WF times. Here, W is used to indicate the ratio of the resolution between the wide-angle color camera and the wide-angle black-and-white camera. For example, the resolution of a wide-angle color camera is A, and the resolution of a wide-angle black-and-white camera is B, then W=A/B.

For example, the size of the first image before being cropped is: length L ₁ , width H ₁ , and the size of the first image after cropping is: length L ₁ /W/F, width H ₁ /W/F. The size of the second image before it is cropped is: length L ₂ /WF, width H ₂ /F, size of the second image after cropping, length: L ₂ /F/W, width: H ₂ /F/W . This type of cropping is suitable for wide-angle color cameras and wide-angle black and white cameras with different resolutions.

S304. Output an image of the object to be photographed.

For an introduction to S304, please refer to the above description about S204 in the embodiment shown in FIG. 2. For the sake of brevity of the description, it will not be described here.

In the present application, the position of each camera in the image capture device may be arbitrary. For example, all cameras may be disposed more concentrated at a certain position in the image capturing setting, or may be dispersedly disposed at different positions in the image capturing device. The image capturing device is provided with three cameras as an example. Please refer to FIG. 4, which illustrates a possible arrangement between three cameras (cameras A-C) in the image capture device. Of course, in practical applications, the positions of the respective cameras are not limited to the several arrangements listed in FIG. 4, and may be based on actual conditions. The situation depends on it.

It should be noted that in order to make the image capturing device more light and thin, a plurality of cameras may be located on the same horizontal surface, that is, there is no height difference between the two cameras. In this way, the image capture device can be prevented from being too thick, which helps to improve the user experience. Of course, the ordering between multiple cameras on the same plane can also be arbitrary.

In the present application, an optical image stabilizer (OIS) may be provided for each camera to prevent blurring of the captured image due to user's jitter during image capture. Of course, it is also possible to configure only one OIS, that is, all cameras share the OIS.

In summary, in the present application, the image capturing device includes three cameras: a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera. Each of the three cameras has advantages. For example, a wide-angle black-and-white camera is suitable for capturing close-ups and capturing objects to be photographed. The ability to be more detailed, the wide-angle color camera is suitable for shooting close-ups and has the ability to obtain color information of the object to be photographed, while the telephoto camera is suitable for shooting distant scenes. The image capturing device can take advantage of the respective advantages of the three cameras to obtain an image of a better-quality object to be photographed, thereby improving the quality of the obtained image.

The device provided by the present application will be described below with reference to the accompanying drawings.

FIG. 5 shows a schematic structural view of an image capturing device 500. The image capture device 500 can implement the functions of the image capture device referred to above. The image capturing device 500 may include an input unit 501, a processing unit 502, and an output unit 503. Wherein, the input unit 501 can be used to execute S301 in the embodiment shown in FIG. 3, and/or other processes for supporting the techniques described herein. Processing unit 502 can be used to perform S302-S303 in the embodiment illustrated in FIG. 3, and/or other processes for supporting the techniques described herein. Output unit 503 can be used to perform S304 in the embodiment shown in FIG. 3, and/or other processes for supporting the techniques described herein. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.

FIG. 6 shows a schematic structural view of an image capturing device 600. The image capture device 600 can implement the functions of the image capture device referred to above. The image capture device 600 can include a processing unit 601 and an output unit 602. Wherein, the processing unit 601 can be used to execute S201-S203 in the embodiment shown in FIG. 2, and/or other processes for supporting the techniques described herein. Output unit 602 can be used to perform S204 in the embodiment shown in FIG. 2, and/or other processes for supporting the techniques described herein. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.

It should be noted that, in the present application, the image capturing device 500 and the image capturing device 600 described above are presented in the form of functional units. The term "unit" as used herein, without limitation, may refer to an application-specific integrated circuit (ASIC), electronic circuit, (shared, dedicated, or group) that executes one or more software or firmware programs. A processor and memory, combinational logic, and/or other suitable components that provide the described functionality.

In a simple embodiment, those skilled in the art will appreciate that any one of the image capture device 500 and the image capture device 600 can also be implemented by the structure shown in FIG.

As shown in FIG. 7, the image capture device 700 can include a memory 701, a processor 702, and a bus 703. The memory 701 and the processor 702 can be connected by a bus 703. The memory 701 is configured to store computer execution instructions. When the image capturing apparatus 700 is in operation, the processor 702 executes computer execution instructions stored in the memory 701 to cause the image capturing apparatus 700 to perform the embodiment provided in the embodiment shown in FIG. 2 or FIG. 3. Image capture method. For a specific image capturing method, reference may be made to the related descriptions in the above and the drawings, and details are not described herein again.

In the present application, the processor 702 may be a field-programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processing unit. (central processor unit, CPU), network processor (NP), digital signal processor (DSP), microcontroller (micro controller unit (MCU), can also use programmable controller (programmable Logic device, PLD) or other integrated chip. The bus 703 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus or the like. The bus 703 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.

In the above described embodiments of the invention, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with the present application are generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another readable storage medium, for example, the computer instructions can be passed from a website site, computer, server or data center Wired (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) to another website site, computer, server, or data center. The computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media. The usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)) or the like.

The above embodiments are only used to describe the technical solutions of the present application in detail, but the description of the above embodiments is only for helping to understand the method and the core idea of the present application, and should not be construed as limiting the present application. Those skilled in the art, within the scope of the technical scope of the present application, are susceptible to variations or substitutions within the scope of the present application.

Claims

An image capture device, characterized in that the device comprises:

a wide-angle color camera, a wide-angle black-and-white camera, a telephoto camera, a processor, and a memory; wherein the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto camera are disposed on the same side of the housing of the image capturing device; The wide-angle black-and-white camera and the wide-angle color camera have the same angle of view, and the field of view of the telephoto camera is smaller than the angle of view of the wide-angle color camera;

The memory is configured to store a static or dynamic image of an object to be photographed captured by at least one of the wide-angle color camera, the wide-angle black-and-white camera, or the telephoto camera;

The processor is configured to process the static or dynamic image to obtain an image of the object to be photographed.
The apparatus of claim 1 wherein said wide-angle color camera is located between said wide-angle black and white camera and said telephoto camera.
The apparatus of claim 1 or 2 wherein said telephoto camera is a telephoto color camera.
The device according to any one of claims 1-3, wherein the telephoto camera is a built-in camera, and the wide-angle color camera and the wide-angle black-and-white camera are disposed on an external component of the image capturing device. The external accessory is rotatably coupled to a bezel of the image capture device, and an angle formed between the external accessory and a display screen of the image capture device is any angle between 0 and 360 degrees.
An image capturing method, wherein the method is applied to an image capturing device including a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto color camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have an angle of view The same, and the field of view of the telephoto color camera is smaller than the field of view of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the telephoto camera. The method includes:

Receiving a scaling instruction, the scaling instruction is for scaling a current preview image of the device;

Obtaining, by the wide-angle color camera and the wide-angle black-and-white camera, an image captured by the object to be photographed, respectively, and outputting an image of the object to be photographed, where the zoom ratio corresponding to the zoom instruction is less than or equal to a preset ratio The image of the object to be photographed is obtained by fusing the image captured by the wide-angle color camera and the wide-angle black-and-white camera; or

If the zoom ratio corresponding to the zoom ratio is greater than the preset ratio, acquiring the image captured by the wide-angle black-and-white camera and the telephoto color camera at the same time; and outputting an image of the object to be photographed, where The image of the object to be photographed is obtained by fusing the image captured by the wide-angle white camera and the telephoto color camera.
The method of claim 5, wherein the method further comprises: before acquiring the image captured by the object to be photographed, the method further comprising:

Determining a brightness value of a scene in which the object to be photographed is located;

And controlling, according to the brightness value, each of the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto color camera to capture an image of a corresponding number of frames.
The method according to claim 6, wherein the controlling each camera to capture an image of the corresponding number of frames according to the brightness value comprises:

Controlling, by the each camera, a P frame image if the brightness value is greater than the first preset brightness value; or

If the brightness value is less than or equal to the second preset brightness value, controlling each of the cameras to capture the Q frame image;

The second preset brightness value is smaller than the first preset brightness value, P and Q are positive integers, and P is greater than Q.
The method according to any one of claims 5-7, wherein before the outputting the image of the object to be photographed, the method further comprises:

Determining depth information of a scene in which the object to be photographed is located;

The obtained image captured by the object to be photographed is processed according to the depth information.
An image capturing method, wherein the method is applied to an image capturing device including a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto black-and-white camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have an angle of view The same, and the field of view of the telephoto black and white camera is smaller than the field of view of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the telephoto camera. The method includes:

Receiving a scaling instruction, the scaling instruction is for scaling a current preview image of the device;

Obtaining, by the wide-angle color camera and the wide-angle black-and-white camera, an image captured by the object to be photographed, respectively, and outputting an image of the object to be photographed, where the zoom ratio corresponding to the zoom instruction is less than or equal to a preset ratio The image of the object to be photographed is obtained by fusing the image captured by the wide-angle color camera and the wide-angle black-and-white camera; or

Obtaining, by the wide-angle color camera and the telephoto black-and-white camera, an image captured by the object to be photographed; and outputting an image of the object to be photographed, where the zoom ratio is greater than the preset scale The image of the object to be photographed is obtained by fusing the image captured by the wide-angle color camera and the telephoto black-and-white camera.
The method of claim 9, wherein the method further comprises: before acquiring the image captured by the object to be photographed, the method further comprising:

Determining a brightness value of a scene in which the object to be photographed is located;

And controlling, according to the brightness value, each of the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto black-and-white camera to capture an image of a corresponding number of frames.
The method according to claim 10, wherein the controlling each camera to capture an image of the corresponding number of frames according to the brightness value comprises:

Controlling, by the each camera, a P frame image if the brightness value is greater than the first preset brightness value; or

If the brightness value is less than or equal to the second preset brightness value, controlling each of the cameras to capture the Q frame image;

The second preset brightness value is smaller than the first preset brightness value, P and Q are positive integers, and P is greater than Q.
The method according to any one of claims 9-11, wherein before the outputting the image of the object to be photographed, the method further comprises:

Determining depth information of a scene in which the object to be photographed is located;

The obtained image captured by the object to be photographed is processed according to the depth information.
An image capturing method, characterized in that the method is applied to a wide-angle color camera, widely An image capturing device of an angle black and white camera, a telephoto black and white camera; wherein, the wide angle color camera and the wide angle black and white camera have the same angle of view, and the field of view of the telephoto black and white camera is smaller than that of the wide angle color camera The field of view, the method includes:

Determining the scene in which the object to be photographed is located;

If the scene is a distant view, acquiring an image captured by the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto camera respectively for the object to be photographed;

Determining depth information of the scene according to the first image acquired by the wide-angle color camera and the second image captured by the wide-angle black and white camera;

Processing the first pre-capture image according to the depth information to obtain an image of the object to be photographed; the first pre-capture image is collected by the first image, the second image, and the telephoto camera The third image is obtained by fusion;

An image of the object to be photographed is output.
The method of claim 13 wherein the method further comprises:

If the scene is a close-up view, acquiring an image captured by the wide-angle color camera and the wide-angle black-and-white camera at the same time for the object to be photographed;

Determining depth information of the scene according to the third image acquired by the wide-angle color camera and the fourth image captured by the wide-angle black and white camera;

And processing the second pre-capture image according to the scene depth information to obtain an image of the object to be photographed; and the second pre-capture image is obtained by fusing the third image and the fourth image.
The method of claim 13, wherein the method further comprises: before acquiring an image captured by the object to be photographed, the method further comprising:

Determining a brightness value of the scene;

And controlling, according to the brightness value, each of the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto camera to acquire an image of a corresponding number of frames.
The method of claim 15, wherein each camera is configured to acquire an image of the corresponding number of frames according to the brightness value, comprising:

Controlling, by the each camera, a P frame image if the brightness value is greater than the first preset brightness value; or

If the brightness value is less than or equal to the second preset brightness value, controlling each camera to collect a Q frame image;

The second preset brightness value is smaller than the first preset brightness value, P and Q are positive integers, and P is greater than Q.
An image capturing device, comprising: a wide-angle color camera, a wide-angle black-and-white camera, a telephoto color camera, a processing unit, and an input unit and an output unit; wherein the wide-angle color camera and the wide-angle black-and-white camera The field of view is the same, and the field of view of the telephoto color camera is smaller than the field of view of the wide-angle color camera; the resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the telephoto camera;

The input unit is configured to receive a zoom instruction, where the zoom instruction is used to scale a current preview image of the device;

The processing unit is configured to acquire an image captured by the wide-angle color camera and the wide-angle black-and-white camera at the same time when the zoom ratio corresponding to the zoom instruction is less than or equal to a preset ratio;

The output unit is further configured to output an image of the object to be photographed, wherein the image of the object to be photographed is obtained by fusing an image captured by the wide-angle color camera and the wide-angle black-and-white camera;

The processing unit is further configured to acquire an image captured by the wide-angle black-and-white camera and the telephoto color camera at the same time when the zoom ratio corresponding to the zoom ratio is greater than the preset ratio;

The output unit is further configured to output an image of the object to be photographed, wherein the image of the object to be photographed is obtained by fusing an image captured by the wide-angle white camera and the telephoto color camera.
The apparatus according to claim 17, wherein said processing unit is further configured to:

Determining a brightness value of a scene in which the object to be photographed is located;

And controlling, according to the brightness value, each of the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto color camera to capture an image of a corresponding number of frames.
The device according to claim 18, wherein the processing unit is specifically configured to:

Controlling, by the each camera, a P frame image if the brightness value is greater than the first preset brightness value; or

If the brightness value is less than or equal to the second preset brightness value, controlling each of the cameras to capture the Q frame image;

The second preset brightness value is smaller than the first preset brightness value, P and Q are positive integers, and P is greater than Q.
The device according to any one of claims 17 to 19, wherein the processing unit is further configured to:

Determining depth information of a scene in which the object to be photographed is located;

The obtained image captured by the object to be photographed is processed according to the depth information.
An image capturing device, comprising: a wide-angle color camera, a wide-angle black-and-white camera, a telephoto black-and-white camera, an input unit, a processing unit, and an output unit; wherein the wide-angle color camera and the wide-angle black-and-white camera The field of view is the same, and the field of view of the telephoto black and white camera is smaller than the field of view of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the telephoto camera;

The input unit is configured to receive a zoom instruction, where the zoom instruction is used to scale a current preview image of the device;

The processing unit is configured to acquire an image captured by the wide-angle color camera and the wide-angle black-and-white camera at the same time when the zoom ratio corresponding to the zoom instruction is less than or equal to a preset ratio;

The output unit is configured to output an image of the object to be photographed, wherein the image of the object to be photographed is obtained by fusing an image captured by the wide-angle color camera and the wide-angle black-and-white camera;

The processing unit is further configured to acquire an image captured by the wide-angle color camera and the telephoto black-and-white camera at the same time when the zoom ratio corresponding to the zoom ratio is greater than the preset ratio;

The output unit is further configured to output an image of the object to be photographed, wherein the image of the object to be photographed is obtained by fusing an image captured by the wide-angle color camera and the telephoto black and white camera.
The device of claim 21, wherein the processing unit is further configured to:

Determining a brightness value of a scene in which the object to be photographed is located;

And controlling, according to the brightness value, each of the wide-angle color camera, the telephoto black and white camera, and the telephoto black and white camera to capture an image of a corresponding number of frames.
The device according to claim 22, wherein the processing unit is specifically configured to:

Controlling, by the each camera, a P frame image if the brightness value is greater than the first preset brightness value; or

If the brightness value is less than or equal to the second preset brightness value, controlling each of the cameras to capture the Q frame image;

The second preset brightness value is smaller than the first preset brightness value, P and Q are positive integers, and P is greater than Q.
The device according to any one of claims 21 to 23, wherein the processing unit is further configured to:

Determining depth information of a scene in which the object to be photographed is located;

The obtained image captured by the object to be photographed is processed according to the depth information.
An image capturing device, comprising: a wide-angle color camera, a wide-angle black-and-white camera, a telephoto black-and-white camera, and a processing unit and an output unit; wherein an angle of view of the wide-angle color camera and the wide-angle black-and-white camera Similarly, and the field of view of the telephoto black and white camera is smaller than the field of view of the wide-angle color camera, the processing unit is configured to:

Determining the scene in which the object to be photographed is located;

If the scene is a distant view, acquiring an image captured by the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto camera respectively for the object to be photographed;

Determining depth information of the scene according to the first image acquired by the wide-angle color camera and the second image captured by the wide-angle black and white camera;

Processing the first pre-capture image according to the depth information to obtain an image of the object to be photographed; the first pre-capture image is collected by the first image, the second image, and the telephoto camera The third image is obtained by fusion;

The output unit is configured to output an image of the object to be photographed.
The apparatus of claim 25, wherein the processing unit is further configured to:

If the scene is a close-up view, acquiring an image captured by the wide-angle color camera and the wide-angle black-and-white camera at the same time for the object to be photographed;

Determining depth information of the scene according to the third image acquired by the wide-angle color camera and the fourth image captured by the wide-angle black and white camera;

And processing the second pre-capture image according to the scene depth information to obtain an image of the object to be photographed; and the second pre-capture image is obtained by fusing the third image and the fourth image.
The apparatus of claim 25, wherein the processing unit is further configured to:

Determining a brightness value of the scene;

And controlling, according to the brightness value, each of the wide-angle color camera, the wide-angle black-and-white camera, and the telephoto camera to acquire an image of a corresponding number of frames.
The device according to claim 27, wherein the processing unit is specifically configured to:

Controlling, by the each camera, a P frame image if the brightness value is greater than the first preset brightness value; or

If the brightness value is less than or equal to the second preset brightness value, controlling each camera to collect a Q frame image;

The second preset brightness value is smaller than the first preset brightness value, P and Q are positive integers, and P is greater than Q.
A computer readable storage medium, comprising instructions that, when run on a computer, cause the computer to perform the method of any of claims 5-16.
A computer program product comprising instructions, wherein when executed on a computer, causes the computer to perform the method of any one of claims 5-16.