CN109923850B

CN109923850B - Image capturing device and method

Info

Publication number: CN109923850B
Application number: CN201780069983.6A
Authority: CN
Inventors: 罗巍; 陈刚; 杜成; 朱聪超; 唐忠伟; 唐玮; 敖欢欢
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2017-07-07
Filing date: 2017-07-07
Publication date: 2020-09-11
Anticipated expiration: 2037-07-07
Also published as: WO2019006762A1; CN109923850A

Abstract

The application discloses image capture device and method, the device includes: the system comprises a wide-angle color camera, a wide-angle black-and-white camera, a telephoto camera, a processor and a memory; the wide-angle color camera, the wide-angle black-and-white camera and the telephoto camera are arranged on the same side surface of a shell of the image capturing device; the wide-angle black-and-white camera and the wide-angle color camera have the same field angle, and the field angle of the tele camera is smaller than that of the wide-angle color camera; the memory is used for storing static or dynamic images of an object to be shot captured by at least one camera in the wide-angle color camera, the wide-angle black-and-white camera or the telephoto camera; the processor is used for processing the static or dynamic image to obtain an image of the object to be shot.

Description

Image capturing device and method

Technical Field

The present application relates to the field of image processing technologies, and in particular, to an image capturing apparatus and method.

Background

In order to improve the photographing effect, the industry proposes to provide two cameras in an image capturing device, and complement image information by using the difference between the image information captured by the two cameras, so as to improve the quality of the photographed image. Especially for mobile phone manufacturers, the dual-camera system is becoming more and more popular and is becoming the standard of each mobile phone.

However, in practice, the current image capturing apparatus with two cameras simply fuses the images captured by the two cameras when capturing images. And the mode can not shoot images with high quality under various scenes. For example, an image capturing apparatus configured with a wide-angle and a telephoto dual camera acquires two images by the two cameras, respectively, and then fuses the two images to obtain a finally photographed image. The wide-angle camera is suitable for close-range shooting because of a large field angle, and the long-focus camera is suitable for long-range shooting because of a small field angle. And the final image obtained by fusing the two images obtained by the two cameras with unmatched field angles has poor stereoscopic impression and poor image quality.

As can be seen, even if two cameras are provided in the current image capturing apparatus, high-quality images cannot be obtained in various scenes.

Disclosure of Invention

The application provides an image capturing device and method for improving image shooting quality.

In a first aspect, the present application provides an image capture device. The image capturing apparatus includes: the system comprises a wide-angle color camera, a wide-angle black-and-white camera, a telephoto camera, a processor and a memory; the wide-angle color camera, the wide-angle black-and-white camera and the telephoto camera are arranged on the same side surface of a shell of the image capturing device; the wide-angle black-and-white camera and the wide-angle color camera have the same field angle, and the field angle of the tele camera is smaller than that of the wide-angle color camera; the memory is used for storing static or dynamic images of an object to be shot captured by at least one camera in the wide-angle color camera, the wide-angle black-and-white camera or the telephoto camera; the processor is used for processing the static or dynamic image to obtain an image of the object to be shot.

In the present application, the image capturing device includes three cameras, namely, a wide-angle color camera, a wide-angle monochrome camera, and a telephoto camera, which have advantages, for example, the wide-angle monochrome camera has a larger field angle, is suitable for capturing a close-up view and has a stronger capability of capturing details of an object to be captured, the wide-angle color camera has a larger field angle, is suitable for capturing a close-up view and has a stronger capability of capturing color information of the object to be captured, and the telephoto camera has a smaller field angle, and is suitable for capturing a long-range view. The image capturing device can obtain images of objects to be shot with good quality under different scenes (such as a close scene, a long scene and the like) by utilizing the respective advantages of the three cameras, so that the image shooting quality is improved.

In one possible design, the wide-angle color camera is located between the wide-angle monochrome camera and the tele camera.

In the present application, since the angle of view of the wide-angle color camera is large and a color image can be obtained, the image capturing apparatus can use the wide-angle color camera as the main camera and the other two cameras as the auxiliary cameras. When the wide-angle color camera is arranged between the wide-angle black-and-white camera and the telephoto camera, the wide-angle color camera can capture more information of an object to be shot in the main view field range.

In one possible design, the tele camera is a tele color camera.

In this application, because the tele camera is suitable for taking distant scenes, if the tele camera is a tele color camera, then the image capture device can obtain the color information of the distant scenes. And the three cameras in the image capturing device can be switched to use. For example, when the close range is switched to the long range, the long-focus camera is suitable for shooting the long range, so the image capturing device can be switched to the long-focus camera from the wide-angle color camera and the wide-angle black-and-white camera.

In one possible design, the tele-camera is a built-in camera, the wide-angle color camera and the wide-angle black-and-white camera are arranged on an external accessory of the image capturing device, the external accessory is rotatably connected to a frame of the image capturing device, and an angle formed between the external accessory and a display screen of the image capturing device is any angle between 0 and 360 degrees.

In the present application, the wide-angle color camera and the wide-angle monochrome camera of the three cameras provided in the image capturing apparatus may be provided on an external attachment of the image capturing apparatus. When the external accessory rotates, the wide-angle color camera and the wide-angle black-and-white camera rotate simultaneously. Taking the example that the image capturing device is a mobile phone, if the user wants to use the mobile phone to self-shoot, the external rotating accessory is directly opposite to the user, that is, the self-shoot is performed through the wide-angle color camera and the wide-angle black-and-white camera, so that a self-shoot image with higher quality is obtained.

In a second aspect, the present application provides an image capture method that may be implemented by an apparatus comprising a wide-angle color camera, a wide-angle monochrome camera, a tele color camera; the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, the field angle of the tele color camera is smaller than that of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to that of the tele color camera; the method comprises the following steps: receiving a zooming instruction, wherein the zooming instruction is used for zooming the current preview image of the device; if the zoom ratio corresponding to the zoom instruction is smaller than or equal to the preset ratio, acquiring images captured by the wide-angle color camera and the wide-angle black-and-white camera respectively and simultaneously by the object to be shot; outputting an image of an object to be shot, wherein the image of the object to be shot is obtained by fusing images captured by the wide-angle color camera and the wide-angle black-and-white camera; or if the scaling corresponding to the scaling is larger than the preset scaling, acquiring images captured by the wide-angle black-and-white camera and the long-focus color camera simultaneously on the object to be shot; and outputting an image of the object to be shot, wherein the image of the object to be shot is obtained by fusing images captured by the wide-angle white camera and the long-focus color camera.

Generally, during the process of gradually increasing the zoom ratio, that is, during the process of gradually enlarging the preview image by the user, the definition of the image gradually decreases, and the user can obviously feel that the enlarged image is blurred. In the application, the image capturing device can select different cameras from three cameras according to different scales to capture the image of the object to be shot. When the scaling is small, the image capturing device captures the image of the object to be shot through the wide-angle black-and-white camera and the wide-angle black-and-white camera, and when the scaling is large, the image capturing device captures the image of the object to be shot through the wide-angle black-and-white camera and the long-focus color camera.

In one possible design, before acquiring the image captured of the object to be photographed, the method further includes: determining the brightness value of a scene where an object to be shot is located; and respectively controlling each camera in the wide-angle color camera, the wide-angle black-and-white camera and the tele color camera to capture images of corresponding frame numbers according to the brightness value.

In the application, the image capturing device can determine how many frames of images are captured by each camera according to the brightness value of the scene where the object to be shot is located, for example, when the scene is bright, each camera can capture images with fewer frames, and when the scene is dark, each camera can capture images with more frames.

In one possible design, separately controlling each camera to capture a corresponding number of frames of images based on the brightness values includes: if the brightness value is larger than a first preset brightness value, controlling each camera to capture a P frame image; or if the brightness value is less than or equal to a second preset brightness value, controlling each camera to capture a Q frame image; wherein the second predetermined brightness value is smaller than the first predetermined brightness value, P, Q is a positive integer, and P is greater than Q.

In one possible design, before outputting the image of the object to be photographed, the method further includes: determining depth information of a scene where an object to be shot is located; and processing the obtained image captured by the object to be shot according to the depth information.

In the application, the image capturing device can process the obtained image captured by the object to be shot according to the depth information of the scene where the object to be shot is located, so that the stereoscopic impression and the layering impression of the image are improved.

In a third aspect, the present application provides an image capturing method, which may be implemented by an apparatus comprising a wide-angle color camera, a wide-angle black-and-white camera, a tele black-and-white camera; the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, the field angle of the tele black-and-white camera is smaller than that of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to that of the tele color camera, and the method comprises the following steps: receiving a zooming instruction, wherein the zooming instruction is used for zooming the current preview image of the device; if the zoom ratio corresponding to the zoom instruction is smaller than or equal to the preset ratio, acquiring images captured by the wide-angle color camera and the wide-angle black-and-white camera respectively and simultaneously by the object to be shot; outputting an image of an object to be shot, wherein the image of the object to be shot is obtained by fusing images captured by the wide-angle color camera and the wide-angle black-and-white camera; or if the scaling corresponding to the scaling is larger than the preset scaling, acquiring images captured by the wide-angle color camera and the telephoto black-and-white camera simultaneously on the object to be shot; and outputting an image of the object to be shot, wherein the image of the object to be shot is obtained by fusing images captured by the wide-angle color camera and the telephoto black-and-white camera.

Generally, during the process of gradually increasing the zoom ratio, that is, during the process of gradually enlarging the preview image by the user, the definition of the image gradually decreases, and the user can obviously feel that the enlarged image is blurred. In the present application, the image capturing apparatus may select an appropriate camera from the three cameras according to different scales to capture an image of an object to be photographed. When the scaling is small, the image capturing device captures the image of the object to be shot through the wide-angle color camera and the wide-angle black-and-white camera, and when the scaling is large, the image capturing device captures the image of the object to be shot through the wide-angle color camera and the telephoto black-and-white camera.

In one possible design, before acquiring the image captured of the object to be photographed, the method further includes: determining the brightness value of a scene where an object to be shot is located; and respectively controlling each camera in the wide-angle color camera, the wide-angle black-and-white camera and the tele black-and-white camera to capture images of corresponding frame numbers according to the brightness value.

In one possible design, before outputting the image of the object to be photographed, the method further includes: determining the depth information of the scene where the object to be shot is located; and processing the obtained image captured by the object to be shot according to the depth information.

In a fourth aspect, the present application provides an image capture method that may be implemented by an apparatus comprising a wide-angle color camera, a wide-angle black-and-white camera, a tele black-and-white camera; the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, and the field angle of the tele black-and-white camera is smaller than that of the wide-angle color camera, and the method comprises the following steps: determining a scene where an object to be shot is located; if the scene is a long shot, acquiring images captured by a wide-angle color camera, a wide-angle black-and-white camera and a telephoto camera respectively and simultaneously by an object to be shot; determining the depth information of a scene according to a first image acquired by a wide-angle color camera and a second image acquired by a wide-angle black-and-white camera; processing the first pre-shot image according to the depth information to obtain an image of an object to be shot; the first pre-shot image is obtained by fusing the first image, the second image and a third image acquired by the tele-camera.

In this application, the image capture device includes that three cameras are wide angle color camera, wide angle black and white camera, telephoto camera respectively, and three cameras respectively have an advantage, for example the ability that wide angle black and white camera is fit for shooing close-range and catches the details of waiting to shoot the object is stronger, wide angle color camera is fit for shooing close-range and the ability of acquireing the colour information of waiting to shoot the object is stronger, and telephoto camera is fit for shooing the distant view. Since the field angles of the wide-angle color camera and the wide-angle black-and-white camera are the same, the image capturing device can obtain the depth information of the scene based on the two cameras, and then process the first pre-shot image according to the depth information, so that the finally obtained image of the object to be shot has stronger stereoscopic sense.

In one possible design, the method further includes: if the scene is a close scene, acquiring images captured by a wide-angle color camera and a wide-angle black-and-white camera respectively and simultaneously by an object to be shot; determining the depth information of the scene according to the third image acquired by the wide-angle color camera and the fourth image acquired by the wide-angle black-and-white camera; processing the second pre-shot image according to the scene depth information to obtain an image of the object to be shot; and the second pre-shot image is obtained by fusing the third image and the fourth image.

In the present application, if the scene is a close-up scene, the image capturing apparatus may acquire images captured by the wide-angle color camera and the wide-angle monochrome camera respectively and simultaneously with the object to be photographed. When the wide-angle black-and-white camera is used for shooting images, the capability of capturing detailed information of an object to be shot is strong. And when the wide-angle color camera shoots an image, the capability of capturing the color information of the object to be shot is stronger. Therefore, the image capturing device has higher quality of the image of the object to be shot obtained by fusing the images collected by the wide-angle color camera and the wide-angle black-and-white camera.

In one possible design, before acquiring the image captured of the object to be photographed, the method further includes: determining a brightness value of a scene; and respectively controlling each camera in the wide-angle color camera, the wide-angle black-and-white camera and the telephoto camera to acquire images with corresponding frame numbers according to the brightness value.

In one possible design, respectively controlling each camera to acquire images of corresponding frame numbers according to the brightness value, wherein if the brightness value is greater than a first preset brightness value, each camera is controlled to acquire P frame images; or if the brightness value is less than or equal to a second preset brightness value, controlling each camera to acquire Q frame images; wherein the second predetermined brightness value is smaller than the first predetermined brightness value, P, Q is a positive integer, and P is greater than Q.

In a fifth aspect, the present application provides an image capture device. The image capturing device has the function of realizing the image capturing device in the method design of the second aspect. These functions may be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more units corresponding to the above functions.

In one possible design, a specific structure of the image capturing apparatus may include an input unit, a processing unit, and an output unit. These units may perform the respective functions in the method provided by the second aspect or any one of the possible designs of the second aspect.

In a sixth aspect, the present application provides an image capture device. The image capturing device has the function of realizing the image capturing device in the method design of the third aspect. These functions may be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more units corresponding to the above functions.

In one possible design, a specific structure of the image capturing apparatus may include an input unit, a processing unit, and an output unit. These units may perform the corresponding functions in the method provided by the third aspect or any one of the possible designs of the third aspect.

In a seventh aspect, the present application provides an image capture device. The image capturing apparatus has a function of implementing the image capturing apparatus in the method design of the fourth aspect. These functions may be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more units corresponding to the above functions.

In one possible design, the specific structure of the image capturing apparatus may include a processing unit and an output unit. These units may perform the respective functions in the method provided by the fourth aspect or any one of the possible designs of the fourth aspect.

In an eighth aspect, the present application further provides an image capturing apparatus. The image capturing device has the function of realizing the image capturing device in the method design of the third aspect. These functions may be implemented by hardware. The image capturing apparatus includes: a memory for storing computer executable program code; a processor coupled with the memory. Wherein the program code stored by the memory comprises instructions which, when executed by the processor, cause the image capturing apparatus to carry out the method performed by the image capturing apparatus of the third aspect or any one of the possible designs of the third aspect.

In a ninth aspect, the present application further provides an image capturing apparatus. The image capturing apparatus has a function of implementing the image capturing apparatus in the method design of the fourth aspect. These functions may be implemented by hardware. The image capturing apparatus includes: a memory for storing computer executable program code; a processor coupled with the memory. Wherein the program code stored by the memory includes instructions that, when executed by the processor, cause the image capture device to perform the methods described above in the fourth aspect or any one of the possible designs of the fourth aspect.

In a tenth aspect, the present application further provides an image capturing apparatus. The image capturing device has the function of realizing the image capturing device in the method design of the fifth aspect. These functions may be implemented by hardware. The image capturing apparatus includes: a memory for storing computer executable program code; a processor coupled with the memory. Wherein the program code stored by the memory includes instructions which, when executed by the processor, cause the image capturing apparatus to perform the method as performed by the image capturing apparatus of the fifth aspect described above or any one of the possible designs of the fifth aspect.

In an eleventh aspect, the present application further provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to execute the image capturing method of the second aspect described above.

In a twelfth aspect, the present application further provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to execute the image capturing method of the third aspect described above.

In a thirteenth aspect, the present application also provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to execute the image capturing method of the fourth aspect described above.

In a fourteenth aspect, the present application also provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the image capturing method of the second aspect described above.

In a fifteenth aspect, the present application also provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the image capturing method of the third aspect described above.

In a sixteenth aspect, the present application also provides a computer program product containing instructions which, when run on a computer, cause the computer to perform the image capturing method of the fourth aspect described above.

In the present application, the image capturing apparatus includes three cameras, namely, a wide-angle color camera, a wide-angle monochrome camera, and a telephoto camera, wherein the three cameras have respective advantages, for example, the wide-angle monochrome camera has a larger field angle suitable for capturing a close-up view and has a stronger capability of capturing details of an object to be captured, the wide-angle color camera has a larger field angle suitable for capturing a close-up view and has a stronger capability of capturing color information of an object to be captured, and the telephoto camera has a smaller field angle suitable for capturing a long-range view. The image capturing device can obtain images of objects to be shot with good quality under different scenes (such as a close scene, a long scene and the like) by utilizing the respective advantages of the three cameras, so that the image shooting quality is improved.

Drawings

FIG. 1 is an architecture diagram of an image capture device provided herein;

FIG. 2 is a flow chart of an image capture method provided herein;

FIG. 3 is a flow chart of another image capture method provided herein;

FIG. 4 is a diagram illustrating a sorting pattern among three cameras in an image capture device according to the present disclosure;

FIG. 5 is a schematic structural diagram of an image capture device provided in the present application;

FIG. 6 is a schematic diagram of another image capture device provided in the present application;

fig. 7 is a schematic structural diagram of another image capturing apparatus provided in the present application.

Detailed Description

The technical solutions provided in the present application will be clearly and completely described below with reference to the accompanying drawings in the present application.

Hereinafter, some terms in the present application are explained to facilitate understanding by those skilled in the art.

(1) A scene may be understood as an object and the environment in which the object is located. Generally, the environment in which the object is located may be large or small, for example, the environment in which the object is located may be wide, such as a mountain, sky, etc. Of course, the object may be located in a narrow environment, such as a room, or a simple desk. Therefore, in order for the image capturing apparatus to understand and describe the scene like a human being, the scene recognition capability is also an important reference index for whether the image capturing apparatus is intelligent.

(2) And the preview image is an image presented on a shooting preview interface by the image capturing device before shooting the image, and a user can check the shooting effect through the preview image and click a shooting button to shoot the image if the user is satisfied with the shooting effect of the preview image.

(3) The field angle is an important performance parameter of an image capture device. The field angle is used to indicate the maximum angular range that the image capture device can capture during the process of capturing an image. If the object to be shot is within the angle range, the object to be shot is collected by the image capturing device and then presented in the preview image. If the object to be photographed is outside this angular range, the photographed device will not be captured by the image capturing means, i.e. will not be presented in the preview image.

Generally, the larger the field angle of the image capturing apparatus, the larger the shooting range, and the shorter the focal length. And the smaller the angle of view of the image capturing apparatus, the smaller the shooting range and the longer the focal length.

In the present application, the term "angle of view" may be referred to as a "field of view range" or a "field of view range". That is, the name of "angle of view" herein is not limited as long as the concept as above is expressed.

(4) Scene depth, which is a parameter used to describe a scene. The scene depth can be understood as the distance between the image capture device and the object to be photographed. The depth of the scene may be represented by a depth map, in which each pixel value may reflect the magnitude of the distance between the object to be photographed and the image capture device. The closer to the image capturing device, the smaller the pixel value, and the farther from the image capturing device, the larger the pixel value.

In the present application, the "scene depth" may be referred to as "depth of field", "image depth", or the like. That is, the name of "scene depth" is not limited herein as long as the concept as above is expressed.

(5) Zoom photography, i.e., the image capture device changes the focal length during the process of taking an image. For example, when a user photographs a distant object through an image capturing apparatus, the object is necessarily displayed smaller in a preview image displayed by the image capturing apparatus. In the case where the user does not change his or her own position, zoom shooting may be selected in order to "zoom in" the object in the preview image.

In general, zoom photographing includes two modes, optical zoom photographing and digital zoom photographing. Both of these ways can change the size of objects in the preview image displayed by the image capture device.

(6) Resolution, is an important performance parameter of image capture devices. In colloquial terms, resolution is understood to be the ability to resolve the details of a subject. For example, if the subject is a piece of paper and is covered with many lines, the image capturing device with strong resolution can recognize 100 lines, while the image capturing device with weak resolution can recognize only 10 lines. The greater the resolution of the image capturing apparatus, the greater the ability of the image capturing apparatus to restore details of an object to be photographed after capturing an image of the object to be photographed, e.g., the greater the sharpness of the magnified image the user wants to magnify the captured image.

Generally, the resolution has a certain relationship with the pixel, resolution, etc., the higher the pixel or resolution, the stronger the resolution of the image capturing apparatus, and in the case of a black-and-white image capturing apparatus, the greater the resolution of the black-and-white image capturing apparatus is, because of its greater ability to capture details of the object to be photographed, the greater the resolution of the color image capturing apparatus is.

(7) The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship, unless otherwise specified. Also, the terms "first," "second," and the like in the description of the present application are used for descriptive purposes only and are not intended to indicate or imply relative importance nor order to be construed.

The following describes a process of image capturing by the present image capturing apparatus.

In order to improve the photographing effect, the industry proposes to provide two cameras in an image capturing device, and complement image information by using the difference between image information obtained by the two cameras, so as to improve the quality of the finally photographed image. However, the image capturing apparatus provided with two cameras simply superimposes image information acquired by the two cameras when capturing an image. In this way, images with high quality cannot be shot under various scenes. For example, the image capture device is configured with two cameras, one wide camera and one tele camera. The image capturing device respectively acquires two images through the two cameras, and then fuses image information of the two images to obtain a finally shot image. However, the wide-angle camera is suitable for close-range shooting because of its large field angle, and the telephoto camera is suitable for long-range shooting because of its small field angle. Therefore, although the current dual-camera image capturing device can take pictures of different scenes at the same time, the three-dimensional effect of the finally obtained image is poor and the image quality is poor due to the fact that the field angles of the two cameras are not matched. For example, two images obtained by such a dual-camera image capturing apparatus include a portion where the angles of view overlap and a portion where the angles of view do not overlap. If the two images are directly fused, the definition of the part with the overlapped field angle in the finally shot image is high, and the definition of the part without the overlapped field angle is low, so that the definition of the central part and the definition of the peripheral part of the whole image are inconsistent. Moreover, two images obtained by cameras with unmatched view angles cannot obtain a depth map with a larger view field, so that the depth map-based processing cannot be performed on the whole image, and the finally obtained image has poor stereoscopic impression and poor image quality.

As can be seen, even if dual cameras are provided in the current image capturing apparatus, images with high quality cannot be captured in various scenes.

In order to solve the technical problem, the present application provides a new image capturing apparatus. The image capturing device is provided with three cameras, namely a wide-angle color camera, a wide-angle black-and-white camera and a telephoto camera; the image capturing device can obtain an image of an object to be shot with better quality by utilizing the respective advantages of the three cameras, thereby improving the quality of the obtained image. First, the system architecture of the image capturing apparatus of the present application will be described in detail. The image capture device herein may be a cell phone, a PAD, or a camera, etc. Take the example that the image capturing device is specifically a mobile phone. Referring to fig. 1, fig. 1 shows a system architecture of a handset 100.

As shown in fig. 1, the cellular phone 100 includes: wide-angle color camera 110, wide-angle monochrome camera 120, and tele camera 130, processor 140, display 150, memory 160, and power supply 170. The wide-angle color camera 110, the wide-angle black-and-white camera 120, and the telephoto camera 130 are respectively used for acquiring images of an object to be photographed. The processor 140 may be used to process images. The display screen 150 may be used to display images. The memory 160 may be used to store images. The power supply 170 may be used to power the handset 100. The process of the user taking an image through the mobile phone 100 is as follows:

the user triggers at least one of the wide-angle color camera 110, the wide-angle monochrome camera 120, and the telephoto camera 130 in the mobile phone 100 to acquire an image of an object to be photographed, and transmits the acquired image to the processor 140. The processor 140 receives and processes the image captured by at least one camera to obtain a preview image, which may be the image captured by one of the cameras, for example, the image captured by the wide-angle color camera 110. The processor 140 transmits the preview image to the display 150 to be displayed so that the user can see the preview image before photographing through the display 150. The preview image may be displayed specifically by the display panel 151 in the display screen 150. A user can input a shooting instruction through the touch panel 152 in the display screen 150, so that the mobile phone 100 shoots an object to be shot through the mutual cooperation of the wide-angle color camera 110, the wide-angle black-and-white camera 120 and the telephoto camera 130.

Referring to fig. 2, a flowchart of an image capturing method according to an embodiment of the present application is shown. In the following description, the method is applied to the mobile phone shown in fig. 1 as an example. The process of the method is described as follows:

s201: and determining the scene of the object to be shot.

As mentioned above, the scene can be understood as the environment in which the object is located, and the environment in which the object is located may be large or small. Therefore, one possible implementation manner of S101 is that the image capturing device determines the scene in which the object to be photographed is located by detecting the distance between the object to be photographed and the image capturing device.

Therefore, in the present application, the image capturing apparatus may set a standard distance range in advance. And when the distance between the image capturing device and the object to be shot is greater than the maximum value in the standard distance range, determining that the scene in which the object to be shot is located is a long shot. When the distance between the image capturing device and the object to be shot is within the standard distance range, the scene where the object to be shot is located is determined to be a medium scene. And when the distance between the image capturing device and the object to be shot is smaller than the minimum value in the standard distance range, determining that the scene in which the object to be shot is located is a close scene.

Of course, S201 may have other modes, and this application does not specifically limit this.

S202: according to a scene, at least one camera suitable for the scene is selected from three cameras provided in an image capturing apparatus.

Two implementations of S202 are described below.

In the first way, the image capturing apparatus selects at least one camera suitable for shooting a scene according to the scene and the field angles of the three cameras.

As mentioned above, the image capturing apparatus can divide the scene in which the object to be photographed is located into a near view, a middle view, and a far view. Then in the first mode, there are three cases. In the first case, when the scene in which the object to be photographed is located is a close scene, how the image capturing apparatus selects a camera suitable for photographing the scene. In the second case, when the scene in which the object to be photographed is located is a distant view, how the image capturing apparatus selects a camera suitable for photographing the scene. In the third case, when the scene in which the object to be photographed is located is a medium scene, how the image capturing apparatus selects a camera suitable for photographing the scene.

As mentioned above, the larger the angle of view of the camera is, the better the close shot is, i.e. when the close shot is shot by the camera with the larger angle of view, the quality of the finally shot image is better. Conversely, the smaller the angle of view of the camera, the better the suitability for taking a long shot. That is, when a long-range view is photographed by a camera having a small field angle, the quality of the finally photographed image is good. Therefore, the image capturing apparatus can perform shooting by reversely deducing the camera of which angle of view is required to be taken by the scene in which the object to be shot is located.

Therefore, for the first case, the scene in which the object to be photographed is located is a close view. The image capturing apparatus may select a camera with a large angle of view. For the second case, the scene in which the object to be photographed is located is a medium scene. The image capture device may select a camera with a moderate field angle. For the third case, the scene in which the object to be shot is located is a long shot. The image capturing apparatus may select a camera with a small angle of view.

In the present application, the image capturing apparatus may set a preset field angle range in advance. When the field angle of the camera is larger than the maximum value of the preset field angle range, the field angle of the camera is considered to be larger, and the camera is suitable for close-range shooting. When the field angle of the camera is smaller than the minimum value in the preset field angle range, the field angle of the camera is considered to be smaller, and the camera is suitable for long-range shooting. When the field angle of the camera is within the preset field angle range, the field angle of the camera is considered to be moderate, and the camera is suitable for medium-view shooting.

Therefore, when the scene in which the object to be photographed is located is a close scene, the image capturing apparatus can select a camera with a large angle of view to photograph. For example, since the wide-angle color camera has a large angle of view, and a color image can be obtained. Therefore, the image capturing device can directly select the wide-angle color camera to shoot, and the mode is simple and easy to realize. Of course, the image capturing apparatus may also select the wide-angle color camera and the wide-angle monochrome camera to perform shooting simultaneously. This approach helps to improve the quality of the final captured image. This is because the wide-angle black-and-white camera has a strong ability to capture detailed information of an object to be photographed when photographing an image. And when the wide-angle color camera shoots an image, the capability of capturing the color information of the object to be shot is stronger. Therefore, the image capturing device has high quality of a shot image obtained by fusing the images collected by the wide-angle color camera and the wide-angle black-and-white camera.

When the scene of the object to be shot is a long shot, the image capturing device can select a camera with a small field angle for shooting. For example, because the field angle of the tele camera is small, if the third camera is a tele color camera, the image capturing device can directly select the tele color camera for shooting, which is simple and easy to implement. If the third camera is a tele black and white camera, the image capture device may directly select the wide-angle color camera and the tele black and white camera to shoot simultaneously. Of course, the image capturing apparatus may select three cameras to capture images simultaneously. This approach helps to improve the quality of the final captured image for reasons that will be described later.

Second, the image capture device selects at least one camera suitable for capturing the scene based on the brightness of the scene and the format of the camera.

Taking the example that the first camera is in the Quadra format, when the scene brightness is low, the wide-angle color camera and the wide-angle black-and-white camera can be directly adopted for shooting. This is because the wide-angle color camera has a strong ability to capture color information and luminance information of an object to be photographed. The wide-angle black-and-white camera has strong capability of capturing the detailed information of the object to be shot. The brightness information, the color information, the definition and the like of the finally shot image are obtained through the fusion of the images collected by the two cameras. When the scene brightness is high, the image capturing device can change the Quadra format of the wide-angle color camera into the Bayer format through the Remosaic algorithm, and then shooting is carried out by adopting the wide-angle color camera and the wide-angle black-and-white camera.

It should be noted that, if the camera is in the Quadra format, 4 pixels in the image captured by the camera correspond to one brightness value, so the brightness value of the image is increased by 4 times, that is, the brightness value of the image is larger. If the camera is in a Bayer format, 1 pixel point in an image captured by the camera corresponds to a brightness value, and the brightness value in the image is smaller.

Therefore, when the brightness of the scene is low, in order to ensure that the finally photographed image has sufficient brightness, the brightness value of the finally photographed image can be increased by adopting the Quadra format. If the brightness of the scene is high, the first camera can capture an image with enough brightness value only by using a Bayer format. Therefore, the Quadra format can be converted into the Bayer format.

As a possible implementation manner, the manner in which the first camera is converted from the Quadra format to the Bayer format may be that a Remosaic algorithm is adopted, that is, 4 pixel points are changed from the original 1 brightness value to 4 brightness values, and the brightness values are supplemented by other 3 pixel points through a difference value reconstruction manner.

In actual operation, the image capturing apparatus may adopt any one of the above two modes according to actual conditions. Of course, the two ways may be combined, and the present application is not limited to this.

S203: and acquiring an image acquired by at least one camera and a shot object, and processing the acquired image to obtain an image of the object to be shot.

Taking at least one camera, specifically three cameras as an example, the process of S203 can be implemented by two steps. Firstly, three cameras respectively and simultaneously acquire images of an object to be shot; and secondly, processing the images acquired by the three cameras by the image capturing device to obtain an image of the object to be shot. These two steps are as follows.

In a first step, the image capture device may determine the number of frames each of the three cameras acquired an image. One possible implementation manner is that the image capturing device respectively controls each camera to acquire images of corresponding frame numbers according to the brightness of the scene where the object to be shot is located.

For example, when the brightness of the scene is low, the image capturing device may control each camera to capture more frames of images. When the brightness of the scene is large, the image capturing device can control each camera to capture images of fewer frames.

This is because the brightness of the scene in which the object to be photographed is located can affect the signal-to-noise ratio of the image captured by the camera. If the brightness of the scene is low, the signal-to-noise ratio of the acquired image is low, that is, the ratio of the effective signal to the noise in the acquired image is low, and the component occupied by the noise is large. At this time, in order to obtain a sufficient effective signal, the image capturing apparatus may control the camera to capture images of a plurality of frames. If the brightness of the scene is larger, the signal-to-noise ratio of the acquired image is larger, that is, the ratio of the effective signal to the noise in the acquired image is larger, that is, the noise occupies smaller components. At this time, sufficient effective information can be obtained without acquiring more images, so the image capturing device can control the camera to acquire less frames of images.

Of course, the image capturing device may also determine the number of frames of the captured images by each camera in other manners, and the application is not limited in particular.

After the image capturing device determines the number of frames that each camera captures an image, each camera captures an image for the corresponding number of frames.

In a second step, the image capturing device may pre-process the images captured by each camera separately. The pretreatment process is as follows:

the image capturing device can perform noise reduction processing on the image acquired by each camera, and fuse all the frame images subjected to the noise reduction processing to obtain an image with a relatively high signal-to-noise ratio. Thus, each camera corresponds to an image with a relatively high signal-to-noise ratio. Then, the image capturing device may fuse the images corresponding to each camera again to obtain an image of the object to be photographed preliminarily, and the image may be directly used as a final image of the object to be photographed.

Of course, the image capturing apparatus may further process the preliminarily obtained image of the object to be photographed in order to improve the quality of the final image of the object to be photographed. For example, the image capturing apparatus may perform image enhancement processing on the preliminarily obtained image of the object to be photographed according to the scene depth information to improve the quality of the final image of the object to be photographed.

In the present application, there may be a plurality of image fusion methods, such as wavelet transformation fusion method, pyramid transformation fusion method, etc., and the present application does not limit this method specifically.

In the present application, the manner in which the image capture device determines the scene depth information may be varied. For example, the image capturing device may determine two cameras with equal field angles, such as a wide-angle color camera and a wide-angle black-and-white camera, of the three cameras, and then determine the depth information of the scene through the parallax of the images captured by the two cameras. There are, of course, other implementations, and the present application is not limited in this regard.

There are also various ways in which the image capture device performs image enhancement processing on the preliminarily obtained image of the object to be photographed according to the scene depth information. For example, the image capturing apparatus may perform image enhancement processing of contrast and sharpness only on the preliminarily obtained image of the object to be photographed as a whole according to the scene depth information to improve the stereoscopic impression and the hierarchical impression of the final image of the object to be photographed. For example, the image capturing device may only perform image enhancement processing on the definition of the foreground, such as a portrait, in the preliminarily obtained image of the object to be photographed according to the scene depth information, and does not perform processing on the definition of the background, or perform image blurring processing, which is similar to the case where the user uses a large aperture to photograph, thereby realizing personalized photographing. For another example, the image capturing device may further perform image enhancement processing on the definition of the region selected by the user on the preliminarily obtained image of the object to be photographed according to the scene depth information, and perform no processing or image blurring processing on other regions, which is similar to the effect of focusing after photographing by the user, thereby realizing personalized photographing.

And S204, outputting the image of the object to be shot.

The image capturing apparatus may output, for example, display an image of the object to be photographed on a display screen of the image capturing apparatus after obtaining the image of the object to be photographed. Of course, other implementations are possible, and the present application is not limited in particular.

In the embodiment shown in fig. 2, the image capturing device does not change the focal length during the capturing of the image, i.e. the image capturing device performs normal 1x capture. Another embodiment is described below in which an image capturing apparatus performs zoom photographing.

Referring to fig. 3, a flow chart of another image capturing method provided by the present application is shown. The process of the method is described as follows:

s301: a zoom instruction is received that instructs a preview image currently displayed by the image capture device to be zoomed.

In the present application, the manner in which different image capture devices receive zoom instructions may vary. For example, in a smartphone having a touch panel, a user may input a zoom instruction by performing a zoom operation on a preview image displayed on the touch panel, or may input a zoom instruction by a volume key, or the like. For the digital camera, the user can input a zoom instruction by adjusting the zoom ring, and further zoom the preview image. Of course, the image capturing apparatus may have other ways of receiving the zoom command, which is not specifically limited in this application.

S302: and selecting at least one camera suitable for the scaling from the three cameras of the image capturing device according to the scaling corresponding to the scaling instruction.

If the image capturing apparatus inputs a zoom instruction by a zoom operation of the user on the preview image, the user zooms the preview image to a greater degree, and the zoom ratio is greater. If the user zooms the preview image to a smaller degree, the zoom ratio is smaller. Similarly, if the image capture device inputs a zoom instruction by user adjusting the zoom ring, the larger the user adjusts the zoom ring, the larger the zoom ratio, and the smaller the user adjusts the zoom ring, the smaller the zoom ratio.

Note that the zoom magnification and the zoom ratio have a certain relationship. For example, when the user photographs an object 10 meters away from the user through a mobile phone, the object in the preview image is displayed relatively small, and if the user enlarges the preview image by 2 times, the user is equivalent to the effect that the user himself moves to a position 5 meters away from the object to photograph the object under the condition that the position of the user is not moved, that is, the user is equivalent to the effect that the user reduces the focal length by 2 times. It can be seen that the scaling herein can also be understood as zoom magnification.

As one possible implementation, the image capturing apparatus may select a camera suitable for the scaling according to the scaling and the resolving power of the three cameras.

When the designer designs the image capturing device, the resolving power relationship among the wide-angle color camera, the wide-angle black-and-white camera and the telephoto color camera can be designed in advance. For example, the resolution of the wide-angle color camera is smaller than that of the wide-angle monochrome camera, and the resolution of the wide-angle monochrome camera is equal to or greater than that of the tele color camera.

As mentioned above, the resolution of the cameras and the resolution of the cameras have a certain correlation, so the relationship between the resolution of the three cameras can be indirectly represented by the relationship between the resolutions. Take the resolution of the wide-angle color camera as Wa × Ha, the resolution of the wide-angle black-and-white camera as Wb × Hb, and the resolution of the telephoto camera as Wc × Hc as an example. Where H denotes the height direction and W denotes the width direction. Wa is equal to or less than Wb. When the resolution of the wide-angle black-and-white camera and the tele camera meets Wb S-W C F₀When the image is taken, the resolution of the long-focus camera is greater than or equal to that of the wide-angle black-and-white camera. Where S can be understood as a resolution enhancement factor introduced when the image capture device processes the wide-angle monochrome camera according to the super-resolution technique (the determination of S will be described later). Since the telephoto camera may be a telephoto black-and-white camera or a telephoto color camera, two cases will be described below.

In the first case, the image capturing apparatus includes three cameras, i.e., a wide-angle color camera, a wide-angle monochrome camera, and a telephoto color camera.

In the present application, the image capturing apparatus may be preset with a scaling ratio F₀. The image capturing device can adjust the scaling (F) corresponding to the scaled-in scaling instruction to the preset scaling (F)₀) And (6) comparing. The comparison results in three cases, i.e. F is greater than F₀Equal to F₀Or less than F₀。

The following describes the determination of the scaling F by the image capturing apparatus₀Of a wide-angle colour camera, e.g. of a wide-angle colour cameraThe field angle is α, the field angle of the wide-angle black-and-white camera is α, the field angle of the tele camera is β > β, and the pre-stored scaling F is₀Can be obtained by the following formula:

in this case, the telephoto camera is specifically a telephoto color camera, so that when F is equal to or less than F₀The image capturing device selects a wide-angle color camera and a wide-angle black-and-white camera to capture an image of an object to be photographed. When F is greater than F₀The image capturing device selects the wide-angle black-and-white camera and the telephoto color camera to capture an image of an object to be photographed.

This is because, in this case, the resolution of the wide-angle monochrome camera is larger than that of the telephoto color camera. For example, both have the same horizontal and vertical resolution, but in the diagonal direction, the resolution of the wide-angle monochrome camera is greater than that of the tele color camera. Therefore, when the scale of the user input is small, the image capturing apparatus performs photographing through the wide-angle color camera and the wide-angle monochrome camera. When the user gradually increases the zoom scale, the image capture device can switch the wide-angle color camera to the tele color camera, i.e., shoot through the wide-angle monochrome camera and the tele color camera, and since the resolution of the wide-angle monochrome camera is large, the sharpness of the image is good even if the user "zooms in" the preview image by a large amount.

In the second case, the image capturing apparatus includes three cameras, i.e., a wide-angle color camera, a wide-angle monochrome camera, and a telephoto monochrome camera.

In this case, the telephoto camera is specifically a telephoto black-and-white camera, and then when F is equal to or less than F₀In time, the image capture device takes a picture through a wide-angle color camera and a wide-angle monochrome camera. When F is greater than F₀Meanwhile, the image capturing device performs shooting by the second wide-angle color camera and the tele black-and-white camera.

This is because, in this case, the resolution of the wide-angle monochrome camera is equal to that of the telephoto color camera. Therefore, if the zoom ratio input by the user is small, the image capturing apparatus performs photographing through the wide-angle color camera and the wide-angle monochrome camera. When the user gradually increases the zoom scale, the image capturing device can switch the wide-angle monochrome camera to the tele-black-white camera, that is, shoot through the wide-angle color camera and the tele-black-white camera, and since the resolution of the wide-angle monochrome camera is equal to that of the tele-color camera, even if the user 'magnifies' the preview image by a large margin, the sharpness of the image will not jump.

It should be noted that the wide-angle color camera may be in a Bayer format or a Quadra format. Taking the example that the wide-angle color camera is in the Quadra format, in zoom shooting, if an image is captured by the wide-angle color camera, it may be considered to adjust the format of the wide-angle color camera according to the luminance value of the scene.

For example, when the scene brightness is low, a wide-angle color camera in the Quadra format can be directly adopted. When the scene brightness is high, the image capturing device can change the Quadra format of the wide-angle color camera into the Bayer format through the Remosaic algorithm and then shoot by adopting the wide-angle color camera.

One possible way in which the image capture device determines S is described below.

Generally, after an image is captured by a camera, the image has an initial value of resolution. And the initial value of the resolution of the image tends to be low, the image capturing apparatus can increase the initial value of the resolution of the image. But cannot be increased without limitation, so the image capturing apparatus can only increase the resolution of the image to an optimal value by the super-resolution technique. And S may be understood as the difference between the optimum value and the initial value.

S303: and acquiring images which are acquired by at least one camera and acquired by the object to be shot, and processing the acquired images to obtain the image of the object to be shot.

S303 may be implemented in two steps. Firstly, each camera collects an image of an object to be shot; and secondly, processing the images collected by each camera by the image capturing device to obtain the images of the object to be shot. These two steps are similar to those of S203 in the embodiment shown in fig. 1 described earlier. The only difference is that in the second step here, a process is added in which the image capturing means crop the image of the object to be photographed.

This is because the user desires to "zoom in" a displayed small object in the image, and the image after the zoom-in is actually a part of the image before the "zoom-in", so in order to photograph the object after the "zoom-in", the image capturing apparatus may crop the object to be photographed to obtain a photographed image of the object that the user desires to "zoom-in".

Taking the example that the image capturing device selects the wide-angle color camera and the wide-angle monochrome camera to capture the image of the object to be photographed, the image capturing device may crop the first image captured by the wide-angle color camera and the second image captured by the wide-angle monochrome camera. Two possible clipping methods are described below.

First, the image capture device may reduce the length and width of the first image or the second image by F times, respectively. Here, F is the scaling determined by the image capturing apparatus according to the scaling instruction.

For example, the size of the first image before cropping is: long L₁Width H₁The size of the first image after cropping is: long L₁/F, width H₁and/F. The size of the second image before cropping is: long L₂Width H₂The size of the second image after cropping is: long L₂/F, width H₂and/F. This approach is suitable for the case where the resolution is the same between the wide-angle color camera and the wide-angle monochrome camera.

Second, the image capture device may reduce the length and width of the first image or the second image by WF times, respectively. W here is used to indicate the ratio of the resolution between the wide-angle color camera and the wide-angle monochrome camera. For example, if the resolution of the wide-angle color camera is a and the resolution of the wide-angle monochrome camera is B, W is a/B.

For example, the size of the first image before cropping is: long L₁Width H₁The size of the first image after cropping is: long L₁W/F, width H₁and/W/F. The size of the second image before cropping is: long L₂WF, Width H₂and/F, the size of the second image after cropping is, length: l is₂/F/W, Width: h₂and/F/W. The cutting is suitable for the condition that the resolution ratio of a wide-angle color camera is different from that of a wide-angle black-and-white camera.

And S304, outputting the image of the object to be shot.

Reference to S304 is made to the foregoing reference to S204 in the embodiment illustrated in fig. 2. For the sake of brevity of the description, no further description is provided herein.

In the present application, the positions where the respective cameras are located in the image capturing apparatus may be arbitrary. For example, all cameras may be located more centrally at one location in the image capture device or may be located discretely at different locations in the image capture device. Take an example in which the image capturing apparatus is provided with three cameras. Referring to fig. 4, fig. 4 illustrates a possible arrangement of three cameras (cameras a-C) in the image capture device. Of course, in practical application, the positions of the cameras are not limited to the several arrangements listed in fig. 4, and may be determined according to practical situations.

It should be noted that, in order to make the image capturing apparatus lighter and thinner, the plurality of cameras may be located on the same horizontal plane, that is, there is no height difference between every two cameras. In this way, the image capturing device can be prevented from being too thick, which is helpful for improving the user experience. Of course, the ordering among the multiple cameras on the same plane may be arbitrary.

In the present application, an Optical Image Stabilization (OIS) module may be configured for each camera to prevent a situation that a captured image is blurred due to a shake of a user during capturing the image. Of course, it is also possible to configure only one OIS, i.e. all cameras share the OIS.

In summary, in the present application, the image capturing device includes three cameras, namely, a wide-angle color camera, a wide-angle black-and-white camera, and a telephoto camera, wherein the three cameras have respective advantages, for example, the wide-angle black-and-white camera is suitable for capturing a close-up view and has a strong ability to capture details of an object to be captured, the wide-angle color camera is suitable for capturing a close-up view and has a strong ability to acquire color information of the object to be captured, and the telephoto camera is suitable for capturing a long-up view. The image capturing device can obtain an image of an object to be shot with better quality by utilizing the respective advantages of the three cameras, thereby improving the quality of the obtained image.

The apparatus provided by the present application is described below with reference to the accompanying drawings.

Fig. 5 shows a schematic configuration of an image capture apparatus 500. The image capturing apparatus 500 may implement the functions of the image capturing apparatus referred to above. The image capturing apparatus 500 may comprise an input unit 501, a processing unit 502, an output unit 503. Input unit 501 may be used, among other things, to perform S301 in the embodiment shown in fig. 3, and/or to support other processes for the techniques described herein. Processing unit 502 may be used to perform S302-S303 in the embodiment shown in FIG. 3, and/or other processes for supporting the techniques described herein. Output unit 503 may be used to perform S304 in the embodiment shown in fig. 3, and/or other processes for supporting the techniques described herein. All relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.

Fig. 6 shows a schematic configuration of an image capture apparatus 600. The image capturing apparatus 600 may implement the functions of the image capturing apparatus referred to above. The image capturing apparatus 600 may include a processing unit 601 and an output unit 602. Among other things, processing unit 601 may be used to perform S201-S203 in the embodiment shown in FIG. 2, and/or other processes for supporting the techniques described herein. Output unit 602 may be used to perform S204 in the embodiment shown in fig. 2, and/or other processes for supporting the techniques described herein. All relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.

Note that, in the present application, the image capturing apparatus 500 and the image capturing apparatus 600 are shown as functional units. As used herein, without limitation, the term "unit" may refer to an application-specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and memory that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.

In a simple embodiment, it will be appreciated by those skilled in the art that any one of the image capturing apparatus 500 and the image capturing apparatus 600 may also be implemented by the structure shown in fig. 7.

As shown in fig. 7, the image capturing apparatus 700 may include: memory 701, processor 702, and bus 703. The memory 701 and the processor 702 may be connected by a bus 703. Wherein, the memory 701 is used for storing computer executable instructions, and when the image capturing apparatus 700 is operated, the processor 702 executes the computer executable instructions stored in the memory 701, so as to make the image capturing apparatus 700 execute the image capturing method provided by the embodiment shown in fig. 2 or fig. 3. For a specific image capturing method, reference may be made to the above description and the related description in the drawings, and details are not repeated here.

In this application, the processor 702 may be a field-programmable gate array (FPGA), an Application Specific Integrated Circuit (ASIC), a system on chip (SoC), a Central Processing Unit (CPU), a Network Processor (NP), a digital signal processing circuit (DSP), a Microcontroller (MCU), or a Programmable Logic Device (PLD) or other integrated chips. The bus 703 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus 703 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 7, but this is not intended to represent only one bus or type of bus.

In the above-described embodiments of the invention, may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions described in accordance with the present application are generated, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

The above embodiments are only used to describe the technical solutions of the present application in detail, but the above embodiments are only used to help understanding the method and the core idea of the present application, and should not be construed as limiting the present application. Those skilled in the art can easily conceive of changes or substitutions within the technical scope of the present disclosure, and all such changes or substitutions are intended to be included within the scope of the present disclosure.

Claims

1. An image capturing apparatus, characterized in that the apparatus comprises:

the system comprises a wide-angle color camera, a wide-angle black-and-white camera, a telephoto camera, a processor and a memory; the wide-angle color camera, the wide-angle black-and-white camera and the tele camera are arranged on the same side surface of a shell of the image capturing device; the wide-angle black-and-white camera and the wide-angle color camera have the same field angle, and the field angle of the tele camera is smaller than that of the wide-angle color camera; the wide-angle color camera is positioned between the wide-angle black-and-white camera and the tele camera; the long-focus camera is a long-focus color camera;

the memory is used for storing static or dynamic images of an object to be shot, which are captured by at least one camera of the wide-angle color camera, the wide-angle black-and-white camera or the long-focus camera;

the processor is used for processing the static or dynamic image to obtain an image of the object to be shot.

2. The apparatus of claim 1, wherein the tele camera is a built-in camera, the wide color camera and the wide monochrome camera are disposed on an external component of the image capture device, the external component is rotatably connected to a bezel of the image capture device, and an angle formed between the external component and a display screen of the image capture device is any angle between 0 and 360 degrees.

3. An image capturing method is characterized in that the method is applied to an image capturing device comprising a wide-angle color camera, a wide-angle black-and-white camera and a long-focus color camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, the field angle of the tele color camera is smaller than the field angle of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to the resolution of the tele color camera, and the method comprises:

receiving a zooming instruction, wherein the zooming instruction is used for zooming a current preview image of the device;

if the zoom ratio corresponding to the zoom instruction is smaller than or equal to a preset ratio, acquiring images captured by the wide-angle color camera and the wide-angle black-and-white camera respectively and simultaneously by an object to be shot; outputting an image of the object to be shot, wherein the image of the object to be shot is obtained by fusing images captured by the wide-angle color camera and the wide-angle black-and-white camera; or

If the scaling corresponding to the scaling is larger than the preset scaling, acquiring images captured by the wide-angle black-and-white camera and the long-focus color camera simultaneously on an object to be shot; and outputting the image of the object to be shot, wherein the image of the object to be shot is obtained after the images captured by the wide-angle white camera and the long-focus color camera are fused.

4. The method of claim 3, wherein prior to acquiring the image captured of the object to be photographed, the method further comprises:

determining the brightness value of the scene where the object to be shot is located;

and respectively controlling each camera in the wide-angle color camera, the wide-angle black-and-white camera and the tele color camera to capture images of corresponding frame numbers according to the brightness value.

5. The method of claim 4, wherein said individually controlling each camera to capture a corresponding number of frames of images based on the brightness values comprises:

if the brightness value is larger than a first preset brightness value, controlling each camera to capture a P frame image; or

If the brightness value is smaller than or equal to a second preset brightness value, controlling each camera to capture a Q frame image;

wherein the second preset brightness value is smaller than the first preset brightness value, P, Q is a positive integer, and P is greater than Q.

6. The method according to any one of claims 3 to 5, wherein before outputting the image of the object to be photographed, the method further comprises:

determining the depth information of the scene where the object to be shot is located;

and processing the obtained image captured by the object to be shot according to the depth information.

7. An image capturing method is characterized in that the method is applied to an image capturing device comprising a wide-angle color camera, a wide-angle black-and-white camera and a tele black-and-white camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, the field angle of the tele black-and-white camera is smaller than the field angle of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to that of the tele color camera, and the method comprises:

If the scaling corresponding to the scaling is larger than the preset scaling, acquiring images captured by the wide-angle color camera and the tele black-and-white camera simultaneously on the object to be shot; and outputting the image of the object to be shot, wherein the image of the object to be shot is obtained by fusing the images captured by the wide-angle color camera and the tele black-and-white camera.

8. The method of claim 7, wherein prior to acquiring the image captured of the object to be photographed, the method further comprises:

and respectively controlling each camera in the wide-angle color camera, the wide-angle black-and-white camera and the tele black-and-white camera to capture images of corresponding frame numbers according to the brightness value.

9. The method of claim 8, wherein said individually controlling each camera to capture a corresponding number of frames of images based on the brightness values comprises:

10. The method according to any one of claims 7 to 9, wherein before outputting the image of the object to be photographed, the method further comprises:

11. An image capturing method is characterized in that the method is applied to an image capturing device comprising a wide-angle color camera, a wide-angle black-and-white camera and a tele black-and-white camera; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, and the field angle of the tele black-and-white camera is smaller than the field angle of the wide-angle color camera, the method comprising:

determining a scene where an object to be shot is located;

if the scene is a long shot, acquiring images of the wide-angle color camera, the wide-angle black-and-white camera and the telephoto camera which are respectively and simultaneously captured on the object to be shot;

determining the depth information of the scene according to the first image acquired by the wide-angle color camera and the second image acquired by the wide-angle black-and-white camera;

processing the first pre-shot image according to the depth information to obtain an image of the object to be shot; the first pre-shot image is obtained by fusing the first image, the second image and a third image acquired by the tele-camera;

and outputting the image of the object to be shot.

12. The method of claim 11, wherein the method further comprises:

if the scene is a close scene, acquiring images captured by the wide-angle color camera and the wide-angle black-and-white camera on the object to be shot respectively and simultaneously;

determining the depth information of the scene according to the third image acquired by the wide-angle color camera and the fourth image acquired by the wide-angle black-and-white camera;

processing a second pre-shot image according to the scene depth information to obtain an image of the object to be shot; and the second pre-shot image is obtained by fusing the third image and the fourth image.

13. The method of claim 11, wherein prior to acquiring the image captured of the object to be photographed, the method further comprises:

determining a luminance value of the scene;

and respectively controlling each camera in the wide-angle color camera, the wide-angle black-and-white camera and the tele camera to acquire images of corresponding frame numbers according to the brightness value.

14. The method of claim 13, wherein separately controlling each camera to capture a corresponding number of frames of images based on the brightness values comprises:

if the brightness value is larger than a first preset brightness value, controlling each camera to collect a P frame image; or

If the brightness value is less than or equal to a second preset brightness value, controlling each camera to acquire Q frame images;

15. An image capturing apparatus, characterized in that the apparatus comprises a wide-angle color camera, a wide-angle black-and-white camera, a tele color camera, a processing unit and an input unit and an output unit; the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, and the field angle of the tele color camera is smaller than that of the wide-angle color camera; the resolution of the wide-angle black-and-white camera is greater than or equal to that of the long-focus color camera;

the input unit is used for receiving a zooming instruction, and the zooming instruction is used for zooming the current preview image of the device;

the processing unit is used for acquiring images captured by the wide-angle color camera and the wide-angle black-and-white camera respectively and simultaneously by an object to be shot when the zoom ratio corresponding to the zoom instruction is smaller than or equal to a preset ratio;

the output unit is further used for outputting the image of the object to be shot, wherein the image of the object to be shot is obtained by fusing the images captured by the wide-angle color camera and the wide-angle black-and-white camera;

the processing unit is further used for acquiring images captured by the wide-angle black-and-white camera and the long-focus color camera simultaneously on an object to be shot when the scaling corresponding to the scaling is larger than the preset scaling;

the output unit is further used for outputting the image of the object to be shot, wherein, or the image of the object to be shot is obtained after the wide-angle white camera and the image captured by the long-focus color camera are fused.

16. The apparatus as recited in claim 15, said processing unit to further:

17. The apparatus as recited in claim 16, said processing unit to:

18. The apparatus of any of claims 15-17, wherein the processing unit is further to:

19. An image capturing apparatus, characterized in that the apparatus comprises a wide-angle color camera, a wide-angle black and white camera, a tele black and white camera, an input unit, a processing unit and an output unit; the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, the field angle of the tele black-and-white camera is smaller than that of the wide-angle color camera, and the resolution of the wide-angle black-and-white camera is greater than or equal to that of the tele color camera;

the output unit is used for outputting the image of the object to be shot, wherein the image of the object to be shot is obtained by fusing the images captured by the wide-angle color camera and the wide-angle black-and-white camera;

the processing unit is further used for acquiring images captured by the wide-angle color camera and the tele black-and-white camera simultaneously on an object to be shot when the scaling corresponding to the scaling is larger than the preset scaling;

the output unit is further used for outputting the image of the object to be shot, wherein the image of the object to be shot is obtained after the wide-angle color camera and the image captured by the tele black-and-white camera are fused.

20. The apparatus as recited in claim 19, said processing unit to further:

and respectively controlling each camera in the wide-angle color camera, the tele black-and-white camera and the tele black-and-white camera to capture images of corresponding frame numbers according to the brightness value.

21. The apparatus as recited in claim 20, said processing unit to:

22. The apparatus of any of claims 19-21, wherein the processing unit is further to:

23. An image capturing apparatus, characterized in that the apparatus comprises a wide-angle color camera, a wide-angle black and white camera, a tele black and white camera, a processing unit and an output unit; wherein the wide-angle color camera and the wide-angle black-and-white camera have the same field angle, and the field angle of the tele black-and-white camera is smaller than that of the wide-angle color camera, and the processing unit is configured to:

determining a scene where an object to be shot is located;

the output unit is used for outputting the image of the object to be shot.

24. The apparatus as recited in claim 23, said processing unit to further:

25. The apparatus as recited in claim 23, said processing unit to further:

determining a luminance value of the scene;

26. The apparatus as recited in claim 25, said processing unit to:

27. A computer-readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 3-14.

28. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 3 to 14.