WO2017185265A1

WO2017185265A1 - Method for determining image photography parameters and photographic apparatus

Info

Publication number: WO2017185265A1
Application number: PCT/CN2016/080379
Authority: WO
Inventors: 徐荣跃; 王君; 易彦; 魏代玉
Original assignee: 华为技术有限公司
Priority date: 2016-04-27
Filing date: 2016-04-27
Publication date: 2017-11-02
Also published as: CN107615744B; CN107615744A

Abstract

A method for determining image photography parameters, comprising a photographic apparatus (101, 300, 400) acquiring the amount of jitter of the photographic apparatus (101, 300, 400) (201); determining the ambient brightness of the environment of the image to be photographed (202); at least on the basis of the ambient brightness and the amount of jitter, determining a target exposure time for photographing the image to be photographed (203). Thus, the target exposure time can be comprehensively determined on the basis of the impact of the amount of jitter and the ambient brightness; when using the target exposure time to perform image photography, the determined target exposure time will not allow the photographic image to be excessively blurry as a result of jitter, and will also not allow the image noise to be excessive, thereby improving image definition.

Description

Method for determining image capturing parameters and camera device

Technical field

The present invention relates to the field of image pickup device control, and in particular, to a method for determining image capture parameters and an image capture device.

Background technique

When the user uses the camera to take an image, even if the user does not realize that he or she is shaking, the user's hand may move constantly, and the shaking of the hand may cause blurring of the image during image capturing. In order to overcome the image blur caused by the jitter, the prior art uses Optical Image Stabilization (OIS) for anti-shake to reduce the blurring of the image caused by the jitter, thereby improving the image sharpness. The amount of blur of the image is related to the amount of jitter. The larger the amount of jitter, the larger the amount of blur, and the lower the sharpness of the captured image. It is known from daily experience that the amount of blur of the image is also related to the exposure time. In the case where the amount of jitter is constant, the longer the exposure time, the larger the amount of blurring of the image due to the amount of jitter. In order to reduce the amount of blur, it is necessary to minimize the exposure time.

However, depending on the brightness of the external environment, the difference in exposure time may cause different noise on the image. For example, when the ambient brightness is low, the exposure time is reduced, which may cause the internal sensitivity of the imaging device to rise, and the sensitivity may increase. The noise of the image increases, which reduces image sharpness.

In the prior art, image capturing parameters such as exposure time are usually preset, and there is no balance between the amount of jitter and ambient brightness on the image sharpness. Therefore, it is urgent to determine the image capturing parameter. The method and the camera device are used to determine better image capturing parameters, thereby balancing the amount of shaking and the ambient brightness, thereby improving the sharpness of the captured image.

Summary of the invention

Embodiments of the present invention provide a method for determining image capturing parameters and an image capturing device for determining better image capturing parameters, thereby balancing the amount of shake and ambient brightness, thereby improving the sharpness of the captured image.

An embodiment of the present invention provides a method for determining an image capturing parameter, including:

Obtaining a shake amount of the image capturing device; determining an ambient brightness of an environment in which the image to be captured is located; and determining a target exposure time for capturing an image to be captured, at least according to the ambient brightness and the amount of shake. In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

Optionally, determining, according to at least the ambient brightness and the amount of jitter, the target exposure time for capturing the image to be captured, including: calculating the first exposure time according to at least the ambient brightness and the amount of jitter; from the first exposure time and the second exposure time The minimum value is determined as the target exposure time; wherein, the second exposure time is the exposure time calculated when the amount of jitter is assumed to be zero under ambient brightness.

Since the second exposure time is an exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero, it is assumed that the second exposure time is less than the first exposure time, and at this time, the target exposure time is selected as the second exposure time, and the target exposure time is on the one hand It meets the noise requirement of the image, that is, the target exposure time is not shortened due to the amount of jitter, so it does not add extra noise to the image; secondly, the target exposure time is less than the first exposure time, so it can be further in the case of jitter Reduce the amount of blurring of the image, which further enhances the sharpness of the image. Assuming that the second exposure time is not less than the first exposure time, and the target exposure time is selected as the first exposure time, the target exposure time meets the blur quantity requirement, and since the value of the blur amount has been discussed before, it has been considered. The influence of the image noise, that is, the maximum exposure time is obtained as much as possible when the blur amount of the image meets the requirements, so the sensitivity of the image at this time is also the minimum value in the case where the blur amount satisfies the requirement, The noise of the image is also the minimum value in the case where the amount of blurring meets the requirements. Therefore, the method provided by the embodiment of the present invention further enhances the sharpness of the image.

Optionally, determining an application scenario of the camera device; determining, according to at least a preset correspondence between the application scenario and the blur amount, a range of values of the blur amount corresponding to the ambient brightness in the application scenario; and a blur amount corresponding to the ambient brightness The amount of blur corresponding to the ambient brightness is determined in the range of values; the first exposure time is calculated according to the amount of blur and the amount of jitter corresponding to the ambient brightness. So that the first exposure can be made The requirements are more consistent with the current application scenario. Since the user has different requirements for the amount of blur in different application scenarios, the amount of blur determined by the method can be sufficiently clear for the current application scenario of the user.

Optionally, calculating the first exposure time according to the ambient brightness and the amount of jitter, including: determining an application scenario of the camera device; determining the application scenario according to at least a preset relationship between the ambient brightness, the application scenario, and the blur amount. The range of the blur amount corresponding to the ambient brightness is determined; the blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, the first exposure time can be more consistent with the current application scenario, and also meets the current ambient brightness condition. Since the user has different requirements for the amount of blur under different application scenarios and different ambient brightness conditions, Therefore, the amount of blur determined by this method can be sufficiently clear for the current application scenario of the user.

Optionally, calculating the first exposure time according to at least the ambient brightness and the amount of jitter, including: determining, according to at least a corresponding relationship between the preset ambient brightness and the blur amount, a range of values of the blur amount corresponding to the ambient brightness; The blur amount corresponding to the ambient brightness is determined in the range of the blur amount value; the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, since an acceptable range of blurring values is set for each environment brightness, it is not necessary to require the minimum amount of blurring in any scene, and the flexible amount can be flexibly selected according to the ambient brightness, thereby ensuring When the amount of blur meets the requirements, the exposure time is adjusted to coordinate the noise influence of the image, thereby improving the sharpness of the image.

Optionally, the amount of blur corresponding to the ambient brightness is a maximum value within a range of values of the blur amount corresponding to the ambient brightness. Thus, since the amount of blur is larger, the exposure time is longer, so that the exposure time can be extended as much as possible while the amount of blurring is satisfactory, thereby reducing the noise of the image.

Optionally, calculating the first exposure time according to the amount of blur and the amount of jitter includes: dividing the amount of blur by the amount of jitter to obtain a first exposure time. It can be seen that the first exposure time is inversely proportional to the amount of jitter, and is proportional to the amount of blur, and by dividing the amount of blur by the amount of jitter, the first exposure time can be more accurately obtained, thereby more accurately determining the target exposure time.

Optionally, determining a target for capturing an image to be captured, at least according to ambient brightness and amount of jitter The exposure time includes: determining a noise influence coefficient corresponding to the ambient brightness according to a preset relationship between the preset ambient brightness and the noise influence coefficient; wherein, the brighter the ambient brightness, the larger the noise influence coefficient; according to the noise influence coefficient and the shake amount, Calculate the first exposure time. According to the correspondence between the ambient brightness and the noise influence coefficient, the noise influence coefficient corresponding to the determined ambient brightness is already an optimal value, and the noise influence coefficient can balance the influence of the blur amount and the ISO on the image sharpness, thereby making the image clear. The greatest degree. Thereafter, the imaging device calculates the first exposure time based on the noise influence coefficient and the shake amount.

Optionally, after determining the target exposure time for capturing the image to be captured, according to the ambient brightness and the amount of jitter, further comprising: calculating the first sensitivity according to the target exposure time; when determining that the first sensitivity is greater than the sensitivity threshold, The sensitivity threshold is taken as the target sensitivity of the image to be captured; when it is determined that the first sensitivity is not greater than the sensitivity threshold, the first sensitivity is taken as the target sensitivity of the image to be captured. In this way, it is ensured that when the determined target exposure time is very short, the sensitivity is not excessively large and beyond the capability range of the image pickup device itself, that is, the sensitivity threshold is not exceeded, thereby ensuring the sensitivity of the image pickup apparatus. The rationality of this parameter is that the target sensitivity determined by the embodiment of the present invention is within the capability range of the imaging device, so even if the imaging device is subjected to severe jitter, the target exposure is not in the embodiment of the present invention. The time is too short and the target sensitivity exceeds the sensitivity threshold, thus ensuring that the imaging device can work normally even under severe jitter.

Optionally, the amount of jitter of the camera device is obtained according to the following formula:

S=Q ₁ ×R _q +Q ₂ ×R _reR +Q ₃ ×R _a

Where R _q is the amount of jitter about the x-axis and about the y-axis; R _reR is the amount of jitter about the z-axis; R _a is the amount of jitter caused by translation along the x-axis and the y-axis, and R _a is the focal distance Inverse _ratio ; Q ₁ , Q ₂ and Q ₃ are constant terms; the values of Q ₁ , Q ₂ and Q ₃ are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of camera shake; x-axis, y-axis The z-axis and the z-axis belong to the camera coordinate system of the imaging device, and the optical axis of the imaging device is the z-axis. It can be seen that the coefficients of each item in the formula can be adjusted according to the specific anti-shake parameters of the camera device. Thus, the formula can be more compatible with various anti-shake parameters of the camera device, thereby more accurately calculating the corresponding camera devices. The amount of jitter. Moreover, the amount of jitter R _a caused by the translation along the x-axis and the y-axis can be calculated more accurately by the focus distance, thereby more accurately calculating the amount of jitter corresponding to the imaging device.

Optionally, when it is determined that the imaging device comprises a gyroscope, and anti-shake is performed for the x-axis rotation and the y-axis rotation, Q _{1 is} smaller than Q ₂ and Q _{1 is} smaller than Q ₃ ; determining that the imaging device includes the accelerometer, and When anti-shake is performed about the z-axis rotation, Q _{2 is} smaller than Q ₁ and Q _{2 is} smaller than Q ₃ . In this way, the formula can be better compatible with various anti-shake parameters of the camera device, such as two-axis anti-shake, four-axis anti-shake and five-axis anti-shake camera, etc., so as to more accurately calculate the corresponding camera device The amount of jitter.

An embodiment of the present invention provides an image capturing apparatus, comprising: a determining unit, configured to acquire a shaking amount of the image capturing device; determine an ambient brightness of an environment in which the image to be captured is located; and a processing unit configured to determine at least according to the ambient brightness and the amount of jitter The target exposure time for taking the image to be captured. In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

Optionally, the processing unit is configured to calculate a first exposure time according to at least the ambient brightness and the amount of jitter; determine a minimum value from the first exposure time and the second exposure time as the target exposure time; wherein, the second exposure time The exposure time calculated to assume that the amount of jitter is zero under ambient brightness. Since the second exposure time is an exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero, it is assumed that the second exposure time is less than the first exposure time, and at this time, the target exposure time is selected as the second exposure time, and the target exposure time is on the one hand It meets the noise requirement of the image, that is, the target exposure time is not shortened due to the amount of jitter, so it does not add extra noise to the image; secondly, the target exposure time is less than the first exposure time, so it can be further in the case of jitter Reduce the amount of blurring of the image, which further enhances the sharpness of the image. Assuming that the second exposure time is not less than the first exposure time, and the target exposure time is selected as the first exposure time, the target exposure time meets the blur quantity requirement, and since the value of the blur amount has been discussed before, it has been considered. The influence of the image noise, that is, the maximum exposure time is obtained as much as possible when the blur amount of the image meets the requirements, so the sensitivity of the image at this time is also the minimum value in the case where the blur amount satisfies the requirement, The noise of the image is also the minimum value in the case where the amount of blurring meets the requirements, and therefore, the embodiment of the present invention provides The method provided further enhances the sharpness of the image.

Optionally, the processing unit is configured to determine an application scenario of the camera device; and determine, according to at least a preset relationship between the preset application scenario and the blur amount, a range of values of the blur amount corresponding to the ambient brightness in the application scenario; The blur amount corresponding to the ambient brightness is determined in the range of the blur amount corresponding to the brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, the first exposure time can be more consistent with the current application scenario. Since the user has different requirements for the amount of blur in different application scenarios, the amount of blur determined by the method is for the current application scenario of the user. , can be clear enough.

Optionally, the processing unit is configured to determine an application scenario of the camera device; and determine, according to the preset relationship between the ambient brightness, the application scenario, and the blur amount, the range of the blur amount corresponding to the ambient brightness in the application scenario. The blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, the first exposure time can be more consistent with the current application scenario, and also meets the current ambient brightness condition. Since the user has different requirements for the amount of blur under different application scenarios and different ambient brightness conditions, Therefore, the amount of blur determined by this method can be sufficiently clear for the current application scenario of the user.

Optionally, the processing unit is configured to determine, according to a preset correspondence between the ambient brightness and the blur quantity, a range of the blur quantity corresponding to the ambient brightness; and determine an ambient brightness corresponding to the range of the blur quantity corresponding to the ambient brightness. The amount of blur; the first exposure time is calculated based on the amount of blur and the amount of jitter corresponding to the ambient brightness. In this way, since an acceptable range of blurring values is set for each environment brightness, it is not necessary to require the minimum amount of blurring in any scene, and the flexible amount can be flexibly selected according to the ambient brightness, thereby ensuring When the amount of blur meets the requirements, the exposure time is adjusted to coordinate the noise influence of the image, thereby improving the sharpness of the image.

Optionally, calculating the first exposure time according to the amount of blur and the amount of jitter, including: dividing the amount of blur The first exposure time is obtained in terms of the amount of jitter. It can be seen that the first exposure time is inversely proportional to the amount of jitter, and is proportional to the amount of blur, and by dividing the amount of blur by the amount of jitter, the first exposure time can be more accurately obtained, thereby more accurately determining the target exposure time.

Optionally, the processing unit is configured to determine, according to a preset correspondence between the ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the greater the noise influence coefficient; according to the noise influence coefficient And the amount of jitter, calculate the first exposure time. According to the correspondence between the ambient brightness and the noise influence coefficient, the noise influence coefficient corresponding to the determined ambient brightness is already an optimal value, and the noise influence coefficient can balance the influence of the blur amount and the ISO on the image sharpness, thereby making the image clear. The greatest degree. Thereafter, the imaging device calculates the first exposure time based on the noise influence coefficient and the shake amount.

Optionally, the processing unit is further configured to calculate a first sensitivity according to the target exposure time; when determining that the first sensitivity is greater than the sensitivity threshold, use the sensitivity threshold as the target sensitivity of the image to be captured; When the degree is not greater than the sensitivity threshold, the first sensitivity is taken as the target sensitivity of the image to be captured. . In this way, it is ensured that when the determined target exposure time is very short, the sensitivity is not excessively large and beyond the capability range of the image pickup device itself, that is, the sensitivity threshold is not exceeded, thereby ensuring the sensitivity of the image pickup apparatus. The rationality of this parameter is that the target sensitivity determined by the embodiment of the present invention is within the capability range of the imaging device, so even if the imaging device is subjected to severe jitter, the target exposure is not in the embodiment of the present invention. The time is too short and the target sensitivity exceeds the sensitivity threshold, thus ensuring that the imaging device can work normally even under severe jitter.

Optionally, the determining unit is configured to obtain the amount of jitter of the camera according to the following formula:

S=Q ₁ ×R _q +Q ₂ ×R _reR +Q ₃ ×R _a

Where R _q is the amount of jitter about the x-axis and about the y-axis; R _reR is the amount of jitter about the z-axis; R _a is the amount of jitter caused by translation along the x-axis and the y-axis, and R _a is the focal distance Inverse _ratio ; Q ₁ , Q ₂ and Q ₃ are constant terms; the values of Q ₁ , Q ₂ and Q ₃ are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of camera shake; x-axis, y-axis The z-axis and the z-axis belong to the camera coordinate system of the imaging device, and the optical axis of the imaging device is the z-axis.

Optionally, when it is determined that the imaging device comprises a gyroscope, and for anti-shake around the x-axis rotation and the y-axis rotation, Q _{1 is} smaller than Q ₂ and Q _{1 is} smaller than Q ₃ ; determining that the imaging device includes the accelerometer, and When anti-shake is performed around the z-axis, Q2 is smaller than Q1, and Q2 is smaller than Q3.

It can be seen that the coefficients of each item in the formula can be adjusted according to the specific anti-shake parameters of the camera device. Thus, the formula can be more compatible with various anti-shake parameters of the camera device, thereby more accurately calculating the corresponding camera devices. The amount of jitter. Moreover, the amount of jitter R _a caused by the translation along the x-axis and the y-axis can be calculated more accurately by the focus distance, thereby more accurately calculating the amount of jitter corresponding to the imaging device.

An embodiment of the present invention provides a camera device, including: a camera module for collecting a picture of an image to be captured; a display for displaying a picture captured by the camera module; and a memory for storing a picture captured by the camera module And one or more processors, wherein the processor is configured to acquire a shake amount of the image capturing device; determine an ambient brightness of an environment in which the image to be captured is located; and determine a target exposure time for capturing an image to be captured according to at least the ambient brightness and the amount of shake. In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

Optionally, the processor is configured to calculate a first exposure time according to at least the ambient brightness and the amount of jitter; determine a minimum value from the first exposure time and the second exposure time as the target exposure time; wherein, the second exposure time The exposure time calculated to assume that the amount of jitter is zero under ambient brightness.

Since the second exposure time is an exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero, it is assumed that the second exposure time is less than the first exposure time, and at this time, the target exposure time is selected as the second exposure time, and the target exposure time is on the one hand It meets the noise requirement of the image, that is, the target exposure time is not shortened due to the amount of jitter, so it does not add extra noise to the image; secondly, the target exposure time is less than the first exposure time, so it can be further in the case of jitter Reduce the amount of blurring of the image, which further enhances the sharpness of the image. Assuming that the second exposure time is not less than the first exposure time, and the target exposure time is selected as the first exposure time, the target exposure time meets the blur quantity requirement, and since the value of the blur amount has been discussed before, it has been considered. Image noise The influence of the aspect, that is, the maximum exposure time is obtained as much as possible when the blur amount of the image meets the requirements. Therefore, the sensitivity of the image at this time is also the minimum value in the case where the blur amount satisfies the requirement, and thus the image noise It is also the minimum value in the case where the amount of blurring meets the requirements. Therefore, the method provided by the embodiment of the present invention further enhances the sharpness of the image.

Optionally, the processor is configured to determine an application scenario of the camera device; and at least determine a range of values of the blur amount corresponding to the ambient brightness in the application scenario according to a preset relationship between the preset application scenario and the blur amount; The blur amount corresponding to the ambient brightness is determined in the range of the blur amount corresponding to the brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness.

Optionally, the processor is configured to determine an application scenario of the camera device; determining, according to at least a preset relationship between the ambient brightness, the application scenario, and the blur amount, the range of the blur amount corresponding to the ambient brightness in the application scenario. The blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness.

Optionally, the processor is configured to determine, according to a preset correspondence between the ambient brightness and the blur quantity, a range of the fuzzy quantity corresponding to the ambient brightness; and determine, according to the range of the fuzzy quantity corresponding to the ambient brightness, the ambient brightness corresponding to the range The amount of blur; the first exposure time is calculated based on the amount of blur and the amount of jitter corresponding to the ambient brightness.

In this way, since an acceptable range of blurring values is set for each environment brightness, it is not necessary to require the minimum amount of blurring in any scene, and the flexible amount can be flexibly selected according to the ambient brightness, thereby ensuring When the amount of blur meets the requirements, the exposure time is adjusted to coordinate the noise influence of the image, thereby improving the sharpness of the image.

Optionally, calculating the first exposure time according to the amount of blur and the amount of jitter includes: dividing the amount of blur by the amount of jitter to obtain a first exposure time.

Optionally, the processor is configured to determine, according to a preset relationship between the preset ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the noise influence coefficient The larger the time; the first exposure time is calculated based on the noise influence coefficient and the amount of jitter. According to the correspondence between the ambient brightness and the noise influence coefficient, the noise influence coefficient corresponding to the determined ambient brightness is already an optimal value, and the noise influence coefficient can balance the influence of the blur amount and the ISO on the image sharpness, thereby making the image clear. The greatest degree. Thereafter, the imaging device calculates the first exposure time based on the noise influence coefficient and the shake amount.

Optionally, the processor is further configured to calculate the first sensitivity according to the target exposure time; when determining that the first sensitivity is greater than the sensitivity threshold, using the sensitivity threshold as the target sensitivity of the image to be captured; When the degree is not greater than the sensitivity threshold, the first sensitivity is taken as the target sensitivity of the image to be captured. In this way, it is ensured that when the determined target exposure time is very short, the sensitivity is not excessively large and beyond the capability range of the image pickup device itself, that is, the sensitivity threshold is not exceeded, thereby ensuring the sensitivity of the image pickup apparatus. The rationality of this parameter is that the target sensitivity determined by the embodiment of the present invention is within the capability range of the imaging device, so even if the imaging device is subjected to severe jitter, the target exposure is not in the embodiment of the present invention. The time is too short and the target sensitivity exceeds the sensitivity threshold, thus ensuring that the imaging device can work normally even under severe jitter.

Optionally, the processor is configured to obtain the amount of jitter of the camera according to the following formula:

S=Q ₁ ×R _q +Q ₂ ×R _reR +Q ₃ ×R _a

Optionally, when it is determined that the imaging device comprises a gyroscope, and anti-shake is performed for the x-axis rotation and the y-axis rotation, Q _{1 is} smaller than Q ₂ and Q _{1 is} smaller than Q ₃ ; determining that the imaging device includes the accelerometer, and When anti-shake is performed about the z-axis rotation, Q _{2 is} smaller than Q ₁ and Q _{2 is} smaller than Q ₃ .

As can be seen from the above, in the embodiment of the present invention, the image capturing device acquires the amount of shake of the image capturing device; determines the ambient brightness of the environment in which the image to be captured is located; and determines the target for capturing the image to be captured according to at least the ambient brightness and the amount of jitter. Exposure time. In this way, depending on the amount of jitter and the brightness of the environment The effect is to comprehensively determine a target exposure time, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the blurring amount of the captured image due to the amount of jitter to be too high, and the other aspect The determined target exposure time does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below.

FIG. 1 is a schematic structural diagram of a system according to an embodiment of the present disclosure;

FIG. 1a is a schematic structural diagram of a suitable system according to an embodiment of the present invention;

2 is a schematic flowchart of a method for determining image capturing parameters according to an embodiment of the present invention;

2a is a schematic diagram of a relationship between a jitter amount and an exposure time according to an embodiment of the present invention;

2b is a schematic flowchart of a method for determining image capturing parameters according to an embodiment of the present invention;

2c is a schematic diagram showing the relationship between the rotational jitter along the x-axis and/or the y-axis and the translational jitter along the x-axis and/or the y-axis and the amount of blurring of the image according to an embodiment of the present invention;

3 is a schematic structural diagram of an image pickup apparatus according to an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of another image capturing apparatus according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The method for determining image capturing parameters and the camera device provided by the embodiments of the present invention are applicable to various systems, such as a single camera system, an OIS system for a single camera, and an OIS system under a multi-camera. The image capturing device in the embodiment of the present invention may be a device having a camera function, such as a mobile phone having a camera function, a computer, a tablet computer, or the like. In the embodiment of the present invention, the camera coordinate system is introduced, and the coordinate of the camera coordinate system is centered on the camera device. In the system, the optical axis of the imaging device is taken as the z-axis. In the specific implementation, the embodiments of the present invention are also applicable to other coordinate systems, such as a world coordinate system, etc., in which case conversion between coordinate systems is required. The world coordinate system can also be called the real or real world coordinate system, which is the absolute coordinate of the objective world.

FIG. 1 and FIG. 1a are a schematic diagram showing a suitable system architecture provided by an embodiment of the present invention. As shown in FIG. 1 and FIG. 1a, the image capturing apparatus 101 captures an image in a current scene, and the image capturing apparatus 101 includes a lens 103. Also included is an image sensor 107 whose lens 103 faces the object 102 to be photographed. In the embodiment of the present invention, the camera device can detect the amount of jitter of the camera device itself. For the camera device, the three axes in the camera coordinate system defined by the embodiments of the present invention are the x-axis 104, the y-axis 105, and the z-axis 106, respectively. The z-axis 106 is the horizontal direction shown in FIG. 1, that is, the z-axis is the optical axis direction of the imaging device 101, the z-axis 106 is perpendicular to the circular plane of the lens in the lens 103 of the imaging device; the y-axis 105 is the one on FIG. The vertical direction, i.e., the y-axis 105 is perpendicular to the z-axis 106; the x-axis 104 is an axis perpendicular to the y-axis 105 and perpendicular to the z-axis 106. The center of the x-axis 104, the y-axis 105, and the z-axis 106 may be the center of the image sensor 107.

Based on the above, FIG. 2 exemplarily shows a schematic flowchart of a method for determining image capturing parameters according to an embodiment of the present invention. As shown in FIG. 2, the method may be performed by an image capturing apparatus, and the method includes:

Step 201: Acquire a jitter amount of the camera device.

Step 202: Determine an ambient brightness of an environment in which the image to be captured is located;

Step 203, determining a target exposure time for capturing an image to be captured, at least according to the ambient brightness and the amount of shake.

In the embodiment of the present invention, the camera device calculates the amount of shake of the camera device, determines the ambient brightness, and determines the target exposure time for image capturing based on at least the ambient brightness and the amount of jitter. In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

Specifically, it can be determined by a combination of factors such as ambient brightness and jitter. The following two optional embodiments 1 and 2 are provided in the embodiment of the present invention.

Embodiment 1

Specifically, the imaging device first determines the ambient brightness before calculating the first exposure time based on at least the ambient brightness and the amount of jitter. There are a plurality of ways to determine the ambient brightness in the embodiment of the present invention. An optional implementation manner is provided in the embodiment of the present invention.

The camera device obtains the correspondence between the exposure time of the normal exposure mode and the ambient brightness in advance, and the camera device can adopt an ordinary exposure mode to determine the exposure time in the normal exposure mode under different ambient brightness, thereby obtaining the normal exposure mode. The correspondence between exposure time and ambient brightness. For example, the correspondence between the exposure time of the normal exposure mode and the ambient brightness can be saved in the form of a correspondence table. After that, under the current ambient brightness, the exposure time of the normal exposure mode under the current ambient brightness is acquired, and then the ambient brightness corresponding to the exposure time of the normal exposure mode is determined according to the correspondence table, and the determined ambient brightness is determined. This is the current ambient brightness. The normal exposure mode in the embodiment of the present invention is a conventional mode of exposing only according to the exposure time determined by the ambient brightness, and the target exposure time is determined according to at least the ambient brightness and the amount of jitter in the embodiment of the present invention, and The mode of exposure using the target exposure time is different.

For example, when the ambient brightness is low, the exposure time t of the normal exposure mode is greater than T2; when the ambient brightness is medium brightness, the exposure time t of the normal exposure mode is not greater than T2, and greater than T1. The value of the exposure time t of the normal exposure mode is not greater than the value of T1 when the ambient brightness is high. The low brightness brightness value of the ambient brightness is less than or equal to the medium brightness value; the medium brightness value is less than or equal to the high brightness value. Optionally, the low brightness, the medium brightness, and the high brightness are respectively three brightness levels of the ambient brightness, for example, determining that the current ambient brightness is less than the first brightness threshold, determining that the current ambient brightness is low brightness; determining the current ambient brightness is not The first brightness threshold is smaller than the second brightness threshold, and the second brightness threshold is greater than the first brightness threshold, determining that the current ambient brightness belongs to the medium brightness; determining that the current ambient brightness is not less than the second brightness threshold, determining the current The ambient brightness is high brightness.

Where T2 is greater than T1. Specifically, it can be determined by formula (1):

f × tan (T1 × x) ≤ A; f × tan (T2 × x) ≤ B ... formula (1)

In formula (1), f is the focal length of the lens of the camera; x is the angular velocity of the hand shake, and the unit is radians per second (rad/s); alternatively, x is 0.03; A is the first level of the fuzzy standard. Corresponding fuzzy quantity; B is the fuzzy quantity corresponding to the second level of the fuzzy quantity standard.

Optionally, the values of A and B in the embodiment of the present invention may be selected by themselves, or may be as follows. In a specific implementation, the human has different requirements for the amount of blurring of the image in different application scenarios. Table 1 exemplarily shows a fuzzy amount standard in different scenarios, as shown in Table 1. The camera device includes a 24-inch display. When the user views the image captured by the camera device using the 24-inch display on the camera device, at least the image blur amount standard first level is required, and the blur amount standard corresponds to the first level. The amount of blur is 0.06 degrees, and the amount of blur is 0.06 degrees, which is equivalent to a blur amount of 3 pixels (pixel), or a blur amount of 0.06 degrees can be equivalent to a blur amount of 4 micrometers (μm). When the camera device includes a 6-inch display, when the user zooms in and views the image captured by the camera device using the 6-inch display, for example, by zooming in on the image captured by the camera device twice by double-clicking the image displayed on the 6-inch display, at least the requirement is required. The blur quantity standard of the image is the second level, the blur quantity corresponding to the second level of the blur quantity standard is 0.1 degree, the blur quantity is 0.1 degree, and the blur quantity is 6 pixels (pixel), or the blur quantity is 0.1 degree. The amount of blur is 9 micrometers (μm). When the user directly views the image using the 6-inch display instead of zooming in on the image taken by the camera device, at least the blur level of the image is required to be at the third level, and the blur amount corresponding to the third level of the blur amount standard is 0.15 degrees, and the amount of blur is 0.15 degrees can also be equivalent to a blur amount of 10 pixels (pixel), or a blur amount of 0.15 degrees can also be equivalent to a blur amount of 14 micrometers (μm).

Table 1 A fuzzy amount standard in different application scenarios

模糊量标准Fuzzy quantity standard	应用场景Application scenario	模糊量Fuzzy quantity
第三级Third level	用户通过6寸显示器直接看Users look directly through the 6-inch display	0.15度(10pixel，14um)0.15 degrees (10pixel, 14um)
第二级second level	用户通过6寸显示器放大观看Users zoom in and out through a 6-inch display	0.1度(6pixel，9um)0.1 degree (6pixel, 9um)
第一级First level	用户通过24寸显示器观看Users watch through a 24-inch monitor	0.06度(3pixel，4um)0.06 degrees (3pixel, 4um)

Optionally, determining a range of values of the amount of blurring corresponding to the ambient brightness includes a plurality of manners, such as:

In the first mode, according to the application scenario of the image to be captured, the corresponding relationship between the preset application scenario and the fuzzy amount is determined, and the value range of the fuzzy amount is determined;

In the second manner, the application scenario of the image to be captured is determined, and the range of the fuzzy amount corresponding to the ambient brightness is determined according to the preset relationship between the ambient brightness, the application scenario, and the blur amount. For example, if the brightness is medium, the user can zoom in and view the captured image through the 6-inch display. At this time, the blurring amount corresponding to the ambient brightness can be [0.06, 0.1]; in the case of medium brightness, the user The captured image is directly viewed through the 6-inch display, and the blurring amount corresponding to the ambient brightness may be in the range of [0.1, 0.15];

In the third manner, according to the corresponding relationship between the preset ambient brightness and the blur amount, the range of the blur amount corresponding to the ambient brightness is determined.

After determining the range of the blur amount corresponding to the ambient brightness by the above three methods, the blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness. Thereafter, the first exposure time is calculated based on the amount of blur and the amount of shake corresponding to the ambient brightness.

Specifically, in the third method, the imaging device calculates the first exposure time according to the ambient brightness and the amount of jitter, and includes: the imaging device determines a blur amount corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the blur amount corresponding to the ambient brightness The smaller the image pickup device calculates the first exposure time based on the amount of blur and the amount of shake. The blur amount corresponding to the ambient brightness is a value within the range of the blur amount corresponding to the ambient brightness, or the blur amount corresponding to the ambient brightness is the maximum value within the range of the blur amount corresponding to the ambient brightness.

In the embodiment of the present invention, after acquiring the ambient brightness, the imaging device determines the amount of blur corresponding to the ambient brightness. Optionally, the exposure time of the normal exposure mode under the current ambient brightness is obtained by the above manner, and then the blur amount corresponding to the ambient brightness is determined according to the correspondence between the exposure time and the blur amount of the normal exposure mode. Specifically, the higher the ambient brightness, the shorter the exposure time, and the smaller the value of the required blur amount at this time.

Optionally, the amount of blur corresponding to the ambient brightness is a value within a range of values of the blur amount corresponding to the ambient brightness. For example, after detection, under the current ambient brightness, the exposure time t of the normal exposure mode is greater than the value of T2, and the ambient brightness is low brightness, and the range of the blur amount should be For the value range not greater than A, the fuzzy quantity is a value not greater than A, and A is the fuzzy quantity corresponding to the first level of the fuzzy quantity standard, for example, the range of the fuzzy quantity is not more than 0.06 degrees; after detection, the current Under the ambient brightness, the exposure time t of the normal exposure mode is not greater than T2, and is greater than the value of T1. At this time, the ambient brightness is medium brightness, and the value of the blur amount should be greater than A and not greater than B. Range, the amount of blur is a value greater than A and not greater than B, and B is the blur amount corresponding to the second level of the blur amount standard; after detection, under the current ambient brightness, the exposure time t of the normal exposure mode is not greater than T1 Value, at this time, the ambient brightness is low brightness. At this time, the value range of the blur quantity should be greater than B and not larger than the value range of C. The blur quantity is a value greater than B and not greater than C, and C is the third standard of fuzzy quantity. The amount of blur corresponding to the level. Optionally, the values of A, B, and C can be as shown in Table 1. The value of A is 0.06 degrees, the value of B is 0.1 degrees, and the value of C is 0.15 degrees. It can also be determined according to the specific implementation. In this way, since an acceptable range of blurring values is set for each environment brightness, it is not necessary to require the minimum amount of blurring in any scene, and the flexible amount can be flexibly selected according to the ambient brightness, thereby ensuring When the amount of blur meets the requirements, the exposure time is adjusted to coordinate the noise influence of the image, thereby improving the sharpness of the image.

Optionally, the amount of blur corresponding to the ambient brightness is a maximum value within a range of values of the blur amount corresponding to the ambient brightness. The camera device determines the amount of blur corresponding to the ambient brightness, which may be a value within the range of the blur amount corresponding to the ambient brightness, or may be the maximum value within the range of the blur amount corresponding to the ambient brightness. For example, after detection, under the current ambient brightness, the exposure time t of the normal exposure mode is greater than the value of T2, and the ambient brightness is low brightness, and the amount of blur should be A; after detection, under the current ambient brightness, The exposure time t of the normal exposure mode is not more than T2, and is greater than the value of T1. At this time, the ambient brightness is medium brightness, and the blur amount should be B; after the detection, the current ambient brightness, the exposure time of the normal exposure mode t is a value not greater than T1, and the ambient brightness is low brightness at this time, and the amount of blur should be C. Thus, since the amount of blur is larger, the exposure time is longer, so that the exposure time can be extended as much as possible while the amount of blurring is satisfactory, thereby reducing the noise of the image.

Optionally, the imaging device calculates the first exposure time according to the amount of blur and the amount of jitter, including: the camera divides the amount of blur by the amount of jitter to obtain a first exposure time. It can be seen that the first exposure time is inversely proportional to the amount of jitter, proportional to the amount of blur, and can be more accurately obtained by dividing the amount of blur by the amount of jitter. By the first exposure time, the target exposure time is more accurately determined.

Specifically, optionally, when noise and denoising are not considered, the relationship between the amount of blur, the amount of jitter, and the exposure time is expressed by equation (2):

In the formula (2), T is the start time of the exposure, Δt is the exposure time; S _x (t) is the total jitter speed along the x-axis at the time t;

Indicates the moving distance of the lens on the x-axis from the start time T of the exposure,

Represents the maximum value that can be obtained for the value obtained after S _x (t) is integrated over time, equal to the blur amount blur _{x of the} x-axis;

Is the expected mean of S _x ; S _y (t) is the total jitter velocity along the y-axis at time t;

Indicates the moving distance of the lens on the y-axis from the start time T of the exposure;

Represents the maximum value of the value obtained after integrating S _y (t) over time, equivalent to the blur amount blur _{y of the} y-axis;

Is the expected mean of S _y .

2a is a schematic diagram showing the relationship between the amount of jitter and the exposure time provided by the embodiment of the present invention. As shown in FIG. 2a, the abscissa 2101 represents the amount of jitter, the ordinate 2102 represents the exposure time, and the curve 2103 represents the imaging device including the OIS function. The relationship between the amount of time jitter and the exposure time, and the curve 2104 indicates the relationship between the amount of jitter and the exposure time when the image pickup apparatus does not include the OIS function. As can be seen from the curve 2103 and the curve 2104, the larger the amount of jitter, the shorter the exposure time. The exposure time can be referred to as a safe shutter time. For an imaging device including an OIS function, the safety shutter time is slowed down as the amount of jitter increases; and for an imaging device not including the OIS function, the shutter time is safe. As the amount of jitter increases, the speed is reduced compared to the block.

In the embodiment of the present invention, the sharpness of the image is determined by two parameters, the amount of blur and the exposure time; the product of the exposure time and the amount of jitter is proportional to the amount of blur, that is, the longer the exposure time, the longer the exposure time is. The amount of blur caused by the amount of jitter is larger. In the embodiment of the present invention, the above-mentioned side is adopted. The first exposure time determined by the process is: the longest exposure time when the image blur amount is satisfied. It can be seen that the first exposure time satisfies the image blur quantity requirement and also prolongs the time as much as possible; As the exposure time is longer, the sensitivity is lower, so the noise of the image is less. Therefore, it can be seen that the first exposure time in the embodiment of the present invention satisfies the requirements of the image blur amount and noise, and improves the image. Sharpness.

Optionally, the imaging device determines, according to at least the ambient brightness and the amount of shaking, the target exposure time for capturing the image to be captured, including: calculating the first exposure time according to at least the ambient brightness and the amount of jitter; from the first exposure time and the second The minimum value is determined as the target exposure time in the exposure time; wherein, the second exposure time is the exposure time calculated when the amount of jitter is assumed to be zero under ambient brightness.

Specifically, the imaging device calculates the second exposure time based on the current ambient brightness and the amount of jitter, that is, assuming that the amount of jitter is zero, before determining the target exposure time. The calculation method of the second exposure time can be performed by using a calculation formula in the prior art, that is, determining the second exposure time based only on the current ambient brightness. Then, since the second exposure time is the exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero, it is assumed that the second exposure time is less than the first exposure time, and at this time, the target exposure time is selected as the second exposure time, and the target exposure time is one. The aspect meets the noise requirement of the image, that is, the target exposure time is not shortened due to the amount of jitter, so the image is not added with extra noise; secondly, the target exposure time is less than the first exposure time, so in the case of jitter Further reducing the amount of blurring of the image further enhances the sharpness of the image. Assuming that the second exposure time is not less than the first exposure time, and the target exposure time is selected as the first exposure time, the target exposure time meets the blur quantity requirement, and since the value of the blur amount has been discussed before, it has been considered. The influence of the image noise, that is, the maximum exposure time is obtained as much as possible when the blur amount of the image meets the requirements, so the sensitivity of the image at this time is also the minimum value in the case where the blur amount satisfies the requirement, The noise of the image is also the minimum value in the case where the amount of blurring meets the requirements. Therefore, the method provided by the embodiment of the present invention further enhances the sharpness of the image.

In the embodiment of the present invention, optionally, after the imaging device determines the target exposure time of the imaging device according to the ambient brightness and the amount of jitter, the imaging device calculates the first sensitivity according to the target exposure time. Optionally, the camera uses an Automatic Exposure (AE) algorithm to calculate the first sensitivity according to the target exposure time. The AE algorithm in the embodiment of the present invention is an algorithm commonly used by those skilled in the art. Specifically, the automatic exposure is that the camera automatically determines the exposure amount according to the lighting condition. It can be determined according to the actual situation.

When it is determined that the first sensitivity is greater than the sensitivity threshold, the sensitivity threshold is used as the target sensitivity of the imaging device; when it is determined that the first sensitivity is not greater than the sensitivity threshold, the first sensitivity is used as the target sensitivity of the imaging device. In this way, it is ensured that when the determined target exposure time is very short, the sensitivity is not excessively large and beyond the capability range of the image pickup device itself, that is, the sensitivity threshold is not exceeded, thereby ensuring the sensitivity of the image pickup apparatus. The rationality of this parameter is that the target sensitivity determined by the embodiment of the present invention is within the capability range of the imaging device, so even if the imaging device is subjected to severe jitter, the target exposure is not in the embodiment of the present invention. The time is too short and the target sensitivity exceeds the sensitivity threshold, thus ensuring that the imaging device can work normally even under severe jitter.

In the embodiment of the present invention, the sensitivity is the chemical reaction speed of the film to the light, and is also the standard for the photosensitive speed in the film industry. The sensitivity of the film (film) to light; the low sensitivity refers to the film (film) of 100 or less (International Standardization Organization photosensibility), the medium sensitivity refers to the sensitivity of 200 to 800, and the high sensitivity is the sensitivity of 800 or more. . When using a conventional camera, we can purchase different sensitivity (speed) negatives depending on the brightness of the shooting environment. For example, the general cloudy environment can use ISO200, the darkness is like the stage, the concert environment can be ISO400 or higher, and the digital camera. There is a similar function in it, which changes the ISO value by changing the amplification factor of the signal amplifier in the sensor chip, but when the ISO value is raised, the amplifier also amplifies the noise in the signal to produce an image of coarse particles.

FIG. 2b is a schematic flow chart showing a method for determining image capturing parameters according to an embodiment of the present invention. As shown in FIG. 2b, the method includes:

Step 2201: The camera device calculates the amount of camera shake and the ambient brightness;

Step 2202, the imaging device determines whether the ambient brightness belongs to low brightness, medium brightness or high brightness; if the ambient brightness belongs to high brightness, step 2203 is performed; if the ambient brightness belongs to medium brightness, step is performed Step 2204; If the ambient brightness is low brightness, step 2205 is performed;

Step 2203, determining that the amount of blur corresponding to the ambient brightness is A, and dividing A by the amount of jitter to obtain a first exposure time;

Step 2204, determining that the amount of blur corresponding to the ambient brightness is B, and dividing B by the amount of jitter to obtain a first exposure time;

Step 2205, determining that the amount of blur corresponding to the ambient brightness is C, and dividing C by the amount of jitter to obtain a first exposure time;

Step 2206, the camera determines a minimum value from the first exposure time and the preset second exposure time as the target exposure time;

Step 2207, the imaging device calculates a first sensitivity according to the target exposure time; when determining that the first sensitivity is greater than the sensitivity threshold, the sensitivity threshold is used as the target sensitivity of the imaging device; and determining that the first sensitivity is not greater than the sensitivity threshold When the first sensitivity is used as the target sensitivity of the imaging device;

Step 2208, image capture is performed using the target exposure time and the target sensitivity.

In the embodiment of the present invention, the single-frame shooting and the multi-frame shooting may be performed when the image is taken, and the single-frame shooting or the multi-frame shooting may be determined according to the actual situation, which is not limited in the embodiment of the present invention.

Embodiment 2

Specifically, before the imaging device calculates the first exposure time based on the ambient brightness and the amount of jitter, the imaging device first determines the ambient brightness. The manner of determining the ambient brightness in the embodiment of the present invention is various. The manner for determining the ambient brightness in the embodiment of the present invention is described in the embodiment, and details are not described herein again.

In the embodiment of the present invention, the sharpness of the image is affected by the amount of blur and noise, and the sharpness of the image is inversely proportional to the amount of blur and noise; the noise is proportional to the sensitivity, and the sensitivity is inversely proportional to the exposure time; In the case, the amount of blur is proportional to the exposure time. Alternatively, the relationship can be described by equation (3):

In equation (3), quality is the image sharpness, blur is the blur amount; λ is the noise influence coefficient; ISO is the sensitivity; Δt is the first exposure time; S is the jitter amount. Optionally,

S _x is the amount of jitter along the x-axis, and S _y is the amount of jitter along the y-axis.

From equation (3) and related discussion, theoretically, there is an exposure time to make the image clearest.

In the embodiment of the present invention, the correspondence between the ambient brightness and the noise influence coefficient can be obtained in a plurality of manners. In an optional implementation manner, the user can set a plurality of different ambient brightness in a fixed scene, and The images are taken under different ambient brightness, and then the effects of noise and denoising parameters on the image are compared under different brightness, and then the noise influence coefficients corresponding to different ambient brightness are determined.

In the embodiment of the present invention, after acquiring the correspondence between the ambient brightness and the noise influence coefficient, the camera device may determine the noise influence coefficient corresponding to the ambient brightness according to the corresponding relationship between the preset ambient brightness and the noise influence coefficient; The brighter the ambient brightness, the larger the noise influence coefficient; the imaging device calculates the first exposure time according to the noise influence coefficient and the shake amount. According to the correspondence between the ambient brightness and the noise influence coefficient, the noise influence coefficient corresponding to the determined ambient brightness is already an optimal value, and the noise influence coefficient can balance the influence of the blur amount and the ISO on the image sharpness, thereby making the image clear. The greatest degree. Thereafter, the imaging device calculates the first exposure time based on the noise influence coefficient and the shake amount.

Optionally, the first exposure time is calculated according to formula (4):

In the formula (4), λ is the noise influence coefficient; Δt is the first exposure time; and S is the jitter amount.

Optionally, the imaging device calculates a first exposure time according to the ambient brightness and the amount of jitter; the imaging device determines a minimum value from the first exposure time and the preset second exposure time as the target exposure time; wherein, the second exposure The time is the exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero. For specific discussion, refer to one embodiment, and details are not described herein again.

In the embodiment of the present invention, optionally, after the imaging device determines the target exposure time of the imaging device according to the ambient brightness and the amount of jitter, the imaging device calculates the first sensitivity according to the target exposure time; When it is determined that the first sensitivity is greater than the sensitivity threshold, the sensitivity threshold is used as the target sensitivity of the imaging device; when it is determined that the first sensitivity is not greater than the sensitivity threshold, the first sensitivity is used as the target sensitivity of the imaging device. For specific discussion, refer to one embodiment, and details are not described herein again.

In the first embodiment and the second embodiment described above, it is necessary to calculate the amount of jitter. An embodiment of the method for calculating the amount of jitter is provided in the embodiment of the present invention, as shown in the following. The x-axis, the y-axis, and the z-axis in the embodiment of the present invention are the x-axis, the y-axis, and the z-axis in the camera coordinate system shown in FIG. 1, that is, the z-axis is the optical axis of the imaging device.

The calculation of the jitter speed in the embodiment of the present invention is as follows:

First, for the rotational jitter around the x-axis or the y-axis, the amount of blurring of the image caused by the rotational jitter around the x-axis or the y-axis can be determined by equation (5):

b _xyx =v×tan(θ)...Formula (5)

In formula (5), θ is the jitter angle; v is the image distance, that is, v is the distance from the focal plane of the imaging device to the lens; wherein v=f+offset; f is the focal length of the imaging device; offset is the focusing distance, That is, offset is the movable distance of the motor of the imaging apparatus during the focusing process of the imaging apparatus; b _xyx is the amount of blurring of the image caused by the rotational jitter around the x-axis or the y-axis.

In an embodiment of the invention, the angle of dither may be the angle between a line perpendicular to the plane defined by the x-axis and the y-axis.

Second, for the rotational jitter around the z-axis, the amount of blur of the image corresponding to the pixel of the image sensor from the center of the image sensor r by the rotation jitter about the z-axis can be determined by the formula (6):

b _zx =r×cos(θ)...Formula (6)

In the formula (6), θ is the shake angle; r is the distance of the pixel on the image sensor in the image pickup device from the center of the image sensor; b _zx is the blur amount of the image caused by the rotational shake around the z-axis.

Third, for translational jitter along the x-axis or y-axis, the amount of blurring of the image caused by translational jitter along the x-axis or y-axis can be determined by equation (7):

b _xyp =x*v/u...Formula (7)

In formula (7), x is the amount of translational shake along the x-axis or y-axis; v is the image distance, ie, v is the focal plane-to-lens distance of the imaging device; where v=f+offset; f is the imaging device The focal length; offset is the focusing distance, that is, the offset is the movable distance of the motor of the imaging device during the focusing process of the imaging device;

b _xyp is the amount of blurring of the image caused by translational jitter along the x-axis or y-axis.

2c is a schematic diagram showing the relationship between different types of jitter and the amount of blur of an image provided by an embodiment of the present invention. As shown in FIG. 2c, the abscissa indicates the focus distance, the ordinate indicates the image sharpness, and the curve 2301 indicates the x-axis. And/or the y-axis translational jitter and the amount of jitter is fixed, the relationship between the focus distance and the amount of blur, and the curve 2302 indicates the relationship between the focus distance and the amount of blur when the rotation jitter along the x-axis and/or the y-axis is fixed and the amount of jitter is fixed. curve. Curve 2301 shows that when the jitter is shifted along the x-axis and/or the y-axis, the focus distance is larger, that is, the smaller the amount of movement of the lens, the smaller the amount of blurring of the image; the curve 2302 can be seen along the x-axis. When and/or the y-axis is rotated, the image sharpness is substantially unaffected by the focus distance.

Fourth, for the translational shake caused by the rotation along the z-axis, it is assumed that the center of the lens of the current imaging device is taken as the origin and after the angle is rotated along the z-axis. The coordinates of the speed sensor (a-sensor) of the imaging device are determined by the formula (8):

which is

In equation (8), θ is the jitter angle; x _a is the x-axis coordinate of the speed sensor of the imaging device before the jitter; y _a is the y-axis coordinate of the speed sensor of the imaging device before the jitter; x _a 'is the imaging device The speed sensor is the x-axis coordinate after shaking; y _a ' is the y-axis coordinate of the speed sensor of the imaging device after shaking; when the angle θ is small, cos θ approaches 1 and sin θ approaches θ, so the formula (8) ) simplified to equation (9):

which is

In equation (9), θ is the jitter angle; x _a is the x-axis coordinate of the speed sensor of the imaging device before the jitter; y _a is the y-axis coordinate of the speed sensor of the imaging device before the jitter; x _a 'is the imaging device The speed sensor is the x-axis coordinate after shaking; y _a ' is the y-axis coordinate of the speed sensor of the imaging device after shaking; Δx is the amount of change of the x-axis coordinate of the speed sensor of the imaging device after shaking before and after shaking; Δy is The amount of change in the y-axis coordinate of the speed sensor of the imaging device after shaking before and after shaking.

It can be seen from equations (8) and (9) that the amount of jitter rotating along the z-axis causes jitter in the translational direction along the x-axis and/or the y-axis.

Through the above discussion, in the embodiment of the present invention, the following optional calculation method of the jitter amount is obtained:

Fifth, for the rotation along the x-axis and / or y-axis, the total jitter speed of the x-axis and the y-axis is calculated by equation (10):

In equation (10), X _r (q) is the effect of jitter along the x-axis on the amount of blur; q is the jitter frequency; H _x (q) is the compensation coefficient of the x-axis at a frequency of q; Y _r (q) The effect of jitter on the y-axis on the amount of blur; H _y (q) is the compensation coefficient of the y-axis at a frequency of q; S _qx is the total jitter velocity along the x-axis; and S _qy is the total jitter velocity along the y-axis.

In the embodiment of the present invention, optionally, the mechanical characteristics of the motor of the image pickup apparatus determine that H _x (q) and H _y (q) are related to the jitter frequency. Optionally, the jitter data may be detected by an angular velocity sensor and a speed sensor, and the jitter data may be subjected to spectrum analysis to obtain parameters related to the jitter, such as a jitter frequency.

Since the jitter frequency when the hand is shaken is mainly concentrated in the frequency range of 2 Hz to 10 Hz, and the performance parameter of the OIS in the frequency range of 2 Hz to 10 Hz is generally stabilized to a value, based on this, the formula (10) can be approximated as a formula ( 11):

In equation (11), X _r (q) is the effect of jitter along the x-axis on the amount of blur; q is the jitter frequency; Y _r (q) is the effect of jitter along the y-axis on the amount of blur; Q ₁ is OIS Performance parameters; S _qx is the total jitter speed along the x-axis; S _qy is the total jitter speed along the y-axis.

Further simplify equation (11) to equation (12)

In equation (12), X _r (q) is the effect of jitter along the x-axis on the amount of blur; q is the jitter frequency; Y _r (q) is the effect of jitter along the y-axis on the amount of blur; Q ₁ is OIS Performance parameters; S _qx is the total jitter speed along the x-axis; S _qy is the total jitter speed along the y-axis.

Sixth, for the rotational jitter around the z-axis, the average jitter speed of the pixel at a distance r from the center of the image sensor of the imaging apparatus is calculated by the formula (13):

Z=Q ₂ *r*cos(θ)...Formula (13)

In the formula (13), Z is the average jitter speed of the pixel at a distance r from the center of the image sensor of the image pickup apparatus; Q ₂ is a performance parameter of the OIS; r is a distance between the pixel and the center of the image sensor of the image pickup apparatus; θ is Jitter angle.

For the rotational jitter around the z-axis, the total jitter velocity along the x-axis and the y-axis due to the z-axis jitter is calculated by equation (14):

In equation (14), Q ₂ is a performance parameter of the OIS; Res along the _x-axis resolution x; _y Res resolution along the y axis; S _resx along the x-axis velocity total jitter; S _resy along The total jitter speed of the y-axis.

Seventh, for the two-axis OIS in the imaging device, for the translation along the x-axis and the y-axis, the total jitter velocity along the x-axis and the y-axis is calculated by equation (15):

In formula (15), x _a ' is the x-axis coordinate of the speed sensor of the imaging device after shaking; y _a ' is the y-axis coordinate of the speed sensor of the imaging device after shaking; v is the image distance, that is, v is the camera The focal plane to the lens distance of the device; wherein, v=f+offset; f is the focal length of the imaging device; offset is the focusing distance, that is, the offset is the movable distance of the motor of the imaging device during the focusing process of the imaging device;

S _ax is the total jitter speed along the x-axis; _Say is the total jitter speed along the y-axis.

For the four-axis OIS in the imaging device, the total jitter velocity along the x-axis and the y-axis is calculated by equation (16) for translation along the x-axis and the y-axis:

In formula (16), x _a ' is the x-axis coordinate of the speed sensor of the imaging device after shaking; y _a ' is the y-axis coordinate of the speed sensor of the imaging device after shaking; v is the image distance, that is, v is the camera The focal plane to the lens distance of the device; wherein, v=f+offset; f is the focal length of the imaging device; offset is the focusing distance, that is, the offset is the movable distance of the motor of the imaging device during the focusing process of the imaging device;

S _ax is the total jitter speed along the x-axis; _Say is the total jitter speed along the y-axis; Q ₃ is the performance parameter of the OIS.

In summary, an embodiment of the present invention provides an optional implementation for determining the amount of jitter of the camera.

Optionally, the camera device calculates the amount of camera shake by the formula (17):

S=Q ₁ ×R _q +Q ₂ ×R _res +Q ₃ ×R _a ......Formula (17)

In equation (17), R _q is the amount of jitter about the x-axis and about the y-axis; R _reR is the amount of jitter about the z-axis; and R _a is the amount of jitter caused by translation along the x-axis and the y-axis; ₁ , Q ₂ and Q ₃ are constant terms. Optionally, the values of Q ₁ , Q _{2 ,} and Q ₃ are determined according to the x-axis, the y-axis, and the z-axis of the anti-shake; S is the amount of camera shake; the x-axis, the y-axis, and the z-axis belong to the camera coordinate system of the camera. And the optical axis of the imaging device is the z-axis.

It can be seen that the coefficients of each item in the formula (17) can be adjusted according to the specific anti-shake parameters of the camera device. Thus, the formula (17) can be more compatible with various anti-shake parameters of the camera device, thereby more accurately calculating The amount of jitter corresponding to various imaging devices.

Optionally, when it is determined that the imaging device comprises a gyroscope, and for anti-shake around the x-axis rotation and the y-axis rotation, Q _{1 is} smaller than Q ₂ and Q _{1 is} smaller than Q ₃ ; determining that the imaging device includes the accelerometer, and When anti-shake is performed about the z-axis rotation, Q _{2 is} smaller than Q ₁ and Q _{2 is} smaller than Q ₃ . In this way, the above formula (17) can be better compatible with various anti-shake parameters of the camera device, such as two-axis anti-shake, four-axis anti-shake and five-axis anti-shake camera, etc., thereby more accurately calculating various The amount of jitter corresponding to the imaging device. Optionally, R _a is inversely proportional to the focusing distance. Thus, the amount of jitter R _a caused by the translation along the x-axis and the y-axis can be calculated more accurately by the focusing distance, thereby more accurately calculating the jitter corresponding to the imaging device. the amount.

Alternatively, the above formula (17) can be written in the form of the formula (18) in detail:

In equation (18), S _x is the total jitter velocity along the x-axis; S _y is the total jitter velocity along the y-axis; Q ₁ , Q ₂ and Q ₃ are the performance parameters of OIS; X _r (q) is The effect of jitter along the x-axis on the amount of blur; q is the jitter frequency; Y _r (q) is the effect of jitter along the y-axis on the amount of blur; Res _x is the resolution along the x-axis; and Res _y is along the y-axis Resolution; x _a ' is the x-axis coordinate of the speed sensor of the imaging device after shaking; y _a ' is the y-axis coordinate of the speed sensor of the imaging device after shaking; v is the image distance, that is, v is the focal plane of the imaging device The distance to the lens; wherein, v=f+offset; f is the focal length of the imaging device; offset is the focusing distance, that is, the offset is the movable distance of the motor of the imaging device during the focusing process of the imaging device;

* indicates multiplication.

The amount of jitter of the image pickup apparatus in the embodiment of the present invention may be the total jitter speed in the embodiment of the present invention. For example, the jitter amount S in the formula (17) may include the total jitter speed S _x along the x-axis in the formula (18) and The total jitter speed S _y along the y-axis. In an embodiment of the invention, optionally, the jitter amount S satisfies the formula (19):

In the formula (19), S is the amount of jitter in the embodiment of the invention, S may also be referred to as the jitter speed, S _x is the total jitter speed along the x-axis; and S _y is the total jitter speed along the y-axis.

In the formula (17) and the formula (18), and R _q in the formula (17) includes R _qx and R _qy in the formula (18); R _res in the formula (17) includes R _resx and in the formula (18) R _resy ; R _a in the formula (17) includes R _ax and R _ay in the formula (18). Comparing equation (17) with equation (18), you can get the following information:

In the embodiment of the present invention, Q ₁ , Q _{2 ,} and Q ₃ may be determined according to a specific implementation scenario, and an embodiment of the present invention provides an optional value example. Alternatively, in equation (18):

When the camera device determines that the camera device does not include the OIS function, it can make Q ₁ =1, Q ₂ =1, and Q ₃ =1;

The imaging device determines that the imaging device only includes rotational anti-shake along the z-axis, that is, the imaging device includes rotational anti-shake along the x-axis and the y-axis, and translational anti-shake along the x-axis and the y-axis, then Q ₂ = =1;

The imaging device determines that the anti-shake axis of the camera is two-axis anti-shake based on the gyroscope, that is, the camera includes rotation anti-shake along the x-axis and the y-axis, so that Q ₂ = Q ₃ =1, Q ₁ ==0.05;

When the camera determines that the anti-shake axis of the camera is an accelerometer-based two-axis anti-shake, that is, the camera includes anti-shake along the z-axis, Q ₁ = Q ₃ =1, Q ₂ = 0.05 ;

The camera device determines that the anti-shake axis of the camera device is five-axis anti-shake, that is, the camera device includes rotation anti-shake along the x-axis and the y-axis, anti-shake along the z-axis, and translation along the x-axis and the y-axis. For anti-shake, Q ₁ = Q ₂ = Q ₃ = 0.05.

Optionally, in the embodiment of the present invention, the camera device can adaptively select a constant term parameter in the calculation formula of the jitter amount according to the actual anti-shake condition of the camera device, that is, the camera device can adaptively determine the jitter matched with itself. The formula for calculating the amount.

As can be seen from the above, in the embodiment of the present invention, the image capturing device acquires the amount of shake of the image capturing device; determines the ambient brightness of the environment in which the image to be captured is located; and determines the target for capturing the image to be captured according to at least the ambient brightness and the amount of jitter. Exposure time. In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

FIG. 3 is a schematic structural diagram of another image pickup apparatus according to an embodiment of the present invention.

Based on the same concept, another camera device provided by an embodiment of the present invention is configured to perform the above method. As shown in FIG. 3, an embodiment of the present invention provides an image capturing device, which includes a determining unit 301 and a processing unit. 302:

The embodiment of the present invention provides an image capturing apparatus 300, including: a determining unit 301, configured to acquire a shake amount of the image capturing apparatus 300; determine an ambient brightness of an environment in which the image to be captured is located; and a processing unit 302 configured to at least according to ambient brightness and jitter A quantity that determines a target exposure time for taking an image to be captured. In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

Optionally, the processing unit 302 is configured to calculate a first exposure time according to at least an ambient brightness and a shake amount; determine a minimum value from the first exposure time and the second exposure time as a target exposure time; wherein, the second exposure The time is the exposure time calculated when the amount of jitter is assumed to be zero under ambient brightness. Since the second exposure time is an exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero, it is assumed that the second exposure time is less than the first exposure time, and at this time, the target exposure time is selected as the second exposure time, and the target exposure time is on the one hand It meets the noise requirement of the image, that is, the target exposure time is not shortened due to the amount of jitter, so it does not add extra noise to the image; secondly, the target exposure time is less than the first exposure time, so it can be further in the case of jitter Reduce the amount of blurring of the image, which further enhances the sharpness of the image. Assuming that the second exposure time is not less than the first exposure time, At this time, the target exposure time is selected as the first exposure time, and the target exposure time meets the fuzzy amount requirement, and since the value of the blur amount has been discussed before, the influence of image noise has been considered, that is, the image is made When the amount of blur meets the requirements, the maximum exposure time is obtained as much as possible. Therefore, the sensitivity of the image at this time is also the minimum value in the case where the amount of blur meets the requirements, so the noise of the image is also in the case where the amount of blur meets the requirements. The minimum value, therefore, the method provided by the embodiment of the present invention further improves the sharpness of the image.

Optionally, the processing unit 302 is configured to determine an application scenario of the camera device 300; and determine, according to a preset correspondence between the preset application scenario and the blur amount, a range of values of the blur amount corresponding to the ambient brightness in the application scenario; The blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, the first exposure time can be more consistent with the current application scenario. Since the user has different requirements for the amount of blur in different application scenarios, the amount of blur determined by the method is for the current application scenario of the user. , can be clear enough.

Optionally, the processing unit 302 is configured to determine an application scenario of the camera device 300; and determine, according to a preset relationship between the preset ambient brightness, the application scenario, and the blur amount, the blur amount corresponding to the ambient brightness in the application scenario. The value range; the blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, the first exposure time can be more consistent with the current application scenario, and also meets the current ambient brightness condition. Since the user has different requirements for the amount of blur under different application scenarios and different ambient brightness conditions, Therefore, the amount of blur determined by this method can be sufficiently clear for the current application scenario of the user.

Optionally, the processing unit 302 is configured to determine, according to a preset correspondence between the ambient brightness and the blur quantity, a range of the blur quantity corresponding to the ambient brightness; and determine an ambient brightness from the range of the blur quantity corresponding to the ambient brightness. The corresponding blur amount; the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness. In this way, since an acceptable range of blurring values is set for each environment brightness, it is not necessary to require the minimum amount of blurring in any scene, and the flexible amount can be flexibly selected according to the ambient brightness, thereby ensuring When the amount of blur meets the requirements, Adjust the exposure time to coordinate the noise effects of the image to improve the sharpness of the image.

Optionally, the processing unit 302 is configured to determine, according to a preset correspondence between the ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the greater the noise influence coefficient; The coefficient and the amount of jitter are used to calculate the first exposure time. According to the correspondence between the ambient brightness and the noise influence coefficient, the noise influence coefficient corresponding to the determined ambient brightness is already an optimal value, and the noise influence coefficient can balance the influence of the blur amount and the ISO on the image sharpness, thereby making the image clear. The greatest degree. Thereafter, the imaging apparatus 300 calculates the first exposure time based on the noise influence coefficient and the shake amount.

Optionally, the processing unit 302 is further configured to calculate a first sensitivity according to the target exposure time; when determining that the first sensitivity is greater than the sensitivity threshold, use the sensitivity threshold as the target sensitivity of the image to be captured; When the sensitivity is not greater than the sensitivity threshold, the first sensitivity is taken as the target sensitivity of the image to be captured. . In this way, it is ensured that when the determined target exposure time is very short, the sensitivity is not excessively large and beyond the capability range of the image pickup device itself, that is, the sensitivity threshold is not exceeded, thereby ensuring the sensitivity of the image pickup apparatus. The rationality of this parameter is that the target sensitivity determined by the embodiment of the present invention is within the capability range of the imaging device, so even if the imaging device is subjected to severe jitter, the target exposure is not in the embodiment of the present invention. The time is too short and the target sensitivity exceeds the sensitivity threshold, thus ensuring that the imaging device can work normally even under severe jitter.

Optionally, the determining unit 301 is configured to obtain the amount of jitter of the camera 300 according to the following formula:

S=Q ₁ ×R _q +Q ₂ ×R _reR +Q ₃ ×R _a

Where R _q is the amount of jitter about the x-axis and about the y-axis; R _reR is the amount of jitter that rotates around the z-axis; R _a is the amount of jitter caused by translation along the x-axis and the y-axis, and R _a is the focal distance Inverse _ratio ; Q ₁ , Q ₂ and Q ₃ are constant terms; the values of Q ₁ , Q ₂ and Q ₃ are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of jitter of the imaging device 300; x-axis, y The axis and the z-axis belong to the camera coordinate system of the imaging apparatus 300, and the optical axis of the imaging apparatus 300 is the z-axis.

Optionally, when it is determined that the imaging apparatus 300 includes the gyroscope, and the anti-shake is performed for the x-axis rotation and the y-axis rotation, Q _{1 is} smaller than Q ₂ and Q _{1 is} smaller than Q ₃ ; in determining that the imaging apparatus 300 includes the accelerometer, And for anti-shake around the z-axis rotation, Q2 is smaller than Q1, and Q2 is smaller than Q3.

It can be seen that the coefficients of the respective items in the formula can be adjusted according to the specific anti-shake parameters of the camera 300. Thus, the formula can be more compatible with the camera device 300 of various anti-shake parameters, thereby more accurately calculating various camera devices. The amount of jitter corresponding to 300. Moreover, the amount of jitter R _a caused by the translation along the x-axis and the y-axis can be calculated more accurately by the focus distance, thereby more accurately calculating the amount of jitter corresponding to the imaging device 300.

FIG. 4 is a schematic structural diagram of another image pickup apparatus according to an embodiment of the present invention.

Based on the same concept, another camera device provided by an embodiment of the present invention is configured to perform the above method. As shown in FIG. 4, an embodiment of the present invention provides an image capturing device. The camera device 400 includes a camera module 401 and a display 402. , memory 403, one or more processors 404:

a camera module 401 for capturing a picture of an image to be captured; a display 402 for displaying a picture captured by the camera module 401; a memory 403 for storing a picture captured by the camera module 401; and one or more processors 404, the processor 404 is configured to acquire the amount of jitter of the image capturing apparatus 400; determine the ambient brightness of the environment in which the image to be captured is located; and determine at least according to the ambient brightness and the amount of jitter. The target exposure time for taking the image to be captured.

Optionally, the camera module 401 is connected to the display 402, the memory 403, and the processor 404, and the image of the image to be captured collected by the camera module 401 can be transmitted to the processor 404, so that the processor 404 performs some column processing. The display 402 can be directly transmitted to the display 402, and the display 402 can directly display the acquired picture, or can be transferred to the memory 403, so that the memory 403 stores the collected picture. The display 402 and the camera module 401, the memory 403 and the processor 404 are respectively connected. The display 402 can directly display the screen collected by the camera module 401, and can also display the screen after being processed by the processor 404, or can be displayed in the memory 403. Stored current or historically acquired images. The memory 403 is connected to the camera module 401, the display 402 and the processor 404, respectively. The memory 403 can store the collected images transmitted by the received camera module 401, and can also process the processed images transmitted by the processor 404. For storage, the corresponding program or code may also be stored in the memory 403 to cause the processor 404 to read the program or code stored in the memory 403 to perform the method provided in the embodiment of the present invention. The processor 404 is respectively connected to the camera module 401, the display 402 and the memory 403. The processor 404 can directly receive the image transmitted by the camera module 401, and then process the image, and then the processed image can be transmitted to the display 402. It is used for display or transferred to the memory 403 to cause the memory 403 to be stored.

In this way, according to the influence of the amount of jitter and the brightness of the environment, a target exposure time can be comprehensively determined, so that when the target exposure time is used for image capturing, the target exposure time determined on the one hand does not cause the captured image to be shaken. The amount of blur generated is too high, and the target exposure time determined on the other hand does not cause the noise of the image to be too high, thereby improving the sharpness of the image.

Optionally, the processor 404 is configured to calculate a first exposure time according to at least an ambient brightness and a jitter amount; determine a minimum value from the first exposure time and the second exposure time as a target exposure time; wherein, the second exposure The time is the exposure time calculated when the amount of jitter is assumed to be zero under ambient brightness.

Since the second exposure time is an exposure time corresponding to the ambient brightness in the case where the amount of jitter is zero, it is assumed that the second exposure time is less than the first exposure time, and at this time, the target exposure time is selected as the second exposure time, and the target exposure time is on the one hand Meets the noise requirements of the image, that is, the target exposure time is not shortened due to the amount of jitter, so it does not add extra noise to the image; secondly, the target The exposure time is less than the first exposure time, so the blur amount of the image can be further reduced in the case of jitter, thereby further improving the sharpness of the image. Assuming that the second exposure time is not less than the first exposure time, and the target exposure time is selected as the first exposure time, the target exposure time meets the blur quantity requirement, and since the value of the blur amount has been discussed before, it has been considered. The influence of the image noise, that is, the maximum exposure time is obtained as much as possible when the blur amount of the image meets the requirements, so the sensitivity of the image at this time is also the minimum value in the case where the blur amount satisfies the requirement, The noise of the image is also the minimum value in the case where the amount of blurring meets the requirements. Therefore, the method provided by the embodiment of the present invention further enhances the sharpness of the image.

Optionally, the processor 404 is configured to determine an application scenario of the camera device 400; and determine, according to a preset correspondence between the preset application scenario and the blur amount, a range of values of the blur amount corresponding to the ambient brightness in the application scenario; The blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness.

Optionally, the processor 404 is configured to determine an application scenario of the camera device 400, and determine, according to a preset relationship between the preset ambient brightness, the application scenario, and the blur amount, the blur amount corresponding to the ambient brightness in the application scenario. The value range; the blur amount corresponding to the ambient brightness is determined from the range of the blur amount corresponding to the ambient brightness; and the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness.

Optionally, the processor 404 is configured to determine, according to a preset correspondence between the ambient brightness and the blur quantity, a range of the blur quantity corresponding to the ambient brightness; and determine an ambient brightness from the range of the blur quantity corresponding to the ambient brightness. The corresponding blur amount; the first exposure time is calculated according to the blur amount and the shake amount corresponding to the ambient brightness.

Optionally, the processor 404 is configured to determine, according to a preset correspondence between the ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the greater the noise influence coefficient; The coefficient and the amount of jitter are used to calculate the first exposure time. According to the correspondence between the ambient brightness and the noise influence coefficient, the noise influence coefficient corresponding to the determined ambient brightness is already an optimal value, and the noise influence coefficient can balance the influence of the blur amount and the ISO on the image sharpness, thereby making the image clear. The greatest degree. Thereafter, the imaging apparatus 400 calculates the first exposure time based on the noise influence coefficient and the shake amount.

Optionally, the processor 404 is further configured to calculate a first sensitivity according to the target exposure time; when determining that the first sensitivity is greater than the sensitivity threshold, use the sensitivity threshold as the target sensitivity of the image to be captured; When the sensitivity is not greater than the sensitivity threshold, the first sensitivity is taken as the target sensitivity of the image to be captured. In this way, it is ensured that when the determined target exposure time is very short, the sensitivity is not excessively large and beyond the capability range of the image pickup device itself, that is, the sensitivity threshold is not exceeded, thereby ensuring the sensitivity of the image pickup apparatus. The rationality of this parameter is that the target sensitivity determined by the embodiment of the present invention is within the capability range of the imaging device, so even if the imaging device is subjected to severe jitter, the target exposure is not in the embodiment of the present invention. The time is too short and the target sensitivity exceeds the sensitivity threshold, thus ensuring that the imaging device can work normally even under severe jitter.

Optionally, the processor 404 is configured to obtain the amount of jitter of the camera device 400 according to the following formula:

S=Q ₁ ×R _q +Q ₂ ×R _reR +Q ₃ ×R _a

Where R _q is the amount of jitter about the x-axis and about the y-axis; R _reR is the amount of jitter about the z-axis; R _a is the amount of jitter caused by translation along the x-axis and the y-axis, and R _a is the focal distance Inverse _ratio ; Q ₁ , Q ₂ and Q ₃ are constant terms; the values of Q ₁ , Q ₂ and Q ₃ are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of jitter of the imaging device 400; x-axis, y The axis and the z-axis belong to the camera coordinate system of the imaging apparatus 400, and the optical axis of the imaging apparatus 400 is the z-axis.

Optionally, when it is determined that the camera device 400 includes a gyroscope, and for anti-shake around the x-axis rotation and the y-axis rotation, Q _{1 is} smaller than Q ₂ and Q _{1 is} smaller than Q ₃ ; in determining that the imaging device 400 includes the accelerometer, And for anti-shake around the z-axis rotation, Q _{2 is} smaller than Q ₁ and Q _{2 is} smaller than Q ₃ .

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, or a computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device. Having a series of operational steps performed on a computer or other programmable device to produce computer-implemented processing such that instructions executed on a computer or other programmable device are provided for implementing one or more processes and/or block diagrams in the flowchart. The steps of a function specified in a box or multiple boxes.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of the invention as claimed.

Claims

A method for determining image capturing parameters, comprising:

Obtaining the amount of jitter of the camera device;

Determining the ambient brightness of the environment in which the image to be captured is located;

A target exposure time for capturing the image to be captured is determined based at least on the ambient brightness and the amount of shake.
The method according to claim 1, wherein the determining a target exposure time for capturing the image to be captured based on at least the ambient brightness and the amount of jitter comprises:

Calculating a first exposure time according to at least the ambient brightness and the amount of jitter;

Determining a minimum value from the first exposure time and the second exposure time as the target exposure time;

The second exposure time is an exposure time calculated when the amount of jitter is assumed to be zero under the ambient brightness.
The method of claim 2, wherein the calculating the first exposure time based on at least the ambient brightness and the amount of jitter comprises:

Determining, according to a preset correspondence between the ambient brightness and the blur amount, a range of the blur amount corresponding to the ambient brightness; determining a blur corresponding to the ambient brightness from the range of the blur amount corresponding to the ambient brightness the amount;

The first exposure time is calculated according to the amount of blur corresponding to the ambient brightness and the amount of jitter.
The method according to claim 3, wherein the blur amount corresponding to the ambient brightness is a maximum value within the range of the blur amount corresponding to the ambient brightness.
The method according to claim 2, wherein the determining a target exposure time for capturing the image to be captured based on the ambient brightness and the amount of jitter comprises:

Determining, according to a preset correspondence between the ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the greater the noise influence coefficient;

The first exposure time is calculated based on the noise influence coefficient and the amount of jitter.
The method according to any one of claims 1 to 5, wherein the determining, after determining the target exposure time for capturing the image to be captured, at least according to the ambient brightness and the amount of shake, further includes :

Calculating a first sensitivity according to the target exposure time;

When determining that the first sensitivity is greater than a sensitivity threshold, the sensitivity threshold is used as a target sensitivity of the image to be captured;

When it is determined that the first sensitivity is not greater than a sensitivity threshold, the first sensitivity is used as a target sensitivity of the image to be captured.
The method according to any one of claims 1 to 6, wherein the amount of jitter of the camera device is obtained according to the following formula:

S=Q 1 ×R q +Q 2 ×R reR +Q 3 ×R a

Where R q is the amount of jitter about the x-axis and about the y-axis; R reR is the amount of jitter about the z-axis; R a is the amount of jitter caused by translation along the x-axis and the y-axis, and R a is the focal distance Inverse ratio ; Q 1 , Q 2 and Q 3 are constant terms; the values of Q 1 , Q 2 and Q 3 are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of camera shake; x-axis, y-axis And the z-axis belongs to the camera coordinate system of the imaging device, and the optical axis of the imaging device is the z-axis.
The method according to claim 7, wherein when it is determined that said image pickup device comprises a gyroscope, and for anti-shake around x-axis rotation and y-axis rotation, Q 1 is smaller than Q 2 and Q 1 is smaller than Q 3 ;

In determining that the camera device includes an accelerometer, and for anti-shake for rotation about the z-axis, Q 2 is less than Q 1 and Q 2 is less than Q 3 .
A camera device, comprising:

a determining unit, configured to acquire a shaking amount of the image capturing device; and determine an ambient brightness of an environment in which the image to be captured is located;

And a processing unit, configured to determine, according to the ambient brightness and the amount of jitter, a target exposure time for capturing the image to be captured.
The image pickup apparatus according to claim 9, wherein the processing unit is configured to:

Calculating a first exposure time according to at least the ambient brightness and the amount of jitter;

Determining a minimum value from the first exposure time and the second exposure time as the target exposure time;

The second exposure time is an exposure time calculated when the amount of jitter is assumed to be zero under the ambient brightness.
The image pickup apparatus according to claim 10, wherein the processing unit is configured to:

Determining, according to a preset correspondence between the ambient brightness and the blur amount, a range of the blur amount corresponding to the ambient brightness; determining a blur amount corresponding to the ambient brightness from the range of the blur amount corresponding to the ambient brightness ;

The first exposure time is calculated according to the amount of blur corresponding to the ambient brightness and the amount of jitter.
The image pickup apparatus according to claim 11, wherein the blur amount corresponding to the ambient brightness is a maximum value within a range of the blur amount corresponding to the ambient brightness.
The image pickup apparatus according to claim 10, wherein the processing unit is configured to:

Determining, according to a preset correspondence between the ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the greater the noise influence coefficient;

The first exposure time is calculated based on the noise influence coefficient and the amount of jitter.
The image pickup apparatus according to any one of claims 9 to 13, wherein the processing unit is further configured to:

Calculating a first sensitivity according to the target exposure time;

When determining that the first sensitivity is greater than a sensitivity threshold, the sensitivity threshold is used as a target sensitivity of the image to be captured;

When it is determined that the first sensitivity is not greater than a sensitivity threshold, the first sensitivity is used as a target sensitivity of the image to be captured.
The image pickup apparatus according to any one of claims 9 to 14, wherein the determining unit is configured to:

Obtain the amount of jitter of the camera device according to the following formula:

S=Q 1 ×R q +Q 2 ×R reR +Q 3 ×R a

Where R q is the amount of jitter about the x-axis and about the y-axis; R reR is the amount of jitter about the z-axis; R a is the amount of jitter caused by translation along the x-axis and the y-axis, and R a is the focal distance Inverse ratio ; Q 1 , Q 2 and Q 3 are constant terms; the values of Q 1 , Q 2 and Q 3 are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of camera shake; x-axis, y-axis And the z-axis belongs to the camera coordinate system of the imaging device, and the optical axis of the imaging device is the z-axis.
The image pickup apparatus according to claim 15, wherein when it is determined that said image pickup apparatus includes a gyroscope, and for anti-shake around x-axis rotation and y-axis rotation, Q 1 is smaller than Q 2 and Q 1 is smaller than Q 3 ;

When it is determined that the camera device includes an accelerometer and anti-shake is performed for rotation about the z-axis, Q2 is smaller than Q1, and Q2 is smaller than Q3.
A camera device, comprising:

a camera module for collecting a picture of an image to be captured;

a display for displaying a picture collected by the camera module;

a memory for storing a picture collected by the camera module;

One or more processors for:

Obtaining a jitter amount of the camera device; determining an ambient brightness of an environment in which the image to be captured is located;

A target exposure time for capturing the image to be captured is determined based at least on the ambient brightness and the amount of shake.
The image pickup apparatus according to claim 17, wherein said processor is configured to:

Calculating a first exposure time according to at least the ambient brightness and the amount of jitter;

Determining a minimum value from the first exposure time and the second exposure time as the target exposure time;

The second exposure time is an exposure time calculated when the amount of jitter is assumed to be zero under the ambient brightness.
The image pickup apparatus according to claim 18, wherein said processor is configured to:

Determining the corresponding brightness of the environment according to a preset relationship between the ambient brightness and the blur amount a range of values of the fuzzy amount; determining a blur amount corresponding to the brightness of the environment from a range of values of the amount of blur corresponding to the brightness of the environment;

The first exposure time is calculated according to the amount of blur corresponding to the ambient brightness and the amount of jitter.
The image pickup apparatus according to claim 19, wherein the blur amount corresponding to the ambient brightness is a maximum value within a range of the blur amount corresponding to the ambient brightness.
The image pickup apparatus according to claim 18, wherein said processor is configured to:

Determining, according to a preset correspondence between the ambient brightness and the noise influence coefficient, a noise influence coefficient corresponding to the ambient brightness; wherein, the brighter the ambient brightness, the greater the noise influence coefficient;

The first exposure time is calculated based on the noise influence coefficient and the amount of jitter.
The image pickup apparatus according to any one of claims 17 to 21, wherein the processor is further configured to:

Calculating a first sensitivity according to the target exposure time;

When determining that the first sensitivity is greater than a sensitivity threshold, the sensitivity threshold is used as a target sensitivity of the image to be captured;

When it is determined that the first sensitivity is not greater than a sensitivity threshold, the first sensitivity is used as a target sensitivity of the image to be captured.
The image pickup apparatus according to any one of claims 17 to 22, wherein the processor is configured to:

Obtain the amount of jitter of the camera device according to the following formula:

S=Q 1 ×R q +Q 2 ×R reR +Q 3 ×R a

Where R q is the amount of jitter about the x-axis and about the y-axis; R reR is the amount of jitter about the z-axis; R a is the amount of jitter caused by translation along the x-axis and the y-axis, and R a is the focal distance Inverse ratio ; Q 1 , Q 2 and Q 3 are constant terms; the values of Q 1 , Q 2 and Q 3 are determined according to the x-axis, y-axis and z-axis of anti-shake; S is the amount of camera shake; x-axis, y-axis And the z-axis belongs to the camera coordinate system of the imaging device, and the optical axis of the imaging device is the z-axis.
The image pickup apparatus according to claim 23, wherein when it is determined that said image pickup apparatus includes a gyroscope, and for anti-shake around x-axis rotation and y-axis rotation, Q 1 is smaller than Q 2 and Q 1 is smaller than Q 3 ;

In determining that the camera device includes an accelerometer, and for anti-shake for rotation about the z-axis, Q 2 is less than Q 1 and Q 2 is less than Q 3 .