CN116017158B - Calibration method and equipment for optical anti-shake - Google Patents

Abstract

The application provides an optical anti-shake calibration method and equipment, relates to the technical field of optical electronic devices, and is used for solving the problem of low accuracy of OIS calibration. The method comprises the following steps: and acquiring N images acquired by the camera module at a first shooting state and a first preset calibration plate comprising at least one characteristic point. N is larger than 2, and N images are respectively set to different values corresponding to motors of the camera module. The first shooting state includes: the camera module vibrates and the OIS function of the camera module is started; when the OIS function of the camera module is started, the motor drives the lens of the camera module to move when the image is acquired so as to compensate the blurring caused by the vibration of the camera module. And obtaining the jitter condition of the characteristic points in each image, and determining the jitter center of each image according to the jitter condition of the characteristic points. And searching target images of which the distances between the jitter centers and the image centers meet preset conditions from the N images. And obtaining a target gain corresponding to the target image, and determining the target gain as a calibrated gain value of the motor.

Description

Calibration method and equipment for optical anti-shake

Technical field

The present application relates to the technical field of optical electronic devices, and in particular to an optical anti-shake calibration method and equipment.

Background technique

Optical Image Stabilizer (OIS) moves the position of the lens group or photosensitive chip to compensate for image blur caused by camera shake during shooting, thereby achieving the function of shock reduction and anti-shake, making the shooting image clear and stable. For camera modules with OIS anti-shake function, in order to ensure the OIS anti-shake effect, the OIS function needs to be calibrated before being put into use.

A commonly used calibration method in related technologies is to use a calibration plate with a single feature point to perform OIS calibration on a camera module, set a single feature point in the center of the calibration plate, and use the camera module to be calibrated to capture an image of the calibration plate. OIS calibration is performed on the camera module to be calibrated based on the information of a single feature point in the captured image.

Periscope lens, also known as "internal zoom" lens, means that optical zoom is completed inside the fuselage. Some periscope camera modules perform anti-shake processing on the prism. When using the above method to perform OIS calibration on this type of periscope camera module, after the calibration plate position is fixed, different periscope camera modules When photographing a calibration plate, the position of a single feature in the image is not necessarily in the center of the image. In this case, when performing OIS calibration on a periscope camera module, it is easy to cause the problem that the center of image evaluation is far from the center of the lens screen, and the accuracy of OIS calibration is low.

Contents of the invention

Embodiments of the present application provide an optical anti-shake calibration method and equipment, which are used to solve the problem of OIS calibration of periscope camera modules. It is easy for the center of image evaluation to be far away from the center of the lens screen, and the accuracy of OIS calibration is relatively low. low question. In order to achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

In the first aspect, an optical anti-shake calibration method is provided, which method includes:

Obtain N images collected by the camera module on the first preset calibration plate in the first shooting state. The first preset calibration plate includes at least one feature point, and N is a positive integer greater than 2; the N images are collected when the motor of the camera module is set to different gains. The first shooting state includes: the camera module vibrates and the optical anti-shake function of the camera module is turned on; when the optical anti-shake function of the camera module is turned on, when the camera module collects images, the motor drives the camera module The lens moves to compensate for the blur caused by the vibration of the camera module. Then, obtain the jitter of the feature points in each of the N images, and determine the jitter center of each image based on the jitter of the feature points in each of the N images; the jitter center is used to indicate the jitter in the image Minimal location. Then, among the N images, find the target image whose distance between the jitter center and the image center satisfies the preset condition; the preset condition is used to indicate that the distance between the jitter center of the image and the image center is the smallest, and the distance is smaller than the a preset threshold. Finally, the target gain corresponding to the motor when collecting the target image is obtained, and the target gain is determined as the calibrated gain value of the motor.

In this solution, by analyzing the images collected by the camera module at different motor gains, the location of the jitter center is found in each image, and based on whether the distance between the jitter center and the image center is less than a certain value and The distance is the smallest among N images to find the target image. Then, the gain value of the motor used to collect the target image is determined as the calibrated gain value of the motor. In this way, it is possible to ensure that the position targeted by the OIS calibration is the center of the image or a position closer to the center of the image, that is, where the center of the camera module is located, so that the position of the OIS calibration is as close as possible to the center of the image, thereby improving OIS calibration accuracy. At the same time, you only need to find the jitter centers of different images, and complete the OIS calibration when the jitter center is determined to be close to the image center. This can help quickly complete the OIS calibration process, reduce the time required for OIS calibration, and improve the efficiency of OIS calibration.

In a possible implementation, obtaining the jitter of each feature point in the N images, and determining the jitter center of each image based on the jitter of each feature point in the N images, may specifically include: first Filtering is performed to obtain N filtered images; wherein the filtered images include at least one feature object corresponding to at least one feature point, each feature point and a blurred portion corresponding to the corresponding feature point. Since a feature object corresponds to a feature point and its fuzzy part, that is to say, the feature object reflects the fuzzy amount of the corresponding feature point. Therefore, the location of the jitter center in the image corresponding to each filtered image can be determined based on the size of at least one feature object in each filtered image of the N filtered images.

In a possible implementation, the above-mentioned method determines the location of the jitter center in the image corresponding to each filtered image based on the size of at least one feature object in each filtered image of the N filtered images, which may specifically include : Find the smallest feature object in each filtered image of N filtered images respectively. Then, based on the smallest feature object in each filtered image, the location of the jitter center in the image corresponding to each filtered image is determined. In this solution, the smallest feature object is found in the filtered image, and then the location of the jitter center is determined based on the minimum feature object, which can help quickly and effectively find the location of the jitter center.

In a possible implementation, based on the smallest characteristic object in each filtered image, determining the location of the jitter center in the image corresponding to each filtered image may specifically include: if the smallest characteristic object is located at the center of the filtered image edge, and the size of the smallest feature object exceeds the second preset threshold, it is determined that the jitter center is outside the image corresponding to the target filtered image. If the minimum feature object is not at the edge of the filtered image, or the size of the minimum feature object does not exceed the second preset threshold, then the location of the jitter center is determined based on the position of the minimum feature object in the target filtered image. A second preset threshold is set to distinguish whether the jitter center is within the image. When it is determined that the jitter center is outside the image, it is necessary to continue to adjust the gain of the motor to move the jitter center within the image. After confirming that the jitter center is within the image, adjust the motor gain so that the jitter center of the image can move to the center of the image. In this way, the optimal gain value of the motor can be easily determined. Since the original image collected by the camera module is filtered, the shaking center position can be determined directly by comparing the size of the characteristic object. There is no need to calculate the fuzzy amount of feature points, which can reduce the calculation amount during the calibration process and improve the efficiency of OIS calibration.

In a possible implementation, determining the location of the jitter center based on the position of the minimum feature object in the target filtered image may specifically include: if the minimum feature object includes a feature object, then the location of the center of the minimum feature object is Determine the location of the jitter center. If the minimum feature object includes more than two feature objects, the location of the jitter center is fitted based on the location of the minimum feature object. Since the first preset calibration plate includes multiple feature points, there may be no feature points in the image center of the collected image. Therefore, when finding the jitter center based on the feature object, the minimum feature object can be combined to fit the location of the jitter center. This results in a more accurate location of the jitter center.

In a possible implementation, obtaining N images collected by the camera module on the first preset calibration plate in the first shooting state may specifically include: increasing or decreasing the gain of the motor from the initial value, and When the motor is set to different gains, the image captured by the camera module on the first preset calibration plate in the first shooting state is correspondingly obtained. In this solution, during the calibration process of optical anti-shake, the gain of the control motor is increased or decreased in sequence, which can make the position of the jitter center in different images change in one direction, which makes it easy to quickly find the jitter center close to the image center. Image. This can improve the speed of OIS calibration.

In a possible implementation, the jitter of the feature points in each of the N images is obtained, and based on the jitter of the feature points in each of the N images, the jitter of each image is determined. The jitter center may specifically include: after obtaining the current image collected by the camera module when the motor is set to the current gain, obtain the jitter of the feature points in the current image, and determine the current jitter based on the jitter of the feature points in the current image. The jitter center of the image. In this embodiment, the above method further includes: when it is determined that the distance between the jitter center of the current image and the image center of the current image meets the preset condition, stopping the acquisition of the first preset image by the camera module in the first shooting state. Images collected from the calibration plate.

In this solution, after the camera module is adjusted to a motor gain value each time and an image is collected, it is first analyzed whether the jitter center and the image center of the image meet the preset conditions. If the preset conditions are met, the camera module no longer needs to adjust the gain value of the motor or collect new images. If the preset conditions are not met, it means that the motor gain value corresponding to the image is not the optimal gain value of the motor. At this time, the camera module can continue to adjust the gain value of the motor and collect new images for analysis. In this way, the camera module can avoid collecting redundant images, and there is no need to analyze these redundant images, which can reduce the time required for calibration and increase the speed of OIS calibration.

In a possible implementation, the gain of the motor increases or decreases from the initial value, which may specifically include: during the process of increasing or decreasing the gain of the motor from the initial value, if the first gain corresponds to the jitter center of the first image Outside the first image, the first gain is increased or decreased based on the first preset step size.

In a possible implementation, the gain of the motor increases or decreases from the initial value, and when the motor is set to a different gain, the corresponding acquisition data of the first preset calibration plate collected by the camera module in the first shooting state is obtained. The image may specifically include: while the gain of the motor is increasing or decreasing from the initial value, obtaining the second image collected by the camera module when the gain of the motor is set to the second gain; if the jitter center of the second image is at the Within two images, increase or decrease the second preset step size on the basis of the second gain to obtain the third gain, and obtain the third image collected by the camera module; based on the jitter center of the second image and the jitter center of the third image The moving distance and the second preset step size determine the target step size; increase or decrease the target step size based on the third gain to obtain the fourth image collected by the camera module when the motor is set to the target step size.

In this solution, since the gain of the motor changes in order of size, after it is detected that the jitter center of the image moves within the image, the changes in the jitter center of the two images can be used to determine the motor corresponding to the two images. Gain changes determine the relationship between the jitter center and gain changes. Then based on the correlation of the changes, the gain value of the motor that needs to be adjusted to move the jitter center of the image to the center of the image, that is, the target step size, can be determined. In this way, after it is determined that the jitter center is within the image, the jitter center can be quickly moved to the image center, reducing the number of image acquisition and analysis times and increasing the speed of OIS calibration.

In some possible implementations, the first preset calibration plate includes a plurality of circular feature points that are periodically arranged and have the same size. Periodically arranged multiple circular feature points of the same size can improve the accuracy of OIS calibration.

In some possible implementations, at least one feature point includes more than two feature points.

In some possible implementations, after searching for the target image whose distance between the jitter center and the image center satisfies the preset condition among the N images, the above method further includes: obtaining the image of the camera module in the second shooting state. The fifth image collected by the first preset calibration plate; in the second shooting state, the camera module vibrates and the optical anti-shake function of the camera module is turned off; in the third shooting state, the camera module acquires the first preset image The sixth image collected by the calibration board; in the third shooting state, the camera module remains stable; the compression ratio is determined based on the blur amount of the feature points in the target image, the fifth image, and the sixth image. Among them, the compression ratio is used to indicate the performance of the motor.

In this solution, after finding the target image whose distance between the jitter center and the image center meets the preset conditions, the blur amount of the feature point with the smallest jitter in the target image is combined with the optical anti-shake function of the camera module being turned off. When the blur amount of the same feature point is calculated, the compression ratio can be calculated. Since the motor's compensation for external jitter in the target image has reached a good level, using the blur amount of the image collected by the camera module at this time to calculate the compression ratio can improve the accuracy of the compression ratio calculation. At the same time, in order to avoid the influence of other factors, when calculating the compression ratio, the blur amount of the same feature point in the image collected by the camera module in a stable state is also combined. It can also improve the accuracy of compression ratio calculation.

In some possible implementations, determining the compression ratio based on the blur amount of the feature points in the target image, the fifth image, and the sixth image may include: obtaining the target feature points in the first preset calibration plate respectively in the target image, the fifth image, and the sixth image. The corresponding blur amounts in the fifth image and the sixth image; the compression ratio is calculated based on the corresponding blur amounts of the target feature points in the target image, the fifth image and the sixth image.

In some possible implementations, the compression ratio is calculated based on the blur amount corresponding to the target feature point in the target image, the fifth image, and the sixth image. Specifically, the compression ratio can be calculated by the following formula: CR=-20Log10 ((OIS on -Still)/(OIS off- Still)); where CR represents the compression ratio, OIS on represents the blur amount corresponding to the target feature point in the target image, and OIS off represents the blur amount corresponding to the target feature point in the fifth image, Still represents the blur amount corresponding to the target feature point in the sixth image.

In a second aspect, this application provides an optical anti-shake calibration method, which method includes:

Obtain the calibration image collected by the camera module on the second preset calibration plate; the second preset calibration plate includes at least one feature point; acquire the first position of the preset feature point in the second preset calibration plate in the calibration image, and the distance between the first position and the image center of the calibration image; based on the distance between the first position and the image center of the calibration image, adjust the stroke of the motor of the camera module so that the preset feature point is in the center of the image; obtain the camera M images collected by the module on the second preset calibration plate in the third shooting state; the third shooting state includes vibration of the camera module and the optical anti-shake function of the camera module is turned on; the optical anti-shake of the camera module When the camera module is collecting images when the dynamic function is turned on, the motor drives the lens of the camera module to move to compensate for the blur caused by the vibration of the camera module; M is a positive integer greater than or equal to 2; acquire M images The jitter condition of the preset feature points in the motor is determined; based on the jitter condition of the preset feature points, the calibration gain value of the motor is determined.

In this solution, a calibration plate including at least one feature point is used to perform optical anti-shake calibration on a camera module that performs optical anti-shake processing in the X and Y directions of the prism. After collecting an image, determine the distance between the preset feature points and the center of the image. Then the stroke of the motor is changed based on this distance, and the preset feature point is adjusted to the center of the image, that is, the center of the camera module's screen. This can avoid the problem of low optical anti-shake calibration accuracy caused by the preset feature point not being in the center of the camera module's screen.

In a third aspect, an electronic device is provided, including: a processor and a memory; the memory is used to store computer execution instructions; when the electronic device is running, the processor executes the computer execution instructions stored in the memory, so that the The electronic device performs the optical anti-shake calibration method according to any one of the above first aspects.

In a fourth aspect, a computer-readable storage medium is provided. Instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer can perform the optical anti-shake of any one of the above-mentioned first aspects. calibration method.

A fifth aspect provides a computer program product containing instructions that, when run on an electronic device, enables the electronic device to perform any one of the optical anti-shake calibration methods of the first aspect.

A sixth aspect provides a device (for example, the device may be a chip system). The device includes a processor and is used to support an electronic device to implement the functions involved in the above-mentioned first aspect. In a possible design, the device further includes a memory, which is used to store necessary program instructions and data of the electronic device. When the device is a chip system, it may be composed of a chip or may include a chip and other discrete components.

Among them, the technical effects brought by any one of the design methods in the third to sixth aspects can be found in the technical effects brought by the different design methods in the first and second aspects, and will not be described again here.

Description of the drawings

Figure 1 is a schematic diagram of images captured by a camera module provided by an embodiment of the present application on a calibration plate;

Figure 2 is a schematic structural diagram of a personal computer provided by an embodiment of the present application;

Figure 3 is a schematic diagram of an application scenario of an optical anti-shake calibration method provided by an embodiment of the present application;

Figure 4 is a schematic flow chart of an optical anti-shake calibration method provided by an embodiment of the present application;

Figure 5 is a schematic diagram of the first preset calibration plate provided by the embodiment of the present application;

Figure 6 is a schematic diagram of the first preset calibration plate provided by the embodiment of the present application;

Figure 7 is a schematic flow chart of an optical anti-shake calibration method provided by an embodiment of the present application;

Figure 8 is a schematic diagram of a filtered image provided by an embodiment of the present application;

Figure 9 is a schematic flow chart of an optical anti-shake calibration method provided by an embodiment of the present application;

Figure 10 is a schematic flow chart of an optical anti-shake calibration method provided by an embodiment of the present application;

Figure 11 is a schematic flow chart of an optical anti-shake calibration method provided by an embodiment of the present application;

Figure 12 is a schematic diagram of an image collected by a camera module provided by an embodiment of the present application on a second preset calibration plate;

Figure 13 is a schematic structural diagram of a chip system provided by an embodiment of the present application.

Detailed ways

OIS compensates for image blur caused by camera shake during shooting by moving the position of the lens group or photosensitive chip, thereby achieving the function of shock absorption and anti-shake, making the shooting picture clear and stable. For camera modules with OIS anti-shake function, in order to ensure the OIS anti-shake effect, the OIS function needs to be calibrated before being put into use.

In some embodiments, in the OIS anti-shake system, a motor is used to drive the lens in the camera module to move on a plane vertical to the optical axis, so as to offset as much as possible the impact of external vibrations (such as hand shake) on picture clarity during shooting. Impact. Specifically, based on the jitter data obtained during shooting, the motor can generate force in the opposite direction to balance the light path affected by the jitter, so that the jittered light can still fall in its original position, thereby obtaining a more stable and clear image. Effect.

Due to motor production differences, different motors may have different sensitivities to the same jitter data. The offset amount of the motor-controlled lens movement has a certain relationship with the size of the external jitter. This relationship can be expressed by the gain of the motor. When the shake data during shooting is the same, if the gain of the motor is set to a different value, the offset amount of the motor controlling the movement of the lens will be different. In some embodiments, in order to obtain a better anti-shake effect, a motor is required to push the lens as far as possible to a place where the light can fall at its original position. Therefore, this position can be found by adjusting the gain of the motor, that is, finding the gain of the motor that can obtain a good anti-shake effect, which can be called the best gain of the motor. The process of OIS calibration includes the process of finding the optimal gain value of the motor.

A commonly used calibration method in related technologies is to use a single feature calibration board to perform OIS calibration on a camera module. A single feature is set in the center of the calibration board, and the camera module to be calibrated is used to capture the image captured by the calibration board. The image is used for OIS calibration of the camera module to be calibrated.

Some camera modules are equipped with prisms, and after the optical anti-shake (OIS) function is turned on, anti-shake processing is performed on the prism in the X and Y directions, such as periscope camera modules. That is to say, if the OIS function is turned on, the motor of the camera module will perform shake compensation in the X and Y directions of the prism according to the shake situation. Since the periscope camera module collects images, the light path needs to be refracted by the prism before reaching the imaging device. Therefore, if anti-shake processing is performed in the X and Y directions of the prism, the compensation effect will appear at different positions in the image. Inconsistent. In other words, the anti-shake effect may be inconsistent at different locations in the captured image. After testing, it was found that when the above-mentioned camera module has external jitter and the OIS function is turned on, the images collected may produce image rotation. The phenomenon of image rotation refers to the phenomenon of image rotation with a center as the origin.

If the above method is used for OIS calibration for a camera module that performs anti-shake processing in the X and Y directions on the prism, after the position of the calibration plate is fixed, when using different camera modules to shoot the calibration plate, due to assembly problems , the position of a single feature in the image does not necessarily appear in the center of the image. As shown in Figure 1, the calibration plate 10 is used for OIS calibration. A single cross feature (cross chart) is set in the center of the calibration plate 10. When shooting with different camera modules, the cross chart in the image 11 collected by the camera module The position may be 12, 13, 14 or 15, and is not necessarily in the center of the image. It should be understood that in other embodiments, the features in the calibration plate used for OIS calibration can also be feature points other than a single cross chart, such as a single circular feature point, a single square feature point or a single triangular feature. Wait.

When OIS calibration, it is usually necessary to combine the jitter amount of the feature points in the image collected by the camera module to determine the anti-shake effect. In this case, the position targeted during the OIS calibration process is a single feature collected in the image. The location of the point. For periscope camera modules, since the location of a single feature point when collecting images is not necessarily the center of the lens screen (image center) of the camera module, the position for OIS calibration evaluation is not necessarily the center of the lens screen.

However, when users use the camera module to capture images, they usually focus on the center of the image. Therefore, when performing optical anti-shake calibration on a camera module, it is usually necessary to evaluate the anti-shake effect at the center of the lens frame of the camera module. If you use the above method to perform OIS calibration on this type of lens, it is easy to have the problem that the center of image evaluation is far away from the "0" field of view in the center of the lens frame, and the accuracy of OIS calibration is low.

Based on this, this application proposes an optical anti-shake calibration method. In the method provided by the embodiment of the present application, the first preset calibration plate used for OIS calibration includes at least one feature point. Obtain N images collected by the camera module on the first preset calibration plate in the first shooting state; wherein, different images are collected when the motor of the camera module is set to different gains. Afterwards, the jitter center of each image can be determined based on the jitter of the feature points in each image collected by the camera module. Then, the target image whose distance between the jitter center and the image center meets the preset conditions can be found in the N images, and the target gain corresponding to the motor setting when the camera module collects the target image is determined as the calibration of the camera module's motor. gain value. The preset condition is used to indicate that the distance between the jitter center of the image and the center of the image is the smallest, and the distance is smaller than the first preset threshold.

The above method, when performing OIS calibration, finds the target image whose distance between the jitter center and the image center meets the preset conditions, determines the gain value of the motor based on the target image, and ensures that the position targeted by the OIS calibration is the image center or is closer to the image center. The position is where the center of the camera module’s screen is. Even if the image collected with the OIS function turned on has image rotation, the calibrated gain value of the motor is able to achieve the best OIS effect at the center of the image (that is, the center of the camera module). Thereby improving the accuracy of OIS calibration.

In some embodiments, the first preset calibration plate can include more than two feature points. In this way, during OIS calibration, any one or more feature points can be selected according to the actual situation, and the jitter based on the one or more feature points can be situation to evaluate the OIS effect. In an image with image rotation problems, the jitter center of the image may have minimal or no jitter, while other locations outside the jitter center may have larger jitter amounts. Therefore, the jitter center of the image can be found based on analyzing the jitter of different feature points in the image. Then, among the N images collected by the camera module, find the target image whose jitter center is closest to the image center, and then use the target gain of the motor corresponding to the target image as the calibration gain value of the motor. The image center of the target image is close to the position with the smallest amount of jitter in the entire image, and is also the position with the best anti-shake effect in the target image. The motor gain corresponding to the target image is the motor gain value that can achieve the best anti-shake effect at the center of the lens screen (image center), which is the calibration gain value of the motor that needs to be determined for OIS calibration.

In this way, it can be ensured that the position targeted by the calibration is the position corresponding to the center of the lens frame (i.e., the center of the image), thereby improving the accuracy of the calibration. Moreover, OIS calibration can be completed by finding the jitter centers of different images, which can help quickly complete the OIS calibration process, reduce the time required for OIS calibration, and improve the efficiency of OIS calibration.

From the above description, it can be seen that if the camera module performs optical anti-shake processing in the X and Y directions of the prism, the images collected by the camera module may still have image rotation problems. In some embodiments, in an image causing an image rotation problem, the above-mentioned jitter center may also be called an image rotation center.

It should be noted that the optical anti-shake calibration method provided by the embodiments of the present application can be applied to a separate test device, can be integrated into a test module, or can also be applied to an electronic device connected to the test device.

For example, in some embodiments, the above-mentioned electronic device may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a personal computer, a notebook computer, an ultra-mobile personal computer (UMPC), or a netbook. , as well as cellular phones, personal digital assistants (PDAs), wearable devices, augmented reality (AR)/virtual reality (VR) devices, media players, televisions and other equipment, this application is implemented There are no special restrictions on the specific form of the equipment.

Taking the above-mentioned electronic device as an example, the personal computer 20 may be used. Please refer to FIG. 2 , which is a schematic structural diagram of the personal computer 20 provided by an embodiment of the present application. As shown in Figure 2, the personal computer 20 may include: a processor 21, a memory 22, a display screen 23, a Wi-Fi device 24, a Bluetooth device 25, an audio circuit 26, a microphone 26A, a speaker 26B, a power system 27, and peripherals. Interface 28, sensor module 29, data conversion module 30 and other components. These components may communicate via one or more communication buses or signal lines (not shown in Figure 2). Those skilled in the art can understand that the hardware structure shown in FIG. 2 does not constitute a limitation on the personal computer 20. The personal computer 20 may include more or fewer components than shown, or some components may be combined, or different components may be used. Component placement.

Among them, the processor 21 is the control center of the personal computer 20, using various interfaces and lines to connect various parts of the personal computer 20, by running or executing application programs stored in the memory 22, and calling data and data stored in the memory 22. instructions to perform various functions of the personal computer 20 and process data. In some embodiments, the processor 21 may include one or more processing units; the processor 21 may also integrate an application processor and a modem processor; where the application processor mainly processes operating systems, user interfaces, application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 21 .

In some other embodiments of the present application, the above-mentioned processor 21 may also include an AI chip. The learning and processing capabilities of AI chips include image understanding capabilities, natural language understanding capabilities, and speech recognition capabilities. AI chips can enable the personal computer 20 to have better performance, longer battery life, and better security and privacy. For example, if the personal computer 20 processes data through the cloud, the data needs to be uploaded and processed before returning the results, which is very inefficient under the current technical conditions. If the local side of the personal computer 20 has strong AI learning capabilities, then the personal computer 20 does not need to upload the data to the cloud and can process it directly on the local side. Therefore, the security and safety of the data can be improved while improving the processing efficiency. Privacy.

The memory 22 is used to store application programs and data, and the processor 21 executes various functions and data processing of the personal computer 20 by running the application programs and data stored in the memory 22 . The memory 22 mainly includes a storage program area and a storage data area. The storage program area can store the operating system and at least one application program required for the function (such as a sound playback function, an image playback function, etc.); the storage data area can store personal data according to the use of the program. Data created by the computer 20 (such as audio data, video data, etc.). In addition, the memory 22 may include high-speed random access memory, and may also include non-volatile memory, such as a magnetic disk storage device, a flash memory device or other non-volatile solid-state storage devices.

Memory 22 may store various operating systems. For example, the memory 22 may also store data related to the calibration of the embodiment of the present application, such as collected images, motor gain, and other data.

The display screen 23 is used to display images, videos, etc. The display screen may be a touch screen. In some embodiments, the personal computer 20 may include 1 or N display screens 23, where N is a positive integer greater than 1. The personal computer 20 implements display functions through a GPU, a display screen 23, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 23 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 21 may include one or more GPUs that execute program instructions to generate or alter display information.

The Wi-Fi device 24 is used to provide the personal computer 20 with network access that complies with Wi-Fi related standard protocols. The personal computer 20 can access the Wi-Fi access point through the Wi-Fi device 24, thereby helping the user to send and receive emails, browse web pages, access streaming media, etc., which provides users with wireless broadband Internet access. The personal computer 20 can also establish a Wi-Fi connection with a terminal device connected to the Wi-Fi access point through a Wi-Fi device and a Wi-Fi access point for mutual transmission of data. In some other embodiments, the Wi-Fi device 24 can also serve as a Wi-Fi wireless access point and can provide Wi-Fi network access for other computer devices.

The Bluetooth device 25 is used to realize data exchange between the personal computer 20 and other short-distance electronic devices (such as terminals, smart watches, etc.). The Bluetooth device in the embodiment of the present application may be an integrated circuit or a Bluetooth chip, etc.

Audio circuit 26, microphone 26A, and speaker 26B may provide an audio interface between the user and personal computer 20. The audio circuit 26 can transmit the electrical signal converted from the received audio data to the speaker 26B, and the speaker 26B converts it into a sound signal for output; on the other hand, the microphone 26A converts the collected sound signal into an electrical signal, and the audio circuit 26 After receiving, it is converted into audio data, and then the audio data is sent to the terminal through the Internet or Wi-Fi network or Bluetooth, or the audio data is output to the memory 22 for further processing.

Power supply system 27 is used to charge various components of personal computer 20. The power supply system 27 may include a battery and a power management module. The battery may be logically connected to the processor 21 through a power management chip, so that functions such as charging, discharging, and power consumption management can be implemented through the power supply system 27 .

The peripheral interface 28 is used to provide various interfaces for external input/output devices (such as keyboard, mouse, external monitor, external memory, user identification module card, etc.). For example, it is connected to a mouse through a universal serial bus interface to achieve the purpose of receiving relevant operations performed by the user through the mouse. For another example, the storage capacity of the personal computer 20 can be expanded by connecting to an external memory, such as a Micro SD card, through an external memory interface. Peripheral interface 28 may be used to couple the external input/output peripherals described above to processor 21 and memory 22 .

Sensor module 29 may include at least one sensor. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor. Among them, the ambient light sensor can adjust the brightness of the display screen 23 according to the brightness of the ambient light. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three axes). It can detect the magnitude and direction of gravity when stationary. It can be used to identify applications of personal computer posture (such as horizontal and vertical screen switching, Related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc. Of course, according to actual needs, the sensor module can also include any other feasible sensors.

The data conversion module 30 may include a digital-to-analog converter 30A and an analog-to-digital converter 30B. Among them, digital to analog converter (DAC), also known as D/A converter. A digital-to-analog converter is a device that converts digital signals into analog signals. Analog to digital converter (ADC), also known as A/D converter. An analog-to-digital converter is a device that converts analog signals into digital signals.

In some embodiments, the optical image stabilization calibration methods in the following embodiments can be executed in the personal computer 20 having the above hardware structure.

The technical terms that may be involved in the embodiments of this application are described below.

A periscope lens, also known as an "internal zoom" lens, means that the optical zoom is completed inside the fuselage.

The working principle of the optical image stabilizer is based on the gyroscope detecting the amount of shake and performing displacement compensation. That is, the gyroscope in the lens detects the slight movement caused by the shake of the camera module, and then transmits the signal to the central processing unit (CPU) for processing, and the CPU calculates the amount of displacement to be compensated. Then the motor is controlled to move the suspended lens in the camera module according to the displacement to be compensated to offset the tiny displacement caused by the shake, thereby effectively overcoming the image blur caused by the vibration of the camera module.

OIS on means that the optical anti-shake function is on, and OIS off means that the optical anti-shake function is off.

The gain of the motor, the offset amount of the motor controlled lens movement, and the size of the external jitter satisfy a certain relationship. This relationship can be represented by the gain of the motor.

The process of OIS calibration is the calibration process of optical image stabilization. In this process, the gain of the motor that can obtain better anti-shake effect can be determined, that is, the optimal gain value of the motor.

In some embodiments, the process of OIS calibration of the camera module to be calibrated may include: turning on the optical anti-shake function of the camera module and adding vibration to the camera module. Adjust the gain of the motor of the camera module, and obtain images captured by the camera module on the first preset calibration plate when the motor is set to each gain. Then the images corresponding to the gains of different motors are analyzed to determine the calibrated gain value of the motor. The vibration may be constant vibration, such as vibration of 6 Hertz (Hz), 3 degrees (°), 5 Hz, and 1°. The first preset calibration plate includes at least one feature point, and the first preset calibration plate is within the shooting range of the camera module to be calibrated.

In order to calibrate the OIS of the camera module, it is necessary to evaluate the anti-shake effect of the camera module when the OIS function is turned on. Therefore, during the OIS calibration process, it is necessary to simulate external jitter (such as hand jitter). In the embodiment of the present application, external jitter is simulated by using a vibrating table to drive the camera module to vibrate.

As shown in FIG. 3 , it is a schematic diagram of an application scenario of the optical anti-shake calibration method provided by an embodiment of the present application. In this embodiment, the above method is applied to the personal computer 30 connected to the test device as an example. As shown in Figure 3, the personal computer 30 is connected to the test device 31 and the camera module 32. The personal computer 30 can send instructions to the test device 31, so that the test device 31 performs corresponding operations based on the instructions. The personal computer 30 can also send instructions to the camera module 32 to control and adjust parameters of the devices in the camera module 32 . Among them, the camera module 32 can be installed on the testing device 31 . It should be understood that when the vibrating table 311 vibrates, it will drive the camera module 32 to vibrate.

Exemplarily, the test equipment 31 includes a vibration table 311. The test equipment 31 can receive a first instruction from the personal computer 30, and in response to the first instruction, control the vibration table 311 to vibrate according to preset vibration parameters. The preset vibration parameters may specifically include vibration angle and vibration frequency. It should be understood that when the personal computer 30 does not send the first instruction to the test device 31, the vibration table 311 of the test device 31 can remain stationary.

Exemplarily, the camera module 32 includes a motor 321 and a lens 322. The camera module 32 may receive a second instruction from the personal computer 30 and control the gain of the motor 321 to adjust to a specified value in response to the second instruction. After the optical anti-shake function of the camera module 32 is turned on, if external shake is detected when the lens 322 of the camera module 32 collects images, the motor 321 will move according to the currently set gain value to push the lens 322 toward Move in the opposite direction of the jitter to offset external jitter as much as possible. This results in a more stable and clear image.

It should be noted that the personal computer 30 shown in FIG. 3 is connected to the test equipment 31 and the camera module 32 respectively, and can respectively control the test equipment 31 and the camera module 32 to perform corresponding operations. In other embodiments, the test equipment 31 and the camera module 32 can be connected to different personal computers respectively, and the corresponding personal computers can control them respectively. Among them, a connection and communication can be established between the personal computer connected to the test device 31 and the personal computer connected to the camera module 32 .

In other embodiments, during the calibration process, a complete electronic device (such as a mobile phone) can also be calibrated directly. The electronic device is equipped with a camera module and a motor. For example, the mobile phone is set on the test equipment, and when the vibration table in the test equipment vibrates, the mobile phone vibrates. It is understandable that when the phone vibrates, the camera module in the phone will also vibrate. In this embodiment, instructions can also be sent to the mobile phone through a personal computer to control the mobile phone to adjust parameters of the devices in the camera module 32 .

This application provides an optical anti-shake calibration method, which can be applied to the scenario of calibrating the optical anti-shake function of some camera modules, and can be used to perform anti-shake processing on cameras in the X and Y directions of the prism. The module is calibrated to avoid the problem of low accuracy of OIS calibration caused by image rotation problems.

The optical anti-shake calibration method provided by the embodiments of the present application will be described in detail below with reference to the embodiments and drawings. For example, FIG. 4 is a schematic flowchart of an optical anti-shake calibration method provided by an embodiment of the present application. In this embodiment, the optical anti-shake calibration method is applied to a personal computer connected to the test equipment as an example. The above method includes S401-S410, where:

S401. The personal computer sends the first instruction to the test device.

The first instruction is used to instruct the test equipment to perform corresponding operations.

In some embodiments, the testing equipment includes a vibration table. For example, the first instruction can be used to instruct the vibrating table to vibrate with preset vibration parameters; wherein the first instruction carries the preset vibration parameters. After receiving the first instruction, the test equipment can analyze the first instruction to obtain the preset vibration parameters.

In some embodiments, the preset vibration parameters may include vibration angle and vibration frequency. For example, the vibration angle is 3° and the vibration frequency is 6Hz. After the test equipment obtains the preset vibration parameters, it controls the vibration table to vibrate based on the vibration angle and vibration frequency. In other embodiments, the vibration angle and vibration frequency in the preset vibration parameters can also be set to other values, which are not limited in the embodiments of the present application.

In other embodiments, the preset vibration parameters may also include a vibration time for indicating the vibration table. The vibration time may include the start time and end time of the vibration; or the vibration time may also include the duration of the vibration; or the vibration time may also be used to indicate the period of the vibration, and so on. After the test equipment obtains the preset vibration parameters, it controls the vibration table to vibrate based on the vibration time.

In addition to instructing the above vibration-related parameters, the first instruction may also be used in other embodiments to instruct the testing equipment to adjust other parameters. For example, the first instruction may be used to indicate parameters such as position, height, etc. set by the test equipment.

It should be understood that S401 can also represent the test device receiving the first instruction from the personal computer.

S402. The test equipment responds to the first instruction and controls the vibration table to vibrate with preset vibration parameters.

In some embodiments, the testing equipment controls the vibration table to vibrate with preset vibration parameters in response to the first instruction. It can be seen from the above description of FIG. 3 that when the vibrating table vibrates, it will drive the camera module installed on the vibrating table to vibrate together.

S403. The personal computer sends the second command to the camera module.

Among them, the camera module has optical anti-shake (OIS) function. In this embodiment of the present application, the camera module includes a motor and a prism. After the optical anti-shake function is turned on, the camera module can use the motor to push the prism to move in the X and Y directions to compensate for blur caused by external shake. For example, the camera module may be a periscope camera module. It should be understood that the above-mentioned camera module is only an example. In other embodiments, the camera module can also be other camera modules that implement optical anti-shake processing through prisms.

It can be seen from the above description of Figure 3 that the camera module can be placed on the vibration table during the calibration process. Among them, the vibration table can vibrate or remain stationary under control. When the vibrating table is in a vibrating state, the camera module will be affected by the vibration of the vibrating table and vibrate. When the vibrating table remains stationary, it is deemed that the camera module also remains stationary, that is, the camera module is not affected by external jitter.

In some embodiments, the second instruction may include a preset value, which is used to instruct the gain of the motor of the camera module to be adjusted to the preset value. The preset value may include one or more.

When the second command includes carrying a preset value, the personal computer can send the second command to the camera module multiple times. Different second commands include different preset values, so that the camera module adjusts the gain of the motor to different values. numerical value. In some embodiments, the interval between the preset values corresponding to two adjacent second instructions sent by the personal computer may be the same.

In some embodiments, the preset values carried in the second instruction sent by the personal computer to the camera module in chronological order may be arranged in order of size. For example, when the personal computer sends the second command to the camera module for the first time, the preset value carried by the second command is 0. When the personal computer sends the second command to the camera module for the second time, the preset value carried by the second command may be 0.2. When the personal computer sends the second command to the camera module for the third time, the preset value carried by the second command may be 0.5; and so on.

Furthermore, the preset value carried in the second instruction sent by the personal computer to the camera module in chronological order may increase or decrease in a preset step starting from the initial value. Taking the preset step size as 0.1 as an example, when the personal computer sends the second command to the camera module, it sequentially increments (or decrements) the preset value carried in the last second command with the preset step size to obtain this time. The default value corresponding to the second command. Among them, the initial value and preset step size can be set according to the actual situation. In some embodiments, the initial value can be set to 0, and the preset value starts from 0 and increases. Or, in other embodiments, the initial value can be set to a value greater than 0, and the preset value decreases from the initial value.

For example, when the personal computer sends the second command to the camera module for the first time, the preset value carried by the second command is 0. When the personal computer sends the second command to the camera module for the second time, the preset value carried by the second command may be 0.1. When the personal computer sends the second command to the camera module for the third time, the preset value carried by the second command may be 0.2; and so on. It should be understood that the above-mentioned preset step size is only an example, and in other embodiments, the preset step size can be set to other values.

In some embodiments, the preset step size can be adjusted according to actual conditions. For example, when the personal computer sends the second command to the camera module within a period of time, it sequentially increases the preset value with a preset step size of 0.1. When the personal computer sends a second command to the camera module in another period of time, the preset value is sequentially increased with a preset step of 0.5.

When the second command carries multiple preset values, the personal computer sends the second command to the camera module once to instruct the camera module to respectively control the gain of the motor to adjust to different preset values based on the second command.

In other embodiments, the second instruction may also include gain adjustment rules. In some embodiments, the second instruction is used to instruct the gain of the motor to increase in a preset step size starting from an initial value. The preset step size is set according to actual conditions, and is not limited in the embodiments of this application.

Before performing OIS calibration on the camera module to be calibrated, the OIS function of the camera module needs to be turned on. In some embodiments, the camera module can enable the OIS function in response to the second instruction. In this embodiment, the second instruction can also be used to instruct the camera module to enable the OIS function. In other embodiments, the OIS function of the camera module can also be turned on manually; that is, before the above S403, the relevant personnel manually turns on the OIS function of the camera module to be calibrated.

It should be understood that S403 can also represent the camera module receiving the second instruction from the personal computer.

S404. In response to the second command, the camera module controls the gain of the motor of the camera module to adjust to a preset value.

It can be seen from the description of the above embodiments that the second command can carry a preset value. In this embodiment, when the camera module receives the second command sent by the personal computer, it controls the motor of the camera module to adjust to the preset value in the second command. When receiving a new second command sent by the personal computer, the motor of the camera module is controlled to adjust to a preset value corresponding to the new second command. For example, after receiving the second instruction, the camera module determines that the preset value corresponding to the second instruction is 0.1, adjusts the motor to 0.1 in response to the second instruction, and then performs image acquisition. After the camera module receives the new second command, the preset value corresponding to the new second command is 0.2, in response to the new second command, the gain of the motor is adjusted to 0.2, and then image acquisition is performed; and so on.

In other embodiments, the second instruction may carry multiple preset values. In this embodiment, after receiving the second command, the camera module analyzes and obtains a plurality of preset values corresponding to the second command. In response to the second instruction, the camera module first adjusts the gain of the motor to one of the preset values, and then collects images. Then adjust the gain of the motor to another preset value and perform image acquisition; and so on. Among them, when the second command carries the adjustment rule of the gain, the camera module can adjust the gain of the motor to a value each time according to the adjustment rule and collect images, then adjust it to the next value, and then collect new images; in this way, analogy.

S405. The camera module collects corresponding images of the first preset calibration plate.

Before OIS calibration is performed on the camera module to be calibrated, it is not clear what value should be set for the motor gain of the camera module to achieve the best optical anti-shake effect of the camera module. Therefore, in the embodiment of the present application, when the gain of the motor is set to different values, the optical anti-shake effect of the images captured by the camera module can be evaluated respectively. When the optical anti-shake effect of the image captured by the camera module is the best, the corresponding motor gain value is the optimal gain value of the motor. In images with image rotation, the optical anti-shake effect is inconsistent at different positions in the image. Therefore, in order to meet the needs of users, the optical anti-shake effect can be best at the position of the image center of the image captured by the camera module. When , the corresponding motor gain value is determined as the optimal gain value of the motor.

In some embodiments, the first preset calibration plate includes at least one feature point. For example, the first preset calibration plate may include one feature point, or may include two or more feature points. It can be seen from the above description that the first preset calibration plate is within the shooting range of the camera module. Therefore, in the image collected by the camera module of the first preset calibration plate, the feature points in the first preset calibration plate can be collected. image.

Further, in one embodiment, the shape of the feature points included in the first preset calibration plate may be any shape, such as square, triangle, cross shape, circle, etc.

When the first preset calibration plate includes more than two feature points, in some embodiments, the multiple feature points in the first preset calibration plate may be arranged periodically, and the shape and size of the multiple feature points are uniform. are the same, and the intervals between adjacent feature points are the same. Among them, the interval between adjacent feature points, as well as the shape and size of a single feature point can be set according to the actual situation.

Taking the shape of the feature point as a circle as an example, FIG. 5 is a schematic diagram of the first preset calibration plate in some embodiments. A plurality of circular feature points of the same size are periodically arranged in the first preset calibration plate; the intervals between adjacent circular feature points are the same. In other embodiments, the color of the feature points in the first preset calibration plate can also be any color.

In some embodiments, the first preset calibration plate includes a plurality of circular feature points. From the above description, it can be seen that after the OIS function is turned on by the camera module, the images collected may have image rotation problems. If the shape of the feature point is such as a square, triangle, etc., then at the location of the jitter center (i.e., image rotation center), the center position of the feature point may not move with external jitter (vibration), but there may also be rotation caused by movement, resulting in blur. As shown in Figure 6, taking the position corresponding to 601 in the figure as the jitter center of the image as an example, the square feature point 602 still has blur caused by rotating with the jitter center as the origin, and other feature points other than the jitter center (such as feature Point 603, feature point 604) The blur amount produced by rotating with the shaking center as the origin is relatively larger than the blur amount of feature point 602. Among them, the blur amount of the feature point is used to represent the blur degree of the feature point. The larger the blur amount, the greater the blur degree of the feature point, which can reflect the greater jitter of the feature point.

And if the feature point is a circle, then at the center of the image rotation, even if the circular feature point rotates, it is relatively easy to find a smaller point of the circular feature point in the picture, which makes it easier to locate the jitter center.

In some embodiments, the spacing between adjacent feature points in the first preset calibration plate and the size of a single feature point can be set in combination with the parameters of the camera module to be calibrated. For example, the parameters of the camera module can be determined including the optical front focal length (Front Focal Length, EFL), Field of View (FOV), and vibration angle of the camera module.

As a possible implementation method, the feature points in the calibration plate can be adjusted based on the parameters of the camera module. In some embodiments, in order to reduce test errors, when the FOV of the camera module to be calibrated increases, when the first preset calibration plate is set, the diameter of the circular feature points can be relatively increased. The larger the FOV, the wider the area that the camera module can cover when collecting images. Therefore, when the diameter of the circular feature points is larger, it is beneficial to analyze the collected images. On the contrary, if the FOV is smaller, the diameter of the circular feature points in the first preset calibration plate can be set smaller.

In other embodiments, when the vibration angle of the camera module increases, when setting the first preset calibration plate, the diameter of the circular feature points can be relatively reduced; conversely, the smaller the vibration angle, the smaller the diameter of the first preset calibration plate. The diameter of the circular feature points set in the preset calibration plate can be relatively increased. As the vibration angle increases, in the images collected by the camera module, the motion trajectories of adjacent feature points may overlap, and the blurred parts may overlap. This is not conducive to analyzing the jitter effect based on circular feature points in the image. Therefore, in order to enable the camera module to collect the motion trajectories of more circular feature points, the diameter of the feature points can be reduced, thereby reducing the problem of overlapping motion trajectories of different feature points due to too large vibration angles, and improving the accuracy of OIS calibration. Accuracy.

In some embodiments, the number of images collected by the camera module at different motor gains is recorded as N. Based on the description of the above embodiments, it can be seen that the N images are collected when the motor of the camera module is set to different gains. The value of N can be set in advance, or it can be determined by a personal computer after analyzing the effect of optical anti-shake based on the image collected by the camera module.

It can be seen from the description of the above embodiments that the second command may only carry a preset value. In this embodiment, after receiving different second instructions, the camera module can respectively control the gain of the motor to adjust to a preset value corresponding to each second instruction, and after adjusting the gain of the motor, adjust the first preset value. Set up the calibration plate to collect images.

In other embodiments, the second instruction may carry multiple preset values. In this embodiment, after receiving the second instruction, the camera module can control the gain of the motor to adjust to different preset values, and collect images from the first preset calibration plate when the motor is set to different gains. The second command carries N preset values.

In other embodiments, the second instruction may carry a gain adjustment rule. In this embodiment, the camera module can adjust the gain of the motor according to the adjustment rules, and collect images of the first preset calibration plate when the motor is set to gain. In some embodiments, the camera module collects N images cumulatively.

It should be understood that the above-mentioned S404 and S405 are operations performed by the camera module after receiving the second instruction. If the second command carries a preset value, the personal computer sends the second command to the camera module once, and the camera module executes S404 and S405 in sequence.

If the second command carries multiple preset values, then the personal computer sends a second command to the camera module. Then in S404, the camera module can adjust the gain of the motor to one of the preset values in response to the second command. , execute S405, that is, collect images of the first preset calibration plate. Then return to S404, the camera module adjusts the gain of the motor to another preset value, and then executes S405 to collect a new image of the first preset calibration plate. And so on until all the preset values in the second command are traversed.

Similarly, if the second instruction carries the adjustment rule of the motor gain, then when S404 is executed for the first time, the camera module can first set the gain of the motor to the initial value in response to the second instruction, and then execute S405 to adjust the first predetermined value. Set up the calibration plate to collect images. Then return to S404, the camera module adjusts the gain of the motor based on the adjustment rule in the second instruction, and then executes S405 to collect a new image of the first preset calibration plate; and so on.

Among them, the camera module can collect images of the first preset calibration plate through manual operation; for example, relevant personnel manually trigger the image acquisition operation of the camera module. Alternatively, the camera module may also respond to the second instruction and automatically perform an image acquisition operation on the first preset calibration plate after the gain of the motor is adjusted to a preset value.

It should be understood that in the embodiment where the camera module automatically performs the image acquisition operation, the second instruction is also used to instruct the camera module to collect images of the first preset calibration plate after the gain of the motor is adjusted to a preset value. In this embodiment, the camera module may control the camera module to collect images of the first preset calibration plate after controlling the gain of the adjustment motor to a preset value in response to the second instruction.

When the second command includes multiple preset values, the camera module collects an image of the first preset calibration plate once when the control motor is set to different preset values. Similarly, in this embodiment, the camera module collects images of the first preset calibration plate, which can be manually operated or automatically performed after the gain of the motor is adjusted to different preset values.

Combining the above S401-S404, it can be seen that when the camera module performs S405 to collect images, the camera module is in a vibrating state, and the optical anti-shake (OIS) function of the camera module is turned on. In some embodiments, this shooting state is noted as the first shooting state.

S406. The camera module sends the image to the personal computer.

It can be seen from the description in the above embodiments that the second command may carry a preset value. In this embodiment, after the camera module executes the above S405, the camera module can send an image collected this time to the personal computer. Afterwards, if the camera module receives a new second command sent by the personal computer, it will sequentially execute S404-S406 in response to the new second command; and so on.

In other embodiments, the second instruction may carry a plurality of preset values, or the second instruction may carry an adjustment rule for the motor gain. In some embodiments, when executing the above S404 and S405, the camera module first adjusts the gain of the motor to one of the preset values. After collecting the image of the first preset calibration plate, the camera module can first execute S406 to collect the image. Send to PC. In other embodiments, when implementing the above S404 and S405, the camera module can collect images of the first preset calibration plate when the motors are adjusted to different preset values, that is, images corresponding to different motor gains are obtained. After that, execute S406 again. That is, the above-mentioned S406 specifically includes: the camera module sends multiple images collected when the motor is set to different gain values to the personal computer.

In other embodiments in which the second command carries multiple preset values, or the second command carries an adjustment rule for the motor gain, the above S406 may also set a preset number. When the images collected by the camera module reach the preset number, the camera module executes S406. For example, after every five images collected, the camera module sends the five images to the personal computer, then continues to collect five new images, and then sends the new five images to the personal computer; and so on.

It should be understood that the above S406 also represents the personal computer receiving the image sent by the camera module.

S407. The personal computer obtains the jitter of the feature points in the image.

In some embodiments, the first preset calibration plate includes a feature point. In this embodiment, the above-mentioned S407 specifically includes obtaining the jitter condition of the feature point.

In other embodiments, the first preset calibration plate includes a plurality of feature points. In this embodiment, the above-mentioned S407 specifically includes obtaining the jitter conditions of one or more feature points in the first preset calibration plate.

S408. The personal computer determines the jitter center of the image based on the jitter of the feature points in the image.

Among them, the jitter center is used to indicate the position in the image where the jitter is minimal. It can be seen from the description of the above embodiments that after the OIS function of the camera module that performs OIS processing in the X and Y directions of the prism is turned on, the image collected by the camera module may have an image rotation problem when the outside world is shaken. Image rotation means that the image is rotated around an origin. Therefore, there may be an image rotation problem in the images collected according to the above S401-S405. That is to say, in each image collected by the above-mentioned camera module, there may be an origin of image rotation. In the embodiment of this application, the origin is recorded as the jitter center. It can be understood that the location of the jitter center is the location with the smallest jitter in the image. It should be understood that in other embodiments, the jitter center can also be named by other names such as a rotation center.

In some embodiments, the first preset calibration plate includes a feature point. In this embodiment, the jitter situation of the feature point is analyzed to determine the location of the jitter center of the image.

In other embodiments, the camera module collects images from a first preset calibration plate including multiple feature points. Therefore, in the embodiment of the present application, the jitter can be determined based on the jitter of each feature point in the image. center.

In the same image, feature points near locations with larger jitter will have a larger amount of blur; conversely, feature points near locations with smaller jitter will have a smaller amount of blur. Therefore, in some embodiments, after acquiring the image collected by the camera module, the jitter center of the image can be determined by determining the position with the smallest amount of blur in the image.

In other embodiments, the original image collected by the camera module can also be processed to a certain extent, and the feature points and the fuzzy parts of the feature points can be converted into feature objects, and then the size of the feature objects can be determined to analyze the feature points. Jitter situation. Since the feature object includes a feature point and a fuzzy part of the feature point, a feature point with a larger amount of blur corresponds to a larger feature object. On the contrary, the smaller the blur amount, the smaller the corresponding feature object. Therefore, the above-mentioned S408 may specifically include: processing the image, converting a feature point in the image and the blur amount corresponding to the feature point into a feature object; determining the jitter of the corresponding image based on the size of the feature object in the image obtained after filtering. center.

In some embodiments, as shown in Figure 7, the above-mentioned S408 includes S701-S703, wherein:

S701. Perform filtering on the image to obtain the filtered image.

In some embodiments, the above-mentioned S701 may specifically include: performing binarization processing on the image to obtain a binarized image, that is, the above-mentioned filtered image. Image Binarization is to set the grayscale value of the pixels on the image to 0 or 255, which is the process of making the entire image show an obvious black and white effect.

In some embodiments, the post-filtering image includes at least one feature object corresponding to at least one feature point, and each feature object includes a corresponding feature point and a blurred part of the corresponding feature point. By analyzing the size of the feature objects in each filtered image, the location of the jitter center in the image corresponding to each filtered image can be determined.

After binarizing the original image collected by the camera module, the feature points and the blurred part corresponding to the feature point can be converted into an overall feature object, and then the blur corresponding to the feature point can be judged based on the size of the feature object. quantity. Then the feature point with the smallest amount of blur can be found through the size of the feature object. Finally, the position of the jitter center of the corresponding image can be determined based on the position with the smallest amount of blur.

In other embodiments, the filtering process in the above S701 can also be implemented in other ways, as long as it is ensured that in the image obtained by the filtering process, the feature points in the original image and the blurred parts corresponding to the feature points can be converted into an overall feature object. That’s it.

S702. Find the smallest feature object among at least one feature object in the filtered image.

It can be seen from the description of the above embodiments that the feature objects in the filtered image represent feature points and the blurred parts corresponding to the feature points. The larger the amount of jitter, the larger the motion trajectory of the feature points, the more blurred parts in the collected image, and the larger the corresponding feature object in the filtered image. On the contrary, the smaller the amount of jitter, the smaller the motion trajectory of the feature points, the fewer blurred parts in the collected image, and the smaller the feature object in the corresponding filtered image. The feature point corresponding to the smallest feature object is the feature point with the smallest amount of jitter in the image, and it is also the feature point with the smallest amount of blur. Therefore, after finding the minimum feature object in the filtered image, the position of the jitter center of the corresponding image can be determined based on the minimum feature object.

In some embodiments, the above-mentioned S702 may specifically find the smallest feature object by comparing the sizes of feature objects in the same filtered image. For example, if a certain feature object A is found in the filtered image, and for this feature object A, the sizes of other surrounding feature objects are greater than or equal to the size of feature object A, then it can be determined that feature object A is the smallest feature object. The size of the feature object may specifically be the length or area of the feature object, etc.

If the personal computer obtains N images and then determines the jitter center for the N images respectively, the above-mentioned S702 may specifically include: searching for the smallest characteristic object among at least one characteristic object in each filtered image of the N filtered images. .

S703. Based on the minimum feature object, determine the location of the jitter center in the image corresponding to the filtered image.

In images corresponding to different motor gains, the location of the jitter center of the image may be different. In some embodiments, the jitter center of the image may be outside the image, or the jitter center of the image may be within the image.

In some embodiments, the above-mentioned S703 may specifically include: in the target filtered image, if the smallest feature object is at the edge of the target filtered image, and the size of the smallest feature object exceeds the second preset threshold, determine that the jitter center is at the target Other than the image corresponding to the filtered image.

Among them, the target filtered image is any filtered image among the N filtered images.

Since the jitter center of the image is the position with the smallest jitter (blur amount), if the jitter center is within the image, then the blur amount of the feature points near the jitter center is small. At this time, the feature points and the feature objects corresponding to the feature points should be close in size. Therefore, in some embodiments, the size of the characteristic object can be judged by setting a second preset threshold to determine whether the jitter center of the image is within the image. Wherein, the second preset threshold is used to measure the size of the feature object. The second preset threshold can be set according to the size of the feature points in the image collected by the first preset calibration plate when the camera module has no jitter (vibration). For example, the second preset threshold can be set to 1.2 times or other multiples of the size of the feature points in the image captured by the camera module when there is no shaking.

If the size of the smallest feature object found in the target filtered image is at the edge of the target filtered image, and the size of this smallest feature object exceeds the second preset threshold, then it can be considered that the jitter center of the image corresponding to the target filtered image does not Appears within the image corresponding to the standard filtered image. In some embodiments, since the goal of OIS calibration is to find a position as close as possible to the center of the jitter and the center of the image, there is no need to determine the specific position of the jitter center of the image when it is determined that the jitter center is not within the image.

In other embodiments, if in the target filtered image, the smallest feature object found is not at the edge of the target filtered image, or the size of the smallest feature object in the target filtered image does not exceed the second preset threshold, Then the location of the jitter center is determined based on the position of the minimum feature object in the target filtered image.

It can be seen from the description of the above embodiment that if the smallest feature object appears at the edge of the filtered image and the size exceeds the second preset threshold, it is determined that the jitter center is outside the image corresponding to the filtered image. On the contrary, if the minimum feature object is at the edge of the filtered image but the size of the minimum feature object does not exceed the second preset threshold, or the minimum feature object is not at the edge of the filtered image, then it can be determined that the jitter center is at this time Within the image corresponding to the filtered image. After that, the location of the jitter center is determined based on the location of the smallest feature object.

In some embodiments, the first preset calibration plate has multiple feature points, and the feature points are arranged periodically, and there may be a certain interval between the feature points. In some images, the jitter center may be exactly at the center of a feature point (feature object). At this time, the center position corresponding to the smallest feature object in the image can be directly obtained. In some embodiments, determining the location of the jitter center based on the location of the minimum feature object in the target filtered image may specifically include: if the minimum feature object includes one feature object, then determining the location of the center of the minimum feature object as The location of the jitter center.

In another part of the image, the location of the jitter center may be in the interval between feature points. In the image in this embodiment, there may be multiple feature objects of the same size. At this time, the location of the jitter center of the image can be fitted based on the locations of multiple minimum feature objects. In some embodiments, determining the location of the jitter center based on the position of the minimum feature object in the target filtered image may specifically include: if the minimum feature object includes more than two feature objects, based on the location of the minimum feature object, Fit the location of the jitter center.

For example, if the filtered image includes four minimum feature objects of the same size, the position of the jitter center can be determined as the center position of the area composed of the four minimum feature objects. In other embodiments, based on the locations of two or more minimum feature objects, the location of the jitter center of the fitted image can also be implemented in any other manner, which is not limited in this application.

In the technical solution provided by the embodiments of this application, finding the location of the jitter center based on the number of minimum feature objects can help quickly and effectively find the location of the jitter center.

As shown in a, b and c in Figure 8, schematic diagrams of filtered images in some embodiments are shown. Among them, 801, 802 and 803 respectively represent different characteristic objects. As shown in a in Figure 8, the personal computer can find that the smallest feature object in the filtered image is at the edge of the image, and the size of the smallest feature object exceeds the second preset threshold, then it is determined that the jitter center is in the target filtered image corresponding to In addition to the image, for example, the jitter center of a in Figure 8 can be at the position shown as 801. As shown in b in Figure 8, after finding that the smallest feature object in the filtered image is not at the edge of the filtered image, it is determined that the jitter center is within the image. Then the location of the jitter center can be determined based on the minimum feature object in b in Figure 8 (shown as 802 in the figure). In other embodiments, when the smallest feature object is found to be at the edge of the image but the size of the smallest feature object (shown as 803 in the figure) does not exceed the second preset threshold, it can be determined that the jitter center of the image is within the image. As shown in c in Figure 8, the smallest feature object in the filtered image is in the center of the image, which means that the jitter center of the corresponding image in the filtered image is in the center of the image.

In the technical solution provided by the embodiment of the present application, a second preset threshold is set to distinguish whether the jitter center is within the image. When it is determined that the jitter center is outside the image, the gain of the motor needs to be continuously adjusted to move the jitter center within the image. After confirming that the jitter center is within the image, adjust the motor gain so that the jitter center of the image can move to the center of the image. In this way, the optimal gain value of the motor can be easily determined. Since the original image collected by the camera module is filtered, the shaking center position can be determined directly by comparing the size of the characteristic object. There is no need to calculate the fuzzy amount of feature points, which can reduce the calculation amount during the calibration process and improve the efficiency of OIS calibration.

S409. The personal computer determines the target image whose distance between the jitter center and the image center satisfies the preset condition.

In some embodiments, the preset condition is used to indicate that the distance between the jitter center of the image and the center of the image is the smallest among different collected images, and the distance is smaller than the first preset threshold. It should be understood that due to differences in the production of motors, it may happen that no matter how the gain of the motor is adjusted, the jitter center and the image center cannot be completely coincident. Therefore, in the embodiment of the present application, as long as the distance between the jitter center and the image center is found to be less than a certain value and is the smallest distance between the jitter center and the image center in all images, the image can be corresponding to The motor gain is determined as the optimal gain value of the motor. In this embodiment of the present application, images that meet preset conditions are recorded as target images.

In some embodiments, after acquiring the N images collected by the camera module, the personal computer may perform S408 on the N images respectively, that is, determine the jitter center of each image. In this embodiment, the above-mentioned S409 may specifically include: the personal computer searches the N images for a target image whose distance between the jitter center and the image center satisfies the preset condition.

Further, the personal computer searches the N images for a target image whose distance between the jitter center and the image center satisfies the preset condition. Specifically, the personal computer determines the distance between the jitter center and the image center of each image. Whether the preset conditions are met.

In other embodiments, the personal computer may also execute S407 and S408 after each image acquired by the camera module to find the jitter center of the image. In this embodiment, as shown in Figure 9, the above-mentioned S409 may specifically include S901 and S902:

S901. The personal computer determines whether the distance between the jitter center of the current image and the image center meets the preset conditions.

In this embodiment, the preset condition is used to indicate that the distance between the jitter center of the current image and the image center is the smallest among all acquired images, and the distance is smaller than the first preset threshold. If the distance between the jitter center of the current image and the image center meets the preset conditions, it means that the current image is the target image.

S902. The personal computer determines the current image as the target image.

In other embodiments, when the second instruction carries the adjustment rule for the gain of the motor, when the camera module controls the gain of the motor to be adjusted to different preset values in order of magnitude, the personal computer obtains the information sent by the camera module every time. In the embodiment where S407 is performed after an image, if it is determined in S409 that the distance between the jitter center of the current image and the image center satisfies the preset condition, then the calibrated gain value of the motor can be determined directly based on the current image. That is, if the distance between the jitter center of the current image and the image center meets the preset conditions, the camera module does not need to continue to collect new images.

In some embodiments, after determining that the distance between the jitter center of the current image and the image center satisfies the preset condition, the above method further includes: the personal computer can stop acquiring the images collected by the camera module, and the camera module does not need to continue. Acquire images using setting other motor gain values.

In the embodiment where the second command includes a preset value, the personal computer may stop sending the second command to the camera module. In an embodiment in which the second instruction includes a plurality of preset values or the second instruction includes an adjustment rule for the motor gain, after it is determined in S409 that the distance between the jitter center of the current image and the image center satisfies the preset condition, the personal computer may Send a third command to the camera module. The third instruction may be used to instruct the camera module to stop adjusting the gain of the motor and stop collecting images of the first preset calibration plate.

It should be understood that after S901 in the above example, if it is determined that the distance between the jitter center of the current image and the image center does not meet the preset conditions, you can return to S403, execute S403-S408 in sequence, re-acquire a new image and analyze whether it meets the preset conditions. Preset conditions.

In the technical solution provided by the embodiment of this application, if the gain of the motor of the camera module is adjusted in order of size during the calibration process, then when the jitter center of an image and the image center are found to meet the preset conditions, it can be controlled The camera module stops collecting new images. In this way, unnecessary image acquisition can be reduced. At the same time, the personal computer no longer needs to search for the jitter center of the images collected later and determine the distance between the jitter center and the image center. Therefore, the time of OIS calibration can be reduced and the efficiency of OIS calibration can be improved.

S410. The personal computer obtains the target gain corresponding to the motor when collecting the target image, and determines the target gain as the calibrated gain value of the motor.

It can be seen from the description of the above embodiment that if the distance between the shake center and the image center is found to meet the preset conditions, it means that in this image, the anti-shake effect of the image center or a position closer to the image center is the entire image. The best in images. Therefore, the gain (target gain) of the motor corresponding to this image can be determined as the calibrated gain value of the motor, so that when the motor is set to the calibrated gain, the optical anti-shake effect at the center of the image (center of the lens screen) is ensured to be optimal. good.

In the technical solution provided by the embodiment of the present application, by analyzing the images collected by the camera module at different motor gains, the location of the jitter center is found in each image, and based on the distance between the jitter center and the image center Find the target image by checking whether the distance is less than a certain value and the distance is the smallest among N images. Then, the gain value of the motor used to collect the target image is determined as the calibrated gain value of the motor. In this way, it is possible to ensure that the position targeted by the OIS calibration is the center of the image or a position closer to the center of the image, that is, where the center of the camera module is located, so that the position of the OIS calibration is as close as possible to the center of the image, thereby improving OIS calibration accuracy. At the same time, you only need to find the jitter centers of different images, and complete the OIS calibration when the jitter center is determined to be close to the image center. This can help quickly complete the OIS calibration process, reduce the time required for OIS calibration, and improve the efficiency of OIS calibration.

It can be seen from the description of the above embodiment that when the personal computer sends the second command to the camera module in S403, the preset value may be increased or decreased according to the preset step size. Taking the second command carrying a preset value as an example, the personal computer controls the preset value to increase or decrease according to the preset step when sending the second command to the camera module.

At the same time, combined with the description of Figure 8, it can be seen that when the camera module sets the gain of the motor to different values, the jitter center of the image may be outside the image or within the image. In this embodiment, the preset value starts from 0 and increases. Combined with the process shown in Figure 9, the personal computer sends a second command to the camera module, receives the image collected by the camera module and analyzes: if the distance between the image center of the current image and the jitter center does not meet the preset conditions. Then the personal computer sends a new second command to the camera module, and then receives the new image sent by the camera module for analysis.

Since the specific location of the jitter center cannot be determined when the jitter center is outside the image, when the personal computer sends the second command to the camera module for the first time, the preset value can be incremented by the first preset step. As the preset value (motor gain) increases, the jitter center in the images captured by the camera module will move accordingly. When the jitter center appears within the image, the specific location of the jitter center can be determined. Among them, the first preset step size can be set according to the actual situation.

After the jitter center begins to appear within the image, the distance between the position of the jitter center in the two images and the difference in gain of the motor corresponding to the two images can be combined to determine the gain value of the motor and the jitter center. The relationship between changes, or sensitivity. Then based on the determined change correlation, the gain value of the motor is controlled and adjusted to quickly move the jitter center of the image to the center of the image. This reduces the number of times and time required for calibration and improves calibration efficiency.

In some embodiments, the preset value carried by the second command in S403 gradually increases from 0, and the camera module in S405 respectively collects corresponding images when adjusting the gain of the motor to different preset values. Correspondingly, in the above S406, the personal computer can obtain the images collected by the camera module at different motor gains.

In some embodiments, the above S406 includes: acquiring the first image collected by the camera module when the gain of the motor is set to the first gain; the first gain is greater than or equal to 0. Then the personal computer executes S407 and S408. If it is determined that the jitter center of the first image is outside the first image, the gain of the motor is obtained by incrementing or decrementing the first gain with a first preset step size.

In other embodiments, while the gain of the motor is increasing or decreasing from the initial value, the second image collected by the camera module when the gain of the motor is set to the second gain is acquired; if the jitter center of the second image is at within the second image, then increase or decrease the second preset step size on the basis of the second gain to obtain the third gain, and obtain the third image collected by the camera module; based on the jitter center of the second image and the jitter of the third image The moving distance of the center and the second preset step size determine the target step size; increase or decrease the target step size on the basis of the third gain to obtain the fourth gain, and obtain the camera module when the gain of the motor is set to the fourth gain. The fourth image collected.

The second preset step size and the first preset step size may be set to be the same or different. In the embodiment of the present application, after the personal computer determines that the jitter center begins to appear in the image, the motor gain can be adjusted only once; that is, the second gain is adjusted to obtain the third gain. Then, the third image collected by the camera module when the motor is set to the third gain is analyzed to determine the jitter center position of the third image. Then determine the distance moved by the jitter center position of the third image compared to the jitter center position of the second image. Combining the difference between the third gain and the second gain, that is, the second preset step size, the correlation between the change in gain and the change in the jitter center can be determined. After that, combined with the distance between the position of the jitter center of the third image and the image center, and the correlation between the change in gain and the change in the jitter center, it is determined that on the basis of the third image, the jitter center moves to the image The adjustment value of the gain that needs to be adjusted in the center is the above target step size.

Finally, the personal computer can send the target step size to the camera module, instructing the camera module to control the motor to adjust according to the target step size based on the third gain to obtain the fourth gain. At this time, the camera module collects the fourth image of the first preset calibration plate. According to the above relationship, the jitter center of the fourth image almost overlaps with the image center, that is, the distance between the jitter center and the image center meets the preset condition. Afterwards, the camera module sends the fourth image to the personal computer, and the personal computer sequentially executes S408 and S409 on the fourth image, and will obtain that the distance between the jitter center of the fourth image and the image center satisfies the preset condition. Then, in S410, the personal computer can directly determine the fourth image as the target image. This reduces the number of times required for calibration and improves the efficiency of OIS calibration.

It should be understood that the jitter centers of the above-mentioned second image and the third image are respectively within the respective images, but not at the center of the image.

In the technical solution provided by the embodiment of the present application, during the calibration process of optical anti-shake, the gain of the control motor is increased or decreased sequentially, which can cause the position of the jitter center in different images to change in one direction, which facilitates rapid finding. Images where the jitter center is close to the center of the image. This can improve the speed of OIS calibration.

After the above S410, that is, after the target image is found, the target image is the image that can achieve the best OIS effect of the camera module. The amount of blur where the jitter center of the target image is located can be determined to be almost zero. If the jitter center is at the center of a feature point, the blur amount of the feature point is almost zero. If the jitter center does not completely coincide with the center position of any feature point, then the blur amount of the feature points closer to the jitter center will also be smaller. After finding the feature point with the smallest blur amount in the target image, the blur amount of the feature point with the smallest blur amount can be used to evaluate the performance of the motor. In some embodiments, the performance of the motor can be evaluated by calculating the compression ratio.

In some embodiments, after the above S410, as shown in Figure 10, the above method also includes S1000-S1006, wherein:

S1000. In the second shooting state, the camera module collects the fifth image of the first preset calibration plate.

The second shooting state includes a shooting state in which the camera module is in a vibrating state and the OIS function is turned off, which is recorded as the second shooting state.

In some embodiments, the camera module can turn off the OIS function of the camera module in response to instructions from the personal computer. In this embodiment, before the above-mentioned S1000, it also includes: the personal computer sends a fourth instruction to the camera module, and the fourth instruction is used to control the camera module to turn off the OIS function. In other embodiments, the OIS function of the camera module can also be manually turned off by relevant personnel.

In some embodiments, when the camera module in S1000 collects images, the test equipment still controls the vibration table to vibrate with preset vibration parameters, thereby driving the camera module to vibrate.

S1001. The camera module sends the fifth image to the personal computer.

S1002. The personal computer sends the fifth command to test preparation.

S1003. The test equipment responds to the fifth command and controls the vibration table to stop vibrating.

Among them, the fifth instruction is used to instruct the test equipment to control the vibration table to stop vibrating, so that the camera module can maintain a stable state to collect the sixth image. It should be understood that in other embodiments, the vibration of the vibration table can also be manually turned off by relevant personnel.

S1004. In the third shooting state, the camera module collects the sixth image of the first preset calibration plate.

Among them, in the third shooting state, the camera module remains stable.

S1005. The camera module sends the sixth image to the personal computer.

S1006. The personal computer determines the compression ratio based on the blur amount of the feature points in the target image, the fifth image, and the sixth image.

In one embodiment, the compression ratio refers to the compression ratio of the image, and the compression ratio can be used to indicate the performance of the motor. It can be seen from the description of the above embodiments that the jitter in the target image has been minimized, and the blur amount of the feature points in the target image has been minimized. So for the feature points in the target image, the blur caused by external vibration has been offset by the compensation of the motor and can be almost ignored. If there is still blur in the target image, the blur may be due to the inability of the motor to completely compensate for the offset. Therefore, when the external vibration is the same, by combining the target image (OIS on) and the image collected when OIS is off, the compression ratio can be calculated and used to evaluate the performance of the motor.

In some embodiments, the above-mentioned S1004 may specifically include: obtaining the blur amounts corresponding to the target feature points in the first preset calibration plate in the target image, the fifth image, and the sixth image respectively. The compression ratio is calculated based on the blur amounts corresponding to the target feature points in the target image, the fifth image, and the sixth image. Among them, the target feature point can be any one or multiple feature points in the target image. In some embodiments, the target feature point may be a feature point with minimal jitter in the target image.

In some embodiments, the target feature point may be the location of the jitter center in the target image, such as the feature point corresponding to the location shown as 803 in Figure 8 . In other embodiments, if the jitter center of the target image does not coincide with any feature point in the first preset calibration plate, then the feature point closest to the jitter center in the target image can be used as the target feature point.

After selecting the target feature point, find the target feature point in the target image, the fifth image, and the sixth image respectively, and obtain the blur amounts in the target image, the fifth image, and the sixth image respectively. The compression ratio is then determined based on the three blur amounts.

The specific implementation method of obtaining the blur amount of the feature points in the image can refer to the description in the related art, and will not be described again in the embodiment of the present application.

In some embodiments, the compression ratio is calculated based on the blur amount corresponding to the target feature point in the target image, the fifth image, and the sixth image. Specifically, the compression ratio can be implemented through the following formula:

CR=-20Log10 ((OIS on-Still)/(OIS off- Still));

Among them, CR (Compression Ratio) represents the compression ratio, OIS on represents the blur amount corresponding to the target feature point in the target image, OIS off represents the blur amount corresponding to the target feature point in the fifth image, and Still represents the target feature point in the sixth image. The corresponding amount of blur in the image.

In an embodiment where there are multiple target feature points, the corresponding compression ratio can be calculated using the above formula for each target feature point. Then, the average compression ratio corresponding to different target feature points is calculated as the compression ratio used to evaluate the motor performance.

In the embodiment of the present application, the blur amount of the target feature point in the image collected when the camera module is in a vibrating state and the OIS function is turned on, and the target feature point in the image collected when the camera module is in a vibrating state and the OIS function is turned off. The blur amount is subtracted from the blur amount of the target feature points in the image collected by the camera module in a stable state, which can reduce the impact of other external factors on the compression ratio calculation.

In the technical solution provided by the embodiment of this application, after the gain of the motor is calibrated using the solution of S401-S410, when the motor of the camera module is set to the calibrated gain value, the compression ratio is calculated based on the blur amount of the feature points in the image. , to evaluate the performance of the motor. Since calibrating the motor through the above-mentioned S401-S410 scheme can obtain a more accurate calibration gain value, more accurate evaluation results can also be obtained by evaluating the performance of the motor under the state of the calibration gain value.

In some embodiments, the camera module in S405 above can use different parameters to collect images of the first preset calibration plate. In some embodiments, the parameters of the camera module include frame rate and exposure time. When the camera module collects images through low frame rate and long exposure time, the image formed by the collected feature points and the blurred parts of the feature points is relatively dense. Therefore, in this embodiment, when calculating the above compression ratio, for the target feature point and the blurred part of the target feature point, the area of the center motion trajectory of the target feature point can be used to represent the blur of the target feature point in the target image. quantity.

When the camera module collects images through high frame rates and low exposure times, the image formed by the collected feature points and the blurred parts of the feature points is relatively less dense. Therefore, in this embodiment, when calculating the above compression ratio, for the target feature point and the blurred part of the target feature point, the length of the center motion trajectory of the target feature point can be used to represent the blur amount of the target feature point in the target image. .

The embodiment of the present application also provides another optical anti-shake calibration method, which can use a single feature point calibration plate to achieve OIS calibration of, for example, a periscope camera module. From the above description, it can be seen that if a calibration plate with a single feature point is used to implement OIS calibration of a periscope camera module, when the image is lit, the single feature point is not necessarily in the center of the lens, resulting in the position targeted by the OIS calibration. It is not at the center of the screen, resulting in low calibration accuracy. In order to avoid this situation, in the embodiment of the present application, when the camera module lights up the screen, it first determines the position of a single feature point in the screen, and then performs center compensation on the position. Specifically, a single feature point can be moved to the center of the lens frame by adjusting the stroke of the motor. Then perform OIS calibration on the camera module to ensure that the position targeted by the OIS calibration process is the center of the lens screen of the camera module.

In some embodiments, as shown in Figure 11, the optical anti-shake calibration method provided by the embodiment of the present application may include S1101-S1113, where:

S1101. The camera module collects the calibration image of the second preset calibration plate.

Wherein, the second preset calibration plate includes at least one feature point.

In some embodiments, the second preset calibration plate includes a single feature point, and the single feature point in the second preset calibration plate can be set as the center position of the calibration plate. The shape of a single feature point in the second preset calibration plate can be any shape, such as a circle, a square, a triangle or a cross shape, etc. The size of a single feature point in the second preset calibration plate can be set according to actual conditions. It should be understood that when the second preset calibration plate is used to perform OIS calibration on the camera module, the second preset calibration plate is set within the viewing range of the camera module.

In some embodiments, the second preset calibration plate may also include multiple feature points.

The settings of the camera module can be referred to the settings in Figure 3.

In some embodiments, the camera module can collect images of the second preset calibration plate in response to instructions from the personal computer. In this embodiment, before the above-mentioned S1101, it also includes: the personal computer sends a sixth instruction to the camera module, and the sixth instruction is used to instruct the camera module to collect images. In other embodiments, the process of image collection by the camera module can also be manually triggered by relevant personnel.

S1102. The camera module sends the calibration image to the personal computer.

S1103. The personal computer obtains the first position of the preset feature point in the calibration image, and the distance between the first position and the image center of the calibration image.

If the second preset calibration plate includes a single feature point, the preset feature point is the single feature point. If the second preset calibration plate includes more than two feature points, the preset feature point can be any one of the feature points; the preset feature point can be specified in advance. In some embodiments, when the second preset calibration plate includes more than two feature points, the preset feature point may be a feature point provided at a central position in the second preset calibration plate. Similar to the first preset calibration plate in the above embodiment, the size, shape, color and spacing between the feature points of the second preset calibration plate can be set according to the actual situation. In the embodiment of the present application Species are not limited.

The preset feature point may be at the center of the calibration image in the calibration image, or may not be at the center of the image, for example, it may be at the position shown at 12, 13, 14 or 15 in Figure 1. The center of the image of the camera module is also the image center of the calibration image collected by the camera module. It should be understood that if the first position is at the image center of the calibration image, then the distance between the first position and the image center of the calibration image is 0.

S1104. Based on the distance between the first position and the image center of the calibration image, send a seventh instruction to the camera module.

Among them, the seventh instruction is used to instruct the camera module to adjust the stroke of the motor so that the preset feature point is at the center of the image of the camera module. The stroke of a motor indicates the range within which the motor can move. In some embodiments, the seventh instruction carries the target adjustment value of the motor stroke; the seventh instruction is used to instruct the camera module to adjust the motor stroke based on the target adjustment value.

In some embodiments, the above S1104 is executed when the preset feature point in the calibration image is not located in the center of the image. If the preset feature point in the calibration image is at the center of the image, there is no need to adjust the stroke of the motor.

In some embodiments, after obtaining the distance between the first position in the calibration image and the center of the image of the camera module, it is determined based on the distance how to adjust the stroke of the motor to move the preset feature point to the center of the image. The adjustment method for determining the motor stroke based on the distance may refer to the description of the related art, and will not be described again in the embodiment of the present application.

In some embodiments, when determining the target adjustment value of the motor stroke in S1104 above, the short side position of the Hall calibration (Hall cal) can be used for the up stroke, and the down stroke can be calculated through the code position. Among them, code represents the value that moves to a certain distance and the image becomes clear.

S1105. The camera module adjusts the stroke of the motor in response to the seventh command.

It should be understood that after the camera module adjusts the stroke of the motor in response to the seventh instruction, the preset feature point in the second preset calibration plate will appear in the center of the image of the camera module. Therefore, performing OIS calibration on the camera module after S1105 can avoid the problem of low OIS calibration accuracy caused by the preset feature point being outside the center of the screen. In other words, the second preset calibration plate can be used to perform OIS calibration on the camera module, and a more accurate calibration result can be obtained.

S1106. The personal computer sends the first instruction to the test device.

S1107. The camera module responds to the first instruction and controls the vibration table to vibrate with the preset vibration parameters.

S1108. The personal computer sends the second command to the camera module.

S1109. In response to the second instruction, the camera module controls the gain of the motor of the camera module to adjust to a preset value.

S1110. The camera module collects corresponding images of the second preset calibration plate.

S1111. The camera module sends images to the personal computer.

For the specific implementation process of S1106-S1111, please refer to the description of S401-S406 in the above embodiment.

S1112. The personal computer obtains the jitter condition of the preset feature points in the image.

It can be seen from the description of the above embodiments that the greater the jitter of the preset feature points, the greater the blur amount of the preset feature points in the image. Therefore, in some embodiments, the personal computer can calculate the blur amount of preset feature points in the image. The specific implementation method of calculating the blur amount of the feature points in the image can refer to the description in the related art, and will not be described again in the embodiment of the present application.

S1113. The personal computer determines the calibrated gain value of the motor based on the jitter of the preset feature points in the image corresponding to different motor gain values.

When the motor of the camera module is set to different values, the compensation effect for the blur caused by external vibration is inconsistent, so the jitter of a single feature point is also inconsistent. In the process of OIS calibration of the camera module, it is necessary to find the motor gain value that can achieve the best compensation effect. In other words, it is necessary to find the motor gain value that minimizes the jitter of the preset feature points. In other words, the smaller the blur amount of the preset feature points, the better the compensation effect.

Therefore, in some embodiments, the above-mentioned S1113 may specifically include: the personal computer searches for the image with the smallest amount of blur (i.e., the smallest jitter) of the preset feature points among multiple images, and obtains the motor gain corresponding to the image with the smallest amount of blur. value, and determine the motor gain value as the calibrated gain value of the camera module.

As shown in Figure 12, it is a schematic diagram of the image collected by the camera module on the second preset calibration plate during the process of S1101-S1113 in the embodiment of the present application. In the example of FIG. 12 , the second preset calibration plate includes a single feature point, and the single feature point is a circular feature point. a in Figure 12 is a schematic diagram of the image collected at S1101, and the single feature point 1201 is not in the center of the image. b in Figure 12 is a schematic diagram of the image collected from the second preset calibration plate after the S1105 camera module adjusts the stroke of the motor. The single feature point 1202 is in the center of the image, that is, the center of the camera module's screen. c in Figure 12 is one of the schematic diagrams of images collected by the camera module in S1110 on the preset calibration plate in the third shooting state, and a single feature point is blurred. d in Figure 12 is a schematic diagram of the image captured by the second preset calibration plate when the motor of the camera module is adjusted to the calibrated gain value after finding the motor's calibration gain value in S1113. The blur of a single feature point is small.

It should be noted that for a camera module that performs OIS calibration using the above-mentioned methods S1101-S1113, the target adjustment value of the motor's stroke also needs to be saved as the calibration result. When the camera module is put into use, it is necessary to use the calibrated gain value of the motor obtained by this method to perform OIS processing after the motor's stroke is adjusted according to the target adjustment value, in order to obtain a better anti-shake effect. In some embodiments, the above-mentioned methods S1101-S1113 are suitable for camera modules with better linearity and crosstalk after motor compensation.

In the technical solution provided by the embodiment of the present application, a calibration plate including a single feature point is used to perform OIS calibration on a camera module that performs OIS processing in the X and Y directions of the prism. By changing the stroke of the motor, it is ensured that a single feature point appears. In the center of the camera module's screen. This can avoid the problem of low OIS calibration accuracy caused by a single feature point not being in the center of the picture.

Other embodiments of the present application provide a computer device, which may be the above-mentioned personal computer. The computer device may include memory and one or more processors. The memory is coupled to the processor. The memory is also used to store computer program code, which includes computer instructions. When the processor executes computer instructions, the computer device may perform various functions or steps performed by the personal computer in the above method embodiments. When the computer device is an electronic device, its structure may refer to the structure of the personal computer 20 shown in FIG. 2 .

An embodiment of the present application also provides a chip system. As shown in FIG. 13 , the chip system 130 includes at least one processor 1301 and at least one interface circuit 1302 . The processor 1301 and the interface circuit 1302 may be interconnected by wires. For example, interface circuitry 1302 may be used to receive signals from other devices, such as memory of a computer device. As another example, interface circuit 1302 may be used to send signals to other devices (eg, processor 1301). For example, the interface circuit 1302 can read instructions stored in the memory and send the instructions to the processor 1301. When the instructions are executed by the processor 1301, the computer device can be caused to perform various steps in the above embodiments. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiments of this application.

Embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium includes computer instructions. When the computer instructions are run on the above-mentioned personal computer, the electronic device causes the electronic device to execute each of the steps executed by the personal computer in the above-mentioned method embodiment. function or step.

Embodiments of the present application also provide a computer program product. When the computer program product is run on a computer, it causes the computer to perform various functions or steps performed by the personal computer in the above method embodiments. Wherein, the computer may be an electronic device, such as a personal computer.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In practical applications, the above functions can be allocated according to needs. Different functional modules are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be combined or can be integrated into another device, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separate. A component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

Integrated units may be stored in a readable storage medium if they are implemented in the form of software functional units and sold or used as independent products. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or contribute to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium includes several instructions to cause a device (which can be a microcontroller, a chip, etc.) or a processor to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code.

The above contents are only specific implementation modes of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be covered by the protection scope of the present application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (17)

1. A calibration method for optical image stabilization, characterized in that the method includes: Obtain N images collected by the camera module on the first preset calibration plate in the first shooting state; the first preset calibration plate includes at least one feature point, and N is a positive integer greater than 2; the N images The images are collected when the motor of the camera module is set to different gains; the first shooting state includes: the camera module vibrates and the optical anti-shake function of the camera module is turned on; When the optical anti-shake function of the camera module is turned on, when the camera module collects images, the motor drives the lens of the camera module to move to compensate for the blur caused by the vibration of the camera module. ; Obtain the jitter situation of the feature points in each of the N images, and determine the jitter center of each image according to the jitter situation of the feature points in each of the N images; the jitter center is Indicates the position with the smallest jitter in the image; Among the N images, find the target image whose distance between the jitter center and the image center satisfies the preset condition; the preset condition is used to indicate that the distance between the jitter center and the image center of the image is the smallest, and the The distance is less than the first preset threshold; Obtain the target gain corresponding to the motor when collecting the target image, and determine the target gain as the calibrated gain value of the motor. 2. The method according to claim 1, wherein the jitter of the feature points in each of the N images is obtained, and the jitter of the feature points in each of the N images is obtained. situation, determine the jitter center of each image, including: Perform filtering processing on the N images to obtain N filtered images; the filtered images include at least one feature object corresponding to the at least one feature point; each feature object includes a corresponding feature point and a corresponding feature point corresponding to the fuzzy part; Based on the size of at least one feature object in each of the N filtered images, the location of the jitter center in the image corresponding to each filtered image is determined. 3. The method according to claim 2, characterized in that, based on the size of at least one characteristic object in each filtered image of the N filtered images, determining the size of the image corresponding to each filtered image. The location of the jitter center includes: Search for the smallest feature object among at least one feature object in each of the N filtered images; Based on the minimum feature object in each filtered image, the location of the jitter center in the image corresponding to each filtered image is determined. 4. The method according to claim 3, characterized in that, based on the minimum feature object in each filtered image, determining the location of the jitter center in the image corresponding to each filtered image includes: : In the target filtered image, if the minimum feature object is at the edge of the target filtered image, and the size of the minimum feature object exceeds the second preset threshold, then it is determined that the jitter center is at the edge of the target filtered image. Other than the image corresponding to the image; the target filtered image is any filtered image among the N filtered images; In the target filtered image, if the minimum feature object is not at the edge of the target filtered image, or the size of the minimum feature object does not exceed the second preset threshold, then based on the minimum feature object The location in the filtered image of the target determines where the jitter center is located. 5. The method of claim 4, wherein determining the location of the jitter center based on the location of the minimum feature object in the target filtered image includes: If the minimum feature object includes one feature object, then determine the location of the center of the minimum feature object as the location of the jitter center; If the minimum feature object includes more than two feature objects, the location of the jitter center is fitted based on the location of the minimum feature object. 6. The method according to claim 1, characterized in that the acquisition of N images collected by the camera module on the first preset calibration plate in the first shooting state includes: The gain of the motor increases or decreases from the initial value, and when the motor is set to a different gain, the image collected by the camera module on the first preset calibration plate in the first shooting state is correspondingly obtained. . 7. The method according to claim 6, wherein the jitter of the feature points in each of the N images is obtained, and the jitter of the feature points in each of the N images is obtained. situation, determine the jitter center of each image, including: After obtaining the current image captured by the camera module when the motor is set to the current gain, obtain the jitter of the feature points in the current image, and determine the jitter of the feature points in the current image based on the jitter of the feature points in the current image. Describes the jitter center of the current image; The method also includes: When it is determined that the distance between the jitter center of the current image and the image center of the current image meets the preset condition, stop acquiring the first preset calibration plate collected by the camera module in the first shooting state. Image. 8. The method according to claim 6, characterized in that the gain of the motor increases or decreases from an initial value, including: During the process of increasing or decreasing the gain of the motor from the initial value, if the jitter center of the first image corresponding to the first gain is outside the first image, the first gain will be adjusted with a first preset step size. on the basis of increment or decrement. 9. The method according to claim 6, characterized in that the gain of the motor increases or decreases from an initial value, and when the motor is set to a different gain, the camera module is correspondingly obtained at the first The images collected on the first preset calibration plate in the shooting state include: In the process of increasing or decreasing the gain of the motor from the initial value, obtaining the second image collected by the camera module when the gain of the motor is set to the second gain; If the jitter center of the second image is within the second image, then increase or decrease the second preset step size on the basis of the second gain to obtain a third gain, and obtain the third gain captured by the camera module. three images; Determine a target step size based on the movement distance of the jitter center of the second image and the jitter center of the third image, and the second preset step size; On the basis of the third gain, the target step size is increased or decreased to obtain a fourth gain, and a fourth image collected by the camera module when the gain of the motor is set to the fourth gain is obtained. 10. The method according to any one of claims 1-9, characterized in that the at least one feature point includes more than two feature points. 11. The method according to claim 10, wherein the first preset calibration plate includes a plurality of circular feature points that are periodically arranged and have the same size. 12. The method according to any one of claims 1 to 9, characterized in that, among the N images, after searching for a target image whose distance between the jitter center and the image center satisfies a preset condition, the Methods also include: Acquire the fifth image collected by the camera module on the first preset calibration plate in the second shooting state; in the second shooting state, the camera module vibrates and the optics of the camera module Anti-shake function is turned off; Obtain the sixth image collected by the camera module on the first preset calibration plate in the third shooting state; in the third shooting state, the camera module remains stable; A compression ratio is determined based on the blur amount of feature points in the target image, the fifth image, and the sixth image, and the compression ratio is used to indicate the performance of the motor. 13. The method of claim 12, wherein determining the compression ratio based on blur amounts of feature points in the target image, the fifth image, and the sixth image includes: Obtain the blur amounts corresponding to the target feature points in the first preset calibration plate in the target image, the fifth image and the sixth image respectively; the target feature points include jitter in the target image smallest feature point; The compression ratio is calculated based on the blur amounts corresponding to the target feature points in the target image, the fifth image, and the sixth image. 14. The method according to claim 13, wherein the compression is calculated based on blur amounts corresponding to the target feature points in the target image, the fifth image and the sixth image. Than, including: The compression ratio is calculated based on the following formula: CR=-20Log10 ((OIS on-Still)/(OIS off- Still)); Where, CR represents the compression ratio, OIS on represents the blur amount corresponding to the target feature point in the target image, OIS off represents the blur amount corresponding to the target feature point in the fifth image, and Still represents The blur amount corresponding to the target feature point in the sixth image. 15. A calibration method for optical anti-shake, characterized in that the method includes: Obtain the calibration image collected by the camera module on the second preset calibration plate; the second preset calibration plate includes at least one feature point; Obtain the first position of the preset feature point in the second preset calibration plate in the calibration image, and the distance between the first position and the image center of the calibration image; Based on the distance between the first position and the image center of the calibration image, adjust the stroke of the motor of the camera module so that the preset feature point is at the center of the image; Obtain M images of the second preset calibration plate collected by the camera module in a third shooting state; the third shooting state includes vibration of the camera module and the optical protection of the camera module The shake function is turned on; when the optical anti-shake function of the camera module is turned on, when the camera module collects images, the motor drives the lens of the camera module to move to compensate for the camera movement. Blur caused by the vibration of the module; the M is a positive integer greater than or equal to 2; Obtain the jitter condition of the preset feature points in each of the M images; Based on the jitter of the preset feature points in each of the M images, the calibrated gain value of the motor is determined. 16. An electronic device, characterized in that the electronic device includes: a processor and a memory; computer program code is stored in the memory, and the computer program code includes computer instructions. When the computer instructions are processed by the When the processor is executed, the electronic device is caused to execute the method according to any one of claims 1-15. 17. A computer-readable storage medium, characterized by comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the method according to any one of claims 1-15 .