CN109194877B - Image compensation method and apparatus, computer-readable storage medium, and electronic device - Google Patents

Abstract

The application relates to an image compensation method and device, a computer readable storage medium and an electronic device, wherein the image compensation method comprises the following steps: controlling a camera to acquire an image and acquiring exposure information of the acquired image; when the camera is detected to shake, acquiring lens offset of the camera when the image is acquired; determining a target calibration function according to the exposure information, and acquiring an image offset corresponding to the lens offset; the image is compensated according to the exposure information and the image offset, the image offset can be more accurately acquired according to the exposure information, and then the image is compensated, so that the definition of the image can be improved.

Description

Image compensation method and apparatus, computer readable storage medium and electronic device

technical field

The present application relates to the field of computer technology, and in particular, to an image compensation method and apparatus, a computer-readable storage medium, and an electronic device.

Background technique

Optical Image Stabilization (Optical Image Stabilization), as an anti-shake technology currently recognized by the public, mainly corrects the "optical axis shift" through the floating lens of the lens. The tiny movement is detected, and then the signal is sent to the microprocessor. The processor immediately calculates the amount of displacement that needs to be compensated, and then compensates according to the shaking direction and displacement of the lens through the compensation lens group; thus effectively overcome the vibration caused by the camera. The resulting image is blurry.

However, in the process of shaking, an image shift will occur, and the movement of the lens will actually affect the image, and the general optical image stabilization technology cannot solve the problem of image shift.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an image compensation method and apparatus, a computer-readable storage medium, and an electronic device, which can compensate for image shift caused by shaking and improve image clarity.

An image compensation method, the method comprising:

Controlling a camera to collect images, and acquiring exposure information for collecting the images; the camera includes an optical image stabilization system;

When it is detected that the camera shakes, obtain the lens offset of the camera when the image is captured;

Determine a target calibration function according to the exposure information, and acquire an image offset corresponding to the lens offset;

The image is compensated according to the exposure information and the image offset.

An image compensation device, the device includes:

an exposure information acquisition module, configured to control a camera to collect images and acquire exposure information for collecting the images; the camera includes an optical image stabilization system;

a lens offset acquisition module, configured to acquire the lens offset of the camera when the image is captured when it is detected that the camera shakes;

an image offset acquisition module, configured to determine a target calibration function according to the exposure information, and acquire an image offset corresponding to the lens offset;

An image compensation module, configured to compensate the image according to the exposure information and the image offset.

A computer-readable storage medium on which a computer program is stored, the computer program implementing the steps of an image compensation method when executed by a processor.

An electronic device includes a memory and a processor, wherein computer-readable instructions are stored in the memory, and when executed by the processor, the instructions cause the processor to perform steps of an image compensation method.

The above-mentioned image compensation method and device, computer-readable storage medium and electronic device can control the camera to collect images, and obtain exposure information of the collected images; lens offset; determine a target calibration function according to the exposure information, and obtain an image offset corresponding to the lens offset; compensate the image according to the exposure information and the image offset, The image offset can be obtained more accurately according to the exposure information, and then the image can be compensated to improve the clarity of the image.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a block diagram of an electronic device in one embodiment;

2 is a flowchart of an image compensation method in one embodiment;

3 is a flowchart of determining a target calibration function according to exposure information and acquiring an image offset corresponding to the lens offset in one embodiment;

4 is a flowchart of determining a preset calibration function matching the standard exposure information for each level of standard exposure information in one embodiment;

5 is a flow chart of compensating an image according to exposure information and an image offset in one embodiment;

6 is a flow chart of compensating an image according to exposure information and an image offset in another embodiment;

7 is a flow chart of acquiring the lens shift of the camera when capturing an image when it is detected that the camera shakes in one embodiment;

8 is a structural diagram of an image compensation device in one embodiment;

FIG. 9 is a schematic diagram of an image processing circuit in one embodiment.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

It will be understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first image could be referred to as a second image, and, similarly, a second image could be referred to as a first image, without departing from the scope of this application. Both the first image and the second image are images, but they are not the same image.

The electronic device can photograph all the scenes, people, etc. in the scene through the imaging device. The imaging device includes an OIS (Optical Image Stabilization, optical image stabilization) system, that is, the imaging device includes a camera carrying the OIS system. Optical image stabilization relies on a special lens or the structure of the CCD photosensitive element to minimize the image instability caused by the operator's shaking during use. Specifically, when the gyroscope in the camera detects a slight movement, it will transmit the signal to the microprocessor to immediately calculate the displacement amount that needs to be compensated, and then compensate according to the shaking direction and displacement of the lens through the compensation lens group. This effectively overcomes image blurring caused by camera shake.

Optionally, this solution can also be applied to an imaging device including two or more cameras, wherein the two or more cameras include at least one camera with an OIS function.

The above imaging device can be applied to electronic devices, and the electronic devices can be mobile phones, tablet computers, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, sales terminal), vehicle computer, wearable device, digital camera, etc. Any terminal device with photo and video functions. It should be noted that the imaging device may be provided on the electronic device, or may not be provided on the electronic device but connected to the electronic device, and the screen of the electronic device may display the image collected by the imaging device.

The imaging device can control the camera to collect images and obtain the exposure information of the collected images; the camera includes an optical image stabilization system; when it is detected that the camera shakes, the lens offset of the camera is obtained; the target calibration function is determined according to the exposure information, and the correlation with the lens is obtained. The image offset corresponding to the offset; compensate the image captured by the camera when shaking occurs according to the exposure information and the image offset.

Figure 1 is a block diagram of an electronic device in one embodiment. As shown in FIG. 1, the electronic device includes a processor, a memory, a display screen and an input device connected through a system bus. Among them, the memory may include a non-volatile storage medium and a processor. The non-volatile storage medium of the electronic device stores an operating system and a computer program, and when the computer program is executed by the processor, an image compensation method provided in the embodiments of the present application is implemented. The processor is used to provide computing and control capabilities that support the operation of the entire electronic device. Internal memory in an electronic device provides an environment for the execution of computer programs in non-volatile storage media. The display screen of the electronic equipment can be a liquid crystal display screen or an electronic ink display screen, etc., and the input device can be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the shell of the electronic equipment, or a An external keyboard, trackpad, or mouse, etc. The electronic device may be any terminal device with photographing and video recording functions, such as a mobile phone, a tablet computer, a PDA (Personal Digital Assistant, a personal digital assistant), a POS (Point of Sales, a sales terminal), a vehicle-mounted computer, a wearable device, and a digital camera. Those skilled in the art can understand that the structure shown in FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may be Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.

FIG. 2 is a flowchart of an image compensation method in one embodiment. . In one embodiment, the image compensation method includes steps 202-208. in,

Step 202: Control the camera to capture images, and acquire exposure information of the captured images.

The camera includes an optical image stabilization system (Optical Image Stabilization, OIS). The camera includes lens, voice coil motor, infrared filter, image sensor (Sensor IC) and digital signal processing (DSP) and PCB circuit board. Among them, the lens is usually composed of multiple lenses, and its imaging function, if the lens has the OIS function, in the case of shaking, the lens is controlled to translate relative to the image sensor to offset the image shift caused by the hand shake.

When the imaging device enters the image preview interface, the imaging device can control the camera to preview and capture images in various viewing angle ranges in real time, or when the imaging device enters the image preview interface, the imaging device can capture images in various viewing angle ranges.

During the process of acquiring an image, the imaging device will also acquire exposure information of the image. Among them, exposure can refer to the process in which the photosensitive element of the imaging device receives external light and then forms an image, and this process directly determines the brightness/darkness of the image. The three elements of exposure are aperture, shutter, and ISO.

Exposure information can be understood as the shutter or sensitivity among the three elements of exposure. Among them, the shutter speed is usually abbreviated as the shutter, which refers to the time from the opening to the closing of the shutter of the imaging device, and the light-sensitive time of the CCD is controlled by the shutter. Shutter speed is usually expressed in fractional form, and it is customary to be a multiple, arranged in the sequence of 1 second, 1/2 second....1/1000 second. For example, 1/100 means that the shutter is open to close in 0.01 seconds, and 1/10 is 0.1 seconds. Sensitivity, also known as ISO value, can refer to the sensitivity of the film to light. Under the condition that the aperture and shutter remain unchanged, the higher the sensitivity, the stronger the sensitivity of the imaging device, and the brighter the image will be. Otherwise, it will be darker.

Step 204, when it is detected that the camera shakes, obtain the lens offset of the camera.

The imaging device also includes a gyroscope sensor to detect camera shake. When the angular velocity information collected by the gyro sensor changes, it can be considered that the camera shakes. When the camera shakes, the lens offset of the camera can be obtained.

Optionally, whether the camera shakes can be detected based on the gyro sensor in the imaging device or based on the gyro sensor and/or acceleration sensor in the original electronic device.

In one embodiment, a two-dimensional coordinate system can be established by taking the plane where the image sensor of the camera is located as the XY plane, and the origin of the two-dimensional coordinate system is not further limited in this application. The lens offset can be understood as the vector offset between the current position after the lens shake and the initial position before the lens shake in the two-dimensional coordinate system, that is, the vector of the current position after the lens shake relative to the initial position before the lens shake distance. The initial position can be understood as the position of the lens when the distance between the lens and the image sensor is one focal length of the lens. Lens offset refers to the vector distance between the optical centers before and after the lens (convex lens) moves.

Further, the movement amount of the lens in the camera, that is, the lens shift, can be collected based on the Hall sensor or laser technology in the camera. The angular velocity information collected by the gyroscope sensor corresponds to the Hall value collected by the Hall sensor in time series. In the embodiment of the present application, the size of the lens offset at the current moment can be determined by knowing the size of the Hall value collected by the Hall sensor. In OIS systems, this lens offset is on the order of microns.

It should be noted that, while controlling the camera to capture images, it will also synchronously determine and acquire the lens offset, and the acquisition frequency of the Hall sensor is higher than the frequency of acquisition of images by the camera. That is, when the camera captures one frame of image, multiple lens offsets can be acquired simultaneously. For example, if the camera collects images at 30Hz, and the Hall sensor collects Hall values at 200Hz at the same time, the time to collect one frame of image will correspond to 6-7 Hall values in time series, and multiple Lens offset.

Step 206: Determine the target calibration function according to the exposure information, and acquire the image offset corresponding to the lens offset.

The target calibration function can be understood as a calibration function matching the current exposure information, and the target calibration functions corresponding to different exposure information may or may not be the same. Since the unit of lens offset is code and the unit of image offset is pixel (pixel), the lens offset can be converted into image offset based on the target calibration function, and the lens offset can be converted into image offset quantity.

Image offset can be understood as the displacement of the same feature point before and after the lens shakes within the same field of view during the process of capturing an image once. For example, before the imaging device shakes, that is, when the lens is in the first position, the first image is collected and the coordinate positions of each pixel in the first image on the XY plane are recorded. When the imaging device shakes, the lens will move in the XY plane, that is, when the lens is in the second position (the current position after the movement), the second image is collected and the coordinate position of each pixel in the second image on the XY plane is recorded. , the offset of the second image relative to the first image can be referred to as an image offset.

The target calibration function can be obtained according to a specific calibration method, and the target calibration function can be a one-dimensional quadratic function, a two-dimensional quadratic function, or a two-variable multiple function, wherein the offset of the lens in the XY plane along the x-axis can be calculated. The offset along the y-axis is brought into the target calibration function, and the corresponding image offset d1 is obtained through calculation. Collecting one frame of image corresponds to multiple lens offsets, and according to the target calibration function, multiple image offsets can be obtained correspondingly.

Step 208: Compensate the image according to the exposure information and the image offset.

The image is compensated according to the acquired exposure information and image offset. Different exposure information corresponds to different compensation strategies. For example, the compensation strategies may include frame-by-frame or inter-frame compensation, block compensation, progressive or inter-line compensation, and so on. Among them, frame-by-frame or frame-by-frame compensation can use one image offset to uniformly compensate all areas of different frame images; block compensation, progressive or interlace compensation can be used to compensate different areas of the same frame image, that is, Different areas can be compensated with different image offsets.

The above-mentioned image compensation method can control the camera to collect images, and obtain exposure information of the collected images; when it is detected that the camera shakes, obtain the lens shift of the camera when collecting the image; determine the target according to the exposure information calibration function, and obtain the image offset corresponding to the lens offset; the image is compensated according to the exposure information and the image offset, and the image offset can be more accurately obtained according to the exposure information Shifting, and then compensating for the image, which can improve the clarity of the image.

FIG. 3 is a flowchart of determining a target calibration function according to exposure information and acquiring an image offset corresponding to a lens offset in one embodiment. In one embodiment, the target calibration function is determined according to the exposure information, and the image offset corresponding to the lens offset is obtained, including:

Step 302 , constructing a mapping relationship between the standard exposure information of multiple gears and multiple preset calibration functions.

In one embodiment, the exposure information is sensitivity, which is a measure of the sensitivity of the negative to light, and is determined by sensitivity measurement and measurement of several values. Among them, the sensitivity includes ISO100, ISO200, ISO400, ISO800, ISO1000, ISO1600, ISO3200, ISO6400, ISO12800 and so on. In the process of capturing an image, the sensitivity of the currently captured image, such as ISO400, can be directly obtained.

The electronic device can pre-store standard exposure information of multiple gears, wherein the gears of the standard exposure information can be set to five gears, which are ISO100 (first gear), ISO500 (second gear), and ISO1000 (third gear). , ISO2000 (four gears), ISO4000 (five gears).

Optionally, the standard exposure information can also be set to six gears, which are ISO100 (first gear), ISO200 (second gear), ISO400 (third gear), ISO800 (fourth gear), and ISO1000 (fifth gear). ), ISO1600 (sixth gear). In the embodiment of the present application, the number of gears of the standard exposure information and the specific value of each gear may be set according to actual needs, which is not further limited herein.

For example, when the electronic device sets the standard exposure information gears to five gears, which are SO100, ISO500, ISO1000, ISO2000, and ISO4000, respectively, the electronic device can set the standard exposure information to ISO100, ISO500, ISO1000, ISO2000, and ISO4000, respectively. A preset calibration function with calibration coefficients is determined according to a preset calibration model. The standard exposure information of each gear corresponds to a preset calibration model, and a unique preset calibration function can be determined according to the preset calibration module. Correspondingly, if the standard exposure information of five gears is included, it can also be determined that five corresponding preset calibration functions can be denoted as F ₁ (ΔX, ΔY), F ₂ (ΔX, ΔY), F ₃ (ΔX, ΔY), respectively. ΔY), (ΔX, ΔY), F ₅ (ΔX, ΔY).

For example, the mapping relationship can be expressed as ISO100→F ₁ (ΔX,ΔY), ISO500→F ₂ (ΔX,ΔY), ISO1000→F ₃ (ΔX,ΔY), ISO2000F ₄ →(ΔX,ΔY), ISO4000→F ₅ (ΔX,ΔY).

Specifically, the preset calibration function may be a univariate quadratic function, a binary quadratic function, a binary multiple function, etc. The lower the value of its sensitivity, the more complex the dimension of the corresponding preset calibration function. The higher the value of its sensitivity, the simpler the dimension of the corresponding preset calibration function.

Under the condition of the same aperture, if you need to obtain the same exposure value, the sensitivity is inversely proportional to the shutter speed, that is, the higher the sensitivity, the smaller the corresponding door opening speed. On the contrary, if the sensitivity is smaller, the The corresponding opening speed is also large.

Optionally, in one embodiment, the exposure information may also be a shutter speed. The shutter speed represents the length of the exposure time. Generally, the shorter the exposure time is required under the condition of sufficient light, and the longer the exposure time is required under the condition of insufficient light. Shutter speed is usually expressed in fractional form, and it is customary to be a multiple, arranged in the sequence of 1 second, 1/2 second....1/1000 second. The electronic device can pre-store standard exposure information of multiple gears, wherein the gears of the standard exposure information can be set to five gears, which are 1 second, 1/2 second, 1/4 second, and 1/8 second respectively. , 1/16 second. The electronic device may determine a preset calibration function with a calibration coefficient according to a preset calibration model under the conditions of 1 second, 1/2 second, 1/4 second, 1/8 second, and 1/16 second, respectively. The standard exposure information of each gear corresponds to a preset calibration model, and a unique preset calibration function can be determined according to the preset calibration module. If the standard exposure information of five gears is included, correspondingly, five corresponding preset calibration functions may also be determined. The faster the shutter speed, the simpler the dimension of the corresponding preset calibration function, and the slower the shutter speed, the more complex the dimension of the corresponding preset calibration function.

Step 304: Determine the gear of the exposure information according to the standard exposure information of the multiple gears.

The electronic device can acquire the exposure information when the image is captured, and compare the exposure information with the standard exposure information of multiple gears to determine the standard exposure information that is closest to the exposure information. For example, if the exposure information when capturing an image is ISO400, and the standard exposure information is set to five gears, which are ISO100, ISO500, ISO1000, ISO2000, and ISO4000, it can be determined that the exposure information closest to the exposure information The standard exposure information is ISO500, and the corresponding gear is the second gear, that is, the gear of the current exposure information is also the second gear. Correspondingly, if the exposure information is the shutter speed, the standard exposure information closest to the shutter speed can also be determined, and then the gear of the shutter speed can be determined.

Step 306 , according to the mapping relationship, determine a target calibration function matching the gear of the exposure information among the plurality of preset calibration functions.

If the mapping relationship in the electronic device is ISO100→F ₁ (ΔX,ΔY), ISO500→F ₂ (ΔX,ΔY), ISO1000→F ₃ (ΔX,ΔY), ISO2000F ₄ →(ΔX,ΔY), ISO4000→F ₅ (ΔX, ΔY), according to the determined gear of exposure information, the target calibration function can be determined from five preset calibration functions. If the exposure information ISO400 is in the second gear, and the preset calibration function corresponding to the second-grade standard exposure information ISO500 is F ₂ (ΔX,ΔY), then the preset calibration function corresponding to the second-grade standard exposure information is called as Calibration function for the target.

Step 308: Determine the image offset corresponding to the lens offset according to the target calibration function.

In one embodiment, the preset calibration function may be a one-variable quadratic function, a two-variable quadratic function, a two-variable multiple function, and the like. For example, the preset calibration function F ₁ (ΔX,ΔY) can be expressed as:

F ₁ (ΔX,ΔY)=ax ⁽ⁿ⁾ +by ⁽ⁿ⁾ +...+cxy+dx+ey+f;

The preset calibration function F2(ΔX,ΔY) can be expressed as:

F ₂ (ΔX,ΔY)=ax ² +by ² +cxy+dx+ey+f

The preset calibration function F3(ΔX,ΔY) can be expressed as:

F ₃ (ΔX,ΔY)=ax ² +by ² +cx+dy+e

The preset calibration function F4(ΔX,ΔY) can be expressed as:

F ₄ (ΔX,ΔY)=axy+bx+cy+d

The preset calibration function F5(ΔX,ΔY) can be expressed as:

F ₅ (ΔX,ΔY)=ax+by+c

In the above formulas, a, b, c, d, e, and f are calibration coefficients, which are known coefficients. F _i (ΔX, ΔY) (i=1, 2, 3, 4, 5) is used to represent the current image offset, and x and y represent the horizontal and vertical coordinates of the current lens offset, respectively.

The above-mentioned preset calibration function is obtained according to a preset rule. It should be noted that the expression of the preset calibration function is not limited to the above examples, and can also be expressed by other expressions.

If the target calibration function is the preset calibration function F2 (ΔX, ΔY), the image offset can be obtained according to the target calibration function F2 (ΔX, ΔY). For example, if the current lens offset is p(2,1), the corresponding image offset F2(ΔX,ΔY) is 4a+b+2c+2d+e+f. According to the determined calibration coefficient, then The image offset F2 (ΔX, ΔY) can be obtained, which is a scalar offset. The preset calibration function is a binary quadratic function, which comprehensively considers the information of the x-axis offset and the y-axis offset of the lens offset, and can convert the lens offset into an image more accurately and efficiently. Offset.

In one embodiment, before constructing the mapping relationship between the standard exposure information and the preset calibration function, the method further includes step 300 , for each level of standard exposure information, determining a preset calibration function matching the standard exposure information.

FIG. 4 is a flowchart of determining a preset calibration function matching the standard exposure information for each level of standard exposure information in one embodiment. Specifically, for each level of standard exposure information, determine a preset calibration function that matches the standard exposure information, including:

Step 402 , for each level of standard exposure information, drive the motor to move the camera according to a preset trajectory, and the preset trajectory includes a plurality of displacement points.

Fix the test target plate in the imaging range of the camera, and control the motor to move the lens of the camera according to the preset trajectory to drive the lens. The test target can be a CTF (Contrast Transfer Function) target, an SFR (Spatial Frequency Response) target, a DB target or other custom targets. Preset tracks can be circles, ellipses, rectangles or other preset tracks. A plurality of displacement points are set on the preset track, wherein the distance between two adjacent displacement points may be the same or different. The position information of the displacement point can be represented by the coordinate position in the XY plane. For example, the position information of the displacement point qi can be represented by the coordinate position q _i (x _i , y _j ) in the XY plane, that is, the first position information of the displacement point can be represented by the coordinate position q _i (x _i , y _{j )} ) to indicate.

If the gears of the standard exposure information are set to five gears, they are ISO100, ISO500, ISO1000, ISO2000, and ISO4000 respectively. Then it is driven under the standard exposure information of ISO100, ISO500, ISO1000, ISO2000, and ISO4000, respectively. The motor moves the camera according to the preset trajectory, and records and stores the corresponding image data in groups.

Step 404, when the lens moves to each displacement point, correspondingly collect image information of the test target.

When the driving motor pushes the lens of the camera to move according to the preset trajectory, the image information of the test target is correspondingly collected at each displacement point. A displacement point corresponds to the image information of a test target, and the image information can be understood as the position information of a plurality of pixel points constituting the image. For example, when the number of displacement points is six, it needs to collect image information of six test targets correspondingly.

Step 406 , correspondingly acquire the first position information of each displacement point and the image offset of the same feature point relative to the initial position in the image information collected at each displacement point.

The electronic device can select a feature point p _i in the image information to obtain the second position information of the feature point p _i , and the second position information of the feature point p _i can also be used in the XY plane using the coordinates p _i (X _i, Y _j ) is represented.

Among them, the feature point p _i may be the shooting target corresponding to the pixel point near the center position in the image information, or may be the shooting target corresponding to the pixel point with the brightest brightness or other pixel points with prominent significance in the image information , here, the specific positions and definitions of the feature points are not further limited.

It should be noted that the shooting targets corresponding to the feature points in the image information of multiple test targets are the same, that is, the position information of the feature points in the image information collected at different displacement points is different, but the same feature point corresponds to the same shooting target.

In one embodiment, the displacement point q ₀ (x ₀ , y ₀ ) of the lens at the initial position may be the origin. When the lens is at the initial position q ₀ (x ₀ , y ₀ ), the characteristic points in the acquired image information of the test target can also be represented by p ₀ (X ₀ , Y ₀ ).

When the lens moves to the displacement point q ₁ (x ₁ , y ₁ ), the characteristic point p ₁ (X ₁ , Y 1 ) in the image information of the test target is obtained correspondingly, and the characteristic point p ₁ (X ₁ , Y ₁ ) ₁ ) The image offset d1 relative to the feature point p ₀ (X ₀ , Y ₀ ) acquired at the initial position; and so on, when the lens moves to the shift point q ₆ (x _6, y ₆ ), the corresponding acquisition test The feature point p 6 (X 6 , Y 6 ) in the image information of the target and the feature point p ₆ (X ₆ , Y ₆ ) at the feature point p ₆ (X ₆ , Y ₆ ) relative to the feature point p ₀ (X ₀ , Y ₀ ) acquired at the initial position The image offset d6.

Step 408 , inputting the first position information and the image offset into a preset offset transformation model to determine a preset offset transformation function with calibration coefficients, wherein the number of displacement points is associated with the number of calibration coefficients.

The standard exposure information of different gears corresponds to different preset calibration models, and different preset calibration models have different calibration coefficients. Wherein, different preset calibration models require different numbers of displacement points, and the number of unknown coefficients in the preset calibration model is less than or equal to the number of displacement points.

The preset calibration model may be a univariate quadratic function model, a binary quadratic function model, or a binary multiple function model, and the setting of the preset calibration model is obtained by learning.

The corresponding preset calibration model can be determined according to the gear position of the current standard exposure information, and the acquired first position information of the characteristic movement point, the second position information of the characteristic point corresponding to the displacement point, and the image offset A preset calibration model for the average input value, through analysis and operation, each coefficient in the preset calibration model is determined, and then there is a preset calibration function of the calibration coefficients. Correspondingly, the preset calibration function corresponding to the standard exposure information of each gear can be obtained.

It should be noted that the preset calibration model is consistent with the expression of the preset calibration function. For the preset calibration model, the calibration coefficient is an unknown number, and for the preset calibration function, the corresponding calibration coefficient is a known number.

For example, when the preset calibration model is a binary quadratic function model, it can be expressed by the following formula:

F(ΔX,ΔY)=ax ² +by ² +cxy+dx+ey+f

In the formula, (ΔX,ΔY) represents the image offset, which represents the current displacement point q(x _i , y _j ) relative to the same feature point obtained at the initial position q(x ₀ , y ₀ ) The image offset is a scalar offset, that is, the distance between the current displacement point q(x _i , y _j ) and the same feature point at the initial position q(x ₀ , y ₀ ). x represents the coordinate parameter of the horizontal axis x of the displacement point; y represents the coordinate parameter of the vertical axis y of the displacement point.

Among them, the binary quadratic function model includes six unknown coefficients a, b, c, d, e, f, and the obtained six displacement points q ₁ (x ₁ , y ₁ )-q ₆ (x ₆ , y ₆ ) and the image offsets d ₁ -d ₆ corresponding to the six feature points p ₁ (X ₁ , Y ₁ )-p ₆ (X ₆ , Y ₆ ) are respectively input into the binary quadratic function model, then The a, b, c, d, e, and f in the above equation can be parsed, and the obtained coefficients a, b, c, d, e, and f are brought into the binary quadratic function model, and the corresponding A preset calibration function, wherein a, b, c, d, e, and f are calibration coefficients of the preset calibration function.

In the image compensation method in this embodiment, a corresponding preset calibration function can be obtained according to a preset calibration model, a plurality of displacement points, and a plurality of corresponding feature points. Efficient acquisition of image offset values, higher calibration efficiency and higher accuracy, laying a good foundation for compensating images.

FIG. 5 is a flowchart of image compensation based on exposure information and image offset in one embodiment. In one embodiment, the image is compensated according to the exposure information and the image offset, including:

Step 502: Determine the exposure level of the exposure information, where the exposure level includes primary exposure, secondary exposure and tertiary exposure.

In one embodiment, if the exposure information is the sensitivity, the exposure level can be set according to the sensitivity. The sensitivity of electronic equipment includes ISO100, ISO200, ISO400, ISO800, ISO1000, ISO1600, ISO3200, ISO6400, ISO12800, etc. The exposure equal diameter can be divided according to the sensitivity. For example, the sensitivity less than or equal to ISO500 can be regarded as primary exposure, the sensitivity greater than ISO500 and less than or equal to ISO1000 can be regarded as secondary exposure, and the sensitivity greater than ISO1000 can be regarded as tertiary exposure. The electronic device may determine the exposure level of the current exposure information according to the set primary exposure, secondary exposure and tertiary exposure.

In one embodiment, if the exposure information is the shutter speed, the exposure level can be set according to the shutter speed. The shutter speed of the electronic device includes 1 second, 1/2 second, 1/4 second, 1/8 second, 1/16 second, etc., and the exposure equal diameter can be divided according to the shutter speed. For example, a shutter speed greater than 1/2 second and a shutter speed less than or equal to 1/8 second can be regarded as primary exposure, a shutter speed greater than 1/8 second and less than or equal to 1/2 second can be regarded as secondary exposure, and Shutter speeds greater than 1/2 second are triple exposures. The electronic device may determine the exposure level of the current exposure information according to the set primary exposure, secondary exposure and tertiary exposure.

It should be noted that the electronic device divides the exposure levels according to the exposure information, and the specific division rules are not limited to the above examples, and the range of exposure information for each exposure level can also be set according to actual needs.

Step 504: Determine a corresponding compensation strategy according to the exposure level.

The image compensation strategy corresponding to each exposure level is different. Specifically, when the exposure level is primary exposure, the corresponding compensation strategy is frame-by-frame or frame-by-frame compensation; when the exposure level is secondary exposure, the corresponding compensation strategy is block compensation; when the exposure level is tertiary exposure , the corresponding compensation strategy is progressive or interlaced compensation.

Step 506: Compensate the image according to the image offset and the compensation strategy.

In one embodiment, if the exposure level corresponding to the exposure information is primary exposure, frame-by-frame or frame-by-frame compensation may be used. When the electronic device collects one frame of image, the corresponding obtained image offsets are multiple. When the frame-by-frame or frame-by-frame compensation strategy is used to compensate the image, the smallest image offset, the image offset with the smallest derivative, and the image offset with the smallest difference from the average jitter can be obtained among multiple image offsets Compensate all pixels of each frame or every other frame as the target image offset.

In one embodiment, if the exposure level corresponding to the exposure information is secondary exposure, the compensation can be performed in blocks. When the electronic device collects one frame of image, the corresponding obtained image offsets are multiple. For example, there are currently six Hall values of hall1-hall6, each of which corresponds to a unique image offset, which is recorded as biaspixel1-biaspixel6. At this time, if the CMOS scans 60 lines, it can be corrected in blocks. That is, the 60 lines are divided into 6 blocks, one block contains 10 lines, and the 6 blocks of images are corrected block by block with biaspixel1-biaspixel6 respectively, that is, the 10 lines contained in the first block are all compensated and corrected by using biaspixel1 as the correction parameter, and the second block The 10 lines included use biaspixel2 as the correction parameter for compensation correction.

In one embodiment, if the exposure level corresponding to the exposure information is three-level exposure, the compensation can be performed line by line or interlace. When the electronic device collects one frame of image, the corresponding obtained image offsets are multiple. For example, there are six Hall values in hall1-hall6, and each Hall value corresponds to a unique image offset. The six image offsets can be recorded as biaspixel1-biaspixel6. At this time, if the CMOS scans 6 lines, Then you can use biaspixel1 to compensate the first row of pixels, use biaspixel2 to compensate for the second row of pixels, use biaspixel3 to compensate for the third row of pixels, use biaspixel4 to compensate for the fourth row of pixels, you can use biaspixel, 5 pairs Compensate the pixels in the 5th row, use biaspixel6 to compensate the pixels in the 6th row, that is, use biaspixel1-biaspixel6 to compensate the pixels in rows 1-6 row by row, and so on, to complete the compensation of this image

Optionally, based on the obtained 6 image offsets biaspixel1-biaspixel6, arbitrarily select 1, 2 or 3 image offsets to interlace the pixels in the first row, the third row, and the fifth row respectively. Compensation, or, interlace compensation is performed on the pixel points of the second row, the fourth row, and the sixth row, and so on, to complete the compensation of this image.

In this embodiment, different compensation strategies can be adaptively used to compensate the image based on different exposure levels, which can improve the image clarity under different exposure levels.

FIG. 6 is a flow chart of compensating an image according to an image offset amount and a compensation strategy when the exposure level is secondary exposure in one embodiment. In one embodiment, when the exposure level is secondary exposure, the image is compensated according to the image offset and the compensation strategy, including:

Step 602: Identify the image to identify the to-be-compensated area and the non-compensated area, wherein the color of each pixel in the non-compensated area is the same, and the proportion of the non-compensated area to the image is greater than or equal to a preset value.

In one embodiment, the electronic device may acquire the color value of each pixel point in the image; and cluster each pixel point based on the color value of each pixel point. Among them, the color values of the pixels in each pixel category are the same; for each category of pixels after clustering, determine the contours of each connected region formed by the pixels in this category to obtain a contour set, and then Obtain the area of each contour set to filter out the contour with the largest area, and use the area corresponding to the contour as the non-compensated area.

The combination of the non-compensated area and the to-be-compensated area is the entire image. After the non-compensated area is acquired, it is determined that the non-compensated area accounts for the proportion of the entire image. If the proportion is greater than or equal to the preset value, the non-compensated area is considered valid, and then Get the area to be compensated. If the ratio is smaller than the preset value, it is considered that the non-compensated area is valid, and the entire image is used as the area to be compensated.

Further, the preset value may be data such as one-half, three-fifth, four-seventh, etc. The specific preset value is not further limited, and can be set according to actual needs.

For example, if the collected image is a night scene image, most of the area in the image is a pure black area, and only a relatively small part is a bright area, the black area can be used as the non-compensated area, and the bright area can be used as the area to be compensated. If the collected image is a portrait + background image, in which the portrait is the foreground area, and the background area is the area with the same color, if the proportion of the background area to the entire image is greater than or equal to the preset value, the background area will be regarded as non-compensated If the proportion of the background area in the whole image is less than the preset value, the whole image is regarded as the area to be compensated.

It should be noted that the method of image recognition is not limited to the above-mentioned examples, and can also be identified by using color feature extraction, texture feature extraction, and edge feature extraction algorithms. limit.

Step 604: Compensate the compensation area according to the image offset and the compensation strategy.

The compensation strategy corresponding to the secondary exposure level is block compensation, that is, according to the image offset, block compensation can be performed on the area to be compensated, that is, fine compensation can be performed on the area to be compensated, but not on the non-compensated area. Any processing to improve the sharpness of the area to be compensated and at the same time improve the efficiency of image processing.

FIG. 7 is a flow chart of acquiring the lens shift of the camera when capturing an image when it is detected that the camera shakes in one embodiment. In one embodiment, when it is detected that the camera shakes, the lens offset of the camera when capturing the image is acquired, including:

Step 702, when it is detected that the camera shakes, synchronously acquire multiple camera shake amounts when a frame of image is collected.

Specifically, the first frequency at which the camera collects images and the second frequency at which the gyro sensor collects angular velocity information is obtained; that is, when the camera collects one frame of image, multiple pieces of angular velocity information collected by the gyro sensor are simultaneously obtained. Among them, the acquisition frequency of the gyroscope sensor is higher than the frequency of acquiring the image acquired by the camera. For example, if the camera collects images at 30Hz, and the gyroscope sensor collects angular velocity information at 200Hz at the same time, the time to collect one frame of image will correspond to 6-7 pieces of angular velocity information in time series.

The corresponding jitter amount is determined according to the acquired multiple angular velocity information, wherein the jitter amount corresponds to the angular velocity information one-to-one, each angular velocity information corresponds to a jitter amount, and the collected 6-7 angular velocity information corresponds to 6-7 jitter amounts. The amount of jitter can be understood as the angle information after the angular velocity information is integrated. Among them, the integration time is related to the frequency at which the angular velocity information is collected by the gyro sensor.

Step 704 , control the movement of the camera lens driven by the motor according to the plurality of jitter amounts.

Wherein, the imaging device further includes a motor for driving the movement of the lens of the camera and an OIS controller for controlling the movement of the motor. When the gyro sensor detects that the camera shakes, the electronic device can control the motor to drive the lens of the camera to move according to the obtained multiple shakes, and the movement of the lens is opposite to the direction of the shake to eliminate the bias caused by the shake shift.

Step 706 , the lens offset of the camera is determined based on the Hall value of the Hall sensor, and the angular velocity information is collected synchronously with the Hall value.

Among them, the imaging device also includes a Hall sensor for recording the movement of the lens. The Hall sensor is a magnetic field sensor made according to the Hall effect. The Hall effect is essentially that moving charged particles are affected by the magnetic field. Deflection due to the action of the Lorentz force. The angular velocity information collected by the gyroscope sensor corresponds to the Hall value collected by the Hall sensor in time series.

The imaging device can record the offset scale of the camera lens on the XY plane through a Hall sensor or a laser, and while recording the offset scale, it can also record the direction of the offset, the distance corresponding to each scale, and the direction of the offset , and then the lens offset p(x _i , y _j ) is obtained.

In this embodiment, based on the frequency at which the data collected by the gyro sensor and the Hall sensor correspond in time sequence, and at the same time, the data collected by the camera and the data collected by the gyro sensor are synchronized in time stamps and have different frequencies, so the time for collecting one frame of image can be Correspondingly, a plurality of angular velocity information is collected, and then a plurality of lens offsets can be determined from the plurality of angular velocity information, so as to be converted into a plurality of image offsets, and then the accuracy and effect of image compensation can be improved.

It should be understood that although the steps in the flowcharts of FIGS. 2-7 are shown in sequence according to the arrows, these steps are not necessarily executed in the sequence shown by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIGS. 2-7 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but may be executed at different times. These sub-steps or stages are not necessarily completed at the same time. The order of execution of the steps is not necessarily sequential, but may be performed alternately or alternately with other steps or at least part of sub-steps or stages of other steps.

FIG. 8 is a structural diagram of an image compensation apparatus in an embodiment. The embodiment of the present application also provides an image compensation device, which is applied to an imaging device including an optical image stabilization system. The imaging device is provided with a camera carrying an optical image stabilization system. The image compensation device includes: an exposure information acquisition module 810, a lens offset A shift acquisition module 820 , an image offset acquisition module 830 and an image compensation module 840 are included. in,

The exposure information acquisition module 810 is used to control the camera to capture images and acquire exposure information of the captured images; the camera includes an optical image stabilization system;

a lens offset acquisition module 820, configured to acquire the lens offset of the camera when it is detected that the camera shakes;

an image offset acquisition module 830, configured to determine a target calibration function according to the exposure information, and acquire an image offset corresponding to the lens offset;

The image compensation module 840 is used for compensating the image according to the exposure information and the image offset.

The above-mentioned image compensation device can control the camera to collect images, and obtain exposure information for collecting the images; when it is detected that the camera shakes, obtain the lens shift of the camera when collecting the image; determine the target according to the exposure information calibration function, and obtain the image offset corresponding to the lens offset; the image is compensated according to the exposure information and the image offset, and the image offset can be more accurately obtained according to the exposure information Shifting, and then compensating for the image, which can improve the clarity of the image.

In one embodiment, the exposure information includes shutter speed or sensitivity; the image offset acquisition module 830 includes:

a construction unit, configured to construct a mapping relationship between the standard exposure information of multiple gears and a plurality of preset calibration functions, wherein the standard exposure information of each gear corresponds to one of the preset calibration functions;

a gear determination unit, configured to determine the gear of the exposure information according to the standard exposure information of the multiple gears;

a matching unit, configured to determine, according to the mapping relationship, the target calibration function that matches the gear of the exposure information among the plurality of preset calibration functions;

An offset acquisition unit, configured to determine an image offset corresponding to the lens offset according to the target calibration function.

In one embodiment, the image offset acquisition module 830 further includes:

The function determination unit is configured to determine, for each file of the standard exposure information, a preset calibration function matching the standard exposure information.

In the image compensation method in this embodiment, a corresponding preset calibration function can be obtained according to a preset calibration model, a plurality of displacement points, and a plurality of corresponding feature points. Efficient acquisition of image offset values, higher calibration efficiency and higher accuracy, laying a good foundation for compensating images.

In one embodiment, the image compensation module 840 includes:

a level determination unit, configured to determine an exposure level of the exposure information, where the exposure level includes primary exposure, secondary exposure and tertiary exposure;

a strategy unit, configured to determine a corresponding compensation strategy according to the exposure level;

A compensation unit, configured to compensate the image according to the image offset and the compensation strategy.

In one embodiment, the strategy unit is also used to:

When the exposure level is primary exposure, the corresponding compensation strategy is frame-by-frame or frame-by-frame compensation;

When the exposure level is secondary exposure, the corresponding compensation strategy is block compensation;

When the exposure level is three-level exposure, the corresponding compensation strategy is progressive or interlaced compensation.

In this embodiment, different compensation strategies can be adaptively used to compensate the image based on different exposure levels, which can improve the image clarity under different exposure levels.

In one embodiment, when the exposure level is secondary exposure, the compensation unit is further configured to: identify the image to identify an area to be compensated and a non-compensated area, wherein each of the non-compensated areas The colors of the pixels are the same, and the proportion of the non-compensated area in the image is greater than or equal to a preset value; the compensated area is compensated according to the image offset and the compensation strategy.

In this embodiment, fine compensation can be performed on the area to be compensated, and no processing is performed on the non-compensated area, so as to improve the definition of the area to be compensated and improve the efficiency of image processing.

In one embodiment, the lens offset acquisition module 820 includes:

a jitter acquisition unit, configured to synchronously acquire multiple jitter amounts of the camera when a frame of the image is collected when it is detected that the camera shakes;

a driving unit, configured to control the motor to drive the movement of the camera lens according to the plurality of shaking amounts;

A calculation unit, configured to determine the lens shift amount of the camera based on the Hall value of the Hall sensor, and the jitter amount is collected synchronously with the Hall value.

In this embodiment, based on the frequency at which the data collected by the gyro sensor and the Hall sensor correspond in time sequence, and at the same time, the data collected by the camera and the data collected by the gyro sensor are synchronized in time stamps and have different frequencies, the time for collecting one frame of image can be Correspondingly, a plurality of angular velocity information is collected, and then a plurality of lens offsets can be determined from the plurality of angular velocity information, so as to be converted into a plurality of image offsets, and then the accuracy and effect of image compensation can be improved.

The division of each module in the above image compensation apparatus is only for illustration. In other embodiments, the image compensation apparatus may be divided into different modules as required to complete all or part of the functions of the above image compensation apparatus.

Embodiments of the present application also provide a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform any of the above-described embodiments. Image compensation method.

The embodiments of the present application also provide an electronic device. The electronic device includes an imaging device of an optical image stabilization system, a memory and a processor, the imaging device includes a camera carrying the optical image stabilization system; the memory stores computer-readable instructions, and when the instructions are executed by the processor , so that the processor executes the image compensation method in any of the above embodiments. The electronic device includes an image processing circuit, and the image processing circuit may be implemented by hardware and/or software components, and may include various processing units that define an ISP (Image Signal Processing, image signal processing) pipeline. FIG. 9 is a schematic diagram of an image processing circuit in one embodiment. As shown in FIG. 9 , for the convenience of description, only various aspects of the image compensation technology related to the embodiments of the present application are shown.

As shown in FIG. 9 , the image processing circuit includes an ISP processor 940 and a control logic 950 . Image data captured by imaging device 910 is first processed by ISP processor 940 , which analyzes the image data to capture image statistics that can be used to determine and/or control one or more parameters of imaging device 910 . Imaging device 910 may include a camera having one or more lenses 912 and an image sensor 914 . Image sensor 914 may include an array of color filters (eg, Bayer filters), image sensor 914 may obtain light intensity and wavelength information captured with each imaging pixel of image sensor 914 and provide a set of raw materials that may be processed by ISP processor 940. image data. The sensor 920 (eg, a gyroscope) may provide the acquired image compensation parameters (eg, anti-shake parameters) to the ISP processor 940 based on the sensor 920 interface type. The sensor 920 interface may utilize a SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above interfaces.

In addition, the image sensor 914 can also send raw image data to the sensor 920, the sensor 920 can provide the raw image data to the ISP processor 940 for processing based on the sensor 920 interface type, or the sensor 920 can store the raw image data in the image memory 930 .

The ISP processor 940 processes raw image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 9, 10, 12, or 14 bits, and the ISP processor 940 may perform one or more image compensation operations on the raw image data, collecting statistical information about the image data. Among them, the image compensation operation can be performed with the same or different bit depth precision.

ISP processor 940 may also receive pixel data from image memory 930 . For example, the sensor 920 interface sends the raw image data to the image memory 930, and the raw image data in the image memory 930 is provided to the ISP processor 940 for processing. The image memory 930 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access, direct memory access) feature.

When receiving raw image data from the image sensor 914 interface or from the sensor 920 interface or from the image memory 930, the ISP processor 940 may perform one or more image compensation operations, such as temporal filtering. Image data processed by ISP processor 940 may be sent to image memory 930 for additional processing before being displayed. The ISP processor 940 receives processed data from the image memory 930 and performs image data processing in the original domain and in the RGB and YCbCr color spaces on the processed data. The processed image data may be output to the display 980 for viewing by a user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the ISP processor 940 may also be sent to the image memory 930 , and the display 980 may read image data from the image memory 930 . In one embodiment, image memory 930 may be configured to implement one or more frame buffers. Additionally, the output of ISP processor 940 may be sent to encoder/decoder 970 for encoding/decoding image data. The encoded image data can be saved and decompressed prior to display on the display 980 device.

The ISP-processed image data may be sent to the encoder/decoder 970 for encoding/decoding the image data. The encoded image data can be saved and decompressed prior to display on the display 980 device. The image data processed by the ISP processor 940 may also be processed by the encoder/decoder 970 first. The encoder/decoder 970 may be a CPU (Central Processing Unit, central processing unit) or a GPU (Graphics Processing Unit, graphics processing unit) in the mobile terminal, or the like.

Statistics determined by the ISP processor 940 may be sent to the control logic 950 unit. For example, the statistics may include image sensor 914 statistics such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens 912 shading compensation, and the like. Control logic 950 may include a processor and/or microcontroller executing one or more routines (eg, firmware) that may determine control parameters of imaging device 910 and ISP processing based on received statistics control parameters of the controller 940. For example, imaging device 910 control parameters may include sensor 920 control parameters (eg, gain, integration time for exposure control, stabilization parameters, etc.), camera flash control parameters, lens 912 control parameters (eg, focal length for focusing or zooming), or these combination of parameters. ISP control parameters may include gain levels and color compensation matrices for automatic white balance and color adjustment (eg, during RGB processing), and lens 912 shading compensation parameters.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium , when the program is executed, it may include the flow of the above-mentioned method embodiments. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or the like.

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the patent of the present application. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (10)

1. an image compensation method, is characterized in that, described method comprises: Controlling a camera to capture an image, and acquiring exposure information for capturing the image; the camera includes an optical image stabilization system, and the exposure information includes shutter speed or sensitivity; When it is detected that the camera shakes, obtain the lens offset of the camera when the image is collected; Determine a target calibration function matching the exposure information according to the exposure information, and obtain an image offset corresponding to the lens offset according to the target calibration function; determining an exposure level of the exposure information, where the exposure level includes primary exposure, secondary exposure and tertiary exposure; Determine a corresponding compensation strategy according to the exposure level; The image is compensated according to the image offset and the compensation strategy. 2 . The method according to claim 1 , wherein the target calibration function matching the exposure information is determined according to the exposure information, and the lens offset is obtained according to the target calibration function. 3 . Corresponding image offsets, including: constructing a mapping relationship between the standard exposure information of multiple gears and a plurality of preset calibration functions, wherein the standard exposure information of each gear corresponds to one of the preset calibration functions; Determine the gear of the exposure information according to the standard exposure information of the plurality of gears; According to the mapping relationship, the target calibration function that matches the gear of the exposure information is determined from among the plurality of preset calibration functions; An image offset corresponding to the lens offset is determined according to the target calibration function. 3. The method according to claim 2, characterized in that, before the construction of the mapping relationship between the standard exposure information and the preset calibration function, the method further comprises: For each level of the standard exposure information, a preset calibration function matching the standard exposure information is determined. 4. The method according to claim 1, wherein the determining a corresponding compensation strategy according to the exposure level comprises: When the exposure level is primary exposure, the corresponding compensation strategy is frame-by-frame or frame-by-frame compensation; When the exposure level is secondary exposure, the corresponding compensation strategy is block compensation; When the exposure level is three-level exposure, the corresponding compensation strategy is progressive or interlaced compensation. 5. The method according to claim 4, wherein when the exposure level is secondary exposure, compensating the image according to the image offset and the compensation strategy, comprising: Identifying the image to identify the area to be compensated and the non-compensated area, wherein the color of each pixel in the non-compensated area is the same, and the proportion of the non-compensated area in the image is greater than or equal to a preset value; The to-be-compensated area is compensated according to the image offset and the compensation strategy. 6. The method according to claim 1, wherein when it is detected that the camera shakes, acquiring the lens offset of the camera when the image is captured, comprising: When it is detected that the camera shakes, synchronously acquire multiple shaking amounts of the camera when a frame of the image is collected; Controlling a motor to drive the movement of the camera lens according to the plurality of shaking amounts; The lens shift amount of the camera is determined based on the Hall value of the Hall sensor, and the jitter amount is collected synchronously with the Hall value. 7. An image compensation device, wherein the device comprises: an exposure information acquisition module, configured to control a camera to capture an image and acquire exposure information for capturing the image; the camera includes an optical image stabilization system, and the exposure information includes shutter speed or sensitivity; a lens offset acquisition module, configured to acquire the lens offset of the camera when the image is captured when it is detected that the camera shakes; an image offset acquisition module, configured to determine a target calibration function matching the exposure information according to the exposure information, and obtain an image offset corresponding to the lens offset according to the target calibration function; Image compensation module, including: a level determination unit, configured to determine an exposure level of the exposure information, where the exposure level includes primary exposure, secondary exposure and tertiary exposure; a strategy unit, configured to determine a corresponding compensation strategy according to the exposure level; A compensation unit, configured to compensate the image according to the image offset and the compensation strategy. 8. The apparatus according to claim 7, wherein the image offset acquisition module comprises: a construction unit, configured to construct a mapping relationship between the standard exposure information of multiple gears and a plurality of preset calibration functions, wherein the standard exposure information of each gear corresponds to one of the preset calibration functions; a gear determination unit, configured to determine the gear of the exposure information according to the standard exposure information of the multiple gears; a matching unit, configured to determine, according to the mapping relationship, the target calibration function that matches the gear of the exposure information among the plurality of preset calibration functions; An offset acquisition unit, configured to determine an image offset corresponding to the lens offset according to the target calibration function. 9. A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented. 10. An electronic device, comprising an imaging device of an optical image stabilization system, a memory and a processor, the imaging device comprising a camera carrying an optical image stabilization system; computer-readable instructions are stored in the memory, wherein the The instructions, when executed by the processor, cause the processor to perform the steps of the method as claimed in any one of claims 1 to 6.

Images