CN113472991B - Control method, control device, camera assembly, electronic device and medium - Google Patents
Control method, control device, camera assembly, electronic device and medium Download PDFInfo
- Publication number
- CN113472991B CN113472991B CN202110777091.XA CN202110777091A CN113472991B CN 113472991 B CN113472991 B CN 113472991B CN 202110777091 A CN202110777091 A CN 202110777091A CN 113472991 B CN113472991 B CN 113472991B
- Authority
- CN
- China
- Prior art keywords
- image sensor
- shake
- lens
- driving
- control method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/685—Vibration or motion blur correction performed by mechanical compensation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Adjustment Of Camera Lenses (AREA)
Abstract
The application discloses a control method, a control device, a camera assembly, electronic equipment and a medium. The control method is used for the camera component. The camera component comprises a lens and an image sensor, wherein the image sensor can acquire external light rays through the lens and generate corresponding original images, and the control method comprises the following steps: when a shooting command is received, focusing operation is carried out; determining the current focal length of the lens when the focusing operation is completed; determining a shake compensation displacement amount of the image sensor according to the current focal length of the lens and the shake angle of the camera component; the image sensor is driven to move according to the shake compensation displacement amount to perform shooting shake compensation. In the control method, the control device, the camera component, the electronic equipment and the medium, degradation and even abrupt change of jitter compensation effect caused by untimely signal synchronization can be avoided. In addition, stable and consistent jitter compensation can be ensured under different current focal lengths, and the consistency of the anti-jitter effect is ensured.
Description
Technical Field
The application relates to the technical field of shooting anti-shake, in particular to a control method, a control device, a camera component, electronic equipment and a medium.
Background
In general, in order to obtain an image with high definition, it is necessary to keep the photographing apparatus in a substantially stable state during photographing, which may increase photographing difficulty. Although an optical anti-shake technique has been developed to improve the problem of blurring and unclear images captured due to shake of a capturing device, in the related art, some special scenes are not considered in the optical anti-shake technique, so that the shake compensation effect is poor in the special scenes and the sharpness of the captured images is low.
Disclosure of Invention
The embodiment of the application provides a control method, a control device, a camera assembly, electronic equipment and a medium.
The control method of the embodiment of the application is used for the camera assembly. The camera component comprises a lens and an image sensor, wherein the image sensor can acquire external light through the lens and generate a corresponding original image, and the control method comprises the following steps: when a shooting command is received, focusing operation is carried out; determining a current focal length of the lens when the focusing operation is completed; determining a shake compensation displacement amount of the image sensor according to the current focal length of the lens and the shake angle of the camera component; and driving the image sensor to move according to the shake compensation displacement amount so as to carry out shooting shake compensation.
The control device of the embodiment of the application is used for the camera assembly. The camera assembly includes a lens and an image sensor. The image sensor can acquire external light through the lens and generate a corresponding original image. The control device comprises a focusing module, a first determining module, a second determining module and a compensating module. The focusing module is used for carrying out focusing operation when receiving a shooting command. The first determining module is used for determining the current focal length of the lens when the focusing operation is completed. The second determining module is used for determining the shake compensation displacement of the image sensor according to the current focal length of the lens and the shake angle of the camera component. The compensation module is used for driving the image sensor to move according to the shake compensation displacement so as to carry out shooting shake compensation.
The camera component of the embodiment of the application comprises a lens, an image sensor and a processor. The image sensor can acquire external light through the lens and generate a corresponding original image. The processor is configured to: when a shooting command is received, focusing operation is carried out; determining a current focal length of the lens when the focusing operation is completed; determining a shake compensation displacement amount of the image sensor according to the current focal length of the lens and the shake angle of the camera component; and driving the image sensor to move according to the shake compensation displacement amount so as to carry out shooting shake compensation.
The electronic device of the embodiment of the application comprises a shell and the camera assembly of the embodiment, wherein the camera assembly is combined with the shell.
The computer-readable storage medium according to the embodiment of the present application has a computer program stored thereon, and is characterized in that the steps of the control method according to the above embodiment are realized when the program is executed by a processor.
In the control method, the control device, the camera component, the electronic equipment and the medium, shooting jitter compensation is carried out after focusing operation is completed, so that degradation and even abrupt change of jitter compensation effect caused by untimely signal synchronization can be avoided. In addition, the jitter compensation displacement of the image sensor is determined according to the current focal length of the lens and the jitter angle of the camera component, so that stable and consistent jitter compensation can be ensured under different current focal lengths, and the consistency of the anti-jitter effect is ensured.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a flow chart of a control method of an embodiment of the present application;
FIG. 2 is a schematic diagram of a control device of an embodiment of the present application;
FIG. 3 is a schematic view of a camera assembly of an embodiment of the present application;
FIG. 4 is a schematic view of a first driver of a camera assembly of an embodiment of the present application;
FIG. 5 is a flow chart of a control method of an embodiment of the present application;
FIG. 6 is a schematic diagram of a control device of an embodiment of the present application;
FIG. 7 is a flow chart of a control method of an embodiment of the present application;
FIG. 8 is a schematic diagram of a control device of an embodiment of the present application;
FIG. 9 is a schematic view of a second driver of a camera assembly of an embodiment of the present application;
FIG. 10 is a flow chart of a control method of an embodiment of the present application;
FIG. 11 is a flow chart of a control method of an embodiment of the present application;
FIG. 12 is a schematic view of a camera assembly of an embodiment of the present application;
fig. 13 is a schematic view of a control device of an embodiment of the present application;
FIG. 14 is a flow chart of a control method of an embodiment of the present application;
fig. 15 is a schematic view of a control device of an embodiment of the present application;
FIG. 16 is a flow chart of a control method of an embodiment of the present application;
FIG. 17 is a flow chart of a control method of an embodiment of the present application;
fig. 18 is a schematic view of a control device of an embodiment of the present application;
FIG. 19 is a flow chart of a control method of an embodiment of the present application;
fig. 20 is a schematic view of a control device of an embodiment of the present application;
FIG. 21 is a schematic diagram of an electronic device of an embodiment of the present application;
description of main reference numerals:
the camera assembly 100, the lens 111, the image sensor 113, the processor 114, the first driving piece 115, the second driving piece 117, the image processor 119, the anti-shake driving circuit 121, the focusing driving circuit 123;
the device comprises a control device 200, a focusing module 21, a first determining module 23, a second determining module 25, a compensating module 27 and a resetting module 29;
Detailed Description
Embodiments of the present application are described in detail below, and are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
In the description of embodiments of the present application, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more of the described features. In the description of the embodiments of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
Referring to fig. 1-3, a control method according to an embodiment of the present application is used for a camera module 100. The camera assembly 100 includes a lens 111 and an image sensor 113. The image sensor 113 can acquire external light through the lens 111 and generate a corresponding original image. The control method comprises the following steps:
01: when a shooting command is received, focusing operation is carried out;
03: upon completion of the focusing operation, the current focal length of the lens 111 is determined;
05: determining a shake compensation displacement amount of the image sensor 113 according to the current focal length of the lens 111 and the shake angle of the camera assembly 100;
07: the image sensor 113 is driven to move according to the shake compensation displacement amount to perform shooting shake compensation.
The control method of the embodiment of the present application may be implemented by the control apparatus 200 of the embodiment of the present application. Specifically, the control device 200 is used for the camera assembly 100. The camera assembly 100 includes a lens 111 and an image sensor 113. The image sensor 113 can acquire external light through the lens 111 and generate a corresponding original image. The control device 200 comprises a focusing module 21, a first determination module 23, a second determination module 25 and a compensation module 27. The focusing module 21 is used for performing focusing operation when receiving a shooting command. The first determining module 23 is configured to determine a current focal length of the lens 111 when the focusing operation is completed. The second determining module 25 is configured to determine a shake compensation displacement amount of the image sensor 113 according to the current focal length of the lens 111 and the shake angle of the camera assembly 100. The compensation module 27 is used for driving the image sensor 113 to move according to the shake compensation displacement amount to perform shooting shake compensation.
The control method of the embodiment of the present application may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the camera assembly 100 includes a lens 111, an image sensor 113, and a processor 114. The image sensor 113 can acquire external light through the lens 111 and generate a corresponding original image. The processor 114 is configured to perform a focusing operation upon receiving a photographing command, and to determine a current focal length of the lens 111 upon completion of the focusing operation, and to determine a shake compensation displacement amount of the image sensor 113 according to the current focal length of the lens 111 and a shake angle of the camera assembly 100, and to drive the image sensor 113 to move according to the shake compensation displacement amount to perform photographing shake compensation.
In the control method, the control device 200 and the technical solution of the camera module 100 in this embodiment, shooting shake compensation is performed after focusing operation is completed, so that degradation or even abrupt change (such as rapid switching of close range and long range of point focusing) of shake compensation effect caused by untimely signal synchronization can be avoided when both focus control and shooting shake compensation control work independently. In addition, the shake compensation displacement amount of the image sensor 113 is determined according to the current focal length of the lens 111 and the shake angle of the camera assembly 100, so that stable and consistent shake compensation can be ensured under different current focal lengths, and consistency of anti-shake effects is ensured.
Specifically, the user may initiate a photographing command through the camera assembly 100, for example, the user may initiate a photographing command in the form of a key, touch, or voice command, or the like. The shooting command may also be initiated by an Application (APP) installed by the camera assembly 100. The photographing command may include a photograph photographing request or a video recording request.
The focusing operation, it can be understood that moving the lens 111 changes the focal length of the lens 111 so that the light reflected by the photographic subject can generate an original image with higher definition when the light is acquired by the image sensor 113 through the lens 111. The focusing operation may be automatic focusing or manual focusing by a user, and is not limited herein. It will be appreciated that the camera assembly 100 is capable of automatically determining the current focal length of the lens 111 after the focusing operation is completed.
In some embodiments, the shake compensation displacement amount is a length by which the image sensor 113 is driven to move from the calibration position in order to avoid blurring or low sharpness of the acquired original image due to shake. The amount of jitter displacement compensation can be expressed by the following formula: x=f tan θ. Where X is the jitter displacement compensation amount, f is the current focal length of the lens 111, and θ is the jitter angle of the camera assembly 100. In some embodiments, the camera assembly 100 includes a gyroscope, and the shake angle of the camera assembly 100 may be determined from measurement data of the gyroscope.
Further, after determining the shake compensation displacement amount, the image sensor 113 is driven to move in the same direction as the shake direction of the camera module 100 to perform shooting shake compensation. For example, when the shake direction of the camera module 100 is vertically downward, the image sensor 113 is driven to move in the vertically downward direction by a shake compensation displacement amount.
Referring to fig. 4, in some embodiments, the lens 111 includes a barrel 1111, and the camera assembly 100 includes a first driving member 115, and the first driving member 115 can drive the lens 111 to move along an axial direction of the barrel 1111 to perform a focusing operation.
In this way, the lens 111 can complete the focusing operation under the drive of the first driver 115.
Specifically, the first driver 115 may include a ball type voice coil motor, a dome type voice coil motor, a piezoelectric motor, etc. The lens 111 further includes a lens fixedly mounted to the barrel 1111. The lens barrel 1111 may be cylindrical, and the first driving member 115 may drive the cylindrical lens barrel 1111 to move along the axial direction under the condition of a varying current, thereby completing a focusing operation.
Referring to fig. 5 and 6, in some embodiments, the first driving member 115 includes a first magnetic member 1151, a first Coil 1153 (Coil), a first magnetic induction sensor 1155, a first iron shell 1157 and a first ball bearing 1159, the first magnetic member 1151 is fixedly mounted on the lens barrel 1111, the first Coil 1153 and the first magnetic induction sensor 1155 are fixedly mounted on the first iron shell 1157, the first Coil 1153 can drive the lens 111 to move under the action of a first driving current, the first magnetic induction sensor 1155 can measure the position of the lens 111 based on the change of magnetic flux when the lens 111 moves, the first ball bearing 1159 is disposed on the lens barrel 1111 to control the stability when the lens 111 moves along the axial direction of the lens barrel 1111, and the focusing operation includes:
011: determining the current position of the lens 111 from the data measured by the first magnetic induction sensor 1155;
013: the first driving current of the first coil 1153 is adjusted to drive the lens 111 to move from the current position to the focus position.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the focusing module 21 includes a measurement unit 211 and a driving unit 213. The measurement unit 211 is used for determining the current position of the lens 111 based on the data measured by the first magnetic induction sensor 1155. The driving unit 213 is used for adjusting a first driving current of the first coil 1153 to drive the lens 111 to move from the current position to the focus position.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to determine a current position of the lens 111 according to data measured by the first magnetic induction sensor 1155, and to adjust a first driving current of the first coil 1153 to drive the lens 111 to move from the current position to the focus position.
In this way, the lens 111 can be stably and accurately driven to the focus position.
Specifically, the first driver 115 is a ball-type voice coil motor. It will be appreciated that the lens 111 may tilt, stop oscillating, lag, etc. during movement along the axial direction of the barrel 1111, and the accuracy of the image sensor 113 below the lens 111 may be ensured by using a ball type voice coil motor. The first magnetic member 1151 may include a magnet. In the embodiment of fig. 4, the first magnetic member 1151 is fixedly installed to the outer side wall of the lens barrel 1111, and the length of the first magnetic member 1151 is the same as the length of the lens barrel 1111. The first magnetic induction sensor 1155 may comprise a Hall sensor (Hall). The first magnetic induction sensor 1155 is disposed opposite to the first magnetic member 1151. Since the first magnetic member 1151 is fixedly mounted to the lens barrel 1111, the first magnetic member 1151 maintains synchronous movement with the lens barrel 1111 as the lens barrel 1111 moves relative to the first iron shell 1157, and the first magnetic induction sensor 1155 maintains a stationary state relative to the first iron shell 1157, the first magnetic induction sensor 1155 can measure the position of the lens 111 based on a change in magnetic flux when the lens 111 moves.
Further, when the first coil 1153 is energized with the varying first driving current, a lorentz force may be generated, and after the lorentz force acts on the first magnetic member 1151, the first magnetic member 1151 drives the lens 111 to move. Since the data measured by the first magneto-inductive sensor 1155 is transmitted to the focus driving circuit 123 in real time, the first driving current can be continuously adjusted to ensure that the lens 111 reaches the accurate focus position. The focus position can be understood as a position of the lens 111 that enables generation of an original image with high definition when light reflected by a photographic subject is acquired by the image sensor 113 through the lens 111.
In some embodiments, the focal position has a first correspondence with the focal length of the lens 111, and the focal length of the lens 111 may be determined according to the focal position and the first correspondence.
Referring to fig. 7-9, in some embodiments, the camera assembly 100 includes a second driving member 117, where the second driving member 117 is capable of driving the image sensor 113 to move under the action of a second driving current, and step 07 includes:
071: determining a second driving current according to the jitter compensation displacement amount;
073: the image sensor 113 is driven to move according to the second driving current to perform shooting shake compensation.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the compensation module 27 includes a first determination unit 271 and a first compensation unit 273. The first determination unit 271 is configured to determine the second driving current according to the shake compensation displacement amount. The first compensation unit 273 is used for driving the image sensor 113 to move according to the second driving current to perform shooting shake compensation.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to determine the second driving current according to the shake compensation displacement amount, and to drive the image sensor 113 to move according to the second driving current for performing shooting shake compensation.
In this way, the image sensor 113 can be driven to move more accurately, thereby completing shooting shake compensation.
In particular, the second driver 117 may be a voice coil motor. Referring to fig. 9, in some embodiments, the second driving member 117 includes a second magnetic member 1171, a second Coil 1173 (Coil), a second magnetic induction sensor 1175, a second iron housing 1177, and a second ball bearing 1179, wherein the second magnetic member 1171 is fixedly mounted to the image sensor 113, the second Coil 1173 and the second magnetic induction sensor 1175 are fixedly mounted to the second iron housing 1177, the second Coil 1173 is capable of driving the image sensor 113 to move under the action of a second driving current, the second magnetic induction sensor 1175 is capable of measuring the position of the image sensor 113 based on the change of the magnetic flux when the image sensor 113 moves, and the second ball bearing 1179 is disposed at the side of the image sensor 113 to control the stability when the image sensor 113 moves along the side direction. The second magnetic induction sensor 1175 may comprise a Hall sensor (Hall). It is understood that the principle of the second driving member 117 driving the image sensor 113 to move is substantially the same as that of the first driving member 115 driving the lens 111 to move, and is not repeated for avoiding redundancy.
Further, after the shake compensation displacement amount is determined, the second driving current can be determined according to the shake compensation displacement amount and the preset second corresponding relation, and then the second coil drives the image sensor 113 to move under the action of the second driving current so as to perform shooting shake compensation.
Referring to fig. 10, in certain embodiments, step 07 comprises:
075: during the exposure of the image sensor 113, the image sensor 113 is driven to move according to the shake compensation displacement amount to perform shooting shake compensation.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the compensation module 27 is configured to drive the image sensor 113 to move according to the shake compensation displacement amount to perform shooting shake compensation during the exposure of the image sensor 113.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to drive the image sensor 113 to move according to the shake compensation displacement amount to perform shooting shake compensation during exposure of the image sensor 113.
In this way, performing shake compensation while exposing the image sensor 113 can save the power consumption overhead of anti-shake compensation, and avoid meaningless displacement of the image sensor 113 during non-exposure time. It can be understood that in the related art, the photographing shake compensation is performed in real time, and even if the image sensor is not in the process of exposure, since the photographing shake compensation frequency is high and the compensation range is small, it is generally mainly aimed at suppressing motion blur instead of image stabilization at the time of video photographing, and therefore, the effective operation period of the photographing shake compensation is an exposure period, and the frame interval period and readout period before exposure do not need to be performed.
Referring to fig. 11-13, in some embodiments, the camera module 100 includes an image processor 119 (ISP) and an anti-shake driving circuit 121 (OIS Driver IC), and step 075 includes, during exposure of the image sensor 113:
0751: when the image processor 119 receives the focus completion signal (Focus Ready Notification), it sends an Exposure enable command (Exposure Request) to the image sensor 113, and an anti-shake enable command (Stabilize Request) to the anti-shake driving circuit 121;
0753: when the image sensor 113 receives the exposure enabling command, exposure is performed;
0755: when the anti-shake driving circuit 121 receives the anti-shake enable command, the image sensor 113 is driven to move according to the shake compensation displacement amount to perform shooting shake compensation during the exposure of the image sensor 113.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the compensation module 27 includes a first transmission unit 275, an exposure unit 277, and a second compensation unit 279. The first transmitting unit 275 is configured to transmit an exposure enable command to the image sensor 113 and an anti-shake enable command to the anti-shake driving circuit 121 when the image processor 119 receives a focus completion signal. The exposure unit 277 is used to perform exposure when the image sensor 113 receives an exposure enable command. The second compensation unit 279 is used for driving the image sensor 113 to move according to the shake compensation displacement amount to perform shooting shake compensation during the exposure of the image sensor 113 when the shake-proof driving circuit 121 receives the shake-proof enabling command.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to send an exposure enable command to the image sensor 113 when the image processor 119 receives the focus completion signal, and send an anti-shake enable command to the anti-shake driving circuit 121, and to perform exposure when the image sensor 113 receives the exposure enable command, and to drive the image sensor 113 to move according to the shake compensation displacement amount to perform shooting shake compensation during exposure of the image sensor 113 when the anti-shake driving circuit 121 receives the anti-shake enable command.
In this way, the image sensor 113 is exposed while compensating, so that the power consumption cost of anti-shake compensation can be saved and meaningless displacement of the image sensor 113 in non-exposure time can be avoided by performing shake compensation.
Specifically, the camera assembly 100 includes a focus drive circuit 123 (AF Driver IC). When the focus driving circuit 123 completes the focus operation, the focus driving circuit 123 generates a focus completion signal and sends the focus completion signal to the image processor 119. The timing at which the image processor 119 transmits the exposure enable command and the timing at which the anti-shake enable command is transmitted are the same or substantially the same. Substantially the same, i.e., the time difference between the time when the exposure time command is sent and the time when the anti-shake enable command is sent is within a small threshold (e.g., 10 ms).
Further, when the image sensor 113 receives the exposure enabling command, exposure is immediately performed. When the anti-shake driving circuit 121 receives the anti-shake enable command, shooting shake compensation is immediately performed. It will be appreciated that since the timing at which the image processor 119 transmits the exposure enable command and the timing at which the anti-shake enable command is transmitted are the same or substantially the same, the timing at which the image sensor 113 starts exposure and the timing at which the anti-shake drive circuit 121 starts shooting shake compensation are also the same or substantially the same, thereby ensuring that shooting shake compensation is performed within the exposure timing.
It is noted that the specific values mentioned above are only for the purpose of illustrating the implementation of the present application in detail as examples and should not be construed as limiting the present application. In other examples or embodiments or examples, other values may be selected according to the present application, without specific limitation.
Referring to fig. 14 and 15, in some embodiments, after step 07, the control method further includes:
09: upon completion of the exposure of the image sensor 113, the attitude of the image sensor 113 is reset.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the control device 200 further includes a reset module 29. The reset module 29 is configured to reset the pose of the image sensor 113 when the exposure of the image sensor 113 is completed.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to reset the posture of the image sensor 113 when the exposure of the image sensor 113 is completed.
In this way, the image sensor 113 has a consistent full-stroke margin before each frame of the original image is subject to the photographing shake compensation, thereby improving the overall photographing shake compensation effect.
Specifically, during the exposure of the image sensor 113, since the position of the image sensor 113 is generally changed due to the shooting shake compensation, by determining the calibration position in advance, the image sensor 113 is reset to the calibration position each time the exposure of the image sensor 113 is completed, so that the compensation margin of the shooting shake compensation at the next exposure of the image sensor 113 can be ensured.
Referring to fig. 16, in some embodiments, the camera module 100 includes an image processor 119 and an anti-shake driving circuit 121, and step 09 includes:
091: upon completion of exposure of the image sensor 113, an anti-shake reset command (Stabilize Reset Request) is sent to the anti-shake drive circuit 121 to reset the attitude of the image sensor 113.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the reset module 29 is configured to send an anti-shake reset command to the anti-shake driving circuit 121 to reset the posture of the image sensor 113 when the exposure of the image sensor 113 is completed.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to send an anti-shake reset command to the anti-shake driving circuit 121 to reset the posture of the image sensor 113 when the exposure of the image sensor 113 is completed.
In this way, the image sensor 113 can be reset in time when the exposure of the image sensor 113 is completed.
Specifically, when the exposure of the image sensor 113 is completed, the image sensor 113 reads out the original image to the image processor 119 to ensure that the image processor 119 performs subsequent processing on the original image. In some embodiments, the image processor 119 processes the raw image to generate an output image and transmits the output image to an application for storage or display by the application. The timing at which the image sensor 113 outputs the original image is the same as or substantially the same as the timing at which the anti-shake reset command is transmitted.
Referring to fig. 17 and 18, in some embodiments, the camera assembly 100 includes an image processor 119 and a focus driving circuit 123, and step 01 includes:
015: when the image processor 119 receives a photographing command (Capture Request), it sends a Focus command (Focus Request) to the Focus driving circuit 123;
017: when the focus driving circuit 123 receives a focus command, a focus operation is performed.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the focusing module 21 includes a second transmitting unit 215 and a focusing unit 217. The second transmitting unit 215 is configured to transmit a focus command to the focus driving circuit 123 when the image processor 119 receives a photographing command. The focusing unit 217 is configured to perform a focusing operation when the focusing driving circuit 123 receives a focusing command.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to send a focus command to the focus driving circuit 123 when the image processor 119 receives a photographing command, and to perform a focus operation when the focus driving circuit 123 receives a focus command.
In this way, when the image processor 119 receives a photographing command, the focus driving circuit 123 can be quickly informed to perform a focusing operation.
Specifically, the focus drive circuit 123 may be a closed-loop autofocus control link. The shooting command may also be initiated by an Application 125 (Application) installed by the camera assembly 100.
It should be noted that, the control algorithms of the focusing driving circuit 123 and the anti-shake driving circuit 121 may be placed in the image processor 119 or the image sensor 113, where both the image processor 119 and the image sensor 113 have processing capabilities, so that the hardware costs of the focusing driving circuit 123 and the anti-shake driving circuit 121 can be simplified, and since the control algorithms of focusing operation and photographing anti-shake compensation and the processing time sequence of the image processor 119 or the processing time sequence of the image sensor 113 are located in the same processing component, I2C or SPI synchronous communication connection between the processing components can be reduced, and synchronization is directly implemented by thread control in the internal synchronization process of the processing components.
Referring to fig. 19 and 20, in some embodiments, the camera module 100 includes a focus driving circuit 123 and an anti-shake driving circuit 121, and step 03 includes:
031: when the focus driving circuit 123 completes the focus operation, a focus completion signal (Focus Ready Notification) is sent to the anti-shake driving circuit 121;
033: when the anti-shake driving circuit 121 receives the focus completion signal, the current focal length of the lens 111 is determined according to the focus completion signal.
The control method of the above embodiment may be implemented by the control device 200 of the embodiment of the present application. Specifically, the first determination module 23 includes a third transmission unit 231 and a second determination unit 233. The third transmitting unit 231 is configured to transmit a focus completion signal to the anti-shake driving circuit 121 when the focus driving circuit 123 completes a focus operation. The second determining unit 233 is configured to determine, when the anti-shake driving circuit 121 receives the focusing completion signal, a current focal length of the lens 111 according to the focusing completion signal.
The control method of the above embodiment may be implemented by the camera module 100 of the embodiment of the present application. Specifically, the processor 114 is configured to send a focus completion signal to the anti-shake driving circuit 121 when the focus driving circuit 123 completes a focus operation, and to determine a current focal length of the lens 111 according to the focus completion signal when the anti-shake driving circuit 121 receives the focus completion signal.
In this way, when the focus driving circuit 123 completes the focusing operation, the anti-shake driving circuit 121 can quickly determine the current focal length of the lens 111.
Specifically, the current focal length information of the lens 111 may be included in the focus completion signal, and thus, when the anti-shake driving circuit 121 receives the focus completion signal, the current focal length of the lens 111 may be directly determined.
Referring to fig. 21, an electronic device 1000 according to an embodiment of the present application includes a housing 300 and the camera assembly 100 according to the above embodiment, where the camera assembly 100 is combined with the housing 300.
In the technical solution of the electronic device 1000 in this embodiment of the present application, shooting shake compensation is performed after focusing operation is completed, so that degradation, even abrupt change, of shake compensation effect caused by untimely signal synchronization can be avoided. In addition, the jitter compensation displacement of the image sensor is determined according to the current focal length of the lens and the jitter angle of the camera component, so that stable and consistent jitter compensation can be ensured under different current focal lengths, and the consistency of the anti-jitter effect is ensured.
In particular, the electronic device 1000 may include a cell phone, tablet, camera, gaming machine, smart watch, or other terminal with a camera function. In the embodiment shown in fig. 21, the electronic device 1000 is a cellular phone. The camera assembly 100 is coupled to the housing 300, for example, the camera assembly 100 may be mounted within the housing 300.
It should be noted that the above explanation of the embodiments and advantageous effects of the control method, the control device 200 and the camera module 100 also applies to the electronic apparatus 1000 of the present embodiment, and is not developed in detail here to avoid redundancy.
The computer-readable storage medium according to the present embodiment stores a computer program that, when executed by a processor, performs the steps of the control method according to any of the above embodiments.
For example, in the case where the program is executed by a processor, the steps of the following control method are implemented:
01: when a shooting command is received, focusing operation is carried out;
03: upon completion of the focusing operation, the current focal length of the lens 111 is determined;
05: determining a shake compensation displacement amount of the image sensor 113 according to the current focal length of the lens 111 and the shake angle of the camera assembly 100;
07: the image sensor 113 is driven to move according to the shake compensation displacement amount to perform shooting shake compensation.
It is understood that the computer program comprises computer program code. The computer program code may be in the form of source code, object code, executable files, or in some intermediate form, among others. The computer readable storage medium may include: any entity or device capable of carrying computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a software distribution medium, and so forth. The processor may be a central processing unit, but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.
Although embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the application, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the application.
Claims (12)
1. A control method for a camera module, the camera module comprising a lens, an image processor, an anti-shake driving circuit, and an image sensor capable of acquiring external light through the lens and generating a corresponding original image, the control method comprising:
when a shooting command is received, focusing operation is carried out;
determining a current focal length of the lens when the focusing operation is completed;
determining a shake compensation displacement amount of the image sensor according to the current focal length of the lens and the shake angle of the camera component;
in the exposure process of the image sensor, driving the image sensor to move according to the shake compensation displacement to perform shooting shake compensation, specifically comprising:
transmitting an exposure enabling command to the image sensor and an anti-shake enabling command to the anti-shake driving circuit when the image processor receives a focusing completion signal;
performing exposure when the image sensor receives the exposure enabling command;
and when the anti-shake driving circuit receives the anti-shake enabling command, driving the image sensor to move according to the shake compensation displacement amount in the process of exposing the image sensor so as to carry out shooting shake compensation.
2. The control method according to claim 1, wherein the lens includes a barrel, and the camera assembly includes a first driving member that is capable of driving the lens to move in an axial direction of the barrel to perform the focusing operation.
3. The control method according to claim 2, wherein the first driving member includes a first magnetic member fixedly mounted to the lens barrel, a first coil capable of driving the lens to move by a first driving current, a first magnetic induction sensor capable of measuring a position of the lens based on a change in magnetic flux when the lens moves, a first iron case, and a first ball bearing provided to the lens barrel to control stability when the lens moves in an axial direction of the lens barrel, the focusing operation including:
determining the current position of the lens according to the data measured by the first magnetic induction sensor;
the first driving current of the first coil is adjusted to drive the lens to move from the current position to an in-focus position.
4. The control method according to claim 1, wherein the camera module includes a second driving member capable of driving the image sensor to move by a second driving current, the driving the image sensor to move according to the shake compensation displacement amount to perform shooting shake compensation, comprising:
determining the second driving current according to the jitter compensation displacement amount;
and driving the image sensor to move according to the second driving current so as to perform shooting jitter compensation.
5. The control method according to claim 1, characterized in that after said driving the image sensor to move in accordance with the shake compensation displacement amount for shooting shake compensation, the control method further comprises:
and resetting the posture of the image sensor when the exposure of the image sensor is completed.
6. The control method according to claim 5, wherein resetting the attitude of the image sensor when the exposure of the image sensor is completed, comprises:
and when the exposure of the image sensor is completed, sending an anti-shake reset command to the anti-shake driving circuit to reset the posture of the image sensor.
7. The control method according to claim 1, wherein the performing a focusing operation when a photographing command is received includes:
when the image processor receives the shooting command, sending a focusing command to the focusing driving circuit;
and when the focusing driving circuit receives the focusing command, performing focusing operation.
8. The control method according to claim 1, wherein the determining the current focal length of the lens when the focusing operation is completed includes:
when the focusing driving circuit finishes the focusing operation, sending the focusing finishing signal to the anti-shake driving circuit;
and when the anti-shake driving circuit receives the focusing completion signal, determining the current focal length of the lens according to the focusing completion signal.
9. A control device for a camera module, the camera module including a lens, an image processor, an anti-shake driving circuit, and an image sensor capable of acquiring external light through the lens and generating a corresponding original image, the control device comprising:
the focusing module is used for carrying out focusing operation when receiving a shooting command;
a first determining module, configured to determine a current focal length of the lens when the focusing operation is completed;
the second determining module is used for determining the shake compensation displacement of the image sensor according to the current focal length of the lens and the shake angle of the camera component;
the compensation module is used for driving the image sensor to move according to the shake compensation displacement to perform shooting shake compensation in the exposure process of the image sensor, and is specifically used for:
transmitting an exposure enabling command to the image sensor and an anti-shake enabling command to the anti-shake driving circuit when the image processor receives a focusing completion signal;
performing exposure when the image sensor receives the exposure enabling command;
and when the anti-shake driving circuit receives the anti-shake enabling command, driving the image sensor to move according to the shake compensation displacement amount in the process of exposing the image sensor so as to carry out shooting shake compensation.
10. The utility model provides a camera subassembly, its characterized in that, camera subassembly includes camera lens, image processor, anti-shake drive circuit, image sensor and treater, image sensor can obtain external light and generate corresponding primitive image through the camera lens, the treater is used for:
when a shooting command is received, focusing operation is carried out;
determining a current focal length of the lens when the focusing operation is completed;
determining a shake compensation displacement amount of the image sensor according to the current focal length of the lens and the shake angle of the camera component;
in the exposure process of the image sensor, the image sensor is driven to move according to the shake compensation displacement to perform shooting shake compensation, and the method is specifically used for:
transmitting an exposure enabling command to the image sensor and an anti-shake enabling command to the anti-shake driving circuit when the image processor receives a focusing completion signal;
performing exposure when the image sensor receives the exposure enabling command;
and when the anti-shake driving circuit receives the anti-shake enabling command, driving the image sensor to move according to the shake compensation displacement amount in the process of exposing the image sensor so as to carry out shooting shake compensation.
11. An electronic device, the electronic device comprising:
a housing; a kind of electronic device with high-pressure air-conditioning system
The camera assembly of claim 10, the camera assembly being coupled to the housing.
12. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the control method according to any one of claims 1-8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110777091.XA CN113472991B (en) | 2021-07-09 | 2021-07-09 | Control method, control device, camera assembly, electronic device and medium |
| PCT/CN2022/085821 WO2023279791A1 (en) | 2021-07-09 | 2022-04-08 | Control method, control device, camera assembly, electronic device, and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110777091.XA CN113472991B (en) | 2021-07-09 | 2021-07-09 | Control method, control device, camera assembly, electronic device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113472991A CN113472991A (en) | 2021-10-01 |
| CN113472991B true CN113472991B (en) | 2023-04-25 |
Family
ID=77879368
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110777091.XA Active CN113472991B (en) | 2021-07-09 | 2021-07-09 | Control method, control device, camera assembly, electronic device and medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113472991B (en) |
| WO (1) | WO2023279791A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113472991B (en) * | 2021-07-09 | 2023-04-25 | Oppo广东移动通信有限公司 | Control method, control device, camera assembly, electronic device and medium |
| CN116437206A (en) * | 2021-12-30 | 2023-07-14 | Oppo广东移动通信有限公司 | Anti-shake method, apparatus, electronic device, and computer-readable storage medium |
| CN115022548A (en) * | 2022-06-23 | 2022-09-06 | Oppo广东移动通信有限公司 | Control method, control device, electronic apparatus, and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104601897A (en) * | 2015-02-13 | 2015-05-06 | 浙江宇视科技有限公司 | Anti-shake device and method of video camera |
| CN106303220A (en) * | 2016-07-29 | 2017-01-04 | 广东欧珀移动通信有限公司 | Stabilization system calibration method, device and mobile terminal |
| CN107483825A (en) * | 2017-09-08 | 2017-12-15 | 上海创功通讯技术有限公司 | A kind of method and apparatus of automatic focus adjustable |
| CN110794547A (en) * | 2019-08-31 | 2020-02-14 | 东莞睿恩科技有限公司 | Lens driving device of ball type voice coil motor, camera device and electronic apparatus |
| CN111147741A (en) * | 2019-12-27 | 2020-05-12 | Oppo广东移动通信有限公司 | Focusing processing-based anti-shake method and device, electronic equipment and storage medium |
| CN111158103A (en) * | 2019-12-31 | 2020-05-15 | Oppo广东移动通信有限公司 | Zoom lens, camera module and electronic device |
| CN111726508A (en) * | 2020-07-06 | 2020-09-29 | 瑞声新能源发展(常州)有限公司科教城分公司 | Lens module |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006079007A (en) * | 2004-09-13 | 2006-03-23 | Konica Minolta Photo Imaging Inc | Digital camera |
| JP5458802B2 (en) * | 2008-10-23 | 2014-04-02 | リコーイメージング株式会社 | Digital camera |
| JP5181001B2 (en) * | 2010-08-09 | 2013-04-10 | キヤノン株式会社 | Image blur correction apparatus, control method therefor, and imaging apparatus and optical apparatus equipped with the image blur correction apparatus |
| JP5249377B2 (en) * | 2011-03-22 | 2013-07-31 | キヤノン株式会社 | Imaging apparatus, control method therefor, and program |
| CN108353131B (en) * | 2016-10-17 | 2021-05-04 | 华为技术有限公司 | Method and terminal device for acquiring image |
| CN111258021A (en) * | 2018-11-30 | 2020-06-09 | 新思考电机有限公司 | Driving device, camera device and electronic equipment |
| CN110012224B (en) * | 2019-03-26 | 2021-07-09 | Oppo广东移动通信有限公司 | Camera anti-shake system, camera anti-shake method, electronic device, and computer-readable storage medium |
| CN112532862A (en) * | 2019-09-18 | 2021-03-19 | 新思考电机有限公司 | Actuator, camera module, and camera mounting device |
| KR20210071253A (en) * | 2019-12-06 | 2021-06-16 | 삼성전자주식회사 | Camera movement controlling method and apparatus |
| CN112969017B (en) * | 2021-02-10 | 2023-02-24 | 维沃移动通信有限公司 | Camera module and electronic equipment |
| CN113472991B (en) * | 2021-07-09 | 2023-04-25 | Oppo广东移动通信有限公司 | Control method, control device, camera assembly, electronic device and medium |
-
2021
- 2021-07-09 CN CN202110777091.XA patent/CN113472991B/en active Active
-
2022
- 2022-04-08 WO PCT/CN2022/085821 patent/WO2023279791A1/en unknown
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104601897A (en) * | 2015-02-13 | 2015-05-06 | 浙江宇视科技有限公司 | Anti-shake device and method of video camera |
| CN106303220A (en) * | 2016-07-29 | 2017-01-04 | 广东欧珀移动通信有限公司 | Stabilization system calibration method, device and mobile terminal |
| CN107483825A (en) * | 2017-09-08 | 2017-12-15 | 上海创功通讯技术有限公司 | A kind of method and apparatus of automatic focus adjustable |
| CN110794547A (en) * | 2019-08-31 | 2020-02-14 | 东莞睿恩科技有限公司 | Lens driving device of ball type voice coil motor, camera device and electronic apparatus |
| CN111147741A (en) * | 2019-12-27 | 2020-05-12 | Oppo广东移动通信有限公司 | Focusing processing-based anti-shake method and device, electronic equipment and storage medium |
| CN111158103A (en) * | 2019-12-31 | 2020-05-15 | Oppo广东移动通信有限公司 | Zoom lens, camera module and electronic device |
| CN111726508A (en) * | 2020-07-06 | 2020-09-29 | 瑞声新能源发展(常州)有限公司科教城分公司 | Lens module |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113472991A (en) | 2021-10-01 |
| WO2023279791A1 (en) | 2023-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113472991B (en) | Control method, control device, camera assembly, electronic device and medium | |
| US11006032B2 (en) | Exchangeable lens with focus adjustment lens and transceiver for transmitting image plane transfer coefficient | |
| JP5535080B2 (en) | Camera system | |
| US20170309002A1 (en) | Camera system, camera body, and control method of camera system | |
| JP2003172961A (en) | Camera shake correcting device and photographing device | |
| JP2017161586A (en) | Image shake correction device and method of controlling image shake correction device, imaging device, program, and storage medium | |
| US10708503B2 (en) | Image capture system, image capturing apparatus, lens unit, control methods therefor, and storage medium | |
| JP2010271697A (en) | Interchangeable lens, camera body, and camera system | |
| JP6723438B2 (en) | Imaging device, imaging control method, and program | |
| JP6432038B2 (en) | Imaging device | |
| JPH07295008A (en) | Image blurring correction photographing device | |
| JP2011239131A (en) | Imaging apparatus | |
| CN107360360B (en) | Image pickup apparatus having image stabilization function, control method therefor, and storage medium | |
| JP2003307762A (en) | Blur correcting photographic device | |
| WO2013069279A1 (en) | Image capturing device | |
| JP5064831B2 (en) | Cameras, accessories and camera systems | |
| US11330179B2 (en) | Imaging device and control method thereof | |
| JP2020008785A (en) | Imaging apparatus | |
| JP2019109271A (en) | Imaging device | |
| JP2014006477A (en) | Imaging apparatus, lens device and method for controlling imaging apparatus | |
| JP2012042589A (en) | Image shake correction mechanism, lens barrel, and image sensor | |
| JP2017134185A (en) | Image blur correction device, imaging apparatus, lens unit, control method of image blur correction device, program, and storage medium | |
| JP2008139640A (en) | Imaging apparatus | |
| US11924558B2 (en) | Image pickup apparatus that performs optical image blur correction and alignment composition of plurality of still images shot in time continuous manner, control method thereof, and storage medium | |
| US11368622B2 (en) | Photographing method, photographing device and mobile terminal for shifting a lens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |