CN111093020A - Information processing method, camera module and electronic equipment - Google Patents

Information processing method, camera module and electronic equipment Download PDF

Info

Publication number
CN111093020A
CN111093020A CN201911424158.0A CN201911424158A CN111093020A CN 111093020 A CN111093020 A CN 111093020A CN 201911424158 A CN201911424158 A CN 201911424158A CN 111093020 A CN111093020 A CN 111093020A
Authority
CN
China
Prior art keywords
lens
target position
initial position
camera module
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911424158.0A
Other languages
Chinese (zh)
Other versions
CN111093020B (en
Inventor
肖鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201911424158.0A priority Critical patent/CN111093020B/en
Publication of CN111093020A publication Critical patent/CN111093020A/en
Application granted granted Critical
Publication of CN111093020B publication Critical patent/CN111093020B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Adjustment Of Camera Lenses (AREA)

Abstract

The present disclosure provides an information processing method, including: obtaining a target position; controlling a lens in a camera module to move from an initial position to the target position; and obtaining at least one first acquisition image for at least one acquisition position in the process of moving the lens from the initial position to the target position, wherein the at least one first acquisition image is used as a frame image in a continuous output file. The disclosure also provides a camera module and an electronic device.

Description

Information processing method, camera module and electronic equipment
Technical Field
The disclosure relates to an information processing method, a camera module and an electronic device.
Background
In some cases, in order to enhance the interest or the expression effect of the multimedia file, the user may want to obtain some special effects in the multimedia file.
In one processing mode, the dithering effect in the multimedia file is obtained by performing post-editing processing on an image by using a digital image processing technology on the basis of the image which is obtained by shooting by a camera module of the electronic equipment. For example, a shot picture is rotated and cut at different angles to obtain a plurality of processed pictures, and the plurality of processed pictures are combined into a dynamic picture with a shaking effect. However, since the multiple processed pictures are derived from the same capture scene relative to the electronic device, the processed judder effect is not natural, significant, and real enough.
Disclosure of Invention
One aspect of the present disclosure provides an information processing method, including: a target position is obtained. And then, controlling the lens in the camera module to move from the initial position to the target position. At least one first captured image for at least one capture position is obtained during movement of the lens from the initial position to the target position. Wherein at least one first captured image is used as a frame image in a continuous output file.
Optionally, the method further includes: and after the lens moves from the initial position to the target position, controlling the lens to return to the initial position from the target position.
Optionally, the controlling the lens to return from the target position to the initial position includes: and acquiring the deflection parameter of the camera module and the position of the lens relative to the camera module. And then, determining an initial position according to the deflection parameter of the lens and the position of the lens relative to the camera module. Then, the lens is controlled to move to the initial position.
Optionally, the obtaining the target position includes: a plurality of target locations are obtained. The above-mentioned lens in the control camera module moves to the target position from initial position and includes: and for any target position in the plurality of target positions, after the lens is restored to the initial position from the previous target position of the target position, controlling the lens to move from the initial position to the target position after a preset time interval.
Optionally, the method further includes: and obtaining a second acquisition image with the lens positioned at the initial position. Then, a continuous output file is generated based on the at least one first captured image and the second captured image.
Optionally, the controlling the lens in the camera module to move from the initial position to the target position includes: the optical anti-shake system is switched from the adaptive mode to the control mode. Then, the coordinates of the target position are acquired. Then, the coordinates of the target position are transmitted to the optical anti-shake system, so that the optical anti-shake system controls the lens to move from the initial position to the target position. The controlling the lens to return from the target position to the initial position includes: and switching the optical anti-shake system from the control mode to the adaptive mode so that the optical anti-shake system controls the lens to recover from the target position to the initial position.
Optionally, the obtaining the target position includes: and acquiring a trigger instruction, and determining a video acquisition mode corresponding to the trigger instruction. The video capture mode is used to characterize the respective offset distance and direction of the at least one target location relative to the initial location. Then, respective coordinates of the at least one target location are determined based on the video capture mode. Preset time interval
Optionally, the video capture mode is further used to characterize at least one of: a preset time interval and at least one acquisition position.
Another aspect of the present disclosure provides a camera module, including: lens and optical anti-shake system. The optical anti-shake system is used for obtaining a target position and controlling a lens in the camera module to move from an initial position to the target position. The lens is used for acquiring at least one first image aiming at least one acquisition position in the process that the lens moves from the initial position to the target position. Wherein at least one first captured image is a frame image in a continuous output file.
Optionally, the optical anti-shake system is further configured to: and after the lens moves from the initial position to the target position, controlling the lens to return to the initial position from the target position.
Another aspect of the present disclosure provides an electronic device including: the camera module comprises a memory, a processor, a computer program stored on the memory and capable of running on the processor, and a camera module. The camera module at least comprises a lens. The processor, when executing the computer program, is configured to: obtaining a target position; controlling a lens in a camera module to move from an initial position to the first target position; and acquiring at least one first acquisition image acquired when the lens moves from the initial position to the target first position and aiming at least one acquisition position, wherein the at least one first acquisition image is a frame image in a continuous output file.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the method as described above when executed.
Another aspect of the disclosure provides a computer program comprising computer executable instructions for implementing the method as described above when executed.
Drawings
For a more complete understanding of the present disclosure and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:
fig. 1 schematically illustrates an application scenario of an information processing method, a camera module, and an electronic device according to an embodiment of the present disclosure;
FIG. 2 schematically shows a flow chart of an information processing method according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates an example schematic of lens movement according to an embodiment of this disclosure;
fig. 4A schematically illustrates an example block diagram of an optical anti-shake system according to an embodiment of this disclosure;
FIG. 4B schematically illustrates an example schematic diagram of a closed control circuit of an optical anti-shake system according to an embodiment of the disclosure;
fig. 4C schematically illustrates an example schematic diagram of a body coordinate system of a camera module according to an embodiment of the disclosure;
fig. 4D schematically illustrates an example schematic view of a camera module according to an embodiment of the disclosure;
fig. 5 schematically illustrates a block diagram of a camera module according to an embodiment of the present disclosure; and
fig. 6 schematically shows a block diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
Some block diagrams and/or flow diagrams are shown in the figures. It will be understood that some blocks of the block diagrams and/or flowchart illustrations, or combinations thereof, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, which execute via the processor, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks. The techniques of this disclosure may be implemented in hardware and/or software (including firmware, microcode, etc.). In addition, the techniques of this disclosure may take the form of a computer program product on a computer-readable storage medium having instructions stored thereon for use by or in connection with an instruction execution system.
The embodiment of the disclosure provides an information processing method, a camera module and electronic equipment. The information processing method may include: a target acquisition process, a movement control process and an image acquisition process. In the target acquisition process, a target position is obtained. And then, carrying out a movement control process to control the lens in the camera module to move from the initial position to the target position. In the process of moving the lens from the initial position to the target position, an image acquisition process is performed to obtain at least one first acquired image for at least one acquisition position. Wherein the at least one first captured image acquired during the image capturing process may be part or all of the frame images in the continuous output file.
Fig. 1 schematically shows an application scenario of an information processing method, a camera module, and an electronic device according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the application scenario 100 illustrates a scenario in which a user takes an image (e.g., including pictures and videos) using an electronic device 101. When the user triggers a physical key or a virtual key on the electronic device 100 to start video photographing, the electronic device 100 starts video photographing. During video capture, a user may preview via a display screen of the electronic device 100. And then multimedia files such as dynamic pictures, videos and the like can be obtained by using the shot images.
The electronic device 101 shown in fig. 1 is a smartphone, and may have one camera or a plurality of cameras. In other embodiments, the electronic device 101 may be various electronic devices having a camera module and supporting video/image capturing, including but not limited to a smart phone, a tablet computer, a laptop portable computer, a desktop computer, and the like, without limitation.
In some cases, in order to enhance the interest or the expression effect of the multimedia file, the user may want to obtain some special effects in the multimedia file, such as a jitter (jitter) effect of the frames in the multimedia file.
In one processing mode, the dithering effect in the multimedia file is obtained by performing post-editing processing on an image by using a digital image processing technology on the basis of the image which is obtained by shooting by a camera module of the electronic equipment. For example, a shot picture is rotated and cut at different angles to obtain a plurality of processed pictures, and the plurality of processed pictures are combined into a dynamic picture with a shaking effect. However, since the plurality of processed pictures all correspond to the same field of view (angle of view) and the same imaging range (angle of coverage) of the camera assembly of the electronic device, that is, the plurality of processed pictures are derived from the same capture scene with respect to the electronic device, the processed dithering effect is not natural, significant and real enough.
According to an embodiment of the present disclosure, there is provided an information processing method for obtaining a multimedia file having a more realistic, natural, and significant dithering effect by controlling mechanical movement and image capturing of a lens in a camera module of an electronic device. The method is illustrated by the figure below. It should be noted that the sequence numbers of the respective operations in the following methods are merely used as representations of the operations for description, and should not be construed as representing the execution order of the respective operations. The method need not be performed in the exact order shown, unless explicitly stated.
Fig. 2 schematically shows a flow chart of an information processing method according to an embodiment of the present disclosure. The method is applied to the electronic equipment, and the electronic equipment at least comprises a camera module (lens), and the camera module at least comprises a lens (lens).
As shown in fig. 2, the method may include operations S210 to S230 as follows.
In operation S210, a target position is obtained.
The target position represents a deviation position of a lens in a camera module of the desired electronic device relative to the camera module, and may be represented by coordinates relative to a body coordinate system of the electronic device, or may be represented by coordinates relative to a world coordinate system, which is not limited herein. The target positions can include one or more, and any acquired target position needs to be subjected to subsequent operation.
Then, in operation S220, the lens in the camera module is controlled to move from the initial position to the target position.
The lens of the camera module is a lens group consisting of one or more lenses.
Exemplarily, fig. 3 schematically shows an example schematic diagram of a lens shift according to an embodiment of the present disclosure. As shown in fig. 3(a), when the lens 301 is in the initial position, an optical axis (optical axis) (shown by a dotted line) of the lens 301 passes through the center of the photosensitive element 302 in the camera module 300, i.e., the optical center of the lens 301 is collinear with the center of the photosensitive element 302. As shown in fig. 3(b), when the lens 301 is moved from the initial position to the target position, the optical axis of the lens 301 is shifted from the center of the photosensitive element 302, i.e., the optical center of the lens 301 and the center of the photosensitive element 302 are no longer collinear. In other embodiments, the initial position may also be set as required, and it should be noted that the effective photosensitive range of the photosensitive element can always cover the imaging range of the lens in the process of moving the lens from the initial position to the target position.
Then, in operation S230, at least one first captured image for at least one capture position is obtained as a frame image in a continuous output file in the course of moving the lens from the initial position to the target position.
Wherein, at least one acquisition position can be preset according to actual needs. For example, the target position is taken as one capturing position, and the lens is controlled to capture one first captured image while the lens is moved to the target position. When the number of the first captured images is plural, the first captured images may be used as one frame image of the subsequent continuous output file, and when the number of the first captured images is plural, the first captured images may be used as part or all of the frame images of the subsequent continuous output file. The continuous output file is the multimedia file described above, and may be, for example, a moving picture, a video, or the like.
As can be understood by those skilled in the art, the information processing method according to the embodiment of the present disclosure controls the lens in the camera module to move from the initial position to the target position after obtaining the target position, and controls the lens to capture at least one first captured image during the movement process, so as to serve as a part of or all of frame images in the multimedia file to be output. Different frame images in the multimedia file are acquired by the lens at different acquisition positions and correspond to different acquisition scenes, so that a shaking effect can be formed based on the frame images from the different acquisition scenes in the multimedia file, and the multimedia file is more real, remarkable and natural.
Further, to facilitate controlling the lens to move to a new target position next time, the information processing method according to the embodiment of the present disclosure may further include: and after detecting that the lens moves from the initial position to the target position, controlling the lens to return to the initial position from the target position. Following the example shown in fig. 3 above, after the control lens is moved from the position shown in fig. 3(a) to the position shown in fig. 3(b), the control lens is then returned from the position shown in fig. 3(b) to the position shown in fig. 3 (a).
For the case where only one target position is acquired, according to an embodiment of the present disclosure, at least one first captured image is captured in the process of controlling the lens to move from the initial position to the target position, and the at least one first captured image is used for presenting different captured scenes of the lens in the moving process. Further, when the lens is located at the initial position, the lens can be controlled to capture a second captured image, and the second captured image is used for presenting a captured scene corresponding to the lens at the initial position (i.e. when the lens is not in a moving state). Then, a continuous output file is generated based on the at least one first captured image and the second captured image. For example, the at least one first captured image and the second captured image may be combined into a continuous output file in the order from the front to the back of the image capturing time, and since the at least one first captured image and the second captured image respectively represent different capturing scenes, the continuous output file represents a transition between the different capturing scenes, that is, a shaking effect with a real and strong appearance is formed.
For the case where multiple target positions are acquired, the multiple target positions constitute a target position sequence { p1，p2，...，pNWhere N is an integer greater than 1. According to an embodiment of the present disclosure, for the sequence of target positions { p }1，p2，...，pNAny target position p iniControlling the lens to move from the initial position to the any one target position piThen controlling the lens to move from any one of the target positions piAnd returning to the initial position, wherein i is an integer which is more than or equal to 1 and less than or equal to N. And moving the lens from the initial position to the any one of the target positions piIn the process, the lens is controlled to collect M first collected images { pi，jJ is an integer of 1 or more and M or less. Then, the lens is controlled to move from any target position piAfter the lens returns to the initial position, the lens is controlled to move from the initial position to any target position p after a preset time intervaliAt the rear target position pi+1. Similarly, the lens is controlled to move from the initial position to the target position pi+1In the process, the lens is controlled to collect M first collected images { p(i+1)，jAnd then controlling the lens to move from the target position pi+1And moving to the initial position. And repeating the steps until all the target positions in the target position sequence are processed, and obtaining at least one first acquisition image aiming at each target position.
It is understood that, after obtaining the plurality of target positions, for any one of the plurality of target positions, after the lens is restored from the previous target position to the initial position, the above-mentioned embodiment controls the lens to move from the initial position to the any target position after a preset time interval, that is, the lens is controlled by the preset time intervalThe frequency of multiple movements of the lens for multiple target locations. The first captured image { p obtained as described above1，j，p2，j，...，pN，jAnd the camera is used for presenting different acquisition scenes of the lens in multiple moving processes. Further, when the lens is located at the initial position, the lens can be controlled to capture a second captured image, and the second captured image is used for presenting a captured scene corresponding to the lens at the initial position (i.e. when the lens is not in a moving state). Then, based on the first captured image { p obtained as described above1，j，p2，j，...，pN，jAnd (6) generating a continuous output file together with the second collected image. For example, the at least one first captured image and the second captured image may be combined into a continuous output file in the order from the front to the back of the image capturing time, and since the at least one first captured image and the second captured image respectively represent different capturing scenes, the continuous output file represents a transition between the different capturing scenes, that is, a shaking effect with a real and strong appearance is formed.
According to the embodiment of the disclosure, the preset time interval can be set according to actual needs, if the preset time interval is smaller, the jitter frequency is higher, and if the preset time interval is larger, the jitter frequency is lower. The offset distance and the offset direction of any two target positions in the plurality of target positions with respect to the initial position may be different, and may be set as needed. For example, a distribution curve of a target position sequence composed of a plurality of target positions follows the law of a sine wave (sine wave). The offset distance and the offset direction of the multiple movements of the lens are performed according to the rule of a sine curve. In the case where the preset time interval is small, a shake effect in which the photographic subject moves as a ripple appears in the continuous output file can be seen. For another example, a distribution curve of a target position sequence composed of a plurality of target positions conforms to the rule of a conic section (conic section), such as a circle, an ellipse, and the like. The offset distance and the offset direction of the lens moving for many times are performed according to the rule of a conical curve, and when the circular rule is met, the offset distances of the lens moving for many times are the same, but the offset directions of the lens moving for many times are different.
According to an embodiment of the present disclosure, when a user takes an image using an electronic device and desires to obtain a continuous output image having a shake effect, the above-described information processing process may be performed based on a trigger instruction of the user. Illustratively, the obtaining the target position includes: and acquiring a trigger instruction, and determining a video acquisition mode corresponding to the trigger instruction. The video capture mode is used to characterize an offset distance and direction of each of the at least one target location relative to the initial location. Then, respective coordinates of the at least one target location are determined based on the video capture mode. Furthermore, in other embodiments, the video capture mode is further used to characterize at least one of: a preset time interval and at least one acquisition position.
The above embodiments exemplify a process of obtaining a multimedia file having a dithering effect by controlling mechanical movement of a lens and image capturing in a camera module of an electronic device, and the control principle thereof is exemplified below with reference to the embodiments.
According to an embodiment of the present disclosure, the camera module of the electronic device may further include an Optical anti-shake system, which may also be referred to as an Optical Image Stabilization (OIS) system. The initial aim at that sets up optics anti-shake system in the camera module realizes optics anti-shake.
Fig. 4A schematically illustrates an example block diagram of an optical anti-shake system according to an embodiment of this disclosure.
As shown in fig. 4A, the optical anti-shake system 410 of the camera module 400 may include a gyroscope (gyro)411, a microcontroller (microcontroller)412, a hall sensor (hall sensor)413, and a driver (driver) 413. The gyroscope 411 is used for detecting the pose change of the camera module caused by vibration or shake and transmitting the pose change to the microprocessor 412. The microprocessor 412 thus calculates the amount of displacement to be compensated and sends instructions to the driver 414. The driver 414 is used for driving the lens to move according to the instruction of the microprocessor. The hall sensor 413 is used for measuring the moving position of the lens in the camera module 400 and feeding back the moving position to the microprocessor 412.
Fig. 4B schematically illustrates an example schematic diagram of a closed control circuit of an optical anti-shake system according to an embodiment of the disclosure.
As shown in fig. 4B, the gyroscope (Gyro)411 measures the pitch angular velocity ω based on the x-axis and the y-axis of the camera module 400, respectivelypitchAnd yaw rate ωyawAnd input to the microcontroller 412. The microcontroller 412 may include an integration circuit 4121, a compensation calculation circuit 4122, and a controller 4123. Pitch angle rate omegapitchAnd yaw rate ωyawThe pitch angles theta are respectively obtained through an integrating circuit 4121pitchAnd yaw angle thetayawAnd input to the compensation calculation circuit 4122. The current position (θ) of the lens measured by the hall sensor 413 with respect to the camera module 400HSx，θHSy) Also input to the compensation calculation circuit 4122. The compensation calculating circuit 4122 calculates the yaw angle θ based on the yaw angleyawAnd the current position theta of the lens on the x-axisHSxCalculating to obtain the compensation quantity theta in the x-axis directionXerrAccording to the pitch angle thetapitchAnd the current position theta of the lens on the y-axisHSyCalculating to obtain the compensation quantity theta in the y-axis directionYerr. The controller 4123 issues a command to the driver 414 according to the compensation displacements in the x-axis and the y-axis to cause the driver 414 to drive the lens to move by the corresponding compensation displacements in the x-axis and the y-axis, respectively, based on the command. Please refer to fig. 4C for the body coordinate system o-xyz of the camera module 400.
Fig. 4C schematically illustrates an example schematic diagram of a body coordinate system of a camera module according to an embodiment of the disclosure. As shown in FIG. 4C, the Pitch (Pitch) angle θpitchFor angles of rotation about the x-axis, the Yaw (Yaw) angle θyawThe Roll (Roll) angle of rotation about the z-axis is also shown for the angle of rotation about the y-axis. The example shown in fig. 4B is not mentioned because small changes in roll angle have little effect on the shot capture scene.
Fig. 4D schematically illustrates an example schematic of a camera module according to an embodiment of this disclosure. As shown in fig. 4D, the lens 420 can move in a receiving space of the camera module 400, and the lens 420 is disposed in the receiving space through a plurality of springs (springs) 430. Driver 414 may include a magnet (magnet)4141 and a coil (coil) 4142. The displacement of the lens 420 is controlled by controlling the magnitude and direction of the current in each coil 4142 to control the distance between each pair of opposing magnets 4141 and coils 4142.
The above process may be called an adaptive mode of the optical anti-shake system, and adaptive compensation and adjustment are performed on shaking conditions of a user who uses the electronic device to perform shooting, such as breathing, heartbeat, and involuntary body shaking. In addition to the adaptive mode, the optical anti-shake system can be set to a control mode in which the instruction output by the microcontroller can be adjusted directly by an active input to the microcontroller. Thereby causing the driver to perform a driving process according to the instruction.
Based on the principle, the optical anti-shake system in the camera module can drive the lens to move towards all directions and detect the moving position of the lens in real time. According to the embodiment of the disclosure, the information processing method according to the embodiment of the disclosure can be implemented by using the optical anti-shake system without changing the hardware configuration of the camera module.
For example, the process of controlling the lens in the camera module to move from the initial position to the target position may include: the optical anti-shake system is switched from the adaptive mode to the control mode. Then, the coordinates of the target position are acquired. Then, the coordinates of the target position are sent to the optical anti-shake system, so that the controller in the optical anti-shake system generates an instruction for the coordinates of the target position and sends the instruction to the driver, and the driver controls the lens to move from the initial position to the target position based on the instruction. In the process of controlling the lens to return from the target position to the initial position, the optical anti-shake system may be switched from the control mode to the adaptive mode, so that the optical anti-shake system controls the lens to return from the target position to the initial position based on the above-mentioned operating principle in the adaptive mode.
For example, the process of controlling the lens to return from the target position to the initial position may include: the optical anti-shake system uses the gyroscope to obtain the deflection parameters (which may include the pitch angle and the yaw angle, for example) of the camera module, and uses the hall sensor to obtain the position of the lens relative to the camera module. And then, determining an initial position by using the microprocessor according to the deflection parameter of the lens and the position of the lens relative to the camera module. Then, the lens is controlled to move to the initial position by the driver.
Fig. 5 schematically illustrates a block diagram of a camera module according to an embodiment of the present disclosure.
As shown in fig. 5, the camera module 500 may include: a lens 510 and an optical anti-shake system 520.
The optical anti-shake system 520 has the same functions as the optical anti-shake system 410 shown in fig. 4A to 4D, and repeated descriptions thereof are omitted. The optical anti-shake system 520 is used to obtain a target position and control the lens 510 in the camera module 500 to move from an initial position to the target position. The control process is described above and will not be described in detail here.
The lens 510 has the same function as the lens 301/420 shown in fig. 3 and fig. 4A to 4D, and repeated descriptions are omitted. The lens 510 is used to capture at least one first image for at least one capture position during movement of the lens 510 from an initial position to a target position. Wherein at least one first captured image is a frame image in a continuous output file.
According to an embodiment of the present disclosure, the optical anti-shake system 520 is further configured to: after the lens 510 is moved from the initial position to the target position, the lens 510 is controlled to return from the target position to the initial position. The control process is described above and will not be described in detail here.
It should be noted that the implementation, solved technical problems, implemented functions, and achieved technical effects of each module/unit/subunit and the like in the apparatus part embodiment are respectively the same as or similar to the implementation, solved technical problems, implemented functions, and achieved technical effects of each corresponding step in the method part embodiment, and are not described herein again.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
Fig. 6 schematically shows a block diagram of an electronic device adapted to implement the above described method according to an embodiment of the present disclosure. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 600 includes a processor 610, a computer-readable storage medium 620, and a camera module 630. The camera module 630 at least includes a lens 631. The electronic device 600 may perform the information processing method according to the embodiment of the present disclosure. Illustratively, the computer program when executed by a processor is operative to: obtaining a target position; controlling a lens in a camera module to move from an initial position to the first target position; and acquiring at least one first acquisition image acquired when the lens moves from the initial position to the target first position and aiming at least one acquisition position, wherein the at least one first acquisition image is a frame image in a continuous output file.
In particular, the processor 610 may comprise, for example, a general purpose microprocessor, an instruction set processor and/or related chip set and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. The processor 610 may also include onboard memory for caching purposes. The processor 610 may be a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
Computer-readable storage medium 620, for example, may be a non-volatile computer-readable storage medium, specific examples including, but not limited to: magnetic storage devices, such as magnetic tape or Hard Disk Drives (HDDs); optical storage devices, such as compact disks (CD-ROMs); a memory, such as a Random Access Memory (RAM) or a flash memory; and so on.
The computer-readable storage medium 620 may include a computer program 621, which computer program 621 may include code/computer-executable instructions that, when executed by the processor 610, cause the processor 610 to perform a method according to an embodiment of the disclosure, or any variation thereof.
The computer program 621 may be configured with, for example, computer program code comprising computer program modules. For example, in an example embodiment, code in computer program 621 may include one or more program modules, including 621A, 621B, … …, for example. It should be noted that the division and number of the modules are not fixed, and those skilled in the art may use suitable program modules or program module combinations according to actual situations, so that the processor 610 may execute the method according to the embodiment of the present disclosure or any variation thereof when the program modules are executed by the processor 610.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
While the disclosure has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents. Accordingly, the scope of the present disclosure should not be limited to the above-described embodiments, but should be defined not only by the appended claims, but also by equivalents thereof.

Claims (10)

1. An information processing method comprising:
obtaining a target position;
controlling a lens in a camera module to move from an initial position to the target position; and
obtaining at least one first captured image for at least one capture position during movement of the lens from the initial position to the target position, wherein the at least one first captured image is as a frame image in a continuous output file.
2. The method of claim 1, further comprising:
and after the lens is moved from the initial position to the target position, controlling the lens to return to the initial position from the target position.
3. The method of claim 2, wherein the controlling the lens to return from the target position to the initial position comprises:
acquiring deflection parameters of the camera module and the position of the lens relative to the camera module;
determining the initial position according to the deflection parameter of the lens and the position of the lens relative to the camera module; and
and controlling the lens to move to the initial position.
4. The method of claim 2, wherein the obtaining a target location comprises: obtaining a plurality of target positions;
the controlling the lens in the camera module to move from the initial position to the target position comprises: and for any target position in the target positions, after the lens returns to the initial position from a previous target position of the target position, controlling the lens to move from the initial position to the target position after a preset time interval.
5. The method of claim 2, further comprising:
obtaining a second acquisition image of the lens at the initial position; and
generating a continuous output file based on the at least one first captured image and the second captured image.
6. The method of claim 2, wherein,
the controlling the lens in the camera module to move from the initial position to the target position comprises:
switching the optical anti-shake system from an adaptive mode to a control mode;
acquiring coordinates of the target position; and
sending the coordinates of the target position to the optical anti-shake system so that the optical anti-shake system controls the lens to move from the initial position to the target position;
the controlling the lens to return from the target position to the initial position includes: switching the optical anti-shake system from the control mode to the adaptive mode so that the optical anti-shake system controls the lens to return from the target position to the initial position.
7. The method of claim 1, wherein the obtaining a target location comprises:
acquiring a trigger instruction;
determining a video acquisition mode corresponding to the trigger instruction, wherein the video acquisition mode is used for representing the offset distance and the direction of at least one target position relative to the initial position respectively at a preset time interval; and
determining respective coordinates of the at least one target location based on the video capture mode.
8. The method of claim 7, wherein the video capture mode is further used to characterize at least one of: the preset time interval and the at least one acquisition location.
9. A camera module, comprising: a lens and an optical anti-shake system;
the optical anti-shake system is used for obtaining a target position; controlling a lens in the camera module to move from an initial position to the target position;
the lens is used for acquiring at least one first image aiming at least one acquisition position in the process that the lens moves from the initial position to the target position, wherein the at least one first acquisition image is a frame image in a continuous output file.
10. An electronic device, comprising: the camera module comprises a memory, a processor, a computer program which is stored on the memory and can run on the processor, and a camera module;
the camera module at least comprises a lens;
the processor, when executing the computer program, is configured to:
obtaining a target position;
controlling a lens in a camera module to move from an initial position to the first target position; and
and acquiring at least one first acquisition image acquired when the lens moves from the initial position to the target first position and aiming at least one acquisition position, wherein the at least one first acquisition image is a frame image in a continuous output file.
CN201911424158.0A 2019-12-31 2019-12-31 Information processing method, camera module and electronic equipment Active CN111093020B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911424158.0A CN111093020B (en) 2019-12-31 2019-12-31 Information processing method, camera module and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911424158.0A CN111093020B (en) 2019-12-31 2019-12-31 Information processing method, camera module and electronic equipment

Publications (2)

Publication Number Publication Date
CN111093020A true CN111093020A (en) 2020-05-01
CN111093020B CN111093020B (en) 2022-03-25

Family

ID=70398711

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911424158.0A Active CN111093020B (en) 2019-12-31 2019-12-31 Information processing method, camera module and electronic equipment

Country Status (1)

Country Link
CN (1) CN111093020B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111787200A (en) * 2020-06-23 2020-10-16 上海源涛信息科技有限公司 Anti-falling protection system and method for lens and image acquisition equipment
WO2022000549A1 (en) * 2020-06-30 2022-01-06 诚瑞光学(常州)股份有限公司 Lens driving apparatus
WO2022000548A1 (en) * 2020-06-30 2022-01-06 诚瑞光学(常州)股份有限公司 Lens driving apparatus
WO2022083489A1 (en) * 2020-10-22 2022-04-28 重庆传音通讯技术有限公司 Camera module and mobile terminal

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003021780A (en) * 2001-07-10 2003-01-24 Nidec Copal Corp Camera apparatus
CN103491308A (en) * 2013-10-10 2014-01-01 珠海市魅族科技有限公司 Method and terminal for acquiring image data
CN108683854A (en) * 2018-07-02 2018-10-19 羊晓东 A kind of stabilizer of included Image Acquisition camera
CN108989629A (en) * 2017-06-02 2018-12-11 宁波舜宇光电信息有限公司 Driving assembly and camera module and its electronic equipment
CN109743489A (en) * 2019-02-14 2019-05-10 南京泓众电子科技有限公司 A kind of rotary camera and big visual angle method, photo taking
CN110012224A (en) * 2019-03-26 2019-07-12 Oppo广东移动通信有限公司 Camera stabilization system, method, electronic equipment and computer readable storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003021780A (en) * 2001-07-10 2003-01-24 Nidec Copal Corp Camera apparatus
CN103491308A (en) * 2013-10-10 2014-01-01 珠海市魅族科技有限公司 Method and terminal for acquiring image data
CN108989629A (en) * 2017-06-02 2018-12-11 宁波舜宇光电信息有限公司 Driving assembly and camera module and its electronic equipment
CN108683854A (en) * 2018-07-02 2018-10-19 羊晓东 A kind of stabilizer of included Image Acquisition camera
CN109743489A (en) * 2019-02-14 2019-05-10 南京泓众电子科技有限公司 A kind of rotary camera and big visual angle method, photo taking
CN110012224A (en) * 2019-03-26 2019-07-12 Oppo广东移动通信有限公司 Camera stabilization system, method, electronic equipment and computer readable storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111787200A (en) * 2020-06-23 2020-10-16 上海源涛信息科技有限公司 Anti-falling protection system and method for lens and image acquisition equipment
CN111787200B (en) * 2020-06-23 2022-03-01 上海源涛信息科技有限公司 Anti-falling protection system and method for lens and image acquisition equipment
WO2022000549A1 (en) * 2020-06-30 2022-01-06 诚瑞光学(常州)股份有限公司 Lens driving apparatus
WO2022000548A1 (en) * 2020-06-30 2022-01-06 诚瑞光学(常州)股份有限公司 Lens driving apparatus
WO2022083489A1 (en) * 2020-10-22 2022-04-28 重庆传音通讯技术有限公司 Camera module and mobile terminal

Also Published As

Publication number Publication date
CN111093020B (en) 2022-03-25

Similar Documents

Publication Publication Date Title
CN111093020B (en) Information processing method, camera module and electronic equipment
US9667862B2 (en) Method, system, and computer program product for gamifying the process of obtaining panoramic images
US9723203B1 (en) Method, system, and computer program product for providing a target user interface for capturing panoramic images
US10104300B2 (en) System and method for supporting photography with different effects
US10165157B2 (en) Method and device for hybrid robotic/virtual pan-tilt-zoom cameras for autonomous event recording
JP6071545B2 (en) IMAGING DEVICE, IMAGE PROCESSING DEVICE AND ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM
US10404915B1 (en) Method and system for panoramic video image stabilization
US11200752B1 (en) Color correction for immersive content production systems
JP7319974B2 (en) Method for Realizing Bullet Time Shooting Effect and Panoramic Camera
CN112311965A (en) Virtual shooting method, device, system and storage medium
KR101997991B1 (en) Image merging method and system using viewpoint transformation
CN110062165B (en) Video processing method and device of electronic equipment and electronic equipment
WO2019104569A1 (en) Focusing method and device, and readable storage medium
CN110049246A (en) Video anti-fluttering method, device and the electronic equipment of electronic equipment
KR101645427B1 (en) Operation method of camera apparatus through user interface
US11489998B2 (en) Image capturing apparatus and method of controlling image capturing apparatus
Inoue et al. Motion-blur-free video shooting system based on frame-by-frame intermittent tracking
JP2013131905A (en) Imaging device
WO2021207943A1 (en) Projection display method and system based on multiple photographic apparatuses, and terminal and storage medium
JP2011239178A (en) Imaging device
KR101993468B1 (en) Apparatus and method for stabilizing multi channel image
JP5153183B2 (en) Image shake correction apparatus and imaging apparatus
CN111781998A (en) Electronic device and information processing method
JP2015103918A (en) Imaging apparatus and imaging apparatus control method
US10951829B2 (en) Image capturing apparatus and method for controlling display

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant