CN111935370A - Camera module, shooting method and device - Google Patents

Camera module, shooting method and device Download PDF

Info

Publication number
CN111935370A
CN111935370A CN202010663758.9A CN202010663758A CN111935370A CN 111935370 A CN111935370 A CN 111935370A CN 202010663758 A CN202010663758 A CN 202010663758A CN 111935370 A CN111935370 A CN 111935370A
Authority
CN
China
Prior art keywords
object distance
focal length
tof
shooting
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010663758.9A
Other languages
Chinese (zh)
Inventor
徐爱新
孟伟
黄庆跃
王旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunshan Q Technology Co Ltd
Original Assignee
Kunshan Q Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunshan Q Technology Co Ltd filed Critical Kunshan Q Technology Co Ltd
Priority to CN202010663758.9A priority Critical patent/CN111935370A/en
Publication of CN111935370A publication Critical patent/CN111935370A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/671Focus control based on electronic image sensor signals in combination with active ranging signals, e.g. using light or sound signals emitted toward objects

Abstract

The invention relates to the technical field of image processing, in particular to a camera module, a shooting method and a shooting device. This module of making a video recording includes: the TOF light-sensitive chip is arranged on the base plate and electrically connected with the base plate, and the controller is connected with the motor, the light emitter and the TOF light-sensitive chip, and the lens can move along the optical axis direction of the lens relative to the TOF light-sensitive chip under the driving of the motor; when the camera module carries out image shooting, the controller is used for controlling the TOF light emitter and the TOF photosensitive chip to obtain the object distance of a shooting object and controlling the motor to drive the lens to move to the focal distance position corresponding to the object distance. The image definition in the range of variable depth of field is realized.

Description

Camera module, shooting method and device
Technical Field
The invention relates to the field of image processing, in particular to a camera module, a shooting method and a shooting device.
Background
TOF (Time of Flight) technology generates depth information by continuously sending light pulses to a target, reflecting off of the target object, receiving light returning from the object with a sensor, and calculating the distance to the object being photographed by calculating the difference in light ray emission and emission times or phase. Such depth information may be used for 3D image construction, segmentation of target images, labeling, recognition, tracking, and other applications. At present, the TOF lens is basically an integral lens or a lens with a fixed focal length in a screw mode, and an image is only clear within a specified depth of field range, and beyond the range, the image becomes blurred, and some errors exist in distance measurement.
Disclosure of Invention
The embodiment of the invention provides a camera module, a shooting method and a shooting device, which are used for providing a focusing TOF camera module and realizing clear images in a range of variable depth of field.
In a first aspect, the present invention provides a camera module, including:
the optical fiber TOF sensor comprises a lens, a motor, an optical filter, a base support, a photosensitive chip, a substrate, a TOF illuminator and a controller, wherein the lens is arranged in the motor, the optical filter is arranged between the motor and the base support, the TOF illuminator is arranged on the base support, the TOF photosensitive chip is arranged on the substrate, the TOF photosensitive chip is electrically connected with the substrate, the controller is connected with the motor, the illuminator and the TOF photosensitive chip, and the lens can move along the optical axis direction of the lens relative to the TOF photosensitive chip under the driving of the motor;
when the camera module carries out image shooting, the controller is used for controlling the TOF light emitter and the TOF photosensitive chip to obtain the object distance of a shooting object and controlling the motor to drive the lens to move to the focal distance position corresponding to the object distance.
Optionally, the motor includes any one of a voice coil motor, a micro-electromechanical MEMS driving module, a shape memory alloy SMA driving module, a liquid crystal driving module, a liquid driving module, and an adjustable lens TLENS driving module.
Optionally, the TOF light emitter is configured to emit a light signal with a specific wavelength, and the TOF photosensitive chip is configured to receive a reflected light signal of the light signal reflected by a shooting object, and obtain an object distance of the shooting object based on the reflected light signal.
Optionally, a plurality of object distance intervals are prestored in the controller, and different object distance intervals correspond to different focal length intervals, and when the controller obtains the current object distance of the shooting object detected by the TOF light emitter, the controller determines a target object distance interval to which the current object distance belongs, determines a target focal length interval corresponding to the target object distance interval, and determines a focal length position corresponding to the current object distance from the target focal length interval.
Optionally, the focal length position is included in the focal length position, and the definition of an image shot by the camera module meets a preset condition.
In a second aspect, the present invention provides a shooting method applied to the camera module set of the first aspect, where the method includes:
when image shooting is carried out, the object distance of the shooting object is obtained through the TOF light emitter and the TOF photosensitive chip;
determining a focal length position corresponding to the object distance;
controlling the motor to drive the lens to move to the focal length position;
and shooting to obtain an image at the focal position.
Optionally, the determining a focal length position corresponding to the object distance includes:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
Optionally, the determining a focal length position corresponding to the object distance from the target focal length interval includes:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
In a third aspect, the present invention provides a shooting device applied to the camera module set of the first aspect, the device including:
the acquisition module is used for acquiring the object distance of the shooting object through the TOF light emitter and the TOF photosensitive chip when image shooting is carried out;
a determining module for determining a focal length position corresponding to the object distance;
the control module is used for controlling the motor to drive the lens to move to the focal length position;
and the shooting module is used for shooting and obtaining the image at the focal length position.
Optionally, the determining module is specifically configured to:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
Optionally, the determining module is specifically configured to:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
In a fourth aspect, the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a controller, performs the steps of the method of the second aspect.
In a fifth aspect, the present invention provides a terminal system, including the camera module according to the first aspect.
One or more technical solutions in the embodiments of the present application have at least one or more of the following technical effects:
in the technical scheme of the embodiment of the invention, the TOF camera module capable of focusing comprises a lens, a motor, an optical filter, a base support, a time-of-flight TOF photosensitive chip, a substrate, a TOF illuminator and a controller, wherein the lens is arranged in the motor, the optical filter is arranged between the motor and the base support, the TOF illuminator is arranged on the base support, the TOF photosensitive chip is arranged on the substrate, the TOF photosensitive chip is electrically connected with the substrate, the controller is connected with the motor, the illuminator and the TOF photosensitive chip, and the lens can move along the optical axis direction of the lens relative to the TOF photosensitive chip under the driving of the motor. Furthermore, when the camera module carries out image shooting, the controller can control the TOF light emitter and the TOF photosensitive chip to obtain the object distance of a shooting object, and control the motor to drive the lens to move to the focal distance position corresponding to the object distance. Therefore, the TOF camera module in the embodiment of the invention can be used for focusing according to different shooting requirements, adjusting to different focal length positions and obtaining a clear depth-of-field image. Furthermore, the range of distance measurement is widened, the range capable of being accurately calibrated is larger, and the clear image in the range of variable depth of field is realized.
Drawings
FIG. 1 is a schematic diagram of one possible terminal system;
fig. 2 is an exploded view of the camera module according to the first embodiment of the present invention;
FIG. 3 is a schematic view of an assembly structure of the camera module according to the first embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating a camera module obtaining an object distance of a subject according to a first embodiment of the present invention;
FIG. 5 is a flowchart of a photographing method according to a second embodiment of the present invention;
fig. 6 is a schematic structural diagram of a photographing device according to a third embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a camera module, a shooting method and a shooting device, which are used for providing a TOF camera module capable of automatically zooming and realizing the purpose that an image is clear within a range of variable depth of field.
In order to solve the technical problems, the technical scheme provided by the invention is as follows:
in the technical scheme of the embodiment of the invention, the TOF camera module capable of focusing comprises a lens, a motor, an optical filter, a base support, a time-of-flight TOF photosensitive chip, a substrate, a TOF illuminator and a processor, wherein the lens is arranged in the motor, the optical filter is arranged between the motor and the base support, the TOF illuminator is arranged on the base support, the TOF photosensitive chip is arranged on the substrate, the TOF photosensitive chip is electrically connected with the substrate, the processor is connected with the motor, the illuminator and the TOF photosensitive chip, and the lens can move along the optical axis direction of the lens relative to the substrate under the driving of the motor. Furthermore, when the camera module carries out image shooting, the processor can control the TOF light emitter and the TOF photosensitive chip to obtain the object distance of a shooting object, and control the motor to drive the lens to move to the focal distance position corresponding to the object distance. Like this, through the TOF module of making a video recording that can zoom automatically, enlarge the clear scope of range finding, the scope that can accurate demarcation is bigger, realizes that the image is clear in the scope of variable depth of field.
The technical solutions of the present invention are described in detail below with reference to the drawings and specific embodiments, and it should be understood that the specific features in the embodiments and examples of the present invention are described in detail in the technical solutions of the present application, and are not limited to the technical solutions of the present application, and the technical features in the embodiments and examples of the present application may be combined with each other without conflict.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
In order to conveniently introduce the technical scheme in the embodiment of the present invention, a terminal system to which the camera module in the embodiment of the present invention is applicable is introduced. Please refer to fig. 1, which is a schematic diagram of a possible terminal system. In fig. 1, a terminal system 100 is a system including a touch input device 101. However, it should be understood that the system may also include one or more other physical user interface devices, such as a physical keyboard, mouse, and/or joystick. The operation platform of the terminal system 100 may be adapted to operate one or more operating systems, such as general operating systems, e.g., an Android operating system, a Windows operating system, an apple IOS operating system, a BlackBerry operating system, and a google Chrome operating system. However, in other embodiments, the terminal system 100 may run a dedicated operating system instead of a general-purpose operating system.
In some embodiments, the terminal system 100 may also support the running of one or more applications, including but not limited to one or more of the following: disk management applications, secure encryption applications, rights management applications, system setup applications, word processing applications, presentation slide applications, spreadsheet applications, database applications, gaming applications, telephone applications, video conferencing applications, email applications, instant messaging applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, digital video player applications, and the like.
The operating system and various applications running on the terminal system may use the touch input device 101 as a physical input interface device for the user. The touch input device 101 has a touch surface as a user interface. Optionally, the touch surface of the touch input device 101 is a surface of the display screen 102, and the touch input device 101 and the display screen 102 together form the touch-sensitive display screen 120, however, in other embodiments, the touch input device 101 has a separate touch surface that is not shared with other device modules. The touch sensitive display screen still further includes one or more contact sensors 106 for detecting whether a contact has occurred on the touch input device 101.
The touch sensitive Display 120 may alternatively use LCD (Liquid Crystal Display) technology, LPD (light-emitting polymer Display) technology, or LED (light-emitting diode) technology, or any other technology that enables image Display. Touch-sensitive display screen 120 further may detect contact and any movement or breaking of contact using any of a variety of touch sensing technologies now known or later developed, such as capacitive sensing technologies or resistive sensing technologies. In some embodiments, touch-sensitive display screen 120 may detect a single point of contact or multiple points of contact and changes in their movement simultaneously.
In addition to the touch input device 101 and the optional display screen 102, the terminal system 100 can also include memory 103 (which optionally includes one or more computer-readable storage media), a memory controller 104, and one or more processors (processors) 105, which can communicate via one or more signal buses 107.
Memory 103 may include Cache (Cache), high-speed Random Access Memory (RAM), such as common double data rate synchronous dynamic random access memory (DDR SDRAM), and may also include non-volatile memory (NVRAM), such as one or more read-only memories (ROM), disk storage devices, Flash memory (Flash) memory devices, or other non-volatile solid-state memory devices, such as compact disks (CD-ROM, DVD-ROM), floppy disks, or data tapes, among others. Memory 103 may be used to store the aforementioned operating system and application software, as well as various types of data generated and received during system operation. Memory controller 104 may control other components of system 100 to access memory 103.
The processor 105 is used to run or execute the operating system, various software programs, and its own instruction set stored in the internal memory 103, and is used to process data and instructions received from the touch input device 101 or from other external input pathways to implement various functions of the system 100. The processor 105 may include, but is not limited to, one or more of a Central Processing Unit (CPU), a general purpose image processor (GPU), a Microprocessor (MCU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), and an Application Specific Integrated Circuit (ASIC). In some embodiments, processor 105 and memory controller 104 may be implemented on a single chip. In some other embodiments, they may be implemented separately on separate chips from each other.
In fig. 1, a signal bus 107 is configured to connect the various components of the end system 100 for communication. It should be understood that the configuration and connection of the signal bus 107 shown in fig. 1 is exemplary and not limiting. Depending on the specific application environment and hardware configuration requirements, in other embodiments, the signal bus 107 may adopt other different connection manners, which are familiar to those skilled in the art, and conventional combinations or changes thereof, so as to realize the required signal connection among the various components.
Further, in some embodiments, the terminal system 100 may also include peripheral I/O interfaces 111, RF circuitry 112, audio circuitry 113, speakers 114, microphone 115, and camera module 116. The device 100 may also include one or more heterogeneous sensor modules 118.
RF (radio frequency) circuitry 112 is used to receive and transmit radio frequency signals to enable communication with other communication devices. The RF circuitry 112 may include, but is not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a Subscriber Identity Module (SIM) card, memory, and so forth. The RF circuitry 112 optionally communicates with networks, such as the internet (also known as the World Wide Web (WWW)), intranets, and/or wireless networks, such as cellular telephone networks, wireless Local Area Networks (LANs), and/or Metropolitan Area Networks (MANs), as well as other devices via wireless communications. The RF circuitry 112 may also include circuitry for detecting Near Field Communication (NFC) fields. The wireless communication may employ one or more communication standards, protocols, and techniques including, but not limited to, Global System for Mobile communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), evolution, data-only (EV-DO), HSPA +, Dual-cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), wideband code division multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth Low Power consumption, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and/or IEEE 802.11ac), Voice over Internet protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and/or Post Office Protocol (POP)) Instant messaging (e.g., extensible messaging and presence protocol (XMPP), session initiation protocol for instant messaging and presence with extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and/or Short Message Service (SMS), or any other suitable communication protocol including communication protocols not yet developed at the time of filing date of this application.
Audio circuitry 113, speaker 114, and microphone 115 provide an audio interface between a user and end system 100. The audio circuit 113 receives audio data from the external I/O port 111, converts the audio data into an electric signal, and transmits the electric signal to the speaker 114. The speaker 114 converts the electrical signals into human-audible sound waves. The audio circuit 113 also receives electrical signals converted by the microphone 115 from sound waves. The audio circuit 113 may further convert the electrical signal to audio data and transmit the audio data to the external I/O port 111 for processing by an external device. The audio data may be transferred to the memory 103 and/or the RF circuitry 112 under the control of the processor 105 and the memory controller 104. In some implementations, the audio circuit 113 may also be connected to a headset interface.
The camera module 116 is used to take still images and video according to instructions from the processor 105. The camera module 116 may have a lens device 1161 and an image sensor 1162, and may be capable of receiving an optical signal from the outside through the lens device 1161 and converting the optical signal into an electrical signal through the image sensor 1162, such as a metal-oxide complementary photo transistor (CMOS) sensor or a Charge Coupled Device (CCD) sensor. The camera module 116 may further have an image processor (ISP)1163 for processing and correcting the aforementioned electric signals and converting them into specific image format files, such as JPEG (joint photographic experts group) image files, TIFF (tagged image file format) image files, and the like. The image file may be sent to memory 103 for storage or to RF circuitry 112 for transmission to an external device, according to instructions from processor 105 and memory controller 104.
External I/O port 111 provides an interface for end system 100 to other external devices or system surface physical input modules. The surface physical input module may be a key, a keyboard, a dial, etc., such as a volume key, a power key, a return key, and a camera key. The interface provided by the external I/O port 111 may also include a Universal Serial Bus (USB) interface (which may include USB, Mini-USB, Micro-USB, USB Type-C, etc.), a Thunderbolt (Thunderbolt) interface, a headset interface, a video transmission interface (e.g., a high definition multimedia HDMI interface, a mobile high definition link (MHL) interface), an external storage interface (e.g., an external memory card SD card interface), a subscriber identity module card (SIM card) interface, and so forth.
The sensor module 118 may have one or more sensors or sensor arrays, including but not limited to: 1. a location sensor, such as a Global Positioning Satellite (GPS) sensor, a beidou satellite positioning sensor or a GLONASS (GLONASS) satellite positioning system sensor, for detecting the current geographical location of the device; 2. the acceleration sensor, the gravity sensor and the gyroscope are used for detecting the motion state of the equipment and assisting in positioning; 3. a light sensor for detecting external ambient light; 4. the distance sensor is used for detecting the distance between an external object and the system; 5. the pressure sensor is used for detecting the pressure condition of system contact; 6. and the temperature and humidity sensor is used for detecting the ambient temperature and humidity. The sensor module 118 may also add any other kind and number of sensors or sensor arrays as the application requires.
In some embodiments of the present invention, the photographing method of the present invention may be performed by the processor 105 calling various components of the terminal system 100 through instructions. The program required by the processor 105 to execute the image processing method of the present invention is stored by the memory 103.
The above is an introduction of a terminal system to which the photographing method is applied, and next, a detailed introduction of a camera module set in the terminal system will be described. Referring to fig. 2, an exploded view of a camera module according to a first embodiment of the present invention includes: the TOF light-sensitive device comprises a lens 201, a motor 202, a filter 203, a base support 204, a time-of-flight TOF light-sensitive chip 205, a substrate 206, a TOF light-emitting device 207 and a controller 208, wherein the lens 201 is arranged in the motor 202, the filter 203 is arranged between the motor 202 and the base support 204, the TOF light-emitting device 205 is arranged on the base support 204, the TOF light-sensitive chip 205 is arranged on the substrate 206, the TOF light-sensitive chip 205 is electrically connected with the substrate 206, the controller 208 is connected with the motor 202, the light-emitting device 207 and the TOF light-sensitive chip 205, and the lens 201 can move along the optical axis direction of the lens relative to the. When the image pickup module performs image pickup, the controller 208 is configured to control the TOF light emitter 207 and the TOF photosensitive chip 205 to obtain an object distance of a subject to be picked up, and control the motor 202 to drive the lens 201 to move to a focal length position corresponding to the object distance. Fig. 3 is a schematic structural diagram of the camera module after the elements are combined together.
Specifically, the conventional TOF camera module usually adopts a fixed-focus design mode, and can only obtain a clear depth-of-field image within a specified range. The camera module in this embodiment, for the more scene demand of adaptation, need can both obtain the image of taking the depth of field of better effect at close-range, medium-range, distant view, so, TOF sensitization chip's camera lens has increased the motor in the module is made a video recording to the TOF, realizes the shooting of can focusing. Furthermore, when the camera module performs image capturing, the controller in the camera module in this embodiment may control the TOF light emitter and the TOF photosensitive chip to obtain an object distance of the object to be captured, and control the motor to drive the lens to move to a focal length position corresponding to the object distance. Like this, through the TOF module of making a video recording in this embodiment, can focus according to the shooting demand of difference, transfer different focus positions, obtain clear depth of field image. Furthermore, the range of distance measurement is widened, the range capable of being accurately calibrated is larger, and the clear image in the range of variable depth of field is realized.
Further, the motor 202 in this embodiment includes any one of a voice coil motor, a micro-electromechanical MEMS driving module, a shape memory alloy SMA driving module, a liquid crystal driving module, a liquid driving module, and an adjustable lens TLENS driving module.
Specifically, the motor in this embodiment may be a voice coil motor, which is a device that converts electrical energy into mechanical energy and realizes linear and limited swing angle motion, and under the driving of the voice coil motor, the lens 201 can move relative to the TOF photosensitive chip 205 along the optical axis direction thereof.
Specifically, the motor in this embodiment may use a MEMS (Micro-Electro-Mechanical System) driving module to drive the lens 201 to move along the optical axis direction of the TOF photosensitive chip 205 relative to the lens, and since the MEMS device is very small, the MEMS machine mainly driven by electrostatic force may achieve a very fast motion speed. Meanwhile, the rigidity of the device is very high, so that the stability of the whole system is high. The MEMS actuation module only needs less than 300 milliseconds to push the lens 80 microns. In addition, after the lens reaches the specified focal length, the MEMS driving module can enter a stable state only within 10 milliseconds, and the MEMS driving module can also very easily realize ultra-high-precision closed-loop control so as to realize accurate focusing.
Specifically, the motor in this embodiment may use a shape Memory alloy SMA (shape Memory alloy) driving module to drive the lens, and since the focusing driving module is made of an SMA material, the length of the focusing driving module may be changed according to heat generated by the power supply current, so as to drive the lens 201 to move in the optical axis direction relative to the TOF photosensitive chip 205, thereby implementing the focusing function.
Specifically, the motor in this embodiment may further adopt a liquid crystal driving module, and the refractive index of the liquid is changed through conduction to change the light path, so that the lens 201 moves in the optical axis direction relative to the TOF photosensitive chip 205, and further the focal length position is adjusted, thereby implementing the focusing function.
Specifically, the motor in this embodiment may further adopt a liquid driving module, and a plastic material is wrapped by a film, and pressure is applied to the liquid driving module to change the curvature, so that the lens 201 moves in the optical axis direction relative to the TOF photosensitive chip 205, and then the focal length position is adjusted, thereby realizing the focusing function.
Specifically, the motor in this embodiment may further adopt an adjustable lens TLENS driving module, and by changing the voltage, the piezoelectric material deforms to drive the gel inside to deform, so as to change the light path, and further, the lens 201 moves in the optical axis direction relative to the TOF photosensitive chip 205, and further, the focal length position is adjusted, and the focusing function is realized.
In a specific implementation process, a specific driving structure adopted by the motor 202 to realize the focusing function may be set according to actual needs, and the embodiment is not limited herein.
Further, in this embodiment, the camera module needs to implement the function of measuring the object distance to achieve precise focusing. Therefore, referring to fig. 4, the TOF light emitter 207 disposed in the camera module is configured to emit a light signal with a specific wavelength, so that the TOF photosensitive chip 205 is configured to receive a reflected light signal of the light signal reflected by the object to be photographed, and obtain an object distance of the object to be photographed based on the reflected light.
Specifically, in the present embodiment, the TOF light emitter 207 is used for measuring the distance of the infrared light signal with a specific wavelength, and the position of the lens is fixed relatively. The TOF light emitter 207 actively emits light to the subject, and includes a light source driving circuit and a light source for driving the light source to generate modulated light. The lens 201 can perform imaging. The TOF photosensitive chip 205 receives infrared light of a specific wavelength reflected back through the photographic subject. And then calculating the object distance of the shooting object according to the received infrared light. The TOF light emitter 201 may be a laser or LED light source, and of course, may also be other light sources, and the embodiment is not limited herein.
The TOF photosensitive chip 205 includes a photosensitive sensor, such as a charge Coupled device (ccd) sensor or a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor. Of course, other image sensors may be used, and the embodiment is not limited herein.
The controller 208 is configured to control the TOF light emitter 207 and the TOF photosensitive chip 205 to operate, so as to obtain object distance information of a shooting object. The controller 208 is also used to control the motor 202 to focus.
Specifically, the controller 208 controls the motor 202 to focus in the following manner:
the controller is pre-stored with a plurality of object distance intervals, different object distance intervals correspond to different focal length intervals, and when the controller obtains the current object distance of a shooting object detected by the TOF illuminator, the controller determines a target object distance interval to which the current object distance belongs, determines a target focal length interval corresponding to the target object distance interval, and determines a focal length position corresponding to the current object distance from the target focal length interval. The focal length position is included in the focal length position, and the definition of an image shot by the camera module meets a preset condition.
Specifically, the controller stores a plurality of object distance ranges in advance, each object distance range corresponds to one focal distance range, and images shot in the corresponding focal distance range are clear. For example, the object distance range (e.g., 30 cm to 2 m) corresponding to the close range is included, and the focal distance range corresponding to the close range is L1 to L2, and the image will be relatively clear when the object in the close range is shot in the focal distance range. The object distance range (such as 2 m-5 m) corresponding to the medium scene is L3-L4, and the image is clearer when the shot object of the medium scene is shot in the focal distance range. The object distance range (for example, 5 m to 10 m) corresponding to the distant view, and the focal distance range corresponding to the near view is L5 to L6, so that the image will be clearer when the object of the distant view is shot in the focal distance range.
Therefore, after the controller determines the object distance of the shooting object, the object distance range to which the shooting object belongs can be obtained, then the focal distance interval corresponding to the object distance range is determined, then a focal distance position is determined from the focal distance interval, and at the focal distance position, the definition of the shot image reaches the preset condition.
Along with the foregoing example, when the photographic subject is located in the close range, assuming that the object distance of the photographic subject, which can be measured by the TOF light emitter and the TOF sensitive chip, is 1 meter, the photographic subject belongs to the object distance range corresponding to the close range, that is, the photographic subject is determined to be located in the close range, the corresponding focal distance range is determined to be L1-L2, and the controller further controls the motor to drive the lens to move along the optical axis direction of the lens relative to the TOF sensitive chip within the focal distance range L1-L2, so as to obtain the focal distance position with the definition meeting the preset condition as the focal distance position of the final shooting.
Similarly, when the shot object is located in the middle view, the object distance of the shot object is assumed to be 3 meters through the TOF light emitter and the TOF photosensitive chip, the shot object belongs to the object distance range corresponding to the middle view, namely the shot object is determined to be located in the middle view, the corresponding focal distance range is determined to be L3-L4, the controller controls the motor to drive the lens to move along the optical axis direction of the lens relative to the TOF photosensitive chip within the focal distance range of L3-L4, and the focal distance position with the definition meeting the preset condition is obtained and serves as the final shot focal distance position.
Similarly, when the shot object is located in a distant view, assuming that the object distance of the shot object can be measured to be 8 meters through the TOF light emitter and the TOF photosensitive chip, the shot object belongs to the object distance range corresponding to the distant view, namely, the shot object is determined to be located in the distant view, the corresponding focal distance range is determined to be L5-L6, the controller controls the motor to drive the lens to move in the optical axis direction of the lens relative to the TOF photosensitive chip within the focal distance range of L5-L6, and the focal distance position with the definition meeting the preset condition is obtained and serves as the final shot focal distance position.
Further, in this embodiment, when determining the focal length position from the focal length interval, a random screening method may be adopted, one focal length position is randomly selected each time, whether the image sharpness corresponding to the focal length position meets a preset condition is determined, if the preset condition is met, the image sharpness corresponding to the focal length position may be used as the focal length position during shooting, if the preset condition is not met, a new focal length position is randomly selected again, and so on until a proper focal length position is determined.
In another embodiment, a step moving manner may also be adopted, one of the boundary values of the interval is determined, then the value is moved to another boundary value at a predetermined interval, a focal length position is generated by each movement, whether the image definition corresponding to the focal length position meets a preset condition is judged, if the preset condition is met, the focal length position can be used as the focal length position during shooting, if the preset condition is not met, the image definition corresponding to the focal length position continues to be moved to another boundary value at a predetermined interval, a new focal length position is generated, and so on until a proper focal length position is determined.
In a specific implementation process, the manner of determining the specific focal length position from the focal length interval may be set according to actual needs, and this embodiment is not limited herein. Further, in this embodiment, the object distance range is only divided into the above 3 types, and in a specific implementation process, the number of the object distance ranges may also be set to 4 or 2, and the setting may be performed according to actual needs, and here, this embodiment is not limited.
Therefore, for the scenes, the shooting objects in the close scene, the middle scene and the long scene can shoot images with good depth of field, so that the range of distance measurement is enlarged, the range capable of being accurately calibrated is larger, and the clear images in the range of variable depth of field are realized. Like this, utilize more accurate depth of field information, can be better with RGB module group image fusion degree of depth, promote the quality of image and the effect that the depth image was used, for example: the face recognition is more accurate, the constructed three-dimensional game scene is more real, the effect is better, and the like.
In this embodiment, the filter 203, the base support 204, and the substrate 206 can be set according to actual requirements, and the present embodiment is not limited thereto.
Based on the same inventive concept as the foregoing embodiment, referring to fig. 5, a second embodiment of the present invention further provides a shooting method applied to the camera module according to the foregoing first embodiment, the method including:
s501: when image shooting is carried out, the object distance of the shooting object is obtained through the TOF light emitter and the TOF photosensitive chip;
s502: determining a focal length position corresponding to the object distance;
s503: controlling the motor to drive the lens to move to the focal length position;
s504: and shooting to obtain an image at the focal position.
Further, the determining a focal length position corresponding to the object distance includes:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
Further, the determining a focal length position corresponding to the object distance from the target focal length interval includes:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
The method for shooting by the camera module in this embodiment has been described in detail in the foregoing first embodiment, and is not described herein again.
Based on the same inventive concept as the previous embodiment, referring to fig. 6, a third embodiment of the present invention further provides a camera apparatus applied to the camera module in the first embodiment, as shown in fig. 6, the camera apparatus includes:
an obtaining module 601, configured to obtain an object distance of the shooting object through the TOF light emitter and the TOF photosensitive chip when performing image shooting;
a determining module 602, configured to determine a focal length position corresponding to the object distance;
a control module 603, configured to control the motor to drive the lens to move to the focal length position;
and a shooting module 604 for shooting the image obtained at the focal position.
Further, the determining module 602 is specifically configured to:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
Further, the determining module 602 is specifically configured to:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
The method for shooting by the camera device in this embodiment has been described in detail in the foregoing first embodiment, and is not described herein again.
Based on the same inventive concept as in the previous embodiments, a fourth embodiment of the present invention also provides a computer-readable storage medium having a computer program stored thereon, the program, when executed by a processor, implementing the steps of:
when image shooting is carried out, the object distance of the shooting object is obtained through the TOF light emitter and the TOF photosensitive chip;
determining a focal length position corresponding to the object distance;
controlling the motor to drive the lens to move to the focal length position;
and shooting to obtain an image at the focal position.
Optionally, the computer-readable storage medium stores and processes: the computer program for determining a focal length position corresponding to the object distance, when executed, specifically comprises the steps of:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
Optionally, the computer-readable storage medium stores and processes: when executed, the computer program determining a focal length position corresponding to the object distance from the target focal length interval specifically includes the following steps:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
Based on the same inventive concept as that in the foregoing embodiment, a fifth embodiment of the present invention further provides a terminal system, including the camera module in the foregoing first embodiment, and please refer to the above for the description of the camera module, the memory, the processor and other structures in the terminal system, which is not repeated herein.
One or more technical solutions in the embodiments of the present application have at least one or more of the following technical effects:
in the technical scheme of the embodiment of the invention, the TOF camera module capable of focusing comprises a lens, a motor, an optical filter, a base support, a time-of-flight TOF photosensitive chip, a substrate, a TOF illuminator and a controller, wherein the lens is arranged in the motor, the optical filter is arranged between the motor and the base support, the TOF illuminator is arranged on the base support, the TOF photosensitive chip is arranged on the substrate, the TOF photosensitive chip is electrically connected with the substrate, the controller is connected with the motor, the illuminator and the TOF photosensitive chip, and the lens can move along the optical axis direction of the lens relative to the TOF photosensitive chip under the driving of the motor. Furthermore, when the camera module carries out image shooting, the controller can control the TOF light emitter and the TOF photosensitive chip to obtain the object distance of a shooting object, and control the motor to drive the lens to move to the focal distance position corresponding to the object distance. Therefore, the TOF camera module in the embodiment of the invention can be used for focusing according to different shooting requirements, adjusting to different focal length positions and obtaining a clear depth-of-field image. Furthermore, the range of distance measurement is widened, the range capable of being accurately calibrated is larger, and the clear image in the range of variable depth of field is realized.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (13)

1. The utility model provides a module of making a video recording which characterized in that includes:
the TOF photosensitive chip is arranged on the substrate and electrically connected with the substrate, the controller is connected with the motor, the light emitter and the TOF photosensitive chip, and the lens can move along the optical axis direction of the lens relative to the TOF photosensitive chip under the driving of the motor;
when the camera module carries out image shooting, the controller is used for controlling the TOF light emitter and the TOF photosensitive chip to obtain the object distance of a shooting object and controlling the motor to drive the lens to move to the focal distance position corresponding to the object distance.
2. The camera module of claim 1, wherein the motor comprises any one of a voice coil motor, a micro-electromechanical MEMS drive module, a shape memory alloy SMA drive module, a liquid crystal drive module, a liquid drive module, and an adjustable lens TLENS drive module.
3. The camera module of claim 1, wherein the TOF light emitter is configured to emit a light signal with a specific wavelength, and the TOF photosensitive chip is configured to receive a reflected light signal of the light signal reflected by a shooting object, and obtain an object distance of the shooting object based on the reflected light signal.
4. The camera module of claim 1, wherein a plurality of object distance intervals are prestored in the controller, different object distance intervals correspond to different focal length intervals, and when the controller obtains the current object distance of the shooting object detected by the TOF light emitter, the controller determines a target object distance interval to which the current object distance belongs, determines a target focal length interval corresponding to the target object distance interval, and determines a focal length position corresponding to the current object distance from the target focal length interval.
5. The camera module according to any one of claims 1-4, wherein the focal position is included in the focal position, and the sharpness of the image captured by the camera module satisfies a predetermined condition.
6. A shooting method applied to the camera module set of any one of claims 1 to 5, the method comprising:
when image shooting is carried out, the object distance of the shooting object is obtained through the TOF light emitter and the TOF photosensitive chip;
determining a focal length position corresponding to the object distance;
controlling the motor to drive the lens to move to the focal length position;
and shooting to obtain an image at the focal position.
7. The method of claim 6, wherein said determining a focal length position corresponding to said object distance comprises:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
8. The method of claim 7, wherein said determining a focal length position corresponding to the object distance from the target focal length interval comprises:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
9. A camera device, applied to the camera module set of any one of claims 1 to 5, the device comprising:
the acquisition module is used for acquiring the object distance of the shooting object through the TOF light emitter and the TOF photosensitive chip when image shooting is carried out;
a determining module for determining a focal length position corresponding to the object distance;
the control module is used for controlling the motor to drive the lens to move to the focal length position;
and the shooting module is used for shooting and obtaining the image at the focal length position.
10. The apparatus of claim 9, wherein the determination module is specifically configured to:
determining a target object distance interval to which the object distance belongs from a plurality of object distance intervals, wherein the plurality of object distance intervals are prestored in the camera module, and different object distance intervals correspond to different focal length intervals;
determining a target focal length interval corresponding to the target object distance interval;
and determining a focal length position corresponding to the object distance from the target focal length interval.
11. The apparatus of claim 10, wherein the determination module is specifically configured to:
and determining a focal length position with shooting definition meeting a preset condition from the target focal length interval as a focal length position corresponding to the object distance.
12. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a controller, carries out the steps of the method of any one of claims 6 to 8.
13. A terminal system, characterized in that, comprises the camera module of any one of claims 1-5.
CN202010663758.9A 2020-07-10 2020-07-10 Camera module, shooting method and device Pending CN111935370A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010663758.9A CN111935370A (en) 2020-07-10 2020-07-10 Camera module, shooting method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010663758.9A CN111935370A (en) 2020-07-10 2020-07-10 Camera module, shooting method and device

Publications (1)

Publication Number Publication Date
CN111935370A true CN111935370A (en) 2020-11-13

Family

ID=73313116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010663758.9A Pending CN111935370A (en) 2020-07-10 2020-07-10 Camera module, shooting method and device

Country Status (1)

Country Link
CN (1) CN111935370A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112651382A (en) * 2021-01-15 2021-04-13 北京中科虹霸科技有限公司 Focusing data calibration system and iris image acquisition system
CN113203735A (en) * 2021-05-11 2021-08-03 宁波胤瑞生物医学仪器有限责任公司 Chip detection device
CN114280778A (en) * 2021-11-24 2022-04-05 歌尔光学科技有限公司 Intelligent glasses and image distance adjusting method thereof
CN114650369A (en) * 2022-03-01 2022-06-21 维沃移动通信有限公司 Image forming method and apparatus
CN115277989A (en) * 2021-04-29 2022-11-01 北京小米移动软件有限公司 Electronic device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104469168A (en) * 2014-12-29 2015-03-25 信利光电股份有限公司 Shooting module and automatic focusing method thereof
CN106937028A (en) * 2015-12-30 2017-07-07 南昌欧菲光电技术有限公司 Camera module assemble method and camera module
CN109031329A (en) * 2018-07-02 2018-12-18 昆山丘钛微电子科技有限公司 A kind of flight time ranging mould group and electronic equipment
CN109756654A (en) * 2017-11-01 2019-05-14 浙江舜宇智能光学技术有限公司 TOF camera module and its manufacturing method and TOF depth image imaging method and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104469168A (en) * 2014-12-29 2015-03-25 信利光电股份有限公司 Shooting module and automatic focusing method thereof
CN106937028A (en) * 2015-12-30 2017-07-07 南昌欧菲光电技术有限公司 Camera module assemble method and camera module
CN109756654A (en) * 2017-11-01 2019-05-14 浙江舜宇智能光学技术有限公司 TOF camera module and its manufacturing method and TOF depth image imaging method and electronic equipment
CN109031329A (en) * 2018-07-02 2018-12-18 昆山丘钛微电子科技有限公司 A kind of flight time ranging mould group and electronic equipment

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112651382A (en) * 2021-01-15 2021-04-13 北京中科虹霸科技有限公司 Focusing data calibration system and iris image acquisition system
CN112651382B (en) * 2021-01-15 2024-04-02 北京中科虹霸科技有限公司 Focusing data calibration system and iris image acquisition system
CN115277989A (en) * 2021-04-29 2022-11-01 北京小米移动软件有限公司 Electronic device
CN113203735A (en) * 2021-05-11 2021-08-03 宁波胤瑞生物医学仪器有限责任公司 Chip detection device
CN113203735B (en) * 2021-05-11 2024-03-15 宁波胤瑞生物医学仪器有限责任公司 Chip detection device
CN114280778A (en) * 2021-11-24 2022-04-05 歌尔光学科技有限公司 Intelligent glasses and image distance adjusting method thereof
CN114650369A (en) * 2022-03-01 2022-06-21 维沃移动通信有限公司 Image forming method and apparatus

Similar Documents

Publication Publication Date Title
CN111935370A (en) Camera module, shooting method and device
KR102324921B1 (en) Macro imaging method and terminal
US11048061B2 (en) Electronic device including camera module
CN107924104B (en) Depth sensing autofocus multi-camera system
CN109495689B (en) Shooting method and device, electronic equipment and storage medium
US10061182B2 (en) Systems and methods for autofocus trigger
KR101990073B1 (en) Method and apparatus for shooting and storing multi-focused image in electronic device
CN108234879B (en) Method and device for acquiring sliding zoom video
CN103837129B (en) Distance-finding method in a kind of terminal, device and terminal
KR102531009B1 (en) A method for image searching using an captured image based on guidelines and an apparatus therefor
CN108234880B (en) Image enhancement method and device
CN105245768A (en) Focal length adjustment method, focal length adjustment device and terminal
WO2021057529A1 (en) Camera module and terminal device
US20160323499A1 (en) Method and apparatus for forming images and electronic equipment
CN106210527B (en) The PDAF calibration methods and device moved based on MEMS
CN112840634B (en) Electronic device and method for obtaining image
CN109547703B (en) Shooting method and device of camera equipment, electronic equipment and medium
JP2020191655A (en) Electronic apparatus and program
US20220268935A1 (en) Electronic device comprising camera and method thereof
US11792518B2 (en) Method and apparatus for processing image
CN112866555B (en) Shooting method, shooting device, shooting equipment and storage medium
EP3813349A1 (en) Terminal device, lens adjustment method and readable storage medium
CN114666490A (en) Focusing method and device, electronic equipment and storage medium
CN112102796A (en) Method and device for acquiring ambient light information by using camera and terminal equipment
US20230298197A1 (en) Electronic device with gaze-based autofocus of camera during video rendition of scene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20201113

RJ01 Rejection of invention patent application after publication