WO2015076055A1 - Module d'imagerie, dispositif électronique, et procédé de commande de module d'imagerie - Google Patents

Module d'imagerie, dispositif électronique, et procédé de commande de module d'imagerie Download PDF

Info

Publication number
WO2015076055A1
WO2015076055A1 PCT/JP2014/078195 JP2014078195W WO2015076055A1 WO 2015076055 A1 WO2015076055 A1 WO 2015076055A1 JP 2014078195 W JP2014078195 W JP 2014078195W WO 2015076055 A1 WO2015076055 A1 WO 2015076055A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
signal
lens
image
imaging module
Prior art date
Application number
PCT/JP2014/078195
Other languages
English (en)
Japanese (ja)
Inventor
健悟 菊田
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Publication of WO2015076055A1 publication Critical patent/WO2015076055A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G02B7/08—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification adapted to co-operate with a remote control mechanism
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B3/00—Focusing arrangements of general interest for cameras, projectors or printers
    • G03B3/10—Power-operated focusing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0015—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design
    • G02B13/002—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design having at least one aspherical surface
    • G02B13/0045—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design having at least one aspherical surface having five or more lenses
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00—Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0007—Movement of one or more optical elements for control of motion blur
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00—Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0046—Movement of one or more optical elements for zooming
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00—Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0053—Driving means for the movement of one or more optical element

Definitions

  • the present invention relates to an imaging module, an electronic apparatus, and a driving method of the imaging module, and more particularly to a technique applied when performing pulse width modulation (PWM) control of a lens driving mechanism of a lens unit.
  • PWM pulse width modulation
  • Patent Document 1 a motor control device that generates a PWM signal based on a reference clock, outputs the generated PWM signal as a drive signal to a drive unit (a three-phase inverter using three pairs of switching elements), and drives a three-phase motor Has been proposed.
  • Patent Document 1 in this type of motor control device, a multistage frequency divider circuit is generally used when generating a frequency division signal for counting from a reference clock signal.
  • the motor control device having such a configuration is described as an issue that electromagnetic noise is generated due to many switch operations.
  • Patent Document 1 does not use a frequency dividing circuit constituted by a multistage counting circuit (counter), but uses a simple circuit configuration by a logic output circuit that is a shift register, An appropriate duty ratio selection signal for setting a modulation factor (duty ratio) corresponding to the value is generated to reduce the scale of the circuit configuration while reducing the generation of noise.
  • Patent Document 2 discloses a small camera module mounted on a mobile phone, a portable game machine, a portable music player, or the like.
  • This camera module includes a lens driving unit such as an autofocus function, a zoom function, and a camera shake correction function.
  • Patent Document 3 discloses a lens driving device that drives a lens barrel of a camera module.
  • the lens driving device includes an autofocus lens driving unit and a camera shake correction unit that are driven by a voice coil motor (VCM).
  • VCM voice coil motor
  • an optical image stabilization (OIS: Optical Image Stabilizer) mechanism is PWM-controlled, it was confirmed that noise was found on the captured image as a result of sensory evaluation.
  • Patent Document 1 describes a technique for reducing noise generated by PWM control, but does not describe an image sensor, and does not describe a technique for removing noise on an image obtained from the image sensor.
  • Patent Document 2 does not describe PWM control of a lens driving unit having a camera shake correction function or the like.
  • the lens driving device described in Patent Document 3 does not perform PWM control of a camera shake correction unit having a voice coil motor (VCM), so that noise associated with PWM control does not occur, but power consumption increases.
  • VCM voice coil motor
  • the OIS mechanism is simply PWM controlled, there is a problem that noise is added to the image as described above.
  • the present invention has been made in view of such circumstances, and achieves power saving by performing pulse width modulation (PWM) control of the lens driving mechanism of the lens unit, and noise is added to the image even if PWM control is performed. It is an object of the present invention to provide an imaging module, an electronic apparatus, and a driving method of the imaging module that can be avoided.
  • PWM pulse width modulation
  • an imaging module includes a lens unit, an imaging element that receives an optical image via the lens unit, and converts the received optical image into an electrical signal, and an imaging element
  • An image sensor drive unit that outputs a drive signal to read an image signal from the image sensor, a lens drive mechanism that drives the lens unit, a pulse width modulation signal based on a command value that controls the lens unit, and a pulse width
  • a PWM control unit that controls the lens driving mechanism based on the modulation signal, and the PWM control unit generates a pulse width modulation signal synchronized with the drive signal generated by the image sensor driving unit.
  • the pulse width modulation signal generated by the PWM control unit is synchronized with the drive signal generated by the image sensor driving unit, thereby reducing noise generated in the image.
  • asynchronous noise occurs in the image.
  • there is horizontal stripe noise As an example in which asynchronous noise appears prominently, there is horizontal stripe noise.
  • the pulse width modulation signal and the drive signal are asynchronous, a line on which noise is periodically generated is generated, and this appears as horizontal stripe noise.
  • periodicity can be eliminated and noise cannot be detected.
  • the imaging element driving unit and the PWM control unit generate a driving signal and a pulse width modulation signal based on a common reference clock, respectively.
  • the PWM control unit can adjust the phase of the pulse width modulation signal so as to be synchronized with the drive signal generated by the image sensor driving unit, but generates the pulse width modulation signal based on a common reference clock. Thus, it can be easily synchronized with the drive signal.
  • the PWM control unit preferably has a clock input terminal for inputting a reference clock. That is, the PWM controller does not need to have a unique oscillator and can use an external clock (common reference clock).
  • the lens driving mechanism preferably includes a voice coil motor that is subjected to pulse width modulation control by a PWM control unit.
  • the lens driving mechanism is a camera shake correction mechanism that moves the lens unit in a plane orthogonal to the photographing optical axis direction.
  • the pixel pitch of the imaging element is 1 ⁇ m or less.
  • An image pickup module mounted on a smartphone or the like is very small, and one pixel of the image pickup device tends to be small as the number of pixels increases.
  • the pixel pitch is 1 ⁇ m or less (when the pixel is small), the amount of incident light per pixel is small, and the photoelectrically converted signal obtained from one pixel is also small, so the signal-to-noise ratio (S / N) is small.
  • the present invention is effective as a noise countermeasure for an imaging module including an imaging device having pixels with a pixel pitch of 1 ⁇ m or less.
  • An electronic device includes the imaging module according to any one of the above and an electronic device main body on which the imaging module is mounted.
  • an electronic device a smart phone, a mobile phone, a tablet terminal, a personal digital assistant (PDA), a glasses-type information terminal, a portable game machine, a portable music player, a camera clock, and the like can be considered. Since these devices are small and the image pickup module is also small, the image pickup element and the lens driving mechanism are close to each other, and noise is easily applied to the image. However, according to the present invention, it is possible to prevent noise from being applied to the image.
  • the electronic device main body includes a reference clock generation unit that generates a reference clock, and the reference clock generation unit supplies a reference clock to each of the image sensor driving unit and the PWM control unit. Supply.
  • the electronic device main body receives an image signal output from the imaging module and performs signal processing on the image signal, and the signal processing unit performs signal processing. And a recording unit for recording the image signal.
  • the invention includes a lens unit, an image sensor that receives an optical image via the lens unit, converts the received optical image into an electrical signal, and outputs a drive signal to the image sensor.
  • An image sensor drive unit that reads an image signal from the image sensor, a lens drive mechanism that drives the lens unit, a pulse width modulation signal based on a command value that controls the lens unit, and a lens drive based on the pulse width modulation signal
  • a pulse width modulation signal generated by the PWM control unit is synchronized with a driving signal generated by an imaging element driving unit.
  • the pulse width modulation signal generated by the PWM control unit is synchronized with the drive signal for driving the image sensor, noise generated in the image when the lens drive mechanism is PWM controlled is reduced. Can do.
  • Sectional perspective view which shows the structure of the imaging module which concerns on this invention Schematic diagram conceptually showing an embodiment of an imaging module according to the present invention
  • Block diagram showing an embodiment of a PWM controller Timing chart showing PWM frequency and image sensor drive frequency signals generated based on the reference clock Timing chart showing PWM frequency and PWM signals having various duty ratios 1
  • Schematic diagram conceptually showing a conventional imaging module
  • a diagram schematically showing the presence or absence of noise in the image The figure which shows the external appearance of the smart phone which is embodiment of an electronic device Block diagram showing the configuration of the smartphone
  • FIG. 1 is a cross-sectional perspective view showing the structure of an imaging module according to the present invention.
  • the imaging module 10 mainly includes a lens unit 12, an imaging element 14, an optical camera shake correction (OIS) mechanism (lens driving mechanism) 16, a focus adjustment mechanism 18, and the like.
  • OIS optical camera shake correction
  • the Z axis is the same axis as the photographic optical axis O
  • the XY axis is an axis orthogonal to the photographic optical axis O. It is.
  • a sensor substrate 22 is attached on a base 20, and an image sensor 14 is disposed on the sensor substrate 22.
  • primary color filters of three primary colors of red (R), green (G), and blue (B) are arranged in a predetermined pattern for each pixel (Bayer arrangement, G stripe R / G complete checkerboard, X -Trans (registered trademark) array, honeycomb array, etc.) and is composed of a CMOS (complementary metal-oxide semiconductor) type image sensor.
  • the image sensor is not limited to a CMOS image sensor, but may be a CCD (charge coupled device) image sensor.
  • a base member 26 having an opening corresponding to the image sensor 14 is fixed on the sensor substrate 22, and an infrared cut filter 28 is disposed in the opening of the base member 26.
  • the base member 26 is provided with a pair of OIS drive coils 28X and 28Y in the X-axis direction and the Y-axis direction via a coil substrate or the like.
  • OIS drive magnets 32X and 32Y are disposed on the lower surface of the magnet holder 30 so as to face the OIS drive coils 28X and 28Y, respectively, and an autofocus (AF) magnet 34 is disposed on the inner side thereof.
  • AF autofocus
  • a cover 38 is attached to the upper surface side of the magnet holder 30 with a metal plate 36 interposed therebetween.
  • the lens unit 12 of this example is configured by housing five lens groups in a lens barrel 42.
  • An AF coil 44 is disposed around the lens barrel 42.
  • the lens unit 12 is housed inside the magnet holder 30 and the like, and is biased toward the base member 26 by a leaf spring (not shown) integrally formed with the metal plate 36, and has a photographing optical axis O (Z axis). ) It is guided to move in the direction.
  • the lens unit 12 and the magnet holder 30 are suspended by four wire springs 40 and guided so as to be movable within a plane (XY plane) orthogonal to the photographing optical axis O. It is guided so as to be movable in the direction of the photographing optical axis O (Z axis).
  • the OIS drive coils 28X and 28Y and the OIS drive magnets 32X and 32Y function as a voice coil motor (VCM) of the OIS mechanism 16, and the AF magnet 34 and the AF coil 44 are VCMs of the focus adjustment mechanism 18. Function as.
  • VCM voice coil motor
  • the lens unit 12 can move in a plane orthogonal to the photographing optical axis O to correct camera shake, and when the VCM of the focus adjustment mechanism 18 is driven.
  • the lens unit 12 can move in the photographing optical axis O direction to perform focus adjustment.
  • FIG. 2 is a schematic view conceptually showing an embodiment of the imaging module 10 according to the present invention.
  • the lens unit 12 is guided so as to be movable in a plane orthogonal to the photographing optical axis O, and is guided so as to be movable in the direction of the photographing optical axis O.
  • the lens unit 12 can move in a plane orthogonal to the photographing optical axis O to correct camera shake, and the VCM 18a of the focus adjustment mechanism 18 is driven. Then, the lens unit 12 can move in the direction of the photographing optical axis O to perform focus adjustment.
  • the image sensor driving unit (not shown) of the image sensor 14 mounted on the sensor substrate 22 and the PWM control unit 50 that performs pulse width modulation (PWM) control of the OIS mechanism 16 are commonly used from the outside.
  • Clock CLK is supplied.
  • the image sensor driving unit generates various drive signals for driving the image sensor 14 based on a reference clock CLK input from the outside, and reads an image signal from the image sensor 14 using the generated drive signal.
  • the PWM control unit 50 generates a pulse width modulation signal (PWM signal) based on a reference clock CLK input from the outside and a command value for controlling the lens unit 12, and controls the OIS mechanism 16 based on the generated PWM signal. Control.
  • PWM signal pulse width modulation signal
  • FIG. 3 is a diagram illustrating an overall configuration example including peripheral circuits of the image sensor 14.
  • the image area 140 of the image sensor 14 is an area where an optical image is received (imaged) via the lens unit 12.
  • pixels 142 made up of a plurality of photoelectric conversion elements are two-dimensionally arranged.
  • the pixel pitch P of the pixels 142 of the image sensor 14 of this example is 1 ⁇ m, and an image pickup module equipped with an image sensor having such a small pixel is not commercially available at present.
  • the image sensor 14 includes an image sensor drive unit such as a timing generator (TG) 143, a vertical driver 144, and a horizontal driver 145, a signal processing unit 146, and MIPI (Mobile Industry Processor Interface) 147. .
  • TG timing generator
  • a vertical driver 144 vertical driver
  • a horizontal driver 145 horizontal driver
  • a signal processing unit 146 signal processing unit
  • MIPI Mobile Industry Processor Interface
  • the TG 143 generates various drive signals for driving the image sensor 14 based on a reference clock CLK input from the outside, and supplies the generated drive signals to each part of the image sensor 14. As a result, the image signal is read out. Note that readout such as thinning readout and partial readout can also be performed.
  • the vertical driver 144 selects the pixels 142 for one row based on the image sensor driving signal applied from the TG 143, and reads the signals from the selected pixels 142.
  • the signal processing unit 146 is provided corresponding to each column of the pixels 142, and performs correlated double sampling (CDS) processing on the signal for one row output from each column read by the vertical driver 144. To convert the processed signal into a digital signal.
  • the signal processed by the signal processing unit 146 is stored in a memory provided for each column.
  • the horizontal driver 145 performs control to sequentially read out signals for one row stored in the memory of the signal processing unit 146 in accordance with the image sensor driving signal applied from the TG 143 and output the signals to the MIPI 147.
  • the MIPI 147 transmits a digital signal in accordance with MIP (Mobile Industry Processor).
  • MIP Mobile Industry Processor
  • FIG. 4 is a block diagram illustrating an embodiment of the PWM control unit 50.
  • the PWM control unit 50 mainly includes a central processing unit (CPU) 51, a PWM signal generation unit 52, and a driver 54, and includes an input terminal 55, a lens position input terminal 56, and a clock input terminal. 57 and an output terminal 58.
  • CPU central processing unit
  • the imaging module 10 is provided with a gyro sensor 60 that detects angular velocities in the direction around the X axis and the direction around the Y axis of the lens unit 12, and from the gyro sensor 60 via the input terminal 55 around the X axis of the lens unit 12.
  • An angular velocity signal indicating the angular velocity in the direction and the direction around the Y axis is applied to the CPU 51.
  • the imaging module 10 is provided with a hall element 62 that detects the positions of the lens unit 12 in the X-axis direction and the Y-axis direction, and the X of the lens unit 12 is transmitted from the hall element 62 via the lens position input terminal 56. Position data indicating the current position in the axial direction and the Y-axis direction is added to the CPU 51.
  • the CPU 51 integrates the angular velocity signal output from the gyro sensor 60 to calculate the deflection angle of the lens unit 12 around the X axis and the Y axis, and cancels the calculated deflection angle of the lens unit 12. A lens displacement amount corresponding to linear movement in the X-axis direction and the Y-axis direction is calculated.
  • the CPU 51 calculates a control target value (command value) of the lens unit 12 based on the calculated lens displacement amount and the position data of the lens unit 12 input from the lens position input terminal 56, and the calculated command value is PWM. Output to the signal generator 52.
  • a reference clock CLK is applied from the clock input terminal 57 to the PWM signal generation unit 52.
  • This reference clock CLK is the same as the reference clock CLK applied to the TG 143 of the image sensor 14.
  • the PWM signal generation unit 52 generates a PWM signal for controlling the OIS mechanism 16 based on the control target value (command value) of the lens unit 12 input from the CPU 51 and the reference clock CLK input from the clock input terminal 57. To do.
  • the generated PWM signal is applied to the driver 54.
  • the driver 54 adjusts the amount of drive current supplied to the VCM 16a by adjusting the on time and the off time of the drive current supplied to the pair of VCMs 16a of the OIS mechanism 16 according to the duty ratio of the input PWM signal. Thereby, the OIS mechanism 16 is driven and the position of the lens unit 12 is controlled.
  • FIG. 5 is a timing chart showing the signal waveform of the PWM frequency and the signal waveform of the image sensor driving frequency generated based on the reference clock.
  • the PWM frequency signal is a signal obtained by dividing the frequency of the reference clock CLK by 1/8, and the image sensor driving frequency signal is multiplied by 5 times the frequency of the reference clock CLK ( (Multiplied by 5).
  • FIG. 6 is a timing chart showing a PWM frequency signal waveform and PWM signals having various duty ratios.
  • the duty ratio of the PWM signal is determined by a command value that is a control target value, and the PWM signal generation unit 52 (FIG. 4), based on the determined command value and the reference clock CLK input from the clock input terminal 57, A PWM signal having a PWM frequency is generated.
  • the PWM frequency signal generated by dividing or multiplying the common reference clock CLK and the image sensor driving frequency signal are different in frequency, but are synchronized.
  • FIG. 7 is a block diagram illustrating an embodiment of an electronic device 100 in which the imaging module 10 having the above configuration is mounted on an electronic device main body such as a portable terminal. Note that FIG. 7 shows only a part that functions as an imaging device of the electronic device 100.
  • a central processing unit (CPU) 102 is a part that performs overall control of the entire apparatus in accordance with an operation input from the operation unit 104 and a predetermined program, and includes auto focus (AF), automatic exposure (AE), and auto white balance. It also functions as a part that performs calculation and control for (AWB).
  • CPU central processing unit
  • the CPU 102 is provided with an oscillator 102a, and the CPU 102 uses a high frequency signal from the oscillator 102a as a clock source for a digital circuit and a timing source for a clock (quartz).
  • the CPU 102 includes a reference clock generation unit that generates a reference clock CLK based on a high frequency signal from the oscillator 102 a, and supplies the generated reference clock CLK to the imaging module 10 via the bus 103.
  • a RAM (Random Access Memory) 108 and a ROM (Read Only Memory) 110 are connected to the CPU 102 via a bus 103 and a memory interface (I / F) 106.
  • the RAM 108 is used as a program development area and a calculation work area for the CPU 102, and is also used as a temporary storage area for image data.
  • the ROM 110 stores programs executed by the CPU 102, various data necessary for control, various constants / information related to imaging operations, and the like.
  • the imaging module 10 performs an imaging operation or the like according to a command from the CPU 102, and outputs an image signal (RGB RAW data) read from the imaging element 14. This raw data is temporarily stored in the RAM 108 via the bus 103 and the memory I / F 106.
  • the RGB RAW data stored in the RAM 108 is input to the digital signal processing unit 112, where gain processing including offset processing, white balance correction, sensitivity correction, gamma correction processing, demosaic processing, RGB / YC conversion Digital signal processing such as processing is performed.
  • the demosaic process is a process for calculating all color information for each pixel from a mosaic image corresponding to the color filter array of a single-plate color image sensor, and is also called a demosaicing process or a synchronization process. For example, in the case of an image sensor made up of three color filters of RGB, this is a process of calculating color information for all RGB for each pixel from a mosaic image made of RGB.
  • the RAW data is recorded in the memory card 116 via the external memory I / F 114 in the RAW file format.
  • the operation unit 104 includes a shutter button, a mode selection switch for selecting a shooting mode and a playback mode, a menu button for displaying a menu screen on the liquid crystal display unit (LCD) 118, and a multi-function for selecting a desired item from the menu screen.
  • the cross key etc. are included.
  • An output signal from the operation unit 104 is input to the CPU 102 via the bus 103, and the CPU 102 performs appropriate processing such as shooting and reproduction based on the input signal from the operation unit 104.
  • the image data (luminance signal Y, color difference signals Cr, Cb) processed by the digital signal processing unit 112 is given to the compression / decompression processing circuit 124, where it is compressed according to a predetermined compression format (for example, JPEG system). .
  • the compressed image data is recorded in the memory card 116 via the external memory I / F 114 in the format of an image file (for example, a JPEG file).
  • the LCD 118 displays a video (live view image) during preparation for imaging by an image signal applied via the LCD interface 126, and a JPEG file or RAW file recorded on the memory card 116 in the playback mode.
  • the image is read and displayed.
  • the compressed image data stored in the JPEG file is decompressed by the compression / decompression circuit 124 and output to the LCD 118.
  • the RAW data stored in the RAW file is RAW developed by the digital signal processing unit 112. Is output to the LCD 118.
  • FIG. 8 is a schematic diagram conceptually showing a conventional imaging module 10A, which is used for comparison with the imaging module 10 according to the present invention shown in FIG.
  • the same reference numerals are given to portions common to the imaging module 10 shown in FIG. 2, and detailed description thereof is omitted.
  • the PWM control unit 50 that drives the OIS mechanism 16 (VCM 16a) of the imaging module 10 illustrated in FIG. 2 is supplied with a reference clock CLK (common to the reference clock CLK supplied to the imaging device 14) from the outside.
  • CLK common to the reference clock CLK supplied to the imaging device 14
  • the reference clock CLK is not supplied from the outside to the PWM control unit 50A of the imaging module 10A shown in FIG.
  • the PWM control unit 50A has a PWM control unit oscillator, and obtains a clock for generating a PWM signal based on a high-frequency signal from the oscillator.
  • the PWM signal generated by the PWM control unit 50A and the drive signal of the image sensor 14 generated based on the reference clock CLK are asynchronous, and noise is added to the image as a result of sensory evaluation on the captured image. It was confirmed.
  • FIG. 9 (a) and 9 (b) are diagrams schematically showing the presence or absence of noise in the image
  • FIG. 9 (a) is an image acquired by the imaging module 10 according to the present invention.
  • FIG. 9B shows an image acquired by the conventional imaging module 10A.
  • noise could not be detected by synchronizing the PWM signal and the drive signal of the imaging device 14 (no noise was added to the image).
  • the PWM signal and the drive signal of the imaging element 14 become asynchronous, and asynchronous noise appears in the captured image.
  • Table 1 below shows the results of sensory evaluation.
  • the noise generated in the image is reduced by synchronizing the PWM signal and the drive signal of the image sensor as compared with the asynchronous case.
  • the pixel pitch P of the image sensor 14 of this example is 1 ⁇ m.
  • the PWM signal and the drive signal of the image sensor are Synchronizing is particularly effective.
  • Examples of the electronic device 100 such as a portable terminal include a smartphone, a mobile phone, a tablet terminal, a personal digital assistant (PDA), a glasses-type information terminal, a portable game machine, a portable music player, and a camera clock.
  • a smartphone will be described as an example, and will be described in detail with reference to the drawings.
  • FIG. 10 shows an appearance of a smartphone 500 that is an embodiment of the electronic device 100.
  • a smartphone 500 illustrated in FIG. 10 includes a flat housing 502, and a display input in which a display panel 521 as a display unit and an operation panel 522 as an input unit are integrated on one surface of the housing 502. Part 520.
  • the housing 502 includes a speaker 531, a microphone 532, an operation unit 540, and a camera unit 541.
  • the configuration of the housing 502 is not limited to this, and for example, a configuration in which the display unit and the input unit are independent, or a configuration having a folding structure and a slide mechanism can be employed.
  • FIG. 11 is a block diagram showing a configuration of the smartphone 500 shown in FIG.
  • the main components of the smartphone 500 include a wireless communication unit 510, a display input unit 520, a call unit 530, an operation unit 540, a camera unit 541, a storage unit 550, and an external input / output.
  • Unit 560 GPS (Global Positioning System) reception unit 570, motion sensor unit 580, power supply unit 590, and main control unit 501.
  • a wireless communication function for performing mobile wireless communication via the base station device BS and the mobile communication network NW is provided as a main function of the smartphone 500.
  • the wireless communication unit 510 performs wireless communication with the base station apparatus BS accommodated in the mobile communication network NW according to an instruction from the main control unit 501. Using this wireless communication, transmission and reception of various file data such as audio data and image data, e-mail data, and reception of Web data and streaming data are performed.
  • the display input unit 520 displays images (still images and moving images), character information, and the like visually by the control of the main control unit 501, and visually transmits information to the user, and detects user operations on the displayed information.
  • This is a so-called touch panel, and includes a display panel 521 and an operation panel 522.
  • the display panel 521 is preferably a 3D display panel.
  • the display panel 521 uses an LCD (Liquid Crystal Display), an OELD (Organic Electro-Luminescence Display), or the like as a display device.
  • LCD Liquid Crystal Display
  • OELD Organic Electro-Luminescence Display
  • the operation panel 522 is a device that is placed so that an image displayed on the display surface of the display panel 521 is visible and detects one or a plurality of coordinates operated by a user's finger or stylus.
  • a detection signal generated due to the operation is output to the main control unit 501.
  • the main control unit 501 detects an operation position (coordinates) on the display panel 521 based on the received detection signal.
  • the display panel 521 and the operation panel 522 of the smartphone 500 integrally form the display input unit 520, but the operation panel 522 is disposed so as to completely cover the display panel 521. ing.
  • the operation panel 522 may have a function of detecting a user operation even in an area outside the display panel 521.
  • the operation panel 522 includes a detection area (hereinafter referred to as a display area) for an overlapping portion that overlaps the display panel 521 and a detection area (hereinafter, a non-display area) for an outer edge portion that does not overlap the other display panel 521. May be included).
  • the size of the display area and the size of the display panel 521 may be completely matched, but it is not always necessary to match the two.
  • the operation panel 522 may include two sensitive regions of the outer edge portion and the other inner portion. Further, the width of the outer edge portion is appropriately designed according to the size of the housing 502 and the like.
  • examples of the position detection method employed in the operation panel 522 include a matrix switch method, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method. You can also
  • the call unit 530 includes a speaker 531 and a microphone 532, and converts a user's voice input through the microphone 532 into voice data that can be processed by the main control unit 501, and outputs the voice data to the main control unit 501, or a wireless communication unit 510 or the audio data received by the external input / output unit 560 is decoded and output from the speaker 531.
  • the speaker 531 and the microphone 532 can be mounted on the same surface as the surface on which the display input unit 520 is provided.
  • the operation unit 540 is a hardware key using a key switch or the like, and receives an instruction from the user.
  • the operation unit 540 is mounted on a lower portion and a lower side of the display unit of the housing 502 of the smartphone 500 and is turned on when pressed with a finger or the like, and is turned off when a finger is released with a restoring force such as a spring. It is a button type switch.
  • the storage unit 550 includes control programs and control data of the main control unit 501, address data in which names and telephone numbers of communication partners are associated, transmitted and received e-mail data, Web data downloaded by Web browsing, and downloaded contents Data is stored, and streaming data and the like are temporarily stored.
  • the storage unit 550 includes an internal storage unit 551 with a built-in smartphone and an external storage unit 552 having a removable external memory slot.
  • Each of the internal storage unit 551 and the external storage unit 552 constituting the storage unit 550 includes a flash memory type (flash memory type), a hard disk type (hard disk type), a multimedia card micro type (multimedia card micro type), It is realized using a storage medium such as a card type memory (for example, Micro SD (registered trademark) memory), RAM (Random Access Memory), ROM (Read Only Memory), or the like.
  • flash memory type flash memory type
  • hard disk type hard disk type
  • multimedia card micro type multimedia card micro type
  • a storage medium such as a card type memory (for example, Micro SD (registered trademark) memory), RAM (Random Access Memory), ROM (Read Only Memory), or the like.
  • the external input / output unit 560 serves as an interface with all external devices connected to the smartphone 500, and communicates with other external devices (for example, universal serial bus (USB), IEEE1394, etc.) or a network.
  • external devices for example, universal serial bus (USB), IEEE1394, etc.
  • a network for example, Internet, wireless LAN, Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA) (registered trademark), UWB (Ultra Wide Band) (registered trademark), ZigBee ( ZigBee) (registered trademark, etc.) for direct or indirect connection.
  • Examples of the external device connected to the smartphone 500 include a memory card connected via a wired / wireless headset, wired / wireless external charger, wired / wireless data port, card socket, and SIM (Subscriber).
  • Identity Module Card / UIM User Identity Module Card
  • external audio / video equipment connected via audio / video I / O (Input / Output) terminal
  • external audio / video equipment connected wirelessly, yes / no
  • the external input / output unit may transmit data received from such an external device to each component inside the smartphone 500, or may allow data inside the smartphone 500 to be transmitted to the external device. it can.
  • the GPS receiving unit 570 receives GPS signals transmitted from the GPS satellites ST1 to STn in accordance with an instruction from the main control unit 501, executes positioning calculation processing based on the received plurality of GPS signals, A position consisting of longitude and altitude is detected.
  • the GPS receiving unit 570 can acquire position information from the wireless communication unit 510 or the external input / output unit 560 (for example, a wireless LAN), the GPS receiving unit 570 can also detect the position using the position information.
  • the motion sensor unit 580 includes, for example, a three-axis acceleration sensor, and detects the physical movement of the smartphone 500 in accordance with an instruction from the main control unit 501. By detecting the physical movement of the smartphone 500, the moving direction and acceleration of the smartphone 500 are detected. This detection result is output to the main control unit 501.
  • the power supply unit 590 supplies power stored in a battery (not shown) to each unit of the smartphone 500 in accordance with an instruction from the main control unit 501.
  • the main control unit 501 includes a microprocessor, operates according to a control program and control data stored in the storage unit 550, and controls each unit of the smartphone 500 in an integrated manner. Further, the main control unit 501 includes a mobile communication control function for controlling each unit of the communication system and an application processing function in order to perform voice communication and data communication through the wireless communication unit 510.
  • the application processing function is realized by the main control unit 501 operating in accordance with application software stored in the storage unit 550.
  • Application processing functions include, for example, an infrared communication function that controls the external input / output unit 560 to perform data communication with the opposite device, an e-mail function that transmits and receives e-mails, and a web browsing function that browses web pages. .
  • the main control unit 501 also has an image processing function such as displaying video on the display input unit 520 based on image data (still image or moving image data) such as received data or downloaded streaming data.
  • the image processing function is a function in which the main control unit 501 decodes the image data, performs image processing on the decoding result, and displays an image on the display input unit 520.
  • the main control unit 501 executes display control for the display panel 521 and operation detection control for detecting a user operation through the operation unit 540 and the operation panel 522.
  • the main control unit 501 displays an icon for starting application software, a software key such as a scroll bar, or a window for creating an e-mail.
  • a software key such as a scroll bar, or a window for creating an e-mail.
  • the scroll bar refers to a software key for accepting an instruction to move the display portion of a large image that does not fit in the display area of the display panel 521.
  • the main control unit 501 detects a user operation through the operation unit 540, or accepts an operation on the icon or an input of a character string in the input field of the window through the operation panel 522. Or a display image scroll request through a scroll bar.
  • the main control unit 501 causes the operation position with respect to the operation panel 522 to overlap with the display panel 521 (display area) or other outer edge part (non-display area) that does not overlap with the display panel 521.
  • a touch panel control function for controlling the sensitive area of the operation panel 522 and the display position of the software key.
  • the main control unit 501 can also detect a gesture operation on the operation panel 522 and execute a preset function according to the detected gesture operation.
  • Gesture operation is not a conventional simple touch operation, but an operation that draws a trajectory with a finger or the like, designates a plurality of positions at the same time, or combines these to draw a trajectory for at least one of a plurality of positions. means.
  • the camera unit 541 is a digital camera that performs electronic photography using an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-Coupled Device).
  • CMOS Complementary Metal Oxide Semiconductor
  • CCD Charge-Coupled Device
  • the camera unit 541 converts image data obtained by shooting into compressed image data such as JPEG (JointoPhotographic coding Experts Group) under the control of the main control unit 501, and records the data in the storage unit 550.
  • the data can be output through the external input / output unit 560 and the wireless communication unit 510.
  • the camera unit 541 is mounted on the same surface as the display input unit 520, but the mounting position of the camera unit 541 is not limited to this and may be mounted on the back surface of the display input unit 520. Alternatively, a plurality of camera units 541 may be mounted. Note that when a plurality of camera units 541 are mounted, the camera unit 541 used for shooting can be switched to shoot alone, or a plurality of camera units 541 can be used simultaneously for shooting.
  • the camera unit 541 can be used for various functions of the smartphone 500.
  • an image acquired by the camera unit 541 can be displayed on the display panel 521, or the image of the camera unit 541 can be used as one of operation inputs of the operation panel 522.
  • the GPS receiving unit 570 detects the position, the position can also be detected with reference to an image from the camera unit 541.
  • the optical axis direction of the camera unit 541 of the smartphone 500 is determined without using the triaxial acceleration sensor or in combination with the triaxial acceleration sensor. It is also possible to determine the current usage environment.
  • the image from the camera unit 541 can be used in the application software.
  • the present invention can be applied not only to the OIS mechanism 16 but also to the case where the focus adjustment mechanism 18 is PWM-controlled. In short, any lens driving mechanism that PWM-controls the lens unit can be applied.
  • SYMBOLS 10 Imaging module, 12 ... Lens unit, 14 ... Image sensor, 16 ... Optical camera shake correction (OIS) mechanism, 18 ... Focus adjustment mechanism, 16a, 18a ... Voice coil motor (VCM), 50 ... Pulse width modulation (PWM) ) Control unit 52... PWM signal generation unit 54.
  • Driver 57. Clock input terminal 100.
  • Electronic equipment 102. Central processing unit (CPU) 102 a Oscillator 112 112 Digital signal processing unit 142 Pixel 143 Timing generator (TG) 144 Vertical driver 145 Horizontal driver

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention concerne un module d'imagerie, un dispositif d'imagerie, et un procédé de commande d'un module d'imagerie qui permettent de conserver la puissance à l'aide d'une modulation d'impulsions en durée (MID) pour commander un mécanisme d'entraînement de lentilles sans ajouter de bruit aux images. Un module d'imagerie (10) dans un mode de réalisation de la présente invention comprend les éléments suivants : une unité de lentilles (12) ; un élément d'imagerie (14) qui reçoit une image optique via ladite unité de lentilles (12) et convertit ladite image optique en un signal électrique ; une unité d'entraînement d'élément d'imagerie qui délivre en sortie un signal d'entraînement pour l'élément d'imagerie (14) et lit un signal d'image de l'élément d'imagerie ; une mécanisme d'entraînement de lentilles qui entraîne l'unité de lentilles (12) ; et une unité de commande MID (50) qui génère un signal MID sur la base d'une valeur d'une instruction pour commander l'unité de lentilles (12) et commande le mécanisme d'entraînement de lentilles sur la base dudit signal MID. L'unité de commande MID (50) génère un signal MID qui est synchronisé avec le signal d'entraînement délivré en sortie par l'unité d'entraînement d'élément d'imagerie.
PCT/JP2014/078195 2013-11-25 2014-10-23 Module d'imagerie, dispositif électronique, et procédé de commande de module d'imagerie WO2015076055A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013243069 2013-11-25
JP2013-243069 2013-11-25

Publications (1)

Publication Number Publication Date
WO2015076055A1 true WO2015076055A1 (fr) 2015-05-28

Family

ID=53179325

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/078195 WO2015076055A1 (fr) 2013-11-25 2014-10-23 Module d'imagerie, dispositif électronique, et procédé de commande de module d'imagerie

Country Status (1)

Country Link
WO (1) WO2015076055A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109803066A (zh) * 2017-11-17 2019-05-24 三星电子株式会社 用于在相机模块内生成时钟信号的电子装置和方法
JP2020148967A (ja) * 2019-03-14 2020-09-17 キヤノン株式会社 信号出力装置およびその制御方法、撮像装置
EP3617765B1 (fr) * 2017-04-28 2022-11-09 Sony Semiconductor Solutions Corporation Dispositif d'imagerie et équipement électronique

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002271664A (ja) * 2001-03-12 2002-09-20 Sanyo Electric Co Ltd 携帯電話機
JP2013080062A (ja) * 2011-10-03 2013-05-02 Rohm Co Ltd リニアアクチュエータの駆動回路および駆動方法ならびにそれらを用いたレンズモジュールおよび電子機器

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002271664A (ja) * 2001-03-12 2002-09-20 Sanyo Electric Co Ltd 携帯電話機
JP2013080062A (ja) * 2011-10-03 2013-05-02 Rohm Co Ltd リニアアクチュエータの駆動回路および駆動方法ならびにそれらを用いたレンズモジュールおよび電子機器

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3617765B1 (fr) * 2017-04-28 2022-11-09 Sony Semiconductor Solutions Corporation Dispositif d'imagerie et équipement électronique
CN109803066A (zh) * 2017-11-17 2019-05-24 三星电子株式会社 用于在相机模块内生成时钟信号的电子装置和方法
KR20190056696A (ko) * 2017-11-17 2019-05-27 삼성전자주식회사 카메라 모듈 내에서 이미지 센서를 위한 클럭 신호를 생성하기 위한 전자 장치 및 방법
EP3496395A3 (fr) * 2017-11-17 2019-09-11 Samsung Electronics Co., Ltd. Dispositif électronique et module de caméra de génération de signal d'horloge pour capteur d'image dans un module de caméra
US11196909B2 (en) 2017-11-17 2021-12-07 Samsung Electronics Co., Ltd. Electronic device and method for generating clock signal for image sensor in camera module
KR102435614B1 (ko) * 2017-11-17 2022-08-24 삼성전자주식회사 카메라 모듈 내에서 이미지 센서를 위한 클럭 신호를 생성하기 위한 전자 장치 및 방법
CN109803066B (zh) * 2017-11-17 2023-03-28 三星电子株式会社 用于在相机模块内生成时钟信号的电子装置和方法
JP2020148967A (ja) * 2019-03-14 2020-09-17 キヤノン株式会社 信号出力装置およびその制御方法、撮像装置
JP7242357B2 (ja) 2019-03-14 2023-03-20 キヤノン株式会社 信号出力装置およびその制御方法、撮像装置

Similar Documents

Publication Publication Date Title
JP5690974B2 (ja) 撮像装置及び合焦制御方法
JP5697801B2 (ja) 撮像装置及び自動焦点調節方法
JP5542249B2 (ja) 撮像素子及びこれを用いた撮像装置及び撮像方法
JP5775977B2 (ja) 画像処理装置、撮像装置、画像処理方法、及び画像処理プログラム
JP5799178B2 (ja) 撮像装置及び合焦制御方法
JP5736512B2 (ja) 撮像装置およびその動作制御方法
JP6077967B2 (ja) 撮像装置
WO2015198690A1 (fr) Dispositif d'imagerie
WO2014141561A1 (fr) Dispositif d'imagerie et procédé et programme de traitement de signaux
WO2015141084A1 (fr) Dispositif d'imagerie, et procédé de commande de focalisation
WO2014038258A1 (fr) Dispositif d'imagerie et procédé de commande de foyer
JP7060634B2 (ja) 撮像装置及び画像処理方法
WO2013168667A1 (fr) Dispositif et procédé de traitement d'images et dispositif de capture d'images
WO2013179899A1 (fr) Dispositif d'imagerie
EP2833406B1 (fr) Élément d'imagerie et dispositif d'imagerie
JP6427720B2 (ja) 撮像素子及び撮像装置
JP5749409B2 (ja) 撮像装置、画像処理方法及びプログラム
WO2015076055A1 (fr) Module d'imagerie, dispositif électronique, et procédé de commande de module d'imagerie
JPWO2017209252A1 (ja) 撮像装置、合焦制御方法、及び、合焦制御プログラム
JP5677628B2 (ja) 撮像装置及び撮像方法
WO2014080682A1 (fr) Dispositif de capture d'images, et procédé de mise au point et programme de commande de mise au point destinés audit dispositif
JP6374535B2 (ja) 操作装置、追尾システム、操作方法、及びプログラム
JP5680803B2 (ja) 画像処理装置および方法ならびに撮像装置
JP6573730B2 (ja) 撮像装置、撮像方法、及び、撮像プログラム
WO2020003944A1 (fr) Dispositif d'imagerie, procédé d'imagerie, et programme

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14863674

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 14863674

Country of ref document: EP

Kind code of ref document: A1