JP2006217398A - Imaging module with sensor function and imaging system with sensor function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging module with a sensor function, which is capable of acquiring information other than video information together with the video information, and an imaging system with a sensor function, which uses the imaging module with the sensor function. <P>SOLUTION: An imaging module 11 with a sensor function includes a solid-state imaging device 101 for converting video information into an electric signal, at least one sensor for detecting information other than video information, a connection part 106 for connecting the solid-state imaging device 101, the sensor, and an external circuit, and an insulating resin mold 103 having the sensor and the connection part 106 mounted thereon. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging module with a sensor function and an imaging system with a sensor function.

  Conventionally, surveillance cameras or portable information terminals are required to acquire audio information together with video information.

  However, when the solid-state imaging device and the microphone are attached as separate parts to a surveillance camera or the like, there is a limit to downsizing due to restrictions on attachment and wiring.

  In view of this, a solid-state imaging device with a microphone function in which a solid-state imaging device that collects video information and a microphone that collects audio information is integrated into one device has already been proposed (see, for example, Patent Document 1).

  FIG. 10 is a perspective view of the above-described solid-state image sensor 9 with a microphone function, and a light-transmitting diaphragm 95 that also serves as a sealing member for the solid-state image sensor 91 is disposed on the front surface of the solid-state image sensor 91.

By using the transparent conductive film affixed to the diaphragm 95 and the metal light shield film covering the surface of the solid-state imaging device 91 as a capacitor electrode, a microphone for converting the vibration of the diaphragm into an electric signal is formed. ing.
Japanese Patent Laid-Open No. 11-127393 ([0007], FIG. 1)

  However, in the above-described solid-state image pickup device with a microphone function, since the diaphragm of the microphone is arranged in front of the solid-state image pickup device, when the vibration plate vibrates by sound, the image captured by the solid-state image pickup device is disturbed. There was a problem that it cannot be avoided.

  In addition, there is a problem that a sensor that can be integrated with a solid-state imaging device is limited to a microphone.

  The present invention has been made to solve the above-described problem, and is capable of acquiring not only clear video information but also information other than video information at the same time as video information, and an imaging module with a sensor function. An object is to provide an imaging system with a sensor function using an imaging module with a sensor function.

  An imaging module with a sensor function of the present invention connects a solid-state imaging device that converts video information into an electrical signal, at least one sensor that detects information other than the video information, and the solid-state imaging device, the sensor, and an external circuit. And an insulating resin mold on which the solid-state imaging device, the sensor, and the connection portion are mounted.

  With this configuration, not only video information but also information other than video information can be acquired simultaneously.

  In the imaging module with a sensor function of the present invention, the solid-state imaging device may be a CCD solid-state imaging device.

  In the imaging module with a sensor function of the present invention, the solid-state imaging device may be a CMOS solid-state imaging device.

  The imaging module with a sensor function of the present invention has a configuration in which the sensor is a microphone that converts audio information into an electrical signal.

  With this configuration, video information and audio information can be acquired simultaneously.

  In the imaging module with a sensor function of the present invention, the microphone may be an electret condenser microphone.

  In the imaging module with a sensor function of the present invention, the microphone may open in the same direction as an opening that guides the video information to the solid-state imaging device.

  In the imaging module with a sensor function of the present invention, the microphone may include a plurality of microphones having different directivities.

  In the imaging module with a sensor function of the present invention, the microphone has a middle-tone microphone that detects a sound having a frequency of about 200 to about 2000 hertz, a low-frequency microphone that detects a low frequency of about 200 hertz or less, and about 2000 hertz. A treble microphone for detecting the above treble may be included.

  In the imaging module with a sensor function of the present invention, the microphone may be an ultrasonic microphone that detects ultrasonic waves.

  The imaging module with a sensor function of the present invention has a configuration in which the sensor includes an optical sensor that detects optical information.

  With this configuration, video information and optical information can be acquired simultaneously.

  In the imaging module with a sensor function of the present invention, the optical sensor may be an infrared light sensor that detects infrared light.

  In the imaging module with a sensor function of the present invention, the optical sensor may be an ultraviolet light sensor that detects ultraviolet light.

  The imaging module with a sensor function of the present invention has a configuration in which the external circuit side end of the connection portion is a solder terminal.

  With this configuration, the imaging module with a sensor function can be connected to the printed circuit board circuit by solder.

  The imaging module with a sensor function of the present invention has a configuration in which the external circuit side end of the connection terminal is a pin terminal.

  With this configuration, the imaging module with a sensor function can be connected to the external circuit via the receptacle.

  The imaging system with a sensor function according to the present invention includes an imaging module with a sensor function, an audio source direction determining unit that determines an audio source direction based on an electrical signal output from a microphone included in the imaging module with the sensor function, and the sensor. And a module direction control unit that controls the video information acquisition direction of the imaging module with a function in the direction of the sound source.

  With this configuration, the image sensor can be directed in the direction of the sound source.

  In the imaging system with a sensor function of the present invention, the microphone may include a plurality of microphones opening in different directions.

  In the imaging system with a sensor function of the present invention, the sound source direction determining unit has a peak holding unit that holds a peak of an electric signal output from the plurality of microphones, and a peak held in the peak holding unit is the maximum. An audio source direction determining unit that determines the opening direction of the microphone as the audio source direction may be included.

  The imaging system with a sensor function of the present invention may include a peak update unit that updates a peak held by the peak holding unit at predetermined time intervals.

  In the imaging system with a sensor function of the present invention, the module direction control unit may use a motor as a drive source for controlling the video information acquisition direction of the imaging module with the sensor function.

  In the imaging system with a sensor function of the present invention, the sensor may include an optical sensor that detects optical information.

  In the imaging system with a sensor function of the present invention, the optical sensor may be a photodiode that detects light.

  The present invention is a sensor capable of not only capturing a clear image but also detecting information other than an image including a sound by mounting a solid-state imaging device, a sensor, and a connection portion on the same insulating resin mold. An imaging module with a function can be provided.

Embodiments of an imaging module with a sensor function and an imaging system with a sensor function according to the present invention will be described below with reference to the drawings.
(First embodiment)
As shown in FIG. 1, the imaging module 11 with a sensor function according to the first embodiment of the present invention includes at least one solid-state imaging device 101 that converts video information into an electrical signal and information other than video information. Each sensor has a configuration including a solid-state image sensor 101, a connection unit 106 that connects the sensor and an external circuit, and an insulating resin mold 103 that mounts the solid-state image sensor 101, the sensor and the connection unit 106. The upper surface of the insulating resin mold 103 may be covered with the cover 107.

  In the following embodiment, the solid-state image sensor 101 is a CCD solid-state image sensor or a CMOS solid-state image sensor, and the sensor is a microphone 102 that detects sound.

  An opening 104 that guides video information to the solid-state imaging device 101 and an opening 105 that guides audio information to the microphone 102 are formed in the cover 107. The cover 107 may be integrated with the insulating resin mold 103, and the opening 104 and the opening 105 may be formed by die cutting at the time of molding.

  The insulating resin mold 103 is embedded with a connection portion 106 that connects the solid-state imaging device 101 and the microphone 102 and an external circuit. One end of the connection portion 106 is connected to the solid-state imaging device 101 and the microphone 102 and the other end. Forms a soldering terminal.

  The other end of the connecting portion 106 may be a pin terminal 501 as shown in FIG.

As described above, according to the imaging module with sensor function of the first embodiment, the acquisition direction of video information by the solid-state imaging device 101 and the acquisition direction of audio information by the microphone 102 can be matched.
(Second Embodiment)
The imaging module 12 with a sensor function according to the second embodiment of the present invention, as shown in FIG. 3, is a solid-state imaging device 101 that converts video information into an electrical signal, and at least one that detects information other than video information. Each sensor has a configuration including a solid-state image sensor 101, a connection unit 106 that connects the sensor and an external circuit, and an insulating resin mold 103 that mounts the solid-state image sensor 101, the sensor and the connection unit 106. The upper surface of the insulating resin mold 103 may be covered with the cover 107.

  In the following embodiment, it is assumed that the solid-state image sensor 101 is a CCD solid-state image sensor or a CMOS solid-state image sensor, and the sensors are a microphone 102 and an optical sensor 301 that detect sound. It is assumed that the optical sensor 301 is inserted into the socket 303.

  An opening 104 that guides video information to the solid-state imaging device 101, an opening 105 that guides audio information to the microphone, and an opening 302 that guides optical information to the optical sensor 301 are formed in the cover 107.

  The insulating resin mold 103 is embedded with a connection portion 106 that connects the solid-state imaging device 101, the microphone 102, and the socket 303 to an external circuit. One end of the connection portion 106 is solid-state imaging device 101, the microphone 102, and the socket 303. The other end forms a solder terminal or a pin terminal.

As described above, according to the imaging module with sensor function of the second embodiment, the acquisition direction of the video information by the solid-state imaging device 101, the acquisition direction of the audio information by the microphone 102, and the optical information acquisition by the optical sensor 301 The direction can be matched.
(Third embodiment)
As shown in FIG. 4, the imaging module 13 with a sensor function according to the third embodiment of the present invention includes at least one solid-state imaging device 101 that converts video information into an electrical signal and information other than the video information. Each sensor has a configuration including a solid-state image sensor 101, a connection unit 106 that connects the sensor and an external circuit, and an insulating resin mold 103 that mounts the solid-state image sensor 101, the sensor and the connection unit 106. The upper surface of the insulating resin mold 103 may be covered with the cover 107.

  In the following embodiment, the solid-state imaging device 101 is a CCD solid-state imaging device or a CMOS solid-state imaging device, and the sensors are a first microphone 121, a second microphone 122, and a third microphone that detect sound. 123 and the fourth microphone 124.

  The cover 107 is formed with an opening 104 for guiding video information to the solid-state imaging device 101 and first to fourth openings 151 to 154 for guiding sound information to the first to fourth microphones 121 to 124.

  The insulating resin mold 103 is embedded with a solid-state image sensor 101 and a connection portion 106 that connects the first to fourth microphones 121 to 124 and an external circuit, and one end of the connection portion 106 is connected to the solid-state image sensor 101 and It is connected to the first to fourth microphones 121 to 124, and the other end forms a solder terminal or a pin terminal.

  The first microphone 121 and the fourth microphone 124 arranged diagonally of the imaging module 12 with the sensor function are medium-sound microphones that detect sound having a frequency of about 200 to about 2000 hertz. The microphone 122 is a low-frequency microphone that detects low sounds of about 200 hertz or lower, and the fourth microphone 124 is a high-frequency microphone that detects high sounds of about 2000 hertz or higher.

  That is, according to the imaging module with a sensor function of the third embodiment, it is possible to simultaneously detect low-frequency sound information and high-frequency sound information in addition to the intermediate frequency sound information mainly including the real voice using a plurality of microphones. It becomes.

  FIG. 5 is a block diagram illustrating the drive processing unit 20 of the imaging module with sensor function 13 according to the third embodiment of the present invention, and a control unit 21 that controls the imaging module with sensor function 13 and a solid-state imaging device. A driving unit 22 that drives the image signal 101; a video signal processing unit 23 that removes noise from the video signal output from the solid-state imaging device 101; and an A / D conversion unit 24 that converts the processed video signal into a digital video signal. And audio signal amplifiers 251 to 254 that amplify audio signals output from the first to fourth microphones 121 to 124, and an audio signal encoding unit 26 that converts the amplified audio signals into digital audio signals. . The control unit 21 sends out a digital video signal and a digital audio signal to the outside. Note that the digital video signal and the digital audio signal may be serial signals and interfaced with the outside through a single cable.

As described above, according to the imaging module with a sensor function of the third embodiment, it is possible to detect not only a real voice but also low and high frequency sounds.
(Fourth embodiment)
The fourth embodiment of the present invention shows an example of implementation.

  As shown in FIG. 6, the imaging module 14 with a sensor function according to the fourth embodiment of the present invention has first to fifth openings that are open on five surfaces other than the back surface of the solid-state imaging device 101 of the imaging module 14 with a sensor function. Microphones 131 to 135 are provided. The insulating resin mold 103 has first to fifth openings 161 to 165 corresponding to the first to fifth microphones 131 to 135.

  FIG. 7 is a block diagram illustrating the drive processing unit 200 of the imaging module with sensor function 14 according to the fourth embodiment of the present invention, and a control unit 21 that controls the imaging module with sensor function 14 and a solid-state imaging device. A driving unit 22 that drives the image signal 101; a video signal processing unit 23 that removes noise from the video signal output from the solid-state imaging device 101; and an A / D conversion unit 24 that converts the processed video signal into a digital video signal. Audio signal amplifying units 251 to 255 for amplifying audio signals output from the first to fifth microphones 121 to 125, an audio signal encoding unit 26 for converting the amplified audio signals into digital audio signals, 1st-5th peak holding | maintenance part 271-275 which hold | maintains the maximum value of the output of the 1st-5th audio | voice signal amplification parts 251-255 are included. The control unit 21 not only sends out the digital video signal and the digital audio signal to the outside, but also drives the PAN motor 41 through the PAN drive circuit 31 and the TILT motor 42 through the TILT drive circuit 32.

  The first to fifth peak holding units 271 to 275 and the control unit 21 that hold the maximum values of the outputs of the first to fifth audio signal amplification units 251 to 255 determine the direction of the audio source that generates the audio. It functions as a sound source direction determining unit.

  The peak holding units 271 to 275 may include a peak update unit that updates a peak held at predetermined intervals (for example, 5 seconds).

  The PAN drive circuit 31, the PAN motor 41, the TILT drive circuit 32, and the TILT motor 42 function as a module direction control unit that controls the imaging module with sensor function 14 in the direction of the sound source.

  And the control part 21 searches the maximum value of the peak hold | maintained at the 1st-5th peak holding | maintenance part 271-275, and the sound source direction determination part which determines the opening direction of the microphone which output the maximum value as a sound source direction Function as.

  FIG. 8 is a front view (a) and a side view (b) of the module direction control unit, in which a stepping motor is used as the PAN motor 41 and the TILT motor 42 for controlling the image information acquisition direction of the imaging module with sensor function. Also good.

  FIG. 9 is a diagram for explaining the operation of the imaging system with a sensor function. When the sound source is on the right side of the imaging module 14 with the sensor function, the audio signal output from the fifth microphone 135 is maximum. The fifth peak holding unit 275 holds the maximum peak.

  Then, the PAN motor 41 and the TILT motor 42 are operated to drive the solid-state imaging device 101 of the imaging module with sensor function 14 so as to face rightward.

  As described above, according to the fourth embodiment, it is possible to quickly acquire video information in the direction in which the sound source exists.

  As described above, the imaging module with a sensor function and the imaging system with a sensor function according to the present invention have an effect that video information and information other than video information can be acquired simultaneously and clearly, and are effective as a monitoring device or the like. .

The perspective view of the imaging module with a sensor function in the 1st Embodiment of this invention The perspective view of the imaging module with a sensor function in the 1st Embodiment of this invention The perspective view of the imaging module with a sensor function in the 2nd Embodiment of this invention The perspective view of the imaging module with a sensor function in the 3rd Embodiment of this invention The block diagram which shows the drive process part for the imaging modules with a sensor function in the 3rd Embodiment of this invention. The perspective view of the imaging module with a sensor function in the 4th Embodiment of this invention The block diagram which shows the drive process part for the imaging modules with a sensor function in the 4th Embodiment of this invention Front view and side view of module direction control unit for imaging module with sensor function in fourth embodiment of the present invention The figure explaining operation | movement of the imaging system with a sensor function using the imaging module with a sensor function in the 4th Embodiment of this invention. A perspective view of a conventional solid-state imaging device with a microphone function

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Imaging module with sensor function 101 Solid-state image sensor 102 Microphone 103 Insulation resin mold 104 Opening for solid-state image sensor 105 Opening for microphone 106 Connection part 107 Cover

Claims (21)

A solid-state imaging device that converts video information into an electrical signal;
At least one sensor for detecting information other than the video information;
A connecting portion for connecting the solid-state imaging device and sensor and an external circuit;
An imaging module with a sensor function including the solid-state imaging device, the sensor, and an insulating resin mold on which the connection portion is mounted. The imaging module with a sensor function according to claim 1, wherein the solid-state imaging device is a CCD solid-state imaging device. The imaging module with a sensor function according to claim 1, wherein the solid-state imaging device is a CMOS solid-state imaging device. The imaging module with a sensor function according to any one of claims 1 to 3, wherein the sensor is a microphone that converts audio information into an electrical signal. The imaging module with a sensor function according to claim 4, wherein the microphone is an electret condenser microphone. 6. The imaging module with a sensor function according to claim 4, wherein the microphone is a microphone that opens in the same direction as an opening that guides the video information to the solid-state imaging device. The imaging module with a sensor function according to any one of claims 4 to 6, wherein the microphone includes a plurality of microphones having different directivities. The microphone includes a mid-range microphone that detects a sound having a frequency of about 200 to about 2000 hertz, a low-frequency microphone that detects a low frequency of about 200 hertz or less, and a high-frequency microphone that detects a high frequency of about 2000 hertz or more. The imaging module with a sensor function according to any one of claims 4 to 6, further comprising: The imaging module with a sensor function according to claim 4, wherein the microphone is an ultrasonic microphone that detects ultrasonic waves. The imaging module with a sensor function according to claim 1, wherein the sensor includes an optical sensor that detects optical information. The imaging module with a sensor function according to claim 10, wherein the optical sensor is an infrared light sensor that detects infrared light. The imaging module with a sensor function according to claim 10, wherein the optical sensor is an ultraviolet light sensor that detects ultraviolet light. The imaging module with a sensor function according to any one of claims 1 to 12, wherein an end of the connection portion on an external circuit side is a soldering terminal. The imaging module with a sensor function according to claim 1, wherein the external circuit side end of the connection terminal is a pin terminal. The imaging module with a sensor function according to any one of claims 4 to 14,
A sound source direction determining unit that determines a sound source direction based on an electrical signal output from a microphone included in the imaging module with a sensor function;
An imaging system with a sensor function, comprising: a module direction control unit that controls the video information acquisition direction of the imaging module with a sensor function in the direction of the sound source. The imaging system with a sensor function according to claim 15, wherein the microphone includes a plurality of microphones opening in different directions. The sound source direction determining unit is
A peak holding unit for holding a peak of an electric signal output from the plurality of microphones;
The imaging system with a sensor function according to claim 16, further comprising: an audio source direction determination unit that determines an opening direction of a microphone having a maximum peak held in the peak holding unit as an audio source direction. The imaging system with a sensor function according to claim 17, wherein the peak holding unit includes a peak updating unit that updates a peak held every predetermined time interval. The imaging system with a sensor function according to any one of claims 15 to 18, wherein the module direction control unit uses a motor as a drive source for controlling the video information acquisition direction of the imaging module with a sensor function. The imaging system with a sensor function according to claim 15, wherein the sensor includes an optical sensor that detects optical information. The imaging system with a sensor function according to claim 20, wherein the optical sensor is a photodiode that detects light.

Images