US8803976B2 - Image pickup apparatus - Google Patents

Image pickup apparatus Download PDF

Info

Publication number
US8803976B2
US8803976B2 US13/005,039 US201113005039A US8803976B2 US 8803976 B2 US8803976 B2 US 8803976B2 US 201113005039 A US201113005039 A US 201113005039A US 8803976 B2 US8803976 B2 US 8803976B2
Authority
US
United States
Prior art keywords
pixels
image pickup
shielding member
pixel
radiation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US13/005,039
Other languages
English (en)
Other versions
US20110181731A1 (en
Inventor
Hidetoshi Kabasawa
Minoru Wakabayashi
Hiroshi Isobe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Assigned to SONY CORPORATION reassignment SONY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ISOBE, HIROSHI, KABASAWA, HIDETOSHI, WAKABAYASHI, MINORU
Publication of US20110181731A1 publication Critical patent/US20110181731A1/en
Application granted granted Critical
Publication of US8803976B2 publication Critical patent/US8803976B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H04N5/3532—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/53—Control of the integration time
    • H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation

Definitions

  • the present application relates to an image pickup apparatus, and more particularly to an image pickup apparatus which is suitable for obtaining an image from an electromagnetic wave such as an infrared ray.
  • an infrared image pickup apparatus (such as a thermography) which captures an image of an object by using an infrared sensor composed of pixels each adapted to detect an infrared ray, thereby measuring a temperature of the object as an object whose image is to be captured has been proposed.
  • This infrared image pickup apparatus for example, is described in Japanese Patent Laid-Open No. 2004-317152.
  • the infrared image pickup apparatus is composed of a lens and an image pickup element.
  • very expensive devices are used as these two constituent elements, respectively.
  • a very expensive lens group made of germanium (Ge), zinc sulfide (ZnS), silicon (Si) or the like which has an excellent transmittance in an infrared wavelength region needs to be used as the lens.
  • a price of one sheet of Ge lens is 10,000 to 50,000 yen. Also, two to five sheets of Ge lenses are used as one set. For this reason, although depending on the necessary resolution, the cost of only the lens group becomes 20,000 to 250,000 yen in total.
  • Germanium used in the existing Ge lens is a rare metal. Thus, since the flows of germanium in the market are very small, a unit price of the material is as very expensive as 50,000 to 180,000 yen/kg.
  • ZnS zinc sulfide
  • the Si lens is more inexpensive than the Ge lens, the Si lens is unsuitable for being used in the thermography because a transmittance thereof in a far-infrared region (8 to 14 ⁇ m) is inferior.
  • the lens which is inexpensive and is not inferior in transmittance without using the rare metal is not currently realized.
  • the inexpensive lens is not yet proposed in the image pickup apparatus for the general terahertz wave typified by the far-infrared thermography.
  • the image pickup element has a hollow structure, called a micro-bolometer, in which pixels each made of a vanadium oxide (VOx) are individually supported in the air.
  • a micro-bolometer in which pixels each made of a vanadium oxide (VOx) are individually supported in the air.
  • the reason for requiring the hollow structure is as follows: An S/N ratio of a signal level to a noise level caused by self-heating or the like of a circuit system is poor because of a heated infrared sensor and a low sensitivity of the VOx element. Thus, for heat insulation, the hollow structure is forced to be adopted in the image pickup element.
  • micro-bolometer is very poor in productivity and thus is a very expensive device.
  • Vanadium in VOx is a rare metal, the number of manufacturing processes for manufacturing the hollow structure is increased, and thus the manufacturing cost is increased. This causes the micro-bolometer to be expensive.
  • the price in terms of the infrared image pickup apparatus is about 600,000 yen in a low pixel product, and is about 9,000,000 yen in a high pixel product.
  • the infrared image pickup apparatus only for business-oriented market is a commercial reality, and thus the infrared image pickup apparatus does not reach an increase in the market in terms of the consumer.
  • thermography The terahertz wave image pickup apparatus other than the far-infrared thermography also undergoes the same situation as that of the thermography and thus is more expensive than the thermography.
  • the use application of the current far-infrared thermography is merely limited to industrial equipment temperature management, object temperature detection for defense/security, night vision for night human body detection used for a luxury class car, and medical body temperature detection. Also, the worldwide shipping volume of the far-infrared thermography is 10,000 to 20,000 yen at the most.
  • the infrared sensor As compared with the image pickup apparatus such as the existing infrared image pickup apparatus (such as the thermography) or the existing teraheltz-wave image pickup apparatus, for example, it is expected to use a charge collecting element.
  • An automatic door, an air conditioner, a human body detecting sensor for detecting that there is a human body in front of a TV, or the like is given as an example in which the charge collecting element is used in the use application of the far-infrared detection.
  • the infrared sensor using the charge collecting element, which has been proposed until now has a structure including a single pixel or up to four pixels. Also, the infrared sensor is not such a sensor as to image a subject, and has only a function of detecting whether or not the human body crosses the front of the sensor.
  • the reason for this is because the charge collecting element cannot detect a statical object because an output signal from the charge collecting element is changed depending on a temperature change.
  • a circular optical chopper 101 having openings 102 formed therein is disposed as a light blocking member in front of an imager (image pickup element) 103 using a charge collecting element.
  • the optical chopper 101 is rotated with a central axis indicated by a chain line as a rotational axis, whereby a light L is radiated to the imager 103 , or is blocked to prevent the light L from being radiated to the imager 103 .
  • an output signal is obtained from the charge collecting element of the imager 103 based on the light L made incident to the imager 103 .
  • the present application has been made in order to solve the problems described above, and it is therefore desirable to provide an image pickup apparatus in which a size of a shutter portion necessary for capturing an image of a statical object can be greatly miniaturized as compared with the case of a size of an existing shutter portion, and which can be miniaturized.
  • an image pickup apparatus including: an image pickup element having a plurality of pixels; and a radiation/shielding portion configured to radiate/shield an electromagnetic wave for the image pickup element in such a way that a partial pixel selective radiation state in which the electromagnetic wave is radiated to a part of the pixels in the image pickup element and the electromagnetic wave is shielded for the pixels other than the part of the pixels is obtained in a time division manner while the part of the pixels to each of which the electromagnetic wave is radiated is successively changed.
  • the construction is not adopted such that the radiation/shielding is selected with all the pixels as an object as with the existing optical chopper 101 .
  • the radiation/shielding of the electromagnetic wave for the image pickup element is carried out in such a way that the partial pixel selective radiation state in which the electromagnetic wave is radiated to only the part of the pixels in the image pickup element is obtained in the time division manner while the part of the pixels are successively changed.
  • a construction for shielding the electromagnetic wave can be enough as long as the pixels for each of which the electromagnetic wave is shielded can be changed with time.
  • the shutter section such as a shielding member (shutter member) or a liquid crystal shutter which is close in size to the image pickup element described above, which is very smaller than the existing optical chopper 101 .
  • the shutter portion necessary for capturing the image of the statical object can be largely miniaturized as compared with existing one.
  • FIG. 1 is a perspective view showing a schematic structure of an image pickup device as a first example of a first embodiment of an image pickup apparatus of the present application;
  • FIGS. 2A and 2B are top plan views showing schematic structures of an imager and a shielding member of the image pickup device as the first example of the first embodiment of the image pickup apparatus shown in FIG. 1 , respectively;
  • FIGS. 3A and 3B are top plan views showing two states when the shielding member shown in FIG. 1 , and FIGS. 2A and 2B is vertically driven, respectively;
  • FIG. 4 is a time chart showing waveforms of signals outputted from the pixels of the imager shown in FIG. 1 ;
  • FIGS. 5A and 5B are graphs each representing a relationship between a chopper frequency and an output voltage after completion of charge-to-voltage conversion in a charge collecting element, respectively;
  • FIG. 6 is a block diagram showing a general internal configuration of the image pickup apparatus according to the first embodiment
  • FIG. 7 is a perspective view showing a schematic structure as a second example of the first embodiment of the image pickup apparatus of the present application.
  • FIGS. 8A and 8B are top plan views showing schematic structures of an imager and a shielding member of the image pickup device as the second example of the first embodiment of the image pickup apparatus shown in FIG. 7 , respectively;
  • FIGS. 9A and 9B are top plan views showing two states when the shielding member shown in FIG. 7 , and FIGS. 8A and 8B is vertically driven, respectively;
  • FIGS. 10A and 10B are top plan views showing schematic structures of an imager and a shielding member of an image pickup device as a third example of the first embodiment, respectively;
  • FIGS. 11A and 11B are top plan views showing schematic structures of an imager and a shielding member of an image pickup device as a fourth example of the first embodiment, respectively;
  • FIGS. 12A , 12 B and 12 C are views explaining a relationship between a minimum spot diameter of an image capturing lens, and a pixel size in order to make subjects identical to each other in the pixels disposed in adjacent portions, respectively;
  • FIG. 13 is a block diagram showing a general internal configuration of an image pickup apparatus according to a second embodiment
  • FIG. 14 is a view explaining a technique for complementing a value from the pixel held in a state in which an electromagnetic wave is shielded;
  • FIGS. 15A and 15B are views explaining a relationship between a gap defined between an image pickup element and a shielding member, and an image blurring region, respectively;
  • FIGS. 16A and 16B are top plan views showing schematic structures of an imager and a shielding member which an image pickup apparatus according to a third embodiment includes, respectively;
  • FIG. 17 is a view explaining a technique for driving a shielding member in the image pickup apparatus according to the third embodiment, respectively;
  • FIG. 18 is a time chart explaining a reading technique for an imager in the image pickup apparatus according to the third embodiment.
  • FIG. 19 is a block diagram showing a general internal configuration of the image pickup apparatus according to the third embodiment.
  • FIGS. 20A and 20B are top plan views showing schematic structures of an imager and a shielding member which an image pickup apparatus according to a fourth embodiment includes, respectively;
  • FIGS. 21A and 21B are a graph and a view explaining that output differences are generated between pixels in which opening portions are located, respectively, when a driving direction of the shielding member is reversed, and pixels other than these pixels, respectively;
  • FIG. 22 is a diagram explaining a driving technique for the shielding member in the image pickup apparatus of the fourth embodiment.
  • FIG. 23 is a view schematically showing a change of a luminance of each pixel following a lapse of time when the shielding member in the image pickup apparatus of the fourth embodiment is driven in accordance with the driving technique;
  • FIG. 24 is a block diagram showing a general internal configuration of the image pickup apparatus according to the fourth embodiment.
  • FIG. 25 is a view showing a construction of a shutter portion using a piezoelectric element actuator
  • FIGS. 26A and 26B are views showing driving forms of the shielding member by the piezoelectric element actuator, respectively.
  • FIG. 27 is a view showing a construction in which an existing optical chopper is provided in an imager composed of a charge collecting element.
  • FIG. 1 is a perspective view showing a schematic structure of an image pickup device as a first example of a first embodiment of an image pickup apparatus of the present application.
  • an image pickup device as the first example of the first embodiment is provided with an imager 3 , and a shutter portion 2 as a constituent element for radiation/shielding of the electromagnetic wave for the imager 3 .
  • the shutter portion 2 includes a shielding member 21 and constituent elements (such as coils 22 and magnets 23 which will be described later).
  • constituent elements such as coils 22 and magnets 23 which will be described later.
  • opening portions 21 A which will be described later and through which the infrared ray is radiated to the imager 3 are formed in the shielding member 21 .
  • the constituent elements are used to cause the shielding member 21 to make a reciprocating motion.
  • FIGS. 2A and 2B are top plan views showing schematic structures of the imager 3 and the shielding member 21 of the image pickup device shown in FIG. 1 .
  • the imager 3 is composed of an image pickup element using a charge collecting element.
  • rectangular pixels are disposed in a grid and in a matrix in a plane.
  • the pixels are classified into pixels 12 belonging to an A group and pixels 13 belonging to a B group.
  • the pixels 12 belonging to the A group hereinafter referred to as “A pixels 12 ”
  • the pixels 13 belonging to the B group hereinafter referred to as “B pixels 13 ” are alternately disposed in a checker-like pattern.
  • PZT lead zirconate titanate
  • the shielding member 21 has the opening portions 21 A each of which passes the electromagnetic wave, and other portions which are not the opening portions 21 A (portions which shield the electromagnetic wave).
  • a size of the opening portion 21 A is either approximately the same as that of the pixel of the imager 11 , or is slightly smaller than that of the pixel of the imager 11 .
  • the opening portions 21 A and the portions which are not the opening portions 21 A are alternately disposed in a checker-like pattern.
  • the coils 22 are provided so as to be connected to an upper portion and a lower portion of the shielding member 21 , respectively. Also, the magnets 23 are disposed so as to face the outsides of the coils 22 , respectively.
  • the shielding member 21 can be vertically driven as shown by a left-hand side double sided arrow in accordance with an operation together with the magnetic fields from the magnets 23 . That is to say, a Voice Coil Motor (VCM) is composed of the coils 22 and the magnets 23 .
  • VCM Voice Coil Motor
  • wire suspensions 24 are connected to four corners of the shielding member 21 , respectively, and a plate-like suspension holder 25 is connected to the other ends of the wire suspensions 24 .
  • At least one wire suspension 24 is a plus electrode, and at least different one wire suspension 24 is a minus electrode.
  • the current can be caused to flow through the coil 22 through the plus electrode and the minus electrode.
  • the shielding member 21 can be driven in accordance with the electromagnetic induction for the magnetic fields of the magnets 23 facing the coils 22 , respectively.
  • FIGS. 3A and 3B are top plan views showing two states when the shielding member 21 is vertically driven, respectively.
  • the shielding member 21 is vertically reciprocated.
  • a first state (refer to FIG. 3A ), and a second state are repetitively obtained.
  • the A pixels 12 face the opening portions 21 A, respectively.
  • the B pixels 13 face the opening portions 21 A, respectively.
  • the electromagnetic wave Since in the first state, the electromagnetic wave is made incident to each of the A pixels 12 , and the electromagnetic wave is made incident to none of the B pixels 13 . On the other hand, since in the second state, the electromagnetic wave is made incident to each of the B pixels 13 , and the electromagnetic wave is made incident to none of the A pixels 12 .
  • a movement amount of shielding member 21 in the transition between the first state and the second state corresponds to a size of about one pixel.
  • a size of the shielding member 21 in the driving direction has only to be at least “a size of the imager 11 +the size of one pixel,” and thus the image pickup apparatus can be miniaturized.
  • the space can be saved.
  • FIG. 4 is a time chart showing waveforms of voltage signals outputted from the pixels 12 and 13 of the imager 11 , respectively.
  • FIG. 4 An upper portion of FIG. 4 shows an actual output voltage signal from the A pixel 12 , and a lower portion of FIG. 4 shows an actual output voltage signal from the B pixel 13 . Note that, in FIG. 4 , 0 V is a reference voltage.
  • a period, P 1 , of time is a period of time for which the opening portion 21 A is located on the B pixel 13 (in a word, the B pixel 13 is held in a state of radiation of the electromagnetic wave) and the shielding member 21 is statical.
  • the statical state as the period, P 1 , of time the electric charges are not generated unless a subject moves, and 0 V is held after completion of the charge-to-voltage conversion.
  • an operation of the shielding member 21 transits from the state of the radiation of the electromagnetic wave to the B pixel 13 to the state of the radiation of the electromagnetic wave to the A pixel 12 .
  • the electromagnetic wave whose intensity gradually increases is radiated to the A pixel 12 . Therefore, the output voltage from the A pixel 12 gradually increases from 0 V in a plus direction, and becomes a peak value (positive peak value) at a timing at which the opening portion 21 A is perfectly located on the A pixel 12 (at a timing at which the radiation state is perfectly obtained).
  • the electromagnetic wave whose intensity gradually decreases is radiated to the B pixel 13 . Therefore, the output voltage from the B pixel 13 gradually decreases in a minus direction, and becomes a peak value (negative peak value) at a timing at which the electromagnetic wave radiated to the B pixel 13 is perfectly shielded by the shielding member 21 .
  • the luminance of the incident light to the A pixel 12 corresponds to “the electromagnetic wave from a temperature of the subject—the electromagnetic wave from a temperature of the shielding member 21 .”
  • the luminance of the incident light in a phase of the shielding of the electromagnetic wave for the B pixel 13 corresponds to “the electromagnetic wave from the temperature of the shielding member 21 —the electromagnetic wave from the temperature of the subject.”
  • the operation of the shielding member 21 transits from the state of the radiation of the electromagnetic wave to the A pixel 12 to the state of the radiation of the electromagnetic wave to the B pixel 13 .
  • the output voltage from the A pixel 12 gradually decreases, and becomes a peak value (negative peak value) at a timing at which the electromagnetic wave radiated to the A pixel 12 is perfectly shielded by the shielding member 21 .
  • the output voltage from the B pixel 13 gradually increases, and becomes a peak (positive peak value) at a timing at which the B pixel 13 is perfectly held in the state of the radiation of the electromagnetic wave through the opening portion 21 A.
  • FIG. 4 shows a situation in which the period of time for the reciprocating motion of the shielding member 21 is up to the period, P 8 , of time, and for a period, P 9 , of time, both the output voltage from the A pixel 12 and the output voltage from the B pixel 13 become 0 V.
  • a captured image signal for one frame of the imager 3 (a captured image signal for all the effective pixels) is obtained by using the peak values (the peak values each obtained at the timing at which the perfect radiation state is obtained) of the A pixel 12 and the B pixel 13 based on the reciprocating motion of the shielding member 21 .
  • the respective positive peak values are detected, and the captured image signal is obtained by using the positive peak values of the A pixel 12 and the B pixel 13 .
  • FIGS. 5A and 5B show a relationship between a chopper frequency (a period with which the shielding member 21 is made to one reciprocating motion: the frame rate for the image capturing), and an output voltage from a charge collecting element after completion of the charge-to-voltage conversion.
  • FIG. 5B shows a relationship between the chopper frequency in a wider range than that in the case of FIG. 5A , and the output voltage from the charge collecting element after completion of the charge-to-voltage conversion.
  • FIG. 5B there is a limit to an increase in output voltage due to an increase in chopper frequency.
  • 30 Hz or 60 Hz can be given as the general frame rate for the output.
  • the frame rate for the image capturing is set as the relatively high frequency such as 120 Hz or more. Also, in order to make the frame rate for the image capturing correspond to the general frame rate for the output such as 30 Hz or 60 Hz, it is effective to take some sort of measures.
  • the frame rate for the output is taken to be F Hz
  • the frame rate for the image capturing is taken to be (n ⁇ F) Hz (n: an integral number of 2 or more)
  • the luminances obtained through the n image capturing manipulations are either integrated or averaged, thereby obtaining the captured image signal for one frame.
  • the frame rate for the image capturing is set as 120 (4 ⁇ F) Hz, and the output voltages from the A pixels 12 , and the output voltages from the B pixels 13 which are obtained for four image capturing manipulations are either integrated or averaged. Also, the captured image signal composed of the values from the respective pixels obtained through either the integration or the averaging is outputted as the image signal for one frame.
  • the sensitivity of the imager 3 can be highly maintained.
  • any of the signal noises can be reduced by either the integration or the averaging, and thus an S/N ratio of the captured image signal can be enhanced.
  • the A pixel 12 and the pixel 13 are made to alternately transit to the radiation state, thereby making it possible to intentionally generate the temperature difference.
  • the temperature distribution of the subject can be captured to obtain the image of the subject. In other words, not only the passing of the subject can be detected, but also the image of the subject can be captured.
  • the constituent element composed of the charge collecting element can be used as the imager 3 .
  • the imager 3 can be inexpensively structured as compared with the case using the existing micro-bolometer, the price of the entire image pickup apparatus can be largely reduced.
  • the price of the entire image pickup apparatus can be largely reduced in such a manner, whereby the image pickup apparatus can be popularized from the existing limited use applications for the study and the industry to the various use applications for the consumer. Also, the application which has not existed heretofore can be realized in the use application for the consumer.
  • the opening portions 21 A in the shielding member 21 , and the portions other than the opening portions 21 A are disposed in the checker-like pattern.
  • the radiation/shielding of the electromagnetic wave for the imager 3 is carried out in such a way that the first state in which the electromagnetic wave is radiated to the A pixel 12 , and the second state in which the electromagnetic wave is radiated to the B pixel 13 are obtained in the time division manner.
  • the shielding member 21 can be close in size to the imager 3 , and the image pickup apparatus can be miniaturized as compared with the case where the existing optical chopper 101 is used.
  • the temperature of the subject detected at this time is not the absolute temperature, and thus is absolutely the relative temperature with the temperature of the shielding member 21 as the reference.
  • the following technique is adopted in order to allow the absolute temperature distribution to be detected as the temperature distribution of the subject.
  • the technique concerned is such that a temperature sensor or a thermistor for detecting the temperature of the shielding member 21 is provided in the vicinity of the shielding member 21 , and the relative temperature described above detected by the imager 3 is calibrated based on the data on the temperature.
  • FIG. 6 is a block diagram showing a general internal configuration of the image pickup apparatus for realizing the image capturing technique in the first embodiment described above.
  • an image capturing lens 1 is provided in the image pickup apparatus.
  • a material for the image capturing lens 1 is especially by no means limited as long as the material transmits the electromagnetic wave as an object.
  • the electromagnetic wave as the object is the infrared ray as with the first embodiment
  • a lens which is made of a more inexpensive material than each of the Ge lens and the Si lens which have been proposed in related art and which can transmit the infrared ray can be used in addition to the Ge lens and the Si lens.
  • a lens material for the infrared ray which will be developed in future can also be used.
  • the electromagnetic wave from the subject is transmitted through the image capturing lens 1 , the electromagnetic wave is radiated to the imager 3 through the shutter portion 2 (the opening portions 21 A).
  • the shutter portion 2 is provided with the shielding member 21 , a member made of the material which shields the electromagnetic wave as the object of the image capturing is used as the shielding member 21 .
  • the driving control for the shielding member 21 in the shutter portion 2 is carried out by a control portion 8 .
  • the shutter portion 2 is constructed so as to drive the shielding member 21 by the VCM.
  • the control portion 8 causes the shielding member 21 to carry out the reciprocating motion in accordance with drive signals supplied to the coils 22 (refer to FIG. 1 ), respectively, in the shutter portion 2 .
  • the control portion 8 supplies the drive signals described above which are set so as to realize the driving for the shielding member 21 based on the reciprocating range and the reciprocating period to the shutter portion 2 .
  • the electric charges obtained from the pixels of the imager 3 so as to follow the reciprocating motion of the shielding member 21 are converted into voltage signals through the charge-to-voltage conversion, and the resulting voltage signals are supplied to the sampling portion 5 .
  • the sampling portion 5 carries out the peak detection (the detection of the positive peak values in the first embodiment) about the voltage signals from the respective pixels and outputs the detected peak values to the averaging portion 6 .
  • the values obtained from the respective pixels through such an averaging operation are outputted as the captured image signals for one frame to a signal processing portion 7 .
  • the signal processing portion 7 comprehensively shows a circuit for, for example, carrying out black level correction, pixel defect complementary, aberration correction, optical shading correction, lens distortion correction, temperature adjustment, calculation of an amount of distance change, coding and the like.
  • An output signal from the signal processing portion 7 is sent to an external display device (image display device) or the like of the image pickup apparatus through an interface (not shown).
  • the image pickup apparatus is provided with a temperature sensor 4 .
  • the temperature sensor 4 is provided in the vicinity of the shielding member 21 in the shutter portion 2 in order to detect a temperature of the shielding member 21 .
  • a temperature value detected by the temperature sensor 4 is supplied to the control portion 8 .
  • the control portion 8 carries out the control as well for allowing the image signal representing the absolute temperature distribution to be obtained as the captured image signal based on the temperature value of the shielding member 21 detected by the temperature sensor 4 .
  • the temperature value supplied from the temperature sensor 4 is given to the signal processing portion 7 , thereby causing the signal processing portion 7 to adjust the values from the respective pixels to the values representing the respective absolute temperatures.
  • the opening portions 21 A and the portions other than the opening portions 21 A are formed so as to be disposed in the checker-like pattern.
  • the A pixels 12 and the B pixels 13 may also be disposed in a stripe-like pattern.
  • FIG. 7 is a perspective view showing a schematic structure as a second example of the first embodiment of the image pickup apparatus of the present application.
  • the shutter portion 2 in the second example of the first embodiment is provided with a shielding member 31 instead of being provided with the shielding member 21 which the shutter portion 2 in the case of the first example includes.
  • FIGS. 8A and 8B show top plan views showing schematic structures of the imager 3 and the shielding member 31 of the image pickup device shown in FIG. 7 .
  • the shielding member 31 has slit-like opening portions 31 A through each of which the electromagnetic wave is passed, and portions other than the opening portions 31 A.
  • a size of the opening portion 31 A is set as either being equal to that for one row of the pixel of the imager 3 or being slightly smaller than that for one row of the pixel of the imager 3 . Also, in the shielding member 31 , as shown in FIG. 8B , the opening portions 31 A and the portions other than the opening portions 31 A are alternately disposed in a stripe-like pattern every other row.
  • the A pixels 12 and the B pixels 13 are alternately disposed in the stripe-like pattern every other row so as to correspond to the shielding member 31 .
  • FIGS. 9A and 9B are top plan views showing two states, respectively, when the shielding member 31 is vertically driven.
  • the shielding member 31 is vertically driven so as to be reciprocated, whereby a first state (refer to FIG. 9A ) in which the A pixels 12 each become a state of radiation of the electromagnetic wave through the opening portions 31 A, and a second state (refer to FIG. 9B ) in which the B pixels 13 each become the state of radiation of the electromagnetic wave through the opening portions 31 A are repeated.
  • the movement amount of shielding member 31 in the transition between the first state and the second state corresponds to about the size of one pixel.
  • FIGS. 10A and 10B are top plan views showing schematic structures of an imager and a shutter of an image pickup device as a third example of the first embodiment.
  • FIG. 10A shows a top plan view of an imager 33 which an image pickup device as the third example of the first embodiment includes
  • FIG. 10B shows a top plan view of a shielding member 34 which the shutter portion 2 has.
  • the imager 33 is composed of the image pickup element using the charge collecting element similarly to the case of the imager 3 .
  • the rectangular pixels are disposed so as to be lined up in an oblique direction. This dispersion is a so-called clear-VID disposition.
  • a size of the opening portion 34 A is set either as being equal to the pixel size of the imager 33 or as being slightly smaller than the pixel size of the imager 33 . Also, the opening portions 34 A and the portions other than the opening portions 34 A are alternately disposed in the checker-like pattern.
  • the A pixel 12 and the B pixel 13 are alternately disposed in the checker-like pattern.
  • the shielding member 34 is driven in the oblique direction by a movement amount corresponding to about the size of one pixel.
  • the opening portions in the shielding member can be made to correspond not only to one row of the pixels as with the second example of the first embodiment previously stated, but also to a plurality of rows.
  • FIGS. 11A and 11B show schematic structural views of an image pickup device as a fourth example of the first embodiment in which the same opening portions of the shielding member are continuously disposed over two or more rows.
  • FIG. 11A shows a top plan view of the imager 3
  • FIG. 11B shows a top plan view which the image pickup device as the fourth example of the first embodiment includes.
  • the imager 3 shown in FIG. 11A is identical to the imager 3 in the case of the first example or the second example, in this case, the A pixels 12 and the B pixels 13 are alternately disposed in the stripe-like pattern with predetermined plural rows as a unit. Specifically, in the fourth example, the stripe-like pattern for two rows of the pixels is obtained in the disposition of the A pixels 12 and the B pixels 13 .
  • the opening portions 35 A each of which has a size either equal to that for two rows of the pixels of the imager 3 , or slightly smaller than that for two rows of the pixels of the imager 3 are formed.
  • the opening portions 35 A and the portions other than the opening portions 35 A are alternately disposed with two rows of the pixels as a unit.
  • the shielding member 35 is vertically driven by a movement amount corresponding to the size of about two pixels.
  • the opening portions 35 A of the shielding member 35 can also be formed up to a half of all the pixel rows of the imager 3 . In a word, all it takes is that the opening portions 35 A and the portions other than the opening portions 35 A are alternately disposed at an interval of two or more rows, up to a half of all the pixel rows.
  • the second embodiment is suitable for the case where the opening portions and the portions other than the opening portions are alternately disposed every other row in the shielding member as with each of the first example, the second example, the third example of the first embodiment, hereinafter, a description will be given by exemplifying the case where the shielding member 21 of the first example of the first embodiment is used.
  • the driving for the shielding member 21 is the reciprocating motion for the size of one pixel similarly to the case of the first example of the first embodiment. From this, a waveform of the output voltage from the A pixel 12 , and a waveform of the output voltage from the B pixel 13 which follow the driving for the shielding member 21 become identical to those shown in FIG. 4 , respectively.
  • the captured image signal for one frame is obtained based on the result of sampling the peak value (positive peak value) of the output voltage from the A pixel 12 obtained in the first state, and the peak value (positive peak value) of the output voltage from the B pixel 13 obtained in the second state.
  • the first state in which the A pixel 12 side is held in the radiation state, and the B pixel 13 side is held in the shielding state: the periods, P 2 , P 4 , P 6 , P 8 of time
  • the second state in which the B pixel 13 side is held in the radiation state, and the A pixel 12 side is held in the shielding state: the periods, P 3 , P 5 , P 7 , of time
  • the peak value of the output voltage from the A pixel 12 , and the peak value of the output voltage from the B pixel 13 are detected in both the first state and the second state. Also, a difference between the peak value of the output voltage from the A pixel 12 and the peak value of the output voltage from the B pixel 13 is calculated. Specifically, in the first state, the peak value (positive peak value) of the output voltage from the A pixel 12 , and the peak value (negative peak value) of the output voltage from the B pixel 13 are individually detected, and the difference between these peak values thus detected is calculated. In addition, in the second state, the peak value (negative peak value) of the output voltage from the A pixel 12 , and the peak value (positive peak value) of the output voltage from the B pixel 13 are individually detected, and the difference between these peak values thus detected is calculated.
  • the captured image signal for one frame is obtained based on the differential values calculated in the first state and the second state (that is, the differential output voltage between the A pixel 12 and the B pixel 13 calculated in the first state, and the differential output voltage between the A pixel 12 and the B pixel 13 calculated in the second state).
  • the calculation for the difference is carried out every pixels located in the positions adjacent to each other. That is to say, the difference between the peak values of the output voltages is calculated between the A pixel 12 and the B pixel 13 adjacent to each other.
  • the output voltage (the luminance of the incident light) from the pixel held in the radiation state so as to follow the reciprocating motion of the shielding member 21 corresponds to “the electromagnetic wave from the temperature of the subject—the electromagnetic wave from the temperature of the shielding member 21 .”
  • the output voltage (the luminance in the phase of the shielding) from the pixel side held in the shielding state corresponds to “the electromagnetic wave from the temperature of the shielding member 21 —the electromagnetic wave from the temperature of the subject.”
  • the temperature of the shielding member 21 corresponds to the temperature of the circumference of the imager 3 including the environmental temperature and the self-heating.
  • the temperature of the circumference of the imager 3 is usually corrected.
  • the difference between the peak value of the output voltage from the A pixel 12 and the peak value of the output voltage from the B pixel 13 is calculated in the manner as described above, whereby the signal level can be approximately doubled, and the S/N ratio can be enhanced. In a word, as a result, the S/N ratio can also be improved.
  • the image capturing technique in the second embodiment it is possible to correct the temperature of the circumference of the imager 3 following the environmental temperature change and the self-heating. In addition, it is possible to suppress the influence (the fluctuation of the output voltage) exerted on the captured image by the environmental temperature change. Also, it is possible to enhance the S/N ratio.
  • FIG. 4 there is exemplified the case where the timing at which the positive peak value (maximum value) comes in the pixel held in the radiation state, and the timing at which the negative peak value (minimum value) comes in the pixel held in the shielding state are identical to each other.
  • a time constant of the charge collecting element a time constant (a time constant in the plus direction) on the side of “the radiation state ⁇ the shielding state,” and a time constant (a time constant in the minus direction) on the side of “the shielding state ⁇ the radiation state” are different from each other, the peak in the plus direction, and the peak in the minus direction are shifted from each other in some cases.
  • the setting is made either for the case where the differential output between the peaks at the different times is obtained, or for the case where the differential output at the same time (this case is better either when one of the output voltages is at the peak or at a time between both the peaks) is obtained.
  • FIGS. 12A , 12 B and 12 C are views explaining a relationship, between a minimum spot diameter obtained by the image capturing lens 1 , and a pixel size, for making the subjects identical to each other in the pixels located in the positions adjacent to each other.
  • FIG. 12A is a top plan view showing a relationship between the minimum spot diameter obtained by the image capturing lens 1 , and the sizes of the pixels in the imager 3
  • FIG. 12B is a cross sectional view showing the relationship between the minimum spot diameter obtained by the image capturing lens 1 , and the sizes of the pixels in the imager 3
  • FIG. 12C is a top plan view showing a relationship between the minimum spot diameter obtained by the image capturing lens 1 , and a size of the opening portion 21 A of the shielding member 21 .
  • ⁇ is a wavelength of the electromagnetic wave as the object
  • NA is a numerical aperture of the image capturing lens 1 .
  • the setting of the size of pixels of the imager 3 , and the design of the image capturing optical system are carried out in such a way that the four pixels adjacent to one another (the two A pixels 12 and the two B pixels 13 in this case) fall within such a minimum spot diameter.
  • the resolution obtained by the image capturing lens 1 is such a resolution as to straddle the four pixels adjacent to one another, it is preferable for this situation to carry out the temperature correction based on the differential output described above because the electromagnetic waves having the same luminance are radiated from approximately the same subject to these four pixels.
  • the electromagnetic wave to be captured is the infrared ray
  • the correction is carried out (in the form of the differential output) every two pixels adjacent to each other after the setting for the resolution of the image capturing lens 1 as described above has been carried out.
  • the reason for this is because the difference in states (such as the temperature, the brightness, and the color) of the subjects whose images are captured by the two pixels in the positions adjacent to each other is absent (or is very small), and thus the correction can be more precisely carried out.
  • the image obtained by only the A pixel 12 side, and the image obtained by only the B pixel 13 side are alternately obtained.
  • the pixel, held in the radiation state, from which the output voltage representing the temperature of the subject is obtained can be referred to as “a selection pixel” as well.
  • the pixel held in the shielding state can be referred to as “a pixel for correction” as well for correcting the output voltage from the selection pixel.
  • the technique is adopted such that the frame rate for the output is taken to be F and the frame rate for the image capturing is taken to be n ⁇ F, and under this condition, the images on the A pixel 12 side and the images on the B pixel 13 side which are obtained by n times are either integrated or averaged every pixel, and the result obtained through either the averaging or the integration is outputted as one frame image.
  • the image on the A pixel 12 side in this case becomes an image which is obtained by calculating the difference between the peak values of the output voltages from the A pixel 12 and the B pixel 13 adjacent to each other when the A pixel 12 side is held in the radiation state (selection pixel).
  • the image on the B pixel 13 side becomes an image which is obtained by calculating the difference between the peak values of the output voltages from the B pixel 13 and the A pixel 12 adjacent to each other when the B pixel 13 side is held in the radiation state (selection pixel).
  • either the thermistor or the temperature sensor is provided in the vicinity of the shutter portion 2 , and the temperature adjustment (calibration) for the captured image is carried out based on the result of the temperature detection.
  • FIG. 13 shows a general internal configuration of an image pickup apparatus as the second embodiment for realizing the image capturing technique in the second embodiment described above.
  • the image pickup apparatus of the second embodiment is different from the image pickup apparatus of the first embodiment described above in that a sampling portion 5 ′ is provided instead of providing the sampling portion 5 , and a differential output portion 9 is inserted between the sampling portion 5 ′ and the averaging portion 6 .
  • the sampling portion 5 ′ is configured so as not to detect only the positive peak values of the output voltages from the A pixel 12 and the B pixel 13 as with the case of the first embodiment, but to detect both the positive and negative peak values of the output voltages from the A pixel 12 and the B pixel 13 .
  • the differential output portion 9 calculates a difference between the peak values of the output voltages from the A pixel 12 and the B pixel 13 , which are successively supplied thereto from the sampling portion 5 ′, every set of A pixel 12 and B pixel 13 located in the positions adjacent to each other.
  • a set of “positive peak value of the output voltage from the A pixel 12 and negative peak value of the output voltage from the B pixel 13 ,” and a set of “positive peak value of the output voltage from the B pixel 13 and negative peak value of the output voltage from the A pixel 12 ” are alternately supplied to the differential output portion 9 with a period corresponding to 1 ⁇ 2 of the frame rate for the image capturing.
  • the differential output portion 9 calculates the difference of “the positive peak value of the output voltage from the A pixel 12 —the negative peak value of the output voltage from the B pixel 13 ” every set of A pixel 12 and B pixel 13 located in the positions adjacent to each other, and outputs the calculation result as the image signal on the A pixel 12 side.
  • the differential output portion 9 calculates the difference of “the positive peak value of the output voltage from the B pixel 13 —the negative peak value of the output voltage from the A pixel 12 ” every set of A pixel 12 and B pixel 13 located in the positions adjacent to each other, and outputs the calculation result as the image signal on the B pixel 13 side.
  • the image signal on the A pixel 12 side, and the image signal on the B pixel 13 side are inputted from the differential output portion 9 to the averaging portion 6 in this case by n times every one frame period of time on the output side.
  • the averaging portion 6 averages the values of the image signals on the A pixel 12 side, and the values of the image signals on the B pixel 13 side which are inputted thereto by n times for one frame period of time on the output side in such a manner every pixel. Also, the averaging portion 6 adds the averaged image signals on the A pixel 12 side, and the averaged image signals on the B pixel 13 side to each other, and outputs the resulting signal as the image signal for one frame.
  • control portion 8 since other configurations of the control portion 8 , the temperature sensor 4 and the like have already been described, a repeated description thereof is omitted here for the sake of simplicity.
  • both the image on the A pixel 12 side and the image on the B pixel 13 are desired to be obtained with the period which is 1 ⁇ 2 of the frame rate for the image capturing, it is effective to carry out the interpolation.
  • FIG. 14 is a diagram explaining a technique for interpolating a value from the pixel held in the shielding state.
  • the image on the B pixel 13 side can be obtained even in the first state in which only the A pixel 12 is held in the radiation state.
  • the shielding member 21 having the checker-like pattern of the first example of the first embodiment is supposed in FIG. 14 , the four pixels which are disposed on the left, right, top, and the bottom of the pixel for correction are utilized as the selection pixels.
  • the positional relationship between the pixel 40 held in the shielding state, and the circumferential pixels each held in the radiation state and used for the interpolation is different from that shown in FIG. 14 depending on the opening portion formation pattern of the shielding member.
  • the six pixels in total of the pixel 42 disposed right above the pixel 40 , the two pixels disposed obliquely upward, the pixel 44 disposed right below the pixel 40 , and the two pixels disposed obliquely downward can be utilized as the medium value interpolation.
  • the image blurring is suppressed which is generated in the vicinities of the boundaries between the opening portions and portions other than the opening portions of the shielding member due to a gap defined between the image pickup element and the shielding portion.
  • FIGS. 15A and 15B are views explaining a relationship between the gap Gap defined between the image pickup element and the shielding member, and an image blurring region.
  • FIG. 15A shows a region of the image blurring generated when the gap defined between the imager 3 as the image pickup element and the shielding member 21 or 35 is small. Also, FIG. 15B shows a region of the image blurring generated when the gap defined between the imager 3 and the shielding member 21 or 35 is large.
  • the gap Gap means an interval between the shielding member 21 or 35 and the imager 3 in a direction parallel with an incidence axis of the electromagnetic wave.
  • a region to which the electromagnetic wave ought to be radiated if the shielding portion is essentially absent, or to which the electromagnetic wave ought not to be radiated if the opening portion is essentially absent is formed in each of the regions closest to the boundary portions between the opening portions and the portions other than the opening portions of the shielding member (hereinafter referred to as “edge portions of the opening portions” as well), at a timing at which the shielding member reaches either an upper limit portion thereof or a lower limit portion thereof (at a timing at which the driving direction of the shielding member is reserved), of the region on the imager 3 .
  • Such regions become the image blurring regions.
  • the image blurring region is a region in which the contrast of the quantity of light is low.
  • such a blurring region on the imager 3 becomes small as the gap defined between the shielding member 21 or 35 and the imager 3 becomes smaller. Conversely, such a blurring region on the imager 3 becomes large as the gap defined between the shielding member 21 or 35 and the imager 3 becomes larger.
  • the image blurring is generated over the region for the two pixels located closest to the edge portion of the opening portion (the two pixels in total of the pixel closest to the upper side, and the pixel closest to the lower side) in some cases.
  • the gap is made small as much as possible.
  • the shielding member is a movable portion, the mechanically high precision is required for making the gap small, which could increase the manufacturing cost of the image pickup apparatus.
  • the driving form for the shielding member, and the reading-out timing for the pixels are devised, thereby making it possible to obtain the captured image signal in which the image blurring is suppressed even when the gap is made large.
  • FIGS. 16A and 16B are top plan views showing the imager 3 and a shielding member 51 which an image pickup device in the third embodiment includes, respectively.
  • opening portions 51 A each having a width for three rows of the pixels are formed in two portions, respectively, through a portion which is not the opening portion 51 A which also has a width for three rows of the pixels.
  • the opening portion 51 A which is formed on the upper side is taken to be an opening portion 51 A- 1
  • the opening portion 51 A which is formed on the lower side is taken to be an opening portion 51 A- 2 .
  • FIG. 16A shows the A pixels 12 and the B pixels 13 corresponding to the case where the shielding member 51 simply makes the reciprocating motion for the three pixels.
  • the A pixels 12 and the B pixels 13 in this case can be grasped as being alternately in the stripe-like pattern every three rows.
  • the shielding region on the upper side of the opening portion 51 A- 1 needs to be formed so as to have a width for at least three or more pixels
  • the shielding region on the lower side of the opening portion 51 A- 2 also needs to be formed so as to have a width for at least three or more pixels.
  • each of the shielding region on the upper side of the opening portion 51 A- 1 , and the shielding region on the lower side of the opening portion 51 A- 2 is provided to have a width for the four or more pixels so as to follow the driving for the reciprocating motion.
  • the size of the shielding member can be made dramatically smaller than that of the existing optical chopper 101 , and the driving range is so small as to have a range for up to four pixels. Therefore, in the third embodiment as well, the image pickup apparatus can be miniaturized similarly to the case of each of the first and second embodiments described above.
  • FIG. 17 is a view explaining a technique for driving the shielding member in the third embodiment.
  • the shielding member 51 is set in a state in which an upper end of the upper-side opening portion 51 A- 1 agrees with an upper end of the imager 3 (an upper end of an effective pixel range).
  • the shielding member 51 is downward driven from the state ⁇ 1 > by a movement amount for the three pixels to be set in a state ⁇ 2 > shown in FIG. 17 .
  • a lower end of the lower-side opening portion 51 A- 2 of the shielding member 51 agrees with a lower end of the imager 3 (a lower end of the effective pixel range).
  • a movement amount for the four pixels is set to obtain a state ⁇ 3 > in FIG. 17 .
  • the upper end of the upper-side opening portion 51 A- 1 is located above the upper end of the imager 3 by an amount for the one pixel.
  • a movement amount for the four pixels is also set to obtain a state ⁇ 4 > in FIG. 17 .
  • the lower end of the lower-side opening portion 51 A- 2 is located below the lower end of the imager 3 by an amount for the one pixel.
  • the state is returned back to the state ⁇ 1 > as shown in FIG. 17 . That is to say, the shielding member 51 is upward driven by a movement amount for four pixels.
  • the shielding member 51 is driven in such a way that the state of ⁇ 1 > ⁇ 2 > ⁇ 3 > ⁇ 4 > ⁇ 1 > . . . is repetitively obtained.
  • FIG. 18 is a time chart explaining a reading-out technique for the imager 3 in the third embodiment.
  • FIG. 18 the A pixels 12 and the B pixels 13 which are disposed in the imager 3 are designated by A 1 , A 2 , A 3 , A 4 , A 5 , A 6 , B 1 , B 2 , B 3 , B 4 , B 5 , and B 6 , respectively, in order from the upper side.
  • FIG. 18 schematically shows the output voltages obtained so as to follow that the driving operation shown in FIG. 17 is carried out in the A 1 , A 2 , A 3 , A 4 , A 5 , A 6 pixels, and the B 1 , B 2 , B 3 , B 4 , B 5 , B 6 pixels.
  • an upward convex portion in FIG. 18 means the positive peak value
  • a downward convex portion means the negative peak value.
  • the convex portion patterned (shaded) means a portion in which the image blurring is generated
  • the convex portion marked with a circle means a portion in which the image blurring is suppressed in accordance with the technique in the third embodiment.
  • a transition period of time of ⁇ 1 > ⁇ 2 > is a simple driving period of time for the three pixels, the image blurring is generated in each of the B 1 , B 3 , and B 4 , B 6 pixels of the B pixels 13 becoming the pixels on the side transiting to the radiation state within this period of time.
  • the region in which the image blurring is generated is a region closest to the edge portion of the opening portion 51 A at the timing at which the shielding member 51 reaches either the upper limit position thereof or the lower limit position thereof (at the timing at which the driving direction for the shielding member is reversed). Therefore, the pixels in each of which the image blurring may be generated for the period of time for which the shielding member 51 is downward driven (for the period of time for which the B pixel 13 side transits to the radiation state) as with the period of time for the transition of ⁇ 1 > ⁇ 2 > are the four pixels, i.e., the B 1 , B 3 , B 4 , and B 6 pixels.
  • the pixels in each of which the image blurring is generated for the period of time for which the shielding member 51 is upward driven are the four pixels, i.e., the A 1 , A 3 , A 4 , and A 6 pixels.
  • the output voltage free from the generation of the blurring is obtained in each of the B 2 and B 5 pixels, which are not closest to the edge portion of the opening portion 51 A, of the B pixels 13 . Therefore, with respect to the pixels corresponding to the B 2 and B 5 pixels (i.e., the pixels belonging to the row of B 2 , and the pixels belonging to the row of B 5 ), the peak values (positive peaks) detected within the period of time for the transition of ⁇ 1 > ⁇ 2 > are sampled as the effective value of the luminances.
  • the period of time for the transition of ⁇ 2 > ⁇ 3 > is a period of time for which the shielding member 51 is upward overrun by an amount for one pixel.
  • the image blurring is suppressed in the A 1 and A 4 pixels, which are located on the overrunning side of the opening portion 51 A, of the A 1 , A 3 , A 4 , and A 6 pixels in each of which the image blurring may be generated for this period of time.
  • the peak values of the output voltages from the A 1 and A 4 pixels which are detected for the period of time for the transition of ⁇ 2 > ⁇ 3 > are sampled as the effective values of the luminances of the A 1 and A 4 pixels.
  • the period of time for the transition of ⁇ 3 > ⁇ 4 > is a period of time for which the shielding member 51 is downward overrun by an amount for one pixel.
  • the upper end of the upper-side opening portion 51 A- 1 of the shielding member 51 is located above the upper end of the A 1 pixels by an amount for one pixel, and the upper end of the lower-side opening portion 51 A- 2 is located in the upper end of the B 3 pixels. Therefore, the image blurring is suppressed in the B 1 pixels and the B 4 pixels in each of which the image blurring may be generated for the period of time for the transition of ⁇ 3 > ⁇ 4 >. In addition, since for this period of time, as described above, the shielding member 51 is downward overrun, the image blurring is also suppressed in the B 3 pixels and the B 6 pixels.
  • the peak values of the output voltages from B 1 , B 3 , B 4 , and B 6 pixels are sampled as the effective values of the luminances, respectively.
  • the period of time for the transition of ⁇ 4 > ⁇ 1 > is a period of time for which the shielding member 51 is upward driven by a movement amount for four pixels.
  • the lower end of the upper-side opening portion 51 A- 1 of the shielding member 51 is located in the lower end of the B 1 pixels, and the lower end of the lower-side opening portion 51 A- 2 is located below the lower end of the B 3 pixels by an amount for one pixel. Therefore, the image blurring is suppressed in the A 3 pixels and the A 6 pixels in each of which the image blurring may be generated for the period of time for the transition of ⁇ 4 > ⁇ 1 >.
  • the peak values of the output voltages detected in the A 3 pixels and the A 6 pixels are sampled as the effective values of the luminances, respectively.
  • the sampling of the peak values for each period of time as described above is carried out, whereby for one period in which the state is returned from the state ⁇ 1 > back to the state ⁇ 1 > again, the image for all the pixels in the imager 3 can be obtained while the image blurring is suppressed in the A 1 , A 3 , A 4 , A 6 , B 1 , B 3 , B 4 , and B 6 pixels in each of which the image blurring is generated when the single reciprocating driving is carried out.
  • the opening portions 51 A each having the width for at least three or more pixels are formed in the shielding member 51 . Also, it is only necessary to reciprocate the shielding member 51 so as to obtain:
  • the effective values for each of which the blurring is suppressed can be obtained as the values of the luminances of the pixels in each of which the image blurring may be generated for each of the periods of time as shown in FIG. 18 .
  • the values of the output voltages from the pixels at the timings at each of which the image blurring is reduced are sampled, thereby making it possible to obtain the captured image signal for which the image blurring is suppressed.
  • the region in which the image blurring is generated depends on the size of the gap defined between the imager 3 and the shielding member 51 . Therefore, an amount by which the shielding member 51 is overrun in terms of the third driving state and the fourth driving state has to be suitably set depending on the size of the gap.
  • the frame rate (chopper frequency) for the image capturing is set as being at least more than twice the frame rate for the output (in this case, precisely meaning that the period obtained by halving the period of ⁇ 1 > ⁇ 1 > is set as being more than twice), thereby making it possible to obtain the image for all the effective pixels of the imager 3 within the period of time for one frame on the output side.
  • the frame rate for the image capturing is set as being more than four times the frame rate for the output.
  • the values each equal to or larger than 2 are obtained as the luminances of the pixels for the period of time for one frame of the output side, and these values are either averaged or integrated, thereby making it possible to increase the sensitivity and to enhance the S/N ratio.
  • FIG. 19 is a block diagram showing a general internal configuration of the image pickup apparatus as the third embodiment for realizing the image capturing technique as the third embodiment described above.
  • the frame rate for the image capturing is set as four times of the frame rate for the output.
  • the image pickup apparatus of the third embodiment is different from the image pickup apparatus of the first embodiment in that a sampling portion 52 is provided instead of providing the sampling portion 5 , and a control portion 53 is provided instead of providing the control portion 8 .
  • the shutter portion 2 in this case is provided with the shielding member 51 .
  • the control portion 53 supplies the drive signal to the shutter portion 2 so as to obtain the first driving state, the second driving state, the third driving state, and the fourth driving state as the driving states of the shielding member 51 .
  • the control portion 53 supplies the drive signal to the shutter portion 2 so as to repetitively obtain the driving states based on the states of ⁇ 1 > ⁇ 2 > ⁇ 3 > ⁇ 4 > ⁇ 1 > previously stated with reference to FIG. 17 .
  • control portion 53 instructs the sampling portion 52 to set the sampling timings for the pixels. Specifically, the control portion 53 instructs the sampling portion 52 to set the sampling timing for each row.
  • the data on the sampling timings can be preset in the control portion 53 depending on the technique for driving the shielding member 51 .
  • control portion 53 carries out the control for causing the signal processing portion 7 to execute temperature adjustment processing for the image corresponding to the temperature value obtained from the temperature sensor 4 similarly to the case of the control portion 8 previously stated.
  • the sampling portion 52 detects the peak values (the positive peak values in this case) of the pixels similarly to the case of the sampling portion 5 .
  • the sampling portion 52 is different from the sampling portion 5 in that the sampling portion 52 is configured in such a way that of the peak values detected, the peak values of the output voltages from the pixels in each of the rows are outputted at the timing which is instructed every row from the control portion 53 .
  • FIGS. 20A and 20B are top plan views of the imager 3 and a shielding member 61 which an image pickup apparatus of the fourth embodiment includes, respectively.
  • each adjacent two of three opening portions 61 A each having a width for one row of the pixels are formed so as to face each other across a portion which is not the opening portion 61 A and which has a width for four rows of the pixels.
  • the three opening portions 61 A are formed in the shielding member 61 in such a manner.
  • the opening portion 61 A formed on the uppermost side is taken to be a first opening portion 61 A- 1
  • the opening portion 61 A formed on the lower side of the first opening portion 61 A- 1 is taken to be a second opening portion 61 A- 2
  • the opening portion 61 A formed on the lowermost side is taken to be a third opening portion 61 A- 3 .
  • FIG. 20B shows a state in which the first opening portion 61 A- 1 is located on the pixels (a pixels) which are formed in the uppermost portion of the imager 3 .
  • a relationship between positions (each indicated by [ ]) where the opening portions 61 A are formed, respectively, and the rows from a to m of the imager 3 in this case is expressed as follows: [a]bcde[f]ghij[k]lm
  • the opening portions 61 A in this case can also be expressed in such a way that the opening portions 61 A are formed every five rows.
  • the output differences are generated between the pixels in which the opening portions are located when the driving direction of the shielding member is reversed, and the pixels other than these pixels due to that a time length required during passing of the shielding member is different between the pixels in which the opening portions are located when the driving direction of the shielding member is reversed, and the pixels other than these pixels.
  • FIGS. 21A and 21B are views explaining this respect.
  • a graph shown in FIG. 21A represents a locus of the drive position of the opening portion 61 A when the shielding member 61 is reciprocated in accordance with a drive signal having a sine wave.
  • FIG. 21B represents transition of the luminaces of the pixels of the rows from a to m in sections 1 to 18 when one period (chopper frequency) of the drive signal for the shielding member 61 is divided into the 18 sections.
  • the luminance in this case is expressed in four steps. That is to say, black represents the lowest luminance, deep gray represents the low luminance, light gray represents a middle luminance, and white represents the high luminance.
  • FIGS. 21A and 21B show an example when the shielding member 61 is reciprocated for six pixels.
  • the reason that the shielding member 61 is not reciprocated for five pixels is based on consideration of the possibility that when the drive distance of the shielding member 61 is long, it is difficult to precisely control the reverse position of the shielding member 61 .
  • a time required for the opening portion 61 A to move for one row becomes relatively long in the vicinity of each of the upper and lower reverse positions. Specifically, in this case, a time length for which the opening portion 61 A sets the pixels in each of the upper and lower reverse positions in the radiation state reaches a time length for four sections (a time length for two sections in outward+a time length for two sections in return). On the other hand, with regard to the portion which is not located in the vicinity of each of the reverse positions, a time length required for a movement for one row is short, and becomes a time length for about one section.
  • FIG. 21B exemplifies the case where the driving for six pixels is carried out, the difference is generated in the number of times of the accumulation of the peak values as described above.
  • the number of times of the detection of the peak values within one period in the f pixels is identical to that in the i pixels.
  • such an output difference which may be generated every row can be calibrated to some degree by carrying out the temperature correction in a phase of the shipping.
  • the temperature correction stated herein means that the electromagnetic wave is radiated with the uniform luminance to carry out the image capturing, and the gain adjustment (the giving of the correction coefficient) is carried out for the pixels so that the output voltages from the pixels obtained in this case becomes uniform.
  • the measures are taken to cope with this situation by devising the technique for driving the shielding member 61 .
  • FIG. 22 is a diagram explaining the technique for driving the shielding member 61 in the fourth embodiment.
  • FIG. 22 shows only a locus of a movement of the second opening portion 61 A- 2 of the three opening portions 61 A- 1 , 61 A- 2 and 61 A- 3 which are formed in the shielding member 61 .
  • the shielding member 61 is driven in such a way that the locus in the range (the range surrounded by a thick frame in FIG. 22 ) within which the second opening portion 61 A- 2 is reciprocated makes one reciprocating motion in the vertical direction with a certain period.
  • the shielding member 61 is driven in such a way that the upper and lower reverse positions of the shielding member 61 are gradually shifted with the period corresponding to one reciprocating motion of the shielding member 61 , and the upper and lower reverse positions of the shielding member 61 are returned back to the original positions, respectively, when the predetermined number of times of the reciprocating motions is reached.
  • the shift of the reverse position is carried out in such a way that after the shift to the upper side is carried out, the shift is switched over to the shift to the lower side, whereby the locus of the reciprocating range of the opening portion 61 A is protruded to the upper side as shown in FIG. 22 .
  • an amount of shift of the reverse position in the period of one reciprocating motion of the shielding member 61 is set one pixel by one pixel as shown in FIG. 22 .
  • an amount of initial drive for the shielding member 61 (an amount of initial outward drive: referred to as “an amount of reference drive” as well) is set as an amount of drive for six pixels.
  • a maximum shift amount of the reverse position is set as an amount for four pixels.
  • FIG. 23 schematically shows changes of the luminances of the pixels following a lapse of time in the case where the shielding member 61 is driven by using the driving technique in the fourth embodiment.
  • Numerical values of 1 to 8 shown in the uppermost portion in FIG. 23 represent the number of times of the reciprocating motion of the shielding member 61 .
  • black represents the lowest luminance
  • deep gray represents the low luminance
  • light gray represents the middle luminance
  • white represents the high luminance
  • the luminance distribution approximately, uniformly spreads over all the pixels with the one unit period.
  • the fourth embodiment there is adopted a technique that after the luminance distribution is made to approximately, uniformly spread over all the pixels with one unit period in such a manner by using the driving technique described above, the peak values (positive peak values) detected from each of the pixels are integrated and outputted.
  • the output difference for each row generated when the reciprocating motions for six pixels (or the reciprocating motions for five pixels) are simply carried out is suppressed by adopting that technique.
  • the luminance especially, uniformly spread over the range of the d pixels to the j pixels.
  • the luminance i.e., the high luminance (white), the middle luminance (light gray), and the low luminance (deep gray)
  • the uniformity of the luminance distribution is further reduced in the pixels from the a pixels to the c pixels formed on the upper side, and the pixels from the k pixels to the m pixels formed on the lower side than in the pixels from the d pixels to the j pixels formed in the intermediate position.
  • the reason for this is because for the pixels from the a pixels to the c pixels, there is no opening portion 61 A provided on the upper side with respect to the first opening portion 61 A- 1 , and for the pixels from the k pixels to the m pixels, there is no opening portion 61 A provided on the lower side with respect to the third opening portion 61 A- 3 .
  • the imager 3 is actually configured so as to have a large number of pixels in order to attain the image resolution based on the VGA (640 ⁇ 480) or the like. That is to say, in this case, when the structure is adopted such that the opening portion 61 A is provided every five rows as with the shielding member 61 , almost the pixels becomes the pixels in the intermediate position like the pixels from the d pixels to the j pixels.
  • the output difference for each pixel can be further improved.
  • the output differences can also be improved similarly to the case of the pixels from the d pixels to the j pixels.
  • the shielding member 61 is driven so as to make one reciprocating motion in the vertical direction with the reciprocating range of the opening portion 61 A as one unit period, and the peak values of the output voltages detected from each of the pixels are integrated every one unit period, whereby the output differences in the pixels can be dramatically suppressed as compared with the case where the reciprocating motions for the predetermined pixels are simply carried out.
  • the frequency corresponding to one unit period has to be made to agree with the frequency of the frame rate for the output at the least.
  • the frame rate for the output 30 Hz
  • one reciprocating period of the shielding member 61 becomes about 240 Hz (240 Hz in average).
  • this one reciprocating period of the shielding member 61 corresponds to the range in which the output of the charge collection is increased, and thus is advantageous in terms of the S/N ratio.
  • the shielding member 61 when the state of “[a]bcde[f]ghij[k]lm” shown in FIG. 20B is treated as the reference position of the shielding member 61 , the shielding member 61 is downward driven by a movement amount for up to six pixels, and is upward driven by a movement amount for up to four pixels. For this reason, a shielding region on the upper side of the first opening portion 61 A- 1 in the shielding member 61 has to be provided by a width for at least the six pixels, and a shielding region on the lower side of the third opening portion 61 A- 3 in the shielding member 61 has to be provided by a width for at least the four pixels.
  • the size of the shielding member can be dramatically reduced as compared with the case of the existing optical chopper 101 , and the driving range is also so small as to correspond to the width for up to the six pixels. Therefore, in terms of the fourth embodiment as well, the fact remains that the image pickup apparatus can be miniaturized similarly to the case of the first embodiment previously stated.
  • FIG. 24 shows a general internal configuration of the image pickup apparatus as the fourth embodiment for realizing the image capturing technique as the fourth embodiment described above.
  • the image pickup apparatus of the fourth embodiment is different from the image pickup apparatus of the first embodiment in that an integrator 62 is provided instead of providing the averaging portion 6 , and a control portion 63 is provided instead of providing the control portion 8 .
  • the shutter portion 2 in this case is provided with the shielding member 61 .
  • the control portion 63 supplies the drive signal to the shutter portion 2 in such a way that the shielding member 61 is driven by using the technique described with reference to FIG. 17 .
  • the control portion 63 supplies the drive signal to the shutter portion 2 in such a way that the initial movement amount (the initial outward drive amount: referred to as “the reference drive amount” as well) of the shielding member 61 is treated as the downward drive amount for the six pixels, and after the upward shift is carried out one pixel by one pixel, the downward shift is carried out one pixel by one pixel with the maximum shift amount of reverse position of the shielding member 61 being set as an amount for the four pixels.
  • control portion 63 carries out the control for causing the signal processing portion 7 to execute the temperature adjustment processing for the image corresponding to the temperature value from the temperature sensor 4 similarly to the case of the control portion 8 .
  • the integrator 62 receives as its inputs the luminance peak values from the pixels which are detected in the sampling portion 5 so as to follow the drive for the shielding member 61 as described above, and integrates these luminance peak values every pixel.
  • the integrator 62 carries out the output and the zero-resetting for the integrated values for the pixels at timing for each one unit period instructed from the control portion 63 .
  • an averaging portion has to be configured in such a way that the peak values supplied thereto from the sampling portion 5 every pixel within the one unit period are averaged and outputted so as to correspond to the number of times of the supply of the peak values.
  • the shielding member which the shutter portion 2 includes is caused to make the vertically reciprocating motion
  • the shielding member can also be caused to make the horizontally reciprocating motion.
  • the shielding member is caused to make the horizontally reciprocating motion
  • the stripe-like openings are provided as with the second example or the fourth example of the first embodiment, the stripe-like openings are not arranged in the row direction, but are arranged in the column direction.
  • the reciprocating range of the shielding member is shifted as with each of the third and fourth embodiments, it also goes without saying that the vertical direction of the shift described above is replaced with the horizontal direction for the shift.
  • the shielding member 34 is not driven in the oblique direction from top left to right bottom or from right bottom to top left, but can be driven in the oblique direction from top right to bottom left or from bottom left to top right.
  • the shielding member is driven by the VCM
  • the present application is by no means limited thereto. That is to say, the shielding member can also be driven by an ultrasonic wave motor, a DC motor, an AC motor, a stepping motor, a linear motor, a molecular motor, an electrostatic motor, a piezoelectric element actuator, or a polymer actuator.
  • FIG. 25 shows a construction of the shutter portion using the piezoelectric element actuator. Note that, in FIG. 25 , the construction of the shutter portion using the piezoelectric element actuator is shown in the form of a cross sectional view.
  • the shielding member 21 , 31 , 34 , 35 , 51 , 61 is supported by a plate-like flexible member 72 and a plate-like flexible member 73 each having a function as an electrode.
  • a plate-like flexible member 72 and a plate-like flexible member 73 each having a function as an electrode.
  • one end portions of the plate-like flexible members 72 and 73 are fixedly adhered to one side surface and the other side surface of the shielding member, respectively, thereby supporting the shielding member.
  • the other end portions of the flexible members 72 and 73 are fixedly adhered to a substrate 71 , respectively, as shown in FIG. 25 .
  • Piezoelectric elements 74 and 74 are fixedly adhered to the flexible member 72 so as to sandwich the flexible member 72 between them.
  • piezoelectric elements 75 and 75 are fixedly adhered to the flexible member 73 so as to sandwich the flexible member 73 between them.
  • an electrode 76 is provided on a surface of one piezoelectric elements 74 (a surface of one piezoelectric elements 74 opposite to a surface of one piezoelectric elements 74 fixedly adhered to the flexible member 72 ).
  • an electrode 77 is provided on a surface of the other piezoelectric element 74 .
  • an electrode 78 is provided on a surface of one piezoelectric element 75 (a surface of one piezoelectric element 75 opposite to a surface of the one piezoelectric element 75 fixedly adhered to the flexible member 73 ). Also, an electrode 79 is provided on a surface of the other piezoelectric element 75 .
  • a PZT in a polarization state, or the like is used as each of the piezoelectric elements 74 and 75 .
  • the polarization state (+/ ⁇ ) of each of the piezoelectric elements 74 and 75 is set in such a way that a plus direction and a minus direction become common among the piezoelectric elements 74 and 75 as shown in FIG. 25 .
  • each of the electrodes 76 , 77 , 78 , and 79 on the surface side is connected to a plus side of a driving voltage source, and each of the flexible members 72 and 73 each having the electrode function is connected to a minus side of the driving voltage source.
  • the piezoelectric elements 74 and 75 are driven.
  • a drive signal such as a drive signal having a sine wave, whose plus voltage and minus voltage are repetitively applied with a predetermined period is supplied to the shutter portion constructed in the manner as described above.
  • the shape of the piezoelectric elements 74 and 75 are changed as the level of the drive signal gradually increases to the plus side.
  • the flexible members 72 and 73 are gradually bent in the left-hand side direction in the paper, and thus the shielding member is also gradually displaced in the left-hand side direction in the paper.
  • the flexible member 72 and 73 are gradually bent in the right-hand side direction in the paper as the level of the drive signal is gradually reduced.
  • the shielding member is also gradually displaced in the right-hand side direction in the paper. It is noted that in FIGS. 26A and 26B , for the sake of convenience of the illustration, only the shielding member, the flexible members 72 and 73 , and the substrate 71 are extracted and shown.
  • the shielding member can be reciprocated. Also, an amount of displacement of the shielding member can be adjusted with the level of the drive signal.
  • the portion with which the radiation/shielding of the electromagnetic wave for the imager 3 is carried out by mechanically moving the shielding member having the opening portions provided therein is exemplified as the shutter portion 2 .
  • an element opening position variable element
  • a liquid crystal shutter in which positions of openings through which the electromagnetic wave is radiated to a part of pixels can be arbitrarily set.
  • the positions of the openings can be set by a Digital Signal Processor (DSP), a microcomputer or the like using a program.
  • DSP Digital Signal Processor
  • cover glasses each made of a material which transmits the infrared ray are used as the cover glasses for holding liquid crystal layer between them instead of using normal cover glasses for the liquid crystal which does not transmit the infrared ray.
  • each of the cover glasses is made of a material such as a Si glass, a Ge glass or a BaF2 glass.
  • electrode films need to be formed on both the surfaces of the glasses, respectively.
  • a Cr film, a Ti film or the like having a high transmittance in the infrared region can be used as each of the electrode films in the case of the infrared ray instead of using an Indium Tin Oxide (ITO) film in the case of the visible light.
  • ITO Indium Tin Oxide
  • the pixels for correction can be set for a plurality of “selection pixels” so as to have the number of pixels which is at least one or more smaller than the number of “selection pixels.”
  • the number of selection pixels can be increased as compared with the case where the number of pixels for correction is equal to the number of selection pixels. Therefore, it is possible to enhance the resolution, and it is also possible to obtain the image closer to the real state of the subject.
  • a waveform shape of the drive signal in accordance with which the shielding member is reciprocated, or the drive signal in accordance with which the shutter portion such as the liquid crystal shutter should not be limited to a sine wave shape, and thus may also be a trapezoidal shape, or any other suitable shape.
  • a configuration is made in such a way that the shielding member is driven to be reversed both in a position where a differential value obtained by differentiating either the luminance average output or the luminance total output from the A pixel 12 becomes zero, and in a position where a differential value obtained by differentiating either the luminance average output or the luminance total output from the B pixel 13 becomes zero.
  • a configuration can also be made in such a way that the shielding member is driven to be reversed in a position where a differential value obtained by differentiating the differential output between the luminance average output or the luminance total output from the A pixel 12 , and the luminance average output or the luminance total output from the B pixel 13 becomes zero.
  • the shielding member carries out the chopper operation so as to be reversed in the predetermined position.
  • the sensor for servo for detecting the position of the shielding member is not added, it is possible to inexpensively carry out the reverse position control for the shielding member.
  • the luminance average output or the luminance total output from the A pixel 12 , and the luminance average output or the luminance total output from the B pixel 13 may be obtained for all the A pixels 12 and all the B pixels 13 , respectively, or for a part of the A pixels 12 and a part of the B pixels 13 , respectively.
  • the A pixel 12 and the B pixel 13 are not necessarily located in the positions adjacent to each other (because there is the A pixel 12 surrounded by the same A pixels 12 ). Therefore, the actual output voltage from the A pixel 12 and the B pixel 13 closest to each other are compared with each other.
  • the image pickup element using the charge collecting element is exemplified as the imager 3 or 33 .
  • the image pickup element which the image pickup apparatus of the present application includes can be composed of the charge collecting element, a ferroelectric element, a micro-bolometer, a meta-material, an antenna element, a Charge Coupled Device (CCD), a Complementary Metal Oxide Semiconductor (CMOS) or the like.
  • the image pickup apparatus of the present application can be applied to a camera or various apparatuses each utilizing a camera.
  • a millimeter-wave image pickup camera using a region on a short wavelength side having a wavelength shorter than 10 mm of the millimeter wave, a teraheltz-wave image pickup camera, a thermography camera, a gas detection camera, a visible light camera, an X-ray camera or the like is especially given as the camera.
  • a user interface input apparatus a night travelling vision auxiliary apparatus (night vision), a security gizmo, a health care apparatus, a temperature difference cipher transmitting apparatus, and the like are given as various apparatuses each using the camera.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
  • Solid State Image Pick-Up Elements (AREA)
US13/005,039 2010-01-27 2011-01-12 Image pickup apparatus Expired - Fee Related US8803976B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JPP2010-016001 2010-01-27
JP2010016001 2010-01-27
JP2010259709A JP5699561B2 (ja) 2010-01-27 2010-11-22 撮像装置
JPP2010-259709 2010-11-22

Publications (2)

Publication Number Publication Date
US20110181731A1 US20110181731A1 (en) 2011-07-28
US8803976B2 true US8803976B2 (en) 2014-08-12

Family

ID=44308687

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/005,039 Expired - Fee Related US8803976B2 (en) 2010-01-27 2011-01-12 Image pickup apparatus

Country Status (3)

Country Link
US (1) US8803976B2 (ja)
JP (1) JP5699561B2 (ja)
CN (1) CN102192791B (ja)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10491842B2 (en) * 2014-08-29 2019-11-26 Panasonic Intellectual Property Management Co., Ltd. Imaging device, a solid-state imaging device for use in the imaging device
US11336850B2 (en) 2018-10-04 2022-05-17 Sony Interactive Entertainment Inc. Electronic device, actuator control method, and program
US11659286B2 (en) 2018-10-04 2023-05-23 Sony Interactive Entertainment Inc. Sensor module, electronic device, vision sensor calibration method, subject detection method, and program

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10079982B2 (en) 2011-06-10 2018-09-18 Flir Systems, Inc. Determination of an absolute radiometric value using blocked infrared sensors
EP2764685A1 (en) * 2011-10-07 2014-08-13 Flir Systems, Inc. Determination of an absolute radiometric value using blocked infrared sensors
CN102661801B (zh) * 2012-06-06 2013-12-25 华中科技大学 一种超分辨率红外热像仪及用其获取高分辨率红外图像的方法
CN102901569B (zh) * 2012-09-25 2014-11-05 中国兵器工业第二○五研究所 红外辐射计
WO2016152222A1 (ja) * 2015-03-25 2016-09-29 Ｓｅｍｉｔｅｃ株式会社 赤外線温度センサ及び赤外線温度センサを用いた装置
JP6324343B2 (ja) * 2015-04-08 2018-05-16 キヤノン株式会社 撮像装置及びカメラ
JP2018068631A (ja) * 2016-10-28 2018-05-10 キヤノン株式会社 放射線撮影システム、放射線表示方法
FR3069333B1 (fr) * 2017-07-24 2021-05-14 Terahertz Waves Tech Systeme de capture de valeurs ponctuelles pour constituer une image avec des rayonnements terahertz
FR3083901B1 (fr) * 2018-07-10 2021-10-08 Schneider Electric Ind Sas Methode de traitement d'une image
JP2018174592A (ja) * 2018-08-15 2018-11-08 株式会社ニコン 電子機器
JP7190478B2 (ja) * 2020-09-04 2022-12-15 インフィニテグラ株式会社 赤外線撮像方法および装置
WO2024062615A1 (ja) * 2022-09-22 2024-03-28 株式会社センチュリーアークス イベントベースビジョンカメラのイベント信号取得方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5712685A (en) * 1994-11-14 1998-01-27 Minister Of National Defence Of Her Majesty's Canadian Government Device to enhance imaging resolution
US6525303B1 (en) * 1999-09-23 2003-02-25 Mitutoyo Corporation Control systems and methods for synchronizing diffuse illumination with a camera
JP2004317152A (ja) 2003-04-11 2004-11-11 Mitsubishi Electric Corp 熱型赤外線検出器及び赤外線フォーカルプレーンアレイ
US20090021612A1 (en) * 2007-07-20 2009-01-22 Hamilton Jr John F Multiple component readout of image sensor

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61173586A (ja) * 1985-01-29 1986-08-05 Matsushita Electric Ind Co Ltd 画像入力装置
JPH09257566A (ja) * 1996-03-21 1997-10-03 Nikon Corp 赤外線検出装置および赤外線検出方法
CN1178374A (zh) * 1996-06-28 1998-04-08 松下电器产业株式会社 高分辨率图象拾取方法及其装置
GB0709026D0 (en) * 2007-05-10 2007-06-20 Isis Innovation High speed imaging with slow scan cameras using pixel level dynami shuttering
JP2009100048A (ja) * 2007-10-12 2009-05-07 Sanyo Electric Co Ltd 撮像装置および撮像機器
JP4950137B2 (ja) * 2008-06-23 2012-06-13 株式会社日本自動車部品総合研究所 撮像装置及びプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5712685A (en) * 1994-11-14 1998-01-27 Minister Of National Defence Of Her Majesty's Canadian Government Device to enhance imaging resolution
US6525303B1 (en) * 1999-09-23 2003-02-25 Mitutoyo Corporation Control systems and methods for synchronizing diffuse illumination with a camera
JP2004317152A (ja) 2003-04-11 2004-11-11 Mitsubishi Electric Corp 熱型赤外線検出器及び赤外線フォーカルプレーンアレイ
US7005644B2 (en) 2003-04-11 2006-02-28 Mitsubishi Denki Kabushiki Kaisha Thermal infrared detector and infrared focal plane array
US20090021612A1 (en) * 2007-07-20 2009-01-22 Hamilton Jr John F Multiple component readout of image sensor

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Maini, Raman; Aggarwal, Himanshu; Study and Comparison of Various Image Edge Detectin Techinques; Feb. 28, 2009; International journal of Image Processing; vol. 3, Issue 1. *
State Intellectual Property Office of P.R.C, Notification of the First Office Action issued in connection with P.R.C. Application No. 201110023340.2, dated Feb. 12, 2014. (16 pages).

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10491842B2 (en) * 2014-08-29 2019-11-26 Panasonic Intellectual Property Management Co., Ltd. Imaging device, a solid-state imaging device for use in the imaging device
US11336850B2 (en) 2018-10-04 2022-05-17 Sony Interactive Entertainment Inc. Electronic device, actuator control method, and program
US11659286B2 (en) 2018-10-04 2023-05-23 Sony Interactive Entertainment Inc. Sensor module, electronic device, vision sensor calibration method, subject detection method, and program

Also Published As

Publication number Publication date
CN102192791B (zh) 2015-02-11
JP5699561B2 (ja) 2015-04-15
JP2011176793A (ja) 2011-09-08
US20110181731A1 (en) 2011-07-28
CN102192791A (zh) 2011-09-21

Similar Documents

Publication Publication Date Title
US8803976B2 (en) Image pickup apparatus
EP3162049B1 (en) Method and apparatus for camera actuator driver mode control synchronized with imaging sensor frame
US11282882B2 (en) Focus detecting device and electronic device
CN105594198B (zh) 摄像元件以及摄像装置
US8203644B2 (en) Imaging system with improved image quality and associated methods
US8823843B2 (en) Image processing device, image capturing device, image processing method, and program for compensating for a defective pixel in an imaging device
US20110025905A1 (en) Imaging device and optical axis control method
US20110109776A1 (en) Imaging device and imaging apparatus
CN104185808A (zh) 包括自适应光学元件的透镜堆叠阵列
US8525914B2 (en) Imaging system with multi-state zoom and associated methods
US20100002119A1 (en) Method and apparatus to extend the effective dynamic range of an image sensing device
CN104618639A (zh) 调焦控制设备及其控制方法
JP7156352B2 (ja) 撮像装置、撮像方法、及びプログラム
US20130240710A1 (en) Imaging apparatus and image sensor thereof
WO2012061571A1 (en) Camera systems and methods for gigapixel computational imaging
US20200092489A1 (en) Optical apparatus, control method, and non-transitory computer-readable storage medium
US9140895B2 (en) Imaging apparatus and imaging method for obtaining images fro electromagnetic waves
JP2022545748A (ja) Ｔｏｆカメラ
US7978252B2 (en) Imaging apparatus, imaging system, and imaging method
JP2021005838A (ja) 撮像装置、及び撮像装置の制御方法
TW201104299A (en) Computational photography digital camera
JP2012023562A (ja) 位相差検出用情報取得装置、位相差検出装置、撮像装置
JP2010044192A (ja) 撮像装置
JP2017092717A (ja) 撮像素子および撮像装置
JP2014207520A (ja) 撮像装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KABASAWA, HIDETOSHI;WAKABAYASHI, MINORU;ISOBE, HIROSHI;REEL/FRAME:025791/0742

Effective date: 20101220

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20220812