US20130194457A1 - Imaging apparatus and imaging method - Google Patents
Imaging apparatus and imaging method Download PDFInfo
- Publication number
- US20130194457A1 US20130194457A1 US13/801,880 US201313801880A US2013194457A1 US 20130194457 A1 US20130194457 A1 US 20130194457A1 US 201313801880 A US201313801880 A US 201313801880A US 2013194457 A1 US2013194457 A1 US 2013194457A1
- Authority
- US
- United States
- Prior art keywords
- imaging
- exposure
- time
- terminated
- line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2625—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
- G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
- G03B7/091—Digital circuits
- G03B7/093—Digital circuits for control of exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/689—Motion occurring during a rolling shutter mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
- H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
- H04N25/533—Control of the integration time by using differing integration times for different sensor regions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
- H04N25/589—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
Definitions
- the present invention relates to an imaging apparatus and an imaging method.
- an astrophotography, etc. When an astrophotography, etc. are taken, for example, a method is employed in which an image is captured in a long time exposure while a digital camera is fixed to a tripod.
- a display section is installed in the digital camera.
- Patent Literature 1 discloses an imaging apparatus which captures a plurality of sheets of images in a shorter exposure time than the exposure time to obtain a desirable exposure, and obtains an image of the desirable exposure by synthesizing the plurality of sheets of images.
- the imaging apparatus it is possible to obtain an image of the desirable exposure without image vibration.
- the user can confirm for the first time a synthetic image or one image among the plurality of sheets of image after the imaging of the plurality of sheets of image is terminated, it is not possible to confirm the image in middle of imaging.
- the imaging method of Patent Literature 1 a selection is performed according to an image vibration degree as to whether a continuous imaging using a mechanical shutter or a continuous imaging using an electronic shutter. For this reason, in the imaging method of Patent Literature 1, in a case of the continuous imaging using a mechanical shutter, a lot of unexposed periods exist between a plurality of imaging, so the user feels a sense of discontinuity in a synthetic image. Further, in the imaging method of Patent Literature 1, in a case of the continuous imaging using the electronic shutter, a distortion occurs with respect to a moving object. Furthermore, in an imaging method of Patent Literature 1, a process to detect an image vibration is necessary, so the process becomes complicated.
- Patent Literature 2 discloses an imaging apparatus which can capture a high quality still image during capturing a moving image. However, in Patent Literature 2, it is not possible to confirm an image during imaging in a long time exposure. Further, in Patent Literature 2, a long time exposure imaging is not considered.
- a first object of the present invention is to provide an imaging apparatus and an imaging method which can simply perform a high quality long time exposure. Further, a second object of the present invention is to provide an imaging apparatus and an imaging method which can confirm in real time an image that is being captured during a long time exposure imaging.
- An imaging apparatus of the present invention comprises: an imaging element; a display section; an imaging control section which causes the imaging element to perform a plurality of times of imaging; and a display control section which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- An imaging method of the present invention comprises: an imaging control step which causes an imaging element to perform a plurality of times of imaging; and a display control step which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- a first time of imaging among a plurality of times of imaging is terminated, it is possible to display the image obtained with the imaging on the display section, and if second and subsequent imaging are terminated, it is possible to display the synthetic image of the image obtained with the imaging and the image obtained with all imaging prior to the imaging on the display section.
- An imaging apparatus of the present invention comprises: a MOS type imaging element including a plurality of lines of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; a recording section which records the synthetic image data in a recording media; and a mechanical shutter provided in a light incident side of the imaging element, in which in a case of a first time of imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset
- An imaging method of the present invention comprises: an imaging control step which causes a MOS type imaging element including a plurality of lines of a photoelectric conversion element to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media; in which in the imaging control step, in a case of a first time of imaging among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a
- exposure starts become equal in all lines in the first imaging, and exposure terminations become equal in all lines in the last imaging.
- the exposure start and the exposure termination in synthetic image data are coincident in all pixels, thereby preventing an image distortion from occurring even in a moving object. Further, it is possible to achieve this effect without a processing to detect an image vibration. Accordingly, it is possible to realize high quality of long time exposure imaging by a simple configuration.
- An imaging apparatus of the present invention comprises: an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals that is output from the imaging element with the plurality of times of imaging; and a recording section which records the synthetic image data in a recording media, in which the imaging control section causes the first group to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, causes the second group to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and causes the imaging element to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- An imaging method of the present invention comprises: an imaging control step which causes an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media, in which in the imaging control step, the first group is caused to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, the second group is caused to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and the imaging element is caused to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- an imaging apparatus and an imaging method in which the user can confirm in real time an image that is being captured during long time exposure imaging. Further, according to the present invention, it is possible to provide an imaging apparatus and an imaging method in which high quality of long time exposure imaging can be simply performed.
- FIG. 1 is a functional block diagram of an imaging apparatus 100 explaining an embodiment of the present invention.
- FIG. 2 is a schematic plan view illustrating a schematic configuration of an imaging element 5 in the imaging apparatus 100 shown in FIG. 1 .
- FIG. 3 is a view illustrating a timing chart in a case of a long time exposure imaging operation of the imaging apparatus 100 shown in FIG. 1 .
- FIG. 4 is a view illustrating a modification example of a plurality of times of imaging method in a case of the long time exposure imaging operation of the imaging apparatus 100 shown in FIG. 1 .
- FIG. 5 is a timing chart illustrating a modification example of an operation in a case of the long time exposure imaging of the imaging apparatus 100 shown in FIG. 1 .
- FIG. 6 is a view illustrating a process to correct unevenness in brightness of an image.
- FIG. 7 is a view illustrating a brightness correction process of an image.
- FIG. 8 is a schematic plan view illustrating a modification example of the imaging element 5 installed in the imaging apparatus 100 shown in FIG. 1 .
- FIG. 9 is a view illustrating a timing chart in a case of the long time exposure imaging operation of the imaging apparatus 100 in which the imaging element 5 ′ shown in FIG. 8 is installed.
- FIG. 10 is a view illustrating a modification example of a timing chart in a case of the long time exposure imaging operation of the imaging apparatus 100 in which the imaging element 5 ′ shown in FIG. 8 is installed.
- FIG. 11 is a view illustrating a modification example of a timing chart in a case of the long time exposure imaging operation of the imaging apparatus 100 in which the imaging element 5 ′ shown in FIG. 8 is installed.
- FIG. 12 is a view illustrating a modification example of the imaging element shown in FIG. 8 .
- FIG. 13 is a view illustrating a modification example of the imaging element shown in FIG. 8 .
- FIG. 1 is a functional block diagram of an imaging apparatus 100 explaining an embodiment of the present invention.
- the imaging system of the imaging apparatus 100 includes an imaging lens system 1 , a diaphragm 2 , a mechanical shutter 3 , a CMOS (Complementary Metal Oxide Semiconductor) type imaging element 5 , and analog/digital (AD) conversion section 6 .
- CMOS Complementary Metal Oxide Semiconductor
- AD analog/digital
- the diaphragm 2 is disposed in the rear portion of the imaging lens system 1 .
- the photographing optical system includes the imaging lens system 1 and the diaphragm 2 .
- the mechanical shutter 3 is disposed in the rear portion of the diaphragm 2 .
- the CMOS type imaging element 5 is disposed in the rear portion of the mechanical shutter 3 .
- a captured image signal corresponding to an object optical image which is passed through the imaging lens system 1 and the diaphragm 2 in this order and incident on the light receiving surface of the imaging element 5 , is converted into digital data in an AD conversion section 6 , and output to the bus 17 .
- a central control unit (CPU) 7 which performs overall control of the entire imaging apparatus 100 , an operation section 16 which is configured by operation buttons and the like including a shutter release button, an image processing section 9 which is configured by DSP and the like and performs a known image processing with respect to the captured image signal based on the instruction from the CPU 7 , an video encoder 15 which converts captured image data, that is obtained by performing an image processing to the captured image signal, into data for display, a driver 13 which displays the captured image data that is converted in the video encoder 15 on the display section 14 , a memory 10 which temporarily stores the captured image signal that is output from the imaging element 5 , the captured image data that is generated in the image processing section 9 , and the like, and a media control section 12 are connected to the bus 17 .
- a recording media (a memory card) 11 is detachably mounted in the media control section 12 .
- a device control section 8 is connected to the CPU 7 .
- the device control section 8 performs the driving control of the imaging element 5 , the opening amount adjustment control of the diaphragm 2 , and the opening/closing control of the mechanical shutter 3 , according to the instruction from the CPU 7 . Further, the device control section 8 performs the focus position control and the zoom position control of the imaging lens system 1 , according to the instruction from the CPU 7 .
- FIG. 2 is a schematic plan view illustrating a schematic configuration of an imaging element 5 in the imaging apparatus 100 shown in FIG. 1 .
- the imaging element 5 includes a plurality of photoelectric conversion elements 50 that is arrayed in a two-dimensional shape (a square lattice shape in the example of FIG. 2 ) in a row direction X and Y direction that is perpendicular to X, a vertical scanning circuit 51 , a horizontal scanning circuit 52 , and a control section 53 .
- the plurality of photoelectric conversion elements 50 are disposed such that each line of the photoelectric conversion elements is configured by a plurality of photoelectric conversion elements 50 that are arranged in a row direction X, and n (n is a natural number of two or more) lines are arrayed in a column direction Y. As shown in FIG. 2 , it is referred to as line ( 1 ), line ( 2 ), line ( 3 ), . . . , line (n), in order from the bottom in FIG. 2 .
- CMOS circuit In each photoelectric conversion element 50 included in the imaging element 5 , a CMOS circuit, not shown, is provided corresponding to the vicinity thereof
- the CMOS circuit is, for example, a known three-transistor configuration or a known four-transistor configuration.
- the vertical scanning circuit 51 performs a driving which selects each line of the photoelectric conversion element, and reads out a signal to the signal output line from the CMOS circuit corresponding to the selected line. Further, the vertical scanning circuit 51 also performs a driving which controls a reset transistor of the CMOS circuit corresponding to each line to reset the accumulated charges in the photoelectric conversion elements 50 in each line (a driving which discharges the accumulated charges in the photoelectric conversion elements to the drain of the reset transistor of the CMOS circuit).
- the horizontal scanning circuit 52 performs a driving which sequentially selects a signal for one line, that is output to the signal output line, to be output to the outside of the imaging element 5 .
- the control section 53 controls the vertical scanning circuit 51 and the horizontal scanning circuit 52 , according to the instruction of the device control section 8 .
- the imaging apparatus 100 in the case of long time exposure imaging, divides the set exposure time into a plurality of times and consecutively performs a plurality of times of short time exposure imaging. Then, the imaging apparatus 100 synthesizes a plurality of images obtained by a plurality of times of short time exposure imaging, so that the imaging apparatus 100 generates the image equivalent to when performing one time of imaging in the set exposure time.
- the imaging apparatus 100 displays the image obtained at the time on the display section 14 in real time. Accordingly, it is possible to confirm the image in the middle of imaging.
- a description of the action of the imaging apparatus 100 will be made when the imaging apparatus 100 performs fifteen seconds of short time exposure imaging four times and performs long time exposure imaging of which exposure time is 1 minute (for example, imaging that regards a moving object such as a star as a major object).
- FIG. 3 is a view illustrating a timing chart in a case of the long time exposure imaging of the imaging apparatus 100 shown in FIG. 1 .
- the parallelogram denoted as “exposure” refers to an exposure period of the short time exposure imaging, and the parallelogram between the exposure periods refers to a signal output period.
- control section 53 performs a rolling reset which resets each line of the photoelectric conversion element 50 at a shifted timing, in the vertical scanning circuit 51 .
- the reset of the photoelectric conversion element 50 is performed in order from line ( 1 ) toward line (n). In each line, at a time when the reset of the accumulated charge is terminated, an exposure of a first time of imaging is started.
- control section 53 If it becomes time t 3 after a given time elapses from when the exposure of line ( 1 ) is started at time t 1 , the control section 53 performs a rolling reading which reads out a signal according to an accumulated charge of the photoelectric conversion element 50 at a shifted timing for each line of photoelectric conversion element 50 to the signal output line, in the vertical scanning circuit 51 .
- the signal for one line that is read out to the signal output line is output to the outside of the imaging element 5 by the horizontal scanning circuit 52 .
- the exposure of the first time of imaging is terminated.
- the exposure of the first time of imaging is terminated.
- the signal according to an accumulated charge of the photoelectric conversion element 50 is read out to the signal output line in order from line ( 1 ) toward line (n).
- the signal for one line that is output to the signal output line is output to the imaging element 5 in the order of output.
- the image processing section 9 performs an image processing to the captured image signal obtained by the first time of imaging that is stored in the memory 10 , generates the captured image data ( 1 ) and stores the captured image data ( 1 ) in the memory 10 .
- the encoder 15 converts the captured image data into data for display. Then, driver 13 displays an image based on the data for display (the first sheet of image shown in FIG. 3 ) on the display section 14 .
- the control section 53 With respect to the line in which the exposure is terminated by the rolling reading started at time t 3 , at a time when the output of the signal to the outside of the imaging element 5 in the line is terminated, the control section 53 resets the accumulated charge of the photoelectric conversion element in the line in the vertical scanning circuit 51 , and causes the exposure of the second time of imaging of the line to be started. In short, the control section 53 causes the exposure of the second time of imaging in each line to be sequentially started by the rolling reset.
- control section 53 starts the rolling reading, and causes the exposure of the second time of imaging to be sequentially terminated in each line.
- the image processing section 9 After the rolling reading is terminated, if the signal that is read out from the line (n) to the signal output line is output to the outside of the imaging element 5 (if the second time of imaging is terminated in entire lines), the image processing section 9 performs an image processing to the captured image signal obtained by the second time of imaging that is stored in the memory 10 , generates the captured image data ( 2 ) and stores the captured image data ( 2 ) in the memory 10 .
- the image processing section 9 synthesizes the captured image data ( 1 ) that is generated with the first time of imaging and the captured image data ( 2 ) that is generated with the second time of imaging to generate the synthetic image data ( 1 ), and stores the synthetic image data ( 1 ) in the memory 10 .
- the encoder 15 converts the synthetic image data ( 1 ) into data for display. Then, the driver 13 displays the synthetic image based on the data for display on the display section 14 (a synthetic image of two sheets of the captured image data shown in FIG. 3 (it is simply shown as two sheets of synthetic images in the drawing)).
- the control section 53 performs a rolling reset after the termination of the second time of imaging, and causes the exposure of the exposure of the third time of imaging to be sequentially started in each line. After that, the control section 53 performs the rolling reading, and causes the exposure of the third time of imaging to be sequentially terminated in each line.
- the image processing section 9 After the rolling reading is terminated, if the signal that is read out from the line (n) to the signal output line is output to the outside of the imaging element 5 (if the third time of imaging is terminated in entire lines), the image processing section 9 performs an image processing to the captured image signal obtained by the third time of imaging that is stored in the memory 10 , generates the captured image data ( 3 ) and stores the captured image data ( 3 ) in the memory 10 .
- the image processing section 9 generates the synthesized image data ( 2 ) in which the synthesized image data ( 1 ) and the captured image data ( 3 ) are synthesized, and stores the synthetic image data ( 2 ) in the memory 10 .
- the encoder 15 converts the synthetic image data ( 2 ) into data for display. Then, the driver 13 displays the synthetic image based on the data for display on the display section 14 (a synthetic image of three sheets of the captured image data shown in FIG. 3 (it is simply shown as three sheets of synthetic images in the drawing)).
- the synthetic image data ( 2 ) may be generated by synthesizing the captured image data ( 1 ) to ( 3 ).
- control section 53 After the third time of imaging is terminated, the control section 53 performs the rolling reset and causes the exposure of the fourth time of imaging to be sequentially started in each line. After that, the control section 53 performs the rolling reading and causes the exposure of the fourth time of imaging to be sequentially terminated in each line.
- the image processing section 9 After the rolling reading is terminated, if the signal that is read out from the line (n) to the signal output line is output to the outside of the imaging element 5 (if the fourth time of imaging is terminated in entire lines), the image processing section 9 performs an image processing to the captured image signal obtained by the fourth time of imaging that is stored in the memory 10 , generates the captured image data ( 4 ) and stores the captured image data ( 4 ) in the memory 10 .
- the image processing section 9 generates the synthesized image data ( 3 ) in which the synthesized image data ( 2 ) and the captured image data ( 4 ) are synthesized, and stores the synthetic image data ( 3 ) in the memory 10 .
- the encoder 15 converts the synthetic image data ( 3 ) into data for display. Then, the driver 13 displays the synthetic image based on the data for display on the display section 14 (a synthetic image of four sheets of the captured image data shown in FIG. 3 (it is simply shown as four sheets of synthetic images in the drawing)).
- the synthetic image data ( 3 ) may be generated by synthesizing the captured image data ( 1 ) to ( 4 ).
- the image processing section 9 After the synthetic image data ( 3 ) is generated, the image processing section 9 records the synthetic image data ( 3 ) in the memory card 11 through a media control section 12 . If the synthetic image data ( 3 ) is recorded in the memory card 11 , the long time exposure imaging is terminated.
- the imaging apparatus 100 displays the image obtained by the imaging on the display section 14 . Further, if the second and subsequent imaging are terminated, the imaging apparatus 100 displays the synthetic image of the image obtained with the imaging and the image obtained with all imaging prior to the imaging on the display section 14 .
- the imaging apparatus 100 divides the long time exposure into a plurality of times of exposure and performs the exposure. For this reason, compare to a case of performing the long time exposure imaging in one time exposure it is easy to ensure a saturation capacity in each short time exposure imaging and it is possible to loosen the constraint condition such as an aperture value. Further, since each short time exposure imaging is a short exposure, it is possible to reduce the noise by that amount.
- a driving method of a plurality of times of imaging is not limited to the driving method shown in FIG. 3 .
- a driving method may be employed in which the mechanical shutter 3 is opened by the exposure period of each of four times of imaging and the exposure start and the exposure termination in each imaging are equal in entire lines.
- the device control section 8 opens the mechanical shutter 3 to cause the exposure of the first time of imaging to be started and closes the mechanical shutter 3 to cause the exposure to be terminated. After the exposure termination, the device control section 8 performs the rolling reading to read the signal. If the output of the signal of the line (n) to the outside of the imaging element is terminated, the device control section 8 performs a global reset which simultaneously resets the accumulated charge of the photoelectric conversion element 50 of the entire lines, and opens the mechanical shutter 3 to cause the exposure of the next imaging to be started. The device control section 8 repeats this driving.
- a signal output period after the termination of each exposure becomes longer than the driving shown in FIG. 3 .
- the signal output period is a period in which the exposure is not performed. For this reason, if the signal output period becomes long, as shown in FIG. 4 , in the synthetic image obtained in a case where the images of four sheets are synthesized, the main object is synthesized in a non-continuous form.
- the driving shown in FIG. 3 it is possible to make the signal output period very small, thereby achieving a high quality of synthetic image.
- a driving may be employed in which the imaging element 5 is a CCD (Charge Coupled Device) type, and using an electronic shutter or a mechanical shutter 3 , a plurality of times of imaging is consecutively performed. Also in this case, since the signal output period in the driving of FIG. 4 becomes longer than the signal output period in the diving of FIG. 3 , it is preferable to employ the driving shown in FIG. 3 in order to achieve a high quality of synthetic image.
- CCD Charge Coupled Device
- the synthetic image data ( 3 ) is recorded in the memory card 11 .
- it may have a configuration such that in a case where there is an instruction to terminate an imaging in the middle of four times of imaging, when the instruction is made, the latest synthetic image data (in a case where only the first time of imaging is terminated, the captured image data ( 1 )) stored in the memory 10 is recorded in the memory card 11 .
- the imaging apparatus 100 may record in the memory card 11 not only the synthetic image data but also entire captured image data that is generated at a time when there is an instruction to terminate an imaging or a plurality of times of imaging that is supposed is completely terminated. Since the entire captured image data is recorded, it is possible for the user to freely generate a favorite synthetic image data after imaging.
- the exposure start of the first time of imaging may be simultaneously controlled in all lines and the exposure termination of the last imaging may be simultaneously controlled in all lines.
- FIG. 5 is a timing chart illustrating a modification example of an operation in a case of the long time exposure imaging of the imaging apparatus 100 shown in FIG. 1 .
- Time t 1 to t 4 in FIG. 5 are the same as time t 2 to t 5 in FIG. 4 .
- FIG. 5 is different from FIG. 3 in that when an imaging instruction is made, the control section 53 causes the vertical scanning circuit 51 to perform a global reset which simultaneously resets the accumulated charge of the entire lines and causes the exposure of the first time of imaging to be simultaneously started in all lines.
- FIG. 5 is different from FIG. 3 in that the device control section 8 performs four time of image through the control section 53 in a state where the mechanical shutter 3 opens and terminates simultaneously the exposure of the fourth time of imaging in all lines by the driving for closing the mechanical shutter.
- control section 53 performs the global reset in time t 1 to cause the exposure of the first time of imaging to be started simultaneously in all lines. After that, the control section 53 causes the second to fourth time of imaging to be performed by the rolling reading and the rolling reset.
- the device control section 8 closes the mechanical shutter 3 to perform a driving to causes the exposure in the all lines to be simultaneously terminated.
- the control section 53 performs the rolling reading to cause the fourth time of imaging to be terminated.
- the exposure start of the first time of imaging may be controlled by the mechanical shutter 3 .
- the device control section 8 may open the mechanical shutter 3 to cause the exposure to be started simultaneously in all lines.
- the exposure time does not made equal in all the signal output lines.
- unevenness in brightness occurs toward the column direction Y in the first sheet of imaging obtained with the first time of imaging and the fourth sheet of imaging obtained with the fourth time of imaging.
- the image processing section 9 performs a processing to correct the unevenness in brightness after the data is generated to store the corrected data in the memory 10 .
- the processing to correct the unevenness in brightness adjusts the brightness of the other lines to the brightness of the brightest line (n) in a case of the captured image data ( 1 ), and adjusts the brightness of the other lines to the brightness of the brightest line ( 1 ) in a case of the captured image data ( 4 ). Through this processing, it is possible to make the image or the synthetic image displayed on the display section 14 good during the imaging.
- the first sheet of image is darkest, next, it becomes brighter in order from the synthetic image of the captured image data of two sheets to the synthetic image of the captured image data of three sheets, and the synthetic image of the captured image data of four sheets is brightest.
- the encoder 15 performs a gain-up processing with respect to the original image such that the brightness of all data for display is identical to the brightness of data for display that is converted from the synthetic image data ( 3 ).
- the encoder 15 performs a processing to make the generated data for display (K/L) times.
- the encoder 15 performs a gain-up processing of making four times to the data for display (the original image) obtained by converting the captured image data ( 1 ). Further, the encoder 15 performs a gain-up processing of making twice to the data for display (the original image) obtained by converting the synthetic image data ( 1 ). Furthermore, the encoder 15 performs a gain-up processing of making three-fourths times to the data for display (the original image) obtained by converting the synthetic image data ( 2 ). Furthermore, the encoder 15 does not perform a gain-up processing or perform a gain-up processing of making one time to the data for display (the original image) obtained by converting the synthetic image data ( 3 ).
- the number of the short time exposure imaging that is set when long time exposure imaging is performed may be set manually by the user or automatically by the imaging apparatus 100 .
- the imaging apparatus 100 performs a processing to shorten the time of the short time exposure to increase the number of the short time exposure imaging, in order for each photoelectric conversion element 50 of the imaging element 5 not to be saturated. Further, in a case where the set aperture value exceeds the threshold value, the light receiving amount of the imaging element 5 becomes small. For this reason, the imaging apparatus 100 performs a processing to lengthen the time of the short time exposure to reduce the number of the short time exposure imaging.
- FIG. 8 is a schematic plan view illustrating a modification example of the imaging element 5 installed in the imaging apparatus 100 shown in FIG. 1 .
- the configuration of the imaging apparatus is the same as FIG. 1 except for that the imaging element 5 is changed to the imaging element 5 ′ shown in FIG. 8 .
- the imaging element 5 ′ includes a first group having a plurality of photoelectric conversion elements 50 a , a second group having a plurality of photoelectric conversion elements 50 b , a vertical scanning circuit 51 a and a horizontal scanning circuit 52 a that are provided corresponding to the first group and a vertical scanning circuit 51 b and a horizontal scanning circuit 52 b that are provided corresponding to the second group.
- the entire photoelectric conversion elements included in the imaging element 5 ′ are disposed in a two-dimensional shape arranged in a column direction Y of a semiconductor substrate surface and in a row direction X perpendicular thereto.
- first lines configured by a plurality of photoelectric conversion elements 50 a arranged in the row direction X and second lines configured by a plurality of photoelectric conversion elements 50 b arranged in the row direction X are alternately arranged with a certain pitch in the row direction Y. Further, the first line is shifted and disposed relative to the second line in the row direction X by a half of the arrangement pitch in the row direction X for the photoelectric conversion elements of each line.
- the first line and the second line are respectively referred to as line ( 1 ), line ( 2 ), line ( 3 ), . . . , line (n), in order from the bottom in FIG. 8 .
- the entire photoelectric conversion elements included in the imaging element 5 ′ have approximately the same configuration (same values on the design).
- the approximately the same configuration means that the sizes of the photoelectric conversion regions (photodiodes) formed within the semiconductor substrates are approximately the same and the sizes of openings of the light shielding films formed above the photoelectric conversion regions are approximately the same.
- CMOS circuit In the entire photoelectric conversion elements included in the imaging element 5 ′, a CMOS circuit, not shown, is provided corresponding to the vicinity thereof
- the CMOS circuit is, for example, a known three-transistor configuration or a known four-transistor configuration.
- the vertical scanning circuit 51 a performs a rolling reading which selects each one line of the first group from line ( 1 ) toward line (n), and reads out a signal to the signal output line from the CMOS circuit corresponding to the selected line. Further, the vertical scanning circuit 51 a also performs a rolling reset which resets the accumulated charges in the photoelectric conversion elements 50 a of the first group in order from line ( 1 ) toward line (n) at a shifted timing.
- the horizontal scanning circuit 52 a performs a driving which sequentially selects a signal for one line of the first group, that is output to the signal output line, to be output to the outside of the imaging element 5 ′.
- the vertical scanning circuit 51 b performs a rolling reading which selects each one line of the second group from line ( 1 ) toward line (n), and reads out a signal to the signal output line from the CMOS circuit corresponding to the selected line. Further, the vertical scanning circuit 51 b also performs a rolling reset which resets the accumulated charges in the photoelectric conversion elements 50 b of the second group in order from line ( 1 ) toward line (n) at a shifted timing.
- the horizontal scanning circuit 52 b performs a driving which sequentially selects a signal for one line of the second group, that is output to the signal output line, to be output to the outside of the imaging element 5 ′.
- the control section 53 controls the vertical scanning circuit 51 a , 51 b and the horizontal scanning circuit 52 a , 52 b according to the instruction of the device control section 8 .
- FIG. 9 is a view illustrating a timing chart in a case of the long time exposure imaging of the imaging apparatus 100 in which the imaging element 5 ′ shown in FIG. 8 is installed.
- the parallelogram denoted as “exposure” refers to an exposure period in a case of the short time exposure imaging, and the parallelogram between the exposure periods refers to a signal output period.
- the exposure period of the short time exposure each has the same length.
- control section 53 performs a rolling reset in the vertical scanning circuit 51 a to reset the accumulated charge of the photoelectric conversion element 50 a of the first group at a shifted timing for each line.
- the exposure is started (the start of the first time of short time exposure imaging).
- the control section 53 performs the rolling reset in the vertical scanning circuit 51 b to reset the accumulated charge of the photoelectric conversion element 50 a of the second group at a shifted timing for each line.
- the exposure is started (the start of the second time of short time exposure imaging).
- the control section 53 performs the rolling reading in the vertical scanning circuit 51 a and reads out a signal according to an accumulated charge of the photoelectric conversion element 50 a of the first group to the signal output line at a shifted timing for each line.
- the signal for one line read in the signal output line is output to the outside of the imaging element 5 ′ by the horizontal scanning circuit 52 a.
- each line of the first group at a time when the reading of the signal according to an accumulated charge of the photoelectric conversion element 50 a from the CMOS circuit to the signal output line is terminated, the exposure is terminated. Further, in each line, at a time when all of the signal for one line that is read out to the signal output line, is output to the outside of the imaging element 5 ′ by the horizontal scanning circuit 52 a , the first time of short time exposure imaging is terminated.
- the image processing section 9 performs an image processing to the captured image signal obtained by the first time of short time exposure imaging that is stored in the memory 10 , generates the captured image data ( 1 ) and stores the captured image data ( 1 ) in the memory 10 .
- the encoder 15 converts the captured image data into data for display. Then, driver 13 causes an image based on the data for display (the first sheet of image shown in FIG. 9 ) to be displayed on the display section 14 .
- control section 53 After the imaging of the line ( 1 ) of the first group is terminated, the control section 53 performs a rolling reset in the vertical scanning circuit 51 a to cause the next exposure to be sequentially started in each line, in the first group (the start of the third time of short time exposure imaging).
- control section 53 performs a rolling reading in the vertical scanning circuit 51 b to read out a signal according to an accumulated charge of the photoelectric conversion element 50 b of the second group to the signal output line at a shifted timing for each line.
- each line of the second group at a time when the reading of the signal according to an accumulated charge of the photoelectric conversion element 50 b from the CMOS circuit to the signal output line is terminated, the exposure is terminated. Further, in each line, at a time when all of the signal for one line that is read out to the signal output line, is output to the outside of the imaging element 5 ′ by the horizontal scanning circuit 52 b , the second time of short time exposure imaging is terminated.
- the image processing section 9 performs an image processing to the captured image signal obtained by the second time of short time exposure imaging that is stored in the memory 10 , generates the captured image data ( 2 ) and stores the captured image data ( 2 ) in the memory 10 .
- the image processing section 9 synthesizes the captured image data ( 1 ) that is generated with the first time of short time exposure imaging and the captured image data ( 2 ) that is generated with the second time of short time exposure imaging to generate the synthetic image data ( 1 ), and stores the synthetic image data ( 1 ) in the memory 10 .
- the encoder 15 converts the synthetic image data ( 1 ) into data for display. Then, the driver 13 causes the synthetic image based on the data for display to be displayed on the display section 14 (a synthetic image of two sheets of captured image data shown in FIG. 9 (it is simply shown as two sheets of synthetic images in the drawing)).
- control section 53 After the imaging of the line ( 1 ) of the second group is terminated (after the second time of short time exposure imaging is terminated), the control section 53 performs the rolling reset in the vertical scanning circuit 51 b , and causes the next exposure to be sequentially started in each line, in the second group (the start of the fourth time of short time exposure imaging).
- the rolling reading of the first group the display of the synthetic image of the captured image data of three sheets, the rolling reset of the first group (the start of the fifth time of short time exposure imaging), the rolling reading of the second group, the display of the synthetic image of the captured image data of four sheets, the rolling reset of the second group (the start of the sixth time of short time exposure imaging), the rolling reading of the first group, the display of the synthetic image of the captured image data of five sheets, the rolling reset of the first group (the start of the seventh time of short time exposure imaging), the rolling reading of the second group, the display of the synthetic image of the captured image data of six sheets, the rolling reset of the second group (the start of the eighth time of short time exposure imaging), the rolling reading of the first group, the display of the synthetic image of the captured image data of seven sheets, the rolling reading of the second group, and the display of the synthetic image of the captured image data of eight sheets. Then, the synthetic image of the captured image data of eight sheets obtained with the eight times
- the imaging device of the modification example performs imaging using the first group with respect to the short time exposure imaging to be performed in an odd number of times and performs imaging using the second group with respect to the short time exposure imaging to be performed in an even number of times. Further, the imaging device shifts the start timings of the short time exposure in the imaging performed in the first group and the imaging performed in the second group, among a plurality of times of short time exposure imaging that is continuously performed in a case of the long time exposure imaging.
- the timing chart of the first group is indicated by the dashed line.
- the entire of the unexposed period (the signal output period) that occurs between short time exposure periods performed in the first group is included in each short time exposure period that is performed in the second group.
- the entire of the unexposed period (the signal output period) that occurs between short time exposure periods performed in the second group is included in each short time exposure period that is performed in the first group. For this reason, it is possible to eliminate the unexposed period that occur in a case of by dividing the long time exposure imaging into a plurality of times of the short time exposure imaging and performing the short time exposure imaging.
- a plurality of times of short time exposure imaging may be performed such that the signal output period after the exposure termination of the former short time exposure imaging is included in the exposure period of the latter short time exposure imaging.
- the exposure start timing of each line of the latter short time exposure imaging may be shifted relative to the exposure start timing of the former short time exposure imaging.
- the unexposed period is eliminated in this manner, so that it is possible to make synthetic image data that is generated after termination of the second and subsequent short time exposure imaging not inferior to the image obtained with the first time of exposure, and realize high quality of long time exposure imaging.
- At least one of the captured image data and the synthetic image data generated at a time when the imaging termination instruction is made or a time when all of the short time exposure imaging is terminated may be recorded.
- the brightness control of the image displayed on the display section 14 may be performed similarly to the imaging apparatus 100 shown in FIG. 1 .
- the driving shown in FIG. 5 can be employed even in the driving shown in FIG. 9 . That is, as shown in FIG. 10 , the exposure start time t 1 of the first time and second time of short time exposure imaging may be controlled by performing the global reset which simultaneously resets the accumulated charges in all lines of the first group and all lines of the second group, and the exposure termination time t 2 of the seventh time and eighth time of short time exposure imaging may be controlled by performing the driving to close the mechanical shutter 3 .
- the driving shown in FIG. 9 can be modified to the driving in which the exposure period of the odd number of times of short time exposure imaging and the exposure period of the even number of times of short time exposure imaging are not overlapped with each other.
- the exposure start time of the first time of short time exposure imaging may be controlled by performing the global reset which simultaneously resets the accumulated charges in all lines of the first group and the exposure termination time of the eighth time of short time exposure imaging may be controlled by performing the driving to close the mechanical shutter 3 .
- the exposure start and the exposure termination timing may be controlled by the rolling reset and the rolling reading.
- the exposure start of at least the first time of short time exposure imaging out of the first time and the second time of short time exposure imaging is controlled by the global reset
- the exposure termination of at least the eighth time of short time exposure imaging out of the seventh time and the eighth time of short time exposure imaging is controlled by closing the mechanical shutter 3 .
- the unevenness in brightness occurs in the column direction Y in the captured image data obtained with the first time and the second time of short time exposure imaging and the captured image data obtained with the seventh time and the eighth time of short time exposure imaging. For this reason, it is preferable that the image processing section 9 correct the unevenness in brightness, similarly to the above description.
- the number of the short time exposure imaging performed in the driving shown in FIGS. 9 to 11 may also be determined according to the aperture value.
- the device control section 8 may determine the number of the short time exposure imaging, in order for the unexposed period not to occur, in response to the aperture value, within the period from the start of the first short time exposure imaging to the termination of the last short time exposure imaging.
- an odd number of times of short time exposure imaging is performed with the first group, but the odd number of times of short time exposure imaging may be performed in the second group and the even number of times of short time exposure imaging may be performed in the first group.
- the arrangement of the photoelectric conversion elements of the imaging element 5 ′ may be the arrangement shown in FIG. 12 and FIG. 13 .
- FIG. 12 is a view illustrating a modification example of the imaging element shown in FIG. 8 .
- a plurality of photoelectric conversion elements are arranged in a square lattice shape, among the photoelectric conversion elements, the odd number of rows are set as the photoelectric conversion elements 50 a and the even number of rows are set as the photoelectric conversion elements 50 b.
- FIG. 13 is a view illustrating a modification example of the imaging element shown in FIG. 8 .
- the imaging element in the modification example has a configuration in which a plurality of photoelectric conversion elements are arranged in a square lattice shape, among the photoelectric conversion elements, the photoelectric conversion elements 50 a are arranged in one checkered position and the photoelectric conversion elements 50 b are arranged in another checkered position.
- a disclosed imaging apparatus comprises: an imaging element; a display section; an imaging control section which causes the imaging element to perform a plurality of times of imaging; and a display control section which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- the imaging element is a MOS type including a plurality of lines of photoelectric conversion elements, further comprising: a mechanical shutter provided in a light incident side of the imaging element, in which the imaging element, in which in a case of the first time of imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing the rolling reset, and causes
- the display control section causes an image of which unevenness due to a variation of an exposure time for each line in the first time of imaging is corrected to be displayed as the image obtained with the first time of imaging on the display section when the first time of imaging is terminated, and causes the synthetic image of which unevenness due to a variation of an exposure time for each line in the first time of imaging and unevenness due to a variation of an exposure time for each line in the last imaging are corrected to be displayed on the display section when the last imaging is terminated.
- the display control section causes the image having further increased brightness than an original image to be displayed, and the smaller the implementation number of imaging other than the last imaging is, the higher an increased degree of the brightness is.
- the imaging element includes a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements
- the imaging control section causes the first group to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, causes the second group to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and causes the imaging element to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- the imaging apparatus further comprising: a mechanical shutter provided in a light incident side of the imaging element, in which the imaging element is a MOS type, in which in a case of at least a first time of imaging among the first time of imaging and subsequent imaging, among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line of the photoelectric conversion element, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in all the lines by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging and subsequent imaging, and at least the last
- the display control section causes an image of which unevenness due to a variation of an exposure time for each line of the first group in the first time of imaging is corrected to be displayed as the image obtained with the first time of imaging on the display section when the first time of imaging is terminated, and causes the synthetic image of which unevenness due to a variation of an exposure time for each line of the first group in the first time of imaging and unevenness due to a variation of an exposure time for each line of the second group in the last imaging are corrected to be displayed on the display section when the last imaging is terminated.
- the display control section causes the image having further increased brightness than an original image to be displayed, and the smaller an implementation number of imaging other than the last imaging is, the higher an increased degree of the brightness is.
- the disclosed imaging apparatus further comprising: a captured image data generating section which generates captured image data using a captured image signal to be output from the imaging device with the imaging whenever each of the plurality of times of imaging is terminated; a synthetic image data generating section which generates synthetic image data obtained by synthesizing the captured image data that is generated with each of second and subsequent imaging and all imaging prior to each imaging, whenever each imaging is terminated; and a recording section which records the synthetic image data in a recording media, the synthetic image data being generated at a time when all of the plurality of times of imaging is terminated or an instruction to stop the plurality of times of imaging in the middle of the imaging is given.
- the imaging control section changes the number of times of the plurality of times of imaging according to an aperture value.
- a disclosed imaging apparatus comprises: a MOS type imaging element including a plurality of lines of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; a recording section which records the synthetic image data in a recording media; and a mechanical shutter provided in a light incident side of the imaging element, in which in a case of a first time of imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets
- a disclosed imaging apparatus comprises: an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals that is output from the imaging element with the plurality of times of imaging; and a recording section which records the synthetic image data in a recording media, in which the imaging control section causes the first group to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, causes the second group to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and causes the imaging element to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- the imaging apparatus further comprising: a mechanical shutter provided in a light incident side of the imaging element, in which the imaging element is a MOS type, in which in a case of at least a first time of imaging among the first time of imaging and subsequent imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line of the photoelectric conversion element, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in all the lines by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging, and subsequent imaging and at least the last imaging among the
- the imaging control section changes the number of times of the plurality of times of imaging according to an aperture value.
- a disclosed imaging method comprises: an imaging control step which causes an imaging element to perform a plurality of times of imaging; and a display control step which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- the imaging element is a MOS type including a plurality of lines of photoelectric conversion elements
- in the imaging control step in a case of the first time of imaging among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion step at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in each line by closing the mechanical shutter provided in a light incident side of the imaging element, and in a case of the imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing the rolling reset, and an exposure is caused to be terminated by performing the rolling reading.
- the imaging element includes a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements, in which in the imaging control step, the first group is caused to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, the second group is caused to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and the imaging element is caused to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- the imaging element is a MOS type
- in the imaging control step in a case of at least a first time of imaging among the first time of imaging and subsequent imaging, among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line of the photoelectric conversion step, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion step at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging and subsequent imaging, and at least the last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an
- a captured image data generating step which generates captured image data using a captured image signal to be output from the imaging device with the imaging whenever each of the plurality of times of imaging is terminated; a synthetic image data generating step which generates synthetic image data obtained by synthesizing the captured image data that is generated with each of second and subsequent imaging and all imaging prior to each imaging, whenever each imaging is terminated; and a recording step which records the synthetic image data in a recording medium, the synthetic image data being generated at a time when all of the plurality of times of imaging is terminated or an instruction to stop the plurality of times of imaging in the middle of the imaging is given.
- An disclosed imaging method comprises: an imaging control step which causes a MOS type imaging element including a plurality of lines of a photoelectric conversion element to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media; in which in the imaging control step, in a case of a first time of imaging among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for
- a disclosed imaging method comprises: an imaging control step which causes an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media, in which in the imaging control step, the first group is caused to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, the second group is caused to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and the imaging element is caused to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- the imaging element is a MOS type
- in the imaging control step in a case of at least a first time of imaging among the first time of imaging and subsequent imaging, among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line of the photoelectric conversion element, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in all the lines by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging and subsequent imaging, and at least the last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging,
- an imaging apparatus and an imaging method in which the user can confirm in real time an image that is being captured during long time exposure imaging. Further, according to the present invention, it is possible to provide an imaging apparatus and an imaging method in which high quality of long time exposure imaging can be simply performed.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
- The present invention relates to an imaging apparatus and an imaging method.
- When an astrophotography, etc. are taken, for example, a method is employed in which an image is captured in a long time exposure while a digital camera is fixed to a tripod. Generally, in order to confirm a moving image that is being taken, or a still image and a moving image that have been captured, a display section is installed in the digital camera. However, in the digital camera in the related art, it is not possible to confirm the captured image on the display section in a case of long time exposure imaging, until the imaging is terminated.
- For this reason, even in a case where the captured image has become a failure due to an accident in which the tripod is shaken by wind during the imaging, the user does not notice it. That is, the user comes to know for the first time that the captured image has become a fail image, after the imaging is terminated.
-
Patent Literature 1 discloses an imaging apparatus which captures a plurality of sheets of images in a shorter exposure time than the exposure time to obtain a desirable exposure, and obtains an image of the desirable exposure by synthesizing the plurality of sheets of images. - According to the imaging apparatus, it is possible to obtain an image of the desirable exposure without image vibration. However, since the user can confirm for the first time a synthetic image or one image among the plurality of sheets of image after the imaging of the plurality of sheets of image is terminated, it is not possible to confirm the image in middle of imaging.
- Further, the imaging method of
Patent Literature 1, a selection is performed according to an image vibration degree as to whether a continuous imaging using a mechanical shutter or a continuous imaging using an electronic shutter. For this reason, in the imaging method ofPatent Literature 1, in a case of the continuous imaging using a mechanical shutter, a lot of unexposed periods exist between a plurality of imaging, so the user feels a sense of discontinuity in a synthetic image. Further, in the imaging method ofPatent Literature 1, in a case of the continuous imaging using the electronic shutter, a distortion occurs with respect to a moving object. Furthermore, in an imaging method ofPatent Literature 1, a process to detect an image vibration is necessary, so the process becomes complicated. -
Patent Literature 2 discloses an imaging apparatus which can capture a high quality still image during capturing a moving image. However, inPatent Literature 2, it is not possible to confirm an image during imaging in a long time exposure. Further, inPatent Literature 2, a long time exposure imaging is not considered. -
Patent Literature 1 JP-A-2006-345317 -
Patent Literature 2 JP-A-2005-244760 - A first object of the present invention is to provide an imaging apparatus and an imaging method which can simply perform a high quality long time exposure. Further, a second object of the present invention is to provide an imaging apparatus and an imaging method which can confirm in real time an image that is being captured during a long time exposure imaging.
- An imaging apparatus of the present invention comprises: an imaging element; a display section; an imaging control section which causes the imaging element to perform a plurality of times of imaging; and a display control section which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- An imaging method of the present invention comprises: an imaging control step which causes an imaging element to perform a plurality of times of imaging; and a display control step which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- According to the configuration and the method, if a first time of imaging among a plurality of times of imaging is terminated, it is possible to display the image obtained with the imaging on the display section, and if second and subsequent imaging are terminated, it is possible to display the synthetic image of the image obtained with the imaging and the image obtained with all imaging prior to the imaging on the display section.
- For this reason, in the middle of a plurality of times of imaging, it is possible for the user of the imaging apparatus to confirm the image obtained at that time on the display section. Therefore, at a time when the image is not obtained as expected, it is possible to stop a plurality of times of imaging to correct the imaging, so there is no waste of time. Further, at a time when the image is obtained as expected, it is possible to terminate the plurality of times of imaging, thereby shortening the time until the termination of the imaging.
- An imaging apparatus of the present invention comprises: a MOS type imaging element including a plurality of lines of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; a recording section which records the synthetic image data in a recording media; and a mechanical shutter provided in a light incident side of the imaging element, in which in a case of a first time of imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of the imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing the rolling reset, and causes an exposure to be terminated by performing the rolling reading.
- An imaging method of the present invention comprises: an imaging control step which causes a MOS type imaging element including a plurality of lines of a photoelectric conversion element to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media; in which in the imaging control step, in a case of a first time of imaging among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of the imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing the rolling reset, and an exposure is caused to be terminated by performing the rolling reading.
- According to the configuration and the method, exposure starts become equal in all lines in the first imaging, and exposure terminations become equal in all lines in the last imaging. For this reason, the exposure start and the exposure termination in synthetic image data are coincident in all pixels, thereby preventing an image distortion from occurring even in a moving object. Further, it is possible to achieve this effect without a processing to detect an image vibration. Accordingly, it is possible to realize high quality of long time exposure imaging by a simple configuration.
- An imaging apparatus of the present invention comprises: an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals that is output from the imaging element with the plurality of times of imaging; and a recording section which records the synthetic image data in a recording media, in which the imaging control section causes the first group to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, causes the second group to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and causes the imaging element to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- An imaging method of the present invention comprises: an imaging control step which causes an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media, in which in the imaging control step, the first group is caused to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, the second group is caused to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and the imaging element is caused to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- According to the configuration and the method, without a processing to detect an image vibration, it is possible to remove unexposed period between the plurality of times of imaging. Accordingly, it is possible to realize high quality of long time exposure imaging by a simple configuration.
- According to the present invention, it is possible to provide an imaging apparatus and an imaging method in which the user can confirm in real time an image that is being captured during long time exposure imaging. Further, according to the present invention, it is possible to provide an imaging apparatus and an imaging method in which high quality of long time exposure imaging can be simply performed.
-
FIG. 1 is a functional block diagram of animaging apparatus 100 explaining an embodiment of the present invention. -
FIG. 2 is a schematic plan view illustrating a schematic configuration of animaging element 5 in theimaging apparatus 100 shown inFIG. 1 . -
FIG. 3 is a view illustrating a timing chart in a case of a long time exposure imaging operation of theimaging apparatus 100 shown inFIG. 1 . -
FIG. 4 is a view illustrating a modification example of a plurality of times of imaging method in a case of the long time exposure imaging operation of theimaging apparatus 100 shown inFIG. 1 . -
FIG. 5 is a timing chart illustrating a modification example of an operation in a case of the long time exposure imaging of theimaging apparatus 100 shown inFIG. 1 . -
FIG. 6 is a view illustrating a process to correct unevenness in brightness of an image. -
FIG. 7 is a view illustrating a brightness correction process of an image. -
FIG. 8 is a schematic plan view illustrating a modification example of theimaging element 5 installed in theimaging apparatus 100 shown inFIG. 1 . -
FIG. 9 is a view illustrating a timing chart in a case of the long time exposure imaging operation of theimaging apparatus 100 in which theimaging element 5′ shown inFIG. 8 is installed. -
FIG. 10 is a view illustrating a modification example of a timing chart in a case of the long time exposure imaging operation of theimaging apparatus 100 in which theimaging element 5′ shown inFIG. 8 is installed. -
FIG. 11 is a view illustrating a modification example of a timing chart in a case of the long time exposure imaging operation of theimaging apparatus 100 in which theimaging element 5′ shown inFIG. 8 is installed. -
FIG. 12 is a view illustrating a modification example of the imaging element shown inFIG. 8 . -
FIG. 13 is a view illustrating a modification example of the imaging element shown inFIG. 8 . - Hereinafter, a description of an embodiment of the present invention will be made referring to drawings.
-
FIG. 1 is a functional block diagram of animaging apparatus 100 explaining an embodiment of the present invention. The imaging system of theimaging apparatus 100 includes animaging lens system 1, adiaphragm 2, amechanical shutter 3, a CMOS (Complementary Metal Oxide Semiconductor)type imaging element 5, and analog/digital (AD)conversion section 6. - The
diaphragm 2 is disposed in the rear portion of theimaging lens system 1. The photographing optical system includes theimaging lens system 1 and thediaphragm 2. - The
mechanical shutter 3 is disposed in the rear portion of thediaphragm 2. The CMOStype imaging element 5, of which detailed description will be made later, is disposed in the rear portion of themechanical shutter 3. A captured image signal corresponding to an object optical image, which is passed through theimaging lens system 1 and thediaphragm 2 in this order and incident on the light receiving surface of theimaging element 5, is converted into digital data in anAD conversion section 6, and output to thebus 17. - A central control unit (CPU) 7 which performs overall control of the
entire imaging apparatus 100, anoperation section 16 which is configured by operation buttons and the like including a shutter release button, animage processing section 9 which is configured by DSP and the like and performs a known image processing with respect to the captured image signal based on the instruction from theCPU 7, anvideo encoder 15 which converts captured image data, that is obtained by performing an image processing to the captured image signal, into data for display, adriver 13 which displays the captured image data that is converted in thevideo encoder 15 on thedisplay section 14, amemory 10 which temporarily stores the captured image signal that is output from theimaging element 5, the captured image data that is generated in theimage processing section 9, and the like, and amedia control section 12 are connected to thebus 17. A recording media (a memory card) 11 is detachably mounted in themedia control section 12. - A
device control section 8 is connected to theCPU 7. Thedevice control section 8 performs the driving control of theimaging element 5, the opening amount adjustment control of thediaphragm 2, and the opening/closing control of themechanical shutter 3, according to the instruction from theCPU 7. Further, thedevice control section 8 performs the focus position control and the zoom position control of theimaging lens system 1, according to the instruction from theCPU 7. -
FIG. 2 is a schematic plan view illustrating a schematic configuration of animaging element 5 in theimaging apparatus 100 shown inFIG. 1 . - The
imaging element 5 includes a plurality ofphotoelectric conversion elements 50 that is arrayed in a two-dimensional shape (a square lattice shape in the example ofFIG. 2 ) in a row direction X and Y direction that is perpendicular to X, avertical scanning circuit 51, ahorizontal scanning circuit 52, and acontrol section 53. - The plurality of
photoelectric conversion elements 50 are disposed such that each line of the photoelectric conversion elements is configured by a plurality ofphotoelectric conversion elements 50 that are arranged in a row direction X, and n (n is a natural number of two or more) lines are arrayed in a column direction Y. As shown inFIG. 2 , it is referred to as line (1), line (2), line (3), . . . , line (n), in order from the bottom inFIG. 2 . - In each
photoelectric conversion element 50 included in theimaging element 5, a CMOS circuit, not shown, is provided corresponding to the vicinity thereof The CMOS circuit is, for example, a known three-transistor configuration or a known four-transistor configuration. - The
vertical scanning circuit 51 performs a driving which selects each line of the photoelectric conversion element, and reads out a signal to the signal output line from the CMOS circuit corresponding to the selected line. Further, thevertical scanning circuit 51 also performs a driving which controls a reset transistor of the CMOS circuit corresponding to each line to reset the accumulated charges in thephotoelectric conversion elements 50 in each line (a driving which discharges the accumulated charges in the photoelectric conversion elements to the drain of the reset transistor of the CMOS circuit). - The
horizontal scanning circuit 52 performs a driving which sequentially selects a signal for one line, that is output to the signal output line, to be output to the outside of theimaging element 5. - The
control section 53 controls thevertical scanning circuit 51 and thehorizontal scanning circuit 52, according to the instruction of thedevice control section 8. - Next, a description with respect to an action in a case of performing long time exposure imaging in the
imaging apparatus 100 configured in this manner will be made. Theimaging apparatus 100, in the case of long time exposure imaging, divides the set exposure time into a plurality of times and consecutively performs a plurality of times of short time exposure imaging. Then, theimaging apparatus 100 synthesizes a plurality of images obtained by a plurality of times of short time exposure imaging, so that theimaging apparatus 100 generates the image equivalent to when performing one time of imaging in the set exposure time. - Further, in the middle of imaging during long time exposure imaging, the
imaging apparatus 100 displays the image obtained at the time on thedisplay section 14 in real time. Accordingly, it is possible to confirm the image in the middle of imaging. Hereinafter, for example, a description of the action of theimaging apparatus 100 will be made when theimaging apparatus 100 performs fifteen seconds of short time exposure imaging four times and performs long time exposure imaging of which exposure time is 1 minute (for example, imaging that regards a moving object such as a star as a major object). -
FIG. 3 is a view illustrating a timing chart in a case of the long time exposure imaging of theimaging apparatus 100 shown inFIG. 1 . The parallelogram denoted as “exposure” refers to an exposure period of the short time exposure imaging, and the parallelogram between the exposure periods refers to a signal output period. - If there is an imaging instruction, the
control section 53 performs a rolling reset which resets each line of thephotoelectric conversion element 50 at a shifted timing, in thevertical scanning circuit 51. - In an example of
FIG. 3 , between from time t1 to time t2, the reset of thephotoelectric conversion element 50 is performed in order from line (1) toward line (n). In each line, at a time when the reset of the accumulated charge is terminated, an exposure of a first time of imaging is started. - If it becomes time t3 after a given time elapses from when the exposure of line (1) is started at time t1, the
control section 53 performs a rolling reading which reads out a signal according to an accumulated charge of thephotoelectric conversion element 50 at a shifted timing for each line ofphotoelectric conversion element 50 to the signal output line, in thevertical scanning circuit 51. - The signal for one line that is read out to the signal output line, is output to the outside of the
imaging element 5 by thehorizontal scanning circuit 52. In each line, at a time when the signal according to an accumulated charge of thephotoelectric conversion element 50 is read out from the CMOS circuit to the signal output line, the exposure of the first time of imaging is terminated. Further, in each line, at a time when the signal for one line that is read out to the signal output line, is output to the outside of theimaging element 5 by thehorizontal scanning circuit 52, the exposure of the first time of imaging is terminated. - In the example of
FIG. 3 , between from time t3 to time t5, the signal according to an accumulated charge of thephotoelectric conversion element 50 is read out to the signal output line in order from line (1) toward line (n). The signal for one line that is output to the signal output line, is output to theimaging element 5 in the order of output. - If the signal that is read out from the line (n) to the output signal line at time t5, is output to the outside of the imaging element 5 (if the first time of imaging is terminated in the entire line), the
image processing section 9 performs an image processing to the captured image signal obtained by the first time of imaging that is stored in thememory 10, generates the captured image data (1) and stores the captured image data (1) in thememory 10. - If the captured image data (1) is generated, the
encoder 15 converts the captured image data into data for display. Then,driver 13 displays an image based on the data for display (the first sheet of image shown inFIG. 3 ) on thedisplay section 14. - With respect to the line in which the exposure is terminated by the rolling reading started at time t3, at a time when the output of the signal to the outside of the
imaging element 5 in the line is terminated, thecontrol section 53 resets the accumulated charge of the photoelectric conversion element in the line in thevertical scanning circuit 51, and causes the exposure of the second time of imaging of the line to be started. In short, thecontrol section 53 causes the exposure of the second time of imaging in each line to be sequentially started by the rolling reset. - If it becomes the time when a given time elapses from time t4 when the exposure of the photoelectric conversion element of line (1) is started by rolling reset, the
control section 53 starts the rolling reading, and causes the exposure of the second time of imaging to be sequentially terminated in each line. - After the rolling reading is terminated, if the signal that is read out from the line (n) to the signal output line is output to the outside of the imaging element 5 (if the second time of imaging is terminated in entire lines), the
image processing section 9 performs an image processing to the captured image signal obtained by the second time of imaging that is stored in thememory 10, generates the captured image data (2) and stores the captured image data (2) in thememory 10. - Subsequently, the
image processing section 9 synthesizes the captured image data (1) that is generated with the first time of imaging and the captured image data (2) that is generated with the second time of imaging to generate the synthetic image data (1), and stores the synthetic image data (1) in thememory 10. - If the synthetic image data (1) is generated, the
encoder 15 converts the synthetic image data (1) into data for display. Then, thedriver 13 displays the synthetic image based on the data for display on the display section 14 (a synthetic image of two sheets of the captured image data shown inFIG. 3 (it is simply shown as two sheets of synthetic images in the drawing)). - The
control section 53 performs a rolling reset after the termination of the second time of imaging, and causes the exposure of the exposure of the third time of imaging to be sequentially started in each line. After that, thecontrol section 53 performs the rolling reading, and causes the exposure of the third time of imaging to be sequentially terminated in each line. - After the rolling reading is terminated, if the signal that is read out from the line (n) to the signal output line is output to the outside of the imaging element 5 (if the third time of imaging is terminated in entire lines), the
image processing section 9 performs an image processing to the captured image signal obtained by the third time of imaging that is stored in thememory 10, generates the captured image data (3) and stores the captured image data (3) in thememory 10. - Subsequently, the
image processing section 9 generates the synthesized image data (2) in which the synthesized image data (1) and the captured image data (3) are synthesized, and stores the synthetic image data (2) in thememory 10. - If the synthetic image data (2) is generated, the
encoder 15 converts the synthetic image data (2) into data for display. Then, thedriver 13 displays the synthetic image based on the data for display on the display section 14 (a synthetic image of three sheets of the captured image data shown inFIG. 3 (it is simply shown as three sheets of synthetic images in the drawing)). In addition, the synthetic image data (2) may be generated by synthesizing the captured image data (1) to (3). - After the third time of imaging is terminated, the
control section 53 performs the rolling reset and causes the exposure of the fourth time of imaging to be sequentially started in each line. After that, thecontrol section 53 performs the rolling reading and causes the exposure of the fourth time of imaging to be sequentially terminated in each line. - After the rolling reading is terminated, if the signal that is read out from the line (n) to the signal output line is output to the outside of the imaging element 5 (if the fourth time of imaging is terminated in entire lines), the
image processing section 9 performs an image processing to the captured image signal obtained by the fourth time of imaging that is stored in thememory 10, generates the captured image data (4) and stores the captured image data (4) in thememory 10. - Subsequently, the
image processing section 9 generates the synthesized image data (3) in which the synthesized image data (2) and the captured image data (4) are synthesized, and stores the synthetic image data (3) in thememory 10. - If the synthetic image data (3) is generated, the
encoder 15 converts the synthetic image data (3) into data for display. Then, thedriver 13 displays the synthetic image based on the data for display on the display section 14 (a synthetic image of four sheets of the captured image data shown inFIG. 3 (it is simply shown as four sheets of synthetic images in the drawing)). In addition, the synthetic image data (3) may be generated by synthesizing the captured image data (1) to (4). - After the synthetic image data (3) is generated, the
image processing section 9 records the synthetic image data (3) in thememory card 11 through amedia control section 12. If the synthetic image data (3) is recorded in thememory card 11, the long time exposure imaging is terminated. - In this manner, in a case of the long time exposure imaging, if the first time of imaging of a plurality of times of imaging that is continuously performed, is terminated, the
imaging apparatus 100 displays the image obtained by the imaging on thedisplay section 14. Further, if the second and subsequent imaging are terminated, theimaging apparatus 100 displays the synthetic image of the image obtained with the imaging and the image obtained with all imaging prior to the imaging on thedisplay section 14. - For this reason, in the middle of a plurality of times of imaging during long time exposure imaging, it is possible for the user of the
imaging apparatus 100 to confirm the image obtained in a case where the imaging is terminated at the time, on thedisplay section 14. Therefore, at a time when the image is not obtained as expected, it is possible to stop a long time exposure imaging and newly restart the long time exposure imaging, so there is no waste of time. Further, at a time when the image is obtained as expected, it is possible to terminate the long time exposure imaging, thereby shortening the time until the termination of the imaging. - Further, the
imaging apparatus 100 divides the long time exposure into a plurality of times of exposure and performs the exposure. For this reason, compare to a case of performing the long time exposure imaging in one time exposure it is easy to ensure a saturation capacity in each short time exposure imaging and it is possible to loosen the constraint condition such as an aperture value. Further, since each short time exposure imaging is a short exposure, it is possible to reduce the noise by that amount. - In addition, in a driving example of
FIG. 3 , the exposure start of entire imaging is regarded as performing a rolling reset and the exposure termination of entire imaging is regarded as performing a rolling reading. However, with consideration of an object to confirm the image in the middle of imaging, a driving method of a plurality of times of imaging is not limited to the driving method shown inFIG. 3 . - For example, as shown in
FIG. 4 , a driving method may be employed in which themechanical shutter 3 is opened by the exposure period of each of four times of imaging and the exposure start and the exposure termination in each imaging are equal in entire lines. - In a driving example shown in
FIG. 4 , thedevice control section 8 opens themechanical shutter 3 to cause the exposure of the first time of imaging to be started and closes themechanical shutter 3 to cause the exposure to be terminated. After the exposure termination, thedevice control section 8 performs the rolling reading to read the signal. If the output of the signal of the line (n) to the outside of the imaging element is terminated, thedevice control section 8 performs a global reset which simultaneously resets the accumulated charge of thephotoelectric conversion element 50 of the entire lines, and opens themechanical shutter 3 to cause the exposure of the next imaging to be started. Thedevice control section 8 repeats this driving. - In a case of employing a driving in
FIG. 4 , a signal output period after the termination of each exposure becomes longer than the driving shown inFIG. 3 . The signal output period is a period in which the exposure is not performed. For this reason, if the signal output period becomes long, as shown inFIG. 4 , in the synthetic image obtained in a case where the images of four sheets are synthesized, the main object is synthesized in a non-continuous form. In a case of the driving shown inFIG. 3 , it is possible to make the signal output period very small, thereby achieving a high quality of synthetic image. - Further, a driving may be employed in which the
imaging element 5 is a CCD (Charge Coupled Device) type, and using an electronic shutter or amechanical shutter 3, a plurality of times of imaging is consecutively performed. Also in this case, since the signal output period in the driving ofFIG. 4 becomes longer than the signal output period in the diving ofFIG. 3 , it is preferable to employ the driving shown inFIG. 3 in order to achieve a high quality of synthetic image. - In addition, in the above description, it was assumed that at a time when the last imaging is terminated among the four times of imaging, the synthetic image data (3) is recorded in the
memory card 11. However, for example, it may have a configuration such that in a case where there is an instruction to terminate an imaging in the middle of four times of imaging, when the instruction is made, the latest synthetic image data (in a case where only the first time of imaging is terminated, the captured image data (1)) stored in thememory 10 is recorded in thememory card 11. - Through this configuration, it is possible for the user to terminate the imaging at a time when the desired image is displayed on the
display section 14, and record the synthetic image data corresponding to the image while the user confirms thedisplay section 14. - Further, the
imaging apparatus 100 may record in thememory card 11 not only the synthetic image data but also entire captured image data that is generated at a time when there is an instruction to terminate an imaging or a plurality of times of imaging that is supposed is completely terminated. Since the entire captured image data is recorded, it is possible for the user to freely generate a favorite synthetic image data after imaging. - Further, it may be controlled in the
imaging apparatus 100 that among a plurality of times of imaging that is supposed in a case of the long time exposure imaging, the exposure start of the first time of imaging may be simultaneously controlled in all lines and the exposure termination of the last imaging may be simultaneously controlled in all lines. -
FIG. 5 is a timing chart illustrating a modification example of an operation in a case of the long time exposure imaging of theimaging apparatus 100 shown inFIG. 1 . Time t1 to t4 inFIG. 5 are the same as time t2 to t5 inFIG. 4 .FIG. 5 is different fromFIG. 3 in that when an imaging instruction is made, thecontrol section 53 causes thevertical scanning circuit 51 to perform a global reset which simultaneously resets the accumulated charge of the entire lines and causes the exposure of the first time of imaging to be simultaneously started in all lines. In addition,FIG. 5 is different fromFIG. 3 in that thedevice control section 8 performs four time of image through thecontrol section 53 in a state where themechanical shutter 3 opens and terminates simultaneously the exposure of the fourth time of imaging in all lines by the driving for closing the mechanical shutter. - As shown in
FIG. 5 , thecontrol section 53 performs the global reset in time t1 to cause the exposure of the first time of imaging to be started simultaneously in all lines. After that, thecontrol section 53 causes the second to fourth time of imaging to be performed by the rolling reading and the rolling reset. - Then, if it becomes time t6 after a given time elapses from when the exposure of the fourth time of imaging is started, the
device control section 8 closes themechanical shutter 3 to perform a driving to causes the exposure in the all lines to be simultaneously terminated. In time t6 and subsequent time, thecontrol section 53 performs the rolling reading to cause the fourth time of imaging to be terminated. - By performing the driving shown in
FIG. 5 , it is possible to cause the exposure start timing of the first time of imaging and the exposure termination timing of the fourth time of imaging to be matched in all lines. For this reason, in a case where the object is moving at high speed during the time when the fourth imaging is performed, the distortion does not occur in the synthetic image of the image obtained with the finally generated four imaging. Accordingly, it is possible to improve the image quality in a case of the long time exposure imaging. - In addition, in the driving shown in
FIG. 5 , the exposure start of the first time of imaging may be controlled by themechanical shutter 3. In this case, at a time when the imaging instruction is made, thedevice control section 8 may open themechanical shutter 3 to cause the exposure to be started simultaneously in all lines. - In addition, in a case of employing the driving shown in
FIG. 5 , in the first time of imaging and the fourth time of imaging, the exposure time does not made equal in all the signal output lines. For this reason, as shown inFIG. 6 , among the images obtained with the first to fourth imaging, unevenness in brightness (vertical unevenness) occurs toward the column direction Y in the first sheet of imaging obtained with the first time of imaging and the fourth sheet of imaging obtained with the fourth time of imaging. - Accordingly, it is preferable that with regard to the captured image data (1) generated after the termination of the first time of imaging and the captured image data (4) generated after the termination of the fourth time of imaging, the
image processing section 9 performs a processing to correct the unevenness in brightness after the data is generated to store the corrected data in thememory 10. - The processing to correct the unevenness in brightness adjusts the brightness of the other lines to the brightness of the brightest line (n) in a case of the captured image data (1), and adjusts the brightness of the other lines to the brightness of the brightest line (1) in a case of the captured image data (4). Through this processing, it is possible to make the image or the synthetic image displayed on the
display section 14 good during the imaging. - Further, even in a case of adopting any driving of
FIG. 3 ,FIG. 4 (including a case of being adapted to a CCD type), andFIG. 5 , in the image displayed on thedisplay section 14, the first sheet of image is darkest, next, it becomes brighter in order from the synthetic image of the captured image data of two sheets to the synthetic image of the captured image data of three sheets, and the synthetic image of the captured image data of four sheets is brightest. - Therefore, when the data for display is generated, it is preferable that the
encoder 15 performs a gain-up processing with respect to the original image such that the brightness of all data for display is identical to the brightness of data for display that is converted from the synthetic image data (3). - Specifically, if the number of the short time exposure imaging to be performed in a case of the long time exposure imaging is K and the number of the short time exposure imaging that has been finished in a case when any data for display is generated is L, the
encoder 15 performs a processing to make the generated data for display (K/L) times. - For example, in a case where K=4, as shown in
FIG. 7 , theencoder 15 performs a gain-up processing of making four times to the data for display (the original image) obtained by converting the captured image data (1). Further, theencoder 15 performs a gain-up processing of making twice to the data for display (the original image) obtained by converting the synthetic image data (1). Furthermore, theencoder 15 performs a gain-up processing of making three-fourths times to the data for display (the original image) obtained by converting the synthetic image data (2). Furthermore, theencoder 15 does not perform a gain-up processing or perform a gain-up processing of making one time to the data for display (the original image) obtained by converting the synthetic image data (3). - Through this processing, it is possible to confirm the finally obtained synthetic image and the image during the driving in the same brightness, thereby displaying the image in the conspicuous manner. The above processing and the processing to correct the unevenness in brightness may be combined to be performed.
- Further, even in a case of adopting any driving of
FIG. 3 ,FIG. 4 (including a case of being adapted to a CCD type), andFIG. 5 , the number of the short time exposure imaging that is set when long time exposure imaging is performed may be set manually by the user or automatically by theimaging apparatus 100. - For example, in a case where the set aperture value is equal to or less than the threshold value, the light receiving amount of the
imaging element 5 becomes big. For this reason, theimaging apparatus 100 performs a processing to shorten the time of the short time exposure to increase the number of the short time exposure imaging, in order for eachphotoelectric conversion element 50 of theimaging element 5 not to be saturated. Further, in a case where the set aperture value exceeds the threshold value, the light receiving amount of theimaging element 5 becomes small. For this reason, theimaging apparatus 100 performs a processing to lengthen the time of the short time exposure to reduce the number of the short time exposure imaging. - Hereinafter, a description of a modification example of the
imaging apparatus 100 will be made. -
FIG. 8 is a schematic plan view illustrating a modification example of theimaging element 5 installed in theimaging apparatus 100 shown inFIG. 1 . The configuration of the imaging apparatus is the same asFIG. 1 except for that theimaging element 5 is changed to theimaging element 5′ shown inFIG. 8 . - As shown in
FIG. 8 , theimaging element 5′ includes a first group having a plurality ofphotoelectric conversion elements 50 a, a second group having a plurality ofphotoelectric conversion elements 50 b, avertical scanning circuit 51 a and ahorizontal scanning circuit 52 a that are provided corresponding to the first group and avertical scanning circuit 51 b and ahorizontal scanning circuit 52 b that are provided corresponding to the second group. - The entire photoelectric conversion elements included in the
imaging element 5′ are disposed in a two-dimensional shape arranged in a column direction Y of a semiconductor substrate surface and in a row direction X perpendicular thereto. With regard to the entire photoelectric conversion elements, first lines configured by a plurality ofphotoelectric conversion elements 50 a arranged in the row direction X and second lines configured by a plurality ofphotoelectric conversion elements 50 b arranged in the row direction X are alternately arranged with a certain pitch in the row direction Y. Further, the first line is shifted and disposed relative to the second line in the row direction X by a half of the arrangement pitch in the row direction X for the photoelectric conversion elements of each line. - It is possible to obtain the above arrangement by disposing the
photoelectric conversion element 50 b in the position shifted in the direction of 45° inclination relative to eachphotoelectric conversion element 50 a that is disposed in a square lattice shape. - As shown in
FIG. 8 , the first line and the second line are respectively referred to as line (1), line (2), line (3), . . . , line (n), in order from the bottom inFIG. 8 . - The entire photoelectric conversion elements included in the
imaging element 5′ have approximately the same configuration (same values on the design). The approximately the same configuration means that the sizes of the photoelectric conversion regions (photodiodes) formed within the semiconductor substrates are approximately the same and the sizes of openings of the light shielding films formed above the photoelectric conversion regions are approximately the same. - In the entire photoelectric conversion elements included in the
imaging element 5′, a CMOS circuit, not shown, is provided corresponding to the vicinity thereof The CMOS circuit is, for example, a known three-transistor configuration or a known four-transistor configuration. - The
vertical scanning circuit 51 a performs a rolling reading which selects each one line of the first group from line (1) toward line (n), and reads out a signal to the signal output line from the CMOS circuit corresponding to the selected line. Further, thevertical scanning circuit 51 a also performs a rolling reset which resets the accumulated charges in thephotoelectric conversion elements 50 a of the first group in order from line (1) toward line (n) at a shifted timing. - The
horizontal scanning circuit 52 a performs a driving which sequentially selects a signal for one line of the first group, that is output to the signal output line, to be output to the outside of theimaging element 5′. - The
vertical scanning circuit 51 b performs a rolling reading which selects each one line of the second group from line (1) toward line (n), and reads out a signal to the signal output line from the CMOS circuit corresponding to the selected line. Further, thevertical scanning circuit 51 b also performs a rolling reset which resets the accumulated charges in thephotoelectric conversion elements 50 b of the second group in order from line (1) toward line (n) at a shifted timing. - The
horizontal scanning circuit 52 b performs a driving which sequentially selects a signal for one line of the second group, that is output to the signal output line, to be output to the outside of theimaging element 5′. - The
control section 53 controls thevertical scanning circuit horizontal scanning circuit device control section 8. - Next, a description with respect to an action in the case of performing long time exposure imaging in the
imaging apparatus 100 in which theimaging element 5′ is installed, will be made. Hereinafter, a description with respect to an action in the case of performing long time exposure imaging by performing eight short time exposure imaging will be made. -
FIG. 9 is a view illustrating a timing chart in a case of the long time exposure imaging of theimaging apparatus 100 in which theimaging element 5′ shown inFIG. 8 is installed. The parallelogram denoted as “exposure” refers to an exposure period in a case of the short time exposure imaging, and the parallelogram between the exposure periods refers to a signal output period. In addition, the exposure period of the short time exposure each has the same length. - If there is an imaging instruction, the
control section 53 performs a rolling reset in thevertical scanning circuit 51 a to reset the accumulated charge of thephotoelectric conversion element 50 a of the first group at a shifted timing for each line. In each line of the first group, at a time when the reset of the accumulated charge is terminated, the exposure is started (the start of the first time of short time exposure imaging). - If a given time (one third of the exposure time of the first time of short time exposure imaging in an example of
FIG. 9 ) elapses after the exposure is started in the line (1) of the first group, thecontrol section 53 performs the rolling reset in thevertical scanning circuit 51 b to reset the accumulated charge of thephotoelectric conversion element 50 a of the second group at a shifted timing for each line. In each line of the second group, at a time when the reset of the accumulated charge is terminated, the exposure is started (the start of the second time of short time exposure imaging). - If a given time (two thirds of the exposure time of the first time of short time exposure imaging in an example of
FIG. 9 ) elapses after the exposure is started in the line (1) of the second group, thecontrol section 53 performs the rolling reading in thevertical scanning circuit 51 a and reads out a signal according to an accumulated charge of thephotoelectric conversion element 50 a of the first group to the signal output line at a shifted timing for each line. The signal for one line read in the signal output line is output to the outside of theimaging element 5′ by thehorizontal scanning circuit 52 a. - In each line of the first group, at a time when the reading of the signal according to an accumulated charge of the
photoelectric conversion element 50 a from the CMOS circuit to the signal output line is terminated, the exposure is terminated. Further, in each line, at a time when all of the signal for one line that is read out to the signal output line, is output to the outside of theimaging element 5′ by thehorizontal scanning circuit 52 a, the first time of short time exposure imaging is terminated. - If the signals of all lines of the first group are output to the outside of the
imaging element 5′ (if the first time of short time exposure imaging is terminated), theimage processing section 9 performs an image processing to the captured image signal obtained by the first time of short time exposure imaging that is stored in thememory 10, generates the captured image data (1) and stores the captured image data (1) in thememory 10. - If the captured image data (1) is generated, the
encoder 15 converts the captured image data into data for display. Then,driver 13 causes an image based on the data for display (the first sheet of image shown inFIG. 9 ) to be displayed on thedisplay section 14. - After the imaging of the line (1) of the first group is terminated, the
control section 53 performs a rolling reset in thevertical scanning circuit 51 a to cause the next exposure to be sequentially started in each line, in the first group (the start of the third time of short time exposure imaging). - If it becomes the exposure termination timing of the line (1) of the second group, the
control section 53 performs a rolling reading in thevertical scanning circuit 51 b to read out a signal according to an accumulated charge of thephotoelectric conversion element 50 b of the second group to the signal output line at a shifted timing for each line. - In each line of the second group, at a time when the reading of the signal according to an accumulated charge of the
photoelectric conversion element 50 b from the CMOS circuit to the signal output line is terminated, the exposure is terminated. Further, in each line, at a time when all of the signal for one line that is read out to the signal output line, is output to the outside of theimaging element 5′ by thehorizontal scanning circuit 52 b, the second time of short time exposure imaging is terminated. - If the signals from all lines of the second group are output to the outside of the imaging element 5 (if the second time of short time exposure imaging is terminated), the
image processing section 9 performs an image processing to the captured image signal obtained by the second time of short time exposure imaging that is stored in thememory 10, generates the captured image data (2) and stores the captured image data (2) in thememory 10. - Subsequently, the
image processing section 9 synthesizes the captured image data (1) that is generated with the first time of short time exposure imaging and the captured image data (2) that is generated with the second time of short time exposure imaging to generate the synthetic image data (1), and stores the synthetic image data (1) in thememory 10. - If the synthetic image data (1) is generated, the
encoder 15 converts the synthetic image data (1) into data for display. Then, thedriver 13 causes the synthetic image based on the data for display to be displayed on the display section 14 (a synthetic image of two sheets of captured image data shown inFIG. 9 (it is simply shown as two sheets of synthetic images in the drawing)). - After the imaging of the line (1) of the second group is terminated (after the second time of short time exposure imaging is terminated), the
control section 53 performs the rolling reset in thevertical scanning circuit 51 b, and causes the next exposure to be sequentially started in each line, in the second group (the start of the fourth time of short time exposure imaging). - Hereinafter, in a similar flow, the following is sequentially performed: the rolling reading of the first group, the display of the synthetic image of the captured image data of three sheets, the rolling reset of the first group (the start of the fifth time of short time exposure imaging), the rolling reading of the second group, the display of the synthetic image of the captured image data of four sheets, the rolling reset of the second group (the start of the sixth time of short time exposure imaging), the rolling reading of the first group, the display of the synthetic image of the captured image data of five sheets, the rolling reset of the first group (the start of the seventh time of short time exposure imaging), the rolling reading of the second group, the display of the synthetic image of the captured image data of six sheets, the rolling reset of the second group (the start of the eighth time of short time exposure imaging), the rolling reading of the first group, the display of the synthetic image of the captured image data of seven sheets, the rolling reading of the second group, and the display of the synthetic image of the captured image data of eight sheets. Then, the synthetic image of the captured image data of eight sheets obtained with the eight times of short time exposure imaging is recorded in the
memory card 11, thus the long time exposure imaging is terminated. - In this manner, the imaging device of the modification example performs imaging using the first group with respect to the short time exposure imaging to be performed in an odd number of times and performs imaging using the second group with respect to the short time exposure imaging to be performed in an even number of times. Further, the imaging device shifts the start timings of the short time exposure in the imaging performed in the first group and the imaging performed in the second group, among a plurality of times of short time exposure imaging that is continuously performed in a case of the long time exposure imaging.
- In the timing chart of the second group shown in
FIG. 9 , the timing chart of the first group is indicated by the dashed line. In order to see and know the dashed line and the timing chart of the second group, the entire of the unexposed period (the signal output period) that occurs between short time exposure periods performed in the first group is included in each short time exposure period that is performed in the second group. In addition, the entire of the unexposed period (the signal output period) that occurs between short time exposure periods performed in the second group is included in each short time exposure period that is performed in the first group. For this reason, it is possible to eliminate the unexposed period that occur in a case of by dividing the long time exposure imaging into a plurality of times of the short time exposure imaging and performing the short time exposure imaging. - In order to eliminate the unexposed period, among two continuous short time exposure imaging, a plurality of times of short time exposure imaging may be performed such that the signal output period after the exposure termination of the former short time exposure imaging is included in the exposure period of the latter short time exposure imaging.
- Specifically, in a range of time of the signal output period after the exposure termination of each line of the previous short time exposure imaging or more and exposure time of each line of the previous short time exposure imaging or less among two continuous short time exposure imaging among a plurality of times of short time exposure imaging, the exposure start timing of each line of the latter short time exposure imaging may be shifted relative to the exposure start timing of the former short time exposure imaging.
- The unexposed period is eliminated in this manner, so that it is possible to make synthetic image data that is generated after termination of the second and subsequent short time exposure imaging not inferior to the image obtained with the first time of exposure, and realize high quality of long time exposure imaging.
- In addition, in the variation example, with respect to the data to be recorded in the
memory card 11, similarly to theimaging apparatus 100 shown inFIG. 1 , at least one of the captured image data and the synthetic image data generated at a time when the imaging termination instruction is made or a time when all of the short time exposure imaging is terminated may be recorded. - Further, the brightness control of the image displayed on the
display section 14 may be performed similarly to theimaging apparatus 100 shown inFIG. 1 . - Further, the driving shown in
FIG. 5 can be employed even in the driving shown inFIG. 9 . That is, as shown inFIG. 10 , the exposure start time t1 of the first time and second time of short time exposure imaging may be controlled by performing the global reset which simultaneously resets the accumulated charges in all lines of the first group and all lines of the second group, and the exposure termination time t2 of the seventh time and eighth time of short time exposure imaging may be controlled by performing the driving to close themechanical shutter 3. - In addition, as shown in
FIG. 11 , the driving shown inFIG. 9 can be modified to the driving in which the exposure period of the odd number of times of short time exposure imaging and the exposure period of the even number of times of short time exposure imaging are not overlapped with each other. - In the driving shown in
FIG. 11 , in a case of employing the driving shown inFIG. 5 (the driving to achieve no distortion of the image), the exposure start time of the first time of short time exposure imaging may be controlled by performing the global reset which simultaneously resets the accumulated charges in all lines of the first group and the exposure termination time of the eighth time of short time exposure imaging may be controlled by performing the driving to close themechanical shutter 3. With respect to the second time to seventh time of short time exposure imaging, the exposure start and the exposure termination timing may be controlled by the rolling reset and the rolling reading. - In this manner, the exposure start of at least the first time of short time exposure imaging out of the first time and the second time of short time exposure imaging is controlled by the global reset, and the exposure termination of at least the eighth time of short time exposure imaging out of the seventh time and the eighth time of short time exposure imaging is controlled by closing the
mechanical shutter 3. In this manner, with respect to the synthetic image data obtained by synthesizing eight captured image data obtained by eight times of the short time exposure imaging, each of the exposure start timing and the exposure termination timing are coincident in all images, and no distortion can be achieved even in the moving object. - In a case of employing the driving shown in
FIG. 10 , similarly to the case of employingFIG. 5 , the unevenness in brightness occurs in the column direction Y in the captured image data obtained with the first time and the second time of short time exposure imaging and the captured image data obtained with the seventh time and the eighth time of short time exposure imaging. For this reason, it is preferable that theimage processing section 9 correct the unevenness in brightness, similarly to the above description. - In addition, the number of the short time exposure imaging performed in the driving shown in
FIGS. 9 to 11 may also be determined according to the aperture value. - In the driving shown in
FIGS. 9 to 11 , it is necessary to set the same time from the start of the exposure of the first time of short time exposure imaging to the termination of the exposure of the eighth time of short time exposure imaging as the exposure time that is set for long time exposure imaging. - That is, if the exposure time for long time exposure imaging is determined, among a plurality of times of short time exposure imaging, the exposure start timing of the first short time exposure imaging and the exposure termination timing of the last short time exposure imaging are determined For this reason, the
device control section 8 may determine the number of the short time exposure imaging, in order for the unexposed period not to occur, in response to the aperture value, within the period from the start of the first short time exposure imaging to the termination of the last short time exposure imaging. - Further, in
FIGS. 8 to 11 , an odd number of times of short time exposure imaging is performed with the first group, but the odd number of times of short time exposure imaging may be performed in the second group and the even number of times of short time exposure imaging may be performed in the first group. - Further, the arrangement of the photoelectric conversion elements of the
imaging element 5′ may be the arrangement shown inFIG. 12 andFIG. 13 . -
FIG. 12 is a view illustrating a modification example of the imaging element shown inFIG. 8 . In the imaging element in the modification example, a plurality of photoelectric conversion elements are arranged in a square lattice shape, among the photoelectric conversion elements, the odd number of rows are set as thephotoelectric conversion elements 50 a and the even number of rows are set as thephotoelectric conversion elements 50 b. -
FIG. 13 is a view illustrating a modification example of the imaging element shown inFIG. 8 . The imaging element in the modification example has a configuration in which a plurality of photoelectric conversion elements are arranged in a square lattice shape, among the photoelectric conversion elements, thephotoelectric conversion elements 50 a are arranged in one checkered position and thephotoelectric conversion elements 50 b are arranged in another checkered position. - Even in the arrangements of the photoelectric conversion element shown in
FIG. 12 andFIG. 13 , since the correlation between the image captured with the first group and the image captured with the second group is high, by performing the driving described inFIGS. 9 to 11 , it is possible to achieve an effect to confirm the image during the long time exposure imaging, an effect to eliminate the distortion, and the like. - As described heretofore, the following is disclosed in the present specification.
- A disclosed imaging apparatus comprises: an imaging element; a display section; an imaging control section which causes the imaging element to perform a plurality of times of imaging; and a display control section which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- It is the disclosed imaging apparatus in which the imaging element is a MOS type including a plurality of lines of photoelectric conversion elements, further comprising: a mechanical shutter provided in a light incident side of the imaging element, in which the imaging element, in which in a case of the first time of imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing the rolling reset, and causes an exposure to be terminated by performing the rolling reading.
- It is the disclosed imaging apparatus in which the display control section causes an image of which unevenness due to a variation of an exposure time for each line in the first time of imaging is corrected to be displayed as the image obtained with the first time of imaging on the display section when the first time of imaging is terminated, and causes the synthetic image of which unevenness due to a variation of an exposure time for each line in the first time of imaging and unevenness due to a variation of an exposure time for each line in the last imaging are corrected to be displayed on the display section when the last imaging is terminated.
- It is the disclosed imaging apparatus in which with respect to an image to be displayed after imaging other than the last imaging among the plurality of times of imaging or the synthetic image, the display control section causes the image having further increased brightness than an original image to be displayed, and the smaller the implementation number of imaging other than the last imaging is, the higher an increased degree of the brightness is.
- It is the disclosed imaging apparatus in which the imaging element includes a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements, in which the imaging control section causes the first group to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, causes the second group to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and causes the imaging element to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- It is the disclosed imaging apparatus, further comprising: a mechanical shutter provided in a light incident side of the imaging element, in which the imaging element is a MOS type, in which in a case of at least a first time of imaging among the first time of imaging and subsequent imaging, among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line of the photoelectric conversion element, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in all the lines by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging and subsequent imaging, and at least the last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing the rolling reset, and causes an exposure to be terminated by performing the rolling reading.
- It is the disclosed imaging apparatus in which the display control section causes an image of which unevenness due to a variation of an exposure time for each line of the first group in the first time of imaging is corrected to be displayed as the image obtained with the first time of imaging on the display section when the first time of imaging is terminated, and causes the synthetic image of which unevenness due to a variation of an exposure time for each line of the first group in the first time of imaging and unevenness due to a variation of an exposure time for each line of the second group in the last imaging are corrected to be displayed on the display section when the last imaging is terminated.
- It is the disclosed imaging apparatus in which with respect to an image to be displayed after imaging other than the last imaging among the plurality of times of imaging or the synthetic image, the display control section causes the image having further increased brightness than an original image to be displayed, and the smaller an implementation number of imaging other than the last imaging is, the higher an increased degree of the brightness is.
- It is the disclosed imaging apparatus, further comprising: a captured image data generating section which generates captured image data using a captured image signal to be output from the imaging device with the imaging whenever each of the plurality of times of imaging is terminated; a synthetic image data generating section which generates synthetic image data obtained by synthesizing the captured image data that is generated with each of second and subsequent imaging and all imaging prior to each imaging, whenever each imaging is terminated; and a recording section which records the synthetic image data in a recording media, the synthetic image data being generated at a time when all of the plurality of times of imaging is terminated or an instruction to stop the plurality of times of imaging in the middle of the imaging is given.
- It is the disclosed imaging apparatus in which the imaging control section changes the number of times of the plurality of times of imaging according to an aperture value.
- A disclosed imaging apparatus comprises: a MOS type imaging element including a plurality of lines of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; a recording section which records the synthetic image data in a recording media; and a mechanical shutter provided in a light incident side of the imaging element, in which in a case of a first time of imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in all the line by closing the mechanical shutter, and in a case of the imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing the rolling reset, and causes an exposure to be terminated by performing the rolling reading.
- A disclosed imaging apparatus comprises: an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements; an imaging control section which causes the imaging element to perform a plurality of times of imaging; a synthetic image data generating section which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals that is output from the imaging element with the plurality of times of imaging; and a recording section which records the synthetic image data in a recording media, in which the imaging control section causes the first group to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, causes the second group to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and causes the imaging element to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- It is the imaging apparatus, further comprising: a mechanical shutter provided in a light incident side of the imaging element, in which the imaging element is a MOS type, in which in a case of at least a first time of imaging among the first time of imaging and subsequent imaging among the plurality of times of imaging, the imaging control section causes an exposure to be simultaneously started in each line of the photoelectric conversion element, and causes an exposure to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and causes an exposure to be simultaneously terminated in all the lines by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging, and subsequent imaging and at least the last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, the imaging control section causes an exposure to be started by performing the rolling reset, and causes an exposure to be terminated by performing the rolling reading.
- It is the disclosed imaging apparatus in which the imaging control section changes the number of times of the plurality of times of imaging according to an aperture value.
- A disclosed imaging method comprises: an imaging control step which causes an imaging element to perform a plurality of times of imaging; and a display control step which causes an image obtained with a first time of imaging to be displayed on the display section when the first time of imaging is terminated, and causes a synthetic image of an image obtained with each of second and subsequent imaging and an image obtained with all imaging prior to each of second and subsequent imaging among the plurality of times of imaging to be displayed on the display section whenever each of second and subsequent imaging is terminated.
- It is the disclosed imaging method in which the imaging element is a MOS type including a plurality of lines of photoelectric conversion elements, in which in the imaging control step, in a case of the first time of imaging among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion step at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in each line by closing the mechanical shutter provided in a light incident side of the imaging element, and in a case of the imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing the rolling reset, and an exposure is caused to be terminated by performing the rolling reading.
- It is the disclosed imaging method in which in the display control step, an image of which unevenness due to a variation of an exposure time for each line in the first time of imaging is corrected, is caused to be displayed as the image obtained with the first time of imaging on the display section when the first time of imaging is terminated, and the synthetic image of which unevenness due to a variation of an exposure time for each line in the first time of imaging and unevenness due to a variation of an exposure time for each line in the last imaging are corrected, is caused to be displayed on the display section when the last imaging is terminated.
- It is the disclosed imaging method in which in the display control step, with respect to an image to be displayed after imaging other than the last imaging among the plurality of times of imaging or the synthetic image, the image having further increased brightness than an original image is caused to be displayed, and the smaller an implementation number of imaging other than the last imaging is, the higher an increased degree of the brightness is.
- It is the disclosed imaging method in which the imaging element includes a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements, in which in the imaging control step, the first group is caused to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, the second group is caused to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and the imaging element is caused to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- It is the disclosed imaging method in which the imaging element is a MOS type, in which in the imaging control step, in a case of at least a first time of imaging among the first time of imaging and subsequent imaging, among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line of the photoelectric conversion step, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion step at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging and subsequent imaging, and at least the last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an exposure is caused to be started by performing the rolling reset, and an exposure is caused to be terminated by performing the rolling reading.
- It is the disclosed imaging method in which in the display control step, an image of which unevenness due to a variation of an exposure time for each line of the first group in the first time of imaging is corrected, is caused to be displayed as the image obtained with the first time of imaging on the display section when the first time of imaging is terminated, and the synthetic image of which unevenness due to a variation of an exposure time for each line of the first group in the first time of imaging and unevenness due to a variation of an exposure time for each line of the second group in the last imaging are corrected, is caused to be displayed on the display section when the last imaging is terminated.
- It is the disclosed imaging method in which in the display control step, with respect to an image to be displayed after imaging other than the last imaging among the plurality of times of imaging or the synthetic image, the image having further increased brightness than an original image is caused to be displayed, and the smaller an implementation number of imaging other than the last imaging is, the higher an increased degree of the brightness is.
- It is the disclosed imaging method, further comprising: a captured image data generating step which generates captured image data using a captured image signal to be output from the imaging device with the imaging whenever each of the plurality of times of imaging is terminated; a synthetic image data generating step which generates synthetic image data obtained by synthesizing the captured image data that is generated with each of second and subsequent imaging and all imaging prior to each imaging, whenever each imaging is terminated; and a recording step which records the synthetic image data in a recording medium, the synthetic image data being generated at a time when all of the plurality of times of imaging is terminated or an instruction to stop the plurality of times of imaging in the middle of the imaging is given.
- It is the imaging method, in which in the imaging control step, the number of times of the plurality of times of imaging is changed according to an aperture value.
- An disclosed imaging method comprises: an imaging control step which causes a MOS type imaging element including a plurality of lines of a photoelectric conversion element to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media; in which in the imaging control step, in a case of a first time of imaging among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in each line by closing the mechanical shutter, and in a case of the imaging other than the first time of imaging and the last imaging among the plurality of times of imaging, an exposure is caused to be started by performing the rolling reset, and an exposure is caused to be terminated by performing the rolling reading.
- A disclosed imaging method comprises: an imaging control step which causes an imaging element including a first group having a plurality of photoelectric conversion elements and a second group having a plurality of photoelectric conversion elements to perform a plurality of times of imaging; a synthetic image data generating step which generates synthetic image data by synthesizing a plurality of captured image data that is obtained by processing each of a plurality of captured image signals to be output from the imaging element with the plurality of times of imaging; and a recording step which records the synthetic image data in a recording media, in which in the imaging control step, the first group is caused to perform imaging with respect to an odd number of times of imaging among the plurality of times of imaging, the second group is caused to perform imaging with respect to an even number of times of imaging among the plurality of times of imaging, and the imaging element is caused to perform the plurality of times of imaging, such that in two consecutive imaging among the plurality of times of imaging, a period necessary for output of a signal obtained by an exposure of former imaging is included in an exposure period of latter imaging.
- It is the disclosed imaging method in which the imaging element is a MOS type, in which in the imaging control step, in a case of at least a first time of imaging among the first time of imaging and subsequent imaging, among the plurality of times of imaging, an exposure is caused to be simultaneously started in each line of the photoelectric conversion element, and an exposure is caused to be terminated by performing a rolling reading which reads out a signal corresponding to an accumulated charge of the photoelectric conversion element at a shifted timing for each line, in a case of at least last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an exposure is caused to be started by performing a rolling reset which resets the accumulated charge of the photoelectric conversion element at a shifted timing for each line, and an exposure is caused to be simultaneously terminated in all the lines by closing the mechanical shutter, and in a case of the imaging other than at least the first time of imaging among the first time of imaging and subsequent imaging, and at least the last imaging among the last imaging and immediately previous imaging, among the plurality of times of imaging, an exposure is caused to be started by performing the rolling reset, and an exposure is caused to be terminated by performing the rolling reading.
- It is the disclosed imaging method in which in the imaging control step, the number of times of the plurality of times of imaging is changed according to an aperture value.
- According to the present invention, it is possible to provide an imaging apparatus and an imaging method in which the user can confirm in real time an image that is being captured during long time exposure imaging. Further, according to the present invention, it is possible to provide an imaging apparatus and an imaging method in which high quality of long time exposure imaging can be simply performed.
- Although the present invention is described in detail or referring to a specific embodiment, it is obvious to those skilled in the art that many modification or variations can be made without departing from the spirit and the scope of the present invention.
- The application is based on Japanese application filed on 14th of September, 2010 (Japanese Patent Application No. 2010-206107) of which the content is incorporated herein by reference.
-
- 5 imaging element
- 8 device control section
- 13 driver
- 15 encoder
Claims (24)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010-206107 | 2010-09-14 | ||
JP2010206107 | 2010-09-14 | ||
PCT/JP2011/061559 WO2012035825A1 (en) | 2010-09-14 | 2011-05-19 | Imaging device and imaging method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/061559 Continuation WO2012035825A1 (en) | 2010-09-14 | 2011-05-19 | Imaging device and imaging method |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130194457A1 true US20130194457A1 (en) | 2013-08-01 |
US9185308B2 US9185308B2 (en) | 2015-11-10 |
Family
ID=45831308
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/801,880 Expired - Fee Related US9185308B2 (en) | 2010-09-14 | 2013-03-13 | Imaging apparatus and imaging method |
Country Status (4)
Country | Link |
---|---|
US (1) | US9185308B2 (en) |
JP (1) | JP5422745B2 (en) |
CN (1) | CN103109523B (en) |
WO (1) | WO2012035825A1 (en) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140168472A1 (en) * | 2012-12-18 | 2014-06-19 | Olympus Corporation | Image pickup device |
US20140192246A1 (en) * | 2013-01-04 | 2014-07-10 | Samsung Electronics Co., Ltd. | Digital photographing apparatus, method of controlling the same, and computer-readable recording medium |
US20150237247A1 (en) * | 2014-02-18 | 2015-08-20 | Sony Corporation | Information processing apparatus, information processing method, information processing system, and imaging apparatus |
EP2858348A4 (en) * | 2012-05-25 | 2016-04-06 | Sony Corp | Image sensor, drive method, and electronic device |
US10616496B2 (en) | 2012-12-27 | 2020-04-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10638051B2 (en) | 2012-12-27 | 2020-04-28 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10685413B2 (en) | 2013-10-22 | 2020-06-16 | ZocDoc, Inc. | System and method for accessing healthcare appointments from multiple disparate sources |
US10819428B2 (en) | 2016-11-10 | 2020-10-27 | Panasonic Intellectual Property Corporation Of America | Transmitting method, transmitting apparatus, and program |
US10951310B2 (en) | 2012-12-27 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Communication method, communication device, and transmitter |
US10951309B2 (en) | 2015-11-12 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Display method, non-transitory recording medium, and display device |
US11394900B1 (en) | 2020-05-07 | 2022-07-19 | Lux Optics Incorporated | Synthesizing intermediary frames for long exposure images |
US20220311922A1 (en) * | 2013-10-21 | 2022-09-29 | Gopro, Inc. | System and method for frame capturing and processing |
US11477391B1 (en) * | 2019-05-07 | 2022-10-18 | Lux Optics Incorporated | Generating long exposure images |
EP4027195A4 (en) * | 2019-09-03 | 2023-11-01 | Pashkovsky, Vladimir Eliich | Device for capturing a long exposure image |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6137936B2 (en) * | 2013-05-10 | 2017-05-31 | オリンパス株式会社 | Imaging device, image processing apparatus, and image correction method |
US9591195B2 (en) * | 2014-07-10 | 2017-03-07 | Intel Corporation | Platform architecture for accelerated camera control algorithms |
CN104113692B (en) * | 2014-07-22 | 2015-11-25 | 努比亚技术有限公司 | Image capturing method and device |
CN104125404B (en) * | 2014-08-06 | 2018-02-23 | 努比亚技术有限公司 | Movement locus of object image pickup method and system |
JP2016076869A (en) * | 2014-10-08 | 2016-05-12 | オリンパス株式会社 | Imaging apparatus, imaging method and program |
CN105208286A (en) * | 2015-10-15 | 2015-12-30 | 广东欧珀移动通信有限公司 | Photographing method and device for simulating low-speed shutter |
WO2019054031A1 (en) * | 2017-09-15 | 2019-03-21 | 富士フイルム株式会社 | Image capture control device, image capture device, image capture control method, and image capture control program |
US10796421B2 (en) * | 2018-02-13 | 2020-10-06 | Adobe Inc. | Creating selective virtual long-exposure images |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060157760A1 (en) * | 2005-01-04 | 2006-07-20 | Sony Corporation | Imaging apparatus and imaging method |
US20080044170A1 (en) * | 2006-08-16 | 2008-02-21 | Choon Hwee Yap | Image Capturing System And Method Of Operating The Same |
US20080122969A1 (en) * | 2006-11-27 | 2008-05-29 | Nokia Corporation | Determination of mechanical shutter exposure time |
US7386228B2 (en) * | 2004-12-15 | 2008-06-10 | Canon Kabushiki Kaisha | Image taking apparatus and image taking method |
US20090219425A1 (en) * | 2008-02-28 | 2009-09-03 | Hirokazu Kobayashi | Imaging apparatus and image signal processing method |
US20090251584A1 (en) * | 2005-12-07 | 2009-10-08 | Juha Alakarhu | Camera Unit and Method for Controlling an Image Sensor in a Camera Unit |
US20100123821A1 (en) * | 2008-11-18 | 2010-05-20 | Samsung Digital Imaging Co., Ltd. | Method and apparatus for controlling light emission of flash and digital photographing apparatus using the method and apparatus |
US20110122287A1 (en) * | 2009-11-25 | 2011-05-26 | Keiji Kunishige | Imaging device and imaging device control method |
US8081220B2 (en) * | 2007-07-03 | 2011-12-20 | Fujifilm Corporation | Digital still camera and method of controlling image combination |
US20120112039A1 (en) * | 2010-11-05 | 2012-05-10 | Renesas Electronics Corporation | Image sensor |
US20120327281A1 (en) * | 2011-06-21 | 2012-12-27 | Sony Corporation | Electronic apparatus and driving method therefor |
US20130113886A1 (en) * | 2011-11-07 | 2013-05-09 | Samsung Electronics Co., Ltd. | 3D Image Photographing Apparatus and Method |
US20130135506A1 (en) * | 2010-07-28 | 2013-05-30 | Fujifilm Corporation | Imaging apparatus and imaging method |
US20130208147A1 (en) * | 2010-09-27 | 2013-08-15 | Fujifilm Corporation | Imaging apparatus and imaging method |
US8848097B2 (en) * | 2008-04-07 | 2014-09-30 | Sony Corporation | Image processing apparatus, and method, for providing special effect |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4503892B2 (en) * | 2001-08-22 | 2010-07-14 | オリンパス株式会社 | Imaging device |
JP2005117395A (en) * | 2003-10-08 | 2005-04-28 | Konica Minolta Photo Imaging Inc | Imaging apparatus |
JP4268891B2 (en) | 2004-02-27 | 2009-05-27 | 京セラ株式会社 | Imaging apparatus and image generation method thereof |
KR101110009B1 (en) | 2004-02-27 | 2012-02-06 | 교세라 가부시키가이샤 | Imaging device and image generation method of imaging device |
EP1701536A1 (en) * | 2005-03-08 | 2006-09-13 | Sony Ericsson Mobile Communications AB | Method and device for creating pictures, using global shutter and multiple exposures |
JP4533252B2 (en) | 2005-06-09 | 2010-09-01 | キヤノン株式会社 | IMAGING DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM |
JP4618100B2 (en) * | 2005-11-04 | 2011-01-26 | ソニー株式会社 | Imaging apparatus, imaging method, and program |
JP4823743B2 (en) * | 2006-04-03 | 2011-11-24 | 三星電子株式会社 | Imaging apparatus and imaging method |
JP4743007B2 (en) | 2006-06-16 | 2011-08-10 | ソニー株式会社 | Image processing apparatus, image processing method, recording medium, and program |
-
2011
- 2011-05-19 JP JP2012533888A patent/JP5422745B2/en not_active Expired - Fee Related
- 2011-05-19 CN CN201180044343.2A patent/CN103109523B/en not_active Expired - Fee Related
- 2011-05-19 WO PCT/JP2011/061559 patent/WO2012035825A1/en active Application Filing
-
2013
- 2013-03-13 US US13/801,880 patent/US9185308B2/en not_active Expired - Fee Related
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7386228B2 (en) * | 2004-12-15 | 2008-06-10 | Canon Kabushiki Kaisha | Image taking apparatus and image taking method |
US20060157760A1 (en) * | 2005-01-04 | 2006-07-20 | Sony Corporation | Imaging apparatus and imaging method |
US20090251584A1 (en) * | 2005-12-07 | 2009-10-08 | Juha Alakarhu | Camera Unit and Method for Controlling an Image Sensor in a Camera Unit |
US20080044170A1 (en) * | 2006-08-16 | 2008-02-21 | Choon Hwee Yap | Image Capturing System And Method Of Operating The Same |
US20080122969A1 (en) * | 2006-11-27 | 2008-05-29 | Nokia Corporation | Determination of mechanical shutter exposure time |
US8081220B2 (en) * | 2007-07-03 | 2011-12-20 | Fujifilm Corporation | Digital still camera and method of controlling image combination |
US20090219425A1 (en) * | 2008-02-28 | 2009-09-03 | Hirokazu Kobayashi | Imaging apparatus and image signal processing method |
US8848097B2 (en) * | 2008-04-07 | 2014-09-30 | Sony Corporation | Image processing apparatus, and method, for providing special effect |
US20100123821A1 (en) * | 2008-11-18 | 2010-05-20 | Samsung Digital Imaging Co., Ltd. | Method and apparatus for controlling light emission of flash and digital photographing apparatus using the method and apparatus |
US20110122287A1 (en) * | 2009-11-25 | 2011-05-26 | Keiji Kunishige | Imaging device and imaging device control method |
US20130135506A1 (en) * | 2010-07-28 | 2013-05-30 | Fujifilm Corporation | Imaging apparatus and imaging method |
US20130208147A1 (en) * | 2010-09-27 | 2013-08-15 | Fujifilm Corporation | Imaging apparatus and imaging method |
US20120112039A1 (en) * | 2010-11-05 | 2012-05-10 | Renesas Electronics Corporation | Image sensor |
US20120327281A1 (en) * | 2011-06-21 | 2012-12-27 | Sony Corporation | Electronic apparatus and driving method therefor |
US20130113886A1 (en) * | 2011-11-07 | 2013-05-09 | Samsung Electronics Co., Ltd. | 3D Image Photographing Apparatus and Method |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2858348A4 (en) * | 2012-05-25 | 2016-04-06 | Sony Corp | Image sensor, drive method, and electronic device |
US20140168472A1 (en) * | 2012-12-18 | 2014-06-19 | Olympus Corporation | Image pickup device |
US10887528B2 (en) | 2012-12-27 | 2021-01-05 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US11165967B2 (en) | 2012-12-27 | 2021-11-02 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10616496B2 (en) | 2012-12-27 | 2020-04-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10638051B2 (en) | 2012-12-27 | 2020-04-28 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10666871B2 (en) | 2012-12-27 | 2020-05-26 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US11659284B2 (en) | 2012-12-27 | 2023-05-23 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10742891B2 (en) | 2012-12-27 | 2020-08-11 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US11490025B2 (en) | 2012-12-27 | 2022-11-01 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10951310B2 (en) | 2012-12-27 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Communication method, communication device, and transmitter |
US20140192246A1 (en) * | 2013-01-04 | 2014-07-10 | Samsung Electronics Co., Ltd. | Digital photographing apparatus, method of controlling the same, and computer-readable recording medium |
US20220311922A1 (en) * | 2013-10-21 | 2022-09-29 | Gopro, Inc. | System and method for frame capturing and processing |
US10685413B2 (en) | 2013-10-22 | 2020-06-16 | ZocDoc, Inc. | System and method for accessing healthcare appointments from multiple disparate sources |
US20150237247A1 (en) * | 2014-02-18 | 2015-08-20 | Sony Corporation | Information processing apparatus, information processing method, information processing system, and imaging apparatus |
US10951309B2 (en) | 2015-11-12 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Display method, non-transitory recording medium, and display device |
US10819428B2 (en) | 2016-11-10 | 2020-10-27 | Panasonic Intellectual Property Corporation Of America | Transmitting method, transmitting apparatus, and program |
US11477391B1 (en) * | 2019-05-07 | 2022-10-18 | Lux Optics Incorporated | Generating long exposure images |
EP4027195A4 (en) * | 2019-09-03 | 2023-11-01 | Pashkovsky, Vladimir Eliich | Device for capturing a long exposure image |
US11394900B1 (en) | 2020-05-07 | 2022-07-19 | Lux Optics Incorporated | Synthesizing intermediary frames for long exposure images |
US11910122B1 (en) | 2020-05-07 | 2024-02-20 | Lux Optics Incorporated | Synthesizing intermediary frames for long exposure images |
Also Published As
Publication number | Publication date |
---|---|
CN103109523A (en) | 2013-05-15 |
WO2012035825A1 (en) | 2012-03-22 |
CN103109523B (en) | 2016-06-15 |
JP5422745B2 (en) | 2014-02-19 |
JPWO2012035825A1 (en) | 2014-02-03 |
US9185308B2 (en) | 2015-11-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9185308B2 (en) | Imaging apparatus and imaging method | |
JP5215262B2 (en) | Imaging device | |
JP5161706B2 (en) | Imaging apparatus and control method thereof | |
JP5342969B2 (en) | Imaging apparatus and imaging method | |
US8390692B2 (en) | Image pick up apparatus and image pick up method capable of reading signal charge for image display by newly performing exposure while reading signal charge for still image by simultaneous exposure of all pixels | |
US8908064B2 (en) | Imaging apparatus and imaging method | |
JP6082274B2 (en) | Imaging apparatus and control method thereof | |
JP2012090118A (en) | Imaging element and imaging apparatus | |
JP5156148B2 (en) | Imaging apparatus and imaging method | |
JP7118893B2 (en) | Imaging device, imaging method, and electronic device | |
JP2010062638A (en) | Image capturing apparatus | |
JP5078458B2 (en) | Imaging apparatus, control method therefor, and imaging system | |
JP2019140648A (en) | Imaging apparatus and control method of imaging apparatus | |
JP7234015B2 (en) | Imaging device and its control method | |
JP5387167B2 (en) | Imaging device | |
JP5127510B2 (en) | IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD | |
JP2009296134A (en) | Imaging device | |
JP5343736B2 (en) | Digital camera | |
JP2012085013A (en) | Solid state image pickup device and imaging apparatus | |
JP2006140581A (en) | Imaging element and image input device | |
JP2008028757A (en) | Solid-state image pickup device and camera | |
JP2013005166A (en) | Imaging apparatus and image reproduction apparatus | |
JP2011077817A (en) | Imaging apparatus and imaging method | |
JP2007295082A (en) | Imaging apparatus | |
JP2010166159A (en) | Camera and method of correcting shake of the camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FUJIFILM CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TANAKA, SEIJI;REEL/FRAME:030000/0158 Effective date: 20130308 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20191110 |