JP2010068241A - Image sensor and image capturing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image sensor, or the like capable of preventing distortion occurring in an image from standing out at low costs when capturing an image of a moving object by an electronic rolling shutter. <P>SOLUTION: The image sensor 6 outputs an image signal according to exposure control by the rolling shutter. The image sensor 6 includes: a photoelectric conversion unit 21 at which a plurality of photoelectric conversion elements 22 are arranged in a matrix along the long and short sides in a rectangular region having the long and short sides, a timing generator 23 for reading a signal from the photoelectric conversion unit 21, a vertical scanning circuit 24, and a horizontal scanning circuit 25 with the long and short sides as horizontal and vertical scanning directions, respectively; and an amplifier 26, a CDS 27, and an ADC 28 that are disposed while being connected to terminals of respective arrangements in the horizontal scanning direction of the photoelectric conversion unit 21, and perform signal processing to the signal read by the photoelectric conversion unit 21. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging device and an imaging apparatus that output an image signal in accordance with exposure control by a rolling shutter.

  In recent years, CMOS type image sensors that have been increasingly mounted on image pickup apparatuses such as camera-equipped mobile phones, electronic cameras, and electronic video cameras use a so-called electronic rolling shutter (hereinafter simply referred to as “rolling shutter”) to generate images. Is to be read.

  Since this rolling shutter has a different read time, that is, exposure end time, for each line (or each pixel), it is known that if there is a moving subject, the image portion of the subject in one frame is distorted. .

  This point will be described with reference to the drawings. First, FIG. 37 is a diagram showing a configuration of a conventional CMOS type image sensor.

  The imaging element 106 includes a photoelectric conversion unit 121 in which a plurality of photoelectric conversion elements 122 are arranged in a matrix along a long side direction and a short side direction in a rectangular region having a long side and a short side. In FIG. 37, the photoelectric conversion unit 121 has a configuration in which the photoelectric conversion elements 122 are arranged in a vertical (vertical) 6 × horizontal (horizontal) 8, that is, a 6 × 8 pixel arrangement.

  The image sensor 106 includes a vertical scanning circuit 124 for selecting any horizontal line of the photoelectric conversion unit 121 and a horizontal scanning circuit 125 for selecting any vertical line of the photoelectric conversion unit 121. I have.

  Further, the image sensor 106 is connected to the end of each vertical line, and includes an amplifier 126, a CDS (Correlated Double Sampling) circuit 127, and an ADC (Analog / Digital Converter) 128. An LVDS (Low Voltage Differential Signaling) circuit 129 is connected.

  In addition, the image sensor 106 includes a vertical scanning circuit 124, a horizontal scanning circuit 125, and a timing generator 123 that outputs a synchronization signal to the LVDS 129.

  That is, the conventional image sensor 106 as shown in FIG. 37 reads signals from the photoelectric conversion unit 121 with the short side direction (vertical direction) as the main scanning direction and the long side direction (horizontal direction) as the sub scanning direction. It has become. Such a configuration has been used in image sensors for video cameras, since it has a high consistency with conventional television systems that draw on cathode ray tubes using scanning lines (electron beams). It continues to be mainstream.

  FIG. 38 is a diagram showing a state when a subject is imaged by the conventional image sensor 106 as described above.

  An optical image IOBJ of the subject OBJ is formed on the photoelectric conversion unit 121 of the image sensor 106 by the lens 103. The electric charge generated in each photoelectric conversion element 122 of the photoelectric conversion unit 121 by the formed optical image IOBJ is sub-scanned in the sub-scanning direction S that is the long side direction, and is read in the main scanning direction that is the short side direction. . Then, for example, the sub-scan is sequentially performed from the upper horizontal line in FIG. 38 toward the lower horizontal line.

  FIG. 39 is a diagram showing a state of image data 141 for one frame obtained when a subject moving in the horizontal direction is picked up by the conventional image pickup device 106 as described above.

  First, it is assumed that image data for one frame captured when the same subject is not moving is as shown in FIG. 9 according to the embodiment of the present invention. On the other hand, it is assumed that the optical image of the subject has moved horizontally from the right to the left in the image data 141 shown in FIG. When the sub-scan is sequentially performed from the upper horizontal line to the lower horizontal line in FIG. 39, the lower horizontal line than the position of the optical image of the subject when the upper horizontal line is exposed. That is, the position of the optical image of the subject when the image is exposed is moved to the left side. Therefore, a subject image 142 as shown in FIG. 39, that is, image data 141 in which a vertical line in the subject is drawn as an oblique line from the upper right to the lower left is obtained.

  Such distortion becomes less noticeable as the time required to read out image data for one screen from the image sensor becomes shorter (that is, the higher the reading speed), the higher the reading speed. Illustrating is one way to reduce distortion. However, the current fastest frame rate is about 30 to 60 fps in an image sensor with 6 million pixels, and it is not technically easy to achieve a higher frame rate with an image sensor with higher pixels. The degree of distortion that occurs varies depending on the moving speed of the subject, the distance from the imaging device to the subject, the focal length of the lens, the shutter speed, etc., so it is considered that visible distortion occurs at the current frame rate. There must be.

  A state in which distortion is generated in an image obtained by actual photographing will be described with reference to FIGS. 40 and 41 obtained by diagramming the outline of the image. 40 and 41 show a train approaching at a speed of about 50 km / h to 80 km / h by a conventional image sensor having a frame rate of 60 fps through a lens of 50 mm (value in terms of 35 mm film). The state of an image obtained by performing horizontal position shooting and vertical position shooting at a shutter speed of 1/4000 sec while panning at a shooting distance of about 2 m is shown.

  First, FIG. 40 is a diagram illustrating an example of image data obtained by photographing a train moving from the right direction to the left direction on the screen using the conventional imaging element 106 as described above.

  The degree to which the vertical line is imaged is determined by how much the optical image of the vertical line is horizontal on the image sensor 106 during the time of reading the entire screen (for example, time of about 1 frame rate). Depends on whether you move in the direction. Here, the train as the subject is traveling from the right hand to the left hand of the image. Therefore, the left window with respect to the traveling direction of the train is in front of the right window with respect to the traveling direction of the train (position close to the imaging device). Due to the difference in distance from the imaging device to the subject, the left window with respect to the traveling direction of the train is inclined relatively obliquely, whereas the right window with respect to the traveling direction of the train is inclined so much. It will not be. Furthermore, even if only the left window with respect to the traveling direction of the train is compared, the left window on the image is more inclined than the right window on the image because it is closer to the imaging device. As described above, it can be seen that even when the image sensor having the highest frame rate is used, visually noticeable distortion occurs in the subject image in the image obtained by photographing.

  Next, FIG. 41 is a diagram showing an example of image data obtained by photographing a train moving from the right direction to the left direction on the screen with the conventional image sensor 106 as described above in the vertical position.

  At this time, the main scanning direction matches the traveling direction of the train, and the vertical line matches the sub-scanning direction. Therefore, if the vertical line is sufficiently thin, it will be read out by sub-scanning of one line, and will not be inclined. However, the portion of the train that is closer to the imaging device extends more in the traveling direction of the train. That is, the image distortion occurs in the same manner in both the vertical position shown in FIG. 41 and the horizontal position shown in FIG. 40, but in the case of the vertical position, the image is not inclined obliquely. Distortion is inconspicuous.

  However, when imaging a moving subject (particularly a subject that moves at high speed), in many cases, shooting (for example, panning) is performed with the imaging device so that the moving direction of the subject is in the longitudinal direction of the screen. This is because if the imaging device is set so that the moving direction of the subject is the short direction of the screen, the chance of capturing the subject in the screen is reduced. Therefore, the conventional image sensor cannot solve the problem that distortion occurs when the image is taken in the horizontal position and a photo opportunity is missed when the image is taken in the vertical position. In addition, since the human eyes are in the horizontal left and right positions on the face, it is more natural to observe a horizontally long screen than a vertically long screen, and it is natural to dispose the image sensor vertically in the image pickup apparatus. Contrary to proper arrangement. In particular, when the imaging device is a digital camera, the housing is often configured to be held in a landscape orientation so as to intuitively match the shape (aspect ratio) of the imaging device. . Accordingly, it is difficult to intuitively say that it is intuitively natural to dispose only the image sensor in the horizontally long casing.

  In a single-lens reflex type camera, a mechanical shutter having a high curtain speed is used to prevent such distortion from occurring. That is, the curtain speed of the mechanical shutter is approximately the sync speed, and generally corresponds to approximately 125 fps to 300 fps when converted into the frame rate of the image sensor (for example, 200 fps if the shutter aperture is crossed at 5 msec). ). Therefore, it is advantageous from the viewpoint of reducing dynamic distortion to use a mechanical shutter that is mounted on a digital single-lens reflex camera.

  However, in order to obtain a high curtain speed, it is necessary to use a spring having a large spring constant as the shutter spring. At this time, for example, a powerful motor is required to charge the spring, or a large structure is required to cope with a high load, so that the camera is enlarged. In addition, it takes time to charge the spring and consumes a large amount of power during continuous shooting (for example, 35 W or more when 10 fps continuous shooting is achieved), which consumes the battery. . Thus, in continuous shooting using a mechanical shutter, the upper limit is a frame rate of about several fps to several tens of fps per second, and it is difficult to achieve high-speed continuous shooting beyond that. Therefore, even when trying to continuously shoot a plurality of still images at a high speed, as in the case of shooting a moving image, leave the mechanical shutter open and use the rolling shutter of the image sensor. It is desirable to do so. Further, the rolling shutter of the image sensor has an advantage that it can be applied to a compact type camera, a mobile phone with a camera, and the like.

  Therefore, for example, in Japanese Patent Application Laid-Open No. 2006-54788, in an imaging apparatus equipped with a CMOS type imaging device, a motion vector of a subject is detected, and a main scanning direction (and a direction corresponding to the direction of the detected motion vector (and By changing the (sub-scanning direction), the dynamic distortion phenomenon peculiar to the rolling shutter as described above is avoided.

  The configuration of an image sensor as described in Japanese Patent Laid-Open No. 2006-54788 will be described with reference to FIG. FIG. 42 is a diagram illustrating a configuration of the image sensor 106A configured to be able to switch between the horizontal direction and the vertical direction as the main scanning direction.

  The imaging element 106A includes a photoelectric conversion unit 121 in which a plurality of photoelectric conversion elements 122 are arranged in a rectangular area, a vertical scanning circuit 124 for selecting any horizontal line of the photoelectric conversion unit 121, and a photoelectric conversion unit. A horizontal scanning circuit 125 for selecting any one of the vertical lines 121, and a timing generator 123 that outputs a synchronization signal to the vertical scanning circuit 124 and the horizontal scanning circuit 125 are provided.

  Furthermore, the image sensor 106A includes a vertical main scanning output unit 131 connected to the end of each vertical line, and a horizontal main scanning output unit 132 connected to the end of each horizontal line.

  When it is detected that the subject is moving in the vertical direction, driving is performed so that the vertical direction becomes the main scanning direction, and signal reading is performed via the output unit 131 during vertical main scanning. Is called. When it is detected that the subject is moving in the horizontal direction, driving is performed so that the horizontal direction becomes the main scanning direction, and the signal is read out via the output unit 132 during horizontal main scanning. Is called.

  In addition, an amplifier 126A, a CDS 127A, and an ADC 128A are provided outside the image sensor 106A so as to be connected to the output of the image sensor 106A, and the signal readout is performed during the vertical main scan time output unit 131 and the horizontal main scan time. Regardless of whether the output is performed with the output unit 132, the signal processing is performed via these.

By the way, the current CMOS type image sensor has an analog amplifier (column amplifier) connected to the end of each column (each vertical line) in the main scanning direction in order to increase the S / N ratio in the image sensor. In addition, in order to increase the speed, a column ADC is generally provided so as to be connected to the subsequent stage of the column amplifier for each column (see the configuration shown in FIG. 37).
JP 2006-54788 A

  However, the configuration described in Japanese Patent Application Laid-Open No. 2006-54788 does not consider the arrangement of amplifiers and ADCs for reducing such noise, so that the noise is considered to be large as it is. Therefore, an amplifier, a CDS, and an ADC are further provided in the imaging device having the configuration described in the publication so as to be connected to the end of each vertical line, and connected to the end of each horizontal line. Thus, it is conceivable to arrange an amplifier, a CDS, and an ADC. However, if such a configuration is adopted, the configuration of the image sensor becomes complicated, and the size of the image sensor increases, leading to high costs.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an image pickup device capable of making distortion generated in an image portion of a moving subject inconspicuous at low cost due to imaging using a rolling shutter. An object is to provide an imaging device.

  In order to achieve the above object, an image sensor according to a first aspect of the present invention is an image sensor that outputs an image signal in accordance with exposure control by a rolling shutter, and is within a rectangular region having a long side and a short side. A plurality of photoelectric conversion elements arranged in a matrix along the long side direction and the short side direction, the long side direction as a main scanning direction and the short side direction as a sub scanning direction, A scanning circuit that reads a signal from the photoelectric conversion unit, and is connected to the end of each array in the main scanning direction of the photoelectric conversion unit, and a predetermined signal with respect to the signal read from the photoelectric conversion unit And a signal processing circuit for performing processing.

  An image pickup apparatus according to a second aspect of the present invention is an image pickup apparatus including the image pickup element according to the first aspect, wherein the main scanning direction is parallel to a horizontal direction in a normal shooting posture of the image pickup apparatus. The image sensor is arranged so that the sub-scanning direction is parallel to the vertical direction in the normal photographing posture of the imaging apparatus.

  Furthermore, an imaging device according to a third aspect of the present invention is a rectangular area configured by an imaging element according to the first aspect and a subject to be imaged by the imaging element, having a long side and a short side. An imaging device comprising: a display unit for observing in which the main scanning direction is parallel to the long side direction of the rectangular region, and the sub-scanning direction is the short side of the rectangular region The imaging element is arranged so as to be parallel to the direction.

  An imaging device according to a fourth aspect of the present invention includes an imaging device according to the first aspect, a storage unit that stores at least one frame of moving image data that is sequentially read from the imaging device in units of frames, and the storage unit From the storage unit, a reading control unit that controls the stored frame image data to be read in an order in which the short side direction of the image sensor is the main scanning direction and the long side direction of the image sensor is the sub-scanning direction; A moving image display unit that displays a moving image based on the read frame image data.

  According to the imaging device and the imaging apparatus of the present invention, it is possible to make distortion generated in an image portion of a moving subject due to imaging using a rolling shutter inconspicuous at low cost.

  Embodiments of the present invention will be described below with reference to the drawings.

[Embodiment 1]
1 to 36 show Embodiment 1 of the present invention, and FIG. 1 is a block diagram showing a configuration of an imaging apparatus.

  The imaging apparatus 1 includes a lens barrel 2 having a lens 3 and a diaphragm 4, a shutter 5, an imaging element 6, a memory 7 as a storage unit, an image processing unit 8, a memory card 9, and a display unit 10. And a control unit 11 including an image analysis unit 11a, an operation unit 12, and a battery 13.

  The lens barrel 2 is configured to be exchangeable via a bayonet mount or the like, for example. Therefore, it is possible to replace the lens barrel 2 with the lens 3 having another focal length. However, it goes without saying that the lens barrel 2 may be of a type fixed to the imaging device 1.

  The lens 3 is for forming an optical image of a subject on the photoelectric conversion unit 21 (see FIG. 2) of the image sensor 6. The lens 3 includes a focus lens for performing focus adjustment.

  The diaphragm 4 is for adjusting the brightness of the subject image formed on the image sensor 6 by defining the passing range of the subject luminous flux from the lens 3 toward the image sensor 6.

  The shutter 5 is for controlling the time during which the subject light flux from the lens 3 irradiates the image sensor 6. The shutter 5 is configured as a mechanical shutter such as a focal plane shutter. In the present embodiment, the shutter 5 is used when capturing a still image in the single image capturing mode. On the other hand, when capturing a still image in the continuous shooting mode and when capturing a moving image in the moving image shooting mode, the shutter 5 is kept open, and each still image or each frame image is captured using the rolling shutter. Is supposed to be done.

  The image sensor 6 is configured as an image sensor that outputs an image signal according to exposure control by a rolling shutter, such as a CMOS sensor. Here, the rolling shutter is a time-series or line-by-pixel basis for reading out signals from a plurality of photoelectric conversion elements 22 (see FIG. 2) arranged in the photoelectric conversion unit 21 (see FIG. 2). Reads data in units of time series. Therefore, the timing at which each photoelectric conversion element 22 is reset may be the same for all pixels, or may be time-series for each pixel or time-series for each line. That is, the name “rolling shutter” is not restricted by the timing at which each photoelectric conversion element 22 is reset.

  The memory 7 is configured as a frame memory for storing a moving image output from the image sensor 6 for at least one frame. Due to the structure of the image sensor 6 as will be described later, the order in which frame images are written in the memory 7 and the order in which frame images are read from the memory 7 are controlled to be different.

  The image processing unit 8 performs various kinds of image processing on the still image output from the image sensor 6 and the moving image output via the memory 7. The image processing unit 8 is also configured to process an image read from the memory card 9.

  The memory card 9 is a recording medium for recording a still image or a moving image processed for recording by the image processing unit 8. Since the memory card 9 is configured to be detachable from the imaging device 1, the memory card 9 may not have a configuration unique to the imaging device 1.

  The display unit 10 displays a still image or a moving image processed for display by the image processing unit 8. That is, the display unit 10 also serves as a moving image display unit.

  The control unit 11 comprehensively controls the inside of the imaging apparatus 1 including the lens barrel 2, the shutter 5, the imaging device 6, the memory 7, and the image processing unit 8, and an input signal from the operation unit 12 is also received. It is supposed to receive. That is, the control unit 11 functions as a lens driving unit, and controls the focus lens of the lens 3 to perform focusing. The control unit 11 functions as an aperture control unit, and controls the aperture 4 based on the exposure value. Furthermore, the control unit 11 functions as a shutter drive unit, and controls the shutter 5 according to whether the imaging device 1 is set to a single image shooting mode, a continuous shooting mode, or a moving image shooting mode. Further, the control unit 11 functions as an image sensor driving unit, performs exposure control using a rolling shutter, and outputs an image signal from the image sensor 6. The control unit 11 functions as a read control unit, and controls the memory 7 so that the writing order (see arrow W in FIG. 1) and the reading order (see arrow R in FIG. 1) are different. In addition, the control unit 11 controls image processing by the image processing unit 8. Further, the image analysis unit 11 a included in the control unit 11 analyzes the image as described later while controlling the image processing unit 8, and acquires information on the operation state of the shutter 5. That is, the control part 11 functions also as a running characteristic test part.

  The operation unit 12 is for performing various operation inputs to the imaging apparatus 1. The operation unit 12 includes a power switch for turning on / off the power of the imaging apparatus 1, a release switch 35 (see FIG. 4) for inputting an image capturing instruction, and an operation mode of the imaging apparatus 1 as a single image capturing mode. , A mode setting switch for setting the continuous shooting mode, the moving image shooting mode, and the like. Here, the release switch 35, for example, captures a still image when pressed once in the single image shooting mode, continuously captures a plurality of still images under the pressed state in the continuous shooting mode, and performs the first time in the moving image shooting mode. It is used to start shooting a moving image by pressing and to end shooting a moving image by pressing the second time.

  The battery 13 is a power supply source of the imaging device 1.

  Next, FIG. 2 is a diagram illustrating a configuration example of the image sensor 6. In FIG. 2, for simplification, the photoelectric conversion unit 21 has a configuration in which the photoelectric conversion elements 22 are arranged in a vertical (vertical) 6 × horizontal (horizontal) 8, that is, a 6 × 8 pixel arrangement. It is shown.

  The image pickup device 6 includes a photoelectric conversion unit 21 including a plurality of photoelectric conversion elements 22, a timing generator 23, a vertical scanning circuit 24, a horizontal scanning circuit 25, an amplifier 26, and a CDS (Correlated Double Sampling (Correlated Double Sampling). A sampling circuit) 27, an ADC (analog / digital converter) 28, and an LVDS (Low Voltage Differential Signaling) circuit 29.

  The photoelectric conversion unit 21 includes a plurality of photoelectric conversion elements 22 arranged in a matrix along a long side direction and a short side direction in a rectangular region having a long side and a short side.

  The vertical scanning circuit 24 is for selecting any horizontal line of the photoelectric conversion unit 21.

  Further, the horizontal scanning circuit 25 is for selecting any vertical line of the photoelectric conversion unit 21.

  The amplifier 26, the CDS 27, and the ADC 28 are signal processing circuits that are respectively connected to the ends of the horizontal lines. The amplifier 26 is an amplifier circuit that amplifies the analog signal output from the photoelectric conversion element 22. The CDS 27 is a circuit for removing reset noise and the like from the analog signal output from the photoelectric conversion element 22. The ADC 28 is an A / D conversion circuit for converting an analog signal processed by the CDS 27 into a digital signal.

  The LVDS 29 is a signal processing circuit provided in connection with the ADC 28 provided for each horizontal line.

  The timing generator 23 constitutes a scanning circuit and outputs a synchronization signal to the vertical scanning circuit 24 and the horizontal scanning circuit 25.

  As described above, the image pickup device 6 as shown in FIG. 2 of the present embodiment has the long side direction (horizontal direction) as the main scanning direction and the short side direction (vertical direction) as the sub scanning direction from the photoelectric conversion unit 21. The signal is read out. This reading is performed under the control of the timing generator 23, the vertical scanning circuit 24, and the horizontal scanning circuit 25. As a result, the photoelectric conversion elements 22 arranged on the vertical line are read out at the same time, so that even if a vertical line in the subject is imaged, an image of an oblique line is not obtained. And since the image pick-up element 6 amplifies the read signal internally and removes the noise before outputting it, it is also possible to reduce the noise.

  Since such a configuration does not match the conventional television system that draws on a cathode ray tube using scanning lines, a memory 7 is provided as shown in FIG. The order of reading from the memory 7 is changed to match the television system. That is, when writing to the memory 7, writing is performed so as to match the reading order of the image sensor 6, that is, in the order of the first column, the second column, the third column,. ing. On the other hand, when reading from the memory 7, the reading is performed in the order of the first row, the second row, the third row,.

  By performing such processing corresponding to the change in the main scanning direction, there is an advantage that subsequent image processing or the like can be performed by an image processing circuit similar to the conventional one.

  In addition, since it is not necessary to perform such a process for the still image, the image is output from the image sensor 6 to the image processing unit 8 without going through the memory 7. However, the present invention is not limited to this, and a process corresponding to a change in the main scanning direction may be performed on a still image as well as a moving image.

  Next, FIG. 3 is a diagram illustrating another configuration example of the image sensor 6. In FIG. 3 as well, for the sake of simplicity, the photoelectric conversion unit 21 has a configuration in which the photoelectric conversion elements 22 are arranged in a vertical (vertical) 6 × horizontal (horizontal) 8, that is, a 6 × 8 pixel arrangement. It is shown.

  The image pickup device 6 is configured in substantially the same manner as the image pickup device 6 shown in FIG. 2, but a multiplexer 31 is provided after the CDS 27 and before the ADC 28, and the number of ADCs 28 is the number shown in FIG. It differs from the element 6 in that the LVDS 29 is omitted.

  In the example shown in FIG. 3, the outputs are three systems of A, B, and C, and the signal is selected by the multiplexer 31, so that the output A includes, for example, pixel 1, pixel 4, pixel 7, From the output B, for example, in the order of pixel 2, pixel 5, pixel 8, pixel 11,..., From the output C, for example, in order of pixel 3, pixel 6, pixel 9, pixel 12,. Then, each signal is output.

  By adopting such a configuration, there is an advantage that the ADC 28 is not provided for each row, but the number of rows can be reduced to a fraction of the number of rows.

  Next, the arrangement of the image pickup device 6 in the image pickup apparatus 1 will be described with reference to FIGS. 4 and 5. 4 is a perspective view showing the arrangement of the image pickup element 6 in the image pickup apparatus 1 from the front side, and FIG. 5 is a perspective view showing the arrangement of the image pickup element 6 in the image pickup apparatus 1 from the back side. In FIGS. 4 and 5, the case where the imaging device 1 is a digital camera is illustrated as an example.

  As shown in FIG. 4, a lens barrel 2 including a lens 3 protrudes from the center of the front side of the imaging device 1. A release switch 35 is disposed on the left side of the upper surface of the imaging device 1 in FIG. 4 at a position where the imaging device 1 can be pressed with the index finger of the right hand when the imaging device 1 is held with the right hand. Further, the housing of the imaging device 1 is configured to be horizontally long (a shape that is longer in the horizontal direction than in the vertical direction) as a whole in a normal shooting posture as shown in FIGS. 4 and 5. .

  Subsequently, as illustrated in FIG. 5, a display unit 10 is disposed in the center on the back side of the imaging device 1. The display unit 10 includes a rectangular display area composed of long sides and short sides, and includes a display element such as an LCD arranged so that the long side direction is a horizontal direction in a normal photographing posture. It consists of Further, a finder 36 constituted by an optical finder, an electronic view finder, or the like is disposed above the display unit 10 on the back side of the imaging device 1. The field of view by the finder 36 is to observe a subject to be imaged in a rectangular area composed of long sides and short sides. Here, the finder 36 is disposed so that the long side direction of the field of view is the horizontal direction in a normal photographing posture. The viewfinder 36 is also a kind of display unit.

  The image sensor 6 has a long side direction, which is the main scanning direction (shown as an arrow M in FIG. 1), parallel to the horizontal direction in the normal photographing posture of the image capturing apparatus 1 and the sub scanning direction (FIG. 1, FIG. 1). 4 (shown as an arrow S in FIG. 5, etc.) is arranged so as to be parallel to the vertical direction in the normal photographing posture of the imaging apparatus 1.

  In addition, the image sensor 6 has a long side direction that is the main scanning direction parallel to the long side direction of the rectangular region of the display unit 10 or the finder 36 and the short side direction that is the sub-scanning direction is the display unit. 10 or the finder 36 is arranged so as to be parallel to the short side direction of the rectangular region.

  Next, FIG. 6 is a diagram illustrating a state in which the parallel light uniform irradiator for inspecting the shutter 5 is attached to the imaging apparatus 1.

  As will be described later, the parallel light uniform irradiator is used to irradiate the photoelectric conversion unit 21 of the image sensor 6 with uniform in-plane illuminance when inspecting the curtain running characteristics of the shutter 5. It has become. In this parallel light uniform irradiator, for example, a point light source 39 including a cover 38 for blocking external light is installed at the front focal position of a lens barrel 2A including a lens 3 having a long focal length (for example, 400 mm or more). Consists of. However, the present invention is not limited to this, and a collimator may be used as a parallel light uniform irradiator.

  Here, in the case of using a parallel light uniform irradiator configured as shown in FIG. 6, it is preferable that the diaphragm 4 provided in the lens barrel 2A is narrowed by about two stages rather than open. Thereby, the in-plane illuminance on the image sensor 6 can be made substantially uniform while preventing the peripheral light amount from being insufficient.

  In order to inspect the shutter 5, the signal value of the portion irradiated with light is higher than the middle of the dynamic range of the image sensor 6, and the signal value of the portion not irradiated with light is in the dynamic range of the image sensor 6. It is desirable to be lower than the middle (because both are close to the upper limit of the dynamic range, or when both are close to the lower limit of the dynamic range, it is more difficult to detect a difference in luminance. ). Further, among the inspection items to be described later regarding the shutter 5, an exposure slit generated when the shutter 5 constituted by a focal plane shutter is driven at a sync speed or higher is necessary. The width of the exposure slit is as narrow as possible. Is desirable to improve inspection accuracy. Therefore, in this case, the shutter 5 is driven at the fastest shutter speed.

  As a specific example, when the maximum shutter speed is 1/8000 second, in order for the signal value of the portion irradiated with light to be higher than the middle of the dynamic range of the image sensor 6, for example, the shutter speed is doubled. That is, it is preferable that proper exposure is obtained at a shutter speed of 1/16000 seconds. Although it is desirable that the luminance of the point light source 39 matches this condition, if it does not match, it is better to adjust the imaging sensitivity to meet the condition.

  Next, FIG. 7 is a diagram showing the relationship among the subject OBJ, the lens 3, and the subject optical image IOBJ on the image sensor 6. The configuration shown in FIG. 7 corresponds to when the shutter 5 is opened (for example, the above-described continuous shooting mode, moving image shooting mode, etc.) or when the imaging device 1 is not provided with the shutter 5. Yes.

  FIG. 8 is a diagram showing the relationship among the subject OBJ, the lens 3, the shutter 5, and the subject optical image IOBJ on the image sensor 6. The configuration shown in FIG. 8 corresponds to when the shutter 5 is used (for example, the above-described single image shooting mode).

  7 and 8, an arrow S indicates the sub-scanning direction of the image sensor 6, and a point ST indicates the position of the scanning start point.

  As shown in the figure, the optical image IOBJ of the subject OBJ imaged on the image sensor 6 by the lens 3 is an inverted image.

  Images obtained by photographing the subject in the arrangement shown in FIG. 7 or 8 by the imaging device 6 having the configuration shown in FIG. 2 or 3 will be described with reference to FIGS. FIG. 9 is a diagram showing an image obtained by photographing a stationary subject, and FIG. 10 is a diagram showing an image obtained by photographing an object moving in the same direction as the main scanning direction. FIG. 11 is a diagram showing a state of an image obtained by photographing a subject moving in a direction parallel to and opposite to the main scanning direction.

  Assume that a subject image 42 as shown in FIG. 9 is captured in an image 41 obtained when a still subject is photographed.

  On the other hand, the optical image of the subject moving in the same direction as the main scanning direction moves on the photoelectric conversion unit 21 of the image sensor 6 in a direction parallel to and opposite to the main scanning direction. (See also FIGS. 7 and 8). Accordingly, since the number of vertical lines to be exposed with the subject light image is smaller than when the subject is stationary, the obtained image 41 has a subject shortened in the horizontal direction as shown in FIG. An image 42 is captured.

  On the other hand, the optical image of the subject moving in the direction opposite to the main scanning direction moves in the same direction as the main scanning direction on the photoelectric conversion unit 21 of the image sensor 6 ( (See also FIGS. 7 and 8). Therefore, since the number of vertical lines that are exposed by the subject light image is larger than that when the subject is stationary, the obtained image 41 is stretched in the horizontal direction as shown in FIG. The subject image 42 is captured.

  However, in any case, unlike the conventional technique described with reference to FIG. 39, the vertical line of the subject does not appear obliquely, and it is not necessary to remember so much strangeness in human vision. (On the other hand, when the image is distorted obliquely as shown in FIG. 39, the visual discomfort is remembered).

  Next, FIG. 12 is a diagram showing an operation cycle of the focal plane shutter.

  The focal plane shutter is composed of two curtains: a front curtain FB that runs on the subject side on the optical axis, and a rear curtain RB that runs on the image sensor 6 side on the optical axis. Note that the front curtain FB and the rear curtain RB are each composed of, for example, a plurality of shutter blades.

  First, FIG. 12A shows a state before photographing (before exposure). The rear curtain RB is retracted to a position above the image sensor 6, and the front curtain FB covers the space between the image sensor 6 and the lens barrel 2 in a light-tight manner.

  Next, FIG. 12B shows a state during shooting (during exposure). FIG. 12B shows a state where the shutter 5 is driven at a speed equal to or higher than the sync speed, that is, when exposure is performed through the exposure slit ES. The upper end of the front curtain FB travels forward on the optical axis of the image sensor 6 downward. On the other hand, the lower end of the rear curtain RB travels downward so as to follow the upper end of the front curtain FB with an interval corresponding to the slit width of the exposure slit ES.

  Next, FIG. 12C shows a state when shooting (exposure) is completed. The front curtain FB has reached a position below the image sensor 6. On the other hand, the rear curtain RB covers the space between the image sensor 6 and the lens barrel 2 in a light-tight manner.

  Further, FIG. 12D shows a state when shutter charging is performed. The front curtain FB and the rear curtain RB are moved upward toward the position shown in FIG. 12A while cooperating so as to have portions that overlap each other (maintain light tightness).

  The focal plane shutter is operated in a cycle as shown in FIG. 12A → FIG. 12B → FIG. 12C → FIG. 12D → FIG. .

  In addition, in the configuration shown in FIG. 12, the traveling direction of the shutter curtain of the mechanical shutter is a direction orthogonal to the main scanning direction of the image sensor 6 (however, here, a case where it is orthogonal is taken as an example). However, the present invention is not limited to this, and if the traveling direction of the shutter curtain intersects with the main scanning direction, it is possible to perform a shutter failure check as described later). When the mechanical shutter and the rolling shutter that is the electronic shutter of the image sensor 6 are operated simultaneously under such an arrangement, the running characteristics of the shutter curtain of the mechanical shutter are improved / decreased as described below. It is possible to detect.

  The mechanical shutter can be confirmed to be good / bad by shipping inspection or repair service. However, the imaging apparatus 1 can be repaired when necessary by the user according to the result. It does not preclude the use for

  FIG. 13 is a diagram illustrating a state in which failure confirmation of the shutter is performed by slit exposure, FIG. 14 is a diagram illustrating a state in which failure is confirmed only in the front curtain of the shutter, and FIG. 15 is a failure confirmation only in the rear curtain of the shutter. It is a figure which shows the mode of time.

  In the present embodiment, when the imaging apparatus 1 is set to the first shutter failure confirmation mode, the shutter failure is confirmed by slit exposure as shown in FIG. This first shutter failure confirmation mode is based on the assumption that the parallel light uniform irradiator as shown in FIG. 6 is attached to the imaging apparatus 1.

  Further, when the imaging apparatus 1 is set to the second shutter failure confirmation mode, the operation as shown in FIG. 14 is performed to confirm the failure of only the front curtain, and the operation as shown in FIG. The trouble is confirmed. Here, in the failure confirmation of the front curtain, slit exposure is not performed, and the rear curtain does not travel while the front curtain travels. In the failure confirmation of the rear curtain, the slit exposure is not performed, and the rear curtain travels after the front curtain finishes traveling to the position where it retracts from the optical path of the image sensor 6. This second shutter failure confirmation mode is based on the assumption that the parallel light uniform illuminator as shown in FIG. 6 is attached to the imaging apparatus 1 or the lens 3 is defocused. .

  FIG. 16 is a diagram showing a running state of the front curtain and the rear curtain during slit exposure. In FIG. 16 and FIGS. 17 and 18 described below, the vertical axis indicates the position of the imaging element 6 in the vertical direction, and the horizontal axis indicates time.

  Both the front curtain shown by the solid line and the rear curtain shown by the dotted line start running and gradually accelerate, and when reaching a certain speed, start to cross the upper end of the image sensor 6 and then (some acceleration etc. is performed) However, the lower end of the image sensor 6 is reached while maintaining a relatively uniform speed. At this time, the time ET from the passage of the front curtain on a certain horizontal line to the passage of the rear curtain is the exposure time on that horizontal line.

  On the other hand, FIG. 17 is a diagram showing the running state of the front curtain and rear curtain during non-slit exposure. At this time, after the front curtain reaches the lower end of the image sensor 6, the rear curtain starts to cross the upper end of the image sensor 6.

  FIG. 18 is a diagram showing a running state of the front curtain and the rear curtain when slit exposure is performed by a shutter having a defect. In the example shown in FIG. 18, the exposure time ET1 in a horizontal line near the upper end of the image sensor 6 and the exposure time ET2 in a horizontal line near the lower end of the image sensor 6 are different. It can be seen that there is a type of defect in which the lower end side is exposed brighter than the upper end side.

  Next, FIG. 19 shows a rolling shutter operation in which a parallel light uniform irradiator is attached to the imaging apparatus 1 to perform slit exposure, and the time from sensor reset to sensor lead is shorter than the readout time of one frame. It is the figure which showed the mode of the image data obtained at the time from the back side of the image pick-up element 6. FIG. However, in the example shown in FIG. 19, the running characteristics of the rear curtain are poor (the curtain speed of the rear curtain is slower than the design value), and the rolling shutter is reached before the rear curtain reaches the lower end of the image sensor 6. This is an example of when the operation ends.

  On the image 41, a substantially oblique bright image portion obtained as a crossing portion of the exposure slit and the rolling shutter is exposed in the dark image portion, and one of the boundary lines between the dark image portion and the bright image portion is exposed. Is a curve Lf resulting from the travel of the front curtain, and the other is a curve Lr resulting from the travel of the rear curtain (however, only an outline will be described here and details will be described later).

  In order to improve the accuracy of detecting a failure of the shutter 5, it is desirable that a substantially oblique bright image portion in FIG. 19 crosses the obtained image data substantially diagonally. Therefore, in order to match a rolling shutter whose upper limit of the frame rate is about 60 fps with a mechanical shutter corresponding to a frame rate of about 125 fps to about 300 fps, as described later, thinning out is read out from the image sensor 6 at the time of the rolling shutter for failure confirmation. To approximate both shutter speeds.

  Next, FIG. 20 is a timing chart showing driving of the image sensor 6 and the shutter 5 when confirming a failure by slit exposure or confirming a failure of only the front curtain. The timing control shown in FIG. 20 is performed by the control unit 11, for example.

  When imaging, first, a sensor reset pulse is applied to all the photoelectric conversion elements 22 of the imaging element 6 at a certain time t0. Thereby, all the photoelectric conversion elements 22 in the photoelectric conversion unit 21 are reset all at once.

  Next, a front curtain start pulse is applied to the shutter 5. Thereby, the traveling of the front curtain of the shutter 5 is started.

  When a predetermined time α has elapsed since the application of the front curtain start pulse, the sensor read pulse is sequentially applied from the first row to the last row of the photoelectric conversion unit 21 at predetermined time intervals K. As a result, the signals in each column are sequentially read out at time K intervals. However, since the leading curtain has not yet reached the upper end of the photoelectric conversion unit 21 when reading is started, the output signals from the first column to the several columns are subject light as shown in FIG. Is a signal that has not reached the image sensor 6.

  In addition, when a predetermined time β determined according to the shutter speed elapses after the first curtain start pulse is applied, the second curtain start pulse is applied to the shutter 5. Thereby, the running of the rear curtain of the shutter 5 is started.

  It is assumed that the front curtain reaches the upper end of the image sensor 6 at time t1f when the time M has elapsed since the application of the front curtain start pulse. A signal read from the image sensor 6 after this time includes a signal value resulting from the arrival of the subject light.

  It is assumed that the rear curtain reaches the upper end of the image sensor 6 at time t1r when the time N has elapsed since the application of the rear curtain start pulse.

  Thereafter, it is assumed that the front curtain reaches the lower end of the image sensor 6 at time t2f when the time Sf has elapsed since the application of the front curtain start pulse.

  Thereafter, it is assumed that the rear curtain reaches the lower end of the image sensor 6 at time t2r when the time Sr has elapsed after the rear curtain start pulse is applied.

  When the sensor lead pulse is applied to the last column of the photoelectric conversion unit 21 when the time P has elapsed since the application of the sensor lead pulse, the exposure for one frame is completed.

  In order to detect the operating state of the shutter curtain (front curtain and rear curtain) traveling from the upper end to the lower end of the image sensor 6 at the timing shown in FIG. As described above, it is preferable that the time Sf and the time P are close to each other, and the time Sr and the time P are close to each other. This setting is performed by thinning out the image sensor 6 and adjusting the element shutter time by the rolling shutter.

  FIG. 21 shows a state when image data exposed by driving at the timing as shown in FIG. 20 is viewed from the back side of the image sensor 6 and a state of signal values obtained in several vertical lines. FIG.

  First, FIG. 21D shows image data. In FIG. 21, a curve Lf indicated by a solid line is a curve resulting from the travel of the front curtain, and a curve Lr indicated by a dotted line is a curve resulting from the travel of the rear curtain. Further, the reading start point of the image sensor 6 is the lower right corner of the image data. In FIG. 21D and FIG. 25 to be described later, the white arrow indicates the main scanning direction of the image sensor 6, and the dotted arrow pointing from bottom to top indicates the sub-scanning direction of each vertical line in the image sensor 6. Yes.

  Next, FIG. 21A is read from the photoelectric conversion unit 21 at time A (see FIGS. 20 and 21D) close to the arrival time after the trailing curtain has reached the upper end of the image sensor 6. The state of signal values in a vertical line (referred to as line A as appropriate) is shown. In the line below the point where the line A and the curve Lf intersect, the signal value is substantially 0 (black level) because the subject light has not yet reached. In addition, the line above the point where the line A and the curve Lr intersect is almost constant because the object light has already reached through the exposure slit and no more object light reaches it. A level signal value is obtained. A portion on the line A between the curve Lf and the curve Lr is a portion where the signal value increases almost linearly. FIG. 22 is a diagram showing the positional relationship between the image sensor 6 and the exposure slit ES composed of the front curtain FB and the rear curtain RB at time A corresponding to FIG.

  FIG. 21B shows a vertical line read from the photoelectric conversion unit 21 at time B (see FIGS. 20 and 21D) when the leading and trailing curtains reach the middle row of the image sensor 6. The state of the signal value in line B) is shown as appropriate. The state of the output signal on line B has been described with reference to FIG. 21A except that the position where the row where the signal value is 0 and the row where the signal value is substantially constant are shifted downward. It is the same as that. FIG. 23 is a diagram showing the positional relationship between the image sensor 6 and the exposure slit ES composed of the front curtain FB and the rear curtain RB at time B corresponding to FIG.

  FIG. 21C shows a vertical line (referred to as line C as appropriate) read from the photoelectric conversion unit 21 at time C (see FIGS. 20 and 21D) when the front curtain reaches the lower end of the image sensor 6. ) Shows the state of signal values. As for the state of the output signal on the line C, the row where the signal value is 0 is shifted to the lower end of the image sensor 6, and similarly, the position of the row where the signal value is substantially constant is further lower than that in FIG. Except for the point deviated, it is the same as that described with reference to FIGS. 21 (A) and 21 (B). FIG. 24 is a diagram showing the positional relationship between the image sensor 6 and the exposure slit ES composed of the front curtain FB and the rear curtain RB at time C corresponding to FIG.

  Then, an inflection point on each vertical line where the signal value changes so as to increase substantially linearly from 0 is detected, and by connecting these, a curve Lf resulting from the running of the front curtain can be detected. it can. Similarly, an inflection point on each vertical line where the signal value increases substantially linearly and changes to a substantially constant level is detected, and by connecting these points, a curve Lr resulting from the running of the trailing curtain is detected. be able to.

  Next, FIG. 25 is a diagram illustrating a time relationship when the exposure as described with reference to FIGS. 21 to 24 is performed based on FIG.

  As described with reference to FIG. 20, the time from the start of application of the sensor lead pulse to the end of application is P. The readout time interval for one vertical line is K. The scanning start point ST is the lower right corner of the image data viewed from the back side. Furthermore, the vertical line corresponding to the point in time (M−α) after the time when the sensor lead pulse is applied becomes the start point of the curve Lf. In addition, a vertical line corresponding to a point of time (N + β−α) after the time when the sensor lead pulse is applied becomes the start point of the curve Lr.

  Next, FIG. 26 shows a state when image data obtained by exposure by driving at the timing as shown in FIG. 20 in order to confirm the failure of only the front curtain is viewed from the back side of the image sensor 6. FIG. However, when only the front curtain is checked for failure, slit exposure is not performed as described with reference to FIG. Accordingly, the trailing curtain start pulse in the timing chart shown in FIG. 20 is applied to the shutter 5 at an appropriate time after the sensor read pulse is applied to the last row, unlike FIG. It has become. As shown in FIG. 20, the leading curtain reaches the lower end of the image sensor 6 at time t2f, and a vertical line read by applying a sensor read pulse at time t2f is denoted as Rf in FIG. Shown (also shown in FIG. 20).

  Next, FIG. 27 is a timing chart showing driving of the image sensor 6 and the shutter 5 when confirming a failure of only the rear curtain. The timing control shown in FIG. 27 is performed by the control unit 11, for example.

  The timing control shown in FIG. 27 is premised on that the front curtain start pulse is applied to the shutter 5 in advance and the front curtain reaches the lower end of the image sensor 6.

  At a certain time after the front curtain reaches the lower end of the image sensor 6, the sensor reset pulse is sequentially applied from the first row to the last row of the photoelectric conversion unit 21 at predetermined time intervals K. As a result, the photoelectric conversion elements 22 are reset in time series for each column.

  In addition, a trailing curtain start pulse is applied to the shutter 5 at a time close to the start of application of the sensor reset pulse.

  From the time when the predetermined exposure time Tex, which is the shutter time of the rolling shutter, has elapsed since the start of the application of the sensor reset pulse (the time when the time δ has elapsed since the application of the rear curtain start pulse), the sensor read pulse Are sequentially applied at a predetermined time K interval from the first column to the last column of the photoelectric conversion unit 21. As a result, the signals in each column are sequentially read out at time K intervals. However, since the trailing curtain has not yet reached the upper end of the photoelectric conversion unit 21 when reading is started, the output signals from the first column to the several columns are shown in FIG. All of the pixels are signals in which the subject light reaches the image sensor 6.

  It is assumed that the rear curtain reaches the upper end of the image sensor 6 at time t1r when the time N has elapsed since the application of the rear curtain start pulse. After this time t1r, a dark part in which the rear curtain travels on the image sensor 6 and the signal value is approximately 0 (black level) by sequentially shielding light from the upper end side of the image sensor 6 will be described later. As shown in FIG. 28, it occurs on the imaging data.

  Thereafter, it is assumed that the rear curtain reaches the lower end of the image sensor 6 at time t2r when the time Sr has elapsed since the application of the rear curtain start pulse.

  After that, when the time P has elapsed since the application of the sensor lead pulse, when the sensor lead pulse is applied to the last column of the photoelectric conversion unit 21, the exposure for one frame is completed.

  Even at the timing shown in FIG. 27, in order to detect the operation state of the trailing curtain with as high accuracy as possible, it is preferable to set the time Sr and the time P close to each other as will be described in detail later.

  Next, FIG. 28 shows a state when image data obtained by exposure by driving at the timing as shown in FIG. 27 in order to confirm the failure of only the rear curtain is viewed from the back side of the image sensor 6. FIG.

  As can be seen from FIG. 27, the vertical line that is the starting point of the curve Lr is applied with the sensor lead pulse when time (N−δ) has elapsed from the time when the application of the sensor lead pulse is started. A vertical line. Further, as shown in FIG. 27, the vertical line that is the end point of the curve Lr is a vertical line to which the sensor lead pulse is applied at time t2r when the trailing curtain reaches the lower end of the image sensor 6. It will be expressed as Rr (also shown in FIGS. 27 and 28).

  Further, in FIG. 28, a curve Lb indicated by a one-dot chain line is drawn so as to be close to the curve Lr indicated by a dotted line. This curve Lb connects inflection points at which the signal value becomes substantially 0 (black level). That is, in the image shown in FIG. 28, the lower right portion of the curve Lr is a portion that has been exposed for the exposure time Tex, and has a signal value at a substantially constant level. Therefore, the curve Lr connects inflection points at which the signal value decreases approximately linearly from a substantially constant level. In detecting the running characteristic of the trailing curtain, either the curve Lr indicated by the dotted line or the curve Lb indicated by the alternate long and short dash line may be used in FIG. 28, but the signal value is substantially 0 in terms of image processing. It is easier to detect the curve Lb obtained by connecting the inflection points rising from (black level).

  Next, FIG. 29 is a flowchart showing the operation in the first shutter failure confirmation mode. In this first shutter failure confirmation mode, slit exposure is performed by timing control as shown in FIG. 20, and it is mainly detected whether or not exposure unevenness due to a failure of the shutter operation occurs in the image. It has become.

  That is, when the imaging apparatus 1 is set to the first shutter failure confirmation mode and this processing is started, first, various settings necessary for performing the processing of the first shutter failure confirmation mode are performed (step S1). Here, for example, imaging sensitivity is set according to the illuminance of the parallel light uniform irradiator, or thinning readout is set to approximate the shutter speeds of the mechanical shutter and the rolling shutter.

  The setting for thinning readout is performed as follows, for example.

  It is assumed that the frame rate of the image sensor 6 is 60 fps, for example. In this case, the time required for reading out one frame (corresponding to the time P shown in FIGS. 20 and 27 if blanking is not taken into consideration) is 16.67 msec (for example, the image sensor 6 is vertically In the case of about 6 million pixels composed of 2100 pixels × horizontal 2800 pixels, the time K required to read out one vertical line is (1 sec / 60/2800) ≈6 μsec).

On the other hand, with respect to the front curtain or rear curtain of the shutter 5, a case is considered in which the time Sf or Sr until the travel of each curtain after the start pulse is applied is 3 msec. At this time,
Since mechanical shutter time << element shutter time, thinning readout is performed to shorten the element shutter time and bring it closer to the mechanical shutter time. Specifically, if the vertical line readout is 1 in 5 (1/5 thinning), (16.67 msec / 5) ≈3.33 msec, and the mechanical shutter time and the element shutter time can be brought close to each other. it can. If the vertical line readout is one out of six lines (1/6 thinning), (16.67 msec / 6) ≈2.78 msec, and although close, the element shutter time is shorter than the mechanical shutter time. turn into. At this time, the curves Lf and Lr cannot start from the upper end of the image data and end at the lower end (that is, they break off at the left end without reaching the lower end). Since it becomes insufficient, it is not desirable from the viewpoint of shutter failure confirmation. Therefore, the element shutter time is preferably close within a range longer than the mechanical shutter time (that is, referring to FIGS. 20 and 27, (Sf−M) <P and (Sf−M) ≈P , And (Sr−N) <P and (Sr−N) ≈P may be satisfied. From such a viewpoint, in the imaging apparatus 1 including the shutter 5 and the imaging element 6 having the shutter time as shown in the above example, 1/5 decimation is set when the failure confirmation of the shutter 5 is performed. Become.

  As another example, the frame rate of the image sensor 6 is 60 fps. However, when the curtain travel times Sf and Sr of the mechanical shutter are 4 msec, the element shutter time is 4.15 msec if 1/4 decimation is performed. It becomes. Therefore, when checking the failure of the shutter 5, 1/4 thinning is set.

  However, thinning-out reading is not necessarily limited to 1 / integer. For example, consider a case where the frame rate of the image sensor 6 is 60 fps, and the curtain travel times Sf and Sr of the mechanical shutter are 6 msec. At this time, if 1/2 decimation is performed, the element shutter time is 8.33 msec (Note that in 1/3 decimation, the element shutter time is 5.56 msec, which is shorter than the mechanical shutter time). Since the value of 8.33 msec is about 1.4 times 6 msec, the number of vertical lines used for confirming the failure of the shutter 5 is about 70% of the total number of lines. Of course, it is possible to confirm the failure, but it is desirable to use a larger number of lines in order to improve detection accuracy. Therefore, consider using a rational number represented by a relatively simple integer ratio. Specifically, 2/5 decimation (in this case, reading is performed at a rate of 2 out of 5 lines, so that 1 line is read out every 3 lines and 1 line is read out every 2 lines. The element shutter time is 6.67 msec, which is a close value in a range longer than the mechanical shutter time. Therefore, in order to check the failure of the shutter 5 in this case, 2/5 thinning may be set instead of 1/2 thinning (in this case, as shown in FIGS. 20 and 26). When calculating the time required for the leading curtain or trailing curtain to travel from the upper end to the lower end of the image sensor 6 based on Rf or Rr shown in FIGS. 27 and 28, the calculation is slightly complicated. Become).

  Returning to the description of FIG. 29, when the processing in step S1 as described above is completed, it is next determined whether or not the parallel light uniform irradiator as shown in FIG. Step S2). The presence / absence of this attachment may be automatically determined by the control unit 11 of the imaging apparatus 1 communicating with the parallel light uniform irradiator, or the user confirms that the parallel light uniform irradiator is attached. May be determined by the control unit 11 based on whether or not is manually input.

  Here, when it is determined that the parallel light uniform irradiator is not attached, a caution display such as “please attach the parallel light uniform irradiator” is performed on the display unit 10 (step S3). It returns to S2 and waits for a parallel light uniform irradiation device to be mounted.

  In this way, if it is determined in step S2 that the collimated light uniform irradiator is mounted, exposure is performed by driving the shutter 5 and the image sensor 6 at the first timing as shown in FIG. Is acquired (step S4).

  Next, based on the image data obtained in step S4, the image analysis unit 11a performs first exposure unevenness determination as will be described later, and determines whether the operation (running characteristics) of the shutter 5 is normal. (Step S5).

  Here, when it is determined that the operation of the shutter 5 is normal, a message such as a predetermined process (for example, “the operation of the shutter is normal”) when there is no uneven exposure by the shutter 5 is displayed on the display unit 10. On the other hand, if it is determined that the operation of the shutter 5 is not normal, a predetermined process (for example, “the operation of the shutter is performed” when uneven exposure of the shutter 5 is found) is determined. Since there is a possibility that it is not normal, a message such as “set to the second shutter failure confirmation mode” is displayed on the display unit 10) (step S7), and then this process is terminated.

  FIG. 30 is a flowchart showing details of the first exposure unevenness determination in step S5 of FIG.

  Here, first, the signal value is substantially linear from the inflection point of the signal value in each vertical line, that is, from the portion where the signal value is at a substantially constant level as shown in FIGS. 21 (A) to 21 (C). An inflection point that shifts to a portion that decreases is detected (step S11).

  Subsequently, the maximum value among the signal values of the inflection points detected for each vertical line is detected (step S12). In FIG. 21D, this maximum value is the widest portion in the horizontal direction in the arc-shaped region sandwiched between the curve Lf and the curve Lr, that is, from when the front curtain passes until the rear curtain passes. Is obtained as a signal value of a pixel at a portion where the longest portion of time intersects the curve Lr.

  Further, the minimum value among the signal values of the inflection points detected for each vertical line is detected (step S13). In FIG. 21D, this minimum value is the portion with the narrowest horizontal width in the arc-shaped region sandwiched between the curve Lf and the curve Lr, that is, from when the front curtain passes until the rear curtain passes. Is obtained as the signal value of the pixel at the intersection of the portion where the time is the shortest and the curve Lr.

  Then, the minimum value of the inflection point is subtracted from the maximum value of the inflection point, and it is determined whether or not the subtracted value is equal to or less than a predetermined upper limit value (step S14). That is, when the operation of the shutter curtain is as designed, uniform exposure should be obtained and the signal value should not vary (in other words, the curve Lf and the curve in FIG. 21D). The horizontal width in the arcuate region between Lr should be the same on all horizontal lines). Therefore, a threshold for determining the presence / absence of signal value variation is set as a predetermined upper limit value, and if it is equal to or lower than this upper limit value, it is considered that the exposure is uniform, and if the upper limit value is exceeded, exposure unevenness occurs. I am trying to judge.

  If it is determined in step S14 that the subtracted value is equal to or less than the predetermined upper limit value, it is determined that the running characteristics of the shutter 5 are normal, and the process proceeds to step S6 in FIG.

  On the other hand, if it is determined in step S14 that the subtracted value is greater than the predetermined upper limit value, it is determined that the running characteristics of the shutter 5 are poor, and the process proceeds to step S7 in FIG.

  Next, FIG. 31 is a flowchart showing the operation of the second shutter failure confirmation mode. In this second shutter defect confirmation mode, whether or not there is a defect in the running characteristics (for example, curtain speed) of the leading curtain by performing exposure by timing control (excluding the trailing curtain start pulse) as shown in FIG. 27, and exposure is performed by controlling the timing as shown in FIG. 27 to detect whether or not there is a defect in the running characteristics of the rear curtain (similarly, for example, the curtain speed). Whether or not exposure unevenness has occurred is detected using the image used in the above and the image used for confirmation of the rear curtain. Note that the second shutter failure confirmation mode process does not need to irradiate light so that the in-plane illuminance is uniform with high accuracy. Therefore, even if no parallel light uniform irradiator is attached, If a generally used lens barrel 2 is attached, the lens 3 of the lens barrel 2 can be substituted by defocusing.

  That is, when the imaging apparatus 1 is set to the second shutter defect confirmation mode and this process is started, first, various settings necessary for performing the second shutter defect confirmation mode process are performed (step S21). Here, similarly to the first shutter failure confirmation mode, for example, the setting of the photographing sensitivity according to the illuminance of the parallel light uniform irradiator or the illuminance of external light incident through the lens barrel 2 is performed, or mechanical In order to approximate the shutter speed between the shutter and the rolling shutter, thinning readout is set.

  Subsequently, it is determined whether or not the parallel light uniform irradiator as shown in FIG. 6 is attached to the imaging apparatus 1 (step S22).

  Here, when it is determined that the parallel light uniform irradiator is not attached, the lens barrel 2 is attached to the image pickup apparatus 1 and the incident light has a sufficient amount of light to check the shutter failure. It is determined whether or not there is (step S23). Here, whether or not the lens barrel 2 is attached is automatically determined when the control unit 11 communicates with a lens CPU (not shown) incorporated in the lens barrel 2 (however, manual input is performed). Of course, you can make a decision based on this). Whether there is incident light is automatically determined based on the signal value of the signal output from the image sensor 6 with the shutter 5 opened. Alternatively, the determination is automatically made based on the output of a photometric sensor (not shown) provided in the imaging apparatus 1.

  In this step S23, if it is determined that the lens barrel 2 is not mounted or that there is not a sufficient amount of incident light, “the lens is mounted and directed toward the brighter side, or the parallel light is uniformly irradiated. Attach a warning message such as “Please wear a device” to the display unit 10 (step S24), and return to step S22 to attach a parallel light uniform irradiator or a lens and turn it toward the brighter side. Wait for something.

  If it is determined in step S23 that the lens barrel 2 is attached and there is a sufficient amount of incident light, the focus lens included in the lens 3 of the lens barrel 2 is driven, Defocusing is performed (step S25). This defocusing may be performed so that the optical image of the subject is blurred as much as possible, and it may be defocused to the infinity side or defocused to the close side.

  When the process of step S25 ends or when it is determined in step S22 that the parallel light uniform irradiator is mounted, the first timing as shown in FIG. 20 (as described above, In step S26, the shutter 5 and the image sensor 6 are driven to perform exposure and image data is acquired (except for the control timing of the trailing curtain start pulse).

  Next, based on the image data obtained in step S26, the image analysis unit 11a performs a front curtain determination as described later, and determines whether or not the running characteristic of the front curtain of the shutter 5 is normal (step). S27).

  Here, if it is determined that the running characteristic of the front curtain of the shutter 5 is not normal, a predetermined process in the case of a shutter failure related to the front curtain is performed (step S28).

  On the other hand, if it is determined in step S27 that the running characteristics of the front curtain of the shutter 5 are normal, the shutter 5 and the image sensor 6 are driven at the second timing as shown in FIG. To obtain image data (step S29).

  Next, based on the image data obtained in step S29, the image analysis unit 11a performs rear curtain determination as described later, and determines whether the running characteristics of the rear curtain of the shutter 5 are normal (step). S30).

  Here, when it is determined that the running characteristics of the rear curtain of the shutter 5 are not normal, a predetermined process in the case of a shutter failure related to the rear curtain is performed (step S31).

  On the other hand, if it is determined in step S30 that the running characteristic of the rear curtain of the shutter 5 is normal, image analysis is performed based on the image data obtained in step S26 and the image data obtained in step S29. The part 11a performs second exposure unevenness determination as will be described later, and determines whether or not the operation (running characteristics) of the shutter 5 is normal (step S32).

  Here, when it is determined that the operation of the shutter 5 is not normal, a predetermined process is performed when there is exposure unevenness (step S33), while when it is determined that the operation of the shutter 5 is normal. Performs a predetermined process when there is no uneven exposure by the shutter 5 (step S34).

  When the process of step S28, S31, S33, or S34 is performed in this way, the series of processes is terminated thereafter.

  FIG. 32 is a flowchart showing details of the leading curtain determination in step S27 of FIG.

  When this process is started, the image analysis unit 11a analyzes the image data obtained by the process of step S26, and the vertical line Rf when the front curtain of the shutter 5 passes the lower end of the image sensor 6 (see FIG. 26). Is detected (step S41).

Subsequently, the time Sf from when the front curtain start pulse is applied until the front curtain reaches the lower end of the image sensor 6 is set as the line number of the vertical line Rf (the line number is 1 for the vertical line including the scanning start point ST). And the line number of the vertical line Rf is expressed using the same symbol Rf).
Sf = K × Rf + α
(Step S42). Here, since the operation of the image sensor 6 is controlled based on a clock generated from a highly accurate oscillator, it may be considered that there is no fluctuation in the operation speed (that is, for example, one vertical line is read out). It can be considered that there is no fluctuation in the time K required for this). The time α between the time when the front curtain start pulse is applied and the time when the sensor read pulse is applied can also be detected based on the clock. Therefore, by performing such a calculation, it is possible to accurately calculate the curtain travel time Sf that serves as an index for detecting the curtain speed of the front curtain.

  Then, it is determined whether or not the curtain running time Sf calculated in step S42 is larger than a predetermined lower limit value TL and smaller than a predetermined upper limit value TH (step S43).

  Here, when it is determined that TL <Sf <TH is satisfied, the traveling characteristic of the front curtain of the shutter 5 is assumed to be normal, and the process proceeds to step S29 in FIG.

  On the other hand, if it is determined in step S43 that TL <Sf <TH is not satisfied, the traveling characteristic of the front curtain of the shutter 5 is determined to be poor, and the process proceeds to step S28 in FIG.

  FIG. 33 is a flowchart showing details of the trailing curtain determination in step S30 in FIG.

  When this process starts, the image analysis unit 11a analyzes the image data obtained by the process of step S29, and displays a line Rr (see FIG. 28) when the rear curtain of the shutter 5 passes the lower end of the image sensor 6. Detection is performed (step S51).

Subsequently, the time Sr from when the rear curtain start pulse is applied until the rear curtain reaches the lower end of the image sensor 6 is defined as the line number of the vertical line Rr (the line number is given as described above, The line number of the vertical line Rr shall be expressed using the same symbol Rr)
Sr = K × Rr + δ
(Step S52). For the same reason as described above with respect to the front curtain, this calculation makes it possible to accurately calculate the curtain travel time Sr that serves as an index for detecting the curtain speed of the rear curtain.

  Then, it is determined whether or not Sr calculated in step S52 is larger than a predetermined lower limit value TL and smaller than a predetermined upper limit value TH (step S53). The upper limit value TH and the lower limit value TL used in the determination in step S53 are the same as the values used in step S43 of the leading curtain determination shown in FIG.

  If it is determined in this step S53 that TL <Sr <TH is satisfied, the traveling characteristic of the rear curtain of the shutter 5 is assumed to be normal, and the process proceeds to step S32 in FIG.

  On the other hand, if it is determined in step S53 that TL <Sr <TH is not satisfied, the running characteristic of the rear curtain of the shutter 5 is determined to be poor, and the process proceeds to step S31 in FIG.

  Next, FIG. 34 is a flowchart showing details of the second exposure unevenness determination in step S32 of FIG.

  When this process is started, the image data for front curtain determination obtained in step S26 is binarized using the black level as a threshold (step S61).

  Further, the image data for rear curtain determination obtained in step S29 is binarized using the black level as a threshold (step S62).

  Subsequently, the 1-bit image binarized in step S61 and the 1-bit image binarized in step S62 are layered into a 2-bit image (step S63).

  FIG. 35 is a diagram showing a state in which binarized image data for front curtain determination and image data for rear curtain determination are layer-combined with a 2-bit image.

  Since a pixel value that can be taken as a pixel value in a 1-bit image is 0 or 1, an image obtained by layer synthesis can take 0, 1, or 2 as a pixel value. In FIG. 35, a portion where the pixel value is 0 is shown as BIT0, a portion where the pixel value is 1 is shown as BIT1, and a portion where the pixel value is 2 is shown as BIT2.

  Thereafter, a histogram of the layer-combined image as shown in FIG. 35 is created (step S64).

  FIG. 36 is a diagram illustrating an example of a histogram created based on binarized and layered image data for front curtain determination and rear curtain determination.

  As can be seen from FIG. 35, the appearance frequency of the pixel having the pixel value 1 is the highest, and the appearance frequency of the pixels having the pixel value 0 and the pixel value 2 is relatively low. Further, as described above, since there is no pixel having the pixel value 3, the appearance frequency of the pixel is zero.

  Subsequently, it is determined whether the appearance frequency of the pixel having the value 0 is equal to or lower than the first predetermined value and whether the appearance frequency of the pixel having the value 2 is equal to or lower than the second predetermined value (step S65).

  Here, when each appearance frequency is equal to or less than each predetermined value, it is determined that there is no exposure unevenness and the operation (running characteristics) of the shutter 5 is normal, and the process proceeds to step S34 in FIG.

  On the other hand, if it is determined in step S65 that the appearance frequency of the pixel having the value 0 is greater than the first predetermined value or the appearance frequency of the pixel having the value 2 is greater than the second predetermined value, the exposure is performed. Since the unevenness has occurred and the operation (running characteristics) of the shutter 5 is defective, the process proceeds to step S33 in FIG.

  In the process of step S33, for example, when it is determined that the appearance frequency of the pixel having the value 0 is larger than the first predetermined value, and the appearance frequency of the pixel having the value 2 is larger than the second predetermined value. Depending on the case, it is possible to perform different processing according to each.

  In the above description, the image analysis unit 11a is provided in the imaging apparatus 1 to analyze the image. However, each image captured at the timing described above may be analyzed by an external personal computer or the like. . In this case, the processing performed by the control unit 11 including the image analysis unit 11a may be performed by a program executed on the computer.

  Furthermore, in the above description, the time Sf is obtained as information related to the traveling speed of the front curtain, and the time Sr is obtained as information related to the traveling speed of the rear curtain. As described above, the information related to the traveling speed of the front curtain or the rear curtain does not have to be the traveling speed itself, and may be time as long as the data can be data for estimating the traveling speed. .

  According to the first embodiment, since the long side direction of the photoelectric conversion unit 21 having a rectangular shape is set as the main scanning direction and the short side direction is set as the sub scanning direction, an image sensor with less noticeable dynamic distortion can be manufactured at low cost. Can be configured.

  Since distortion can be made inconspicuous with only an electronic element shutter, it is possible to perform shooting with the mechanical shutter opened when high-speed continuous shooting is required. As a result, it is possible to prevent an increase in the size of the camera, reduce battery consumption, and perform high-speed continuous shooting that cannot be achieved with a mechanical shutter. On the other hand, in the single image shooting mode, there is no problem in shooting with a mechanical shutter as usual, and a normal relatively inexpensive mechanical shutter is used instead of an expensive mechanical shutter corresponding to high-speed continuous shooting. It becomes possible.

  In addition, since such an image sensor is arranged in an image pickup apparatus having a horizontally long casing so as to match the horizontally long image, the long side direction of the image sensor to be matched with the moving direction of the object is intuitive. Recognition.

  Similarly, since such an image sensor is arranged so that the horizontally long area for observing the subject on the display unit coincides with the horizontally long area, the long side of the image sensor to be matched with the moving direction of the object It becomes possible to recognize the direction intuitively.

  Also, based on the image signal obtained by simultaneously operating the electronic rolling shutter and the mechanical focal plane shutter, because the running characteristics of the mechanical focal plane shutter are tested, without adding a dedicated member or the like, It is possible to easily check whether the running characteristics of the shutter are normal or defective.

  Further, the slit exposure by the mechanical focal plane shutter and the electronic rolling shutter are simultaneously operated to calculate the variation of the inflection point of the pixel value in each line of the image data, and the calculated variation is less than the predetermined upper limit value. In this case, it is determined that the running characteristic of the mechanical focal plane shutter is normal, and if it is greater than the predetermined upper limit value, it is determined to be defective. Using a mechanical focal plane shutter arranged so as to cross the main scanning direction, normality / defectiveness of the running characteristics of the focal plane shutter can be easily confirmed. At this time, since it is known that the operation of the electronic rolling shutter is accurate with sufficient accuracy, it is possible to accurately measure the exposure unevenness caused by the focal plane shutter.

  Then, based on image data obtained by running only the front curtain of the mechanical focal plane shutter and operating the electronic rolling shutter simultaneously with the running of the front curtain, information on the running speed of the front curtain is obtained, and the obtained information Indicates that the traveling speed of the front curtain of the mechanical focal plane shutter is normal, indicating that the traveling speed of the front curtain is outside the predetermined range. In this case, since it is determined to be defective, it is possible to easily confirm normality / defectiveness of the running characteristic of the front curtain of the focal plane shutter by utilizing the mechanical focal plane shutter arranged as described above. it can.

  In addition, after the mechanical focal plane shutter is fully opened, the rear curtain of the mechanical focal plane shutter is run and the electronic rolling shutter is operated simultaneously with the running of the rear curtain. Obtain information on the running speed, and if the obtained information indicates that the running speed of the rear curtain is within a predetermined range, it is determined that the running characteristics of the rear curtain of the mechanical focal plane shutter are normal. Since it is determined to be defective if it is out of range, the mechanical focal plane shutter arranged as described above is utilized to improve the running characteristics of the rear curtain of the focal plane shutter. Normal / bad can be easily confirmed.

  In the second shutter failure confirmation mode, when the parallel light uniform irradiator is not attached, the lens is driven to the defocused state, so even if there is no parallel light uniform irradiator, it is easy. It is possible to test the running characteristics of the mechanical focal plane shutter.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, you may delete some components from all the components shown by embodiment. Furthermore, the constituent elements over different embodiments may be appropriately combined. Thus, it goes without saying that various modifications and applications are possible without departing from the spirit of the invention.

1 is a block diagram illustrating a configuration of an imaging apparatus according to Embodiment 1 of the present invention. FIG. 3 is a diagram illustrating a configuration example of an image sensor in the first embodiment. FIG. 6 is a diagram showing another configuration example of the image sensor in the first embodiment. FIG. 3 is a perspective view showing the arrangement of image pickup elements in the image pickup apparatus according to Embodiment 1 from the front side. FIG. 3 is a perspective view showing the arrangement of image pickup elements in the image pickup apparatus of Embodiment 1 from the back side. FIG. 3 is a diagram illustrating a state when a parallel light uniform irradiator for inspecting a shutter is attached to an imaging apparatus in the first embodiment. FIG. 3 is a diagram illustrating a relationship between a subject, a lens, and a subject light image on an image sensor in the first embodiment. FIG. 3 is a diagram illustrating a relationship among a subject, a lens, a shutter, and a subject light image on an image sensor in the first embodiment. FIG. 3 is a diagram illustrating a state of an image obtained by photographing a stationary subject in the first embodiment. FIG. 3 is a diagram illustrating a state of an image obtained by photographing a subject that is parallel to the main scanning direction and moving in the same direction in the first embodiment. FIG. 3 is a diagram illustrating a state of an image obtained by photographing a subject moving in a direction opposite to the main scanning direction in the first embodiment. FIG. 4 is a diagram illustrating an operation cycle of a focal plane shutter in the first embodiment. FIG. 3 is a diagram illustrating a state when shutter failure confirmation is performed by slit exposure in the first embodiment. FIG. 3 is a diagram illustrating a state when only a shutter front curtain is confirmed for failure in the first embodiment. FIG. 3 is a diagram illustrating a state when only a rear curtain of a shutter is confirmed for failure in the first embodiment. FIG. 3 is a diagram illustrating a running state of a front curtain and a rear curtain during slit exposure in the first embodiment. FIG. 3 is a diagram illustrating a running state of a front curtain and a rear curtain during non-slit exposure in the first embodiment. FIG. 3 is a diagram illustrating a running state of a front curtain and a rear curtain when slit exposure is performed by a shutter in which a defect has occurred in the first embodiment. In Embodiment 1 described above, when a collimated light uniform irradiator is attached to an imaging apparatus to perform slit exposure, and a rolling shutter operation is performed in which the time from sensor reset to sensor lead is shorter than the readout time of one frame. The figure which showed the mode of the obtained image data from the back side of the image pick-up element. 5 is a timing chart showing driving of an image sensor and a shutter when a failure is confirmed by slit exposure or a failure is confirmed only for the front curtain in the first embodiment. In the first embodiment, when the image data exposed by driving at the timing as shown in FIG. 20 is viewed from the back side of the image sensor, and the signal values obtained in several vertical lines. FIG. In the said Embodiment 1, the figure which shows the positional relationship of the image pick-up element in the time A corresponding to FIG. 21 (A), and the exposure slit ES comprised by the front curtain FB and the rear curtain RB. In the said Embodiment 1, the figure which shows the positional relationship of the image pick-up element and the exposure slit ES comprised by the front curtain FB and the rear curtain RB in the time B corresponding to FIG.21 (B). In the said Embodiment 1, the figure which shows the positional relationship of the image pick-up element and exposure slit ES comprised by the front curtain FB and the rear curtain RB in the time C corresponding to FIG.21 (C). The figure which described the time relationship when performing exposure as demonstrated with reference to FIGS. 21-24 in the said Embodiment 1 based on FIG. The figure which shows a mode when the image data obtained by exposing by the drive of the timing as shown in FIG. 20 in order to confirm a failure of only the front curtain in the said Embodiment 1 is seen from the back side of an image pick-up element. . 4 is a timing chart illustrating driving of an image sensor and a shutter when confirming a failure of only the rear curtain in the first embodiment. The figure which shows a mode when the image data obtained by exposing by the drive of the timing as shown in FIG. 27 in order to confirm a failure of only the rear curtain in the said Embodiment 1 is seen from the back side of an image pick-up element. . 6 is a flowchart showing an operation in a first shutter failure confirmation mode in the first embodiment. In the said Embodiment 1, the flowchart which shows the detail of the 1st exposure nonuniformity determination in step S5 of FIG. 7 is a flowchart showing an operation in a second shutter defect confirmation mode in the first embodiment. FIG. 32 is a flowchart showing details of front curtain determination in step S27 of FIG. 31 in the first embodiment. FIG. 32 is a flowchart showing details of rear curtain determination in step S30 of FIG. 31 in the first embodiment. 32 is a flowchart showing details of second exposure unevenness determination in step S32 of FIG. 31 in the first embodiment. FIG. 3 is a diagram showing a state when layered image data for binarized front curtain determination and image data for rear curtain determination is combined with a 2-bit image in the first embodiment. FIG. 5 is a diagram showing an example of a histogram created based on binarized and layered image data for front curtain determination and rear curtain determination in the first embodiment. The figure which shows the structure of the conventional CMOS type image pick-up element. The figure which shows a mode when a to-be-photographed object is imaged with the conventional image pick-up element. The figure which shows the mode of the image data for 1 frame obtained when the to-be-photographed object moved to the horizontal direction is imaged with the conventional image pick-up element. The figure which shows the example of the image data obtained by image | photographing the train which moves to the left direction from the screen right direction with the conventional image sensor. The figure which shows the example of the image data obtained by image | photographing the train which makes the conventional image pick-up element a vertical position, and moves to the left direction from the screen right direction. The figure which shows the structure of the image pick-up element comprised so that switching in which of the horizontal direction and the vertical direction was made into a main scanning direction conventionally.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Imaging device 2, 2A ... Lens barrel 3 ... Lens 4 ... Diaphragm 5 ... Shutter 6 ... Imaging device 7 ... Memory (memory | storage part)
8 ... Image processing unit 9 ... Memory card 10 ... Display unit (moving image display unit)
11. Control unit (reading control unit, imaging device driving unit, shutter driving unit, lens driving unit, running characteristic testing unit)
DESCRIPTION OF SYMBOLS 11a ... Image analysis part 12 ... Operation part 13 ... Battery 21 ... Photoelectric conversion part 22 ... Photoelectric conversion element 23 ... Timing generator (scanning circuit)
24 ... Vertical scanning circuit (scanning circuit)
25. Horizontal scanning circuit (scanning circuit)
26. Amplifier (signal processing circuit)
27 ... CDS (signal processing circuit)
28 ... ADC (signal processing circuit)
29 ... LVDS (signal processing circuit)
31 ... Multiplexer 35 ... Release switch 36 ... Finder (display section)
38 ... Cover 39 ... Point light source

Claims (7)

An image sensor that outputs an image signal according to exposure control by a rolling shutter,
In a rectangular region having a long side and a short side, a plurality of photoelectric conversion elements are arranged in a matrix along the long side direction and the short side direction,
A scanning circuit for reading a signal from the photoelectric conversion unit, with the long side direction as a main scanning direction and the short side direction as a sub-scanning direction;
A signal processing circuit that is connected to the end of each array in the main scanning direction of the photoelectric conversion unit and performs predetermined signal processing on a signal read from the photoelectric conversion unit;
An image pickup device comprising: The signal processing circuit is
An amplification circuit for amplifying a signal read from the photoelectric conversion element;
A CDS circuit connected to the output of the amplifier circuit;
The image pickup device according to claim 1, comprising:   The imaging device according to claim 2, wherein the signal processing circuit further includes an A / D conversion circuit connected to an output of the CDS circuit. An imaging apparatus comprising the imaging device according to claim 1,
The image sensor is arranged so that the main scanning direction is parallel to the horizontal direction in the normal photographing posture of the imaging device and the sub-scanning direction is parallel to the vertical direction in the normal photographing posture of the imaging device. An imaging device characterized by comprising: The image sensor according to claim 1,
A display unit for observing a subject to be imaged by the imaging device in a rectangular region composed of a long side and a short side;
An imaging device comprising:
The imaging device is arranged such that the main scanning direction is parallel to the long side direction of the rectangular area and the sub-scanning direction is parallel to the short side direction of the rectangular area. A characteristic imaging apparatus. The imaging device is configured to be settable in a single image shooting mode and a continuous shooting mode,
A mechanical shutter for controlling the time for the subject light to reach the image sensor;
When the single image shooting mode is set, imaging is performed using the mechanical shutter, and when the continuous shooting mode is set, imaging is performed using the rolling shutter of the imaging element without using the mechanical shutter. A control unit for controlling
The imaging apparatus according to claim 4, further comprising: The image sensor according to claim 1,
A storage unit that stores at least one frame of moving image data that is sequentially read from the imaging device in units of frames;
A read control unit that controls the frame image data stored in the storage unit to be read in an order in which the short side direction of the image sensor is the main scanning direction and the long side direction of the image sensor is the sub-scanning direction;
A moving image display unit that displays a moving image based on the frame image data read from the storage unit;
An image pickup apparatus comprising:

Images