JP2013175873A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image having reduced rolling distortion even when the subject moves at relatively high speed.SOLUTION: An image pickup device 1 comprises an image sensor 4 based on an X-Y address system, an operation unit 15, and a control unit 5 which controls the image sensor 4 so that picture signals can be read out from the image sensor 4 whose main scan direction is set according to an operation signal from the operation unit 15. The image sensor 4 includes an image pickup unit 21 based on an X-Y address system, a horizontal scan unit 22 and a vertical scan unit 23 for scanning the image pickup unit 21 by an X-Y address system, a main scan direction control unit 25 which controls the horizontal scan unit 22 and the vertical scan unit 23 according to a main scan direction control signal which determines whether the main scan direction is horizontal or vertical, and an output unit 24 which outputs a picture signal read out by scanning the image pickup unit 21 by the horizontal scan unit 22 and the vertical scan unit 23.

Description

  The present invention relates to an imaging apparatus.

  In an image pickup apparatus using an XY address type image pickup device such as a CMOS image sensor, a light receiving time (accumulation time) is shifted for each line because, for example, a moving shutter is used during moving image shooting. As a result, distortion (rolling distortion) occurs in the captured image particularly when the direction of movement of the subject is the same direction (parallel or antiparallel) with the main scanning direction of the image sensor.

  Therefore, in the camera system disclosed in Patent Document 1, the main scanning of the image sensor is automatically performed according to the motion vector of the subject generated based on the image signal read from the image sensor of the XY address method. Rolling distortion is reduced by switching the direction between the horizontal direction and the vertical direction.

JP 2006-54788 A

  However, in the conventional camera system, since the motion vector of the subject must be generated based on the image signal read from the image sensor, for example, the camera system is fixed at a predetermined place and a high-speed vehicle is photographed. When shooting a subject moving at a relatively high speed by moving the camera system rapidly, it is difficult to generate a motion vector that follows the relative high-speed movement of the subject. It was difficult to obtain an image with reduced image quality.

  The present invention has been made in view of such circumstances, and an object thereof is to provide an imaging apparatus capable of obtaining an image with reduced rolling distortion even when a subject moves at a relatively high speed.

  The following aspects are presented as means for solving the problems. An image pickup apparatus according to a first aspect reads an image signal from the image pickup device with an XY address type image pickup device, an operation unit, and a main scanning direction set in accordance with an operation signal from the operation unit. A control unit that controls the image sensor.

  The imaging device according to a second aspect is the imaging device according to the first aspect, wherein the control unit sets the main scanning direction to a horizontal direction or a vertical direction while a predetermined operation is performed on the operation unit. On the other hand, when the predetermined operation is not being performed on the operation unit, an image signal is read from the image sensor with the main scanning direction as the other of the horizontal direction and the vertical direction. As described above, the imaging device is controlled.

  The imaging device according to a third aspect is the imaging device according to the first or second aspect, wherein the imaging element includes an imaging unit of an XY address method, a horizontal scanning unit that scans the imaging unit by an XY address method, and A vertical scanning unit; a main scanning direction control unit that controls the horizontal scanning unit and the vertical scanning unit according to a main scanning direction control signal that determines whether a main scanning direction is a horizontal direction or a vertical direction; And an output unit that outputs an image signal read as a result of scanning the imaging unit by the vertical scanning unit, and the control unit sets a direction set according to an operation signal from the operation unit. The main scanning direction control signal shown is sent to the main scanning direction control unit.

  In the imaging device according to a fourth aspect, in any one of the first to third aspects, a storage unit that temporarily stores image data based on an image signal read from the imaging element and the main scanning direction are switched. And a means for changing the image direction vertically and horizontally when the image data is read from the storage means.

  According to the present invention, it is possible to provide an imaging apparatus capable of obtaining an image with reduced rolling distortion even when a subject moves at a relatively high speed.

1 is a schematic block diagram illustrating an imaging apparatus according to a first embodiment of the present invention. It is a figure which shows an example of the state of a to-be-photographed object typically. It is a figure which shows the main scanning direction typically. 3 is a schematic flowchart illustrating an example of an operation of the imaging apparatus illustrated in FIG. It is a schematic flowchart which shows an example of operation | movement of the imaging device by 2nd Embodiment of this Embodiment.

  Hereinafter, an imaging device according to the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a schematic block diagram showing an imaging apparatus 1 according to the first embodiment of the present invention. The imaging device 1 according to the present embodiment is configured as an electronic camera.

  A photographing lens 2 is attached to the imaging apparatus 1 according to the present embodiment. The photographing lens 2 is driven by a lens control unit 3 for focus and diaphragm. In the image space of the photographic lens 2, an imaging surface of the imaging element 4 of the XY address system is arranged.

  The imaging element 4 is driven by a control signal output from the imaging control unit 5 and outputs an image signal. The image signal output from the image sensor 4 is processed through the signal processing unit 6 and the A / D conversion unit 7 and then temporarily stored in the memory 8. The memory 8 is connected to the bus 9. The bus 9 is also connected with a lens control unit 3, an imaging control unit 5, a CPU 10, a recording unit 11, an image processing unit 12, an image compression unit 13, a display unit 14, and the like. An operation unit 15 such as a button or a touch panel is connected to the CPU 10. A recording medium 11a is detachably attached to the recording unit 11. The signal processing unit 6 and the A / D conversion unit 7 may be mounted on the image sensor 4.

  In the present embodiment, the image pickup device 4 is an image pickup unit (area) that scans by an XY address method, similar to the focal plane shutter type image sensor used in the camera system disclosed in Patent Document 1. Sensor) 21, horizontal scanning unit 22 that scans the imaging unit 21 in the horizontal direction according to the XY address system, vertical scanning unit 23 that scans in the vertical direction, and the horizontal scanning unit 22 and the vertical scanning unit 23. The horizontal scanning unit 22 and the vertical scanning unit 23 according to a main scanning direction control signal for determining whether the main scanning direction is a horizontal direction or a vertical direction, and an output unit 24 that outputs an image signal read as a result of scanning And a main scanning direction control unit 25 for controlling.

  The imaging control unit 5 supplies a control signal including the main scanning direction control signal to the imaging element 4 under the control of the CPU 10, thereby setting the main scanning direction according to the operation signal from the operation unit 15. The image sensor 4 is controlled so that an image signal is read out from the image sensor 4 (the set direction of the horizontal direction and the vertical direction). In the present embodiment, the imaging control unit 5 sends a main scanning direction control signal indicating the direction set according to the operation signal from the operation unit 15 to the main scanning direction control unit 25 under the control of the CPU 10. .

  FIG. 2 is a diagram schematically illustrating an example of the state of the subject 100. In the example illustrated in FIG. 2, the subject 100 is an automobile that is traveling in the horizontal direction.

  FIG. 3 is a diagram schematically showing the main scanning direction. FIG. 3A schematically shows a state in which an image signal is read from the image sensor 4 (particularly, the imaging unit 21) with the main scanning direction as the horizontal direction. FIG. 3B schematically shows a state in which an image signal is read from the image sensor 4 (particularly, the imaging unit 21) with the main scanning direction as a vertical direction.

  FIG. 4 is a schematic flowchart illustrating an example of the operation of the imaging apparatus 1 according to the present embodiment. FIG. 4 shows an operation mode (distortion reduction moving image shooting mode) for shooting a moving image with reduced rolling distortion.

  The distortion reduction moving image shooting mode is started when the operation unit 15 performs an operation for starting the distortion reduction moving image shooting mode.

  When the distortion reduction video shooting mode is started, the CPU 10 first inputs whether the moving direction of the subject or the imaging apparatus 1 (the relative moving direction of the subject) is close to the horizontal direction or the vertical direction by the operation unit 15. If it is not input, it waits until it is input. However, although not shown in the drawing, if it is not input even after a predetermined time-out period has elapsed, the distortion reduction moving image shooting mode is terminated. For example, when the moving direction of the subject 100 to be photographed is the horizontal direction as shown in FIG. 2, the photographer performs an operation to the effect that the moving direction is close to the horizontal direction.

  If it is determined in step S1 that the movement direction of the subject or the imaging apparatus 1 (the relative movement direction of the subject) is close to the horizontal direction or the vertical direction, the CPU 10 determines that the input movement direction is close. It is determined whether or not the direction is horizontal (step S2). If it is determined that the input moving direction is horizontal, the CPU 10 sets the main scanning direction to the vertical direction (step S3), and then proceeds to step S5. On the other hand, if it is determined that the input moving direction is not horizontal (vertical) when close, the CPU 10 sets the main scanning direction to horizontal (step S4), and then proceeds to step S5.

  In step S <b> 5, the CPU 10 determines whether or not an operation for starting moving image shooting is performed by the operation unit 15, and waits until the operation is performed if the operation is not performed. However, although not shown in the drawing, if the operation is not performed even after a predetermined time-out period has elapsed, the distortion reduction moving image shooting mode is terminated.

  If it is determined in step S5 that an operation to start moving image shooting has been performed, the CPU 10 causes the imaging control unit 5 to output an image signal of one frame from the imaging device 4 with the main scanning direction as the currently set direction. The image sensor 4 is controlled so as to be read (step S6). At this time, if the currently set main scanning direction is the vertical direction set in step S3, a main scanning direction control signal for setting the main scanning direction to the vertical direction is sent from the imaging control unit 5 to the main scanning direction control unit 25. The imaging unit (area sensor) 21 has a main scanning direction as a vertical direction and a sub-scanning direction as a horizontal direction (that is, the main scanning unit is a vertical scanning unit 23 and the sub-operation unit is a horizontal scanning unit 22). The image signal obtained by the main scanning and the sub scanning is output via the output unit 24. On the other hand, if the currently set main scanning direction is the horizontal direction set in step S4, a main scanning direction control signal for setting the main scanning direction to the horizontal direction is sent from the imaging control unit 5 to the main scanning direction control unit 25. The imaging unit (area sensor) 21 is set to the main scanning direction as the horizontal direction and the sub-scanning direction as the vertical direction (that is, the main scanning unit as the horizontal scanning unit 22 and the sub-operation unit as the vertical scanning unit 23). The image signal obtained by scanning / sub-scanning is output via the output unit 24. The image signal output from the output unit 24 is amplified or the like by the signal processing unit 6, converted to image data composed of a digital signal by the A / D conversion unit 7, and temporarily stored in the memory 8.

  Next, the CPU 10 reads the image data temporarily stored in the memory 8 in step S6 from the memory 8 and records it on the recording medium 11a by the recording unit 11 (step S7). The image signal read from the image sensor 4 with the main scanning direction as the vertical direction is obtained by vertical and horizontal conversion of the image signal read from the image sensor 4 with the main scanning direction as the horizontal direction. Therefore, in the present embodiment, in order to make both the vertical and horizontal directions coincide with each other, in step S7, the CPU 10 reads the image data once stored in the memory 8 in step S6 from the image sensor 4 with the main scanning direction as the vertical direction. If the image data is based on the image signal, the image data is recorded in the recording medium 11a by converting the image data when the image data is read out from the memory 8, while the image once stored in the memory 8 in step S6. When the data is based on the image signal read from the image sensor 4 with the main scanning direction as the horizontal direction, the image data is recorded in the recording medium 11a without being subjected to vertical / horizontal conversion when the image data is read from the memory 8. To record. Note that the image data to be vertically and horizontally converted may be reversed.

  After step S7, the CPU 10 determines whether or not an operation for ending the distortion reduction moving image shooting mode is performed by the operation unit 15 (step S8). If the operation is not performed, the process returns to step S6. On the other hand, if it is determined in step S8 that an operation to end the distortion reduction moving image shooting mode has been performed, the CPU 10 ends the distortion reduction moving image shooting mode.

  According to the present embodiment, when the moving direction of the subject or the imaging apparatus 1 is close to the horizontal direction, the fact is input by the operation unit 15, so that the image from the imaging element 4 is set with the main scanning direction as the vertical direction. The signal is read out. On the other hand, when the moving direction of the subject or the image pickup apparatus 1 is close to the vertical direction, an image signal is read from the image pickup device 4 with the main scanning direction as the horizontal direction by inputting the fact through the operation unit 15. Therefore, according to the present embodiment, rolling distortion is reduced.

  According to the present embodiment, the main scanning direction is set not by the subject motion vector generated based on the image signal read from the image sensor 4 but by the operation signal from the operation unit 15. Therefore, an image with reduced rolling distortion can be obtained even when the subject moves at a relatively high speed. Further, according to the present embodiment, it is not necessary to generate the motion vector, so that the processing burden can be reduced. Further, according to the present embodiment, the processing load can be reduced, so that it is not necessary to employ a processing circuit or the like having a high processing capability, and the cost can be reduced.

  Although not shown in the drawings, in this embodiment, in addition to the above-described distortion reduction moving image shooting mode, a normal moving image shooting mode is also performed. The normal moving image shooting mode is an operation mode for capturing a moving image without performing processing for reducing rolling distortion. In brief, the normal moving image capturing mode is started when an operation for starting the normal moving image capturing mode is performed by the operation unit 15. When the normal moving image capturing mode is started, steps S6 to S8 in FIG. 4 are performed without performing steps S1 to S5 in FIG. However, in the normal moving image pickup mode, in step S6, the image pickup control unit 5 controls the image pickup element 4 so that an image signal of one frame is read from the image pickup element 4 with the main scanning direction always being the horizontal direction.

[Second Embodiment]
FIG. 5 is a schematic flowchart showing an example of the operation of the imaging apparatus according to the second embodiment of the present embodiment. FIG. 5 shows the moving image shooting mode.

  The present embodiment differs from the first embodiment in this embodiment in that a push button (not shown) called a “moving direction horizontal button” is provided as a part of the operation unit 15. In this embodiment, the moving image shooting mode shown in FIG. 5 is performed instead of the distortion-reducing moving image shooting mode and the normal moving image shooting mode in the first embodiment.

  The movement direction horizontal button is operated differently in a pressed state (a state in which a pressing operation is performed as a predetermined operation) and a non-pressed state (a state in which the pressing operation is not performed as the predetermined operation). A push button for supplying a signal to the CPU 10. The moving direction horizontal button is a push button that is pressed when the moving direction of the subject or the imaging apparatus (the relative moving direction of the subject) is close to the horizontal direction, and is not pressed otherwise. The predetermined operation is not limited to the push operation, and other operation means may be used instead of the push button.

  In the present embodiment, the moving image shooting mode starts when the operation unit 15 performs an operation for starting the moving image shooting mode. When the moving image shooting mode is started, the CPU 10 determines whether or not the moving direction horizontal button is pressed (whether or not the moving direction horizontal button is being pressed). If not, the process proceeds to step S12. On the other hand, if it is pressed, the process proceeds to step S13.

  In step S <b> 12, the CPU 10 controls the image sensor 4 so that an image signal of one frame is read from the image sensor 4 with the main scanning direction as the vertical direction. At this time, a main scanning direction control signal whose vertical direction should be the main scanning direction is sent from the imaging control unit 5 to the main scanning direction control unit 25 so that the main scanning direction is the vertical direction and the sub-scanning direction is the horizontal direction (that is, The imaging unit (area sensor) 21 is main-scanned / sub-scanned with the main scanning unit as the vertical scanning unit 23 and the sub operation unit as the horizontal scanning unit 22, and the obtained image signal is output via the output unit 24. The The image signal output from the output unit 24 is amplified or the like by the signal processing unit 6, converted to image data composed of a digital signal by the A / D conversion unit 7, and temporarily stored in the memory 8.

  In step S <b> 13, the CPU 10 controls the image sensor 4 so that an image signal of one frame is read from the image sensor 4 with the main scanning direction as the horizontal direction. At this time, a main scanning direction control signal that should set the main scanning direction to the horizontal direction is sent from the imaging control unit 5 to the main scanning direction control unit 25, and the main scanning direction is set to the horizontal direction and the sub-scanning direction is set to the vertical direction (that is, The imaging unit (area sensor) 21 is main-scanned / sub-scanned with the main scanning unit as the horizontal scanning unit 22 and the sub operation unit as the vertical scanning unit 23, and the obtained image signal is output via the output unit 24. The The image signal output from the output unit 24 is amplified or the like by the signal processing unit 6, converted to image data composed of a digital signal by the A / D conversion unit 7, and temporarily stored in the memory 8.

  Next, the CPU 10 reads out the image data temporarily stored in the memory 8 in step S12 or S13 from the memory 8, and causes the recording unit 11 to record the image data on the recording medium 11a (step S14). The image signal read from the image sensor 4 with the main scanning direction as the vertical direction is obtained by vertical and horizontal conversion of the image signal read from the image sensor 4 with the main scanning direction as the horizontal direction. Therefore, in the present embodiment, in this embodiment, in order to match both the vertical and horizontal directions, in step S14, the CPU 10 reads the image data once stored in the memory 8 in step S6 from the image sensor 4 with the main scanning direction as the vertical direction. If the image data is based on the image signal, the image data is recorded in the recording medium 11a by converting the image data when the image data is read out from the memory 8, while the image once stored in the memory 8 in step S6. When the data is based on the image signal read from the image sensor 4 with the main scanning direction as the horizontal direction, the image data is recorded in the recording medium 11a without being subjected to vertical / horizontal conversion when the image data is read from the memory 8. To record. Note that the image data to be vertically and horizontally converted may be reversed.

  After step S14, the CPU 10 determines whether or not an operation for ending the moving image shooting mode is performed by the operation unit 15 (step S15). If the operation is not performed, the process returns to step S11. On the other hand, if it is determined in step S15 that an operation for ending the moving image shooting mode has been performed, the CPU 10 ends the moving image shooting mode.

  Also in this embodiment, the same advantages as those in the first embodiment can be obtained. In addition, according to the present embodiment, depending on whether or not the moving direction horizontal button is being pressed, reading of the image sensor 4 with the main scanning direction as the vertical direction and imaging device 4 with the main scanning direction as the vertical direction are performed. Therefore, the switching can be performed with excellent operability and speed. Therefore, according to the present embodiment, for example, even when the relative movement direction of the subject changes, it is possible to easily follow the change and perform the switching. An image with a reduced rolling distortion can be obtained following the change.

  In addition, in FIG. 5, you may deform | transform so that it may transfer to step S12, when it is NO at step S11, and to step S13, when it is YES at step S11.

  Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments.

  For example, each of the above embodiments is an example in which the present invention is applied to moving image shooting. However, the present invention may be applied to still image shooting using a rolling shutter or the like.

DESCRIPTION OF SYMBOLS 1 Imaging device 4 Imaging element 5 Imaging control part 8 Signal processing part 11 CPU
15 Operation unit

Claims (4)

An XY address image sensor;
An operation unit;
A control unit that controls the image sensor so that an image signal is read out from the image sensor with a main scanning direction set in accordance with an operation signal from the operation unit;
An imaging apparatus comprising:   While the predetermined operation is being performed on the operation unit, the control unit sets the main scanning direction to one of a horizontal direction and a vertical direction, while the predetermined operation is performed on the operation unit. The image pickup device is controlled so that an image signal is read from the image pickup device with the main scanning direction as the other of the horizontal direction and the vertical direction when the image pickup is not being performed. The imaging apparatus according to 1. The imaging device includes an XY addressing imaging unit, a horizontal scanning unit and a vertical scanning unit that scans the imaging unit using an XY addressing method, and whether a main scanning direction is a horizontal direction or a vertical direction. A main scanning direction control unit for controlling the horizontal scanning unit and the vertical scanning unit in accordance with a main scanning direction control signal for determining the image, and an image read out as a result of scanning the imaging unit by the horizontal scanning unit and the vertical scanning unit An output unit for outputting a signal,
3. The imaging according to claim 1, wherein the control unit sends the main scanning direction control signal indicating a direction set in accordance with an operation signal from the operation unit to the main scanning direction control unit. apparatus. Storage means for temporarily storing image data based on the image signal read from the image sensor;
Means for changing the image direction vertically and horizontally when the image data is read from the storage means when the main scanning direction is switched;
The imaging apparatus according to claim 1, further comprising:

Images