JP2002369083A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup device capable of always acquiring image data indicating an image having good quality by preventing the generation of any return distortion, and suppressing moire. SOLUTION: This image pickup device is provided with a photographing optical system 11 for forming an optical image by receiving a subject light, an image pickup element 14 for applying photoelectric conversion to the optical image formed by the photographing optical system, to convert the image into an image signal, and a driving control circuit 20 for controlling the driving of the image pickup element so that at least two scanning configurations, that is, the first scanning configuration that scanning is performed by using a plurality of pixels arranged on the image pickup face of the image pickup element without being accompanied with any thinning-out scanning and the second scanning configuration that scanning is performed by thinning- out a part of those pixels on the image pickup face of the image pickup element can be switched. The photographing optical system is constituted so that a plurality of optical low pass filters 12 for limiting the spatial frequency characteristics of an incident light flux can be included, and those low pass filters are respectively constituted of different spatial frequency characteristics, and the low pass filters are switched according to the first scanning configuration and the second scanning configuration.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus, and more particularly, to an image pickup device which receives an optical image formed by a photographing optical system that transmits an incident light beam from a subject, and performs photoelectric conversion using the image pickup device. Accordingly, the present invention relates to an imaging device configured to obtain an image signal corresponding to the optical image.

[0002]

2. Description of the Related Art In recent years, an image pickup device or the like which receives a subject image formed based on a light beam condensed by a photographing lens and is formed on a predetermined light receiving surface and performs photoelectric conversion is provided. An imaging device configured to generate a digital signal in a predetermined form by performing predetermined signal processing on an electrical signal or the like to be generated and to record the digital signal in a predetermined form on a predetermined recording medium is provided. It is generally put to practical use.

An image pickup element employed in a conventional general image pickup apparatus is formed by a plurality of pixels arranged in a matrix on a two-dimensional plane which is an image pickup surface (also referred to as a light receiving surface). There are things that are.

When image data is obtained using such an image sensor, all effective pixels (hereinafter abbreviated as "all pixels") that contribute to obtaining image data among all pixels included in the image sensor are used. Various driving methods, such as an “all-pixel driving mode” in which scanning is performed by driving a pixel, and a “block driving mode” in which scanning is performed by driving only some of the pixels of all the pixels of the image sensor. Some are designed to operate in form.

In this case, in order to perform various controls of the whole image pickup apparatus, such as switching control of the driving mode of the image pickup element, the conventional image pickup apparatus is formed by electric members such as a CPU and various electric circuits. Usually, a control circuit such as a so-called system controller is provided.

Various proposals have been made for an image pickup apparatus in which an image pickup element can be operated by a plurality of driving modes.
No. 08, JP-A-9-247689, and the like.

The image pickup apparatus disclosed in Japanese Patent Application Laid-Open No. 9-163208 has a plurality of pixels arranged on an image pickup surface of an image pickup device in addition to the above-mentioned "all pixel drive mode" and "block drive mode". It is configured to be able to operate in three scanning modes of a "skip driving mode" in which a so-called thinning scan is performed in which some pixels are thinned out and scanned. Therefore, in the imaging device, an imaging device capable of individually controlling the driving of each of a plurality of pixels forming the imaging device, that is, individual pixels can be arbitrarily (randomly) used (accessed). A CMD (Charge Modulation Device) type image sensor, which is an image sensor configured as described above, is employed.

FIG. 28, FIG. 29, and FIG. 30 are conceptual diagrams showing a part of the image pickup surface of a conventional image pickup device. FIG. FIG. 30 is a diagram illustrating a state when operating in the “block drive mode”, and FIG. 30 is a diagram illustrating a state when operating in the “skip drive mode”.

When the conventional image pickup device 114 operates in the "all pixel driving mode", all of a plurality of pixels arranged in a matrix on the image pickup surface as shown in FIG. That is, the output signal from each pixel is extracted in a dot-sequential manner with respect to all the pixels (see the hatched portion in FIG. 28).

Similarly, when the conventional image pickup device 114 operates in the "block drive mode", any of a plurality of pixels arranged in a matrix on the image pickup surface as shown in FIG. With respect to the pixels (see the hatched portion in FIG. 29) of a part of the region set as the target, only the output signals from the respective pixels in the target region are taken out in a dot-sequential manner (see the arrow in FIG. 29).

Similarly, when the conventional image pickup device 114 operates in the "skip drive mode", all pixels among a plurality of pixels arranged in a matrix on the image pickup surface as shown in FIG. Scanning is performed by thinning out pixels at predetermined intervals while targeting pixels (see FIG. 3).
Output signals from pixels (shaded by 0).

That is, in the "skip drive mode", a so-called thinning-out scan is performed by skipping (skipping) pixels at predetermined intervals, instead of sequentially scanning all arranged pixels. The image pickup device is driven and controlled so as to take out the pixel signals (see arrows in FIG. 30). FIG. 30 shows an example of “three-pixel thinning scan” in which pixel signals of three pixels are extracted.

These scanning modes are appropriately switched by a control circuit such as a system controller.

The optical image formed by the photographing lens is a continuous image. On the other hand, in a conventional general imaging apparatus, it is common to take out an output signal from each pixel of the imaging element in a dot-sequential manner.

That is, when an optical image is formed on the image pickup surface of the image pickup device by the photographing lens and photoelectric conversion is performed by the pixels of the image pickup device, sampling is performed. In this way, the image sensor acquires individual pixel signals by sampling.

In this case, when a high-frequency optical image of a pixel pitch or more is incident on a pixel on the image pickup surface of the image pickup device, aliasing (called moiré) occurs. Then, moire occurs in an image displayed based on the pixel signals acquired at this time.

In order to avoid this, it is necessary to remove more than one half of the sampling frequency from the high frequency components of the optical image incident on the pixels of the image sensor. For this purpose, in a conventional imaging apparatus, an optical low-pass filter (low-pass filter (R) that removes high-frequency components from an optical image formed by an incident light beam (object light beam) and limits the spatial frequency characteristics of the light beam. LPF); Low
In general, a pass filter (hereinafter, simply referred to as an optical low-pass filter) is arranged at a predetermined position in a space between a photographing lens and an image sensor.

In a normal case, the characteristics of the optical low-pass filter are set in accordance with the pixel pitch of the image sensor. Therefore, when operating in a driving mode (“all pixel driving mode” or “block driving mode”) in which output signals from each pixel of the image sensor are driven in a dot-sequential manner, an appropriate pixel signal is obtained. I am getting it. Therefore, in an image pickup apparatus equipped with a normal optical low-pass filter, an image displayed based on an image signal obtained when the image pickup element is operated in the “all pixel drive mode” or the “block drive mode” has moiré. It is to be possible to obtain a good image in which no image is generated.

However, an image pickup device having the same configuration, that is, an image pickup device constituted by using an optical low-pass filter having the same setting and the same image pickup device is operated in a "skip operation mode", and thus obtained. When an image is displayed on the basis of an image signal, moiré occurs even in the same subject image.

FIGS. 31 (A) to 31 (E) are conceptual diagrams for explaining a state in which moire occurs when sampling is performed by operating an image pickup device in a conventional image pickup apparatus. Note that, as described above, a plurality of pixels in a normal image sensor are arranged in a matrix on a two-dimensional plane. However, in FIG. Only the pixels of FIG.

FIG. 31A shows the pixels of the image sensor 114 when operating in the "all pixel driving mode" or the "block driving mode". In this case, the pixels from which the pixel signals are extracted are indicated by oblique lines, and the order of extracting the pixel signals is indicated by arrows. That is, in the “all pixel driving mode” or the “block driving mode”, scanning is performed for all pixels.

FIG. 31B shows the pixels of the image sensor 114 when operating in the "skip drive mode". In this case, the pixels from which the pixel signals are extracted are indicated by oblique lines, and the order of extracting the pixel signals is indicated by arrows. That is, in the “skip driving mode”, scanning is performed on pixels at predetermined intervals (every three pixels in this drawing).

FIG. 31C shows a frequency curve of the subject. The subject in this case is, for example, a subject in a form in which moiré easily occurs, that is, a striped subject formed at predetermined regular intervals.

FIG. 31D shows sampling points by the image sensor 114 when operating in the "all pixel driving mode" or the "block driving mode". Here, the waveform indicated by the solid line indicates the frequency curve of the subject image based on the sampling result.

FIG. 31E shows sampling points by the image sensor 114 when operating in the "skip drive mode". Here, the waveform shown by the broken line shows the frequency curve of the actual subject, and the waveform shown by the solid line shows the frequency curve of the subject image based on the sampling result.

In the image pickup apparatus disclosed in Japanese Patent Application Laid-Open No. 9-163208, when the image pickup device is operated in the "skip drive mode", scanning is performed by thinning out predetermined pixels among a plurality of pixels in the image pickup device. Since the imaging element is driven, the sampling interval increases (see FIG. 31).
(E)).

In this case, when the image pickup device is operated in the “skip drive mode” by using the optical low-pass filter set so as to match the pixel pitch of the image pickup device 114 as described above, it is sufficient. The high frequency component of the optical image cannot be removed. Therefore, the occurrence of aliasing distortion cannot be avoided, and moire is generated in an image formed based on the image signal obtained at this time.

[0028]

On the other hand, Japanese Patent Application Laid-Open No.
The image pickup apparatus disclosed in Japanese Patent No. 247689 is designed to suppress generation of moiré by performing addition processing or mixing processing on read pixel signals.

As described above, when the addition processing or the mixing processing of the pixel signals is performed, it is considered that the state becomes similar to the state when the image pickup device in which the light receiving area of each pixel is set to be larger is used. Can be. As described above, when an imaging element having a large pixel size is used, the sampling itself has the same effect as that of the optical low-pass filter, so that high frequency components of the subject image are removed.

Therefore, when the image pickup device is operated in the "skip drive mode", even if the optical low-pass filter is set to match the pixel pitch of the image pickup device, it is possible to suppress the occurrence of moire. It is possible.

FIGS. 32 (A) to 32 (D) show a conventional image pickup device in which the image pickup device is operated in a "skip drive mode" to perform sampling to extract a pixel signal, and then to obtain a predetermined pixel value for the obtained pixel signal. It is a conceptual diagram explaining the situation when performing signal addition processing or pixel signal mixing processing. Note that, also in this drawing, only pixels in the one-dimensional direction are shown for simplification of description.

FIG. 32A shows the image sensor 114 when operating in the "skip drive mode". In this case, the pixels from which the pixel signals are extracted are indicated by oblique lines, and the order of extracting the pixel signals is indicated by arrows. That is, in the “skip driving mode” in this example, a pixel signal is extracted from a predetermined number of pixels at predetermined intervals. In the figure, image signals corresponding to three adjacent pixels are taken out every three pixels.

FIG. 32B shows a frequency curve of the subject. The subject in this case is, for example, a subject in a form in which moire easily occurs, that is, a striped subject formed at predetermined regular intervals.

FIG. 32C shows sampling points by the image sensor 114 when operating in the "all pixel driving mode" or the like. The waveform (dotted line) shown here indicates the frequency curve of the subject image based on the sampling result.

FIG. 32D shows sampling points by the image sensor 114 when operating in the "skip drive mode", and shows a state after the pixel signal addition processing or the pixel signal mixing processing is performed as described above. ing. Here, the waveform indicated by the solid line indicates the frequency curve of the subject image based on the sampling result.

According to the means disclosed in the above-mentioned Japanese Patent Application Laid-Open No. 9-247689,
In order to drive the image sensor 114 in the “skip drive mode”, the image sensor is driven so as to perform scanning by thinning out predetermined pixels among a plurality of pixels in the image sensor, and the image signal thus obtained is converted into a pixel signal within a predetermined range. The addition process or the pixel signal mixing process suppresses an increase in the sampling interval (see FIG. 32D).

Accordingly, the occurrence of aliasing can be avoided, and the image formed based on the image signal obtained at this time becomes a high-quality image with reduced moire.

The present invention has been made in view of the above points, and has as its object to avoid the occurrence of aliasing distortion by means different from the means for suppressing moiré in a conventional imaging apparatus. Accordingly, it is an object of the present invention to provide an imaging device capable of suppressing false color components due to moiré and constantly acquiring image data representing an image of good image quality.

[0039]

In order to achieve the above object, an image pickup apparatus according to a first aspect of the present invention comprises: a photographing optical system for receiving a light beam from a subject to form an optical image; An imaging device that converts an optical image to be converted into an electric signal representing an image by performing photoelectric conversion, and a scan performed using a plurality of pixels arranged on an imaging surface of the imaging device, and includes a thinning scan. The imaging is performed so that at least two scanning modes can be switched between a first scanning mode that is not provided and a second scanning mode in which some of the pixels arranged on the imaging surface of the imaging device are thinned out and scanned. A drive control circuit for controlling the driving of the element, wherein the photographing optical system includes a plurality of optical low-pass filters for limiting the spatial frequency characteristics of the incident light beam, and the plurality of optical Low-pass filter Vessels, each made from a different spatial frequency characteristic, a first scan form in the second scanning mode, characterized by the use by switching the plurality of optical low-pass filter.

According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the second scanning mode includes a scanning mode with a plurality of different thinning rates. When performing scanning by thinning out some of the plurality of pixels arranged on the imaging surface of the imaging device based on the thinning rate, the drive control circuit determines the plurality of pixels in accordance with the thinning rate when scanning is performed. Is switched so as to be an optimum low-pass filter among the optical low-pass filters.

The image pickup apparatus according to the third aspect of the present invention includes a photographing optical system for forming an optical image by receiving a light beam from a subject, and an image formed by photoelectrically converting the optical image formed by the photographing optical system. An image sensor that converts the image signal into an electrical signal representing the image signal, and a drive control circuit that thins out and scans some of the plurality of pixels arranged on the imaging surface of the image sensor. In the case of scanning by thinning out some of the pixels, the readout pixels of the image sensor are switched for each frame or each field.

According to a fourth aspect, in the imaging apparatus according to the third aspect, when a part of the plurality of pixels of the image pickup element is scanned while being thinned, the image pickup device differs depending on the area of the image pickup surface of the image pickup element. In the scanning mode based on the thinning rate, the readout pixels of the image sensor are switched for each frame or each field.

According to a fifth aspect of the present invention, in the imaging apparatus according to the third aspect or the fourth aspect, when a part of the plurality of pixels of the image pickup device is scanned and thinned, scanning is performed for each frame or in a field. Each time the readout pixel of the image sensor is switched and read out, control is performed so that pixels of the same color are read out.

According to a sixth aspect of the present invention, in the imaging device according to any one of the third aspect, the fourth aspect, and the fifth aspect, a part of a plurality of pixels of the image sensor is provided. When scanning by thinning out the pixels, the total number of pixels when switching and reading out the readout pixels of the image sensor for each frame or field is controlled so that the same number of pixels are read out for each frame or field. It is characterized by.

According to a seventh aspect, in the imaging apparatus according to the third aspect, when a part of the plurality of pixels of the image sensor is scanned by thinning out, the signal addition processing is performed in units of a plurality of pixels. Alternatively, the readout pixel of the image sensor is changed for each frame or each field while performing the signal mixing process.

An imaging apparatus according to an eighth aspect of the present invention provides a photographing optical system for forming an optical image by receiving a light beam from a subject, and represents an image by photoelectrically converting the optical image formed by the photographing optical system. An image sensor that converts the image into an electric signal; and a drive control circuit that thins out and scans some of the plurality of pixels arranged on an imaging surface of the image sensor. In the case where scanning is performed by thinning out some of the pixels, there is provided variable means for relatively displacing the positional relationship of the image pickup device with respect to the light beam incident on the image pickup device.

According to a ninth aspect, in the imaging device according to the eighth aspect, the variable means can move the imaging element with respect to an incident position of an incident light beam.

According to a tenth aspect, in the imaging device according to the eighth aspect, the variable means is arranged at a position closer to a subject than an imaging surface of the imaging element, and adjusts a luminous flux incident on the imaging element. It is an optical member capable of displacing the incident position.

According to an eleventh aspect, in the imaging device according to the eighth aspect, the ninth aspect, or the tenth aspect, a part of a plurality of pixels of the image sensor is provided. In the case where scanning is performed by thinning out pixels, the readout pixels of the image sensor are switched for each frame or each field in a scanning mode with a different thinning rate depending on the area of the imaging surface of the image sensor.

According to a twelfth aspect, in the imaging apparatus according to the eighth aspect or the ninth, tenth, or eleventh aspect, a part of a plurality of pixels of the imaging element is provided. In the case of scanning by thinning out the pixels, when the readout pixels of the image sensor are switched and read out for each frame or field, control is performed so that pixels of the same color are read out.

According to a thirteenth aspect, in the imaging apparatus according to the eighth aspect or the ninth, tenth, eleventh, or twelfth aspect, the image pickup device includes a plurality of pixels of the image sensor. When scanning by skipping some pixels, the total number of pixels when switching and reading out the readout pixels of the image sensor for each frame or each field is set so that the same number of pixels are read for each frame or each field. It is characterized by controlling.

An imaging apparatus according to a fourteenth aspect of the present invention provides a photographing optical system for forming an optical image by receiving a light beam from a subject, and represents an image by photoelectrically converting the optical image formed by the photographing optical system. An image sensor that converts the image into an electric signal; and a drive control circuit that thins out and scans some of the plurality of pixels arranged on an imaging surface of the image sensor. In the case where scanning is performed by thinning out some of the pixels, a focal plane displacement unit that displaces a position of a focal plane at which an optical image formed on the image pickup device is focused is provided.

According to a fifteenth aspect, in the imaging apparatus according to the fourteenth aspect, the focal plane displacing means is means for displacing the arrangement of the image pickup device.

According to a sixteenth aspect, in the imaging apparatus according to the fourteenth aspect, the focal plane displacement means is means for displacing a part or the entire position of the photographing optical system.

An imaging apparatus according to a seventeenth aspect of the present invention provides a photographing optical system for forming an optical image by receiving a light beam from a subject, and represents an image by photoelectrically converting the optical image formed by the photographing optical system. An image pickup device that converts an electric signal into an electric signal, and a scan performed using a plurality of pixels arranged on an image pickup surface of the image pickup device. A drive control circuit for controlling the drive of the image sensor so that at least two scan modes can be switched between a second scan mode and a second scan mode in which some of the plurality of pixels are scanned out. The image forming apparatus further includes a variable unit that can relatively displace a positional relationship between an incident position of a light beam incident on the image sensor and the image sensor corresponding to the first scanning mode and the second scanning mode. I do.

According to an eighteenth aspect, in the imaging device according to the seventeenth aspect, the variable amount by the variable means is switchable in correspondence with the first scanning mode and the second scanning mode. Features.

According to a nineteenth aspect, in the imaging apparatus according to the seventeenth aspect or the eighteenth aspect, the variable means controls the drive so as to displace the arrangement of the imaging element with respect to the incident light beam. Features.

According to a twentieth aspect, in the imaging apparatus according to the seventeenth aspect or the eighteenth aspect, the variable means is arranged at a position closer to a subject than an imaging surface of the imaging device. It is an optical member capable of displacing the incident position of a light beam incident on the element.

[0059]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the illustrated embodiments. FIG. 1 is a main block diagram showing a schematic configuration of the imaging apparatus according to the first embodiment of the present invention.

The image pickup apparatus 1 of the present embodiment transmits a light beam (hereinafter, referred to as a subject light beam) from a subject to form a predetermined optical image (hereinafter, referred to as a subject image), and forms the optical image on a predetermined image pickup surface (light receiving surface). And a part of the photographing optical system provided to limit a high-frequency component of a subject image formed by a subject light beam transmitted through the photographing lens 11. Constituting optical low-pass filter (Low-pass filter; Low Pass Filter)
(LPF) 12 and a predetermined position on the optical path of a light beam transmitted through (the low-pass filter of) the photographing lens 11 and the optical low-pass filter unit 12. It has a mechanical shutter unit 13 for performing control and an image pickup surface composed of a plurality of pixels, and receives a subject image formed on the image pickup surface after entering from the photographing lens 11 and passing therethrough. An image sensor 14 that performs photoelectric conversion and outputs this as an analog image signal, and receives an analog image signal output from the image sensor 14 and performs various signal processing such as gain adjustment processing on the analog image signal. Analog signal-
A signal processing unit 15 that performs digital signal conversion processing and outputs a digital image signal, and various recording media such as a semiconductor memory, etc., and is optimal for receiving and recording a digital image signal output from the signal processing unit 15. A recording unit 16 that generates image data of the form described below and records the data, and receives a digital image signal output from the signal processing unit 15 and displays an image using a predetermined image display device (not shown) The most suitable form of electrical signal, for example, a standard television signal (NTSC (National Television)
A display signal processing unit 17 including a predetermined electric circuit and the like including a synchronization signal addition circuit and a D / A converter (none of which are shown) for converting the image signal into an image signal of a system (system control system) and outputting the converted signal. And an optical low-pass filter (Optical LP
F) A low-pass filter driving section (LPF filter driving section) 18 for controlling the driving of 12, a timing generating section 19 for generating a timing signal for driving the image pickup device 14, a CPU and various I / Fs (interfaces)
And a control signal such as output of a synchronization signal, switching timing of various operation modes in the image pickup apparatus 1 and scanning form of the image pickup device 14 and the like, and supervises overall control of the image pickup apparatus 1. And a control circuit (hereinafter, referred to as a system controller) 20 for performing the operation.

The system controller 20 is electrically connected to a mechanical shutter unit 13, a signal processing unit 15, a recording unit 16, a display signal processing unit 17, an LPF driving unit 18, a timing generation unit 19, and the like. Is controlling the operation of

The image pickup device 14 in the present image pickup apparatus 1 performs scanning using a plurality of pixels arranged on the image pickup surface of the image pickup device 14. In this case,
The image sensor 14 includes a first scanning mode that does not involve so-called thinning scanning, that is, an “all-pixel driving mode” or a “block driving mode”, and a part of a plurality of pixels arranged on an imaging surface of the image sensor 14. The operation is performed in at least two types of scans, that is, a “skip drive mode”, which is a second scan mode in which pixels are skipped and scanned. The two scanning modes are switched by drive control by the system controller 20. That is, the system controller 20 controls the timing generation unit 1
9 serves as a drive control circuit for controlling the drive of the image sensor 14.

The mechanical shutter unit 13 is provided at a predetermined position on the optical path of the luminous flux of the subject as described above, and is configured to be able to pass or block the luminous flux of the subject by performing opening and closing operations. Have been.
By controlling the opening and closing operation of the mechanical shutter unit 13, it is possible to control the exposure time when the subject light flux is irradiated on the imaging surface of the imaging device 14.

For this purpose, the mechanical shutter unit 13
Are controlled by the system controller 20. That is, the mechanical shutter unit 13 operates according to a predetermined instruction signal transmitted from the system controller 20. For example, when the imaging apparatus 1 operates in the “all pixel driving mode”, the system controller 20 controls the mechanical shutter unit 13
Are controlled to perform opening and closing operations as appropriate. As a result, the exposure time of the image sensor 14 is controlled.

When the image pickup apparatus 1 operates in the "block drive mode" or the "skip drive mode", the system controller 20 controls the mechanical shutter unit 13 to be always open. As a result, a state in which a subject image is always formed on the image sensor 14 can be achieved, and a moving image can be taken without any trouble.

The image sensor 14 is controlled by a system controller 20 via a timing generator 19. In this case, the timing generator 1
Reference numeral 9 serves to control the switching of the operation mode of the image sensor 14 in accordance with an instruction signal transmitted from the system controller 20, output a timing signal corresponding to each operation mode to the image sensor 14, and the like.

The optical low-pass filter unit 12 includes an optical low-pass filter that is a plurality of low-pass filters having different spatial frequency characteristics. FIG. 2 is an essential configuration diagram conceptually showing an optical low-pass filter and members related to the optical low-pass filter in the imaging apparatus of the present embodiment.

As shown in FIG. 2, the optical low-pass filter unit 12 in the image pickup apparatus 1 of the present embodiment
A turret type in which a plurality of low-pass filters (12a, 12b, 12c) having different spatial frequency characteristics are incorporated in the periphery of 2d is adopted. In the present embodiment, an example is shown in which three optical low-pass filters are incorporated in the disk 12d.

The disk 12d of the optical low-pass filter unit 12 is rotatably supported on an internal fixing member (not shown) of the image pickup apparatus 1 at a rotation center indicated by reference numeral 12e.

As described above, the optical low-pass filter unit 12 is electrically connected to the system controller 20 via the LPF driving section 18. Thus, the system controller 20 can transmit a predetermined instruction signal to the optical low-pass filter unit 12 via the LPF driving section 18. Therefore, the rotation of the disk 12d of the optical low-pass filter unit 12 is controlled by the LPF driving unit 18 driven according to an instruction signal from the system controller 20.

In this case, the system controller 20 outputs a predetermined instruction signal corresponding to the scanning mode of the image sensor 14 to the LPF driving section 18. The LPF driving unit 18 receives this and rotates the disk 12d, thereby three low-pass filters (12a, 12b, 12c) incorporated in the disk 12d.
At least one of them is arranged in a space between the photographing lens 11 and the image sensor 14 at a predetermined position on the optical path of a subject light beam incident from the photographing lens 11.

As described above, the system controller 20 and L
The PF drive unit 18 is an optical low-pass filter unit 1
Of the two, it functions as a drive control circuit that drives and controls the optical low-pass filter unit 12 so that the low-pass filters (12a, 12b, and 12c) corresponding to the scanning mode during operation are arranged at predetermined positions.

The optical low-pass filter unit 12
The three low-pass filters (12a, 12b, 12c) incorporated in the circular plate 12d correspond to the case where the image pickup device 14 operates in the "all pixel driving mode" and the "block driving mode" which are the first scanning mode. To match the frequency characteristics of the pixel pitch of the image sensor 14 so that
4 corresponds to the frequency characteristic of the pixel pitch of the image sensor 14 when scanning by skipping pixels at a predetermined thinning rate so as to correspond to the case of operating in the “skip drive mode” which is the second scanning mode. And so on. Here, the thinning rate means a setting at the time of scanning indicated by a jump interval of a pixel from which a pixel signal is to be extracted.

Incidentally, in a general conventional image pickup apparatus, an image pickup element of a system of sequentially reading out pixel signals from a plurality of pixels arranged on an image pickup surface, that is, a CCD (Charge)
(Coupled Device) type imaging devices are widely used.

However, the image pickup device 14 in the image pickup apparatus 1 of the present embodiment is an XY address type image pickup device,
For example, a CMD (Charge Modulation Device) type imaging device is used. This type of image sensor is of a type different from a CCD image sensor that has been widely used in the past.

That is, the image pickup device 14 applied to the image pickup apparatus 1 of the present embodiment selects a pixel at an arbitrary position from a plurality of pixels arranged on the image pickup surface, and selects a pixel from the selected pixel. It is configured so that only signals can be extracted.

FIG. 3 is a configuration diagram of a main part conceptually showing a part of the image pickup device in the present image pickup apparatus.

As shown in FIG. 3, in the image sensor 14,
Each pixel 21 arranged in a matrix comprises a semiconductor switch (not shown) and a photodiode connected to one terminal of the semiconductor switch. The respective control terminals of the semiconductor switches provided in the pixels in the same column are connected to each other, and connected to the vertical signal output lines y1, y2, y3,... Of the vertical scanning shift register 22 for each column. The other terminals of the switches provided in the pixels on the same row are connected to each other, and the horizontal signal output lines x1, x2, x3,.
Are controlled by the semiconductor switches SW1, SW2,
SW3... Are connected to one terminal. The other terminals of the semiconductor switches SW1, SW2, SW3,... Are connected to the output signal line 24.

In the imaging device 14 configured as described above, the output signal from the vertical scanning shift register 22
The signal of the pixel in the row where the semiconductor switch provided in each pixel is turned on is read out to the output line of each column to which the pixel is connected. This signal is supplied to the switches SW1 and S1 driven by the horizontal scanning shift register 23.
.. Are sequentially read from the output terminals via W2, SW3,. At this time, it is also possible to select a plurality of pixels by one or both of the vertical scanning shift register 22 and the horizontal scanning shift register 23, and read out the signals of the plurality of pixels in a mixed manner. For example, vertical scan shift register 2
2 to select one row and three rows, and the horizontal scanning shift register 23
If columns 4 and 6 are selected, (x (column), y (row)) =
(4,1) ・ (4,3) ・ (6,1) ・ (6,3) 4
Pixel signals are added and read.

The imaging apparatus 1 of the present embodiment thus configured is controlled by the system controller 20 to operate in three modes, namely, “all pixel driving mode”, “block driving mode”, and “skip driving mode”. And it works by.

FIGS. 4A to 4E are conceptual diagrams showing the operation of the image pickup device in the image pickup apparatus of the present embodiment. It should be noted that a plurality of pixels of the image sensor 14 are arranged in a matrix (matrix) on the image plane, which is a two-dimensional plane. Is described only.

FIG. 4A shows the image pickup device 14 when the image pickup apparatus 1 operates in the “all pixel drive mode” or the “block drive mode”. In this case, the pixels from which the pixel signals are extracted are indicated by oblique lines, and the order of extracting the pixel signals is indicated by arrows. That is, in the “all pixel driving mode” or the “block driving mode”, scanning is performed for all pixels.

FIG. 4B shows the image pickup device 14 when the image pickup apparatus 1 operates in the “skip drive mode”. In this case, the pixels from which the pixel signals are extracted are indicated by oblique lines, and the order of extracting the pixel signals is indicated by arrows. That is, in the “skip driving mode”, scanning is performed on predetermined pixels at predetermined intervals.

FIG. 4C shows a frequency curve of the object. The subject in this case is, for example, a subject in a form in which moiré easily occurs, that is, a striped pattern formed at predetermined regular intervals.

FIG. 4D shows sampling points by the image sensor 14 when the image pickup apparatus 1 operates in the “all pixel driving mode” or the “block driving mode”. The waveform indicated by the solid line indicates a frequency curve of the subject image based on the sampling result.

FIG. 4E shows sampling points by the image pickup device 14 when the image pickup apparatus 1 operates in the “skip drive mode”. The waveform indicated by the solid line indicates a frequency curve of the subject image based on the sampling result.

When the imaging device 1 operates in the “all-pixel driving mode”, the system controller 20
4 to sequentially select the vertical scan shift register 22 and the horizontal scan shift register 23 of the image sensor 14;
Image signals from all the pixels 21 in the image sensor 14 are sequentially read. The exposure time in this case is controlled by the opening and closing operation of the mechanical shutter unit 13 controlled by the system controller 20.

Before the image pickup device 14 performs the actual scanning, the system controller 20
Is confirmed by a predetermined means that the set scanning mode is the “all pixel driving mode”, the switching driving of the optical low-pass filter unit 12 is performed via the LPF driving unit 18. Execute control.

In this case, for example, the present imaging device 1
When an operation member or the like that generates an instruction signal for performing a still image recording operation is operated by the operator, an instruction signal generated by operating the operation member is transmitted to the system controller 20. Then, the system controller 20 starts control based on the received instruction signal, and sets various settings for operating the image pickup device 14 of the image pickup apparatus 1 in the “all-pixel driving mode”, including the image pickup device 14. This is performed on the constituent members.

Next, the system controller 20 sets L
The optical low-pass filter unit 12 is controlled via the PF driving unit 18 so as to control the optical low-pass filter unit 1.
2 having three low-pass filters (12a, 12b,
12c), the low-pass filter corresponding to the “all pixel driving mode” in the image pickup apparatus 1 is arranged at a predetermined position on the optical axis of the photographing lens 11, that is, on the optical path of the subject light flux.

Here, the optical low-pass filter unit 1
2 having three low-pass filters (12a, 12b,
12c), for example, the low-pass filter 12a is referred to as a first low-pass filter corresponding to the “all-pixel driving mode” and the “block driving mode”. Further, the low-pass filter 12b is set to the second mode corresponding to the "skip drive mode".
It is called a low-pass filter.

The low-pass filter 12c serving as the third low-pass filter corresponds to the “skip drive mode” and corresponds to a thinning rate different from that of the above-described second low-pass filter 12b.

That is, as the second scanning mode among the scanning modes of the image pickup device 14 of the image pickup apparatus 1 of the present embodiment, not only scanning at a predetermined fixed thinning rate but also scanning at a plurality of different thinning rates. May be included. In this case, a low-pass filter corresponding to each thinning rate may be prepared and incorporated into the disk 12d. Then, a configuration may be employed in which a plurality of low-pass filters are switched to an optimal one among a plurality of low-pass filters according to a plurality of scanning modes (thinning rates). The switching control of the low-pass filter in this case may be configured to be driven and controlled by the system controller 20.

The description of the third low-pass filter 12c will be described in detail in a later-described modification of the present embodiment. Therefore, in the imaging device 1 of the present embodiment, the optical low-pass filter unit 12 only needs to be configured to include at least two types of low-pass filters 12a and 12b.

In this way, the preparation of the image pickup apparatus 1 for performing the scanning by the image pickup device 14 in the “all pixel driving mode” is completed.

In this state, a predetermined subject is scanned by the image sensor 14. Here, a description will be given by taking as an example a striped object which is a subject in which moiré easily occurs (see FIG. 4C).

The subject light flux transmitted through the first low-pass filter 12a of the photographing lens 11 and the optical low-pass filter unit 12 forms a subject image on the image pickup surface of the image pickup device 14 only when the mechanical shutter unit 13 is in the open state. .

At this time, the image pickup device 14 performs scanning in the “all pixel driving mode”. Then, the obtained image signal (an analog image signal obtained by photoelectric conversion by the image pickup device 14) is output to the signal processing unit 15. In response to this, the signal processing unit 15
Is subjected to predetermined signal processing for the image signal from. After that, the image signal after the signal processing is output to the recording unit 16.
In response to this, the recording unit 16 performs a predetermined conversion process on the image signal from the signal processing unit 15 so that the image signal is in an optimal form for recording, and then converts the resulting image data. It records in its own predetermined recording area.

Here, the image pickup apparatus 1 operates in the “all pixel driving mode”.
When the operation is performed, scanning for sequentially reading out image signals from the plurality of pixels 21 arranged on the imaging surface of the imaging element 14 is performed for all the pixels 21 (see FIG. 4A).

The image data recorded in this manner is
The subject image displayed based on the image data, which is the sampling point shown in FIG. 4D, can be represented in the form of a frequency curve shown in FIG. At this time, the high-frequency component of the subject image is restricted by the first low-pass filter 12a and the light beam optimized for the “all-pixel driving mode” is irradiated on the imaging surface of the imaging device 14, so that the subject image is Image data suitable for displaying a faithful image is obtained.

On the other hand, the image pickup apparatus 1 is in the “block drive mode”.
When the operation is performed, the system controller 20 controls the image sensor 14 to select the position (hereinafter, referred to as an address) of the vertical scan shift register 22 and the horizontal scan shift register 23 of the image sensor 14. The address selected here is an arbitrary address on the imaging surface of the imaging element 14, and is an address corresponding to the first pixel 21 of the readout area set in advance.

The reading area is an area arbitrarily set by the operator of the imaging apparatus 1. In this case, it can be realized by providing a means for arbitrarily setting a part of a region that can be photographed by an operator performing a predetermined operation prior to the photographing operation.

Alternatively, when operating the image pickup apparatus 1 in the “block drive mode”, a predetermined value may be called and set as a predetermined area. In this case, address information or the like of a predetermined area of the image sensor 14 is set in advance, and its default value is stored in a predetermined storage unit or the like (not shown). It can be realized by providing a means for calling this when operating.

Before the image sensor 14 executes the actual scanning, the system controller 20
Is confirmed by a predetermined means that the set scanning mode is the “block driving mode”, the switching drive control of the optical low-pass filter unit 12 via the LPF driving unit 18 is performed. Execute

Then, the optical low-pass filter unit 1
2 having three low-pass filters (12a, 12b,
12c), the first low-pass filter 12a corresponding to the "block drive mode" in the image pickup apparatus 1 is arranged at a predetermined position on the optical axis of the taking lens 11, that is, on the optical path of the subject light flux.

Then, the system controller 20 controls the image pickup device 14 to start scanning the image signal of the pixel 21 in the predetermined read area starting from the pixel 21 of the selected address. The scanning performed here is sequential reading similar to that in the above-described “all-pixel driving mode” (see FIG. 4A).

Note that the imaging apparatus 1 is in the “block drive mode”.
When the operation is performed with the mechanical shutter unit 13
Is controlled by the system controller 20 to be always in the open state. The analog image signal obtained by the image sensor 14 and subjected to photoelectric conversion and output is transmitted to a predetermined image display device (not shown) via the signal processing unit 15 and the display signal processing unit 17, and the like. To display a moving image.

The image data thus recorded is
Similar to the case of the “all pixel driving mode” described above, the sampling points shown in FIG. 4D, and the subject image displayed based on this image data is represented by the frequency curve shown in FIG. It becomes the form of. At this time, the image sensor 14
The high-frequency component of the subject image is limited by the first low-pass filter 12a on the image pickup surface of the “block driving mode”.
Thus, image data suitable for displaying an image faithful to the subject image can be obtained.

On the other hand, the image pickup apparatus 1 operates in a “skip drive mode”.
When the system controller 20 operates, the system controller 20 controls the image sensor 14 to select an address of the vertical scan shift register 22 and the horizontal scan shift register 23 of the image sensor 14. Here, for example, in order to select a pixel 21 from which an image signal is to be read by thinning and scanning every three pixels in both the horizontal direction and the vertical direction, all the addresses corresponding to the pixel 21 to be selected are selected. The image sensor 14 performs scanning based on the address data of the selected pixel. That is, the image signals from the selected pixels 21 are sequentially read.

Here, each address of the plurality of pixels 21 arranged on the imaging surface of the imaging element 14 is represented by, for example, (row, column) =
If it is indicated by (x, y), the pixel 2 selected to perform scanning when operating in the “skip drive mode”
The address of 1 is, for example, (1,1) · (4,1) · (7,1) ···· (1,4) · (4,4) · (7,4) ···· is there. The pixels 21 thus selected are sequentially read.

In this case as well, the mechanical shutter unit 13 is controlled to be always open as in the case of operating in the above-mentioned "block drive mode". That is, the analog image signal acquired by the image sensor 14 and subjected to photoelectric conversion and output is transmitted to a predetermined image display device (not shown) or the like via the signal processing unit 15 and the display signal processing unit 17. To display a moving image.

The image data recorded in this way is
4 (E), and the subject image displayed based on this image data is shown in FIG.
The form of the frequency curve shown in FIG. At this time, the second low-pass filter 12 is provided on the imaging surface of the imaging device 14.
Since the high-frequency component of the subject image is restricted by b and a light beam optimized for the “skip drive mode” is emitted, image data suitable for displaying an image faithful to the subject image is obtained.

As described above, in the imaging apparatus 1 of the present embodiment, when operating in the “all pixel driving mode” and the “block driving mode”, the frequency of the pixel pitch when the pixels of the image sensor 14 are not thinned out The drive of the optical low-pass filter unit 12 is controlled so as to use the first low-pass filter 12a matched to the characteristics.

When operating in the "skip drive mode", the second low-pass filter 12b adapted to the frequency characteristic of the pixel pitch when scanning by thinning out the pixels of the image sensor 14 at a predetermined thinning rate is used. The drive of the optical low-pass filter unit 12 is controlled so as to perform the operation.

In this case, drive control of the optical low-pass filter unit 12 according to the scanning mode of the image pickup device 14 is performed by the system controller 20 via the LPF drive unit 18.

By the way, in the above-described imaging apparatus 1 of the first embodiment, when operating in the "skip drive mode", the second low-pass filter 12b corresponding to a predetermined thinning rate is used. By changing the setting of the second low-pass filter 12b, it is easy to correspond to further different thinning rates. This is an effective means to cope with so-called electronic zoom or the like in which a part of image data is displayed in a form enlarged at an arbitrary magnification.

In order to realize this, it is necessary to adjust the pixel pitch of the image sensor 14 according to the frequency characteristic of the pixel pitch when scanning by thinning out the pixels of the image sensor 14 at a thinning rate different from the thinning rate suitable for using the second low-pass filter 12b. The optical low-pass filter unit 1
The second disk 12d may be additionally incorporated (see FIG. 2).

The system controller 20 according to the scanning mode selected prior to executing the photographing operation.
Controls the driving of the optical low-pass filter unit 12 via the LPF driving unit 18 to control a plurality of low-pass filters (12a, 12b, 12) according to the set scanning mode.
The optimum low-pass filter is selected from c), and the selected low-pass filter is arranged at a predetermined position on the optical axis of the photographing lens 11, that is, on the optical path of the subject light beam.

As described above, according to the first embodiment, the optical low-pass filter unit 12 having a plurality of low-pass filters (12a, 12b, 12c) according to the scanning mode of the image pickup device 14, and the optical low-pass filter unit 12 An LPF driving unit 18 for driving the low-pass filter unit 12, and the first, second, and third low-pass filters 12 a, 12 b, and 12 c that are optimal according to a scanning mode set prior to performing a photographing operation. One of them is selected by the system controller 20, and the system controller 20 drives and controls the optical low-pass filter unit 12 so that the selected low-pass filter is arranged at a predetermined position on the optical path of the subject light beam. Because of the configuration, “all pixel driving mode”, “block driving mode”
In any of the “skip drive modes”, the image sensor 1
Even when the scanning is performed by the method 4, it is possible to easily acquire and record image data that can always display a good image without generating a false color due to moire.

Further, even in the case of scanning in the "skip drive mode", different types of low-pass filters can be incorporated in the disk 12d of the optical low-pass filter unit 12 in advance so as to correspond to a plurality of thinning rates. For example, it is possible to easily cope with a case where an electronic zoom is performed.

Next, a second embodiment of the present invention will be described.
This will be described below.

In the first embodiment described above, the operation of the optical low-pass filter unit 12 having a plurality of types of low-pass filters is controlled so that the low-pass filter arranged on the optical path of the light beam of the subject is operated in the operation mode of the imaging apparatus 1. A means for switching to an optimum one is provided.

However, in the second embodiment described below, similar effects can be obtained only by performing electrical control when scanning the image sensor 14 in the “skip drive mode”. Therefore, the imaging device of the present embodiment is configured by removing the LPF driving unit 18 provided for driving the optical low-pass filter unit 12 from the imaging device 1 of the above-described first embodiment. .

FIG. 5 is a main block diagram showing a schematic configuration of an imaging apparatus according to the second embodiment of the present invention.

As shown in FIG. 5, the image pickup apparatus 1 of the present embodiment
The configuration of A is basically the same as the configuration of the imaging device 1 of the above-described first embodiment, and is different from the first embodiment in that the LPF driving unit 18 (see FIG. 1) of the first embodiment is not provided. different.

Although not shown in FIG. 5, the configuration of the optical low-pass filter 12A of this embodiment is also different from that of the optical low-pass filter unit 12 of the first embodiment.

That is, the optical low-pass filter 12A of the present embodiment is fixed at a predetermined position between the photographing lens 11 and the image pickup device 14 and on a predetermined position on the optical path of the subject light beam transmitted through the photographing lens 11. It is established. The optical low-pass filter 12A is set so as to have a frequency characteristic corresponding to a pixel pitch when scanning is performed in the “all-pixel driving mode”, for example. That is, the optical low-pass filter 12A of the present embodiment is configured by a single optical member adjusted to a predetermined spatial frequency.

As the image pickup device 14 in the image pickup apparatus 1A of the present embodiment, a CMD type image pickup device, which is an XY address type image pickup device, is used in the same manner as in the above-described first embodiment. Used similarly. Therefore, by controlling the image sensor 14 by the system controller 20, when scanning in the “skip drive mode”, an image signal from an arbitrarily selected pixel can be taken out.

In the image pickup apparatus 1A of the present embodiment, when the image pickup device 14 performs scanning in the “skip drive mode”, the system controller 20 sets a predetermined value among a plurality of pixels arranged on the image pickup surface of the image pickup device 14. Select the pixel of
The drive control is performed such that the address of the selected pixel, that is, the address of the pixel from which the image signal is to be extracted, is arbitrarily switched (changed) for each frame or each field. Thus, image data forming each frame or field is generated based on different pixel signals. The moving image reproduced and displayed based on the image data is a high-quality image in which false colors due to moiré are suppressed.

The operation when the image pickup device 14 of the image pickup apparatus 1A operates in the "skip drive mode" is schematically shown as follows.

FIG. 6, FIG. 7, FIG. 8, and FIG. 9 are views conceptually showing a part of the image pickup surface of the image pickup device in the image pickup apparatus of the present embodiment. The pixel is shown. Of these, FIG. 6 shows hatched pixels which are read out in the first frame when the image pickup device of the image pickup apparatus according to the present embodiment performs scanning in the “skip drive mode”. FIG. 7 similarly shows readout pixels of the second frame, FIG. 8 similarly shows readout pixels of the third frame, and FIG. 9 similarly shows readout pixels of the fourth frame.

In FIGS. 6 to 9, pixels indicated by oblique lines are appropriately selected each time under the control of the system controller 20, and pixel signals of the selected pixels are extracted. In other words, when the image sensor 14 operates in the “skip drive mode”, the pixel from which the image signal is to be read out is selected by thinning and scanning every three pixels in both the horizontal direction and the vertical direction. So-called three-pixel thinning is performed so that image signals are sequentially read.

An address for specifying each pixel of the image sensor 14 is set as follows.

That is, a pixel located at a predetermined position among the effective pixels on the image pickup surface of the image pickup device 14, for example, a pixel at a predetermined position at the upper left corner toward the image pickup surface is set as a base point. The address of each pixel is set for each three pixels in the direction, that is, three pixels × three pixels = 9 pixels as one block. For example, as shown in FIGS. 6 to 9, the address of each pixel is (row, column) = (Xmn, Ym
n). In this case, the symbol m = abcd,..., and the symbol n = 1. Specifically, address numbers Xa, Xb, Xc, Xd,... Are given for every three pixels in a horizontal row.
In addition, the address number Y for every three pixels in the vertical column
a, Yb, Yc, Yd...

Therefore, in this embodiment, the image pickup device 1
The selected pixels on the imaging surface of No. 4 are changed for each frame or for each field. In this case, the selected pixels of the first frame are (Xa1, Ya1) · (Xb1, Ya1) as shown in FIG. (Xc1, Ya1) (Xa1, Yb1) (Xb1, Yb1) (Xc1, Yb1) (Xa1, Yc1) (Xb1, Yc1) (Xc1, Yc1) ... The pixel at the address indicated by. Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the first frame.

As shown in FIG. 7, the selected pixels of the second frame are (Xa2, Ya1), (Xb2, Ya1), (Xc2, Ya1),... (Xa2, Yb1), (Xb2, Yb1). (Xc2, Yb1) (Xa2, Yc1) (Xb2, Yc1) (Xc2, Yc1)... Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the second frame.

As shown in FIG. 8, the selected pixels of the third frame are (Xa3, Ya1), (Xb3, Ya1), (Xc3, Ya1), (Xa3, Yb1), (Xb3, Yb1), (Xc3, Yb1) ··· (Xa3, Yc1) · (Xb3, Yc1) · (Xc3, Yc1) ················· Then, a pixel signal from each of the selected pixels is extracted and becomes image data for forming an image of the third frame.

As shown in FIG. 9, the selected pixels of the fourth frame are (Xa1, Ya2) · (Xb1, Ya2) · (Xc1, Ya2) ··· (Xa1, Yb2) · (Xb1, Yb2) · (Xc1, Yb2) ··· (Xa1, Yc2) · (Xb1, Yc2) · (Xc1, Yc2) ················· Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the fourth frame.

Hereinafter, although not shown, the ninth
(Xa3, Ya3) · (Xb3, Ya3) · (Xc3, Ya3) ··· (Xa3, Yb3) · (Xb3, Yb3) · (Xc3, Yb3) ··· (Xa3, Yc3) ). (Xb3, Yc3). (Xc3, Yc3)......... Thereafter, the above-described address setting of the first to ninth frames is repeated.

As described above, the imaging apparatus 1 according to the second embodiment
In A, when the image sensor 14 is scanned in the “skip drive mode”, the pixel signal of the pixel at the address shifted by one pixel at a time for each frame or field is taken out, so that the gap at the time of the thinning scan is obtained. Are sequentially taken out.

FIGS. 10A to 10H are conceptual diagrams showing the operation of the image pickup device in the image pickup apparatus of the present embodiment. It should be noted that a plurality of pixels of the image sensor 14 are arranged in a matrix (matrix) on the image plane, which is a two-dimensional plane. Is described only.

FIGS. 10 (A), 10 (B), 10
(C) shows the imaging device 14 when the imaging device 1A operates in the “skip drive mode”. In this case, a selected pixel from which a pixel signal is to be extracted is indicated by oblique lines.

FIG. 10A shows the selected pixels in the first frame, FIG. 10B shows the selected pixels in the second frame, and FIG. 10C shows the selected pixels in the third frame. , Respectively. Since the subsequent frames are the same, they are not shown.

FIG. 10D shows a frequency curve of the subject. The subject in this case is, for example, a subject in a form in which moiré easily occurs, that is, a striped pattern formed at predetermined regular intervals.

FIG. 10E shows the sampling points of the first frame when the imaging apparatus 1A operates in the “skip drive mode”. Note that the waveform shown by the solid line shows the frequency curve of the subject image based on the sampling result, and the waveform shown by the dotted line shows the frequency curve of the actual subject.

FIG. 10F shows the sampling points of the second frame when the imaging apparatus 1A operates in the “skip drive mode”. Note that the waveform shown by the solid line shows the frequency curve of the subject image based on the sampling result, and the waveform shown by the dotted line shows the frequency curve of the actual subject image.

FIG. 10G shows the sampling points of the third frame when the image pickup apparatus 1A operates in the “skip drive mode”. Note that the waveform shown by the solid line shows the frequency curve of the subject image based on the sampling result, and the waveform shown by the dotted line shows the frequency curve of the actual subject image.

FIG. 10H shows a frequency curve of a subject image obtained as a result of integrating an image sampled for each frame.

In the image pickup apparatus 1A of the present embodiment, when the image pickup device 14 is operated in the “skip drive mode”, FIG.
As shown in FIG. 0 (A) to FIG. 10 (C), the pixel signal of the pixel 21 of the address shifted by one pixel for each frame is extracted. That is, in the first frame, as shown in FIG. 10A, pixel signals are extracted from the selected pixels denoted by reference numerals [1], [4], [7],. Also, in the second frame, as shown in FIG.
[8] A pixel signal is extracted from the selected pixel.
Then, in the third frame, as shown in FIG. 10C, pixel signals are extracted from the selected pixels denoted by reference numerals [3], [6], [9],. In the subsequent frames, a predetermined selected pixel signal is similarly extracted.

In the image for each frame formed from the pixel signals obtained in this way, FIG.
As shown in FIG. 10 (G), moire occurs. However, in this case, since the sampling point is different for each frame, the phase of the moire generated in each frame image is different.

Incidentally, the resolution of the human eye is about 1/1.
0 seconds (sec.). On the other hand, when displaying a moving image on a general image display device,
Usually, it is performed at 30 frames / second. Therefore, such a moving image is seen by the human eye by integrating images for several fields.

Therefore, as shown in FIG. 10 (H), the moire generated in the image for each frame is observed as an image in which several fields are integrated and averaged. A high-quality image in which the moiré itself is suppressed is observed.

As described above, according to the second embodiment, when scanning in the "skip drive mode", the image pickup device 14 is electrically controlled and only the pixels 21 to be taken out are arbitrarily selected. Thus, the occurrence of moire can be suppressed. Therefore, it is not necessary to add a new component in the imaging apparatus, and good image data can be obtained easily and inexpensively.

In the second embodiment described above,
The selection pixel from which the pixel signal is to be read is changed for each frame (see FIGS. 6 to 10), but is not limited to this, and may be changed for each field, for example.
In this means, when the system controller 20 controls the imaging device 14, control such as pixel selection timing and pixel signal extraction timing can be easily realized by adapting from frame-by-frame timing to field-by-field timing. Can be.

In the above-described second embodiment, the imaging device 1A
When the image pickup device 14 operates in the “skip drive mode”, a means for changing a selected pixel from which a pixel signal is read for each frame or each field is used. In this case, the change of the selected pixel is performed in such a manner that it is shifted by one pixel for each frame or each field. Here, the change of the selected pixel performed for each frame or each field is not limited to such a regular one, and the selection of the pixel may be performed irregularly.

In the following third embodiment of the present invention, when the image pickup device performs scanning in the “skip drive mode”, the change interval (pixel shift interval) of the selected pixel for each frame or field is irregular. The pixel interval is set. Specifically, the vertical pixel shift interval is kept constant, while the horizontal pixel shift interval is irregularly changed.

The basic configuration of this embodiment is exactly the same as that of the second embodiment, except that the control of the image pickup device 14 by the system controller 20 is different. Therefore, a detailed description of the configuration of the imaging device 1A itself is omitted, and the first and second configurations described above are omitted.
Reference is made to the embodiment.

Further, in this embodiment, an example is shown in which the selected pixel is changed for each frame, as in the second embodiment described above. However, the selection of the pixel and the pixel signal from the selected pixel are performed. The same applies to the case where the extraction is changed for each field.

FIGS. 11 and 12 are views conceptually showing a part of the image pickup surface of the image pickup device in the image pickup apparatus according to the third embodiment of the present invention, and show a plurality of pixels arranged on the image pickup surface. Is shown. Among them, FIG. 11 shows hatched pixels corresponding to the second frame when the image pickup device of the image pickup apparatus according to the present embodiment performs scanning in the “skip drive mode”. Similarly, FIG. 12 shows a pixel corresponding to the third frame. Note that the readout pixels of the first frame are exactly the same as those in FIG.

In FIG. 6, FIG. 11 and FIG. 12, pixels indicated by oblique lines are appropriately selected each time under the control of the system controller 20, and pixel signals of the selected pixels are extracted. That is, in the present embodiment, when the image sensor 14 operates in the “skip drive mode”, the thinning-out scanning is performed at irregular intervals in the horizontal direction and at regular intervals of three pixels in the vertical direction. . In this case, the address of each pixel of the image sensor 14 is as follows.

That is, as shown in FIG. 6, the selected pixels of the first frame are (Xa1, Ya1) · (Xb1, Ya1) · (Xc1, Ya1) ··· (Xa1, Yb1) · (Xb1, Yb1) · (Xc1, Yb1) ··· (Xa1, Yc1) · (Xb1, Yc1) · (Xc1, Yc1) ·················· Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the first frame.

The selected pixels in the second frame are shown in FIG.
(Xa2, Ya1) · (Xb3, Ya1) · (Xc3, Ya1) ··· (Xa2, Yb1) · (Xb3, Yb1) · (Xc3, Yb1) ··· (Xa2, Yc1) · (Xb3, Yc1) · (Xc3, Yc1) ································ Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the second frame.

As shown in FIG. 12, the selected pixels in the third frame are (Xa3, Ya1) · (Xb2, Ya1) · (Xc2, Ya1) ··· (Xa3, Yb1) · (Xb2, Yb1) · (Xc2, Yb1) ··· (Xa3, Yc1) · (Xb2, Yc1) · (Xc2, Yc1) ················· Then, a pixel signal from each of the selected pixels is extracted and becomes image data for forming an image of the third frame.

Hereinafter, although not shown, the ninth
(Xa3, Ya3) · (Xb2, Ya3) · (Xc2, Ya3) ··· (Xa3, Yb3) · (Xb2, Yb3) · (Xc2, Yb3) ··· (Xa3, Yc3) ). (Xb2, Yc3). (Xc2, Yc3)......... Thereafter, the above-described address setting of the first to ninth frames is repeated.

As described above, in the image pickup apparatus of the third embodiment, when the image pickup device 14 is scanned in the “skip drive mode”, the selected pixels are changed irregularly for each frame or each field. The pixel signal of the selected pixel is extracted for each frame or each field.

The operation of the image pickup device in the image pickup apparatus in which drive control is performed in this manner is substantially the same as that of the above-described second embodiment.

The effect obtained by this is substantially the same as that of the second embodiment. In addition, according to the imaging apparatus of the present embodiment, the sampling interval is irregular because the pixels selected for each frame or each field are irregular only in the horizontal direction. Moire generated in an image for each frame or for each field can also be suppressed. Therefore, a moving image formed by such a frame or a field can be a high-quality image in which moire is more effectively suppressed.

Next, a fourth embodiment of the present invention will be described.
This will be described below.

In the fourth embodiment of the present invention, the change interval (pixel shift interval) of the selected pixel for each frame or each field performed when the image pickup device performs scanning in the "skip drive mode" is irregular. It is the same as in the above-described third embodiment that the pixel interval is set to be as follows. However, in this embodiment, the vertical pixel shift interval and
The difference is that both the horizontal pixel shift intervals are irregularly changed.

Therefore, the basic configuration of this embodiment is exactly the same as that of the second and third embodiments described above, except that the control of the image pickup device 14 by the system controller 20 is different. It is. Therefore, a detailed description of the configuration of the imaging apparatus itself will be omitted, and the description of each of the above embodiments will be referred to in the present embodiment.

In this embodiment, an example is shown in which the selected pixel is changed for each frame as in the third embodiment described above. However, the selection of the pixel and the pixel signal from the selected pixel are performed. The same applies to the case where the extraction is changed for each field.

FIGS. 13 and 14 are diagrams conceptually showing a part of the image pickup surface of the image pickup device in the image pickup apparatus according to the fourth embodiment of the present invention, and show a plurality of pixels arranged on the image pickup surface. Is shown. Of these, FIG. 13 shows hatched pixels corresponding to the second frame when the image sensor of the image capturing apparatus according to the present embodiment performs scanning in the “skip drive mode”. Similarly, FIG. 14 shows a pixel corresponding to the third frame. Note that the readout pixels of the first frame are exactly the same as those in FIG.

In FIGS. 6, 13 and 14, pixels indicated by oblique lines are appropriately selected each time under the control of the system controller 20, and pixel signals of the selected pixels are extracted. That is, in the present embodiment, when the image sensor 14 operates in the “skip drive mode”, the thinning-out scanning is performed at irregular intervals in both the horizontal and vertical directions. In this case, the address of each pixel of the image sensor 14 is as follows.

That is, as shown in FIG. 6, the selected pixels of the first frame are (Xa1, Ya1) · (Xb1, Ya1) · (Xc1, Ya1) (Xa1, Yb1) · (Xb1, Yb1) · (Xc1, Yb1) ··· (Xa1, Yc1) · (Xb1, Yc1) · (Xc1, Yc1) ·················· Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the first frame.

The selected pixels in the second frame are shown in FIG.
(Xa1, Ya2) · (Xb3, Ya1) · (Xc2, Ya3) ··· (Xa3, Yb1) · (Xb2, Yb2) · (Xc3, Yb2) ··· (Xa1, Yb1) · (Xb1, Yc1) · (Xc2, Yc1) ··································· Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the second frame.

The selected pixels of the third frame are (Xa2, Ya3), (Xb1, Ya2), (Xc2, Ya1), (Xa1, Yb2), (Xb3, Yb3), as shown in FIG. (Xc1, Yb3) ··· (Xa3, Yc1) · (Xb2, Yc1) · (Xc3, Yc1) ·················· Then, a pixel signal from each of the selected pixels is extracted and becomes image data for forming an image of the third frame.

As described above, in the image pickup apparatus according to the fourth embodiment, when the image pickup device 14 is scanned in the “skip drive mode”, the selected pixels are changed irregularly for each frame or each field. The pixel signal of the selected pixel is extracted for each frame or each field.

The operation of the image pickup device in the image pickup apparatus whose drive is controlled in this manner is the same as that of the above-described second / third operation.
This is substantially the same as the embodiment.

The effect obtained by this is almost the same as in the second and third embodiments. In addition, according to the imaging apparatus of the present embodiment, the pixels selected for each frame or each field are irregular in both the horizontal direction and the vertical direction. As a result, the sampling interval becomes more irregular, so that moire generated in an image for each frame or for each field can be more effectively suppressed. Therefore, this makes it possible to obtain image data representing a high-quality image in which the occurrence of moire is suppressed.

By the way, in a general image pickup device, the amount of signal charge stored changes in accordance with the intensity of light of an optical image formed on an image pickup surface, that is, light and dark, so that an amplitude change of an output signal is obtained. It is configured. This output signal does not include color information (color information). Therefore, it is not possible to generate image data capable of displaying a color image (color image) based on the output signal.

Therefore, various means for displaying a color image based on the output signal from the image sensor have been proposed and put to practical use. For example, by using optical means to obtain information corresponding to the wavelength of light, that is, a signal corresponding to three primary colors of R, G, and B, which are color information, color information is obtained from an output signal of the image sensor. Is generally used.

Specifically, for example, in the case of a normal single-panel imaging device, a color filter array (R, G, B, etc.) corresponding to each of a plurality of pixels arranged on the imaging surface of the imaging device ( filter array) is disposed in the vicinity of the imaging surface of the imaging device.

Next, a fifth embodiment of the present invention will be described.
In an image pickup apparatus having an image pickup device provided with a color filter array, it is intended to obtain image data capable of suppressing occurrence of moiré and displaying an image of good quality when scanning is performed in a “skip drive mode”.

The configuration of the present embodiment is basically similar to the above-described second, third and fourth embodiments, and further includes a color filter array near the imaging surface of the imaging device. Is what it is. Other configurations are completely the same as those of the imaging devices of the second, third, and fourth embodiments. Therefore, also in the present embodiment, a detailed description of the configuration of the imaging apparatus itself is omitted, and the description of each of the above-described embodiments will be referred to.

FIGS. 15, 16 and 17 show a fifth embodiment of the present invention.
FIG. 4 is a diagram conceptually showing a part near an imaging surface of an imaging device in the imaging device of the embodiment, and shows a color filter array corresponding to a plurality of pixels arranged on the imaging surface.
Among them, FIG. 15 illustrates a first example in which the imaging device of the imaging device according to the present embodiment performs scanning in the “skip driving mode”.
The corresponding pixel corresponding to the frame is indicated by oblique lines. Similarly, FIG. 16 shows a corresponding pixel corresponding to the second frame by oblique lines. Similarly, FIG. 17 shows a corresponding pixel corresponding to the third frame by oblique lines.

As shown in the figure, the color filter array 40 of the image sensor in the image pickup apparatus of the present embodiment employs a so-called Bayer array color filter array among the primary color filter arrays.

In the image pickup apparatus of this embodiment, when operating the image pickup device provided with such a color filter array in the “skip drive mode”, so-called three-pixel thinning scanning is performed. In this case, the address of each pixel of the image sensor 14 is as follows. Here, the address of each pixel is represented by a horizontal (row) address of X1, X2,
X3..., And the vertical (column) addresses are Y1 and Y2.
-It is represented as Y3 ...

That is, in the imaging device of the present embodiment,
When the image sensor is operated in the “skip drive mode”, the selected pixels in the first frame are R (X1, Y1) · G (X4, Y1) · R (X7, Y1) · G as shown in FIG. (X10, Y1) G (X1, Y4) B (X4, Y4) G (X7, Y4) B (X10, Y4) R (X1, Y7) G (X4, Y7) ) .R (X7, Y7) .G (X10, Y7)...... Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the first frame.

The selected pixels in the second frame are shown in FIG.
R (X3, Y1) · G (X6, Y1) · R (X9, Y1) ··· G (X3, Y4) · B (X6, Y4) · G (X9, Y4) ··· .., R (X3, Y7), G (X6, Y7), R (X6, Y7),... Then, pixel signals from these selected pixels are extracted and become image data for forming an image of the second frame.

As shown in FIG. 17, the selected pixels in the third frame are R (X1, Y3), G (X4, Y3), R (X7, Y3), G (X10, Y3)... G ( X, Y6) B (X4, Y6) G (X7, Y6) B (X10, Y6) R (X1, Y9) G (X4, Y9) R (X7, Y9) G (X10, Y9) ············································· Then, a pixel signal from each of the selected pixels is extracted and becomes image data for forming an image of the third frame.

That is, in the imaging apparatus of the present embodiment,
When the reading order of the pixel signals when the operation in the “skip driving mode” by the three-pixel thinning-out scanning of the image sensor is performed is shown by the color of the corresponding color filter array, in the first frame, as shown in FIG. , R, G, R, G, ...
・ GB ・ GB ・ B ・ ・ ・ ・ ・ ・ RG ・ RG ・ G ・ ・ ・ ・The reading order of the pixel signals is controlled to be the same in different frames. That is, in the next second frame, as shown in FIG. 16, R, G, R, G,..., G, B, G, B,.
・ R ・ G ・ ・ ・ ・ ・ ・ ・In the next third frame, as shown in FIG. 17, R, G, R, G,..., G, B, G, B,.
・ R ・ G ・ ・ ・ ・ ・ ・ ・

That is, when a pixel signal is read out for each frame, the address of the pixel to be read out is changed. In this case, the order of the colors of the color filter array corresponding to the pixel to be read out is different for each frame. Are controlled to be read in the same order.

In the present embodiment, the third and fourth embodiments are also described.
Although the example in which the selection of the selected pixel is changed for each frame is shown in the same manner as in the embodiment, the same applies to the case where the selection of the pixel and the extraction of the pixel signal from the selected pixel are changed for each field. It is.

As described above, the same effects as those of the above-described embodiments can be obtained also in the imaging apparatus of the fifth embodiment.

Further, in the imaging apparatus of the present embodiment,
When scanning the image sensor 14 in the “skip drive mode”,
The pixel signal of the selected pixel is extracted for each frame or each field while the selected pixel from which the pixel signal is to be read is changed irregularly for each frame or each field. Since pixel signals are read out in consideration of the color information of the color filter array corresponding to each selected pixel, the configuration of the apparatus is changed even when the image sensor 14 is a color sensor. The moiré can be suppressed very easily without changing the read control.

Further, in this case, the order of colors for reading out pixel signals is controlled so that the same color order is always applied to different frames or fields.
Moiré can be easily suppressed without changing the configuration of the signal processing system after 5.

When the selected pixels from which pixel signals are to be read are changed irregularly, the total number of pixels to be read may be different for each frame or for each field. In this case, it is necessary to perform a predetermined arithmetic processing or the like in the signal processing unit 15 or the like to make the total number of pixels in each frame or each field uniform. Therefore, in order to avoid this, it is desirable to control so that the total number of pixels to be read in each frame or each field is the same. This makes it possible to cope with the normal processing similar to the case of other driving modes such as the “all pixel driving mode” without complicating the arithmetic processing of the signal processing system after the signal processing unit 15. It is.

As described above, in the image pickup apparatuses of the first to fifth embodiments, the “skip drive mode” is used.
When the imaging element is operated by the method, the generation of moire is suppressed by electrically changing the read control of the pixel from which the pixel signal is to be read, thereby obtaining a high-quality image.

On the other hand, in each of the embodiments described below, the same effect can be obtained by mechanically moving the image sensor, the optical member, and the like in a predetermined direction.

First, with regard to the sixth embodiment of the present invention,
This will be described below.

FIG. 18 is a main block diagram showing a schematic configuration of an imaging apparatus according to the sixth embodiment of the present invention.
FIG. 19 is a main part configuration diagram showing the configuration near the imaging lens and the imaging element in the imaging apparatus according to the present embodiment.

The configuration of the imaging apparatus 1B of the present embodiment is the same as that shown in FIG.
As shown in FIG. 8, it basically has substantially the same configuration as the imaging device 1A of the second embodiment (see FIG. 5). Then, as shown in FIG. 19, in the imaging apparatus 1B of the present embodiment, an imaging element driving unit 31 which is variable means for mechanically driving and controlling the imaging element 14 is newly arranged,
The difference from the above-described second embodiment is that the imaging element 14 is disposed so as to be movable in a predetermined direction. Other configurations are exactly the same as those of the above-described second embodiment.
Therefore, a detailed description of the configuration of the imaging device itself in the present embodiment will be omitted, and only different portions will be described in detail below.

As shown in FIGS. 18 and 19, the image pickup device driving section 31 is a driving means for moving the position of the image pickup device 14 in response to an instruction signal from the system controller 20. It is composed of a motor and the like.

More specifically, the image pickup device driving section 31 in this embodiment connects the image pickup device 14 to the optical axis O of the photographing lens 11.
Is configured to be able to be moved in a direction substantially perpendicular to the direction (the direction of arrow X in FIG. 19).

The image pickup device 14 in the image pickup apparatus 1B of the present embodiment is a CMD image pickup device or a CMOS which is an XY address type image pickup device, similarly to the above-described embodiments.
(Complementary Metal-Oxide Semiconductor; Complementary Metal Oxide Semiconductor) type image sensor or the like is applied.

In the image pickup apparatus 1B of the present embodiment thus configured, the image pickup device 14 in the "skip drive mode" is used.
The operation when is operated is as follows.

The image pickup device 14 operating in the “skip drive mode” is a so-called thinning scan in which pixels are skipped (skip) at predetermined intervals among all the pixels arranged on the image pickup surface as described above. And driving is controlled by the system controller 20 so as to extract a predetermined pixel signal. The read pixel in this case is controlled so that a fixed pixel is always selected. The readout pixel selected at this time is selected based on the pixel address as described in each of the above embodiments.

Then, the system controller 20 controls the image pickup device driving section 31 in synchronization with the readout timing for each frame or each field, and moves the image pickup device 14 in a predetermined direction along the arrow X direction shown in FIG. Move by the movement amount. In this case, the moving amount of the image sensor 14 is a moving amount based on a predetermined pixel interval (pixel pitch). For example, the image sensor 14 is moved by one pixel pitch in FIG.
When the pixel is moved in the X direction shown in FIG. 5, even if the readout pixel of the image sensor 14 is the same pixel, a pixel signal of a pixel corresponding to a position substantially adjacent to the readout pixel is read out. In this way, by moving the image sensor 14 by a predetermined amount in the X direction shown in FIG. 19 for each frame or each field, the reading position of the optical image formed on the imaging surface is made different.

According to the sixth embodiment having the above-described structure, the pixel at a different position for each frame or each field can be used without changing the electrical drive control of the image sensor 14 for each frame or each field. A decimation scan can be performed to acquire a signal. Therefore, the image represented by the image data generated based on the image signal acquired for each frame or each field is different for each frame or each field. Accordingly, the image pickup apparatus 1B of the present embodiment can also obtain image data that can suppress the occurrence of moiré and represent a high-quality image, similarly to the above-described embodiments.

In the image pickup apparatus of the sixth embodiment, when operating the image pickup device 14 in the “skip drive mode”, the image pickup device 14 is so arranged as to always take out a pixel signal from a fixed selected pixel. Although drive control is performed, it is not limited to this.

That is, while moving the image pickup device 14 in synchronization with the readout timing of each frame or each field, the electric drive control of the image pickup device 14 is performed at the same time. May be controlled so as to be different for each frame or each field.

By performing such control, the sampling interval becomes irregular, so that moire generated in an image for each frame or for each field can be more effectively suppressed, and therefore, a higher quality image can be obtained. Image data representing an image can be obtained.

[0213] In the sixth embodiment described above,
Although the color information is not considered, the imaging device 1B
In the case where the color filter array is arranged at a predetermined position with respect to the image pickup device 14 so that color information can be obtained from the output signal of the image pickup device 14, the same as in the fifth embodiment described above. By moving the image sensor 14 by a movement amount in consideration of the position of each color filter, the same effect as in the above-described fifth embodiment can be obtained.

On the other hand, in the sixth embodiment,
When operating the image pickup device 14 in the image pickup apparatus 1B in the “skip drive mode”, the image pickup device 14 is moved by a predetermined movement amount in synchronization with the readout timing for each frame or each field. There is no limit.

That is, the image pickup device 14 may be moved at a higher speed, and drive control may be performed so that the image pickup device 14 continues to move by a predetermined amount even during scanning of one frame or one field. In this case, the readout amount of the pixel signal in one frame or one field increases, so that the same effect as in the case of performing the pixel signal addition processing or the pixel signal mixing processing can be obtained. Therefore, the same effect as the means disclosed in JP-A-9-247689 can be obtained by different means.

When the image pickup device 14 is moved at a high speed as described above, the image pickup device 1 can be moved in the "skip drive mode".
When operating the image pickup device 4, the control of the selected pixel of the image sensor 14 may be performed such that a pixel signal is always taken out from a fixed selected pixel as in the above-described sixth embodiment, Alternatively, the selected pixels may be different.

Also in this case, the image pickup device 14
When the color filter array is arranged on the image pickup device so that color information can be obtained from the output signal of the image pickup device 14, the position of each color filter is considered in the same manner as in the fifth embodiment. By controlling the amount of movement of 14, the same effect as in the fifth embodiment can be obtained.

Further, in the image pickup apparatus according to the sixth embodiment, when operating the image pickup device 14 in the “skip drive mode”, the image pickup device 1 moves in the direction of arrow X shown in FIG.
4 is moved, but the moving direction of the image sensor 14 is not limited to this.

A seventh embodiment of the present invention described next
By moving the image sensor 14 in the direction of the arrow Y shown in FIG. 19, that is, in the direction along the optical axis O of the photographing lens 11, the same moiré suppression effect can be obtained.

[0220] The internal configuration of the imaging apparatus 1B of the present embodiment is as follows.
This is exactly the same as the above-described sixth embodiment, in which the electric drive control of the image sensor 14 performed by the image sensor driver 31 based on the instruction of the system controller 20 is different, and the moving direction of the image sensor 14 is different. Only. Accordingly, the constituent members of the imaging apparatus according to the present embodiment are substantially the same as those in the above-described sixth embodiment, and the illustration and details thereof are omitted.

In the imaging device 1B of the present embodiment, when a photographing operation is performed, first, a focus adjusting operation is performed prior to the photographing operation. Thereby, the image sensor 14
A clear subject image is formed on the image pickup surface of. Note that the focus adjustment operation in this case is an operation performed in a conventional general imaging device, and the details thereof are omitted. Specifically, the operation is such that the taking lens 11 is moved in the optical axis direction by a predetermined lens driving mechanism (not shown in FIG. 19).

In this state, that is, in a state where a clear subject image is formed on the imaging surface of the imaging element 14, the system controller 20 controls the imaging element driving section 31 to move the imaging element 14 to the state shown in FIG. Is moved by a predetermined amount of movement in the direction indicated by the arrow Y, ie, in a predetermined direction along the optical axis O of the photographing lens 11. Then, the image sensor 14 is fixed at that position.
Therefore, the image sensor driving unit 31 in the present embodiment
Is a variable means of the image sensor 14 and serves as a focal plane displacement means.

When the image pickup device 14 moves in the direction of arrow Y,
The imaging surface (light receiving surface) of the imaging element 14 moves in the same direction. As a result, a change occurs in the focus state of the subject image formed on the imaging surface of the imaging element 14.

That is, when the image sensor 14 is moved in the direction of the arrow Y, the subject image formed on the image pickup surface is in an out-of-focus state where the object is out of focus. Here, the frequency characteristic when the subject image is out of focus is higher than the frequency characteristic when the subject image is clearly formed on the imaging surface of the image sensor 14 when the focus is in agreement. The components are in a reduced state. From this, it can be said that the frequency characteristics of an image in a slightly out-of-focus state have substantially the same frequency characteristics as an image obtained after transmission through an optical low-pass filter.

In this state, the system controller 20 controls the driving of the image sensor 14 in accordance with the “skip driving mode”. In other words, the driving of the image sensor 14 is controlled so as to extract a predetermined pixel signal by performing a so-called thinning scan. Here, as a pixel from which a pixel signal is to be extracted, a fixed pixel is always selected for each frame or each field as in the above-described sixth embodiment.

As described above, in the image pickup apparatus 1B of this embodiment, first, the focus adjustment operation is performed prior to the photographing operation, and then, in the direction along the optical axis O of the photographing lens 11 (the direction of arrow Y in FIG. 19). The image sensor 14 is moved by a predetermined amount. After the image pickup device 14 is fixed at the moved position, drive control of the image pickup device 14 is performed by the system controller 20, and so-called thinning scanning is executed. Then, a predetermined signal processing is performed by the signal processing unit 15 and the like in response to the output signal from the image pickup device 14, and predetermined image data is generated. The image data is transmitted to the display signal processing unit 17, subjected to predetermined signal processing so as to be in a form optimal for display, and then output to a display device or the like.

As described above, according to the imaging apparatus 1B of the seventh embodiment, the imaging element 14 is moved in the direction along the optical axis O of the photographing lens 11 by using the imaging element driving section 31 (see FIG. 1).
By performing the predetermined thinning-out scanning while moving by a predetermined amount in the direction of arrow Y (in the direction of arrow 9 in FIG. 9), it is possible to obtain image data capable of displaying an image in a good state in which moire is suppressed.

Note that in the above-described seventh embodiment,
When the image pickup device 14 performs so-called thinning scanning, control is performed such that a fixed pixel is always selected and a pixel signal is extracted for each frame or field, but the present invention is not limited to this. The element 14 may be driven.

That is, when so-called thinning-out scanning is performed by the image pickup device 14, it is conceivable to perform drive control to change the selected pixel at the timing of each frame or each field. In this case, since an image differs for each frame or each field, a further moiré suppression effect can be obtained.

[0230] Also, in the above-described seventh embodiment,
An image sensor 1 having a color filter array arranged on the image sensor 14
It is easy to configure so that color information can be obtained from the output signal of No. 4. In this case, similarly to the above-described fifth embodiment, the driving of the image sensor 14 may be controlled so that the color order of the color filter array corresponding to the pixel to be read out is read out in the same order even if the frame is different. Thereby, a further moiré suppression effect can be obtained as compared with the above-described fifth embodiment.

On the other hand, in the above-described seventh embodiment,
The thinning-out scanning is performed in a state where the image pickup device 14 is fixed at the moved position, but separately from this, for example, at the timing of each frame or each field.
May be taken out while moving in the direction of arrow Y shown in FIG. Here, the moving amount and the moving direction of the image sensor 14 are appropriately changed.
In this case, the pixel signal extraction pixel drives and controls the image sensor 14 so that a fixed pixel is always selected even if the frame or the field is different.

Further, in this case, a means for driving and controlling the image pickup device 14 so that the selected pixel from which a pixel signal is to be extracted is changed for each frame or each field is also conceivable. In the case of such a configuration, by moving the image sensor 14 in the direction of the arrow Y shown in FIG. 19, images having different imaging states for each frame or each field can be obtained, and different pixels for each frame or each field can be obtained. Since moire is selected, moiré can be suppressed more effectively.

Also, while moving the image sensor 14 in the direction of the arrow Y shown in FIG. 19 for each frame or each field,
In synchronization with this, scanning may be performed by selecting a different pixel for each frame or each field. In this case, a further moire suppressing effect can be obtained.

In this case, it is also easy to arrange a color filter array on the image sensor 14 so that color information can be obtained from the output signal of the image sensor 14. For this purpose, the drive control of the image sensor 14 may be set so that the order of the colors of the color filter array corresponding to the pixels to be read is the same even between frames different from each other, as in the above-described fifth embodiment. Thereby, a further moire suppressing effect can be obtained.

In the sixth and seventh embodiments, the image pickup device 14 is moved by using the image pickup device driving section 31 in the direction of arrow X shown in FIG. 19 (in the direction substantially perpendicular to the optical axis O of the photographing lens 11). ) Or in the direction of the arrow Y in the same figure (the direction along the optical axis O of the photographing lens 11).

That is, in the above-described sixth and seventh embodiments, the image pickup device 14 is arranged such that the optical axis O of the photographing lens 11 is substantially perpendicular to the image pickup surface of the image pickup device 14 at all times. become.

Separately from this, for example, the image pickup device driving section 31
When the image sensor 14 is driven by the
The moiré suppression effect can also be obtained by moving the imaging surface of the imaging lens 4 so that the imaging surface of the imaging lens 11 is inclined with respect to the optical axis O of the photographing lens 11, that is, by driving the imaging element 14 like an Aol. This means will be described with reference to the following eighth embodiment of the present invention.

FIG. 20 is a main part configuration diagram showing the configuration near the imaging lens and the imaging element in the imaging apparatus according to the eighth embodiment of the present invention.

The configuration of the imaging apparatus of this embodiment is basically similar to that of the imaging apparatus 1B of the sixth and seventh embodiments (FIG. 18).
And a control performed by an image sensor driving unit 31 that mechanically controls and controls the image sensor 14 based on an instruction from the system controller 20.
A drive mechanism (not shown) for displacing the position of the image sensor 14 is slightly different. Therefore, illustration and details of the constituent members in the imaging device of the present embodiment are omitted.

As shown in FIG. 20, the image pickup device 14 in the image pickup apparatus 1B of the present embodiment has an arrow Ra shown in FIG. 20 centered on an intersection 14a between the image pickup surface of the image pickup device 14 and the optical axis O of the photographing lens 11. It is arranged so that it can rotate by a predetermined amount in the direction. The image sensor 14 is driven and controlled by the image sensor driver 31 based on an instruction from the system controller 20.

That is, the imaging device 14 of the imaging device 1B
Is configured such that its image pickup surface is inclined by a predetermined amount with respect to the optical axis O of the photographing lens 11 by being driven and controlled by the image pickup device driving section 31 and can be fixedly disposed at that position. .

In the image pickup apparatus 1B thus configured, first, a focus adjustment operation is performed prior to a photographing operation, so that a state in which a predetermined subject image is clearly formed on the image pickup surface of the image pickup device 14 is obtained. Become. In the focus adjustment operation in this case, an operation performed in a conventional general imaging device is performed.

In this state, that is, when a clear subject image is formed on the image pickup surface of the image pickup device 14, the system controller 20 controls the image pickup device driving section 31 to make the image pickup surface of the image pickup device 14 Intersection point 1 of lens 11 with optical axis O
The image sensor 14 is rotated (moved) by a predetermined amount in the direction of an arrow Ra shown in FIG. 20 around the center 4a, that is, in the direction along the optical axis O of the photographing lens 11. Then, the image sensor 14 is fixed at that position.

When the image pickup device 14 rotates by a predetermined amount in the direction of the arrow Ra, the image pickup surface (light receiving surface) of the image pickup device 14 moves in the same direction. As a result, a change occurs in the focus state of the subject image formed on the imaging surface of the imaging element 14. That is, at this time, the subject image is out of focus.

In this state, the system controller 20 executes the drive control according to the “skip drive mode”, that is, the drive control for extracting a predetermined pixel signal by performing a so-called thinning scan. Here, as a pixel from which a pixel signal is to be extracted, a fixed pixel is always selected for each frame or each field as in the sixth and seventh embodiments.

As described above, in the imaging apparatus 1B of the present embodiment, first, the focus adjustment operation is performed prior to the imaging operation, and then the intersection 14a between the imaging surface of the imaging device 14 and the optical axis O of the imaging lens 11 is set. Arrow Ra shown in FIG. 20 as the central axis
The image sensor 14 is rotated by a predetermined amount in the direction (along the optical axis O of the photographing lens 11). Then, the image pickup device 14 is fixed at that position, and the system controller 20 controls the driving of the image pickup device 14 to execute a so-called thinning scan. Subsequent signal processing and the like are the same as in the above-described embodiments.

As described above, according to the image pickup apparatus 1B of the eighth embodiment, the image pickup device 14 is moved with respect to the optical axis O of the photographing lens 11 (the intersection 14a An image capable of displaying an image in a good state in which moiré is suppressed by executing predetermined thinning-out scanning while rotating (moving) by a predetermined amount in the direction of arrow Ra shown in FIG. Data can be obtained.

Note that in the above-described eighth embodiment,
When the image pickup device 14 performs so-called thinning scanning, control is performed such that a fixed pixel is always selected and a pixel signal is extracted for each frame or field, but the present invention is not limited to this. The element 14 may be driven.

That is, when so-called thinning-out scanning is performed by the image pickup device 14, it is conceivable to perform drive control to change the selected pixel at the timing of each frame or each field. In this case, since an image differs for each frame or each field, a further moiré suppression effect can be obtained.

Also, in the above-described eighth embodiment,
An image sensor 1 having a color filter array arranged on the image sensor 14
It is easy to configure so that color information can be obtained from the output signal of No. 4. In this case, similarly to the above-described fifth embodiment and the like, the drive of the image sensor 14 is controlled so that the colors of the color filter array corresponding to the pixels to be read can be read in the same order even if the frames are different. Thereby, a further moiré suppressing effect can be obtained as compared with the fifth embodiment.

On the other hand, in the above-described eighth embodiment,
The thinning-out scanning is performed in a state where the image pickup device 14 is fixed at the moved position, but separately from this, for example, at the timing of each frame or each field.
20 may be taken out while rotating in the direction of arrow Ra shown in FIG. 20, that is, driving to vibrate. Here, the rotation amount and the rotation direction of the image sensor 14 are appropriately changed. Also,
In this case, a pixel signal extraction pixel controls the driving of the image sensor 14 so that a fixed pixel is always selected even if the frame or the field is different.

In the case of such a configuration, the image sensor 1
By rotating (moving) in the direction of arrow Ra shown in FIG. 4 in FIG. 20, images having different imaging states for each frame or each field can be obtained, so that moire can be suppressed more effectively.

Further, in the case where pixel signals are taken out while rotating (vibrating) the image sensor 14 in the direction of arrow Ra shown in FIG. 20 at the timing of each frame or each field, selection of taking out pixel signals is performed. The driving of the image sensor 14 may be controlled so that the pixels are changed for each frame or each field. In this case, different pixels are selected for each frame or each field.

Therefore, in the case of such a configuration, the pixel signals of different selected pixels are taken out in different imaging states for each frame or each field, so that a further moire suppressing effect can be obtained. .

Further, in this case, it is also easy to arrange a color filter array on the image sensor 14 so that color information can be obtained from the output signal of the image sensor 14. For this purpose, similarly to the above-described fifth embodiment, the driving of the image sensor 14 may be controlled so that the color order of the color filter array corresponding to the pixel to be read out is read out in the same order even if the frame is different. This allows
A further moiré deterrent effect can be obtained.

On the other hand, as for the drive timing of the image pickup device 14, as described above, the image pickup device 14 is rotated by a predetermined amount and then fixed at that position, or the image pickup device 14 is appropriately moved by a predetermined amount for each frame or field. Instead of only rotating in a predetermined direction, for example, the imaging element 14 may be rotated at a higher speed. That is, drive control may be performed so that the image sensor 14 continues to rotate in both directions along the arrow Ra by a predetermined amount during scanning of one frame or one field, that is, high-speed vibration.

As described above, even when the image pickup device 14 is vibrated at a high speed, when the image pickup device 14 is operated in the “skip drive mode”, the control of the selected pixel of the image pickup device 14 is always performed from a fixed selected pixel. A pixel signal may be extracted, or a selected pixel may be different for each frame or each field.

Also, in this case, the image sensor 14
It is also easy to arrange a color filter array so that color information can be obtained from the output signal of the image sensor 14.

Note that in the above-described eighth embodiment,
The center of rotation of the image sensor 14 is set to the intersection 14a between the imaging surface of the image sensor 14 and the optical axis O of the photographing lens 11. However, the present invention is not limited to this. You may. For example, as shown in FIG.
The same effect can be obtained when the imaging element 14 is rotated in the direction of the arrow Rb shown in FIG. 20 around the one end point 14b of the imaging surface.

Next, a ninth embodiment of the present invention will be described.
This will be described below.

FIG. 21 is a main block diagram showing a schematic configuration of an imaging apparatus according to the ninth embodiment of the present invention.
FIG. 22 is a main part configuration diagram showing the configuration near the imaging lens and the imaging element in the imaging apparatus according to the present embodiment.

The configuration of the imaging device 1C of this embodiment is basically the same as that of the imaging device 1A of the second embodiment (see FIG. 5). And FIG.
As shown in FIG. 1, in the imaging device 1C of the present embodiment,
A parallel plane plate 32 which is an optical member disposed at a predetermined position between the photographing lens 11 and the image sensor 14 and closer to the subject than the imaging surface of the image sensor 14, The second embodiment differs from the above-described second embodiment in that a parallel plane plate driving unit 33, which is variable means for mechanically driving in a predetermined direction, is newly disposed. Other configurations are exactly the same as those of the above-described second embodiment. Therefore, a detailed description of the configuration of the imaging device itself in the present embodiment will be omitted, and only different portions will be described in detail below.

As shown in FIGS. 21 and 22, the present imaging apparatus 1
C is a predetermined position between the photographing lens 11 and the image sensor 14, and a parallel plane plate 32 is disposed at a position on the optical path of a subject light beam transmitted through the photographing lens 11. As a result, the luminous flux of the subject that has entered the photographic lens 11 and has passed through the
No. 4 is reached, and a subject image is formed on this imaging surface.

The parallel flat plate drive unit 33 controlled by the system controller 20 is electrically connected to the parallel flat plate 32. The parallel flat plate drive unit 33 is driven by the parallel flat plate drive unit 33. Has become.

The parallel plane driving section 33 is a driving means for moving the parallel plane 32 in a predetermined direction in response to an instruction signal from the system controller 20. The parallel flat plate driving unit 33 is configured by, for example, an actuator, a piezoelectric actuator, a motor, or the like.

More specifically, the plane-parallel plate driving section 33 in the present embodiment moves the plane-parallel plate 32 in a direction substantially orthogonal to the optical axis O of the photographing lens 11 (the direction of arrow X in FIG. 22).
Is configured to be movable. Other configurations are substantially the same as those of the above-described second embodiment.

In the image pickup apparatus 1C according to the present embodiment thus configured, the image pickup device 14 in the "skip drive mode" is used.
The operation when is operated is as follows.

The image sensor 14 operating in the "skip drive mode" is driven and controlled by the system controller 20 so as to extract a predetermined pixel signal by performing a so-called thinning scan. The read pixel in this case is controlled so that a fixed pixel is always selected.

Then, the system controller 20 controls the parallel plane driving unit 33 in synchronization with the readout timing for each frame or each field to control the parallel plane 32
Is moved by a predetermined moving amount in a predetermined direction along the arrow X direction shown in FIG. Then, the optical axis O of the photographing lens 11
Is moved by the plane-parallel plate 32 as shown in FIG.

Specifically, for example, let us focus on a predetermined light beam that passes through the photographing lens 11 and forms an image at an arbitrary point on the imaging surface of the imaging device 14.

First, when the plane-parallel plate 32 is at an arbitrary position, a predetermined light beam is emitted from the photographing lens 11 and the plane-parallel plate 3.
It is assumed that the light has passed through point 2 and has reached point 14 c on the imaging surface of imaging element 14. The light beam at this time is indicated by a dotted line in FIG.

Next, in this state, the parallel flat plate 3
2 is driven by the plane-parallel plate driving unit 33, and is moved by a predetermined movement amount in the arrow X direction shown in FIG. Then, the traveling direction of the above-described light beam O1 is bent by the refraction of the parallel plane plate 32. Then, the vehicle travels along the solid line O2 shown in FIG. 22 and reaches a predetermined point 14d on the imaging surface of the imaging element 14.

Therefore, by moving the plane-parallel plate by a predetermined amount in the X direction shown in FIG. 22 for each frame or each field, the read-out position of the image formed on the imaging surface can be made different. It is.

According to the ninth embodiment configured as described above, the pixel at a different position for each frame or each field can be used without changing the electrical drive control of the image sensor 14 for each frame or each field. A decimation scan can be performed to acquire a signal. Therefore, similarly to the above-described embodiments, it is possible to obtain image data that can suppress the occurrence of moiré and represent a high-quality image.

In the image pickup apparatus according to the ninth embodiment, when operating the image pickup device 14 in the “skip driving mode”, the image pickup device 14 is always operated so as to extract a pixel signal from a fixed selected pixel. Although drive control is performed, it is not limited to this.

That is, while the parallel plane plate 32 is moved in synchronization with the readout timing of each frame or each field, the electric drive control of the image pickup device 14 is performed at the same time, so that the selection of the pixel signal to be read out is performed. Pixels may be controlled so as to be different for each frame or each field.

By performing such control, the sampling interval becomes more irregular. Therefore, moire generated in an image for each frame or for each field can be more effectively suppressed, and image data representing a higher quality image can be obtained.

In the ninth embodiment described above,
Although the color information is not taken into consideration, the imaging device 1C
In the case where the color filter array is arranged at a predetermined position with respect to the image pickup device 14 so that color information can be obtained from the output signal of the image pickup device 14, the same as in the fifth embodiment described above. By moving the parallel flat plate 32 by a movement amount in consideration of the position of each color filter, the same effect as in the above-described fifth embodiment can be obtained.

On the other hand, in the ninth embodiment,
When operating the imaging device 14 in the imaging device 1C in the “skip drive mode”, the parallel plane plate 32 is moved by a predetermined movement amount in synchronization with the readout timing for each frame or each field. It is not limited to.

That is, the parallel flat plate 32 may be moved at a higher speed, and the driving control may be performed such that the parallel flat plate 32 continues to move by a predetermined amount even during scanning of one frame or one field. In this case, the readout amount of the pixel signal in one frame or one field increases, so that the same effect as in the case of performing the pixel signal addition processing or the pixel signal mixing processing can be obtained.

Even when the plane-parallel plate 32 is moved at a high speed in this manner, when the image pickup device 14 is operated in the “skip driving mode”, the control of the selected pixel of the image pickup device 14 is performed by the above-described control. As in the sixth embodiment, the pixel signal may always be extracted from a fixed selected pixel, or the selected pixel may be different for each frame or each field.

Also, in this case, the image sensor 14
In the case where a color filter array is arranged so that color information can be obtained from the output signal of the image sensor 14, the color filters are arranged in parallel in consideration of the position of each color filter as in the above-described fifth embodiment. If the amount of movement of the flat plate 32 is controlled, the same effects as those of the fifth embodiment can be obtained.

Next, a tenth embodiment of the present invention will be described below.

FIG. 23 is a main block diagram showing a schematic configuration of an imaging apparatus according to the tenth embodiment of the present invention. FIG. 24 is a configuration diagram of a main part of the imaging apparatus according to the present embodiment in which the configuration near the imaging lens and the imaging element is extracted and shown.

[0285] The configuration of the imaging apparatus 1D of this embodiment is the same as that shown in FIG.
As shown in FIG. 3, it basically has substantially the same configuration as the imaging device 1A of the above-described second embodiment (see FIG. 5). The imaging apparatus 1D according to the present embodiment is different from the imaging apparatus 1D in that a lens driving unit 34, which is a variable unit that mechanically drives and moves a part or all of the imaging lens 11 in a predetermined direction, is newly disposed. , Is different from the above-described second embodiment. Other configurations are substantially the same as those of the above-described second embodiment. Therefore, a detailed description of the configuration of the imaging device itself in the present embodiment will be omitted, and only different portions will be described in detail below.

As shown in FIG. 23 and FIG.
A lens driving unit 34 controlled by the system controller 20 is electrically connected to the D taking lens 11. The lens driving unit 34 is a driving unit for receiving the instruction signal from the system controller 20 and moving the taking lens 11 in a predetermined direction. The lens driving unit 34 is disposed, for example, in a conventional general imaging apparatus, and may use a driving member such as an actuator or a piezoelectric actuator / motor which constitutes a part of an automatic focusing mechanism (AF mechanism). Alternatively, a dedicated driving unit may be provided separately from a driving member that drives the above-described automatic focus adjustment mechanism (AF mechanism).

[0287] The lens driving unit 34 in the present embodiment moves the photographing lens 1 at least in a direction substantially orthogonal to the optical axis O of the photographing lens 11 (the direction of arrow X in FIG. 24).
1 can be moved.

As described above, the automatic focusing mechanism (A
In the case where a driving member for driving the F mechanism is also used as the lens driving unit 34, the lens driving unit 34 is arranged in a direction along the optical axis O of the photographing lens 11 (arrow Y direction in FIG. 24).
Needless to say, the photographing lens 11 can also be moved. Other configurations are substantially the same as those of the above-described second embodiment.

In the image pickup apparatus 1D according to the present embodiment thus configured, the image pickup device 14 is operated in a "skip drive mode".
The operation when is operated is as follows.

The image sensor 14 operating in the "skip drive mode" is driven and controlled by the system controller 20 so as to perform a so-called thinning-out scan and extract a predetermined pixel signal as described above. The read pixel in this case is controlled so that a fixed pixel is always selected.

Then, the system controller 20 controls the lens driving unit 34 in synchronization with the readout timing of each frame or each field to move the photographing lens 11 in a predetermined direction along the arrow X direction shown in FIG. Move by the amount. In this case, the movement amount of the photographing lens 11 is a movement amount based on a predetermined pixel interval (pixel pitch). That is, for example, the photographing lens 11 is moved by an amount necessary to move the optical axis by one pixel pitch in FIG.
Is moved in the X direction shown in (1), the optical axis O of the photographing lens 11 moves in a predetermined moving direction by one pixel pitch. Therefore, in this case, even if the readout pixel of the image sensor 14 is the same pixel, the pixel signal of the pixel corresponding to a position substantially adjacent to the readout pixel is read out. In this way, by moving the taking lens 11 by a predetermined amount in the X direction shown in FIG. 24 for each frame or every field, the readout position of the image formed on the imaging surface is made different.

According to the tenth embodiment configured as described above, the optical axis is moved by one pixel in the X direction shown in FIG. 24 by the lens driving unit 34 for each frame or each field. In this way, pixel signals of different pixels can be read for each frame or each field. Therefore, it is possible to execute the thinning-out scanning for acquiring the pixel signal at a different position for each frame or each field without changing the electrical drive control of the image sensor 14 for each frame or each field. Therefore, similarly to the above-described embodiments, it is possible to obtain image data that can suppress the occurrence of moiré and represent a high-quality image.

In the image pickup apparatus 1D according to the tenth embodiment, the image pickup device 14 in the "skip drive mode" is used.
When the is operated, the image pickup device 14 is driven and controlled so as to always take out a pixel signal from a fixed selected pixel.
It is not limited to this.

That is, while the photographing lens 11 is moved in synchronization with the readout timing of each frame or each field, at the same time, the electric drive control of the image pickup device 14 is also performed. May be controlled so as to be different for each frame or each field.

By performing such control, the sampling interval becomes more irregular. Therefore, moire generated in an image for each frame or for each field can be more effectively suppressed, and image data representing a higher quality image can be obtained.

In the tenth embodiment, the color information is not considered, but the color filter array is arranged at a predetermined position with respect to the image pickup device 14 of the image pickup apparatus 1D. In the case where the color information can be obtained from the output signal of No. 14, the fifth
By moving the photographing lens 11 in the X direction in FIG. 24 by the movement amount in consideration of the position of each color filter as in the case of the fifth embodiment, the same effect as that of the fifth embodiment can be obtained.

On the other hand, in the tenth embodiment described above, when operating the image sensor 14 in the image pickup apparatus 1D in the “skip drive mode”, the photographing lens 11 is synchronized with the readout timing for each frame or each field. Although the movement is performed by a predetermined movement amount, the invention is not limited to this.

In other words, the driving of the photographing lens 11 may be controlled at a higher speed so that the photographing lens 11 keeps moving by a predetermined amount even during scanning of one frame or one field. In this case, the readout amount of the pixel signal in one frame or one field increases, so that the same effect as in the case of performing the pixel signal addition processing or the pixel signal mixing processing can be obtained.

Even when the photographing lens 11 is moved at a high speed as described above, when the image pickup device 14 is operated in the “skip driving mode”, the control of the selected pixel of the image pickup device 14 is performed by the above-described tenth control. The pixel signal may always be extracted from a fixed selected pixel as in the embodiment of the present invention, or the selected pixel may be different for each frame or each field.

Also in this case, the image pickup device 14
In the case where a color filter array is arranged so that color information can be obtained from an output signal of the image pickup device 14, a photographing lens is taken into account in consideration of the position of each color filter as in the fifth embodiment. By controlling the amount of movement of the eleventh embodiment, the same effect as in the fifth embodiment can be obtained.

Further, in the image pickup apparatus 1D of the tenth embodiment, the image pickup device 1 is operated in a "skip drive mode".
When the camera 4 is operated, the photographing lens 11 is moved in the arrow X direction shown in FIG. 24, but the moving direction of the photographing lens 11 is not limited to this.

In the eleventh embodiment of the present invention described below, the same moire is obtained by moving the taking lens 11 in the direction of arrow Y shown in FIG. 24, that is, in the direction along the optical axis O of the taking lens 11. The deterrent effect is obtained.

[0303] The internal configuration of the imaging apparatus 1D of the present embodiment is as follows.
This is exactly the same as the tenth embodiment described above, except that the drive control of the taking lens 11 performed by the lens drive unit 34 based on the instruction of the system controller 20 is different.
Therefore, the constituent members of the image pickup apparatus of the present embodiment are exactly the same as those of the above-described tenth embodiment, and the illustration and details are omitted.

As shown in FIG. 24, in the image pickup apparatus 1D, a lens driving section 34 controlled by the system controller 20 is electrically connected to the photographing lens 11, so that the photographing lens 11 It can move in a direction along the axis O (arrow Y direction).

That is, the lens driving section 34 is a driving means for receiving the instruction signal from the system controller 20 and moving the photographing lens 11 in a predetermined direction. The lens driving unit 34 is configured by, for example, an actuator, a piezoelectric actuator, a motor, and the like.

More specifically, the lens driving section 34 in the present embodiment is arranged in a direction along the optical axis O of the photographing lens 11 (see FIG. 2).
4 (in the direction of the arrow Y). Therefore, in the present embodiment, it is the easiest means for the lens driving unit 34 to use the driving member constituting the above-described automatic focus adjustment mechanism. Other configurations are substantially the same as those of the above-described second embodiment.

[0307] In the image pickup apparatus 1D of the present embodiment thus configured, the image pickup device 14 in the "skip drive mode" is used.
The operation when is operated is as follows.

In the image pickup apparatus 1D of the present embodiment, when a photographing operation is performed, a clear subject image is formed on the image pickup surface of the image pickup device 14 by first performing a focus adjustment operation prior to the photographing operation. You. Note that the focus adjustment operation in this case is an operation performed in a conventional general imaging device, and the details thereof are omitted. Specifically, the taking lens 1 is driven by a predetermined lens driving mechanism (for example, the lens driving unit 34 is also used).
1 is moved in a direction along the optical axis O.

In this state, that is, when a clear subject image is formed on the image pickup surface of the image pickup device 14, the system controller 20 controls the lens drive unit 34 to move the photographing lens 11 to the arrow shown in FIG. Y direction, ie, taking lens 1
It is moved by a predetermined amount in a predetermined direction along one optical axis O. Then, the photographing lens 11 is fixed at that position.
Therefore, the lens driving unit 34 in the present embodiment
It is a variable means of the taking lens 11 and serves as a focal plane displacement means.

When the photographic lens 11 moves in the direction of arrow Y, this causes a change in the focus state of the subject image formed on the image pickup surface of the image pickup device 14.

That is, when the photographing lens 11 is moved in the direction of the arrow Y in FIG. 24, the subject image formed on the image pickup surface becomes
So-called out of focus (out of f)
ocus). Thereby, the frequency characteristics of the image in the out-of-focus state have substantially the same frequency characteristics as the image obtained after transmission through the optical low-pass filter.

In this state, the system controller 20 controls the driving of the image pickup device 14 in accordance with the “skip drive mode”. In other words, the driving of the image sensor 14 is controlled so as to extract a predetermined pixel signal by performing a so-called thinning scan. Here, as for the pixel from which the pixel signal is to be extracted, a fixed pixel is always selected for each frame or each field as in the above-described tenth embodiment.

As described above, in the image pickup apparatus 1D of the present embodiment, first, the focus adjustment operation is performed prior to the photographing operation, and then, in the direction along the optical axis O of the photographing lens 11 (the direction of the arrow Y in FIG. 24). The photographing lens 11 is moved by a predetermined amount. After the imaging lens 11 is fixed at the moved position, drive control of the image pickup device 14 is performed by the system controller 20, and so-called thinning scanning is executed. The subsequent processing is the same as in each of the above embodiments.

As described above, according to the imaging apparatus 1D of the eleventh embodiment, the photographing lens 11 is moved along the optical axis O of the photographing lens 11 by using the lens driving section 34 (arrow Y in FIG. 24). Direction), a predetermined thinning-out scan is executed while being moved by a predetermined amount in the direction (i.e., direction). As a result, it is possible to acquire image data capable of displaying an image in a good state in which moire is suppressed.

In the above-described eleventh embodiment, when the image pickup device 14 performs so-called thinning-out scanning,
The control is performed such that a constant pixel is always selected for each frame or each field to extract a pixel signal. However, the present invention is not limited to this, and the image sensor 14 may be driven by different control.

That is, when so-called thinning-out scanning is performed by the image sensor 14, drive control for changing the selected pixel at the timing of each frame or each field may be performed. In this case, since each image is different for each frame or each field, the obtainable pixel signals are different for each frame or each field. Therefore, according to this means, a further moiré suppressing effect can be realized.

Also in the eleventh embodiment described above, it is easy to arrange a color filter array on the image sensor 14 so that color information can be obtained from the output signal of the image sensor 14. In this case, the fifth
The drive of the image sensor 14 may be controlled so that the order of the colors of the color filter array corresponding to the pixels to be read is read in the same order even if the frame is different, as in the embodiment.
Thereby, a further moiré suppression effect can be obtained as compared with the above-described fifth embodiment.

On the other hand, in the above-described eleventh embodiment, thinning-out scanning is performed with the photographing lens 11 fixed at the moved position. Alternatively, for example, the timing for each frame or each field may be set. While moving the taking lens 11 in the direction of arrow Y shown in FIG.
Any pixel signal may be extracted.
Here, the moving amount and moving direction of the photographing lens 11 are appropriately changed.

Further, separately from this, if the drive of the image pickup device 14 is changed so that the selected pixel from which a pixel signal is to be extracted is changed for each frame or each field, a different pixel is selected for each frame or each field. Can be done.

Accordingly, in the case of such a configuration, an image having a different imaging state for each frame or field can be obtained by moving the photographing lens 11 in the direction of the arrow Y shown in FIG. Alternatively, since an image signal of a different selected pixel is obtained for each field, moire can be suppressed more effectively.

Further, also in this case, it is easy to arrange a color filter array on the image sensor 14 so that color information can be obtained from an output signal of the image sensor 14. For this purpose, similarly to the above-described fifth embodiment, the driving of the image sensor 14 may be controlled so that the color order of the color filter array corresponding to the pixel to be read out is read out in the same order even if the frame is different. This allows
A further moiré deterrent effect can be obtained.

Incidentally, in the tenth and eleventh embodiments described above, the photographic lens 1
1 in the direction of the arrow X shown in FIG.
In the direction substantially perpendicular to the direction of FIG.
1 (along the optical axis O).

That is, in the tenth and eleventh embodiments, the photographing lens 11 is arranged so that the optical axis O of the photographing lens 11 is always substantially perpendicular to the imaging surface of the imaging element 14. However, when the photographing lens 11 is driven by the lens driving unit 34, for example, means for moving the optical axis O of the photographing lens 11 so as to be inclined with respect to the imaging surface of the image sensor 14, ie, the photographing lens 11 Can be considered as a means for driving the motor.

According to this means, it is possible to obtain a moiré suppressing effect as in the case where the image pickup device 14 is driven in the aile direction in the above-described eighth embodiment. A twelfth embodiment of the present invention described below is an example employing such a configuration.

That is, FIG. 25 is a main part configuration diagram showing a configuration in the vicinity of an imaging lens and an imaging element in an imaging apparatus according to a twelfth embodiment of the present invention.

The configuration of the imaging apparatus of this embodiment is basically the same as that of the imaging apparatus 1D of the tenth and eleventh embodiments (see FIG. 23). Photographing lens 1 based on 20 instructions
The driving mechanism (not shown) of the taking lens 11 is slightly different from the control performed by the lens driving unit 34 that mechanically controls the driving of the lens 1. Therefore, illustration and details of the constituent members in the imaging device of the present embodiment are omitted.

As shown in FIG. 25, the photographing lens 11 in the image pickup apparatus 1D of the present embodiment has a predetermined amount in the direction of arrow Ra shown in FIG. 25 with the center point 11a through which the optical axis O of the photographing lens 11 passes as the central axis. It is arranged so that it can rotate. The driving of the photographing lens 11 is controlled by a lens driving unit 34 based on an instruction from the system controller 20.

That is, the photographing lens 11 of the image pickup apparatus 1D
Is driven by the lens driving unit 34 so that the virtual axis 11c passing through the center of the photographing lens 11 is inclined by a predetermined amount with respect to the optical axis O, and is fixedly disposed at that position. Is configured to obtain.

In the imaging device 1D thus configured, first, the imaging surface of the imaging device 14 and the virtual axis 11c of the photographing lens 11 are substantially parallel, that is, the imaging device 14
When the optical axis O of the photographing lens 11 is substantially orthogonal to the image pickup plane, a focus adjustment operation performed prior to the photographing operation is executed. As a result, a predetermined subject image is clearly formed on the imaging surface of the imaging element 14. In the focus adjustment operation in this case, an operation performed in a conventional general imaging device is performed.

In this state, that is, when a clear subject image is formed on the image pickup surface of the image pickup device 14, the system controller 20 controls the lens driving unit 34 to make the virtual axis 11c of the photographing lens 11 The photographing lens 11 is rotated (moved) by a predetermined amount in the direction of the arrow Ra shown in FIG. 25 having the intersection 11a with the axis O as the center axis, that is, in the direction of the arrow with respect to the optical axis O of the photographing lens 11. Then, the photographing lens 11 is fixed at that position.

When the photographing lens 11 rotates in the direction of the arrow Ra in this manner, the locus of the subject light beam transmitted through the photographing lens 11 also changes. As a result, a change occurs in the focus state of the subject image formed on the imaging surface of the imaging element 14. That is, at this time, the subject image is out of focus.

In this state, the system controller 20 executes the drive control according to the “skip drive mode”, that is, the drive control for extracting a predetermined pixel signal by performing a so-called thinning scan. Here, as the pixels from which the pixel signals are to be extracted, a fixed pixel is always selected for each frame or each field as in the tenth and eleventh embodiments.

As described above, in the image pickup apparatus 1D of the present embodiment, first, the focus adjustment operation is performed prior to the photographing operation, and then the intersection 11a between the virtual axis 11c of the photographing lens 11 and the optical axis O is set as the central axis. 25, the photographing lens 11 is rotated by a predetermined amount in the direction of arrow Ra (along the optical axis O of the photographing lens 11). Then, the photographing lens 11 is fixed at that position, and the drive of the image pickup device 14 is controlled by the system controller 20, so-called thinning scanning is executed. Subsequent signal processing and the like are the same as in the above-described embodiments.

As described above, according to the imaging apparatus 1D of the twelfth embodiment, the lens driving unit 34 is used to move the photographing lens 11 in the Aol direction (centering on the intersection 11a) with respect to the optical axis O of the photographing lens 11. Arrow Ra shown in FIG. 25 as an axis
By performing predetermined thinning-out scanning while rotating (moving) by a predetermined amount in the direction (direction), image data capable of displaying an image in a good state in which moire is suppressed can be obtained.

In the twelfth embodiment, when the image pickup device 14 performs a so-called thinning scan,
Control is performed so that a fixed pixel is always selected for each frame or each field to extract a pixel signal. However, the present invention is not limited to this, and the image sensor 14 may be driven by different control.

That is, when so-called thinning-out scanning is performed by the image pickup device 14, it is conceivable to perform drive control to change the selected pixel at the timing of each frame or each field. In this case, since an image differs for each frame or each field, a further moiré suppression effect can be obtained.

Also in the twelfth embodiment, it is easy to arrange a color filter array on the image sensor 14 so that color information can be obtained from output signals of the image sensor 14. In this case, the fifth
The drive of the image sensor 14 is controlled so that the color order of the color filter array corresponding to the pixel to be read out can be read out in the same order even if the frame is different as in the embodiments. Thereby, a further moiré suppressing effect can be obtained as compared with the fifth embodiment.

On the other hand, in the twelfth embodiment, thinning-out scanning is performed with the taking lens 11 fixed at the rotated position.
For example, pixel signals may be extracted by the image sensor 14 while rotating the imaging lens 11 in the direction of the arrow Ra shown in FIG. 25 at the timing of each frame or each field. Here, the rotation amount and the rotation direction of the photographing lens 11 are appropriately changed. In this case, the pixel signal extraction pixel drives and controls the image sensor 14 so that a fixed pixel is always selected even if the frame or the field is different.

In the case of such a configuration, an image having a different imaging state for each frame or each field can be obtained by rotating (moving) the taking lens 11 in the direction of the arrow Ra shown in FIG. Moire can be suppressed more effectively.

Further, in the case where pixel signals are taken out while rotating the taking lens 11 in the direction of the arrow Ra shown in FIG. 25 at the timing of each frame or each field, the selected pixel from which the pixel signals are to be taken out is the frame. The drive of the image sensor 14 may be controlled so as to be changed every time or every field. In this case, different pixels are selected for each frame or each field.

In the case of such a configuration, since pixel signals of different selected pixels are taken out in different imaging states for each frame or each field, a further moire suppressing effect can be obtained.

In this case, it is also easy to arrange a color filter array on the image sensor 14 so that color information can be obtained from the output signal of the image sensor 14. For this purpose, similarly to the above-described fifth embodiment, the driving of the image sensor 14 may be controlled so that the color order of the color filter array corresponding to the pixel to be read out is read out in the same order even if the frame is different. This allows
A further moiré deterrent effect can be obtained.

On the other hand, as for the drive timing of the image pickup device 14, as described above, the image pickup device 14 is rotated by a predetermined amount and then fixed at that position, or the image pickup device 14 is appropriately moved by a predetermined amount for each frame or each field. In addition to rotating only in a predetermined direction, for example, rotating the photographing lens 11 at a higher speed so that the photographing lens 11 continues to rotate by a predetermined amount even during scanning of one frame or one field,
That is, drive control may be performed so as to achieve high-speed vibration.

As described above, even when the photographing lens 11 is rotated at a high speed, when the image pickup device 14 is operated in the “skip driving mode”, the control of the selected pixel of the image pickup device 14 is performed.
The pixel signal may always be extracted from a fixed selected pixel, or the selected pixel may be different for each frame or each field.

Also in this case, the image pickup device 14
It is also easy to arrange a color filter array so that color information can be obtained from the output signal of the image sensor 14.

In the twelfth embodiment, the center of rotation of the photographing lens 11 is set at the intersection 11a between the virtual axis 11c of the photographing lens 11 and the optical axis O of the photographing lens 11.
However, the present invention is not limited to this, and another point may be set as the rotation center of the photographing lens 11. For example, even when the photographing lens 11 is rotated in the direction of the arrow Rb shown in FIG. 25 around one end point 11b near the periphery of the photographing lens 11 as shown in FIG. The effect can be obtained.

[0347] In the conventional imaging apparatus, the spatial relative position between the optical image formed on the imaging surface of the imaging device and the imaging surface of the imaging device is temporally shifted by, for example, a half pixel pitch. Performing predetermined signal processing such as pixel signal addition processing or pixel signal mixing processing on the image data to obtain image data capable of representing a still image with higher definition than the number of pixels of the image sensor. So-called pixel shifting means
Various proposals have been made and generally put to practical use. In order to realize this, for example, means for moving the image sensor itself in a predetermined direction by a predetermined amount, and a predetermined prism or a parallel plane plate capable of transmitting a light beam in a space between the imaging lens and the image sensor are arranged. Then, there is a means for moving this by a predetermined amount in a predetermined direction.

This will be described in more detail as follows.

FIG. 26 is a conceptual diagram showing a part of the imaging surface of a general imaging device.

As shown in FIG. 26, a plurality of pixels 21 are arranged in a matrix on the imaging surface (two-dimensional plane) of a general imaging device. Each pixel 21 does not have a photosensitive portion 21b (a rectangular portion shown by oblique lines in FIG. 26) such as a photodiode disposed on the entire surface, and has an ineffective portion 21a such as a transfer portion that does not directly contribute to the photosensitive action. I do. This invalid portion 21a
Exist in the peripheral portion of the photosensitive portion 21b of each pixel 21.

Therefore, by performing the image pickup operation a plurality of times while relatively moving the position of the optical image with respect to the image pickup surface of the image pickup element, the photosensitive action on the invalid portion existing in each pixel 21 of the image pickup element is performed. Effective part that contributes to
That is, so-called pixel shifting is to spatially arrange the photosensitive units (photodiodes or the like).

FIG. 27 is a conceptual diagram illustrating pixel shifting performed in a conventional single-panel imaging apparatus.

As shown in FIG. 27, first, scanning is performed by using all the pixels of the image sensor by performing the first scanning. As a result, after the obtained pixel signal is subjected to predetermined signal processing and converted into image data of a predetermined form,
It is temporarily recorded in a predetermined recording unit (not shown).

Next, for example, after the image pickup device 14 is moved in a predetermined direction by a predetermined shift amount, for example, a half pixel pitch (refer to a symbol P in FIG. 27), a second scan is performed. As a result, the obtained pixel signal is subjected to predetermined signal processing, converted into image data of a predetermined form, and then temporarily recorded in a predetermined recording unit (not shown).

[0355] A plurality of image data obtained by performing a plurality of scans in this way are read from the recording unit, and then, in a predetermined signal processing unit or the like, pixel signal addition processing or pixel signal mixing processing. -Predetermined signal processing such as image synthesis processing is performed. The composite image generated by this is
It becomes image data representing a high-definition image.

On the other hand, in the image pickup apparatus 1B of the sixth embodiment (see FIGS. 18 and 19) of the above-described embodiments, the image pickup device driving section 31 is provided to
A direction substantially orthogonal to the optical axis O of the taking lens 11 (FIG. 1)
9 (in the direction of arrow X).

In the imaging device 1C according to the ninth embodiment (see FIGS. 21 and 22), the plane parallel plate 32
And a parallel plate driving unit 33, and the parallel plate 32
Is movable in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (the direction of arrow X in FIG. 22).

The tenth embodiment (FIG. 23)
In the imaging apparatus 1D of FIG. 24, the lens driving unit 34 is provided to move the photographing lens 11 in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (arrow X in FIG. 24).
Direction).

Therefore, when the imaging devices 1B, 1C, and 1D of the sixth, ninth, and tenth embodiments are operated in the "all-pixel driving mode" and the scanning by the imaging device 14 is performed, By using the pixel shifting means, it is possible to adopt a configuration in which image data representing a still higher definition still image can be obtained.

As a new embodiment in such a configuration, a modified example of each of the sixth, ninth, and tenth embodiments will be described below.

That is, the imaging apparatus 1 of the sixth embodiment described above.
In B, when operating the image sensor 14 in the “skip drive mode”, as described above, the image sensor driver 31 controls the drive of the image sensor 14 in accordance with an instruction from the system controller 20, and the image sensor 1 is controlled at a predetermined timing.
By moving the lens 4 in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (the direction of arrow X in FIG. 19), it is possible to acquire image data representing a high-quality image with reduced moire.

On the other hand, when operating the image sensor 14 in the “all pixel driving mode”, the system controller 2
0, the image sensor driving unit 31 changes the image sensor 1
4 is controlled to move the image pickup device 14 by a predetermined amount at a predetermined timing in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (the direction of the arrow X in FIG. 19), thereby achieving higher definition. It is possible to acquire image data representing a natural image.

The operation timing of the image pickup device 14 in this case is as follows. That is, first, normal scanning is performed in a state where the imaging element 14 is arranged at a normal position. The image signal thus acquired is subjected to predetermined signal processing in the signal processing unit 15 and the like, and then temporarily stored in a predetermined temporary recording unit (not shown).

Next, the image pickup device 14 is moved by the image pickup device driving section 31 in a predetermined direction (arrow X direction in FIG. 19) so as to be at a predetermined position shifted by a predetermined amount, for example, a half pixel. The image sensor 14 is fixed.
Then, the second scanning is performed by driving the image sensor 14. The image signal thus acquired is subjected to predetermined signal processing in the signal processing unit 15 and the like, and then temporarily stored in a predetermined temporary recording unit (not shown).

The two pieces of image data thus obtained are output again to a predetermined processing unit such as the signal processing unit 15 and subjected to predetermined signal processing such as pixel signal addition processing or pixel signal mixing processing. One image data that can represent one image is generated. This image data is converted into image data in a form most suitable for recording, and then recorded in the recording unit 16 and output to the display signal processing unit 17 using a display device (not shown). After being subjected to predetermined signal processing so as to obtain an image signal in a form most suitable for display, the image signal is output as a signal output to an external device such as a display device.

[0366] The image data generated in this manner is higher definition image data than an image displayed by image data that can be generated by one scan performed by the imaging device 14 of the imaging device 1B. I have.

On the other hand, the imaging apparatus 1 of the ninth embodiment described above
In C, when operating the image sensor 14 in the “skip drive mode”, the parallel flat plate driving unit 33 controls the drive of the parallel flat plate 32 by the instruction from the system controller 20 as described above, and the parallel flat plate 32 is controlled at a predetermined timing. By moving the face plate 32 in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (the direction of arrow X in FIG. 22), it is possible to acquire image data representing a high-quality image with reduced moire.

On the other hand, when operating the image sensor 14 in the “all pixel driving mode”, the system controller 2
In response to the instruction of 0, the parallel plane driving unit 33 drives and controls the parallel plane 32, and moves the parallel plane 32 by a predetermined amount at a predetermined timing in a direction substantially orthogonal to the optical axis O of the taking lens 11 (FIG. (In the direction of arrow X), it is possible to acquire image data representing a higher definition image.

The operation timing of the parallel plane plate 32 in this case is as follows. That is, first, the plane-parallel plate 3
Normal scanning is performed in a state where 2 is arranged at a normal position. The image signal thus acquired is subjected to predetermined signal processing in the signal processing unit 15 and the like, and then temporarily stored in a predetermined temporary recording unit (not shown).

Next, the parallel flat plate driving section 33 moves the parallel flat plate 32 in a predetermined direction (arrow X direction in FIG. 22) so as to be at a predetermined position shifted by a predetermined amount, for example, a half pixel. The parallel flat plate 32 is fixed at the position. Then, the parallel scanning plate 32 is driven to perform the second scanning. The image signal thus acquired is subjected to predetermined signal processing in the signal processing unit 15 and the like, and then temporarily stored in a predetermined temporary recording unit (not shown).

The two pieces of image data acquired in this manner are stored in the recording unit 16 in the same manner as in the modification of the sixth embodiment.
And output to a display device or the like as an external device as a signal output after being subjected to predetermined signal processing and the like.

[0372] The image data thus generated has higher definition image data than an image displayed by image data that can be generated by one scan performed by the image pickup device 14 of the image pickup apparatus 1C. Has become.

[0373] The image data thus generated is a higher definition image than an image displayed by image data that can be generated by one scan performed by the image pickup device 14 of the image pickup apparatus 1C.

On the other hand, in the image pickup apparatus 1D of the tenth embodiment, when operating the image pickup device 14 in the “skip drive mode”, the lens drive unit 34 operates the photographing lens 11 by the instruction from the system controller 20 as described above. By driving the photographing lens 11 at a predetermined timing in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (arrow X direction in FIG. 22).
Image data representing a high-quality image with reduced moiré can be obtained.

On the other hand, when operating the image sensor 14 in the “all pixel driving mode”, the system controller 2
0, the lens driving unit 34 sets the photographing lens 1
By controlling the driving of the camera lens 1 and moving the photographing lens 11 by a predetermined amount at a predetermined timing in a direction substantially perpendicular to the optical axis O of the photographing lens 11 (arrow X direction in FIG. 24), a higher Image data representing a fine image can be obtained.

The operation timing of the photographing lens 11 in this case is as follows. That is, first, the photographing lens 1
Normal scanning is performed with 1 placed at a normal position. The image signal thus obtained is subjected to predetermined signal processing in the signal processing unit 15 and the like, and then temporarily stored in a predetermined temporary recording unit (not shown).

Next, the lens driving section 34 moves the taking lens 11 in a predetermined direction (arrow X direction in FIG. 24) so as to be at a predetermined position shifted by a predetermined amount, for example, a half pixel, and moves to the position. The taking lens 11 is fixed. Then, the photographing lens 11 is driven to perform a second scan. The image signal thus acquired is subjected to predetermined signal processing in the signal processing unit 15 and the like, and then temporarily stored in a predetermined temporary recording unit (not shown).

The two image data thus obtained are recorded in the recording section 16 in the same manner as in the modification of the sixth and ninth embodiments, and after being subjected to predetermined signal processing and the like. Is output to a display device or the like, which is an external device, as a signal output.

[0379] The image data generated in this way has a higher definition than the image displayed by the image data generated by one scan performed by the image pickup device 14 of the image pickup apparatus 1D. Data.

[0380] The image data generated as a result is a higher definition image than an image displayed by image data that can be generated by one scan performed by the imaging device 14 of the imaging device 1D.

As described above, the sixth, ninth, and
In each modification of the tenth embodiment, when scanning the image sensor 14 in the “skip drive mode”, the system controller 20 controls the image sensor driver 31, the parallel plane plate driver 33, and the lens driver 34. By appropriately controlling and moving any one of the image sensor 14, the parallel plane plate 32, and the photographing lens 11 in a predetermined direction and a predetermined amount at a predetermined timing according to a case, a high-quality image in which moire is suppressed is displayed. Image data can be acquired, and "all pixel drive mode"
When the scanning of the image sensor 14 is performed by the system controller 20, the system controller 20 controls the image sensor driver 31 and the parallel flat plate driver 3
3. The lens driving unit 34 is appropriately controlled to control the imaging device 14
A plurality of scans by the image sensor 14 are performed while moving any one of the parallel plane plate 32 and the photographing lens 11 in a predetermined direction at a predetermined timing in a predetermined direction as necessary, and a plurality of image signals acquired thereby. By applying pixel signal addition processing or pixel signal mixing processing to the image data, image data representing a higher-definition image can be obtained.

In each of the modified examples of the sixth, ninth, and tenth embodiments described above, each image signal obtained as a result of performing two scans using the pixel shifting means as described above is used. The image data is acquired by performing a pixel signal addition process or a pixel signal mixing process based on the image data.However, the present invention is not limited to this. Image sensor 1 to perform
4 may be controlled. In this case, by performing pixel signal addition processing or pixel signal mixing processing on the image signal obtained by performing the operations a plurality of times, it is also easy to obtain image data that can represent a higher definition image.

In each of the embodiments described above, the case where the image pickup device of the image pickup apparatus is operated in the “block drive mode” has been described mainly in consideration of obtaining moving image data. Separately, even when the image pickup device is driven in the “block drive mode”, it is easy to obtain a still image. The drive control in this case is based on the “all-pixel drive mode”, such as opening and closing the mechanical shutter unit 13. Thereby, a so-called electronic zoom function can be provided.

[0384]

As described above, according to the present invention, the generation of aliasing distortion can be avoided by means different from the means for suppressing moire in the conventional imaging apparatus.
Therefore, it is possible to provide an imaging apparatus capable of always obtaining image data representing an image of good image quality while suppressing moire.

[Brief description of the drawings]

FIG. 1 is a main block diagram showing a schematic configuration of an imaging apparatus according to a first embodiment of the present invention.

FIG. 2 is a main part configuration diagram conceptually showing an optical low-pass filter and members related to the optical low-pass filter in the imaging apparatus of FIG. 1;

FIG. 3 is a main part configuration diagram conceptually showing a part of an image pickup device in the image pickup apparatus of FIG. 1;

FIG. 4 is a conceptual diagram illustrating the operation of an image sensor in the image pickup apparatus of FIG. 1;

FIG. 5 is a main block diagram showing a schematic configuration of an imaging apparatus according to a second embodiment of the present invention.

6 conceptually illustrates a part of a plurality of pixels arranged on an imaging surface of an imaging device in the imaging device in FIG. 5, and reads out a first frame when the imaging device performs scanning in a “skip drive mode”. FIG. 3 is a diagram illustrating pixels.

7 conceptually illustrates a part of a plurality of pixels arranged on an imaging surface of an imaging device in the imaging device in FIG. 5, and reads out a second frame when the imaging device performs scanning in a “skip drive mode”; FIG. 3 is a diagram illustrating pixels.

8 conceptually illustrates a part of a plurality of pixels arranged on an imaging surface of an imaging device in the imaging device in FIG. 5, and reads out a third frame when the imaging device performs scanning in a “skip drive mode”; FIG. 3 is a diagram illustrating pixels.

9 conceptually illustrates a part of a plurality of pixels arranged on an imaging surface of an imaging device in the imaging device in FIG. 5, and reads out a fourth frame when the imaging device performs scanning in a “skip drive mode”. FIG. 3 is a diagram illustrating pixels.

FIG. 10 is a conceptual diagram showing the operation of an image sensor in the image pickup apparatus of FIG. 5;

FIG. 11 conceptually illustrates a part of a plurality of pixels arranged on an imaging surface of an imaging device in an imaging device according to a third embodiment of the present invention, and the imaging device performs scanning in a “skip drive mode” FIG. 9 is a diagram showing read pixels of a second frame at the time.

12 conceptually illustrates a part of a plurality of pixels arranged on an imaging surface of an imaging device in the imaging device in FIG. 11, and illustrates a third frame when the imaging device performs scanning in a “skip drive mode” FIG. 4 is a diagram illustrating a read pixel.

FIG. 13 conceptually shows a part of a plurality of pixels arranged on an imaging surface of an imaging device in an imaging device according to a fourth embodiment of the present invention, and the imaging device performs scanning in a “skip drive mode” FIG. 9 is a diagram showing read pixels of a second frame at the time.

14 conceptually shows a part of a plurality of pixels arranged on an imaging surface of an imaging device in the imaging device in FIG. 13, and illustrates a third frame when the imaging device performs scanning in a “skip drive mode”. FIG. 4 is a diagram illustrating a read pixel.

FIG. 15 conceptually illustrates a part of a color filter array corresponding to a plurality of pixels arranged on an imaging surface of an imaging device in an imaging device according to a fifth embodiment of the present invention. The figure which shows the color filter corresponding to the read-out pixel of the 1st frame at the time of performing a scan by "form."

16 conceptually illustrates a part of a color filter array corresponding to a plurality of pixels arranged on an imaging surface of the imaging device in the imaging device in FIG. 15, and the imaging device performs scanning in a “skip drive mode” FIG. 10 is a diagram showing a color filter corresponding to a readout pixel of the second frame at the time.

17 conceptually illustrates a part of a color filter array corresponding to a plurality of pixels arranged on an imaging surface of the imaging device in the imaging device in FIG. 15, and the imaging device performs scanning in a “skip drive mode” FIG. 9 is a diagram showing a color filter corresponding to a readout pixel of a third frame at the time.

FIG. 18 is a main block diagram showing a schematic configuration of an imaging apparatus according to a sixth embodiment of the present invention.

FIG. 19 is a main part configuration diagram that extracts and shows the configuration in the vicinity of an imaging lens and an imaging element in the imaging devices of the sixth and seventh embodiments of the present invention.

FIG. 20 is a main part configuration diagram illustrating a configuration in the vicinity of an imaging lens and an imaging element in an imaging device according to an eighth embodiment of the present invention.

FIG. 21 is a main block diagram showing a schematic configuration of an imaging device according to a ninth embodiment of the present invention.

FIG. 22 is a main part configuration diagram showing a configuration in the vicinity of an imaging lens and an imaging element in the imaging apparatus in FIG. 21;

FIG. 23 is a main block diagram showing a schematic configuration of an imaging apparatus according to a tenth embodiment of the present invention.

FIG. 24 is a main configuration diagram of a configuration in the vicinity of an imaging lens and an imaging element in the imaging devices according to the tenth and eleventh embodiments of the present invention.

FIG. 25 is a main part configuration diagram showing a configuration in the vicinity of an imaging lens and an imaging element in an imaging device according to a twelfth embodiment of the present invention.

FIG. 26 is a conceptual diagram showing a part of an imaging surface of a conventional general imaging element.

FIG. 27 is a conceptual diagram illustrating pixel shifting performed in a conventional single-panel imaging device.

FIG. 28 is a conceptual diagram illustrating a part of an imaging surface of a conventional imaging element and explaining a state when operating in an “all-pixel driving mode”.

FIG. 29 is a conceptual diagram showing a part of an imaging surface of a conventional imaging device and explaining a state when operating in a “block drive mode”.

FIG. 30 is a conceptual diagram illustrating a part of an imaging surface of a conventional imaging element and explaining a state when operating in a “skip driving mode”.

FIG. 31 is a conceptual diagram illustrating an operation when moiré occurs when sampling is performed by operating an imaging element in a conventional imaging apparatus.

FIG. 32 shows an operation in a case where a conventional image pickup apparatus operates an image pickup device in a “skip drive mode”, performs sampling, extracts a pixel signal, and performs a predetermined pixel signal addition process on the obtained pixel signal. FIG.

[Explanation of symbols]

1.1A.1B.1C.1D... Image pickup device 11... Photographing lens (photographing optical system) 12... Optical low-pass filter unit (optical LPF;
Low-pass filter; photographing optical system) 12a: first low-pass filter (low-pass filter; photographing optical system) 12b: second low-pass filter (low-pass filter; photographing optical system) 12c: second 3 low-pass filter (low-pass filter; photographing optical system) 12d: disk 12A: optical low-pass filter (optical LPF; low-pass filter; photographing optical system) 13: mechanical shutter unit 14, 114 ... Imaging element 15 ... Signal processing unit 16 ... Recording unit 17 ... Display signal processing unit 18 ... Low-pass filter drive unit (LPF drive unit) 19 ... Timing generation unit 20 ... System controller (control circuit; drive control) Circuit 21: Pixel 31: Image sensor driving unit (variable unit; focal plane displacement unit) 32: Parallel plane plate (optical member) 33: Parallel plane plate driving unit (variable unit; Dot surface displacement means) 34 ...... lens driving unit (the variable means the focal point plane displacement means) 40 ...... color filter array

Claims (20)

[Claims] An imaging optical system for forming an optical image by receiving a light beam from a subject, and an imaging device for converting an optical image formed by the imaging optical system into an electric signal representing an image by photoelectrically converting the optical image. A scan performed using a plurality of pixels arranged on the imaging surface of the imaging device, and a first scanning mode without thinning scanning and a plurality of pixels arranged on the imaging surface of the imaging device. A drive control circuit that controls the drive of the image sensor so that at least two scan modes can be switched between a second scan mode and a second scan mode in which some pixels are thinned out, and the imaging optical system includes: It comprises a plurality of optical low-pass filters that limit the spatial frequency characteristics of the incident light beam,
The plurality of optical low-pass filters each have different spatial frequency characteristics, and switch between the plurality of optical low-pass filters in a first scanning mode and a second scanning mode. An imaging device characterized by being used. 2. The second scanning mode includes a scanning mode with a plurality of different thinning rates, and a plurality of pixels arranged on an imaging surface of the image sensor based on one of the plurality of thinning rates. When scanning is performed by thinning out some of the pixels, the drive control circuit determines an optimum low-pass filter among the plurality of optical low-pass filters according to a thinning rate when scanning is performed. The imaging apparatus according to claim 1, wherein the switching is performed so as to be a pass filter. 3. An imaging optical system for forming an optical image by receiving a light beam from a subject, and an image sensor for converting an optical image formed by the imaging optical system into an electric signal representing an image by photoelectrically converting the optical image. And a drive control circuit that thins out and scans some of the plurality of pixels arranged on the imaging surface of the image sensor. An image pickup apparatus characterized in that, in the case of scanning while thinning out, the readout pixels of the image pickup element are switched for each frame or each field. 4. In the case where scanning is performed by thinning out some of the plurality of pixels of the image sensor, a different thinning rate is used depending on the area of the image sensing surface of the image sensor, and the thinning of the image sensor is performed for each frame or each field. The imaging device according to claim 3, wherein read pixels are switched. 5. In a case where scanning is performed by thinning out some of the plurality of pixels of the image sensor, pixels of the same color are read out by switching read pixels of the image sensor for each frame or field. The imaging apparatus according to claim 3, wherein control is performed to read out the image data. 6. In the case where scanning is performed by thinning out some of the plurality of pixels of the image sensor, the total number of pixels at the time of reading by switching read pixels of the image sensor for each frame or field is as follows: The imaging apparatus according to claim 3, wherein control is performed such that the same number of pixels are read for each frame or each field. 7. In the case where scanning is performed by thinning out some of the plurality of pixels of the image pickup device, the image pickup device is subjected to signal addition processing or signal mixing processing in units of a plurality of pixels and frame by frame or field by field. 4. The image pickup apparatus according to claim 3, wherein the read pixels are changed. 8. An image pickup optical system for forming an optical image by receiving a light beam from a subject, and an image sensor for converting an optical image formed by the image pickup optical system into an electric signal representing an image by photoelectrically converting the image. And a drive control circuit that thins out and scans some of the plurality of pixels arranged on the imaging surface of the imaging element. An image pickup apparatus comprising: a variable unit that can relatively displace the positional relationship of the image pickup device with respect to a light beam incident on the image pickup device when scanning by thinning. 9. The image pickup apparatus according to claim 8, wherein said variable means can move said image pickup element with respect to an incident position of an incident light beam. 10. The apparatus according to claim 1, wherein the variable means is an optical member that is disposed closer to a subject than an imaging surface of the image sensor and that can shift an incident position of a light beam incident on the image sensor. Item 9. The imaging device according to Item 8. 11. When performing scanning by thinning out some of the plurality of pixels of the image sensor, the thinning rate may be different depending on the area of the image sensing surface of the image sensor, and the thinning rate of the image sensor may be different for each frame or each field. The imaging device according to claim 8, wherein a read-out pixel is switched. 12. In the case of scanning by thinning out some of the plurality of pixels of the image sensor, pixels of the same color are read out by switching read pixels of the image sensor for each frame or field. 10. The method according to claim 8, wherein the control is performed so as to read out.
12. The imaging device according to any one of 11. 13. In the case where scanning is performed by thinning out some of the plurality of pixels of the image sensor, the total number of pixels at the time of reading by switching read pixels of the image sensor for each frame or field is as follows: 13. The system according to claim 8, wherein control is performed such that the same number of pixels are read out for each frame or each field.
The imaging device according to any one of the above. 14. An imaging optical system for forming an optical image by receiving a light beam from a subject, and an image sensor for converting an optical image formed by the imaging optical system into an electric signal representing an image by photoelectrically converting the optical image. And a drive control circuit that thins out and scans some of the plurality of pixels arranged on the imaging surface of the imaging element, and thins out some of the plurality of pixels of the imaging element. An image pickup apparatus, comprising: a focal plane displacing unit that displaces a position of a focal plane on which an optical image formed on the image pickup element is focused when scanning by an image sensor. 15. The apparatus according to claim 1, wherein the focal plane displacing means is means for displacing the arrangement of the image sensor.
5. The imaging device according to 4. 16. The imaging apparatus according to claim 14, wherein the focal plane displacing means is means for displacing a part or the entire position of the photographing optical system. 17. An image pickup optical system for forming an optical image by receiving a light beam from a subject, and an image sensor for converting an optical image formed by the image pickup optical system into an electric signal representing an image by photoelectrically converting the image. A scan performed using a plurality of pixels arranged on the imaging surface of the imaging device, and a first scanning mode without thinning scanning and a plurality of pixels arranged on the imaging surface of the imaging device. And a drive control circuit that controls the drive of the image sensor so that at least two scan modes can be switched between a second scan mode and a second scan mode in which some pixels are thinned out. An imaging apparatus, comprising: a variable unit capable of relatively displacing a positional relationship between an incident position of a light beam incident on the imaging element and the imaging element in correspondence with a second scanning mode. 18. The imaging apparatus according to claim 17, wherein the variable amount by said variable means is switchable in correspondence with the first scanning mode and the second scanning mode. 19. The imaging apparatus according to claim 17, wherein the variable unit performs drive control so as to displace an arrangement of the imaging element with respect to an incident light beam. 20. The optical apparatus according to claim 20, wherein the variable means is an optical member that is disposed at a position closer to a subject than an imaging surface of the image sensor and that can shift an incident position of a light beam incident on the image sensor. The imaging device according to claim 17.