JPH0965195A - Motion detecting method, motion detector and motion detection image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a motion detection image pickup device using an X-Y address type solid-state image pickup element which is capable of performing a motion detection (motion tracking) without using a high speed and complicated exclusive hardware. SOLUTION: On the solid-state image pickup element composed of plural photodiodes DD, a light receiving element group GP is set by nine photodiodes DD. This light receiving element group GP is defined as a unit and the output signals of the photodiodes DD within the light receiving element group GP are simultaneously read, performing a scanning on an image pickup element. The output signals of the three photodiodes arranging in a vertical direction of the photodiodes DD are added for every column and X direction projection data is generated. The output signals of the three photodiodes arranging in a horizontal direction of the photodiodes DD are added for every line and Y direction projection data is generated. The X direction projection data and the Y direction projection data are compared for every scanning defining the light receiving element group GP as a unit and a motion is detected by using the comparison result.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a MOS-device for switching an output signal corresponding to the amount of light received from a light-receiving element to a light-receiving element corresponding to each pixel.
FET (Metal Oxide Semiconductor-Field Effect Tra
The present invention relates to a motion detection method, a motion detection device, and a motion detection image pickup device using a so-called XY address type solid-state image pickup device in which an nsistor is arranged.

In recent years, due to advances in semiconductor device manufacturing technology,
Also in the solid-state image pickup element, there is a remarkable tendency of increasing the number of pixels and reducing the pixel size. Here, when the above-mentioned solid-state image sensor is used as an input device in image information processing such as image recognition, the output signals from the respective pixels included in the solid-state image sensor are individually fetched, and these are output as signals of a computer or the like. Although it will be processed by the processing device, at this time, the number of output signals to be processed will also increase due to the increase in the number of pixels as described above, and in image recognition that requires real-time processing such as motion tracking The influence of time on the real-time property cannot be ignored.

[0003]

2. Description of the Related Art Conventionally, in image information processing such as motion detection and motion tracking, a CCD (Charge Coupl
ed Device), a serial output signal from this CCD (continuously output for each pixel) is converted into a digital signal by an A / D converter and taken into a computer, and then smoothed on the computer. After performing pre-processing such as contour extraction, necessary image information such as pattern recognition is extracted.

[0004]

However, since the output signal from the CCD is a serial signal as described above, when performing motion detection or the like, the image data for one frame or several frames is displayed on the computer. RAM temporarily
After storing in a memory such as (Random Access Memory),
It is necessary to detect the motion by comparing the next read one frame or several frames worth of data with the previously recorded one frame or several frames worth of data. Therefore, in image information processing that requires real-time processing such as motion detection and motion tracking, the amount of storage and calculation in a computer is generally enormous. Therefore, high-speed processing using a memory with an enormous recording capacity and the like by using dedicated hardware such as a computer and a CCD is required.
There is a problem that the device becomes complicated, large, and expensive.

Therefore, the present invention has been made in view of the above problems, and an object thereof is a motion detection method capable of motion detection (motion tracking) without requiring high-speed and complicated dedicated hardware. To provide a motion detection device and a motion detection imaging device.

[0006]

In order to solve the above problems, the invention according to claim 1 adjoins in a rectangular shape in an image pickup section in which a plurality of light receiving elements such as photodiodes are arranged in a grid pattern. N × m (n: an integer of 2 or more, m: an integer of 2 or more) light receiving elements in the light receiving element group, which are output from each of the light receiving elements and correspond to the imaging target,
An image pickup step of reading the m light receiving elements simultaneously while scanning the image pickup unit at a predetermined scanning timing for each light receiving element group, and simultaneously reading from the light receiving element group at one scanning timing. Among the one scanning output signal composed of the plurality of output signals, a plurality of the output signals output from the respective light receiving elements continuous in a predetermined direction such as a vertical direction are added to output a first addition output signal. At the same time, an adding step of adding a plurality of the output signals output from each light receiving element continuous in a direction perpendicular to the predetermined direction such as the horizontal direction among the one scan output signals to output a second added output signal. And comparing the first addition output signal corresponding to the one scanning timing with the first addition output signal corresponding to another scanning timing after the one scanning timing. Outputs the difference signal, said second sum output signal corresponding to the one scan timing,
A comparison step of outputting a second difference signal by comparing the second addition output signal corresponding to the other scanning timing, and a movement of the imaging target based on the first difference signal and the second difference signal. And a detection step of detecting.

According to the operation of the invention described in claim 1, in the imaging step, the output signals output from the respective light receiving elements in the light receiving element group are simultaneously output to the respective light receiving elements forming the light receiving element group, and Reading is performed while scanning the imaging unit at a predetermined scanning timing for each light receiving element group.

Then, in the adding step, a plurality of output signals output from the respective light receiving elements continuous in a predetermined direction are added to one scanning output signal to output a first addition output signal, and one scanning output is further output. Among the signals, a plurality of output signals output from the respective light receiving elements continuous in a direction perpendicular to the predetermined direction are added to output a second added output signal.

Thereafter, in a comparison step, the first addition output signal corresponding to one scanning timing is compared with the first addition output signal corresponding to another scanning timing after the one scanning timing, and the first difference is obtained. A signal is output, and the second addition output signal corresponding to one scanning timing is compared with the second addition output signal corresponding to another scanning timing to output a second difference signal.

As a result, in the detecting step, the movement of the image pickup object is detected based on the first difference signal and the second difference signal. Therefore, based on the one scanning output signal output from the light receiving element group, the first and second addition signals are generated at each scanning timing, and the plurality of first and second scanning signals obtained by scanning on the imaging unit are obtained. Since the motion detection is performed by mutually comparing the added signals for each first addition signal and each second addition signal, the motion detection process is performed for the output signal of each light receiving element to detect the motion. The motion detection process can be simplified and speeded up as compared with the case of

In order to solve the above problems, a second aspect of the present invention is provided.
According to the invention described in (3), n × m adjacent to each other in a rectangular shape in an image pickup section in which a plurality of light receiving elements such as photodiodes are arranged in a grid pattern
Output from each of the light receiving elements in the light receiving element group consisting of (n: an integer of 2 or more, m: an integer of 2 or more) light receiving elements,
An image pickup unit such as a solid-state image pickup device which reads out an output signal corresponding to an image pickup object simultaneously for n × m light receiving elements and while scanning the image pickup unit at a predetermined scanning timing for each light receiving element group. , A plurality of output from each light receiving element continuous in a predetermined direction such as a vertical direction among one scan output signal composed of the plurality of output signals read from the light receiving element group at the same scanning timing. The output signals are added to output a first addition output signal, and a plurality of the one output signal output from each light receiving element continuous in a direction perpendicular to the predetermined direction such as a horizontal direction is output. An addition unit such as an addition unit that adds the output signals and outputs a second addition output signal, the first addition output signal corresponding to the one scanning timing, and other components after the one scanning timing. Wherein corresponding to the scanning timing first
A first difference signal is output by comparing the addition output signal, and the second addition output signal corresponding to the one scanning timing and the second addition signal corresponding to the other scanning timing.
Comparing means such as a comparing section that compares the added output signal and outputs a second difference signal, and detection of a detecting section that detects the movement of the imaging target based on the first difference signal and the second difference signal And means.

According to the operation of the invention described in claim 2, the image pickup means simultaneously outputs the output signals output from the respective light receiving elements in the light receiving element group to the respective light receiving elements constituting the light receiving element group, and Reading is performed while scanning the imaging unit at a predetermined scanning timing for each light receiving element group.

Then, the adding means adds a plurality of output signals output from the respective light receiving elements continuous in a predetermined direction out of the one scanning output signal to output a first addition output signal, and further outputs one scanning output. Among the signals, a plurality of output signals output from the respective light receiving elements continuous in a direction perpendicular to the predetermined direction are added to output a second added output signal.

After that, the comparison means compares the first addition output signal corresponding to one scanning timing with the first addition output signal corresponding to another scanning timing after the one scanning timing and compares the first addition output signal with the first difference. A signal is output, and the second addition output signal corresponding to one scanning timing is compared with the second addition output signal corresponding to another scanning timing to output a second difference signal.

As a result, the detecting means detects the movement of the image pickup object based on the first difference signal and the second difference signal. Therefore, based on the one scanning output signal output from the light receiving element group, the first and second addition signals are generated at each scanning timing, and the plurality of first scanning signals obtained by scanning the imaging unit are obtained.
Since the motion detection is performed by mutually comparing the second addition signal and the second addition signal for each of the first addition signal and the second addition signal, the motion detection process is performed for the output signal of each light receiving element. The speed of the motion detection processing can be increased as compared with the case of detecting, and the addition means, comparison means and detection means other than the image pickup means can be simplified.

In order to solve the above problems, a third aspect of the present invention is provided.
In the image pickup means in the motion detecting device according to claim 2, each of the light receiving elements constituting the light receiving element group is a first switch means such as a MOS (Metal Oxide Semiconductor) transistor and a MOS transistor. Are connected individually to the same number of output lines as the light receiving elements forming the light receiving element group via the second switch means, and the output signal of each light receiving element is output to the adding means via the output line. At the same time, the signal charge corresponding to the output signal is connected between the first switch means and the second switch means until the reading of the output signal of each light receiving element based on the scanning timing is completed. And a storage unit such as a source follower amplifier that stores the voltage and a voltage that is continuous in a direction perpendicular to the predetermined direction in the light receiving element group. First switch control means such as a vertical shift register for simultaneously controlling activation / deactivation of the first switch means connected to the optical element, and each of the light receiving elements connected in the predetermined direction in the light receiving element group are connected. The second switch control means such as a horizontal shift register for simultaneously controlling the activation of the second switch means, and the output signals of the respective light receiving elements forming the light receiving element group are simultaneously output to the adding means, The timing signal for performing the scanning on the imaging unit is set to the first signal.
And a timing control unit such as a timing control unit for outputting to the switch control unit and the second switch control unit.

According to the operation of the invention described in claim 3, in addition to the operation of the invention described in claim 2, the output signals of the respective light receiving elements forming the light receiving element group are the first switch means and the second switch means. The light is output individually to the same number of output lines as the light receiving elements forming the light receiving element group via the switch means, and to the adding means via the output line.

At this time, the storage means connected between the first switch means and the second switch means outputs an output signal until the reading of the output signal of each light receiving element based on the scanning timing is completed. Corresponding signal charges are accumulated and converted into voltage.

In parallel with this, the first unit included in the image pickup means
The switch control means simultaneously controls the activation / deactivation of the first switch means connected to each light receiving element continuous in the direction perpendicular to the predetermined direction in the light receiving element group.

Further, the second switch control means included in the image pickup means simultaneously controls activation of the second switch means connected to each light receiving element continuous in the predetermined direction in the light receiving element group.

The timing control means included in the image pickup means outputs the output signals of the respective light receiving elements forming the light receiving element group to the adding means at the same time, and at the same time outputs the timing signal for scanning the image pickup section as the first signal. It outputs to the switch control means and the second switch control means.

Therefore, the signal charge corresponding to the output signal is accumulated and voltage-converted by the accumulating means until the reading of the output signal of each light receiving element based on the scanning timing is completed. The output signals of the respective light receiving elements in the light receiving element group are simultaneously output to the adding means. After that, the motion detection is performed by the addition unit, the comparison unit, and the detection unit, so that the motion detection process can be speeded up and the motion detection apparatus can be simplified.

In order to solve the above problems, a fourth aspect of the present invention is provided.
The invention according to claim 2 is the adding means in the motion detecting apparatus according to claim 2, wherein the adding means is arranged on the same chip as the image pickup means and is continuous from the one scanning output signal in the predetermined direction. A first selecting means such as an X-direction selector for selecting an output signal output from the light receiving element and outputting a first direction output signal, and a first direction output signal for each of the selected light receiving elements are added to add the first direction output signal. First select signal adding means such as a source follower amplifier which outputs a 1 addition signal, and an output signal output from a light receiving element continuous in a direction perpendicular to the predetermined direction from the one scanning output signal,
Second selection means such as a Y-direction selector that outputs a second direction output signal, and a source follower amplifier that adds the second direction output signal of each of the selected light receiving elements and outputs the second added signal. And a second selection signal adding means.

According to the operation of the invention described in claim 4, in addition to the operation of the invention described in claim 2, the first selection means included in the addition means arranged on the same chip as the image pickup means, The output signal output from the light receiving element continuous in the predetermined direction is selected from the one scan output signal, and the first direction output signal is output.

Then, the first selection signal adding means adds the first direction output signals for each of the selected light receiving elements and outputs the first addition signal. In parallel with these, the second selecting means included in the adding means selects the output signal output from the light receiving elements continuous in the direction perpendicular to the predetermined direction from the one scanning output signal, and outputs the second direction output signal. Output.

Then, the second selection signal adding means adds the second direction output signals for each of the selected light receiving elements and outputs the second addition signal. Therefore, the output signal to be the first addition output signal is selected by the first selection means, the output signal to be the second addition output signal is selected by the second selection means, and these selection means further add Since it is configured on the same chip as the image pickup means as a means, the configuration of the processing device that performs the comparison processing and the detection processing can be further simplified.

In order to solve the above problems, a fifth aspect of the present invention is provided.
The invention according to claim 4 is the motion detecting apparatus according to any one of claims 2 to 4, wherein the light receiving element group is (2X + 1).
A central pixel selector or the like configured from ² (X: natural number) of the light receiving elements and selecting a center output signal which is an output signal of the light receiving elements at the center position in the light receiving element group from the one scanning output signal. Center signal selection means,
And an image generation unit such as an image generation unit that outputs an image signal corresponding to the imaging target based on the center output signal for each scanning timing.

According to the action of the invention described in claim 5, in addition to the action of the invention described in any one of claims 2 to 4,
The light receiving element group is composed of (2X + 1) ² (X: natural number) light receiving elements, and the center signal selecting means selects the center output signal from one scanning output signal.

Then, the image generating means outputs an image signal corresponding to the object to be imaged, based on the center output signal for each scanning timing. Therefore, since the image signal is obtained based on the center output signal from the light receiving element at the center of the light receiving element group,
The motion detection process can be simplified and speeded up, and at the same time as the motion detection process, an image signal corresponding to the imaging target can be obtained.

In order to solve the above problems, a sixth aspect of the present invention is provided.
The invention according to claim 5 is the motion detecting device according to claim 5, an image forming unit such as an image forming lens for forming an image of the image pickup target on the image pickup unit, and a signal processing unit for signal processing the image signal. And the like, and drive means such as a drive section for driving the motion detecting device.

According to the operation of the invention described in claim 6, in addition to the operation of the invention described in claim 5, the image forming means forms an image of the object to be imaged on the image pickup section. Then, the signal processing means signal-processes the image signal from the image generation means.

In parallel with these, the driving means drives the motion detecting device. Therefore, it is possible to realize a motion detection image pickup apparatus that speeds up the motion detection process and simultaneously obtains an image corresponding to an image pickup target.

[0033]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, a preferred embodiment of the present invention will be described with reference to the drawings. In the following embodiments, a plurality of photodiodes are arranged as a light receiving element in a grid pattern, and an XY address type solid-state image pickup element in which a MOS transistor is used as an analog switch is used as an input device, and an image pickup target is obtained. This embodiment is an embodiment in which the present invention is applied to a motion detection image pickup apparatus capable of performing the motion detection and the motion tracking and simultaneously capturing and outputting the image itself corresponding to the image pickup target. (I) Principle of the Present Invention First, the principle of the present invention will be described with reference to FIG. 1 before describing specific embodiments.

In the present invention, first, as shown in FIG. 1A, photodiodes D as a plurality of pixels forming an image pickup section in a solid-state image pickup device as an input device.
Among D, the light receiving element group GP is set by using a predetermined number of photodiodes DD arranged adjacent to each other in a grid pattern. The number of the photodiodes DD in the light receiving element group GP may be any number as long as it is 4 or more and can be arranged in a lattice, and the number will be described as 9 in the following embodiments.

When one light receiving element group GP is set, next, as shown in FIG. 1B, the output signals of the respective light receiving elements of the light receiving element group GP corresponding to the image of the object Z to be imaged, Three pixels are added to each of the light receiving elements arranged in the vertical direction and the horizontal direction to generate X-direction projection data and Y-direction projection data. More specifically, among the nine photodiodes DD constituting one light receiving element group GP, as shown in FIG. 1B, an output signal of the A pixel, an output signal of the D pixel, and an output signal of the G pixel. Is added to form the first X partial projection data, and the output signal of the B pixel, the output signal of the E pixel, and the output signal of the H pixel are added to form the second X partial projection data, the output signal of the C pixel and the F pixel. And the output signal of the I pixel are added to obtain the third X partial projection data. Then, based on the first X partial projection data to the third X partial projection data, FIG.
The X-direction projection data shown in (B) is generated. At this time,
For example, when the triangular imaging target Z as shown in FIG. 1B is located in the center of the light receiving element group GP, the value of the second X partial projection data corresponding to the central part of the imaging target Z ( The voltage value) is the highest, and the values of the first X partial projection data and the third partial projection data are smaller and equal to those of the second X partial projection data.

On the other hand, in the Y direction, similar to the X direction, the output signal of the A pixel, the output signal of the B pixel, and the output signal of the C pixel are added to form the first Y partial projection data, and the first Y partial projection data is obtained. The second Y partial projection data is obtained by adding the output signal, the output signal of the E pixel, and the output signal of the F pixel, and the second Y partial projection data is obtained by adding the output signal of the G pixel, the output signal of the H pixel, and the output signal of the I pixel. 3Y partial projection data. Then, Y-direction projection data is generated based on the first Y partial projection data to the third Y partial projection data. At this time, for example, in the case of the triangular imaging target Z, the value of the second X partial projection data corresponding to the central part of the imaging target Z becomes the highest, and then the second Y partial projection including the bottom part of the imaging target Z. The value of the data becomes large, the third Y partial projection data including the vertices of the imaging target Z becomes the smallest, and the Y-direction projection data generated based on these becomes
As shown in FIG. 1 (B).

Then, the generated X-direction projection data and Y-direction projection data (feature data having the features of the image pickup target Z) are temporarily stored in the recording unit. The above operation scans the image pickup unit in units of the light receiving element group GP (photodiode DD constituting the light receiving element group GP
Are shifted by one column or one row)).

Next, when the image pickup object Z moves, the light receiving element group GP on which the image of the image pickup object Z is formed changes. At this time, the X-shaped projection data and the X-direction projection data having the same signal shape as those of the X-direction projection data. When the light receiving element group GP that outputs the direction projection data and the Y direction projection data is searched, the position of the searched light receiving element group GP on the image pickup unit and the image pickup unit of the light receiving element group GP before the image pickup target Z is moved. Depending on the position above, the imaging target Z
Can be detected and further tracked. Specifically, as shown in FIG. 1C, the image pickup target Z is imaged on the light receiving element group GP ₁ on the image pickup section TP, and the X direction projection data and the Y direction projection data thereof are shown by dotted lines. Then, after moving the imaging target Z, a light receiving element group that outputs the same X-direction projection data and Y-direction projection data as the dotted X-direction projection data and Y-direction projection data is searched, and as a result, for example, FIG. If the light receiving element group GP ₂ in 1 (C) outputs the same data as the X direction projection data and the Y direction projection data, the light receiving element group G
P ₂ is recognized as a light receiving element group that is imaging the imaged object Z after the movement. Thereby, the movement of the imaging target Z can be detected, and the movement can be further tracked.

As described above, in the present invention, the movement of the image pickup target Z can be detected only by comparing the above-mentioned X-direction projection data and Y-direction projection data.
It is possible to simplify and speed up the motion detection process, as compared with the conventional technique in which the information of each pixel is stored for each frame and compared.

Specific embodiments based on the above-described principle will be described below. (II) First Embodiment First, a first embodiment corresponding to the invention described in claims 1 to 3, 5 and 6 will be described with reference to FIGS. 2 to 5.

First, the configuration of the motion detection / imaging device according to the first embodiment will be described with reference to FIG. As shown in FIG. 2, the motion detection image pickup apparatus S _{1 according} to the first embodiment includes an image pickup section configured by a plurality of photodiodes DD arranged in a grid pattern, and constitutes one light receiving element group. The solid-state imaging device 1 having the same number (9) of output lines O _{1 to} O ₉ as the number of the photodiodes DD, and the incident light IN from the imaging target is condensed on the imaging unit on the solid-state imaging device 1, An image forming lens 2 as an image forming means for forming an image corresponding to an image pickup target on the image pickup unit, and an output signal S of a photodiode DD output from the solid-state image pickup device 1 via output lines O _{1 to} O _9. based on _O1 to S _O9, performs (including. the same applies hereinafter motion tracking) processing the motion detection, and the processing unit 3 for outputting an image signal S _O to generate an image based on the imaging target, the image signal S _O And perform predetermined signal processing,
A signal processing unit 9 as signal processing means for outputting the image output signal S ₀₀ to a display device such as an external monitor (not shown).
And a drive unit 10 as a drive unit that outputs a drive signal S _D including a clock signal for driving the solid-state imaging device 1 and the processing device 3.

The processing device 3 is a computer or the like.
Output line O₁Through O₉Through solid-state image sensor
Output signal S output from 1_O1Or S_O9Based on
Of the photodiodes that make up the device group GP, the vertical one
Output signals corresponding to the three pixels arranged in the same direction,
The above-mentioned first X partial projection data to third X partial projection data
And the first Y partial projection data to the third partial projection data
Generated, and based on these, the X direction as the first addition signal
Projection data S_AXAnd the Y direction projection data as the second addition signal.
Data S_AYAn adding unit 4 as an adding unit for outputting
X-direction projection data S for each scanning timing for each element GP
_AXAnd Y direction projection data S_AYIs temporarily stored in
Based on the X-direction projection data S at each scanning timing,
_AXAnd Y direction projection data S_AYCompare and scan each time
Projection data S in X direction_AXThe first difference, which is the difference between them
X direction difference signal S as a signal_DXAnd at each scan timing
Y direction projection data S in_AYSecond difference signal, which is the difference between the two
Direction difference signal S as_DYAs a comparison means to output
Comparison unit 5 and X direction difference signal S_DXAnd Y direction difference signal S _DYTo
Based on the same X direction projection data S_AXAnd Y direction projection day
TA S_AY(X direction difference signal S_DXAnd Y direction difference signal S_DYBut
X-direction projection data S that is "0"_AXAnd Y direction projection day
TA S_AYSearch for the light receiving element group GP that outputs
By doing so, the detection unit as the detection means for detecting the motion
6 and the output signal S output from the solid-state image sensor 1_O1Or
S_O9From among the light receiving element groups GP at each scanning timing
Signal from the photodiode DD located in the center of the
The central output signal S which is_VOSelect and output center signal
Central pixel selector 7 as means and each scanning timing
Center output signal S at_VOBased on the image signal S_ORaw
An image generation unit 8 as an image generation means for generating and outputting
It is composed of

Next, the structure of the solid-state image pickup device 1 will be described with reference to FIG. In the first embodiment,
As shown in FIG. 3, a solid-state imaging device 1 in which 25 photodiodes D _{11 to} D ₅₅ are arranged in a 5 × 5 lattice will be described. In the solid-state image sensor 1 shown in FIG. 3, the light receiving element group GP is composed of 9 photodiodes.

As shown in FIG. 3, the solid-state image pickup device 1 according to the first embodiment receives the incident light IN which is condensed by the imaging lens 2 (see reference numeral 2 in FIG. 2) and receives the incident light. 5 × 5 which outputs an output signal corresponding to the strength of IN
Of the photodiodes D _{11 to} D ₅₅ as light receiving elements arranged in a lattice and the photodiodes D _{11 to} D ₅₅ connected to the photodiodes D _{11 to} D ₅₅ by the control of the vertical shift register VR as the first switch control means. _{11 to} D
MO as the first switch means for killing the output signal of ₅₅
The second signal for killing the output signals of the photodiodes D _{11 to} D ₅₅ by controlling the S transistors SV _{11 to} SV ₅₅ and the horizontal shift register HR as the second switch control means.
Switch sections S _{1 to} S ₁₅ including MOS transistors as switch means, and photodiodes D _{11 to} D ₅₅
And the bus line BL connecting the switch units S _{1 to} S _{15
1 to} BL ₁₅ and the light receiving elements GP connected to the switch sections S _{1 to} S ₁₅ and outputting the output signals of the photodiodes D _{11 to} D _{55 to} the adder section 4 as output signals S _{O1 to} S _O9. The same number (9) of output lines O _{1 to} O _{9 as the} constituent photodiodes and the MOS transistors connected to the photodiodes arranged in the horizontal direction are simultaneously provided.
In addition, the vertical shift register V that kills each row independently
R and three switch parts S _{1 to} S ₁₅ at the same time, and 3
Horizontal shift register HR that controls each one independently
And timing control as timing control means for performing timing control on the vertical shift register VR and the horizontal shift register HR based on the drive signal S _D from the drive unit 10 to perform scanning for each light receiving element group GP. And a section TG.

Here, one photodiode, for example,
Photodiode D₁₁Focusing on the photodiode
D₁₁Is a MOS transistor SV₁₁Through bus line
BL ₁Connected to the bus line BL₁Is a switch
Part S₁Output line O through₁It is connected to the. Also, 2
Of the five photodiodes, one row (horizontal (horizontal
The photodiodes that make up the
Common vertical control line V via MOS transistor₁Or
V_FiveIs connected to and is controlled by the vertical shift register VR.
Control ON / OFF of each output signal line by line at the same time
Is done.

On the other hand, the photodiodes constituting one row (vertical (vertical direction) row) are connected to a common bus line every two rows via their respective MOS transistors. That is, the photodiode D ₁₁ in FIG.
And the photodiode D ₄₁ are connected to the common bus line BL ₁ , and the photodiode D ₂₁ and the photodiode D ₅₁ are connected to the common bus line BL ₂ . The three bus lines to which the photodiodes that form one column are connected are individually connected to one of the output lines via the switch section. For example, the first
For the photodiodes D _{11 to} D ₅₁ forming the column, the switch unit S is connected via the bus lines BL _{1 to} BL _{3.
1 to} S ₃ and further connected to output lines O _{1 to} O ₃ . At this time, the photodiodes forming one column are connected to the same output line every two columns. That is, in the case of FIG. 3, the photodiodes D _{11 to} D ₅₁ forming the first column and the photodiodes D _{14 to} D ₅₄ forming the fourth column are connected to the same output lines O _{1 to} O ₃ , respectively. There is.

Further, the switch units S _{1 to} S ₁₅ are connected to the horizontal shift register HR via the common horizontal control lines H _{1 to} H ₅ in groups of 3, and are turned on at the same time, and independently of each other. , Off is controlled.

Next, each switch S₁Or S_FifteenIn the configuration of
About switch S₁Or S_ThreeFigure 4 for the case of
It demonstrates using. As shown in FIG. 4, for example, one switch
Touch part S₁Is a source follower amplifier A as a storage means
₁And the MOS transistor S as the second switch means
H₁And the switch section S₂
And S_ThreeIs the same in. And each source follower
Amplifier A₁Through A_ThreeIs the bus line BL₁Through B
L _ThreeAnd each MOS transistor SH₁No
To SH_ThreeThe output end of each is output line O₁Through O_ThreeContact
Has been continued. In addition, each source follower amplifier A₁Through A
_ThreeIs the bus line BL₁To BL_ThreeEach file input from
High impedance for output signal from photodiode
Therefore, the photodiode is
Signal charge corresponding to the output signal from the
Has the effect of accumulating.

Here, when one light receiving element group GP is composed of nine photodiodes, one photodiode is scanned nine times in scanning for each light receiving element group, as described later. Therefore, during the 9 scans, the signal charge corresponding to the output signal is applied to the source follower amplifier A ₁
It is necessary to be stored in A ₃ to A ₃ . Therefore, the shift registers VR and HR are controlled by the timing control unit TG so that the scanning is completed nine times within the predetermined lifetime.

Next, the operation of the solid-state image pickup device 1 will be described with reference to FIGS. In the following description, each photodiode is assumed to always output an output signal corresponding to the received incident light IN. First, the description will focus on Figure 5, the operation based on the control of the vertical shift register VR, the vertical shift register VR on the basis of the vertical timing signal S _TV from the timing control unit TG, the vertical control lines V ₁ to V ₅ With respect to the light receiving element group G
In order to perform scanning in the vertical direction in units of P, the MOS transistors SV _{11 to} SV ₅₅
A control signal is output to turn on. At this time, the time to shift the control signal (corresponding to time t _{v0 to} t _v1 in FIG. 5A) is 1 / time of the time required to scan all the photodiodes included in the solid-state imaging device 1. 3, and for one vertical control line, all the time to turn on the MOS transistor connected to the vertical control line (e.g., corresponding to time t _v0 -t _v3 in FIG. 5A) This is the time required to scan the photodiode of.

For this operation, refer to FIG.
More specifically, at time t_v0-T_v3MOS tiger between
Register SV₁₁To SV_FifteenControl signal to turn on.
Direct control line V₁Output to the MOS transistor for the corresponding period
SV₁₁To SV_FifteenTurns on. Next, time t_v1-T_v4
MOS transistor SV between_{twenty one}To SV_{twenty five}Turn on
Control signal is vertical control line V₂Is output to MO during the period
S transistor SV₁₂To SV_{twenty five}Turns on. Less than,
Similarly, at time t_v2-T_v5MOS transistor SV between₃₁
To SV₃₅Is turned on at time t_v3-T_v6Between MOST
Langista SV ₄₁To SV₄₅Is turned on at time t_v4−
t_v7MOS transistor SV between₅₁To SV₅₅Is on
Become. And time t_v7-T_v8Between the specified rest periods
Then, the above operation is repeated again.

Here, time t_v2-T_v3In between,
Langista SV₁₁To SV_Fifteen, SV _{twenty one}To SV_{twenty five}And
SV₃₁To SV₃₅Know that all are on
You. Therefore, this time t_v2-T_v3In between, horizontal shift cash register
Under the control of the star HR, the light receiving element group GP runs in the horizontal direction.
An inspection will be conducted.

That is, as shown in FIG. 5B, the horizontal shift register HR receives the light receiving elements for each of the horizontal control lines H _{1 to} H ₅ based on the horizontal timing signal S _TH from the timing control section TG. In order to perform scanning in the horizontal direction with the group GP as a unit, the control signals are output so as to turn on the MOS transistors SH _{1 to} SH ₁₅ by shifting them row by row. At this time, the time for shifting the control signal (see FIG.
(Corresponding to time t _h0 -th _h1 in (B)) is set to ⅓ of the time required to scan all the photodiodes in the horizontal direction forming the solid-state image sensor 1, and one horizontal For the control line, the time for turning on the MOS transistor connected to the horizontal control line (see, for example, FIG.
(Corresponding to time t _h0 -th _h3 in (B)) is the time required to scan all the photodiodes in the horizontal direction.

For this operation, refer to FIG.
More specifically, at time t_h0-T_h3MOS tiger between
Register SH₁To SH_ThreeControl signal to turn on
Flat control line H₁Output to the MOS transistor for the corresponding period
SH₁To SH_ThreeTurns on. Next, time t_h1-T_h4
MOS transistor SH between_FourTo SH₆(Switch section
S_FourOr S₆Control signal to turn on).
Flat control line H₂Output to the MOS transistor for the corresponding period
SH_FourTo SH₆Turns on. Hereinafter, similarly, the time t
_h2-T_h5MOS transistor SH between₇To SH₉(Su
Switch part S₇Or S₉(Included in) is turned on and the time
t_h3-T_h6MOS transistor SH between _TenTo SH
₁₂(Switch S_TenOr S₁₂Is included in)
Time t_h4-T_h7MOS transistor SV between₁₃Or
SV_Fifteen(Switch S₁₃Or S_FifteenIs included)
Become.

Here, it can be seen that the MOS transistors SV _{1 to} SV ₉ are all turned on between the times t _{h2 and} t _h3 . Therefore, considering the operation of the vertical shift register VR between the times t _{v2 and} t _v3 described above, the time t _h2 −
During t _h3 , the output signals of the nine photodiodes (light receiving element group GP) of the photodiodes D _{11 to} D ₁₃ , D _{21 to} D ₂₃ , and D _{31 to} D ₃₃ are simultaneously output as the output signals S _{O1 to} S _O9. Is output.

Next, between the times t _{h3 and} t _h4 , all the MOS transistors SV _{4 to} SV ₁₂ are turned on. Therefore,
Similar to the time between t _{h2 and} t _h3 , the photodiodes D _{12 to} D ₁₄ , D _{22 to} D _{24 and} D ₃₂ are located between the time t _{h3 and} t _h4.
The output signals of the light receiving element groups GP of D to D ₃₄ are output signals S _O1
To S _O9 are simultaneously output. Below, time t _h4 −t
In between _h5, photodiode D ₁₃ to D _15, D ₂₃ to D
_{25 and} the output signals of the light receiving element group GP of D _{33 to} D ₃₅ are
The output signals S _{O1 to} S _O9 are simultaneously output. In this way, horizontal scanning is performed for each light receiving element group GP,
Output signals S _{O1 to} S _O9 corresponding to scanning are simultaneously output at each scanning timing.

Next, since the MOS transistors SV _{21 to} SV ₂₅ , SV _{31 to} SV _{35 and} SV _{41 to} SV ₄₅ are all on during the time t _v3 -t _{v4 in} FIG. Between time t _{v3 and} t _v4 , the control signal shown in FIG. 5B is output from the horizontal shift register HR, and horizontal scanning is performed for each light receiving element group GP as described above.

Further, since the MOS transistors SV _{31 to} SV ₃₅ , SV _{41 to} SV _{45 and} SV _{51 to} SV ₅₅ are all on during the time t _{v4 to} t _v5 of FIG. During _{tv4 to tv5} , the control signal shown in FIG. 5B is output from the horizontal shift register HR, and the same horizontal scanning is performed for each light receiving element group GP.

The vertical shift registers VR and VR described above
By the operation of the horizontal shift register HR, all shown in FIG.
For the photodiode of, the light receiving element group GP (9
Vertical and horizontal direction in units of photodiode
Scanning is performed, and scanning is performed at each scanning timing.
The output signal of the corresponding photodiode is the output signal S _O1
Or S_O9Are output at the same time.

At this time, paying attention to one photodiode, for example, the photodiode D ₃₃ , the output signal is read 9 times before the scanning of the entire photodiode included in the solid-state image pickup device 1 is completed. For this reason,
MOS transistors SH _{1 of} each switch S _{1 to} S ₁₅
To SH _{15 on} the input side of source follower amplifiers A _{1 to} A ₁₅
Is provided for accumulating signal charges corresponding to the output signal, and scanning is performed nine times for each source follower amplifier A _{1 to} A _15.
The scan time is controlled by the shift registers VR and HR so that the scan time is shorter than the lifetime of the scan register.

Further, in the actual solid-state image pickup device 1,
Dummy photodiodes are provided around the photodiodes D _{11 to} D ₅₅ shown in FIG. 3 (for example, two rows and two columns are additionally arranged around the photodiodes D _{11 to} D ₅₅ shown in FIG. 3), and this dummy photodiode is provided. By configuring the light receiving element group GP including the dummy photodiodes, the entire photodiodes D _{11 to} D ₅₅ shown in FIG. 3 are configured to scan 9 times each.

By the operation described above, the solid-state image pickup device 1
When the nine output signals S _{O1 to} S _O9 are simultaneously output from each of the scanning timings, the addition unit 4 in the processing device 3 causes
The output signals corresponding to the three pixels arranged in the vertical direction and the horizontal direction are added to generate X-direction projection data S _AX and Y-direction projection data S _AY. Based on this, the comparison unit 5
Therefore, X at each scanning timing for each light receiving element GP
The direction projection data S _AX and the Y direction projection data S _AY are compared, and the X direction difference signal S _DX and the Y direction difference signal S _DY are output. Then, in the detection unit 6, based on the X direction difference signal S _DX and the Y direction difference signal S _DY , the same X direction projection data S _{AX is obtained.}
The motion detection is performed by searching the light receiving element group GP that outputs the Y direction projection data S _AY .

Further, in parallel with this, the central pixel selector 7 selects the central output signal S _{VO at} each scanning timing from the output signals S _{O1 to} S _O9 , and the image generator 8 based on this selects the central output signal S _VO. The signal S _O is generated and output. Then, the signal processing unit 9 performs predetermined signal processing on the image signal S _O , and outputs it as an image output signal S _OO to an external monitor or the like for display.

As described above, according to the motion detecting / imaging device S ₁ of the first embodiment, the output signals of the photodiodes included in one light receiving element group GP are simultaneously output, and the output signals S _{O1 to} S _{O1 to} S 0 are output. X direction projection data S _AX based on _O9
And Y direction projection data S _AY are generated, and the motion is detected by comparing the data for each scan. Therefore, the data is stored based on the data of each photodiode, and compared with the case of comparison. It is possible to reduce the capacity of the storage device that constitutes the unit, further simplify the entire processing device 3 such as the detection unit 5, and since the number of data to be handled is small, the processing speed can be increased.

Further, in parallel with the motion detection, the light receiving element group G
Of the light receiving elements forming P, the output signal of the photodiode located at the center is extracted as the central output signal S _VO ,
Since the image is generated based on the center output signal S _VO for each scan, it is possible to generate the image itself of the imaging target while performing the motion detection. (III) Second Embodiment Next, a second embodiment corresponding to the invention described in claims 4 to 6 will be described with reference to FIG.

The motion detection / imaging device S of the first embodiment described above.
_{In 1} , the members other than the solid-state image sensor 1 are configured outside the solid-state image sensor 1 as a processing device 3 by a computer or the like. However, in the second embodiment, the addition unit 4 and the central pixel selector 7 are It is formed on a chip such as a semiconductor chip on which the solid-state image sensor 1 is formed.

First, the motion detection / imaging device according to the second embodiment.
The configuration of the adder and central pixel selector
This will be described with reference to FIG. As shown in FIG. 6, the second embodiment
In the motion detection image pickup apparatus according to
Direction selection timing signal S_HCCBased on the output line O₁Or
O₉Output signal S output from the fixed image sensor 1 via the
_O1Or S_O9From the inside of the three
Select the output signal of the photodiode for each column,
X direction selection signal as the first direction output signal corresponding to the column
No. S_XS1Or S_XS3As the first selection means to output as
X direction selector 20 and Y direction selection timing signal S
_{VC C}Based on the output signal S_O1Or S_O9From the horizontal
Output signals of three photodiodes arranged in succession
Is selected for each row, and the second direction output corresponding to each row
Y direction selection signal S as a signal_YS1Or S_YS3Out as
The Y-direction selector 21 as the second selecting means for applying
Applied X direction selection signal S_XS1Or S_XS3Each selected
Add every selected signal, and add as described in "Principle of the invention".
1X partial projection data S_XO1, The second X partial projection data S
_XO2, 3X partial projection data S_XO3Output as
Source follower amplifier A as selection signal adding means_X1Or
A_X3And the output Y direction selection signal S_YS1Or S_YS3To
The first Y partial projection data S is added by adding each selection signal.
_YO1, The second Y partial projection data S_YO2, 3rd partial Y projection
Data S_YO3As a second selection signal adding means for outputting as
Source Follower Amplifier A_Y1Through A_Y3And the horizontal shift register
Horizontal selection signal S from the star HR_HCBased on the output signal S
_O1Or S_O9To select the X direction selection signal S_XS1Or S_XS3
X direction selection timing signal S for generating_HCC
Selection timing control unit STX for outputting
Vertical selection signal S from register VR_VCBased on the output signal
No. S_O1Or S _O9To select the Y direction selection signal S_YS1Or S
_YS3Y direction selection timing signal S for generating
_VCCWith the selection timing control unit STY that outputs
It is configured.

Further, the central pixel selector 7'has an X direction.
Selection timing signal S_HCCAnd Y direction selection timing signal
No. S_VCCIs input and, based on this, the output signal S_O1No
To S _O9Of the center output signal S for each scanning timing_VO
Is selected.

Further, in the motion detecting / imaging device of the second embodiment, the vertical shift register VR and the horizontal shift register H are used.
From R, the horizontal selection signal S _HC and the vertical selection signal S _VC for selecting the above-mentioned output signals S _{O1 to} S _O9 are output.

Since members other than the structure shown in FIG. 6 have the same structure and operation as those of the motion detecting / imaging device S _{1 according} to the first embodiment, detailed description thereof will be omitted. Next, the operation will be described.

In the X-direction selector 20, the X-direction selection type
Mingling signal S_HCCA light receiving element group GP based on
Vertically arranged from among the photodiodes
Select the output signal of the three photodiodes for each column,
X direction selection signal S corresponding to each column_XS1Or S
_XS3Output as. More specifically, for example, in FIG.
Photodiode D shown₁₁Or D₁₃, D_{twenty one}Or D_{twenty three}as well as
D₃₁Or D₃₃The light receiving element group GP is configured and scanned by
Output signal S_O1Or S_O9Photo from inside
Diode D₁₁, D_{twenty one}And D₃₁Output signal S_O1, S₀₂Over
And S₀₃To select the X direction selection signal S_XS1And photoda
Iod D₁₂, D_{twenty two}And D₃₂Output signal S _O4, S₀₅as well as
S₀₆To select the X direction selection signal S_XS2And photo die
Aether D₁₃, D_{twenty three}And D₃₃Output signal S_O7, S₀₈And S
₀₉To select the X direction selection signal S_XS3As each saw
Sufollower Amplifier A_X1Through A_X3Output to

On the other hand, in parallel with this, the Y-direction selector 2
1, the Y direction selection timing signal S_VCCBased on
From the photodiodes that make up the optical element group GP,
The output of three photodiodes arranged in a row in a row
Select the force signal for each row and respond to each row in the Y direction
Selection signal S_YS1Or S_YS3Output as. More specific
For example, in the case of the same as the X direction selector 20,
In addition, the output signal S _O1Or S_O9Photodio from inside
Code D₁₁, D₁₂, D₁₃Output signal S_O1, S₀₄And S₀₇To
Select Y direction selection signal S_YS1And the photodiode
D_{twenty one}, D_{twenty two}, D _{twenty three}Output signal S_O2, S₀₅And S₀₈choose
The Y direction selection signal S_YS2And the photodiode
D₃₁, D₃₂And D₃₃Output signal S_O3, S₀₆And S₀₉Choose
Select Y direction selection signal S_YS3As a source
Lower amplifier A_Y1Through A_Y3Output to

Then, in the source follower amplifier A _X1 , X
The three output signals forming the direction selection signal S _XS1 are added and the first X partial projection data S _XO1 is output. Similarly, in the source follower amplifiers A _X2 and A _X3 , the X direction selection signal S
Constituting _XS2 third output signal and the X direction selection signal S _XS3
The three output signals that make up the
X partial projection data S _XO2 and third X partial projection data S
Output _XO3 .

On the other hand, the source follower amplifier A _Y1 adds the three output signals forming the Y direction selection signal S _YS1 and outputs the first Y partial projection data S _YO1 . Similarly, in the source follower amplifiers A _Y2 and A _Y3 , the Y direction selection signal S _YS2
And outputs a third output signal and the Y-direction selection signal S _YS3 the third output signals constituting the each sum separately first 2Y partial projection data S _YO2 and the 3Y partial projection data S _yo3 constituting.

Each of the above source follower amplifiers A _{X1 to} A _X3
Also in A _{Y1 to} A _Y3 , signal charges corresponding to the output signal at the gate terminal are accumulated. Then, the 1X partial projection data S _XO1, based on the 2X partial projection data S _XO2 and the 3X partial projection data S _xO3, X
Generates direction projection data S _AX, further, the 1Y partial projection data S _YO1, based on the 2Y partial projection data S _YO2 and the 3Y partial projection data S _yo3, and generates a Y-direction projection data S _AY, these Based on this, motion detection is performed by the comparison unit 5 and the detection unit 6 shown in FIG.

Further, based on the center output signal S _VO for each scanning timing selected by the center pixel selector 7 ′, the image output section S and the image processing section 9 shown in FIG.
_OO is generated.

As described above, according to the adder 4'and the central pixel selector 7'of the second embodiment, the adder 4'is provided.
Since the central pixel selector 7'is formed on the same chip as the solid-state image pickup device ₁ , compared with the motion detection image pickup device S1 of the _first embodiment, the configuration of the processing unit such as the comparison unit and the detection unit is improved. Further simplification can be achieved, and at the same time, manufacturing cost can be reduced.

[0078]

As described above, according to the invention described in claim 1 or 2, based on one scanning output signal output from the light receiving element group, the first and second scanning timings are set for each scanning timing.
Motion detection is performed by comparing a plurality of first and second addition signals obtained by generating an addition signal and scanning the imaging unit with each other for each first addition signal and each second addition signal. Therefore, the motion detection process can be simplified and speeded up as compared with the case where the motion detection process is performed on the output signal of each light receiving element to detect the motion.

Therefore, it is possible to perform high-speed motion detection (motion tracking) while simplifying the processing device, the storage device, and the like for performing motion detection. According to the invention described in claim 3, in addition to the effect of the invention described in claim 2, the output signals of the respective light receiving elements in the light receiving element group are simultaneously output to the adding means for each scanning timing, and thereafter, By performing the motion detection by the adding means, the comparing means, and the detecting means, it is possible to speed up the motion detecting process and simplify the motion detecting device.

According to the invention set forth in claim 4, according to claim 2,
In addition to the effects of the invention described in 1,
The output signal to be the addition output signal is selected, and the output signal to be the second addition output signal is selected by the second selecting means. These selecting means are configured as the adding means on the same chip as the image pickup means. Therefore, the configuration of the processing device that performs the comparison process and the detection process can be further simplified.

According to the invention of claim 5, claim 2
In addition to the effect of the invention described in any one of 4 to 4, since the image signal can be obtained based on the center output signal from the light receiving element centering on the light receiving element group, simplification and high speed motion detection processing can be performed. At the same time as the motion detection processing, an image signal corresponding to the image pickup target can be obtained.

According to the invention described in claim 6, claim 5
In addition to the effect of the invention described in (1), it is possible to realize a motion detection image pickup apparatus that speeds up the motion detection process and simultaneously obtains an image corresponding to an image pickup target.

[Brief description of drawings]

FIG. 1 is a diagram illustrating the principle of the present invention, FIG. 1A is a diagram illustrating a configuration of a light receiving element group GP, FIG. 1B is a diagram illustrating generation of projection data, and FIG. 8A and 8B are diagrams illustrating motion detection associated with movement of the imaging device.

FIG. 2 is a schematic configuration block diagram of a motion detection image pickup apparatus according to the first embodiment.

FIG. 3 is a diagram showing a configuration of a solid-state image sensor.

FIG. 4 is a diagram showing a configuration of a switch unit.

FIG. 5 is a timing chart showing the operation of the solid-state image sensor.

FIG. 6 is a diagram showing a configuration of an addition unit in the second embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Solid-state image sensor 2 ... Imaging lens 3 ... Processing device 4, 4 '... Addition part 5 ... Comparison part 6 ... Detection part 7, 7' ... Central pixel selector 8 ... Image generation part 9 ... Signal processing part 10 ... Driving Part 20 ... X-direction selector 21 ... Y-direction selector GP, GP ₁ , GP ₂ ... Light receiving element group DD, D _{11 to} D ₁₅ , D _{21 to} D ₂₅ , D _{31 to} D ₃₅ , D _{41 to} D
_{45, D 51 ~D 55, A~I} ... photodiode IN ... incident light _{O 1, O 2, O 3} , O 4, O 5, O 6, O 7, O 8, O
₉ ... Output lines S _O1 , S _O2 , S _O3 , S _O4 , S _O5 , S _O6 , S _O7 , S _O8 , S
_O9 … Output signal S _D … Drive signal S _AX … X direction projection data S _AY … Y direction projection data S _DX … X direction difference signal S _DY … Y direction difference signal S _VO … Center output signal S _O … Image signal S _OO ... Image output signals SV _{11 to} SV ₁₅ , SV _{21 to} SV ₂₅ , SV _{31 to} SV ₃₅ , S
V _{41 to} SV ₄₅ , SV _{51 to} SV ₅₅ , SH _{1 to} SH ₃ ... MO
S transistor S _TV ... vertical timing signal S _TH ... horizontal timing signal TG ... timing controller HR ... Horizontal shift register VR ... vertical shift register V ₁ ~V ₅ ... vertical control line H ₁ to H ₅ ... horizontal control lines BL ₁ ~ BL ₁₅ ... Bus line S _{1 to} S ₁₅ ... Switch section A _{1 to} A ₃ , A _{X1 to} A _X3 , A _{Y1 to} A _Y3 ... Source follower amplifier S _HC ... Horizontal selection signal S _VC ... Vertical selection signal S _HCC ... X direction selection timing signal S _VCC ... Y direction selection timing signal S _{XS1 to} S _XS3 ... X direction selection signal S _{YS1 to} S _YS3 ... Y direction selection signal S _XO1 ... 1st X partial projection data S _XO2 ... 2X partial projection data S _xO3 ... the 3X partial projection data S _YO1 ... first 1Y partial projection data S _YO2 ... first 2Y partial projection data S _yo3 ... first 3Y partial projection data STX, STY ... selection timing controller Z ... imaging pairs elephant

Claims (6)

[Claims] 1. An n × m number (n: an integer not less than 2) adjacent to each other in a rectangular shape in an image pickup section in which a plurality of light receiving elements are arranged in a grid pattern.
(m: an integer of 2 or more), the output signals corresponding to the image pickup target are output from each of the light receiving elements in the light receiving element group consisting of the light receiving elements at the same time for the n × m light receiving elements and the light receiving elements. An imaging step of reading while scanning the imaging unit at a predetermined scanning timing for each group, and one scanning output signal composed of a plurality of the output signals read simultaneously from the light receiving element group at one scanning timing Of the one scanning output signal, in a direction perpendicular to the predetermined direction, the plurality of output signals output from the respective light receiving elements continuous in the predetermined direction are added to output a first addition output signal. An addition step of adding a plurality of the output signals output from each of the successive light receiving elements to output a second addition output signal; a first addition output signal corresponding to the one scanning timing; The first addition output signal corresponding to another scanning timing after the one scanning timing is compared to output a first difference signal, and the second addition output signal corresponding to the one scanning timing, A comparison step of comparing the second addition output signal corresponding to the other scanning timing and outputting a second difference signal; and a movement of the imaging target based on the first difference signal and the second difference signal. A motion detection method comprising: a detection step of detecting. 2. An n × m number (n: an integer of 2 or more, adjacent to each other in a rectangular shape in an image pickup unit in which a plurality of light receiving elements are arranged in a lattice pattern,
(m: an integer of 2 or more), the output signals corresponding to the image pickup target are output from each of the light receiving elements in the light receiving element group consisting of the light receiving elements at the same time for the n × m light receiving elements and the light receiving elements. One scanning output signal composed of an image pickup means for reading while scanning the image pickup section at a predetermined scanning timing for each group, and a plurality of the output signals read simultaneously from the light receiving element group at one scanning timing. Of the one scanning output signal, in a direction perpendicular to the predetermined direction, the plurality of output signals output from the respective light receiving elements continuous in the predetermined direction are added to output a first addition output signal. Adding means for adding a plurality of the output signals output from each successive light receiving element to output a second added output signal; the first added output signal corresponding to the one scanning timing; The first addition output signal corresponding to another scanning timing after the one scanning timing is compared to output a first difference signal, and the second addition output signal corresponding to the one scanning timing, Comparing means for comparing the second addition output signal corresponding to the other scanning timing and outputting a second difference signal; and a movement of the imaging target based on the first difference signal and the second difference signal. A motion detection device comprising: a detection unit that detects the motion. 3. The image pickup means in the motion detecting apparatus according to claim 2, wherein each of the light receiving elements forming the light receiving element group forms the light receiving element group via a first switch means and a second switch means. The same number of output lines as the number of the light receiving elements that are connected to each other, the output signals of the respective light receiving elements are output to the adding means via the output lines, and the first switch means and the second switch means are provided. And a storage unit that stores a signal charge corresponding to the output signal and converts the voltage until the output signal of each of the light receiving elements is read based on the scanning timing. First switch control means for simultaneously controlling activation and deactivation of the first switch means connected to each of the light receiving elements continuous in a direction perpendicular to the predetermined direction in the group, Second switch control means for simultaneously controlling activation / deactivation of the second switch means connected to each of the light receiving elements continuous in the predetermined direction in the light receiving element group, and each of the light receiving elements forming the light receiving element group. A timing control means for simultaneously outputting the output signals of the elements to the adding means, and outputting a timing signal for performing the scanning on the imaging section to the first switch control means and the second switch control means. A motion detection device comprising. 4. The adding means in the motion detecting apparatus according to claim 2, wherein the adding means is arranged on the same chip as the image pickup means, and the light receiving that continues in the predetermined direction from the one scanning output signal is performed. A first selecting means for selecting an output signal output from the element and outputting a first direction output signal, and a first direction output signal for each of the selected light receiving elements are added to output the first addition signal. A first selection signal adding means, and an output signal output from a light receiving element continuous in a direction perpendicular to the predetermined direction from the one scanning output signal,
Second selection signal outputting means for outputting a direction output signal, and second selection signal adding means for adding the second direction output signals of the selected light receiving elements and outputting the second addition signal. Motion detection device characterized by. 5. The motion detection device according to claim 2, wherein the light receiving element group is composed of (2X + 1) ² (X: natural number) of the light receiving elements, and the one scanning is performed. An image corresponding to the imaging target based on the center output signal for each scanning timing, a center signal selection unit that selects a center output signal that is an output signal of the light receiving element at the center position in the light receiving element group from the output signal. An image generation means for outputting a signal, and a motion detection device comprising: 6. The motion detecting apparatus according to claim 5, an image forming unit that forms an image of the image pickup target on the image pickup unit, a signal processing unit that performs signal processing of the image signal, and the motion detecting apparatus. A motion detection image pickup device comprising: