JP2021082995A - Imaging apparatus, control method of imaging apparatus - Google Patents

Abstract

To improve the detectability when a change in photographic subject is detected, and improve the convenience of an intended use in an imaging apparatus that detects the photographic subject.SOLUTION: An imaging apparatus 100 comprises an imaging device in which a plurality of pixel circuits are arranged in a matrix and which can achieve both independent output of a signal value of each pixel of the pixel circuit and output of an added value of a pixel signal for each block constituted of the plurality of pixel circuits. The imaging apparatus 100 further comprises detection means that calculates a difference value from the added value of the pixel signals output from the block at the same position in the imaging device and output early and late, and that detects a photographic subject on the basis of the magnitude of the difference value. The block includes a first block and a second block having the smaller number of horizontal pixel circuits than the first block, and the first block is arranged inside the second block.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image pickup apparatus and a control method for the image pickup apparatus.

Imaging devices are widely used for the purpose of observation, monitoring, and the like. Among them, there is known an imaging device that detects a subject (or a change in the subject) by using a difference in brightness values between front and rear frames, obtains a judgment on the change in the subject, and then starts a shooting and storage operation.

In Patent Document 1, subject detection is performed in a shooting drive mode different from that during normal shooting, and a subject is detected based on the output of a plurality of divided blocks to which pixel signals are added in the plane of the image sensor. Detect. As a result, the amount of information processing is reduced as image and luminance information to reduce power consumption.

Patent Document 2 discloses a technique for detecting a change in a subject at a peripheral portion of a full screen or a specific side in order to detect an intruding object at an early stage.

Japanese Unexamined Patent Publication No. 2018-22935 Japanese Patent No. 4286100

However, in the method of Patent Document 1, if the number of pixel signals to be added is increased in order to increase the power consumption reduction effect, the subject brightness is averaged, which may make it difficult to detect a slight subject change. Further, in the method of detecting a subject only at a specific position as in the method of Patent Document 2, the usage is limited.

Therefore, in an imaging device that detects a change in a subject, a technique for improving the detectability when detecting the change in the subject and improving the convenience of the intended use is provided.

In the present invention for solving the above problems, pixel circuits are arranged in a matrix and configured, and an image pickup capable of outputting an added value of pixel signals for each block composed of a plurality of pixel circuits and a pixel signal value of each pixel circuit. An image pickup device equipped with an element
A detection means for detecting a subject change based on the difference between the added values of the pixel signals output from the block at the same position in the image sensor and which are back and forth in time is provided.
The block includes a first block and a second block having a smaller number of pixel circuits than the first block, and the first block is arranged inside the second block.

According to the present invention, in an imaging device that detects a change in a subject, it is possible to improve the detectability when detecting the change in the subject and improve the convenience of the intended use.

The block diagram which shows the structural example of the image pickup apparatus 100 corresponding to an embodiment. Block diagram showing a configuration example of the image sensor 200 corresponding to the embodiment The figure which shows the configuration example of the pixel array part 220 in the 1st subject detection mode corresponding to an embodiment. The figure which shows the configuration example of the pixel array part 220 in the 2nd subject detection mode corresponding to an embodiment. The figure which shows the configuration example of the pixel blocks 240, 250 in the 1st subject detection mode corresponding to an embodiment. The figure which shows the configuration example of the pixel block 260 in the 2nd subject detection mode corresponding to an embodiment. The figure which shows the configuration example of the event detection part 214 corresponding to an embodiment. The figure which shows an example of the timing chart of the 1st subject detection mode corresponding to an embodiment. The figure which shows an example of the timing chart of the 2nd subject detection mode corresponding to an embodiment. The figure which shows an example of the timing chart of the normal shooting mode corresponding to an embodiment. The figure explaining an example of the mode of subject detection in the 2nd subject detection mode corresponding to an embodiment. The figure explaining another example of the mode of subject detection in the 2nd subject detection mode corresponding to embodiment. The figure explaining an example of the mode of subject detection in the 1st subject detection mode corresponding to an embodiment. The flowchart which shows an example of the operation of the image pickup apparatus 100 corresponding to an embodiment. FIG. 5 is a flowchart showing an example of an operation in the first subject detection mode corresponding to the embodiment and an example of an operation in the second subject detection mode. The figure for demonstrating the structure of the image pickup element 200 corresponding to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiment, not all of the plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the attached drawings, the same or similar configurations are designated by the same reference numbers, and duplicate explanations are omitted.

Hereinafter, the first embodiment will be described with reference to the accompanying drawings. FIG. 1 is a block diagram showing a configuration example of an image pickup apparatus 100 corresponding to an example of a typical embodiment. In FIG. 1, the image pickup lens 101 collects light from a subject onto the image pickup element 200. The image sensor 200 is a CMOS image sensor, and is configured to be able to perform photoelectric conversion of light incident on the image sensor 101 and output it as an image signal. Further, the image pickup device 200 has a control function of selecting and changing the drive control of the image pickup device 200 itself according to the amount of change in the pixel output value and the detection result of the change region. By having the above function, it is possible to select / change to a suitable shooting mode from the detection of the change of the subject by the image sensor itself. Further, the image sensor 200 has a function of cropping to an arbitrary image pickup region and taking a picture.

The image processing unit 102 performs various corrections such as filter processing and digital image processing such as compression on the image signal output from the image sensor 200. Further, the pixel signal in the 4K mode, the FullHD mode, or the like is also subjected to image processing such as resizing according to each mode. The control unit 103 controls the drive timing of the image sensor 200, and also controls the overall drive and control of the entire image pickup device such as the image processing unit 102 and the display unit 106. Further, the control unit 103 receives a user's command and performs drive control according to a shooting mode selected from a plurality of shooting modes such as a still image mode, a FullHD mode, and a 4K mode.

Further, the image sensor 100 includes a subject detection mode in which the image sensor 200 selects and changes the shooting mode according to the detection of the subject change, and controls the operation permission of the image sensor 200 to the subject detection mode. ..

The memory 104 and the storage unit 105 are storage media such as a non-volatile memory and a memory card that store and hold the image signal output from the image processing unit 102. The display unit 106 is a display that displays captured images, various setting screens, and the like.

The operation unit 107 is composed of a button, a touch panel, a switch, and the like, receives an operation input from the user, and reflects the user's command to the control unit 103. The operating unit 107 has switches 1071 and 1072. The switch 1071 is a switch for designating a plurality of subject change detection modes by switching between a plurality of manual modes and automatic modes. According to the switch 1071, the first subject change detection mode or the second subject change detection mode can be specified by the manual mode setting, and further, the automatic mode can be specified. When the automatic mode is specified by the switch 1071, the mode changeover switch 1072 can select the priority learning mode or the brightness determination mode described later. Details of the processing according to these switch selections will be described later.

The brightness measuring unit 108 measures the subject brightness, which is external light data. In the present embodiment, the brightness measuring unit 108 is described as a single configuration for convenience of explanation, but image plane brightness measurement using the output of the image sensor 200 may be performed.

FIG. 2 is a block diagram showing a configuration example of the image sensor 200 corresponding to a typical embodiment. The image sensor 200 includes a pixel array unit 220 in which a plurality of pixels are arranged in a matrix, and is composed of an output in pixel units and a set of a predetermined number of pixel circuits in the plane of the pixel array unit 220. It has a function of dividing into pixel blocks, adding (adding and averaging) pixel signals to each pixel block, and outputting. The pixel signal output from the pixel array unit 220 is analog-digitally converted for each pixel row by the AD conversion circuit 212 or for each block row in pixel block units described later, and then sequentially events are driven by the horizontal scanning circuit 213. It is transferred to the detection unit 214.

The event detection unit 214 receives the control signal of the mode control unit 216, detects the amount of change in the pixel output value as a determination standard for a predetermined event with respect to the output in pixel block units, and outputs the information of the detection result to the image sensor. It is transmitted to the mode control unit 216 that controls the drive mode of the 200. Further, when the output of the pixel array unit 220 is in pixel units, the event detection unit 214 transfers the output pixel data as it is to the signal processing unit 215. Further, the event detection unit 214 integrates the output data in pixel block units and supplies the integrated data to the exposure control unit 217.

The signal processing unit 215 adds information data such as the amount of change in the pixel data and the drive mode of the image sensor 200 before and after the pixel data output from the event detection unit 214, and outputs the information data to the outside of the image sensor 200. The mode control unit 216 receives a signal from the event detection unit 214 inside the image sensor or the control unit 103 outside the image sensor, and drives the drive timing control signal to each of the AD conversion circuit 212, the horizontal scanning circuit 213, and the vertical scanning circuit 211. Is supplied, and drive control is performed according to each image pickup mode of the image pickup element 200. Further, the mode control unit 216 determines whether or not to drive the crop according to the signal from the event detection unit 214, and when driving the crop, controls the imaging region to be driven based on the signal from the event detection unit 214. And perform crop drive. Further, when the image sensor 200 is permitted to operate in the detection mode by the control unit 103, the mode control unit 216 sets the image sensor 200 as the detection mode and starts driving to add a pixel signal for each pixel block.

The vertical scanning circuit 211 performs line selection / driving in pixel units or pixel block units via signal lines connected for each line. The exposure control unit 217 calculates the exposure time as the exposure control of the image sensor based on the integrated data from the event detection unit 214, and supplies the exposure control signal of the image sensor to the mode control unit 216.

Next, the configuration of the pixel array unit 220 corresponding to the embodiment will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram showing an example of the configuration of the pixel array unit 220 corresponding to the first subject change detection mode of the embodiment, and FIG. 4 is a diagram showing a pixel array corresponding to the second subject change detection mode of the embodiment. It is a figure which shows another example of the structure of part 220.

A plurality of pixel circuits 230 are arranged in a matrix in the pixel array unit 220. Further, a pixel block composed of a set of a plurality of pixel circuits as an addition unit of the pixel signal for event detection is shown by a dotted rectangular shape. In the present embodiment, the number of pixel circuits constituting the pixel block is different depending on the subject change detection mode and the position of the image sensor 200 on the image pickup surface. First, in the case of the first subject change detection mode shown in FIG. 3, the pixel blocks are the first pixel block 240 and the second pixel block based on their size, particularly the number of pixel circuits in the horizontal direction. It is classified as 250. The second pixel block 250 is configured to include a pixel circuit located at the end of the imaging surface, and the first pixel block 240 is arranged inside the second pixel block on the imaging surface. In the case of the second subject change detection mode shown in FIG. 4, the pixel block is only the common third pixel block 260.

In the present embodiment, in order to simplify the description, the first pixel block 240 is a set of pixel circuits of 4 rows and 3 columns, and the second pixel block 250 is a set of pixel circuits of 4 rows and 1 column. The case where the pixel block 260 of the above is used as a set of pixel circuits having 4 rows and 2 columns will be described. In the present embodiment, the third pixel block 260 has a smaller number of pixel circuits in the horizontal direction than the first pixel block 240 and a larger number than the second pixel block 250. Further, it is assumed that each pixel block is arranged in the vertical direction by N blocks (N is an arbitrary number). Here, the total number of blocks in each mode can be the same. However, the number of matrices and the arrangement are not limited to this. Further, FIG. 3 describes a case where four first pixel blocks 240 and four second pixel blocks 250 are arranged in the horizontal direction, and FIG. 4 shows a case where the third pixel block 260 is arranged in the horizontal direction. The case where one is arranged will be described, but the number and arrangement of pixel blocks are not limited to this. The configurations described below are common to FIGS. 3 and 4.

The control signals include RST, which is a reset control signal, and SEL_1, which is a row selection control signal. Further, the transfer control signals TX1, TX2, TX3, TX4, the column addition signals ADD3P, ADD2P, and the selection control signals ADD3P_SEL and ADD2P_SEL of the added back row signals are wired from the vertical scanning circuit 211. In the figure, since the control signal of the same function is arranged for each line or block, the block designation number _ * is described at the end of the above name.

The output from the pixel is input to the AD conversion circuit 212 at the connection destination via the vertical signal line 410. By performing the selective driving of each of the horizontal signal lines described above, output is sequentially performed from the image sensor in line units and block line units via each vertical signal line 410. As for the output from the pixel array unit 220, when the imaging device 100 is not operating in the subject change detection mode, the pixel signal values of each pixel circuit 230 are sequentially output, whereas in the subject change detection mode, the output will be described later. By operating the addition switch for each FD in the pixel blocks 240, 250, 260, the addition result is output from a specific pixel.

The number of vertical output lines used at the time of output in FIG. 3 is one for each block, and the first pixel block 240 is four and the second pixel block 250 is four pixel blocks, for a total of four lines. The signals from the eight vertical output lines will be processed. On the other hand, the vertical output line used at the time of output in FIG. 4 has eight third pixel blocks 260, and the number of signals received from the vertical output line is the first subject change detection mode in FIG. This is the same as the second subject change detection mode of FIG. As a result, the post-output processing can be shared between the first subject change detection mode and the second subject change detection mode.

Next, an example of the circuit configuration in each pixel block corresponding to the embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram showing an example of the circuit configuration of the first pixel block 240 and the second pixel block 250 corresponding to the embodiment, and FIG. 6 is a diagram showing an example of the circuit configuration of the third pixel block 260 corresponding to the embodiment. It is a figure which shows an example of the structure. Here, 20 configurations of 4 rows × 5 columns of the pixel circuit 230 on the left side of each of FIGS. 3 and 4 will be cut out and described.

First, a configuration common to each pixel circuit will be described. In the pixel circuit 230, a photodiode 406 and a floating diffusion (hereinafter referred to as FD) 407, and a transfer switch 405 are arranged between the photodiode 406 and the FD 407. The transfer switch 405 transfers the electric charge generated and accumulated by the photodiode 406 to the FD407 under the control of the transfer control signal TX1_1.

Next, the configuration described in the area of the pixel circuit 230 on the first line will be described. Since the following configuration is a configuration for performing a common or addition operation in the column direction, it is assumed that it is arranged only in the first row in this description, but it is assumed to be a periodic configuration (for example, one row in four rows). It has become. The reset switch 404 resets the electric charge stored in the FD 407 by the reset control signal RST_1, and the four lines of FD 407 connected to the reset switch 404 are commonly used.

The source follower amplifier 408 is configured together with a constant current source 411 connected to a vertical output line described later, amplifies a voltage signal based on the electric charge accumulated in the FD 407, and outputs the voltage signal as a pixel signal. The output of the source follower amplifier 408 is connected to the vertical output line 410 by controlling the selection switch 409 by the selection control signals SEL1, ADD3P_SEL_1 or ADD2P_SEL_1 described later. The amount of current required for the constant current source 411 differs depending on the number of pixels to be connected. Therefore, the current settings of the constant current source 411 of the first pixel block 240 and the second pixel block 250 are set differently.

Next, the circuit operation in the first subject change detection mode in the present embodiment will be described with reference to FIG. In the first subject change detection mode, the signal corresponding to the electric charge transferred to the FD 407 is read out for each of the first pixel block 240 and the second pixel block 250. At this time, the FDs of the first row and the second row of the first pixel block 240 are connected via the horizontal addition switch 412, and the FDs of the first row and the third row are connected via the horizontal addition switch 413. It is connected. The horizontal addition switches 412 and 413 are controlled on / off by the column addition signal ADD3P_1. Further, the FDs of the first and second rows of the first pixel block 240 and the FDs of the adjacent second pixel blocks 250 are connected via the horizontal addition switch 414. The horizontal addition switch 414 is controlled on / off by the column addition signal ADD2P_1. Therefore, the horizontal addition switches 412 and 413 are operated by the transfer control signals (TX1_1, TX2_1, TX3_1, TX4_1) and the column addition signal ADD3P_1, and the first pixel block 240 has 4 × 3 columns for a total of 12 FDs. Add and average the charges with. On the other hand, since the second pixel block 250 is not column-added, the charges are added and averaged by four FDs, which is less than the first pixel block 240. After that, in order to output a voltage signal corresponding to the added charge from the vertical line 410, ADD3P_SEL_1 is controlled as a selection control signal of the added back row signal, and the added result is read out.

In this way, the first pixel block 240 is the result of adding charges by the FD of the pixels of the matrix 4 × 3, and the second pixel block 250 is the result of adding the charges by the FD of the pixels of the matrix 4 × 1. Output as change detection mode. In the first subject change detection mode, the addition number of the pixel signals of the first pixel block 240 located at the peripheral portion (edge of the imaging surface) of the screen is 4, whereas from the first pixel block 240. The addition number of the pixel signals of the second pixel block 250 located inside the screen is 12. In this way, the resolution of the peripheral part of the screen where the number of pixel signals added is small is higher than the resolution of the central part of the screen where the number of pixel signals added is large, and the pixel signals are added to reduce power consumption. It is possible to easily capture a slight change in the subject invading from the peripheral part.

In this operation, the addition result in the first pixel block 240 is output from the vertical line 410-3, and the addition result in the second pixel block 250 is output from the vertical lines 410-1 and 410-2. Since the number of pixels to be added is different, the drive current of the constant current source is 411-1 = 411-2 <411-3.

Next, the circuit operation in the second subject change detection mode in the present embodiment will be described with reference to FIG. In the second subject change detection mode, the signal corresponding to the electric charge transferred to the FD 407 is read out for each third pixel block 260. At this time, the FDs of the first row and the second row of the third pixel block 260 are connected via the horizontal addition switch 414. The horizontal addition switch 414 is controlled on / off by the column addition signal ADD2P_1. Therefore, in the second subject change detection mode, the horizontal addition switch 414 is operated by the transfer control signals (TX1_1, TX2_1, TX3_1, TX4_1) and the column addition signal ADD2P_1, and the third pixel block 260 has 4 × 2 columns. The charges are added and averaged by a total of 8 FDs. This second subject change detection mode is different from the first subject change detection mode in that the number of pixel signals to be added does not differ depending on the position. After that, in order to output the added signal from the vertical line 410, ADD2P_SEL_1 is controlled as a selection control signal of the added back row signal, and the added result is read out.

In this way, the third pixel block 260 outputs the result of adding the charges of the pixels of the matrix 4 × 2 by FD as the second subject change detection mode. Therefore, in the second subject change detection mode, the resolution of the entire screen is the same, and the resolution of the peripheral portion is lower than that of the first subject change detection mode, but the resolution of the peripheral portion is lower than that of the first subject change detection mode. The resolution is higher than the change detection mode, and it is suitable for evenly detecting changes in the subject over the entire area of the plane.

In this operation, the addition result in the third pixel block 260 is output from the vertical lines 410-1, 410-3, 410-5, but since the addition number of the pixel signals is the same, the constant current source The drive current is 411-1 = 411-3 = 411-5. Further, since the addition number of the pixel signals is different between the drive current in the first subject change detection mode and the drive current in the second subject change detection mode, the drive currents are also set differently to be optimized. You may.

Further, as a common operation of FIGS. 5 and 6, in the normal shooting mode other than the subject change detection mode, the signals transferred from each pixel circuit 230 are not added by the FD, and the column signal selection control signal SEL_1 is used for each pixel. read out. This normal shooting mode corresponds to the operation of a general imaging device 100.

Next, FIG. 7 is a diagram showing a configuration example of the event detection unit 214 corresponding to a typical embodiment. The output signal of the AD conversion circuit 212 is input to the event detection unit 214. The output switching unit 270 receives the control signal from the mode control unit 216 and switches the output destination of the input signal according to the shooting mode selected as the drive control of the image sensor 200. When the shooting mode selected as the drive control of the image sensor 200 is the subject change detection mode for detecting the subject change, the output switching unit 270 switches the output destination of the pixel signal to the integration calculation processing unit 271. When the shooting mode is not the subject detection mode, the output switching unit 270 switches the output destination of the pixel signal to the signal processing unit 215.

The integration calculation processing unit 271 integrates the pixel signal values output from the output switching unit 270, and supplies the integrated data to the exposure control unit 217. Further, the data is output to the memory 272 that holds the data in pixel block units. The memory 272 associates the signal (added value of the pixel signal) added and averaged for each pixel block with the position information (including the position or the type of the pixel block) in the plane of the image sensor 200 of the corresponding pixel block. Memorize and retain. Further, the memory 272 holds data (for example, a peripheral portion and a central portion of the image) obtained by dividing the block data detected in the past into areas.

The difference detection unit 273 acquires a difference value from the latest added value of the pixel signal of each pixel block and the added value of the past pixel signal of the pixel block at the same position held in the memory 272. .. Here, the added value of the pixel signals used for acquiring the difference value is an added value of pixel signals that are temporally back and forth or adjacent to each other in the pixel blocks at the same position. The acquired difference value is supplied to the comparison unit 274. The comparison unit 274 compares the acquired difference value with a predetermined threshold value, and determines whether or not an event has been detected due to the intrusion of a person or the like. The result obtained by the comparison unit 274 is transmitted to the control unit 103 via the mode control unit 216. Based on the result, the control unit 103 determines a region in which an event such as a subject change is detected occurs in the divided region in the plane of the image sensor 200.

Next, with reference to FIG. 8, the operation of the image pickup apparatus 100 in the first subject change detection mode according to the embodiment will be described. FIG. 8 is a timing chart for explaining an example of the operation of the image pickup apparatus 100 corresponding to a typical embodiment, and shows the timing operation of the first subject change detection mode of the image pickup apparatus 100 for one frame period.

First, it is assumed that the event is detected and the first subject change detection mode is set at the timing T0. The vertical scanning circuit 211 first controls the reset signal RST_1, the transfer signal TX1_1, the TX2_1, the TX3_1, and the TX4_1 to a high level as the reading of the first pixel block 240 and the second pixel block 250. Further, at the same timing T0, the column addition signal ADD3P_1 and the column signal selection control signal ADD3P_SEL_1 are turned on. As a result, the first pixel block 240 in the connected state, the FD 407 connected as the second pixel block 250, and the photodiode 406 are reset to the power supply potential.

At the subsequent timing T1, the reset signal RST1_1, the transfer signals TX1_1, TX2_1, TX3_1, and TX4_1 return to the low level, and the exposure of the first line of the first pixel block 240 and the second pixel block 250 starts. Will be done. At the subsequent timing T2, after a predetermined exposure time, the vertical scanning circuit 211 transmits the transfer signals TX1_1, TX2_1, TX3_1, TX4_1 corresponding to the first line of the first pixel block 240 and the second pixel block 250. The transfer switch 405 is turned on by controlling it to a high level, and the electric charge accumulated in each photodiode 406 is transferred to the FD unit 407 in the connected state. As a result, the electric charges are added and the exposure of the first pixel block 240 and the second pixel block 250 is completed. The charges of the first pixel block 240 and the second pixel block 250 transferred to the FD unit are amplified as voltage signals by the source follower amplifier 408 and output from the vertical output line 410 as pixel output. The pixel output output to each vertical output line is read out by the AD conversion circuit 212.

After that, after the timing T3, the first pixel block 240 and the second pixel block 250 are similarly exposed and read in block line units, so that the reading of all pixel block lines is completed ( 1 block line to N block line). The reading of each frame period is executed a plurality of times in synchronization with the vertical synchronization signal VD.

Next, with reference to FIG. 9, the operation of the image pickup apparatus 100 in the second subject change detection mode according to the embodiment will be described. FIG. 9 is a timing chart for explaining an example of the operation of the image pickup apparatus 100 corresponding to a typical embodiment, and shows the timing operation of the second subject change detection mode of the image pickup apparatus 100 for one frame period.

First, it is assumed that the event is detected and the second subject change detection mode is set at the timing T10. The vertical scanning circuit 211 first controls the reset signal RST_1, the transfer signals TX1_1, TX2_1, TX3_1, and TX4-1 to a high level as the reading of the third pixel block 260. Further, at the same timing T10, the column addition signal ADD2P_1 and the column signal selection control signal ADD2P_SEL_1 are turned on. As a result, the FD 407 connected as the third pixel block 260 in the connected state and the photodiode 406 are reset to the power supply potential.

At the subsequent timing T11, the reset signal RST1_1, the transfer signals TX1_1, TX2_1, TX3_1, and TX4_1 return to the low level, and the exposure of the first row of the third pixel block 260 is started. At the subsequent timing T12, after a predetermined exposure time, the vertical scanning circuit 211 controls the transfer signals TX1_1, TX2_1, TX3_1, and TX4_1 corresponding to the first line of the third pixel block 260 to a high level to control the transfer switch 405. Is turned on, and the electric charge accumulated in each photodiode 406 is transferred to the FD unit 407 in the connected state. As a result, the electric charge is added and the exposure of the third pixel block 260 is completed. The charges of the first pixel block 240 and the second pixel block 250 transferred to the FD unit are amplified as voltage signals by the source follower amplifier 408 and output from the vertical output line 410 as pixel output. The pixel output output to each vertical output line 410 is read out by the AD conversion circuit 212.

After that, after the timing T13, the first pixel block 240 and the second pixel block 250 are similarly exposed and read in block line units, so that the reading of all pixel block lines is completed. (1 block line to N block line). The reading of each frame period is continuously executed in synchronization with the vertical synchronization signal VD.

Next, with reference to FIG. 10, the operation of the image pickup apparatus 100 in the normal photographing mode in the embodiment will be described. FIG. 10 is a timing chart for explaining an example of the operation of the image pickup apparatus 100 corresponding to a typical embodiment, and shows the timing operation of the image pickup apparatus 100 for one frame period in the normal shooting mode.

First, it is assumed that the event is detected at the timing T20 and the normal shooting mode is set as the shooting mode. The vertical scanning circuit 211 sets the row selection control signal SEL_1 to a high level and controls the reset signal RST1_1 to a high level during a predetermined pulse period as the reading of the first row of the pixel row. Further, at the same timing T20, the reset signal RST1_1 and the transfer signal TX1_1 are controlled to a high level. As a result, the FD 407 and the photodiode 406, which are the first row of the pixels, reset the power supply potential. The FD407 of the second to fourth rows of pixels connected every four vertical pixels is reset at the same time.

Next, at the timing T21, the reset signal RST1_1 and the transfer signal TX1_1 return to the low level, and the exposure to the first row of the pixel rows is started. At the subsequent timing T22, after a predetermined exposure time, the vertical scanning circuit 211 controls the transfer signal TX1_1 to a high level to turn on the transfer switch 405, and transfers the charge accumulated in the photodiode 406 to the FD407. Then, the exposure for each pixel is completed. The electric charge transferred to the FD unit is amplified as a voltage signal by each source follower amplifier 408 to be connected, and is output as a pixel output from the vertical output line of each row. The pixel output output to each vertical output line is read by the AD conversion circuit 212 of each column.

At the subsequent timing T23, the transfer signal TX1_1 is returned to the low level, and the reading of the first line of the pixel is completed. The period from timings T21 to T23 is the read-out period of the first pixel row. Since this corresponds to the portion of the first 1 pixel line of the pixel block 250 (4 pixel lines in total), it is expressed here as 1-1 block line for convenience of explanation.

At the following timings T24 to T27, the operation of reading the 1-2 block line of the second pixel line is performed. The operation here is the same as the operation performed for the first row of pixels in T20 to T23. In the case of the second line of the pixel, the transfer signal is replaced from TX1_1 to TX2_1. After that, at timings T28 to T31, the operation of reading the 1-3 block lines of the third pixel line is performed. The operation here is also the same as the operation performed for the first row of pixels in T20 to T23. In the case of the third line of the pixel, the transfer signal is replaced from TX1_1 to TX3_1. After that, at timings T32 to T34, the operation of reading the 1-4 block lines of the fourth pixel line is performed. The operation here is also the same as the operation performed for the first row of pixels in T20 to T23. In the case of the fourth line of the pixel, the transfer signal is replaced from TX1_1 to TX4-1.

After that, exposure and reading are performed in pixel line units in the same manner, and reading of all (4 × N) lines is completed (1-1 block line to N-4 block line). The reading of each frame period is continuously executed in VD synchronization with the vertical synchronization signal.

Next, a mode of subject change detection in the subject change detection mode will be described with reference to FIGS. 11 to 13. 11 and 12 are diagrams for explaining a case where the subject change is detected in the second subject change detection mode corresponding to the embodiment. FIG. 13 is a diagram for explaining a case where the subject change is detected in the first subject change detection mode corresponding to the embodiment.

First, in FIG. 11, it is assumed that a person who is a new subject invades the screen 1100. Here, it is assumed that the size of the new subject is sufficiently larger than the third pixel block 260 in the second subject change detection mode (at least, the subject is photographed across a plurality of pixel blocks). .. Hereinafter, the portion surrounded by the dotted line will be enlarged and described. In the frame 1101 of the time T1, a person has not yet entered the screen, and the addition result in each pixel block at this time is shown in 1102. Here, since the change of the subject is not detected in the pixel blocks, the addition result of each pixel block is shown in white.

At the subsequent time T2, a person invades the frame 1103, so that the addition result in each pixel block is shown in 1104. Here, the addition result of each pixel block is shown by shading according to the ratio of the subject in the pixel block. That is, A12, which has a higher proportion of the subject, is dark, and A11 and A13 are shown lightly because the proportion of the subject is low. A21 to A23, which have not yet been invaded by the subject, remain white. Comparing the addition result 1102 and the addition result 1104, the difference 1105 is obtained by the difference of the addition results between the pixel blocks at the same positions that are back and forth in time.

In the present embodiment, each difference value constituting the difference 1105 is compared with the threshold value, and event detection based on the change of the subject is performed. In the example of FIG. 11, the invading subject is captured in the range of the third pixel block (4 rows × 2 columns = 8 pixels) at the left end of the screen, and the pixel block in which the difference value exceeding the threshold value is detected is the screen. It becomes A11, A12, A13 at the left end. Depending on how the threshold is set, only A12 may be detected. In FIG. 11, since the size of the subject is assumed to be larger than the pixel block, a large output change occurs depending on the subject even in the frame immediately after the subject invades, and the threshold value for detecting the subject change is sufficiently exceeded, so that the subject invades immediately. Can be captured.

Next, FIG. 12 describes a mode of subject change detection in the second subject change detection mode as in FIG. 11, but in FIG. 12, it is assumed that a subject smaller than that of FIG. 11 newly appears. Here, the size of the new subject is set to be substantially the same as or included in the height of the third pixel block 260 (for a 4-pixel circuit) in the second subject change detection mode. Hereinafter, the portion surrounded by the dotted line will be enlarged and described. In frame 1201 of time T1, a person has not yet invaded the screen, and the addition result in each pixel block at this time is shown in 1202. Here, since the subject is not detected by the pixel blocks, the addition result of each pixel block is shown in white.

At the subsequent time T2, a person invades the frame 1203, so that the addition result in each pixel block is shown in 1204. Here, the addition result of each pixel block is shown by shading according to the ratio of the subject in the pixel block. That is, the addition result changes only in A12 where the subject exists more, and A11, A13, A21 to A23 in which the subject has not yet invaded remain white. Comparing the addition result 1202 and the addition result 1204, the difference 1205 is obtained by the difference of the addition results between the pixel blocks at the same positions that are back and forth in time.

In the present embodiment, each difference value constituting the difference 1205 is compared with a threshold value, and event detection based on a change in the subject is performed. In the example of FIG. 12, since the invading subject is small with respect to the screen, it is captured only by one third pixel block A12 at the left end of the screen, and the difference value of the pixel block A12 in which the subject is detected has a threshold value. It may not exceed. In that case, the subject cannot be detected even though the subject actually invades the screen.

In the subsequent time T3, when the subject moves to the inside of the third pixel block A12 in the frame 1206, the addition result in each pixel block is shown in 1207. Here, too, the addition result of each pixel block is shown by shading according to the ratio of the subject in the pixel block. The addition result of the block A12 in the addition result 1207 has a higher density than the addition result of the same block in the addition result 1204, and the proportion of the subject in the pixel block is large. As a result, when the addition result 1204 and the addition result 1207 are compared, the difference 1208 is obtained by the difference of the addition results between the pixel blocks at the same positions that are back and forth in time. Comparing each difference value constituting the difference 1208 with the threshold value, the difference value of the pixel block A12 in which the subject is detected exceeds the threshold value, and as a result, the change of the subject is detected.

As described above, when a sufficient size of the subject cannot be secured for the pixel block, the intrusion of the subject into the screen may not be properly detected, or the reaction to the intrusion detection of the subject may be delayed.

Therefore, in the present embodiment, in the first subject change detection mode, the size of the pixel block at the edge of the screen is made different from the size of the pixel block located inside the screen. Hereinafter, a mode of subject detection in the case of detecting a small subject similar to that of FIG. 12 in the first subject change detection mode will be described with reference to FIG.

Also in FIG. 13, it is assumed that a person who is the same subject as in FIG. 12 invades the screen 1300. Here, the size of the subject is set to be substantially the same as or included in the height of the second pixel block 250 (for a 4-pixel circuit) in the first subject change detection mode. Hereinafter, the portion surrounded by the dotted line will be enlarged and described.

In the frame 1301 of the time T1, a person has not yet invaded the screen, and the addition result in each pixel block at this time is shown in 1302. Here, since the subject is not detected by the pixel blocks, the addition result of each pixel block is shown in white.

At the subsequent time T2, a person invades the frame 1303, so that the addition result in each pixel block is shown in 1304. Here, the addition result of each pixel block is shown by shading according to the ratio of the subject in the pixel block. That is, A12, which has a higher proportion of the subject, is dark, and A11, A13, A21 to A23, and A31 to A33, which the subject has not yet invaded, remain white. Comparing the addition result 1302 and the addition result 1304, the difference 1305 is obtained by the difference of the addition results between the pixel blocks at the same positions that are back and forth in time.

Comparing each difference value constituting the difference 1305 with the threshold value, the pixel block in which the difference value exceeding the threshold value is detected is A12 at the left end of the screen. By reducing the size of the pixel block at the edge of the screen in this way, it is possible to reduce the influence of pixels that are not photographed on the subject on the addition result, and it is easy to catch the appearance of even a small subject. Therefore, the event is detected by detecting the change in the subject.

As described above, the first subject change detection mode has a feature that it is easy to catch intruders in the peripheral part of the screen, and the second subject change detection mode has a constant sensitivity even for a subject whose intrusion is unknown from anywhere on the entire screen. It has the characteristic of being able to react. Hereinafter, switching between the first subject change detection mode and the second subject change detection mode will be described with reference to the flowcharts of FIGS. 14 and 15.

FIG. 14 is a flowchart showing an example of processing when the subject change detection mode is set. First, in S1401, the control unit 103 detects the operation of the operation unit 107 on the manual / automatic changeover switch 1071 and determines whether the manual mode or the automatic mode is specified. In the manual mode, the process shifts to S1402, and in the automatic mode, the process shifts to S1405.

In the present embodiment, in the case of the manual mode setting, it is possible to further specify whether to execute the above-mentioned first subject change detection mode or the second subject change detection mode. Therefore, in S1402, in S1402, whether the manual setting is specified in the "first subject change detection mode (manual 1)" or the "second subject change detection mode (manual 2)". To judge. If the control unit 103 determines that manual 1 is specified, the process shifts to S1403, and if it determines that manual 2 is specified, the process shifts to S1404.

In S1403, the subroutine that drives the above-mentioned "first subject change detection mode" is executed. Details will be described later with reference to the flowchart of FIG. 15 (A). Further, in S1404, the subroutine that drives the above-mentioned "second subject change detection mode" is executed. Details will be described later with reference to the flowchart of FIG. 15 (B). When the processing of S1403 and S1404 is completed, the processing shifts to S1413.

Next, in S1405, the control unit 103 checks the setting of the mode changeover switch 1072 for switching the automatic mode setting. When the control unit 103 determines that the "priority learning mode" is selected, the process shifts to S1406, and when it determines that the "luminance determination mode" is selected, the process shifts to S1411.

In the present embodiment, the priority learning mode includes a first subject change detection mode and a second subject change detection mode based on the number of times a subject change has been detected (event detection) in the past and the detection position thereof. It is a mode to select and execute one of. The brightness determination mode is a mode in which either the first subject change detection mode or the second subject change detection mode is selected and executed based on the brightness measurement result by the brightness measurement unit 108.

First, the case where the priority learning mode is selected will be described. In S1406, the control unit 103 detects the number of times the subject change is detected (the intrusion of the subject is detected) in the past event detection operation from the stored information of the memory 104, and the detection when the subject change is detected. Acquire detection history information including position information. In the following S1407, the control unit 103 determines whether or not the number of detections is greater than the predetermined number of times n among the detection history information acquired in S1406. If the number of detections is not greater than n times, the process shifts to S1409, and if it is more than n times, the process shifts to S1408.

S1408 further calculates the ratio (ratio) of the detection position to the peripheral portion of the screen among all the detection times, based on the information of the detection position in the detection history information. If the calculated ratio (ratio) exceeds the predetermined ratio (predetermined ratio) X%, the process shifts to S1410. In S1406 to S1408, the number of past detections and the ratio are simply used as learning data, but the pixel block that has penetrated in more detail may be learned by AI or the like to improve the search accuracy.

In S1409, assuming that past event detection (detection of intruders) is not biased to the peripheral part of the screen, the control unit 103 controls the image sensor 200 and can detect the entire area with the same performance. Execute "mode". Details of the process will be described later with reference to FIG. 15 (B). In S1410, assuming that past event detection (detection of intruders) is common in the peripheral portion of the screen, the control unit 103 controls the image sensor 200 to perform the "first subject change detection mode" having high detection sensitivity in the peripheral portion. To execute. Details of the process will be described later with reference to FIG. 15 (A).

In this way, when the "priority learning mode" is selected in S1405, the event detection (subject intrusion detection) data is first collected in the "second subject change detection mode". Then, when the number of past event detections collected is greater than the predetermined number of times, it is possible to use as learning information whether or not there are many event detections around the screen. If there are many event detections around the screen, such as when a subject invades from outside the screen, the detection accuracy can be improved by switching to the "first subject change detection mode".

Next, the case where the brightness determination mode is selected will be described. First, in S1411, the control unit 103 acquires the subject brightness, which is the external light data observed by the brightness measuring unit 108, and determines whether or not the subject brightness is brighter than the desired brightness LV. If the subject brightness is higher than LV, the process shifts to S1412, and if it is less than LV, the process shifts to S1409.

When the subject brightness is dark, the entire image becomes dark, which makes it difficult to perform local detection. Therefore, in S1409, the control unit 103 controls the image sensor to execute the "second subject change detection mode" in which the entire screen surface is processed with uniform sensitivity. When the subject brightness is bright, the entire image is bright and local detection is easy. Therefore, in S1412, the control unit 103 controls the image sensor 200 to execute the "first subject change detection mode" having high detection sensitivity in the peripheral portion.

Each subject change detection mode is operated in S1403, S1404, S1409, S1410, and S1412, and when an intruder is detected, the process shifts to S1413. In S1413, the control unit 103 controls the image sensor 200, drives the image sensor 200 in the normal shooting mode described with reference to FIG. 10, and stores the generated image data by the image processing unit 102 and the storage unit 105 in the subsequent stage.

The above is a series of operation flows, and the operation can be repeated until a power switch (not shown) is turned off.

Next, the flow of processing in the first subject change detection mode will be described with reference to FIG. 15 (A). FIG. 15A is a flowchart showing an example of the processing of the first subject change detection mode, and the routine is entered depending on the result of selecting the subject change detection mode. First, in S1501, the control unit 103 controls the image sensor 200 to permit the operation of the first subject change detection mode, and shifts to the first subject change detection mode. The mode control unit 216 includes a vertical scanning circuit 211, an AD conversion circuit 212, and a horizontal scanning circuit so that each pixel block of the pixel array unit 220 becomes a first pixel block 240 and a second pixel block 250. 213 is set and the shooting operation is started. In the subsequent S1502, the control unit 103 controls the image sensor 200 to output the added value of the pixel signals obtained by adding and averaging the pixel signals for each pixel block, and temporarily stores the added value in the memory 272.

Next, in S1503, the control unit 103 determines whether or not the added value of the pixel signals for each pixel block obtained in S1502 is for the second and subsequent pixels after the start of operation. If it is the second and subsequent sheets, the process proceeds to S1504, and if it is less than the second sheet, the process returns to S1502. This is because if it is less than the second image, the difference from the past data for detecting the change in the subject cannot be obtained. In S1504, the difference detection unit 273 acquires the difference value for each pixel block with respect to the added value of the pixel signal acquired in S1502. That is, the difference value between the added value of the acquired pixel signal held in the memory 272 and the added value of the pixel signals having a temporally back-and-forth relationship in the same pixel block is acquired. Since the operation has already been described with reference to FIG. 13, the description thereof is omitted here.

Next, in S1505, the comparison unit 274 determines the presence / absence of event detection based on the difference value acquired in S1504. The comparison unit 274 compares each difference value with a predetermined threshold value and determines whether or not the difference value is equal to or greater than the threshold value. Then, if there is a difference value equal to or greater than the threshold value, the number of pixel blocks is counted. If there is no count (= 0), it is assumed that there is no change detection event, the process returns to S1502, and the operation of detecting the subject change up to S1504 described above is repeated. On the other hand, if the count is counted (> 0), it is assumed that the event has been detected, and the process proceeds to S1506.

In the following S1506, the comparison unit 274 determines whether or not the pixel block related to the event detection is the peripheral portion of the screen in response to the event detection determination, and stores the determination result information as the detection history information in the memory 272. .. For example, the peripheral portion of the screen is set to 1, and the portion that is not the peripheral portion of the screen (when it is inside the peripheral portion of the screen) is saved as 0. Here, the pixel block belonging to the peripheral portion of the screen can be determined in advance. It is assumed that the pixel blocks including the pixel circuits located at the edge of the screen or the pixel blocks composed of the pixel circuits correspond to the pixel blocks belonging to the peripheral portion of the screen, and the position information of those pixel blocks is preliminarily compared with the comparison unit 274. Keep. In this way, the position or type of the pixel block related to the event detection can be stored as the detection history. The detection history information stored in the memory 272 is read out at any time by the control unit 103 and held in the memory 104.

Next, the flow of processing in the second subject change detection mode will be described with reference to FIG. 15 (B). FIG. 15B is a flowchart showing an example of processing in the second subject change detection mode, and the routine is entered depending on the result of selecting the subject change detection mode.

First, in S1511, the control unit 103 controls the image sensor 200 to permit the operation of the second subject change detection mode, and shifts to the second subject change detection mode. The mode control unit 216 sets the vertical scanning circuit 211, the AD conversion circuit 212, and the horizontal scanning circuit 213 so that each pixel block of the pixel array unit 220 becomes the third pixel block 260, and starts a shooting operation. To do. In the following S1512, the control unit 103 controls the image sensor 200 to output the added value of the pixel signal to which the pixel signal is added for each pixel block, and temporarily stores the added value in the memory 272.

Next, in S1513, the control unit 103 determines whether or not the added value of the pixel signals for each pixel block obtained in S1512 is for the second and subsequent pixels after the start of operation. If it is the second and subsequent sheets, the process proceeds to S1514, and if it is less than the second sheet, the process returns to S1512. This is because if it is less than the second image, the difference from the past data for detecting the change in the subject cannot be obtained. In S1514, the difference detection unit 273 acquires the difference value for each pixel block with respect to the added value of the pixel signal acquired in S1512. That is, the difference value between the added value of the acquired pixel signal held in the memory 272 and the added value of the pixel signals having a temporally back-and-forth relationship in the same pixel block is acquired. Since the operation has already been described with reference to FIGS. 11 and 12, the description thereof is omitted here.

Next, in S1515, the comparison unit 274 determines the presence / absence of event detection based on the difference value acquired in S1514. The comparison unit 274 compares each difference value with a predetermined threshold value and determines whether or not the difference value is equal to or greater than the threshold value. Then, if there is a difference value equal to or greater than the threshold value, the number of pixel blocks is counted. If there is no count (= 0), it is assumed that there is no change detection event, the process returns to S1512, and the operation of detecting the subject change up to S1514 described above is repeated. On the other hand, if the count is counted (> 0), it is assumed that the event has been detected, and the process proceeds to S1516.

In the following S1516, the comparison unit 274 determines whether or not the pixel block related to the event detection is the peripheral portion of the screen in response to the event detection determination, and stores the determination result information as the detection history information in the memory 272. .. For example, the peripheral portion of the screen is set to 1, and the portion that is not the peripheral portion of the screen (when it is inside the peripheral portion of the screen) is saved as 0. Here, the pixel block belonging to the peripheral portion of the screen can be determined in advance. It is assumed that the pixel blocks constituting the edge of the screen correspond to the pixel blocks belonging to the peripheral portion of the screen, and the comparison unit 274 holds the position information of those pixel blocks in advance. In this way, the position of the pixel block related to the event detection can be retained as the detection history. The detection history information stored in the memory 272 is read out at any time by the control unit 103 and held in the memory 104.

As described above, in the imaging device that detects a subject change as an event, the detectability can be improved by changing the size of the pixel block when detecting the subject change event. Further, it is possible to provide a convenient imaging device by changing the setting of the pixel block according to the characteristics of the subject to be detected and the installation location.

Next, the structure of the image pickup device 200 will be described with reference to FIG. In the above embodiment, the image sensor 200 can be configured to have a semiconductor substrate 1601 shown by diagonal lines as shown in FIG. 16A and a semiconductor substrate 1602 shown in white. The semiconductor substrate 1601 and the semiconductor substrate 1602 are sealed and modularized (integrated) in a superposed state as shown in FIG. 16 (B). As a result, as shown in FIG. 16C, the semiconductor substrate 1601 and the semiconductor substrate 1602 form a multilayer structure (laminated structure). The circuit formed on the semiconductor substrate 1601 and the circuit formed on the semiconductor substrate 1602 are connected to each other by vias (VIA) or the like. Although the case of two layers is shown in FIG. 16, the number of layers may be increased.

As described above, the image sensor 200 may be formed as a module (also referred to as an LSI (Large Scale Integration) chip) in which the semiconductor substrate 1601 and the semiconductor substrate 1602 are integrated so as to form a multilayer structure. By forming the semiconductor substrate 1601 and the semiconductor substrate 1602 in a multilayer structure in this way inside the module, the image sensor 200 can realize a larger-scale circuit mounting without increasing the size of the semiconductor substrate. .. That is, the image sensor 200 can mount a larger-scale circuit while suppressing an increase in cost.

A pixel array unit 220, an AD conversion circuit 212, a vertical scanning circuit 211, a horizontal scanning circuit 213, and the like are formed on the semiconductor substrate 1601. Further, the event detection unit 214, the signal processing unit 215, the mode control unit 216, and the exposure control unit 217 can be formed on the semiconductor substrate 1602.

Further, in the above-described embodiment, the detection mode has been described as a shooting mode in which the number of output pixels is reduced by adding and averaging a plurality of pixel signals in a predetermined block and reading them out, but the method for reducing the number of pixels is limited to this. It is not something that is done. For example, the number of output pixels may be reduced by periodically thinning out the pixels to be read. At that time, after thinning out the pixels in the pixel block at predetermined intervals, the pixel signals may be added and averaged to detect the change in the subject.

Further, when a color filter or the like is arranged on the image sensor to output pixels for each color, pixel signals of the same color may be added according to rows or columns in which pixels of the same color are arranged. At that time, the pixel signals of only the pixels of a part of the plurality of colors may be added. For example, in the case of RGB, a pixel signal of only G pixels may be added.

The invention is not limited to the above embodiments, and various modifications and modifications can be made without departing from the spirit and scope of the invention. Therefore, a claim is attached to make the scope of the invention public.

100 image pickup device, 200 image pickup device

Claims (13)

An image pickup device in which pixel circuits are arranged in a matrix and includes an image pickup element capable of outputting an addition value of pixel signals for each block composed of a plurality of pixel circuits and a pixel signal value of each pixel circuit.
A detection means for detecting a subject change based on the difference between the added values of the pixel signals output from the block at the same position in the image sensor and which are back and forth in time is provided.
The block includes a first block and a second block having a smaller number of pixel circuits than the first block, and the first block is arranged inside the second block. An imaging device as a feature. The image pickup apparatus according to claim 1, wherein the second block is composed of a pixel circuit at an end of an image pickup surface among the pixel circuits constituting the image pickup element. The imaging device according to claim 1 or 2, wherein when a subject change is detected by the detection means, the position or type of the block that detects the subject change is stored. A reception means that accepts the designation of the operation of the image sensor, and
Further, a control means for controlling the operation of the image pickup element according to the designation received by the reception means is provided.
When the first mode is specified by the receiving means, the control means has the image pickup device so that the block composed of the plurality of pixel circuits is composed of the first block and the second block. Control and
When the second mode is specified by the receiving means, the control means controls the image pickup device so that the block composed of the plurality of pixel circuits is composed of the third block.
The imaging device according to any one of claims 1 to 3, wherein the third block has a number of pixel circuits in the horizontal direction different from those of the first block and the second block. The third block is characterized in that the number of pixel circuits in the horizontal direction is smaller than that of the first block, and the number of pixel circuits in the horizontal direction is larger than that of the second block. Item 4. The imaging device according to item 4. The imaging device according to claim 4 or 5, wherein the total number of blocks is the same in the first mode and the second mode. When the reception means specifies a first automatic mode for selecting either the first mode or the second mode according to the past detection history.
The control means controls the image sensor by selecting the first mode or the second mode according to the number of times a subject change has been detected in the past and the position of the detected block. The image pickup apparatus according to any one of claims 4 to 6. In the control means, the ratio in which the number of times the subject change is detected in the past is greater than the predetermined number of times and the block in which the subject change is detected is located at the end of the image pickup surface of the image sensor is a predetermined ratio. The image pickup apparatus according to claim 7, wherein the first mode is selected when the value is higher than that of the first mode. When the receiving means specifies a second automatic mode for selecting either the first mode or the second mode based on the measurement result of the external light.
The control means selects the first mode when the measurement result is higher than the predetermined brightness, and selects the second mode when the measurement result is not higher than the predetermined brightness. The image pickup apparatus according to any one of claims 4 to 6, wherein the image pickup device is controlled. The added value of the pixel signal is the sum of the pixel signal values of all the pixel signals of the plurality of pixel circuits included in the block, or the sum of the pixel signal values of at least a part of the pixel circuits of the plurality of pixel circuits. The imaging apparatus according to any one of claims 1 to 9, wherein the image pickup apparatus is to be acquired. The image pickup device according to any one of claims 1 to 10, wherein the image pickup device includes the detection means. The image pickup device has a structure in which a plurality of substrates are laminated, and has a structure in which a plurality of substrates are laminated.
The image pickup apparatus according to claim 11, wherein the pixel circuit and the detection means are formed on a different substrate. It is a control method of an image pickup device including an image pickup element in which pixel circuits are arranged in a matrix and can output an addition value of pixel signals for each block composed of a plurality of pixel circuits and a pixel signal value of each pixel circuit. ,
The detection means includes a detection step of detecting a subject change based on the difference in the added values of the pixel signals output back and forth in time from the block at the same position in the image sensor.
The block includes a first block and a second block having a smaller number of pixel circuits than the first block, and the first block is arranged inside the second block. A characteristic method of controlling an imaging device.

Images