JP2010050637A - Imaging apparatus and its control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus normally detecting an immobile object even when an automatic day/night function for changing the luminance and color of the entire image is operated during an immobile object detecting operation. <P>SOLUTION: In the imaging apparatus, when an imaging mode is switched by the automatic day/night function, a reference image stored in a reference image storage part 106 is updated. Then, determination by a first detection determination part 108 or a second detection determination part 109 is switched according to the position (or coordinates) of the area of the pixel stored in a detection area storage part 110. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and a control method thereof, and more particularly, to an imaging apparatus having an unmoving object detection function and a shooting mode switching function and a control method thereof.

  In recent years, various intelligent functions are installed in surveillance camera systems. As one of them, there is a non-moving object detection function for detecting an object which is newly added to the monitoring area and is stationary based on an image obtained from the monitoring camera by image processing. This unmoving object detection function detects a difference portion by comparing the reference image as a reference and the current input image, and when the duration of the difference portion reaches a predetermined time or longer, it displays on the monitoring screen, warns, etc. (For example, refer to Patent Document 1).

On the other hand, an automatic day / night function has been known as one of functions for automatically switching the photographing mode. The auto day / night function is a function that switches between an imaging mode consisting of a day mode and a night mode that increase or decrease the amount of incident light on the image sensor by automatically attaching / removing the infrared cut filter according to the amount of incident light from the subject. It is. When the incident light quantity of visible light decreases, the image is output by switching to the night mode for photographing with infrared light. When the incident light quantity of infrared light increases, the image is output by switching to the day mode for photographing with visible light (see, for example, Patent Document 2).
JP 2000-33254 A JP 2004-120202 A

  However, in the above-described conventional example, when the shooting mode is switched in which the brightness or color of the entire screen changes during the operation of the unmoving object detection function, the difference between the reference image and the current input image is detected in the entire image. The In particular, when the auto day / night function is switched, the luminance of the entire image changes significantly due to the change of infrared light, and a large difference portion is detected in the entire image. Therefore, there is a problem that the unmoving object detection function erroneously detects the entire monitoring area as an unmoving object.

  In addition, if the shooting mode is switched during counting of the duration of detection of the difference portion in the unmoving object detection function, the entire image is displayed even though an object that can be an unmoving object exists in a part of the monitoring area. A difference is detected. Therefore, there is a problem that the region of the object that can be a non-moving object cannot be specified and cannot be detected normally.

  The present invention has been made in view of the above problems, and can perform normal non-moving object detection even when an automatic day / night function that changes the brightness and color of the entire image is activated during the non-moving object detection operation. And it aims at providing the control method.

  In order to achieve the above object, an imaging apparatus according to claim 1 includes: an image storage unit that stores a reference image serving as a reference from a video that is being shot; and the stored reference image and a current image that is being shot. Difference detection means for calculating a difference value for each pixel, first detection determination means for determining that the reference is satisfied when the calculated difference value is larger than a first threshold, and the calculated difference value When it is smaller than the second threshold, it is determined that the reference is satisfied by a second detection determination unit that determines that the criterion is satisfied, and either the first detection determination unit or the second detection determination unit An area storage means for storing the position of the pixel area, a switching means for switching the photographing mode, and when the photographing mode is switched by the switching means, the reference image stored in the image storage means is updated. Depending on the position of the region of the pixel stored in the region storage means, characterized in that it comprises a control means for switching the determination by the first detection determining means or said second detection judging means.

  In order to achieve the above object, the control method of an imaging apparatus according to claim 16 includes an image storage means for storing a reference image serving as a reference from a video being shot, the stored reference image and a current shot being shot. A difference detection unit that calculates a difference value for each pixel from the image, a first detection determination unit that determines that the criterion is satisfied when the calculated difference value is greater than a first threshold, and the calculated When the difference is smaller than the second threshold value, the second detection determination unit that determines that the criterion is satisfied, and the first detection determination unit or the second detection determination unit satisfies the criterion. A method of controlling an image pickup apparatus including a region storage unit that stores a position of a determined pixel region, and a switching step of switching a shooting mode, and when the shooting mode is switched in the switching step, The reference image stored in the image storage unit is updated, and the determination by the first detection determination unit or the second detection determination unit is performed according to the position of the pixel area stored in the region storage unit. And a control process for switching.

  According to the present invention, even if an automatic day / night function that changes the brightness and color of the entire image is activated during the unmoving object detection operation, the unmoving object can be normally detected without erroneously detecting the entire image as an unmoving object. .

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  In the present embodiment, an imaging apparatus that performs a shooting mode switching operation in the automatic day / night function during unmoving object detection will be described.

  FIG. 1 is a block diagram showing components relating to an auto day / night function in an imaging apparatus according to an embodiment of the present invention.

  In FIG. 1, 101 is a lens, 102 is an infrared cut filter, 103 is a CCD (Charge Coupled Device), 104 is an image signal processing unit, 105 is a photographing mode switching unit, and 106 is a reference image storage unit. Reference numerals 107 to 112 denote components of the unmoving object detection unit. Reference numeral 107 denotes a difference detection unit, 108 denotes a first detection determination unit, 109 denotes a second detection determination unit, 110 denotes a detection area storage unit, 111 denotes a timer counter unit, and 112 denotes a detection notification unit.

  The imaging device includes a non-moving object detection function that detects an object that is newly added to the monitoring area and is stationary based on the captured image by image processing. The imaging apparatus also has an auto day / night function that switches between a day mode and a night mode that increase or decrease the amount of light incident on the imaging element by attaching / removing an infrared cut filter.

  In the auto day / night function, a command is sent from the image signal processing unit 104 to the photographing mode switching unit 105 according to the amount of light incident on the CCD 103, and the infrared cut filter 102 is attached / detached by the photographing mode switching unit 105.

  In the day mode (first shooting mode) in which the image is captured in the visible light region according to the brightness of the image, the light incident through the lens 101 is obtained by attaching the infrared cut filter 102 between the lens 101 and the CCD 103. Infrared light in the infrared region is removed. As a result, the CCD 103 is irradiated only with visible light.

  On the other hand, in the night mode (second shooting mode) for shooting with light including the infrared light region, the infrared cut filter 102 is removed by the shooting mode switching unit 105, and incident light including light in the infrared light region is input to the CCD 103. Irradiate. In the auto day / night function, the image signal processing unit 104 sends a command to the photographing mode switching unit 105 according to the amount of incident light, and automatically switches between the day mode and the night mode.

  The basic auto day / night function will be described with reference to FIGS.

  FIG. 2 is a flowchart showing the operation by the auto day / night function, where (a) is in the day mode and (b) is in the night mode. FIG. 3 is a graph showing the change in the amount of incident light from the subject over time.

  In FIG. 2A, when the auto day / night function is in the day mode, the image signal processing unit 104 acquires the amount of incident light from the CCD 103 (step S201). Next, when it is determined that the amount of incident light has fallen below the threshold (YES in step S202), the infrared cut filter 102 is removed by the photographing mode switching unit 105 (step S203), and light in the infrared region is input to the CCD 103.

  In FIG. 3, 301 indicates a period from daytime to sunset, 302 indicates a period from sunset to sunrise, and 303 indicates a period from sunrise to daytime. In the case of shooting under sunlight, the amount of incident light from the subject changes with time. In the period 301, the amount of incident light gradually decreases. When the incident light has a component in the infrared light region at night, the amount of incident light slightly increases as in the period 302, and the amount of incident light gradually increases with sunrise.

  As shown in FIG. 2B, in the night mode, the image signal processing unit 104 acquires the amount of incident light from the CCD 103 (step S204). Next, when it is determined that the amount of incident light exceeds the threshold (YES in step S205), the infrared cut filter 102 is attached by the photographing mode switching unit 105 (step S206), and light in the visible light region is input to the CCD 103. As a result, as in the period 303, the amount of incident light is reduced by a component in the infrared light region.

  Next, a basic unmoving object detection function will be described.

  In the unmoving object detection process in the unmoving object detection function, a reference image serving as a reference from the image being captured is stored in the reference image storage unit 106, and each pixel of the reference image and the current image obtained from the image signal processing unit 104 is stored. The difference value is calculated by the difference detection unit 107. Then, the first detection determination unit 108 or the second detection determination unit 109 determines whether a change is detected from the difference value.

  The first detection determination unit 108 determines that the criterion is satisfied when the difference value is larger than the first threshold value. On the other hand, the second detection determination unit 109 determines that the criterion is satisfied when the difference value is smaller than the second threshold value. In the normal unmoving object detection function, the first detection determination unit 108 determines. The position (or coordinates) of the region of the pixel determined to satisfy the standard by the first detection determination unit 108 or the second detection determination unit 109 is stored in the detection region storage unit 110.

  On the other hand, the position of the region of the pixel that is determined not to satisfy the standard by the first detection determination unit 108 or the second detection determination unit 109 is deleted from the detection region storage unit 110. For each position of the pixel area stored in the detection area storage unit 110, the timer counter unit 111 counts the duration time. When the count value of the timer counter unit 111 reaches a predetermined time or more, the detection notification unit 112 outputs a signal such as a warning. Such unmoving object detection processing is executed every time a new image is acquired by the image signal processing unit 104.

  FIG. 4 is a flowchart showing the unmoving object detection process by the unmoving object detection function, and FIG. 5 is a flowchart showing details of the unmoving object detection process for each pixel in step S503 of FIG. FIG. 6 is a diagram for explaining the unmoving object detection function. Note that the detection determination is performed by the first detection determination unit 108.

  In FIG. 4, first, an image as shown in FIG. 6A serving as a reference for unmoving object detection is taken and stored as a reference image in the reference image storage unit 106 (step S501). The unmoving object detection function detects unmoving objects by comparing this reference image with a current image (step S502) when a new cylindrical object 601 as shown in FIG. Step S503) is performed. In the unmoving object detection, the difference detection unit 107 calculates a difference value of each pixel between the current image being captured and the reference image (step S505). At this time, as shown in FIG. 6C, a large difference is detected on the newly added cylindrical object.

  When the calculated difference value reaches or exceeds the threshold value, the first detection determination unit 108 determines that a new object 601 has been added to the monitoring area (YES in step S506). Then, the position (or coordinates) of the pixel area is stored in the detection area storage unit 110 (step S507), and the duration is counted by the timer counter unit 111 for each pixel (step S508). When a predetermined time elapses, for example, when the predetermined time required for detection is set to 5 minutes, if the value indicated by the counter becomes 5 minutes, the pixel area where the cylindrical object 601 is photographed is detected as a non-moving object. (YES in step S511). Then, as shown in FIG. 6D, the detection notification unit 112 notifies the user of the pixel area as an unmoving object (step S504).

  In the difference detection described above, a difference is detected in a pixel area other than the pixel area where the cylindrical object 601 is placed due to noise or the like, but the difference value does not exceed the first threshold value. The unit 108 does not determine that the standard is satisfied. In addition, when it is determined that the reference is satisfied in the previous frame in the continuous frames in time series, and it is determined that the reference is not satisfied in the current frame, the pixel area stored in the detection area storage unit 110 in the previous frame The position of is cleared (step S509). Also, the count of the timer counter unit 111 is cleared (step S510). Therefore, a moving object or the like is not detected as a non-moving object.

  In the above-described unmoving object detection, the first detection determination unit 108 and the second detection determination unit 109 perform determination for each pixel. However, the present invention is not limited to this, and the image is divided into blocks composed of a plurality of adjacent pixels. However, the determination may be performed for each block. In addition, the change is detected based on the difference between the pixel values. However, the present invention is not limited to this, and a method of detecting from a change in the edge component of the image or a method of detecting from the difference value of the DCT coefficient in units of JPEG coding blocks. It can be implemented.

  Next, the operation when the auto day / night function and the unmoving object detection function function simultaneously will be described. At this time, before and after the shooting mode is switched by the automatic day / night function, it is possible to distinguish between cases where there is a pixel area position stored in the detection area storage unit 110 and cases where there is no pixel area position.

  First, processing when switching of the shooting mode by the automatic day / night function occurs in a state where there is no pixel area position stored in the detection area storage unit 110 will be described with reference to FIGS.

  FIG. 7 is a flowchart showing processing when switching of the shooting mode is executed in a state where there is no position of the pixel area stored in the detection area storage unit 110. FIG. 8 is a diagram illustrating an example of an image captured in the process of FIG. 7, where (a) is a reference image before switching, (b) is a current image after switching, and (c) is a difference image thereof. It is. FIG. 9 is a diagram illustrating an example of an image captured when switching of the imaging mode is performed in a state where there is no pixel area position stored in the conventional detection area storage unit 110. Is a reference image before switching, (b) is a current image after switching, and (c) is a difference image thereof.

  Conventionally, when the shooting mode is switched by the automatic day / night function in the state where the pixel area stored in the detection area storage unit 110 is not located, the reference image before switching as shown in FIG. The luminance value of each pixel is greatly different from the image after switching as in (b). For this reason, a large difference is detected in the entire image as shown in FIG. 9C, and the entire monitoring area is erroneously detected as an unmoving object.

  Therefore, in this embodiment, when the shooting mode is switched by the auto day / night function (YES in step S701), the unmoving object detection function is temporarily stopped (step S702), and the reference image is updated (step S703). Thereafter, the unmoving object detection function is resumed (step S704). As a result, the reference image as shown in FIG. 8A is stored, and if there is no change in the monitoring area, the current image as shown in FIG. 8B and the reference image shown in FIG. The difference between the current image shown in FIG. 8B and the reference image shown in FIG. 8A is as shown in FIG. 8C and is not detected as an unmoving object. That is, the problem of erroneously detecting the entire monitoring area as an unmoving object when the shooting mode is switched by the auto day / night function during the unmoving object detecting function is solved.

  Next, processing when switching of the shooting mode by the automatic day / night function occurs in a state where the position of the pixel area stored in the detection area storage unit 110 is present will be described with reference to FIGS.

  FIG. 10 is a flowchart showing processing when switching of the shooting mode is executed in a state where the position of the pixel area stored in the detection area storage unit 110 is present. FIG. 11 is a diagram illustrating an example of an image captured in the process of FIG. 10, where (a) is a reference image before switching, (b) is a current image after switching, and (c) is a difference image thereof. It is. FIG. 12 is a diagram illustrating an example of an image that is captured when switching of the photographing mode is performed in a state where the position of the pixel region stored in the conventional detection region storage unit 110 is present. Is a reference image before switching, (b) is a current image after switching, and (c) is a difference image thereof.

  Conventionally, when switching of the shooting mode by the automatic day / night function occurs in a state where the pixel area stored in the detection area storage unit 110 exists, an object that can be a non-moving object exists in a part of the monitoring area. Nevertheless, a difference is detected in the entire image. That is, when the reference image as illustrated in FIG. 12A is stored in the reference image storage unit 106, a cylindrical object is added to the monitoring area, and then switching of the shooting mode is executed (see FIG. 12). A current image such as b) is obtained. The difference image between the current image and the reference image at this time is as shown in FIG. 12C, and a cylindrical region that can be a non-moving object cannot be specified. Therefore, there is a problem that an object that can be a non-moving object cannot be normally detected. Further, as described above, if only the reference image is updated after the shooting mode is switched, no change is detected in the cylindrical region that can be a non-moving object, and it cannot be detected as a non-moving object.

  Therefore, in this embodiment, when the shooting mode is switched by the auto day / night function (YES in step S901), the unmoving object detection function is temporarily stopped (step S902). Then, the reference image is updated (step S903) and the detection criterion is switched (step S904), and then the unmoving object detection function is resumed (step S905). The states of the detection area storage unit 110 and the timer counter unit 111 are saved before the unmoving object detection function is temporarily stopped. The switching of the detection determination criteria means that a pixel at a position not stored in the detection area storage unit 110 is processed by the first detection determination unit 108, and a pixel at a position stored in the detection area storage unit 110 is a second pixel. It shows that it is processed by the detection determination unit 109.

  FIG. 13 is a flowchart showing a detection process in each pixel by switching the detection criterion described above.

  Prior to switching of the shooting mode by the auto day / night function, based on the first detection determination unit 108, if the difference value of each pixel between the reference image and the current image is greater than or equal to the first threshold value, it is determined that the criterion is satisfied. These pixels are stored in the detection area storage unit 110 as unmoving object detection candidate pixels, and the count of the timer counter unit 111 is incremented. For the other pixels, the pixels (coordinates) stored in the detection area storage unit 110 are cleared, and the counter of the timer counter unit 111 is reset.

  After the shooting mode is switched by the auto day / night function, the reference image is updated and the unmoving object detection process is resumed. At this time, the position (or coordinates) of the pixel (area) stored in the detection area storage section 110 is determined before the shooting mode is switched (step S1001), and the determination by the first detection determination section 108 based on the result. Alternatively, for the pixel (region) at the position (or coordinate) stored in the detection region storage unit 110 before switching the shooting mode for performing the determination by the second detection determination unit 109 (YES in step S1001), the second The determination is performed by the detection determination unit 109. On the other hand, for a pixel at a position (or coordinate) that is not stored in the detection area storage unit 110 before switching to the shooting mode (NO in step S1001), the first detection determination unit 108 makes a determination.

  If the difference value between the updated reference image and the current image is less than or equal to the second threshold value for the pixel stored in the detection area storage unit 110, that is, the non-moving object detection candidate pixel (in step S1002). YES), it is determined that the standard is satisfied. That is, the object is regarded as not moving, and is stored in the detection area storage unit 110 (step S1004), the count of the timer counter unit 111 is incremented, and the duration is counted (step S1005).

  On the other hand, if it is equal to or greater than the second threshold (NO in step S1002), it is determined that the criterion has not been met. That is, it is considered that the object has moved, the memory of the detection area storage unit 110 is cleared (step S1006), and the count of the timer counter unit 111 is reset (step S1007).

  For pixels that are not stored in the detection area storage unit 110 before switching of the shooting mode, if the difference value is equal to or greater than the first threshold (YES in step S1003), it is determined that a new object has been added and the detection area A new area is stored in the storage unit 110 (step S1008). Then, the timer counter unit 111 starts counting (step S1009).

  On the other hand, if it is equal to or less than the first threshold (NO in step S1003), it is determined that there is no change from before the shooting mode is switched, and no particular processing is performed.

  According to the above embodiment, when the shooting mode is switched by the automatic day / night function, the reference image stored in the reference image storage unit 106 is updated. Then, the determination by the first detection determination unit 108 or the second detection determination unit 109 is switched according to the position (or coordinates) of the pixel region stored in the detection region storage unit 110. As a result, even if an automatic day / night function that changes the brightness and color of the entire image is activated during the unmoving object detection operation, the unmoving object can be normally detected without erroneously detecting the entire image as an unmoving object.

  In addition, when the shooting mode is switched during the duration of the non-moving object detection function, there is no problem that the area of the object that can be a non-moving object cannot be specified, and the non-moving object can be detected normally. . That is, the non-moving object detection function can be normally executed regardless of whether or not the shooting mode is changed in which the luminance and color of the entire screen changes.

  In the above embodiment, the processing when the shooting mode is switched by the auto day / night function during the unmoving object detection operation is not the case where there is a pixel area stored in the detection area storage unit 110 before the shooting mode switching. The explanation was divided into cases. However, in either case, it can be implemented with the same framework. This is because areas that are not stored before switching after the shooting mode switching is processed by the first detection determination unit 108 that is used during normal times, and areas that are stored before switching are processed. This is because the second detection determination unit 109 performs processing.

  In the above-described embodiment, it is assumed that the update of the reference image after the switching of the shooting mode is performed not after the switching of the shooting mode but after the luminance value of the entire image is stabilized. During the period from the switching of the shooting mode to the update of the reference image, the count of the timer counter unit 111 is maintained, and after the update of the reference image, the state before the stop is continued and restarted.

  In the above-described embodiment, an example in which the shooting mode is switched by the automatic day / night function during the unmoving object detection is shown. However, not only the auto day / night function but also the same processing is performed when the luminance and color information of the entire screen changes due to a change in the shooting mode. Examples of changes in the shooting mode include changes in imaging parameters including auto-shade correction, focus, sensitivity, white balance, and gain, and the present invention can be implemented. For example, mode 1 in which an image is captured with normal gain characteristics may be switched to mode 2 in which an image in which only a dark portion has a high gain is captured. Note that the imaging parameters may be changed according to a user instruction.

  In the above embodiment, the photographing mode is switched to either the attached state or the detached state of the infrared filter. However, the present invention is not limited to this, and the configuration of the image sensor including two or more is switched. Also good.

  The object of the present invention can also be achieved by executing the following processing. That is, a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is the process of reading the code. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on an instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, a case where the functions of the above-described embodiment are realized by the following processing is also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

It is a block diagram which shows the component regarding the automatic day / night function in the imaging device which concerns on embodiment of this invention. It is a flowchart which shows the operation | movement by an auto day / night function, (a) is at the time of a day mode, (b) is at the time of a night mode. It is a graph which shows the change of the incident light quantity from a to-be-photographed object over time. It is a flowchart which shows the unmoving object detection process by an unmoving object detection function. It is a flowchart which shows the detail of the unmoving object detection process for every pixel in step S503 of FIG. It is a figure for demonstrating a non-moving object detection function, (a) is a reference image, (b) is a present image, (c) is a difference image, (d) is an image at the time of a non-moving object detection. It is a flowchart which shows a process when switching of imaging | photography mode is performed in the state without the pixel area memorize | stored in the detection area memory | storage part. FIG. 8 is a diagram illustrating an example of an image captured in the process of FIG. 7, where (a) is a reference image before switching, (b) is a current image after switching, and (c) is a difference image thereof. It is a figure which shows an example of the image image | photographed when switching of imaging | photography mode is performed in the state without the pixel area memorize | stored in the conventional detection area memory | storage part 110, (a) is a reference image before switching, (B) is the current image after switching, and (c) is the difference image between them. 7 is a flowchart illustrating processing when switching of a shooting mode is performed in a state where there is a pixel region stored in a detection region storage unit 110. It is a figure which shows an example of the image image | photographed in the process of FIG. 10, (a) is the reference image before switching, (b) is the present image after switching, (c) is those difference images. It is a figure which shows an example of the image image | photographed when switching of imaging | photography mode is performed in the state with the pixel area memorize | stored in the conventional detection area memory | storage part 110, (a) is a reference image before switching, (B) is the current image after switching, and (c) is the difference image between them. It is a flowchart which shows the detection process in each pixel by switching of a detection criterion.

Explanation of symbols

101 Lens 102 Infrared cut filter 103 CCD
104 Image signal processing unit 105 Shooting mode switching unit 106 Reference image storage unit 107 Difference detection unit 108 First detection determination unit 109 Second detection determination unit 110 Detection area storage unit 111 Timer counter unit 112 Detection notification unit 301 Day mode period 302 Night mode period 303 Day mode period

Claims (16)

Image storage means for storing a reference image serving as a reference from a video being shot;
Difference detection means for calculating a difference value for each pixel between the stored reference image and the current image being shot;
First detection determination means for determining that the criterion is satisfied when the calculated difference value is greater than a first threshold;
A second detection determination unit that determines that the criterion is satisfied when the calculated difference value is smaller than a second threshold;
Area storage means for storing the position of the area of the pixel determined to satisfy the criterion by either the first detection determination means or the second detection determination means;
Switching means for switching the shooting mode;
When the photographing mode is switched by the switching unit, the reference image stored in the image storage unit is updated, and the first image is stored according to the position of the pixel region stored in the region storage unit. An image pickup apparatus comprising: a detection determination unit or a control unit that switches determination by the second detection determination unit.   The control means switches the pixel at the position stored in the area storage means to the determination by the second detection determination means, while the pixel at a position not stored in the area storage means. 2. The imaging apparatus according to claim 1, wherein switching to determination by the first detection determination unit is performed.   2. The switching unit according to claim 1, wherein the switching unit switches between a first photographing mode for photographing with incident light in only a visible light region and a second photographing mode for photographing with incident light including an infrared light region. 2. The photographing apparatus according to 2.   3. The photographing according to claim 1, wherein the switching means switches between a first photographing mode for photographing with a normal gain and a second photographing mode for photographing only a dark part with a gain increased. apparatus.   The imaging apparatus according to claim 1, wherein the switching unit switches the photographing mode by switching to any one of a plurality of states or a plurality of configurations.   The imaging apparatus according to claim 1, wherein the switching unit switches imaging parameters including white balance, focus, gain, and sensitivity automatically or according to a user instruction.   The information processing apparatus according to claim 1, further comprising notification means for notifying a user when a time determined by the first detection determination means or the second detection determination means to satisfy the reference has elapsed for a predetermined time. The imaging device according to any one of 6. The difference detection means, the first detection determination means, the second detection determination means, and the area storage means constitute an unmoving object detection function,
When the shooting mode is switched by the switching unit, the non-moving object detection function is stopped during a period from immediately after the switching of the shooting mode to the update of the reference image, and after the reference image is updated, the unmoving object detection is performed. The imaging apparatus according to any one of claims 1 to 7, wherein the function is resumed.   The imaging apparatus according to claim 1, wherein the difference detection unit calculates the difference from a luminance value between the reference image and the current image.   The imaging apparatus according to claim 1, wherein the difference detection unit is calculated from an edge component between a reference image and a current image.   When it is determined by the first detection determination unit or the second detection determination unit that the reference is satisfied, the region storage unit stores a position of a pixel region where the difference value satisfies the reference. The imaging device according to any one of claims 1 to 10, wherein the imaging device is characterized in that:   When the first detection determination unit or the second detection determination unit determines that the reference is not satisfied, the region storage unit clears the position of the stored pixel region. The imaging device according to any one of claims 1 to 11.   The imaging apparatus according to claim 1, wherein the first detection determination unit and the second detection determination unit perform determination for each pixel or for each block including a plurality of adjacent pixels.   The imaging device according to claim 13, wherein the area storage unit stores each pixel or each block including a plurality of adjacent pixels.   15. The imaging apparatus according to claim 1, wherein the updating of the reference image after switching is executed after the luminance value of the entire image is stabilized. Image storage means for storing a reference image serving as a reference from a video being shot;
Difference detection means for calculating a difference value for each pixel between the stored reference image and the current image being shot;
First detection determination means for determining that the criterion is satisfied when the calculated difference value is greater than a first threshold;
A second detection determination unit that determines that the criterion is satisfied when the calculated difference value is smaller than a second threshold;
A method for controlling an imaging apparatus comprising: a region storage unit that stores a position of a region of a pixel determined to satisfy the reference by either the first detection determination unit or the second detection determination unit,
A switching process for switching the shooting mode;
When the photographing mode is switched in the switching step, the reference image stored in the image storage unit is updated, and the first image is updated according to the position of the pixel region stored in the region storage unit. And a control step of switching judgment by the first detection judgment means or the second detection judgment means.

Images