JP5011226B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus that detects a moving object in an imaged subject and performs image processing corresponding to the movement of the moving object.

  As a general technique for adjusting the brightness of a captured image of a camera with a CPU (Central Processing Unit), an area for measuring illuminance in the captured image is specified in advance, and gain adjustment or What adjusts the light quantity of a lens is known.

  In recent years, with the advancement of CPUs, cameras have appeared that estimate the area desired by the user by analyzing the captured subject image and adjust the exposure around the estimated area. Such a camera is called an intelligent camera. As a specific example, a camera that captures a still image is known in which a face is detected from a still captured image and exposure is adjusted to the face area. Thereby, it is possible to photograph the face with appropriate brightness.

In addition, in a camera that captures a moving image, as a monitoring camera for capturing a suspicious person in the dark etc., the motion detection unit detects the amount of motion of the current image, and the region with the largest motion among the detection results When the illuminance is larger than a certain range, there is known a technique that corrects the illuminance of the region so that it falls within the certain range (see, for example, Patent Document 1). Thus, when a moving object such as a suspicious person appears in the captured image, the moving object can be photographed with appropriate brightness.
JP 2001-216583 A

  However, in the conventional motion detection processing technology such as Patent Document 1, when a moving object is erroneously detected, the position and size of the detected moving object is blurred, or the moving object moves quickly and the amount of movement is large. When a moving object suddenly starts moving, the moving object may not be detected properly. As a result, depending on the scene of the subject to be imaged, the movement of the moving object is not continuous between frames, and the movement of the moving object is not continuous and may vary.

  Further, even if the brightness of the image signal is corrected based on the result of such moving object detection processing, the variation in the detection result of the motion of the moving object appears as it is in the correction result of the brightness of the image signal. There was a problem that the motion of the moving object became unclear, such as flickering.

  The present invention has been made to solve the above-described conventional problems, and an object of the present invention is to provide an imaging apparatus capable of providing an image in which a moving object can be easily visually recognized even when the moving object moves greatly.

An imaging device according to the present invention includes an imaging device that captures an image of a subject and generates an image signal, a moving body detection unit that detects a moving body in the subject, a filter unit that adjusts the position and size of the moving body, It has a configuration including a brightness correction unit that corrects the brightness of a region corresponding to the adjusted position and size of the moving object with respect to the image signal .

  With this configuration, it is possible to suppress a significant change in the position and size of the moving object indicated by the corrected moving object information obtained by the adjustment process between frames. In particular, when the movement of the moving body is large, such as when the moving body suddenly starts moving or the movement of the moving body suddenly increases, the position and size of the moving body will change gradually between frames, and the moving body The change of the movement can be reduced. The brightness correction unit corrects the brightness of the corrected moving object region corresponding to the position and size of the moving object indicated by the corrected moving object information, and thus provides an image in which the moving object can be easily seen even when the moving object is large. be able to.

In the imaging device according to the present invention, the filter unit has a configuration that adjusts the position and size of the moving object according to the number of frames after the moving object is detected. Thereby, since the correction process by the brightness correction unit is performed based on the position and size adjusted according to the number of frames, it is possible to suppress a sudden change in brightness of the moving object immediately after the moving object is detected .

Further, in the imaging apparatus according to the present invention, the filter unit adjusts a change amount of the position and size of the moving object in a predetermined time and outputs it as corrected moving object information, and the brightness correction unit includes the corrected moving object. The brightness level of the area is corrected based on the position and size of the moving object indicated by the information. With this configuration, the brightness level is corrected based on the adjusted corrected moving body information, so that the phenomenon that the image flickers can be suppressed while the moving body is brightened .

In the imaging device according to the present invention, the filter unit has a configuration for obtaining a value between the position and size of a moving object in two consecutive frames as the corrected moving object information . Thereby, it is possible to suppress a large change in the position and size of the moving body between frames by a simple method.

Further, in the imaging device according to the present invention, the filter section is between the corrected moving body information of the first frame in the continuous first and second frames and the position and size of the moving body in the second frame. A certain value is newly obtained as the corrected moving body information . Thereby, it is possible to suppress a large change in the position and size of the moving body between frames by a simple method .

In the imaging apparatus according to the present invention, the filter unit has a configuration in which the corrected moving body information is obtained after weighting the position and size of the moving body in two consecutive frames . Thereby, the degree of adjustment can be adjusted between frames .

In the imaging device according to the present invention, the brightness correction unit corrects the brightness of the peripheral edge of the region with respect to the image signal. By brightening the peripheral edge of the region in this way, an image with a clearer motion of the moving object can be obtained.

In the imaging apparatus according to the present invention, the brightness correction unit corrects the area to a brightness level corresponding to the number of frames after the moving object is detected . Thereby, since the brightness level of the area gradually changes, it is possible to suppress a sudden change in brightness of the moving object immediately after the moving object is detected.

The imaging apparatus according to the present invention further includes a moving object tracking unit that tracks a moving object continuously included over a predetermined number of frames, and the filter unit includes a position and a size of a moving object to be tracked by the moving object tracking unit. It has the structure which adjusts thickness. With this configuration, it is possible to remove single moving body information that is not continuous in the preceding and following frames as noise and accurately track the moving body in the subject. Further, since the filter unit adjusts the position and size of the moving object to be tracked by the moving object tracking unit, it is possible to obtain corrected moving object information focusing on the movement of the moving object to be tracked.

  The present invention performs adjustment processing for adjusting the amount of change between frames of the position and size of the moving object on the moving object information in the filter unit, and outputs the adjusted moving object information as corrected moving object information. The brightness correction unit corrects the brightness of the corrected moving object area corresponding to the position and size of the moving object indicated by the corrected moving object information, thus providing an image that makes it easy to visually recognize the moving object even when the moving object moves greatly. It has an excellent effect that can be done.

Hereinafter, imaging devices according to embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating an imaging apparatus according to an embodiment of the present invention. In FIG. 1, an imaging apparatus 1000 includes a lens unit 101, an imaging element 102, a camera signal processing unit 103, a moving object detection unit 104, a detection result accumulation unit 105, a moving object tracking unit 106, and a detection result filter unit 107. And a brightness correction processing unit 108 and an image output unit 109.

  The lens unit 101 focuses the subject image to form the subject image on the image sensor 102. The image sensor 102 captures an image of a subject formed by the lens unit 101 as a subject image, and generates an image signal. The image sensor 102 is configured by an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).

  The camera signal processing unit 103 performs predetermined image processing programmed in advance on the image signal generated by the image sensor 102. Here, the camera signal processing unit 103 calculates a luminance signal and a color difference signal. The camera signal processing unit 103 is configured by a device such as a DSP (Digital Signal Processor).

  The moving object detection unit 104 detects the moving object in the subject for each frame using the image signal output from the camera signal processing unit 103, and indicates the position (coordinates) and size (area size) of the moving object. The information is output to the detection result accumulation unit 105 as moving body information. The moving body information of each frame is handled as metadata.

  The moving object detection process here detects a moving object by separating a region serving as a background and a moving object (a tangible object such as a person, an animal, or an object) from a captured image. Specifically, the moving object detection unit 104 calculates the difference between the image signal between the previous frame and the current frame, analyzes the image signal, and sets the changed area as a moving object area. Detect every time.

  Note that the moving object detection method is not limited to the method based on the difference detection of the image signal between two consecutive frames. For example, a moving object may be detected by creating a reference background frame in advance and calculating a difference between image signals between the current frame and the background frame.

  The detection result accumulating unit 105 stores moving object information, which is a detection result of the moving object detecting unit 104, over a plurality of frames. The moving object tracking unit 106 acquires moving body information of a plurality of frames from the detection result accumulation unit 105, and analyzes temporal and positional correlation of moving objects between the plurality of frames based on the moving object information of the plurality of frames. , Process to track moving objects. Specifically, the moving object tracking unit 106 determines whether or not moving objects in two consecutive frames have portions that spatially overlap each other based on moving object information of a plurality of frames. When some of the moving objects overlap each other, the moving object tracking unit 106 determines that the same moving object is continuously detected in two consecutive frames. The moving object tracking unit 106 sequentially performs this determination for a plurality of frames, thereby tracking moving objects included continuously over a predetermined frame.

  The detection result filter unit 107 performs an adjustment process on the moving object information to adjust the amount of change in the position and size of the moving object tracked by the moving object tracking unit 106, and the adjustment process is performed. The moving body information is output as corrected moving body information. The adjustment process here refers to a relaxation process that suppresses a significant change in the position and size of a moving object that is a tracking target by the moving object tracking unit 106 between frames. Details of the detection result filter unit 107 will be described later in the description of operation. Note that the detection result filter unit 107 may perform the mitigation process on the moving object detected by the moving object detection unit 104 instead of the moving object to be tracked by the moving object tracking unit 106. The detection result filter unit 107 corresponds to the filter unit of the present invention.

  The brightness correction processing unit 108 corrects the brightness (for example, luminance and gradation) of the corrected moving body region corresponding to the position and size of the moving body indicated by the corrected moving body information with respect to the image signal. The details of the brightness correction processing unit 108 will also be described in the operation description described later. The brightness correction processing unit 108 corresponds to the brightness correction unit of the present invention. The image output unit 109 outputs the image signal whose brightness has been corrected by the brightness correction processing unit 108.

Next, the operation of the imaging apparatus 1000 according to the embodiment of the present invention will be described based on the drawings. FIG. 2 is a diagram illustrating an operation flow of the imaging apparatus 1000.
First, the image sensor 102 images the subject imaged by the lens unit 101 and generates an image signal (step (STEP: hereinafter referred to as S) 1). The camera signal processing unit 103 performs predetermined image processing on the image signal generated by the image sensor 102 (S2).

  Next, the moving object detection unit 104 detects the moving object in the subject for each frame based on the image signal obtained by the camera signal processing unit 103, and uses the information indicating the position and size of the moving object as metadata. This is output as moving body information (S3). At this time, the moving object detection unit 104 separates a background region and a moving moving object (a tangible object such as a person, an animal, or an object) in the captured image, and then between the previous frame and the current frame. By calculating the difference between the image signals, the temporal change of the image signal is analyzed, and the moving object is detected from the changed area. The moving object detection unit 104 outputs moving object information indicating the position and size of the moving object as metadata to the detection result accumulation unit 105. The detection result accumulation unit 105 stores moving body information over a plurality of frames.

  Next, the moving body tracking unit 106 acquires moving body information of a plurality of frames from the detection result storage unit 105 (S4). The moving object tracking unit 106 performs processing for tracking a moving object by analyzing temporal and positional correlation of moving objects of a plurality of frames based on moving object information of the plurality of frames (S5). Specifically, the moving object tracking unit 106 determines whether moving objects in two consecutive frames have portions that spatially overlap each other. When some of the moving objects overlap each other, the moving object tracking unit 106 determines that the same moving object is continuously detected in two consecutive frames. The moving object tracking unit 106 sequentially performs this determination for a plurality of frames, thereby tracking moving objects included continuously over a predetermined frame.

  FIG. 3 is a diagram for explaining the tracking process by the moving object tracking unit 106. FIG. 3 shows the detection result of the moving object by the moving object detection unit 104 as the contents of the moving object information. Specifically, in FIG. 3, a moving object in the frame tm1 is represented as a moving object detection result 201 in the frame tm1, and a moving object in the frame tm2 is represented as a moving object detection result 202 in the frame tm2. Frame tm2 is the next frame after frame tm1. As shown by the arrows in FIG. 3, the moving object detection result shifts to a moving object detection result 201 in the frame tm1 and a moving object detection result 202 in the frame tm2.

  The moving object tracking unit 106 determines whether or not the moving object detection result 201 in the frame tm1 and the moving object detection result 202 in the frame tm2 have a spatially overlapping region. In this determination result, when the moving object detection results 201 and 202 in both frames tm1 and tm2 have overlapping regions, the moving object tracking unit 106 determines that the same moving object is detected continuously over two frames. To do. The moving object tracking unit 106 sequentially performs this determination for a plurality of frames, thereby tracking moving objects included continuously over a predetermined frame.

  In this way, since the moving body tracking unit 106 tracks the moving body continuously included over a predetermined frame, the single moving body information that is not continuous in the preceding and following frames can be removed as noise, thereby It is possible to accurately track the movement of the moving object in the subject.

  Here, when only the moving object information output process by the moving object detection unit 104 and the moving object tracking process by the moving object tracking unit 106 are performed, the moving object suddenly starts moving, or the moving object moves suddenly quickly. When the change in motion is large, the position and size of the moving object vary greatly between frames. If the brightness correction processing unit 108 corrects the brightness of the image signal while the size and position of the moving object varies between frames, the brightness corrected image signal also varies, and flickering The phenomenon will occur.

  Therefore, in the embodiment of the present invention, after the moving object tracking process (S5) described above, the detection result filter unit 107 increases the position and size of the moving object tracked by the moving object tracking unit 106 between frames. The mitigation process for suppressing the change is performed on the moving body information, and the moving body information subjected to the mitigation process is output to the brightness correction processing unit 108 as the corrected moving body information (S6).

  FIG. 4 is a diagram for explaining mitigation processing by the detection result filter unit 107. FIG. 4 shows a tracking process of a moving object to be tracked by the moving object tracking unit 106. Specifically, FIG. 4 shows moving object detection results of frames tc1, tc2, and tc3 as the contents of moving object information about the moving object to be tracked. The frame tc1 is followed by the frame tc2, and the frame tc2 is followed by the frame tc3. The moving object detection result shifts to a moving object detection result 301 in the frame tc1, a moving object detection result 302 in the frame tc2, and a moving object detection result 303 in the frame tc3.

  Here, as illustrated in FIG. 4, by moving from the moving object detection result 301 of the frame tc1 to the moving object detection result 303 of the frame tc3, the position coordinates of the tracking target moving object are changed from C1 (cx1, cy1) to C2 (cx2). , Cy2) to C3 (cx3, cy3), and the size (area size) of the moving object to be tracked is the vertical size Hc1, the horizontal size Wc1 to the vertical size Hc2, the horizontal size Wc2, and then the vertical size Hc3. The case where it changes to size Wc3 is demonstrated.

  In this case, the search result filter unit 107 obtains a value between the position coordinates of the moving object in two consecutive frames as corrected moving object information, and uses the position coordinates of the corrected moving object information as the position coordinates of the moving object in the subsequent frame. Perform the replacement process. Similarly, the search result filter unit 107 obtains a value between the sizes of moving objects in a frame as corrected moving object information, and performs processing to replace the size of the corrected moving object information with the size of moving objects in a subsequent frame.

Specifically, the search result filter unit 107 first calculates the moving object position coordinate C1 (cx1, cy1) in the frame tc1 and the moving object in the frame tc2 with respect to the position coordinates of the moving object to be tracked, as shown in Expression (1). Average coordinate value C2 ′ (cx2 ′, cy2 ′) of the position coordinates C2 (cx2, cy2) of the current position is calculated as corrected moving body information, and the position coordinates C2 ′ of the corrected moving body information is the position coordinates of the tracking target moving body in the frame tc2. Replace with

Thereafter, as shown in Expression (2), the search result filter unit 107 calculates the average coordinate of the corrected moving body information C2 ′ (cx2 ′, cy2 ′) obtained earlier and the moving body position coordinates C3 (cx3, cy3) in the frame tc3. A value C3 ′ (cx3 ′, cy3 ′) is obtained as corrected moving body information, and the position coordinate C3 ′ of this corrected moving body information is replaced with the position coordinate of the tracking target moving body in the frame tc3.

The search result filter unit 107 first sets the size of the moving object in the frame tc1 (vertical size Hc1, horizontal size Wc1) and the moving object in the frame tc2, as shown in Expression (3). Average values Hc2 ′ and Wc2 ′ of the sizes (vertical size Hc2 and horizontal size Wc2) are obtained as corrected moving body information, and the sizes Hc2 ′ and Wc2 ′ of the corrected moving body information are determined as the size of the moving object to be tracked in frame tc2. Replace with (vertical size, horizontal size).

Thereafter, as shown in Expression (4), the search result filter unit 107 calculates the corrected moving body information (vertical size Hc2 ′, horizontal size Wc2 ′) obtained earlier and the size of the moving body in the frame tc3 (vertical size Hc3, horizontal size). The average values Hc3 ′ and Wc3 ′ of Wc3) are obtained as corrected moving body information, and the sizes Hc3 ′ and Wc3 ′ of the corrected moving body information are replaced with the sizes (vertical size and horizontal size) of the tracking target moving body in the frame tc3.

  As described above, the search result filter unit 107 obtains a value between the position and size of the moving object in two consecutive frames as the corrected moving object information, and uses this corrected moving object information as the position and size of the moving object in the subsequent frame. Process to replace with. Thereby, it can suppress that the position and magnitude | size of a moving body change greatly between frames.

  In the above description, the average value of the position and size of the moving object in the previous and subsequent frames is calculated as the corrected moving object information. However, the corrected moving object information may be a value between the position and size of the moving object in the previous and subsequent frames. What is necessary is just and it is not limited to the average value of the frame before and behind. Further, the detection result filter unit 107 may perform the mitigation process on the moving object detected by the moving object detection unit 104 instead of the moving object to be tracked by the moving object tracking unit 106.

  In this way, the mitigation process is performed on the moving body information to prevent the position and size of the moving body from greatly changing between frames, and the moving body information subjected to the mitigation process is output as the corrected moving body information. The change in the position and size of the moving object indicated by the obtained corrected moving object information is smaller than that before the relaxation process except when the moving object stops suddenly. As a result, it is possible to prevent the position and size of the moving object indicated by the corrected moving object information from greatly differing between frames, and not to vary greatly between frames.

  In the above description, the corrected moving body information is obtained using the position and size of the moving body after the relaxation process. However, the corrected moving body information may be obtained using the position and size of the moving body before the relaxation process. For example, to calculate the position and size of the moving object in the frame tc3 after the relaxation process, the search result filter unit 107 calculates the position and size of the moving object in the frame tc2 after the relaxation process and the position and size of the moving object in the frame tc3. May be obtained as corrected moving body information, and the value of the corrected moving body information may be replaced with the position and size of the moving body to be tracked in the frame tc3. Even if it does in this way, the effect mentioned above can be acquired.

  Next, the brightness correction processing unit 108 corrects the brightness of the corrected moving body region corresponding to the position and size of the moving body indicated by the corrected moving body information with respect to the image signal (S7). Accordingly, it is possible to correct the brightness in accordance with the position and size of the moving object after suppressing a large change between frames. As a result, even when the movement of the moving object is large, it is easy to visually recognize the moving object and an image with a clear movement of the moving object can be obtained. In this case, the brightness level of the corrected moving body region may be determined by the position and size of the moving body indicated by the corrected moving body information. For example, when the position of the moving object indicated by the corrected moving object information is at the center of the image, correction is performed to make the corrected moving object region brighter than when the position of the moving object is at the periphery of the image. Further, the larger the size of the moving object indicated by the corrected moving object information is, the brighter the correction moving object region is corrected. In this way, the phenomenon of flickering images can be suppressed while making the moving body bright.

  A diaphragm (not shown) is provided between the lens unit 101 and the image sensor 102 for adjusting the amount of light incident on the subject incident on the image sensor 102. The brightness correction processing unit 108 corrects the brightness of the image signal by adjusting the amount of light incident on the image sensor 102 using the diaphragm. Thereby, the brightness of the whole image can be corrected with a simple configuration.

  Preferably, in step S7, the brightness correction processing unit 108 may correct the brightness of the peripheral portion of the corrected moving object region with respect to the image signal. Thereby, it is possible to obtain an image in which the motion of the moving object is clearer.

  Then, the image output unit 109 outputs the image signal whose brightness has been corrected by the brightness correction processing unit 108 (S8).

  According to such an imaging apparatus 1000 according to the embodiment of the present invention, the detection result filter unit 107 performs adjustment processing for adjusting the amount of change in the position and size of the moving object between the frames. Then, the moving body information subjected to the adjustment process is output as corrected moving body information. The adjustment process here refers to a relaxation process that suppresses a significant change in the position and size of a moving object that is a tracking target by the moving object tracking unit 106 between frames. As a result, the change in the position and size of the moving object indicated by the corrected moving object information obtained by the relaxation process is smaller than that before the relaxation process except when the moving object stops suddenly. As a result, it is possible to prevent the position and size of the moving object indicated by the corrected moving object information from greatly differing between frames, and not to vary greatly between frames. In particular, when there is a large change in the movement of the moving object, such as when the moving object suddenly starts moving or the movement of the moving object suddenly becomes faster, The change of the movement can be reduced. Then, the brightness correction processing unit 108 corrects the brightness of the corrected moving body region corresponding to the position and size of the moving body indicated by the corrected moving body information, so that the moving body after suppressing a large change between frames is corrected. The brightness can be corrected in accordance with the position and size of. Thereby, it is possible to obtain an image with a clear moving object while suppressing flickering.

  Further, the brightness correction processing unit 108 corrects the brightness of the corrected moving body area based on the position and size of the moving body indicated by the corrected moving body information, so that it matches the movement of the moving body included in the captured subject. The brightness of the moving object does not change greatly, and an image with a clear movement of the moving object can be obtained. As a result, it is possible to reduce the phenomenon that the image flickers while making the moving body bright. For this reason, it is possible to provide the user with a moving object image with appropriate brightness without any sense of incongruity.

  Further, according to the imaging apparatus 1000 according to the embodiment of the present invention, the detection result filter unit 107 corrects the moving body information between the position and the size of the moving body in two consecutive frames among the plurality of frames. Therefore, it is possible to perform a mitigation process that suppresses a large change in the position and size of the moving object between frames with a simple method, and obtain this as corrected moving object information.

  Further, according to the imaging apparatus 1000 of the embodiment of the present invention, the detection result filter unit 107 is between the corrected moving body information of the previous frame and the position and size of the moving body in the next frame among the plurality of frames. Since the value is newly obtained as corrected moving body information, it is possible to perform relaxation processing on the moving body information with a simple method that suppresses a significant change between frames of the position and size of the moving body.

  Further, according to the imaging apparatus 1000 of the embodiment of the present invention, the brightness correction processing unit 108 corrects the brightness of the peripheral portion of the corrected moving object region with respect to the image signal, so that the moving object moves more clearly. Can be obtained.

  In addition, the imaging apparatus 1000 according to the embodiment of the present invention includes the moving body tracking unit 106 that performs processing for tracking moving bodies continuously included over a predetermined number of frames based on the moving body information, and the detection result. The filter unit 107 has a configuration for performing relaxation processing on a moving object to be tracked by the moving object tracking unit 106. With this configuration, it is possible to remove single moving body information that is not continuous in the preceding and following frames as noise, and thus it is possible to accurately track the moving body in the subject. Further, since the detection result filter unit 107 performs the mitigation process on the moving object tracked by the moving object tracking unit 106, it is possible to obtain corrected moving object information that focuses on the movement of the tracked moving object.

  In addition, according to the imaging apparatus 1000 of the embodiment of the present invention, the imaging apparatus 1000 includes a diaphragm for adjusting the amount of incident light of the subject incident on the imaging element 102, and the imaging apparatus 1000 uses the diaphragm to Since the brightness of the image signal is adjusted by adjusting the amount of incident light, the brightness of the entire image can be easily adjusted.

  The embodiments of the present invention have been described above by way of example, but the scope of the present invention is not limited to these embodiments, and can be changed or modified according to the purpose within the scope of the claims. is there.

  In the embodiment described above, as described with reference to FIG. 4, the detection result filter unit 107 directly corrects a value (for example, an average value) between the position and size of the moving object in two consecutive frames. Although it calculated | required as information, after weighting the position and magnitude | size of the moving body in two frames, the value (for example, average value) between the position and magnitude | size of the moving body in two frames is calculated | required, and this is correct | amended It may be information. Thereby, in the moving body information relaxation process, the degree of relaxation can be adjusted between frames of the position and size of the moving body. For example, when the moving object suddenly moves greatly, the movement of the correction moving object region may be greatly delayed with respect to the actual movement of the moving object on the image. In such a case, after weighting the moving body information of the subsequent frame in the two consecutive frames, a value between the position and size of the moving body in the two frames is calculated as the corrected moving body information. Good. Accordingly, the position and size of the moving object in the subsequent frame are emphasized by weighting, and the position and size of the moving object in the subsequent frame are also emphasized in the corrected moving object information. As a result, even when the moving body suddenly moves greatly, the fluctuation of the correction moving body area can be prevented from being greatly delayed with respect to the fluctuation of the moving body on the actual image.

  In the above-described embodiment, the detection result filter unit 107 uses the mitigation processing that suppresses a large change in the position and size of the moving object between the frames according to the number of frames after the moving object first appears in the moving object information. You may make it carry out with respect to. For example, the detection result filter unit 107 multiplies the size of the moving object by changing the coefficient in a certain frame after the moving object first appears. That is, the detection result filter unit 107 increases the coefficients such as 0.1, 0.2, 0.3,..., 0.8, 0.9, and 1 as the number of frames after the moving object increases. And the above-mentioned relaxation processing (S6 in FIG. 2) is performed by multiplying the coefficient (vertical size, horizontal size) by this coefficient.

  Accordingly, in the brightness correction processing of the brightness correction processing unit 108, the corrected moving object region can be gradually made effective as a brightness correction target, and the brightness level of the moving object is rapidly increased immediately after the moving object is detected. The change can be suppressed. For example, even when the moving object has a certain size, it is possible to reduce a sense of incongruity that suddenly becomes brighter in a frame with the moving object to be tracked.

  In the above-described embodiment, the brightness correction processing unit 108 may correct the corrected moving body region to a brightness level corresponding to the number of frames after the moving body first appears. For example, the brightness is set from level 0 to level 5. At this time, when the target level after correction is set to level 5, the brightness correction processing unit 108 becomes level 0, level 1,..., Level 4, as the number of frames after the moving object first appears increases. The brightness with respect to the image signal is corrected so as to gradually increase the level to level 5. Thereby, instead of suddenly increasing the brightness level of the corrected moving object region to the target level, it is gradually changed, so that the brightness level of the moving object is prevented from changing abruptly immediately after the moving object is detected, You can reduce the sense of incongruity.

  As described above, the present invention has an effect that it is possible to provide an image that makes it easy to visually recognize a moving object even when the moving object is large, and a surveillance camera for photographing a suspicious person in the dark It is useful as an imaging device.

1 is a block diagram illustrating an imaging apparatus according to an embodiment of the present invention. The figure which shows the operation | movement flow of the imaging device of embodiment of this invention The figure for demonstrating the tracking process by the moving body tracking part of the imaging device of embodiment of this invention The figure for demonstrating the relaxation process by the detection result filter part of the imaging device of embodiment of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Lens part 102 Image pick-up element 103 Camera signal processing part 104 Moving object detection part 105 Detection result storage part 106 Moving object tracking part 107 Detection result filter part 108 Brightness correction process part 109 Image output part 1000 Imaging device

Claims (10)

An image sensor that images a subject and generates an image signal;
A moving object detection unit for detecting a moving object in the subject ;
A filter unit for adjusting the position and size of the moving body;
A brightness correction unit that corrects the brightness of a region corresponding to the adjusted position and size of the moving object with respect to the image signal ;
An imaging apparatus comprising: The imaging device according to claim 1, wherein the filter unit adjusts a position and a size of the moving body according to the number of frames after the moving body is detected . The filter unit adjusts the amount of change in the position and size of the moving object in a predetermined time, and outputs it as corrected moving object information,
The brightness correction unit, the corrected moving object based on the position and size of the moving object indicated by the information, the imaging apparatus according to claim 1 or 2 for correcting the brightness level of the area. The filter unit, the imaging apparatus according to claim 2 or 3 obtains a value that is between the position and size of the moving object in two consecutive frames as the correction moving body information. The filter unit newly obtains, as the corrected moving body information, a value between the corrected moving body information of the first frame and the position and size of the moving body in the second frame in successive first and second frames. The imaging device according to claim 2 or 3 . The filter unit, the imaging apparatus according to claim 4 or 5 obtains the correction moving body information after the weighting at the position and size of the moving object in two consecutive frames. The imaging apparatus according to claim 1, wherein the brightness correction unit corrects brightness of a peripheral portion of the region with respect to the image signal. The imaging apparatus according to claim 1, wherein the brightness correction unit corrects the area to a brightness level corresponding to the number of frames after the moving object is detected . A moving body tracking unit that tracks a moving body continuously included over a predetermined number of frames;
The imaging device according to claim 1, wherein the filter unit adjusts a position and a size of a moving object to be tracked by the moving object tracking unit. A method of processing an image signal in accordance with the movement of a moving object,
Detect moving objects,
Adjust the position and size of the moving object according to the number of frames after detecting the moving object,
An image signal processing method for correcting brightness of an area of the image signal corresponding to the adjusted position and size of the moving object .