JP2013186834A - Image processing apparatus, control method for image processing apparatus, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect, even when an erroneous detection occurs in detection processing for a specific object, a specific object at a high speed by appropriately determining a priority of a layer used for pattern matching.SOLUTION: An information processing apparatus includes: a detecting part for detecting a specific object out of an input image by using one or more layers, which are images, which are generated through enlargement or reduction of an input image and have different resolutions; an image specification information generating part for generating image specification information indicative of information for specifying an image used for detecting a specific object; position specification information generating part for generating position specification information indicative of information for specifying a detection position of a specific object in the image; an imparting part for imparting evaluation information to a detection result of the specific object on the basis of the image specification information and the position specification information; and a setting part for setting, for the input image, a layer used for detecting the specific object on the basis of evaluation information.

Description

  The present invention relates to an image processing device for detecting a specific object from an image, a control method for the image processing device, and a program, and more particularly to an image processing device for detecting a human body at high speed from an image of a surveillance camera and a control method for the image processing device. And related to the program.

  Conventionally, when a specific object such as a face or a human body is detected from an image of a monitoring camera, the object is detected by pattern matching processing.

  In Patent Document 1, a plurality of local patterns are extracted using a matching pattern over the entire image while changing the size of the image, and each local feature is calculated. And the method of determining whether it is a human body from the sum total of the result of having weighted the local feature-value is described. Japanese Patent Application Laid-Open No. 2004-26883 discloses a method of changing the face detection processing method according to the posture of the camera body. And in patent document 3, the tracking method by pattern matching is described. In addition, these specific object detection processes need to be able to be performed at high speed in order to perform real-time processing in the background of increasing the number of pixels of network camera devices and monitoring. As a method for realizing high-speed processing, Patent Document 4 describes a method of switching the priority of reduced images (layers) used for pattern matching based on past image capturing results.

JP 2009-211311 A JP 2010-080993 A JP 2002-373332 A JP 2007-135115 A

  However, with the methods described in Patent Literature 1 to Patent Literature 4, the detection processing of the specific object is not always performed correctly. Therefore, if a specific object is frequently erroneously detected in a place where the specific object does not appear, a method of changing the priority of the layer used for pattern matching based on past detection results may not work effectively. There are challenges.

  In view of the above problems, an object of the present invention is to appropriately determine the priority of a layer used for pattern matching and detect a specific object at high speed even when erroneous detection occurs in the specific object detection process. .

An image processing apparatus according to the present invention that achieves the above object is as follows.
Detection means for detecting a specific object from the input image using one or more layers that are images having different resolutions generated by enlarging or reducing the input image;
Image specifying information generating means for generating image specifying information indicating information for specifying an image used for detection of the specific object;
Position specifying information generating means for generating position specifying information indicating information for specifying a detection position of the specific object in the image;
An assigning means for assigning evaluation information to a detection result of the specific object based on the image specifying information and the position specifying information;
Setting means for setting a layer used for detection of the specific object for the input image based on the evaluation information;
It is characterized by providing.

  According to the present invention, even when erroneous detection occurs in the specific object detection process, it is possible to appropriately determine the priority of the layer used for pattern matching and detect the specific object at high speed.

1 is a diagram illustrating a configuration example of an image processing apparatus according to the present invention. Explanatory drawing of the layer process in the human body detection process which concerns on 1st Embodiment. FIG. 4 is a diagram illustrating an example of a recording table according to the first embodiment. The figure which shows the example of GUI for providing the evaluation information which concerns on 1st Embodiment. The figure which shows the example of the recording table to which the evaluation information which concerns on 1st Embodiment was provided. The figure which shows the example of the corresponding | compatible table which concerns on 1st Embodiment. 6 is a flowchart showing a procedure of overall processing according to the first embodiment. The flowchart which shows the procedure of the human body detection process which concerns on 1st Embodiment. The figure which shows the example which divided | segmented the input image which concerns on 2nd Embodiment in the area | region. The figure which shows the example of the recording table to which the evaluation information which concerns on 2nd Embodiment was provided. The figure which shows the example of the corresponding | compatible table which concerns on 2nd Embodiment. The flowchart which shows the procedure of the whole process which concerns on 2nd Embodiment. The flowchart which shows the procedure of the human body detection process which concerns on 2nd Embodiment.

<First Embodiment>
A configuration example of the image processing apparatus 100 according to the first embodiment will be described with reference to FIG. The image processing apparatus 100 includes an image acquisition unit 101, a human body detection unit 102, an image specification information generation unit 103, a detection position specification information generation unit 104, an evaluation information addition unit 105, a layer setting unit 106, and a storage unit. 107 and an external output unit 108. Each processing unit is controlled by a CPU (not shown).

  The image acquisition unit 101 acquires images to be processed from the outside in chronological order. An external device that acquires an image is not limited to a camera, but may be an image stored in a server or an external memory. In addition, both still images and moving images are included. The human body detection unit 102 performs pattern matching processing using one or more layers (reduced images) that are images having different resolutions generated by enlarging or reducing an input image in order to detect human bodies of different sizes. And detecting the human body from the image.

  The image specifying information generating unit 103 generates image specifying information that is information for specifying an image used at the time of detecting a human body with respect to the detection result of the human body by the human body detecting unit 102, and stores the generated image specifying information in the storage unit 107. The detection position specification information generation unit 104 generates detection position specification information, which is information for specifying the detection position at the time of human body detection, from the detection result of the human body by the human body detection unit 102 and stores it in the storage unit 107. .

  Based on the image specifying information generated by the image specifying information generating unit 103 and the detected position specifying information generated by the detected position specifying information generating unit 104, the evaluation information adding unit 105 adds evaluation information for the detection result. The layer setting unit 106 creates a correspondence table in which a predetermined area in the image and a processing layer are associated with each other based on the evaluation information given by the evaluation information giving unit 105. The processing layer refers to information indicating which layer is used for human body detection by the human body detection unit 102.

  The storage unit 107 stores the image specification information generated by the image specification information generation unit 103, the detection position specification information generated by the detection position specification information generation unit 104, and the correspondence table created by the layer setting unit 106. The human body detection unit 102 performs human body detection processing based on the stored setting value of the correspondence table. The storage unit 107 also stores a human body verification pattern used for human body detection processing. The external output unit 108 outputs various information processed by the image processing apparatus 100 to an external apparatus.

  Hereinafter, the layer, the human body detection process, the image specification information, the detection position specification information, the evaluation information addition, and the correspondence table will be described in detail.

  First, the layer and human body detection process will be described. FIG. 2 is a diagram illustrating layer processing in human body detection processing. An image 201 is an image acquired by the image acquisition unit 101. Here, the image 201 is referred to as layer 0 (L0). The collation pattern 202 is a collation pattern when performing human body detection by pattern matching processing. For the image 201, a human body is detected by raster scanning from the upper left of the acquired image using the matching pattern 202. Next, an image 203 in which the size of the image 201 is reduced by a predetermined magnification is created, and a raster scan is performed on the image 203 using the same matching pattern 202 as the image 201 to detect a human body. Here, the reduced image 203 is referred to as layer 1 (L1). Similarly, human body detection processing is performed on the image 204 (layer 2 (L2)) obtained by reducing the image 203 by a predetermined magnification using the matching pattern 202. By repeatedly using the same matching pattern 202 for the reduced image, it is possible to detect human bodies of various sizes in the screen. Here, a layer is a set of a plurality of images with different resolutions generated by enlarging or reducing an input image. As described above, the layers in the present embodiment are a set of images from a plurality of layers 0 to N. The original image is layer 0, and each time the image is reduced, layers 1 and 2 are used. . Further, as described above, the layer and the size of the human body to be detected are related.

  These processes are repeated to detect human bodies of various sizes, and the process ends when the elapsed time from the start of the process reaches a threshold value. In the present embodiment, the process end condition is determined based on the elapsed time from the start of the process, but is not limited to the elapsed time. The process end condition may be determined from the number of detected human bodies, the number of times the human body detection process is executed, and the like.

  Further, the predetermined magnification for creating the reduced image may be any number as long as it is less than 1. The closer to 1, the higher the accuracy, but the longer the processing time, and the lower the magnification, the generally lower the accuracy, but the shorter the processing time, so an appropriate value is set according to the operating conditions. In the present embodiment, the original image 201 is repeatedly reduced and a large human body is sequentially detected. However, the processing order may be changed so that a small human body is detected from a large human body.

  Moreover, in this embodiment, although the detection target is a human body, it is not necessarily limited to a human body. The detection target may be an object that may appear in various sizes on the input image, such as a face, a car (vehicle), or an animal. Furthermore, if a plurality of types of specific objects can be detected simultaneously by a specific object detection unit that detects a plurality of types of specific objects, a plurality of specific object detection processes may be performed on the object. In addition, depending on the object attributes used for the set values such as the object size and aspect ratio set separately, only a predetermined process may be selected from a plurality of specific object detection processes and the process may be performed. For example, the specific object detection unit includes a human body detection unit and a vehicle detection unit. At this time, the size of the car that can appear in the screen is set as a minimum vehicle size in accordance with a user instruction. When the size of the object is smaller than the minimum vehicle size, the possibility of being detected as a car is low, and therefore, the processing in the vehicle detection unit is not performed and only the processing in the human body detection unit is performed. On the other hand, if the size of the object is larger than the minimum vehicle size, there is a possibility that the object is detected as a car, and therefore the process in the car detection unit is performed. In addition, since there is a possibility that a plurality of people act as a group and are detected as one object, processing in the human body detection unit is also performed.

  Next, the image specifying information will be described. The image specifying information is information for specifying the image (layer) used at the time of detecting the human body with respect to the detection result of the human body by the human body detecting unit 102. For example, information indicating the image itself used when detecting the human body is used as the image specifying information. Further, the frame identifier information of the image used at the time of detecting the human body and the time information at the time of detecting the human body may be used as the image specifying information. In this case, the still image or the moving image acquired from the outside by the image acquisition unit 101 together with the frame identifier information and the time information is stored in the storage unit 107 or an external device so that the image used at the time of human body detection can be specified later. It is necessary to record in the storage unit.

  Next, the detection position specifying information will be described. The detection position specifying information is information for specifying the detection position at the time of human body detection with respect to the human body detection result by the human body detection unit 102. For example, coordinate information indicating the position where the human body detection unit 102 has detected the human body is used as the detection position specifying information. The coordinates at this time may use the coordinate system in the reduced image, or the detection position in the reduced image is converted to the detection position on the layer 0 image (original image) corresponding to the reduced image. After that, the coordinate system in layer 0 may be used. Moreover, you may use the image information which superimposed the information showing the position where the human body was detected on the image contained in image specific information as detection position specific information.

  In the present embodiment, a predetermined period is set as a learning period, and the human body detection process is executed using all layers of the input image within the learning period. Based on the detection result, the image specifying information generating unit 103 generates image specifying information, and the detected position specifying information generating unit 104 generates detected position specifying information. Note that detection results may be collected by methods other than a method in which a predetermined period is a learning period. For example, detection results may be collected by setting the learning period until a certain number of human bodies are detected. Further, a detection result prepared in advance may be used directly.

  An example of holding the image specifying information and the detected position specifying information is shown in the recording table of FIG. The recording table records the number of times that the human body detection event has occurred for each layer. Here, the human body detection event indicates that human body detection is detected once in an arbitrary layer. In the example of FIG. 3, it can be seen that 95 human body detection events have occurred in L2 during the learning period. It can also be seen that 34 human detection events occurred at L5 during the learning period. The recording table gives a unique ID (for example, L2-001,..., L2-095, L5-001,..., L5-034) to each detected event, and the image specifying information and the detection corresponding to the event. The position specifying information is recorded in association with the ID.

  The recording table is stored in the storage unit 107. Note that the method for holding the image specifying information and the detected position specifying information is not limited to this method, and any method that can extract the image specifying information and the detected position specifying information corresponding to the detection event in each layer may be used. .

  Next, evaluation information provision will be described. The evaluation information addition means that evaluation information is added to a past human body detection event recorded in the recording table. FIG. 4 shows a user interface 401 that functions as the evaluation information adding unit 105. The user interface 401 sequentially presents image specifying information and detection position specifying information corresponding to past human body detection events recorded in the recording table to the user. The user interface 401 provides the user with an ID 402 of the human body detection event and an input image 403 in which a rectangle indicating the human body detection position acquired using the detection position specifying information is superimposed on the input image acquired using the image specifying information. Presenting. The size of the rectangle is determined by the layer number used when detecting the human body and the size of the matching pattern used in the pattern matching process.

  The user evaluates whether the human body detection result is correct or incorrect based on the presented information, and assigns the evaluation result using the button group 404. In the example of FIG. 4, when the user determines that the human body is correctly detected, “Yes” is selected, and when the user determines that the human body is detected by mistake, “No” is selected. . Further, when it is not possible to make a judgment or when it is desired to skip the judgment, “Skip” is selected. Correct / incorrect information whether the human detection is correct or incorrect is an example of evaluation information. In this way, reception of evaluation information from the user is performed.

  The evaluation information provided by the evaluation information providing unit 105 is not limited to the information described above. For example, evaluation information indicating whether the object needs to be detected may be given. Further, detailed information such as the detected direction of the human body and the type of the detected human body may be given as the evaluation information. Here, the type refers to the property of the detected object, such as male or female, child or adult. In addition, when the detection of a specific object is an error, the cause information of the error may be added as evaluation information.

  Further, the method for providing evaluation information is not particularly limited. For example, the human body detection is performed again on the input image recorded in the recording table by using a human body recognition engine (second detection unit) having higher detection accuracy but higher calculation cost than the human body detection unit 102. Then, assuming that the result of the human body detection is correct data, evaluation information about correctness of detection may be automatically given.

  FIG. 5 is a recording table in which evaluation information is added to the recording table of FIG. In this example, for each detection event, whether the detection result is correct or incorrect is added as evaluation information. In FIG. 5, “correct” indicates that the detection result is correct, “error” indicates that the detection result is incorrect, and “not yet” indicates that neither “correct” nor “false” is assigned. It represents as.

  Note that the method for holding evaluation information is not limited to this method, and any method that can extract evaluation information corresponding to a detection event in each layer may be used.

  In FIG. 5, the statistics of the evaluation information in each layer are recorded in the format (n, p, f). n represents the number of times that a human body detection event has occurred in the layer, similarly to the number of detections shown in FIG. p represents the number to which “positive” evaluation information is assigned among n. f represents the number to which the evaluation information of “false” is given among n. The number of detections obtained by subtracting f from n is referred to as the effective number of detections. However, the number of effective detections may be calculated by any method, for example, p may be used.

  Next, the correspondence table will be described. Specifically, a method for creating a correspondence table from a recording table to which evaluation information is assigned will be described. The correspondence table records a layer for performing human body detection processing. The correspondence table is created by one of the following methods, for example.

-Create a correspondence table only from the layer with the highest number of effective detections-Create a correspondence table from the layers before and after the layer with the highest number of effective detections-The number of effective detections or the number of effective detections per unit time exceeds the threshold Create a correspondence table from layers-Create a correspondence table from a layer whose number of false detections or false detections per unit time is less than or equal to the threshold. However, the creation method of the correspondence table may be any method and is limited to these methods. It is not a thing.

  An example of a correspondence table created based on the recording table of FIG. 5 is shown in FIG. In this example, the effective detection count is defined as n−f, and the correspondence table is created from layers whose n−f is 30 or more. The correspondence table in FIG. 6 indicates that human body detection is performed using layer 2 and layer 3 in the entire area of the input image. This correspondence table is stored in the storage unit 107.

  As described above, the method for creating the correspondence table when the information indicating whether the detection result is correct or incorrect is used as the evaluation information has been described. Similarly, a correspondence table can be created by an arbitrary method even when details such as the direction of the detected object and the type of the detected object are used as the evaluation information, or when the cause information of the detection error is used. . For example, the correspondence table may be created only from the layers in which the number of times that a horizontal man is detected is equal to or greater than a threshold value.

  Next, the procedure of the entire process performed by the human body detection unit 102 will be described with reference to the flowchart of FIG.

  In step S <b> 701, the human body detection unit 102 determines whether to continue the process. When it is determined that the process is to be continued (S701; YES), the process proceeds to S702. On the other hand, when it is determined that the process is to be terminated (S701; NO), the process is terminated.

  In step S <b> 702, the human body detection unit 102 acquires the correspondence table illustrated in FIG. 6 from the storage unit 107. In step S <b> 703, the human body detection unit 102 acquires the layer 0 (L0) image acquired from the outside by the image acquisition unit 101.

  In step S <b> 704, the human body detection unit 102 determines whether it is necessary to perform human body detection on the layer 0 with reference to the correspondence table. If it is determined that it is necessary to perform human body detection on layer 0 (S704; YES), the process proceeds to S705. On the other hand, if it is determined that it is not necessary to perform human body detection on layer 0 (S704; NO), the process proceeds to S706. In step S <b> 705, the human body detection unit 102 performs human body detection processing on the entire region of layer 0.

  S706 to S709 are loop processes for performing human body detection for each layer from layer 1 to layer N. Initially, n = 1, and n increases by 1 each time the loop is repeated. When the process when n = N is completed, the loop process ends, and the process proceeds to S710.

  In step S <b> 706, the human body detection unit 102 determines whether or not at least one layer that needs to perform human body detection exists in the layers after layer n with reference to the correspondence table. If it is determined that there is even one layer that needs to be detected (S706; YES), the process proceeds to S707. On the other hand, if it is determined that there is no layer that needs to be detected (S706; NO), the process goes out of the loop and proceeds to S710. For example, if n = 1 and the correspondence table is {L2, L3}, the process of S706 is determined as Yes, and the process proceeds to S707.

  In step S <b> 707, the human body detection unit 102 reduces the layer (n−1) and generates a layer n. In step S <b> 708, the human body detection unit 102 determines whether it is necessary to perform human body detection on the layer n with reference to the correspondence table. If it is determined that it is necessary to perform human body detection on layer n (S708; YES), the process proceeds to S709. On the other hand, if it is determined that it is not necessary to perform human body detection on layer n (S708; NO), S709 is skipped and the next loop is entered. For example, if n = 1 and the correspondence table is {L2, L3}, the process of S708 is determined No, skips S709, enters the next loop, and proceeds to S706.

  In step S <b> 709, the human body detection unit 102 performs human body detection processing on the entire region of layer n. In step S <b> 710, the human body detection unit 102 performs integration processing of human body detection results in each layer. The integration process is a process of converting the position and size of the human body in the original image based on the position and size of the human body detection result in each layer. Thereafter, the process returns to S701. Thus, the processes in the flowchart of FIG. 7 are completed.

  Next, with reference to the flowchart of FIG. 8, the processing procedure in the human body detection processing subroutines S705 and S709 for one layer in FIG. 7 will be described. In step S <b> 801, the human body detection unit 102 determines whether to continue the scanning process. If it is determined that the scan process is to be continued (S801; YES), the process proceeds to S802. On the other hand, when it is determined that the scanning process is to be terminated (S801; NO), the process is terminated. Here, when the scan using the human body collation pattern in the target layer image is completed at all positions in the image, the scan process ends.

  In step S <b> 802, the human body detection unit 102 performs a human body detection process using the human body matching pattern stored in the storage unit 107, and outputs the position and size at which the human body is detected. In step S <b> 803, the human body detection unit 102 moves the position where the human body detection process using the human body matching pattern is performed by several pixels (pixels) in the raster scan direction of the screen and advances to the next scan position. Thereafter, the process returns to S801. Thus, the processes in the flowchart of FIG. 8 are completed.

  As described above, according to the present embodiment, even when erroneous detection occurs in the specific object detection process, the priority of the layer used for pattern matching is appropriately determined, and high-speed specific object detection can be performed. .

Second Embodiment
In the second embodiment, a configuration will be described in which an input image is divided for each region, and a correspondence table is separately set for each region. The configuration of the image processing apparatus and other processing procedures are the same as those in the first embodiment. Below, description is abbreviate | omitted about the part similar to 1st Embodiment, and only a different point from 1st Embodiment is demonstrated.

  FIG. 9 is a diagram illustrating an example in which an input image is divided into regions. In FIG. 9, an image 901 is an input image. The area ID 902 is an ID (1, 1) assigned to the upper left area among the areas obtained by dividing the input image 901 into three vertically and four horizontally. In the example of FIG. 9, region IDs are assigned from the upper left (1, 1) to the lower right (3,4). In FIG. 9, since the captured image has a depth, the human body 903 located in the back area ID (1, 3) is small, and the human body 904 located in the front area ID (3, 1) is imaged large. .

  Here, in the present embodiment, the entire screen is divided at equal intervals to create a region. However, instead of the entire screen, a part of the screen may be allocated as a region. Alternatively, the area may be any shape such as a polygon set by the user instead of a rectangle.

  FIG. 10 is an example of a recording table according to the second embodiment. In the recording table of FIG. 10, image specifying information, detected position specifying information, and evaluation information are recorded separately for each region. For example, for the region R (1, 1) indicated by ID (1, 1), the statistics of the evaluation information at L0 is (n, p, f) = (5, 3, 1). However, detailed information for each detection event such as image specifying information and detection position specifying information is omitted, and the details thereof are the same as those in FIGS.

  FIG. 11 is an example of a correspondence table according to the second embodiment. In this embodiment, a correspondence table is obtained for each region on the screen using the layer setting unit 106. In this example, human body detection is not performed for any layer in the region R (1, 1). Further, human detection is performed on layer 0 and layer 1 in regions R (1, 2) to R (1, 4). In regions R (2, 1) to R (2, 4), human bodies are detected for layer 1 and layer 2. In regions R (3, 1) to R (3,4), human bodies are detected for layer 3 and layer 4.

  Next, the procedure of the entire process performed by the human body detection unit 102 will be described with reference to the flowchart of FIG. Of the processes in FIG. 12, the processes in S1201, S1203, S1207, and S1210 are the same as the processes in S701, S703, S707, and S710 in FIG. In step S <b> 1202, the human body detection unit 102 acquires the correspondence table illustrated in FIG. 11 from the storage unit 107.

  In step S1204, the human body detection unit 102 determines whether there is at least one region in the layer 0 that is to be subjected to human body detection processing with reference to the correspondence table illustrated in FIG. If it is determined that even one area exists (S1204; YES), the process proceeds to 1205. On the other hand, if it is determined that the area does not exist (S1204; NO), the process proceeds to 1206.

  In step S <b> 1205, the human body detection unit 102 performs human body detection processing on layer 0. In step S <b> 1206, the human body detection unit 102 determines whether there is at least one region that needs to be subjected to human body detection processing in layers after layer n with reference to the correspondence table. If it is determined that there is at least one (S1206; YES), the process proceeds to S1207. On the other hand, if it is determined that it does not exist (S1206; NO), the process exits the loop and proceeds to S1210.

  In step S1208, the human body detection unit 102 determines whether there is at least one region that needs to be subjected to human body detection processing for the layer n with reference to the correspondence table. If it is determined that there is even one area (S1208; YES), the process proceeds to S1209. On the other hand, if it is determined that there is no area (S1209; NO), the process of S1209 is skipped and the next loop is entered. In step S <b> 1209, the human body detection unit 102 performs human body detection processing on a region where layer n human body detection processing needs to be performed. Thus, the processes in the flowchart of FIG. 12 are completed.

  Next, with reference to the flowchart of FIG. 13, the processing procedure in the human body detection processing subroutines S1205 and S1209 for one layer in FIG. 12 will be described. Of the processes in FIG. 13, the process in S1303 is the same as the process in S802 in FIG.

  In step S1301, the human body detection unit 102 determines whether to end the scan process. If it is determined that the scan process is to be terminated (S1301: YES), the process is terminated. On the other hand, when it is determined to continue the scanning process (S1301; NO), the process proceeds to S1302. Here, the process ends when all the human body detection using the human body matching pattern is completed at all positions in the region where the human body detection process is to be performed on the target layer image.

  In step S1302, the human body detection unit 102 determines whether or not the region to which the scan position in the screen currently being collated belongs (divided region as illustrated in FIG. 9) is a target for human body detection. Judgment is made using a table. If it is determined that the current area is a target for human body detection (S1302; YES), the process proceeds to S1303. On the other hand, if it is not the target of human body detection (S1302; NO), the process proceeds to S1304.

  In step S1304, the human body detection unit 102 performs processing to advance to the next scan position, and returns to step S1301. In the next scan position, if the layer corresponds to the detection target in S1302, the several pixel collation pattern is moved in the raster scan direction of the screen. If the layer does not correspond to the detection target in S1302, the same processing as that performed may be performed, but the next scan position may be advanced to the next divided region position in the raster scan direction. Good. By performing such processing, it is possible to omit the human body detection processing in the same divided region at once. Thus, the processes in the flowchart of FIG. 13 are completed.

  As described above, according to the present embodiment, it is possible to detect a specific object at high speed by dividing a screen into regions and appropriately determining the priority of a layer used for pattern matching for each region.

  According to the present invention, evaluation information is added to a detection record table that holds detection results for each processing layer of a specific object detection unit in a predetermined period in the past, thereby removing erroneous detection results and performing object detection. The layer can be selected appropriately. Therefore, even when a specific object is frequently erroneously detected in a video obtained from a surveillance camera or the like, it is possible to perform object detection processing at high speed.

<Other embodiments>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (10)

Detection means for detecting a specific object from the input image using one or more layers that are images having different resolutions generated by enlarging or reducing the input image;
Image specifying information generating means for generating image specifying information indicating information for specifying an image used for detection of the specific object;
Position specifying information generating means for generating position specifying information indicating information for specifying a detection position of the specific object in the image;
An assigning means for assigning evaluation information to a detection result of the specific object based on the image specifying information and the position specifying information;
Setting means for setting a layer used for detection of the specific object for the input image based on the evaluation information;
An image processing apparatus comprising:   The image specifying information includes at least one of information indicating the image itself used to detect the specific object, frame identifier information of the image, or time information at the time of detection of the specific object. The image processing apparatus according to claim 1.   The position specifying information includes at least one of coordinate information indicating a position where the specific object is detected or image information obtained by superimposing information indicating a position where the specific object is detected on the input image. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The giving means is
Presenting means for presenting the image specifying information and the position specifying information to a user;
Receiving means for receiving the evaluation information from the user,
The image processing apparatus according to claim 1, wherein the evaluation information received from the user is added. A second detection means having higher detection accuracy than the detection means,
The said giving means generates the said evaluation information based on the said image specific information and the said position specific information, and the detection result by the said 2nd detection means, The said evaluation information is provided, The said evaluation information is provided. 4. The image processing device according to any one of items 1 to 3.   The image processing apparatus according to claim 1, wherein the evaluation information includes correct / incorrect information indicating whether a detection result of the specific object is correct.   The image processing apparatus according to claim 1, wherein the evaluation information includes at least one of a direction and a type of the specific object. Further comprising a dividing means for dividing the input image into predetermined regions;
The image processing apparatus according to claim 1, wherein the setting unit sets a layer used for detection of the specific object for each of the divided areas. A control method for an image processing apparatus, comprising: a detecting unit; an image specifying information generating unit; a position specifying information generating unit; an assigning unit; and a setting unit.
A detection step in which the detection means detects a specific object from the input image using layers that are image sets having different resolutions generated by enlarging or reducing the input image;
An image specifying information generating step in which the image specifying information generating means generates image specifying information indicating information for specifying an image used for detecting the specific object;
A position specifying information generating step for generating position specifying information indicating information for specifying a detection position of the specific object in the image;
An assigning step in which the assigning unit assigns evaluation information to the detection result of the specific object based on the image specifying information and the position specifying information;
A setting step in which the setting unit sets a layer used for detection of the specific object for the input image based on the evaluation information;
A control method for an image processing apparatus, comprising:   A program for causing a computer to execute each step of the control method of the image processing apparatus according to claim 9.

Images