KR101266755B1 - Color information creation system, color information creation device, color information creation method, and recording medium - Google Patents

Abstract

Even if the color of the object and the color of the background of the object are similar, a color information generation system is provided that generates information enabling color-based retrieval of a photographed image of the object. When the detecting means 200 detects the object, the extracting means 301 performs a process of extracting the object from the color image picked up by the image capturing means 100. The color information generating means 302 generates color information indicating the color according to the extraction result of the extraction means 301, including image capturing date and time information and object type information corresponding to the color image. The color information storage means 303 stores the color information generated by the color information generating means 302. When the extraction means 301 can extract the object, the color information generating means 302 generates color information indicating the color of the object. When the extraction means 301 cannot extract the object, the color information generation means 302 generates color information indicating the color of the background image, which is a color image of a predetermined range prepared in advance.

Description

COLOR INFORMATION CREATION SYSTEM, COLOR INFORMATION CREATION DEVICE, COLOR INFORMATION CREATION METHOD, AND RECORDING MEDIUM}

The present invention provides a computer-readable recording medium having recorded therein a color information generating system, a color information generating apparatus, a color information generating method, and a color information generating program for generating information enabling color-based retrieval of a captured image of an object. It is about.

For crime prevention and other purposes, surveillance cameras are installed in places where an unspecified number of people gather, such as shops, stations, and streets. The image captured by the surveillance camera is monitored in order to respond quickly in the event of an accident or accident, and the images captured and recorded by the surveillance camera may be confirmed in order to solve the incident or accident.

This raises the need to reduce the effort and increase the efficiency of the operation of searching for an image of an object to be searched by a surveillance camera, such as a person, an object, or an animal.

Patent document 1 describes a method of generating a warning when a difference between an image captured by an infrared camera and an image prepared in advance is detected.

Patent document 2 describes the method of detecting a detection object based on the light which passes through an infrared filter in incident light, and the light which passes through a color filter.

Patent document 3 describes a method in which an image of a detection object is picked up by a high-sensitivity color camera when it is detected that an image of the detection object is picked up by an infrared camera.

[Patent Document 1] Japanese Patent Laid-Open No. 2008-27259

[Patent Document 2] Japanese Patent Laid-Open No. 2008-99218

[Patent Document 3] Japanese Patent Laid-Open No. H11-284988

SUMMARY OF THE INVENTION [

In order to reduce the effort and increase the efficiency of the operation of searching for the image of the searched object imaged by the surveillance camera, the imaging of the object is based on the color information indicating the color of the area of the object in the image captured by the surveillance camera. There is a case where an image is retrieved.

In the method described in Patent Document 1 and the method described in Patent Document 2, object detection is performed based on an image captured by an infrared camera. Thus, the color of the object cannot be identified from the captured image, and thus information representing the color of the object cannot be generated. Thus, it is not possible to perform color-based retrieval of the captured image of the object using the image captured by the infrared camera.

In the method described in Patent Document 3, when the color of the object and the color of the background of the object are similar to those in the image photographed by the high-sensitivity color camera, the object cannot be extracted from the image photographed by the high-sensitivity color camera, Accordingly, information representing the color of the object cannot be generated. Therefore, in the method described in Patent Document 3, it is difficult to perform color-based retrieval on the captured image of the object using the image captured by the high-sensitivity color camera.

In this regard, an exemplary object of the present invention is a color information generation system for generating information enabling color-based retrieval of a captured image of an object, even when the color of the object and the color of the background of the object are similar, color information There is provided a computer-readable recording medium on which a generating apparatus, a color information generating method, and a color information generating program are recorded.

Exemplary aspects of the present invention include: image pickup means for imaging an image in a predetermined range and generating image pickup information including color image data and image pickup date and time information indicating an image pickup date and time; Detecting means for detecting an object existing within a predetermined range and generating detection information including object type information indicating the type of the detected object; Extraction means for performing a process of extracting an object in the color image based on the color image data included in the image sensing information generated by the image pickup means when the detecting means detects the object; Color information generating means for generating color information including object type information and image capturing date and time information corresponding to a color image and indicating color according to the extraction result of the extracting means; And color information storage means for storing color information generated by the color information generating means, wherein the color information generating means generates color information indicating the color of the object when the extraction means is capable of extracting the object; The extracting means generates color information indicating the color of the background image when the object cannot be extracted, and the background image is a color information generating system which is a color image of a predetermined range prepared in advance.

An exemplary aspect of the present invention provides a method for detecting an object within a predetermined range, when the detecting means for detecting the object detects the object and generates the detection information including the object type information indicating the type of the detected object. A color image based on the color image data included in the image sensing information generated by the image capturing means for imaging the image and generating image capturing information including color image data and image capturing date and time information indicating the image capturing date and time; Extraction means for performing a process of extracting an object within; Color information generating means for generating color information including object type information and image capturing date and time information corresponding to a color image and indicating color according to the extraction result of the extracting means; And color information storage means for storing color information generated by the color information generating means, wherein the color information generating means generates color information indicating the color of the object when the extraction means is capable of extracting the object; The extracting means generates color information indicating the color of the background image when the object cannot be extracted, and the background image is a color information generating device which is a color image of a predetermined range prepared in advance.

An exemplary aspect of the present invention provides a method for detecting an object within a predetermined range, when the detecting means for detecting the object detects the object and generates the detection information including the object type information indicating the type of the detected object. A color image based on the color image data included in the image sensing information generated by the image capturing means for imaging the image and generating image capturing information including color image data and image capturing date and time information indicating the image capturing date and time; Performing a process of extracting an entity within; When the object is extractable, generating color information including object type information and image capturing date and time information corresponding to the color image and indicating color of the extracted object; If it is impossible to extract the object, generating color information indicating the color of the background image, which includes object type information and image capturing date and time information corresponding to the color image and is a color image of a predetermined range prepared in advance; And storing the generated color information in the color information generating means.

An exemplary aspect of the present invention is a computer readable recording medium having recorded thereon a color information generating program, wherein the color information generating program causes the computer to: detect an object existing within a predetermined range and indicate the type of the detected object. When the detection unit for generating the detection information including the information detects the object, it picks up an image of a predetermined range and generates image pickup information including color image data and image pick-up date and time indicating the image pick-up date and time. An extraction process for performing a process of extracting an object in the color image based on the color image data included in the image pickup information generated by the image pickup unit for the image; When the extraction of the object is possible in the extraction process, generating color information including the object type information and the image capturing date and time information corresponding to the color image and indicating the color of the extracted object, if the extraction of the object is impossible in the extraction process A color information generating process for generating color information indicating the color of a background image, which is a predetermined range of color images, including object type information and image capturing date and time information corresponding to the color image; And a color information storage process for storing the color information generated in the color information generation process in the color information storage means.

According to the present invention, information may be generated that enables color-based retrieval of a photographed image of an object even if the color of the object and the color of the background of the object are similar.

1 is a diagram showing a structural example of an exemplary embodiment of a color information generation system according to the present invention;
2 is a flowchart showing the operation of the color information generation system.
3 is a block diagram showing an overview of the invention.

In the following, an exemplary embodiment of a color information generation system according to the present invention is described with reference to the drawings. 1 is a diagram showing a structural example of an exemplary embodiment of a color information generation system according to the present invention.

As shown in FIG. 1, the color information generation system according to the present invention includes a surveillance camera 10, an object detection sensor 20, and a color information generation device 30. In the example shown in FIG. 1, one surveillance camera 10 and one object detection sensor 20 are connected to the color information generating apparatus 30, but a plurality of surveillance cameras 10 are connected to the color information generating apparatus 30. ) And a plurality of object detection sensors 20 may be connected.

The surveillance camera 10 includes an image pickup unit 11 and a transmission unit 12. The image pickup section 11 picks up an image of a predetermined image pick-up range in order to generate color image data. The transmitting unit 12 generates image information including color image data generated by the image capturing unit 11, and transmits the generated image capturing information to the image information receiving unit in the color information generating apparatus 30 through a communication medium ( 31). For example, the communication medium is a wired communication line such as a Bayonet Neill Concelman (BNC) cable, a telephone line, and an Ethernet (registered trademark) cable, a wireless communication line such as a microwave network and a wireless local area network (LAN), or the Internet.

The image information includes color image data and includes information indicating image capturing details such as a camera number for identifying the surveillance camera 10 for capturing an image and an image capturing date and time. Alternatively, the image information may be information indicating a code for identifying information representing color image data and representing the image capturing details.

The object detecting sensor 20 includes a sensor unit 21, a recognition unit 22, and a transmission unit 23. The measurement range of the sensor unit 21 is an image pickup range of the surveillance camera 10. For example, the sensor unit 21 may be installed according to a near infrared camera, a thermal device, a laser light sensor, a magnetic flux sensor, or an object to be detected (a person, an object, or an animal). ) Sensor. The sensor unit 21 outputs a signal indicating the measurement result, which is a measured physical quantity, to the recognition unit 22. The recognition part 22 detects an object based on the signal output from the sensor part 21, when an object exists in the image imaging range of the surveillance camera 10. As shown in FIG. Upon detection of the object, the recognition unit 22 generates sensor identification information and outputs the sensor identification information to the transmission unit 23.

The sensor identification information is information including information indicating the detection details such as whether the object exists, the type of the object, the detection date and time, and the sensor number for identifying the object detection sensor 20. Alternatively, the sensor identification information may be information indicating a code for identifying information indicating the detection details. For example, when the sensor unit 21 is a heat generating device, the recognition unit 22 may have a shape and size of an area in which heat generated by the object is detected, as indicated by a signal output from the sensor unit 21. The type of the object is determined by identifying whether the object is a person, an object such as a vehicle, or an animal such as a dog. As another example, when the sensor unit 21 is a weight sensor, the recognition unit 22 is the weight of the object represented by the signal output from the sensor unit 21 is not less than the typical vehicle weight, and also the typical vehicle weight and maximum load amount If it is not greater than the sum of the payloads, the type of entity is determined to be a vehicle. As another example, when the sensor unit 21 is a near infrared sensor, the recognition unit 22 continuously receives a signal indicating the reception of the near infrared light by the sensor unit 21 for a predetermined time or longer. 22 determines that there is an object which does not move for a predetermined time or longer within the measurement range, and generates sensor identification information.

The transmitting unit 23 transmits the sensor identification information generated by the recognition unit 22 to the sensor information receiving unit 32 in the color information generating apparatus 30 through a communication medium. Here, when the plurality of monitoring cameras 10 and the plurality of object detection sensors 20 are connected to the color information generating device 30, the plurality of object detection sensors for different respective ones of the plurality of monitoring cameras 10. Since each of 20 is provided, it is assumed that the measurement range of the object detection sensor 20 is the image pickup range of the corresponding monitoring camera 10. In this case, the sensor number of the object detection sensor 20 whose camera number of each surveillance camera 10 and its measurement range are the image capture ranges of the surveillance camera 10 is correlated with each other.

The color information generating apparatus 30 includes an image information receiver 31, a sensor information receiver 32, an analyzer 33, and an object characteristic database 34. The image information receiver 31 receives image information transmitted from the surveillance camera 10. The sensor information receiver 32 receives sensor identification information transmitted from the object detecting sensor 20. The analyzing unit 33 analyzes the image information received by the image information receiving unit 31 and the sensor identification information received by the sensor information receiving unit 32, generates color information indicating the color of the object, and generates the generated color. Information is stored in the object attribute database 34.

The color information is information indicating a color of a predetermined position of the object or a predetermined position of a background image prepared in advance. Alternatively, the color information may be information indicating a code for identifying a color of a predetermined position in the object or a predetermined position in a previously prepared background image. The color information includes information included in the sensor identification information and indicating the type of the object and information included in the image information and indicating the image capturing date and time and the camera number. Note that the color of a predetermined location within an object or a predetermined location within a previously prepared background image may also be referred to simply as the color of the object or background image. The predetermined position in the object is, for example, the position of the center coordinates in the area of the object in the color image based on the color image data. The predetermined position in the background image is a position where the object may exist in the background image picked up with respect to the image pickup range of the image pickup unit 11, for example, when the detection unit 22 detects the object.

According to the setting by the administrator, the date and time indicated by the information provided to the transmission unit 12 of the surveillance camera 10 for generating information indicating the image capture date and time included in the image information generated by the transmission unit 12 is determined. Note that the information provided to the recognition unit 22 of the object detection sensor 20 is synchronized with the date and time indicated to generate information indicating the detection date and time included in the sensor identification information generated by the recognition unit 22. lets do it.

Hereinafter, an operation of the color information generation system shown in FIG. 1 will be described with reference to the drawings. 2 is a flowchart illustrating the operation of the color information generation system.

The image capturing unit 11 of the surveillance camera 10 captures a color image of a predetermined image capturing range, generates color image data, and outputs the generated color image data to the transmission unit 12 (step S101). The transmitting unit 12 generates image information including color image data output from the image capturing unit 11, and transmits the generated image information to the image information receiving unit 31 of the color information generating apparatus 30 ( Step S102). The image information receiving unit 31 of the color information generating apparatus 30 outputs the image information transmitted from the transmitting unit 12 to the analyzing unit 33 in step S102. In addition, the image information receiving unit 31 of the color information generating apparatus 30 stores the image information transmitted from the transmitting unit 12 in step S102 in storage means (not shown).

The sensor unit 21 of the object detecting sensor 20 outputs a signal to the recognition unit 22 according to the measurement result of the image capturing range of the monitoring camera 10 which is the measurement range (step S103). Upon detecting an object present in the detection target region based on the signal output from the sensor unit 21, the recognition unit 22 generates sensor identification information and outputs the generated sensor identification information to the transmission unit 23. (Step S104). The transmitter 23 transmits the sensor identification information to the sensor information receiver 32 of the color information generation device 30 (step S105). The sensor information receiving unit 32 of the color information generating device 30 outputs the sensor identification information transmitted from the transmitting unit 23 to the analyzing unit 33 in step S105. In addition, the sensor information receiving unit 32 of the color information generating apparatus 30 may store the sensor identification information transmitted from the transmitting unit 23 in step S105 in a storage means (not shown). According to this configuration, the image information can be retrieved using the sensor identification information stored in the storage means.

When the sensor identification information is output from the sensor information receiver 32, the analysis unit 33 of the color information generation device 30 performs a process of extracting an object based on the image information output from the image information receiver 31. (Step S106). Specifically, the analysis unit 33 extracts a color image based on the color image data included in the image information, which image information indicates a camera number corresponding to the sensor number indicated by the information included in the sensor identification information. Information; And information indicating an image capturing date and time corresponding to the detection date and time displayed by the information included in the sensor identification information. Further, the analyzing unit 33 extracts an object from the color image as a difference due to the comparison with the color image based on the color image data prepared in advance according to the camera number indicated by the information included in the image information. Note that a color image based on color image data prepared in advance according to the camera number is referred to as a background image, that is, a pre-photographed color image of an image capture range corresponding to the camera number.

When the object is extracted, the analyzer 33 generates color information, the color information including information indicating the type of the object included in the sensor identification information output from the sensor information receiver 32; And information indicating an image capturing date and time included in the image capturing information output from the image information receiving unit 31, and displaying the color of the object extracted from the color image. When the analyzing unit 33 cannot extract the object because, for example, the color of the object and the color of the object background are similar in the color image, the analyzing unit 33 displays color information indicating the color of the background image. Is generated (step S107). The color information may include information indicating a type of an object included in sensor identification information output from the sensor information receiver 32; And information indicating an image capturing date and time included in the image capturing information output from the image information receiving unit 31. That is, when the analysis part 33 cannot extract an object, the analysis part 33 assumes the color of a background image as the color of an object, and produces | generates color information. Note that the analysis unit 33 may generate color information displaying color based on the RGB model, or generate color information displaying color based on the HSV model.

The analyzing unit 33 stores the color information generated in step S107 in the object feature database 34 (step S108). Here, the analysis unit 33 generates color information including information indicating a camera number indicated by the information included in the image information corresponding to the color image that is the object of the object extraction, and generates the generated color information into the object feature database 34. ) Can be stored. In addition, the analyzer 33 may generate color information including information indicating a code for identifying image information, and store the generated color information in the object feature database 34. In addition, the analyzer 33 may generate color information including information indicating a code for identifying sensor identification information, and store the generated color information in the object feature database 34.

According to the present exemplary embodiment, when the object can be extracted from the color image, color information indicating the color of the object may be generated and stored in the object feature database 34. On the other hand, when the object cannot be extracted from the color image, color information indicating the color of the background image of the object may be generated and stored in the object feature database 34. Thus, even when the object cannot be extracted from the color image because the color of the object and the color of the background image of the object are similar in the color image, color information can be generated and stored in the object feature database 34. Therefore, even when the color of the object and the color of the background image of the object are similar in the color image, color information corresponding to the object is extracted from the object feature database 34, and the image capturing date and time included in the extracted color information are displayed. The information can be used to retrieve a captured image of the object. This contributes to labor saving and efficiency improvement in the operation of searching for the captured image of the object using the image captured by the surveillance camera 10.

For example, color information including information indicating the type of search object and indicating the color of the search object is extracted from the color information stored in the object feature database 34. Based on the information indicating the image capturing date and time included in the extracted color information, it is possible to easily extract the photographed image of the object to be searched from the storage means.

Specifically, as an example, based on the information indicating that the characteristic of the criminal according to the criminal witness is "a person dressed in black", for the image of the criminal captured by the surveillance camera 10 installed near the crime scene Suppose a search is performed. In this case, the analyzing unit 33 extracts color information indicating black from the color information stored in the object feature database 34 including information indicating a person as a type of object. Therefore, even when the background image picked up by the surveillance camera 10 is black indexed, it is possible to easily extract the picked-up image of the criminal from the storage means based on the information indicating the date and time of image pick-up included in the color information.

As another example, the image of the lost child captured by the surveillance camera 10 based on information indicating that the characteristic of the lost child according to someone with the child in an amusement park or department store is "a person dressed in blue". Suppose that a search is performed on. In this case, the analyzer 33 extracts color information indicating blue color from among the color information stored in the object feature database 34 including information indicating a person as a type of object. Therefore, even when the background image picked up by the surveillance camera 10 is a blue index, it is possible to easily extract the picked-up image of the lost child from the storage means based on the information indicating the image pick-up date and time included in the color information.

As another example, assume that a search is performed on an image of a white dog taken by the surveillance camera 10 based on information indicating "white dog" according to the owner of the lost dog. In this case, the analyzing unit 33 extracts, from the color information stored in the object feature database 34, color information indicating a white color including information indicating a dog as a type of object. Therefore, even when the background image picked up by the surveillance camera 10 is white in index, the white picked-up images can be easily extracted from the storage means based on the information indicating the date and time of image pick-up included in the color information.

The color information generation system may be connected with a system that performs an alarm operation when an object image of a preset type is imaged. In such a case, when color information including information indicative of a preset type in the system is stored in the object feature database 34, the color information generation system may notify the system that an alert target entity has been detected. Specifically, for example, an object that does not move for a predetermined time or more is detected by the object detecting sensor 20 installed at a station or an airport, and thus, color information including information indicating an object as a type of the object is included. Assume that it is stored in the object feature database 34 for more than a certain time. The color information generation system notifies the system of this. Thus, even if a suspicious item at a station or airport is similar in color to its surroundings, the system may alert that there is a suspicious item.

In addition, the color information generation system is installed in the product manufacturing process, and includes a reading unit for reading information from a Radio Frequency IDentification (RFID) tag, and a system for performing an alarm operation when an object image of a predetermined color is picked up. It can be connected with. In such a case, the system may alert that the color of the photographed image of the product is different from the product color indicated by the information in the RFID tag. Specifically, assume, for example, that a green product is carried on a green conveyor belt during the manufacturing process. In such a case, if the color information indicating green is stored in the object feature database 34 while the information of the RFID tag attached to the product indicates that the product is red, the color information generation system is green. Notify that the color information indicating the is stored in the object feature database 34. As a result, the system can alert that the color of the picked-up image of the product is different from the product color indicated by the information of the RFID tag.

The analyzing unit 33 of the color information generating apparatus 30 may be configured to generate color information including information indicating the type of the object in more detail based on the image information and the sensor identification information. Specifically, for example, when the sensor identification information indicates a person as a type of object, the analyzing unit 33 performs the color and shape of the human area picked up in the color image based on the color image data included in the image information. Based on the above, the upper body and the lower body are extracted. Then, the analysis unit 33 generates color information indicating the color of the upper body and the color of the lower body. Further, the analysis unit 33, based on the color image, color information including object type information indicating that the upper body wore a shirt, and color including object type information indicating that the lower body wore a pair of jeans. Generate information. Such a structure can further improve the accuracy of color based search or the accuracy of object type based search.

Hereinafter, the outline | summary of this invention is demonstrated. 3 is a block diagram illustrating an overview of the present invention. As shown in Fig. 3, the color information generating system according to the present invention comprises an image capturing means 100 (corresponding to the surveillance camera 10 shown in Fig. 1), a detection means 200 (object shown in Fig. 1). Corresponding to the detection sensor 20), and a color information generating apparatus 300 (corresponding to the color information generating apparatus 30 shown in FIG. 1).

The color information generating apparatus 300 includes extraction means 301 (corresponding to analysis unit 33 shown in FIG. 1), color information generating unit 302 (corresponding to analysis unit 33 shown in FIG. 1), And color information storage means 303 (corresponding to the entity feature database 34 shown in FIG. 1).

The image pickup means 100 picks up an image of a predetermined range, and generates image pick-up information including color image data and image pick-up date and time indicating the image pick-up date and time. The detection means 200 detects an entity existing in a predetermined range, and generates detection information including entity type information indicating the type of the detected entity. The extraction means 301 is a process of extracting an object of a color image based on the color image data included in the image sensing information generated by the image capturing means 100 when the detecting means 200 detects the object. Perform The color information generating means 302 includes object type information corresponding to the color image and image capturing date and time information, and generates color information indicating color according to the extraction result of the extraction means 301. The color information storage means 303 stores the color information generated by the color information generating means 302. At this time, when the extraction means 301 can extract the object, the color information generating means 302 generates color information indicating the color of the object. When the extracting means 301 cannot extract the object, the color information generating means 302 generates color information indicating the color of the background image which is a color image of a predetermined range prepared in advance.

According to this structure, even when the color of the object and the color of the object background are similar, information that enables color-based retrieval of the captured image of the object can be generated.

Further, in the above exemplary embodiment, a color information generation system defined in each of the following (1) to (4) is disclosed.

(1) As the color information generating system, the color information generating means 302 generates color information indicating the color of the predetermined position of the object extracted by the extraction means 301 or the predetermined position of the background image.

(2) A color information generation system, wherein when detecting an object, the detection means 200 generates detection information including detection date and time information indicating the date and time at which the object was detected, and the extraction means 301 is included in the detection information. A process of extracting an object of the color image based on the color image data included in the image capturing information including the image capturing date and time information indicating the image capturing date and time corresponding to the date and time indicated by the detected date and time information is performed.

(3) A color information generating system comprising: a plurality of image pickup means 100, and a plurality of detection means each having a detection range corresponding to an image pickup range of different image pickup means among the plurality of image pickup means 100 ( 200, wherein each of the plurality of image capturing means 100 generates image capturing information including a camera number identifying the image capturing means, and the detecting means of the plurality of detecting means 200 detects an object. The extracting means 301 performs a process of extracting an object of a color image based on the color image data generated by the image capturing means 100 which captures an image of the detection range of the detecting means 200, The information generating means 302 applies to the image capturing information including color image data corresponding to the color image in which the extracting means 301 performs the process of extracting the object. Generates color information including the included camera number.

(4) A color information generating system, comprising image sensing information storage means for storing image sensing information generated by the image sensing means 100.

Some or all of the above exemplary embodiments may be described as in the following appendix, but is not limited thereto.

(Supplementary Note 1) The color information generating system includes: image pickup means for picking up an image of a predetermined range and generating image pick-up information including color image data and image pick-up date and time information indicating an image pick-up date and time; Detecting means for detecting an object existing in a predetermined range and generating detection information including object type information indicating the type of detected object; Extraction means for performing a process of extracting an object of a color image based on color image data included in the image sensing information generated by the image pickup means, when the detecting means detects the object; Color information generating means including object type information corresponding to the color image and image capturing date and time information, and generating color information indicating color according to the extraction result of the extracting means; And color information storing means for storing color information generated by the color information generating means, wherein the color information generating means generates color information indicating the color of the object when the extracting means can extract the object; When the extraction means cannot extract the object, it generates color information indicating the color of the background image, the background image being a color image of a predetermined range prepared in advance.

(Supplementary Note 2) The color information generating system according to Supplementary Note 1, wherein the color information generating means generates color information indicating the color of the predetermined position of the object extracted by the extraction means or the predetermined position of the background image.

(Supplementary Note 3) The color information generating system according to Supplementary Note 1 or 2, wherein when detecting an object, the detection means generates detection information including detection date and time information indicating a date and time when the object is detected, and the extraction means is included in the detection information. A process of extracting an object of a color image based on color image data included in the image capturing information including the image capturing date and time information indicating the image capturing date and time corresponding to the date and time indicated by the detected detection date and time information is performed.

(Supplementary Note 4) The color information generating system according to any one of Supplementary Notes 1 to 3, comprising: a plurality of image pickup means; And a plurality of detection means each having a detection range corresponding to the image pickup range of the different image pickup means among the plurality of image pickup means, each of the plurality of image pickup means including a camera number identifying the image pickup means. In the case where the image pickup information is generated and the detection means detects an object among the plurality of detection means, the extraction means is a color image based on the color image data generated by the image pickup means for imaging the image of the detection range of the detection means. And a color information generating means, wherein the color information generating means comprises color information including a camera number included in the image sensing information including color image data corresponding to the color image in which the extracting means performs the process of extracting the object. Create

(Supplementary Note 5) The color information generating system according to any one of Supplementary Notes 1 to 4, comprising image sensing information storage means for storing image sensing information generated by the image sensing means.

(Supplementary note 6) When the detecting means for detecting the object detects the object, the color information generating device detects the object existing in the predetermined range and includes the object type information indicating the type of the detected object. In the color image based on the color image data included in the image sensing information generated by the image capturing means for capturing an image of a range and generating image capturing information including color image data and image capturing date information indicating an image capturing date and time. Extraction means for performing a process of extracting the object; Color information generating means for generating color information including the image capturing date and time information corresponding to the color image and the object type information and indicating color according to the extraction result of the extracting means; And color information storage means for storing the color information generated by the color information generating means, wherein the color information generating means, when the extraction means can extract the object, selects the color of the object. Generating color information, and when the extraction means cannot extract the object, generates color information indicating the color of the background image, which is a color image of the predetermined range prepared in advance.

(Supplementary note 7) The color information generating apparatus according to supplementary note 6, wherein the color information generating means includes color information indicating a color of a predetermined position in the object extracted by the extraction means or a predetermined position in the background image. Create

(Supplementary Note 8) The method for generating color information includes detecting the object when the detecting means for detecting the object existing in the predetermined range and generating the detection information including the object type information indicating the type of the detected object detects the object. In the color image based on the color image data included in the image sensing information generated by the image capturing means for capturing an image of a range and generating image capturing information including color image data and image capturing date information indicating an image capturing date and time. Performing a process of extracting the object; If the object can be extracted, generating color information indicating the color of the extracted object and including the image capturing date and time information and the object type information corresponding to the color image; If the object cannot be extracted, color information indicating the color of the background image, which is the color image of the predetermined range that is prepared in advance, includes the image capturing date and time information and the object type information corresponding to the color image. Making; And storing the generated color information in color information storage means.

(Supplementary Note 9) As the color information generating method according to Supplementary Note 8, when generating the color information, color information indicating a color of a predetermined position in the extracted object or a predetermined position in the background image is generated.

(Appendix 10) A computer readable recording medium having recorded therein a color information generating program, wherein the color information generating program causes the computer to detect an object existing in a predetermined range and includes object type information indicating the type of the detected object. When the detecting means for generating the detection information detects an object, the image pickup means for picking up the image of the predetermined range and generating image pick-up information including color image data and image pick-up date and time indicating the image pick-up date and time. An extraction process for performing a process of extracting the object from a color image based on color image data included in the image sensing information generated by the image; If the object can be extracted in the extraction process, the color information including the image capturing date and time information and the object type information corresponding to the color image is generated, and the color information representing the color of the extracted object is generated. If it cannot be extracted in the extraction process, the color information indicating the color of the background image, which is the color image of the predetermined range that is prepared in advance, includes the image capturing date and time information and the object type information corresponding to the color image. Generating color information process; And a color information storing process for storing the color information generated in the color information generating process in color information storing means.

(Appendix 11) A computer-readable recording medium according to appendix 10, wherein the color information generating program causes the computer to cause a color of a predetermined position in the object or a predetermined position in the background image extracted in the extraction process. To generate color information.

Although the present invention has been described with reference to the above-described exemplary embodiments and examples, the present invention is not limited to the above-described exemplary embodiments and examples. Various modifications that can be understood by those skilled in the art can be made within the scope of the present invention with respect to the structure and details of the present invention.

This application claims priority based on Japanese Patent Application No. 2010-155084 for which it applied on July 7, 2010. As for the indication of this Japanese patent application, the whole is integrated in this specification.

[Industrial applicability]

The present invention is applicable to a system for performing color-based searching on a captured image of a searched object.

10: security camera
11: Image pickup unit
12: transmission unit
20: object detection sensor
21: sensor
22: recognition unit
23: transmission unit
30: color information generating device
31: image information receiving unit
32: sensor information receiver
33: analysis unit
34: Object Attribute Database
100: image pickup means
200: detection means
300: color information generating device
301: extraction means
302: color information generating means
303: color information storage means

Claims (10)

As a color information generation system,
Image pick-up means for picking up an image in a predetermined image pick-up range and generating image pick-up information including color image data and image pick-up date and time indicating the image pick-up date and time;
Detecting means for detecting an object present in the predetermined image capturing range and generating detection information including object type information indicating the type of the detected object;
Extracting means for performing a process of extracting the object from a color image based on the color image data included in the image sensing information generated by the image capturing means when the detecting means detects the object;
Color information generating means for generating color information including the image capturing date and time information corresponding to the color image and the object type information and indicating color of an object or a background image according to the extraction result of the extracting means; And
Color information storage means for storing the color information generated by the color information generating means
/ RTI >
The color information generating means generates color information indicating the color of the object when the extraction means can extract the object, and is prepared in advance when the extraction means cannot extract the object. And color information representing color of a background image that is a color image of the predetermined image capturing range. The method of claim 1,
And the color information generating means generates color information indicating a color of a predetermined position in the object extracted by the extracting means or a predetermined position in the background image. The method according to claim 1 or 2,
When detecting the object, the detecting means generates detection information including detection date and time information indicating a date and time when the object is detected,
The extracting means is based on the color image data included in the image sensing information including image capturing date and time information indicating the image capturing date and time corresponding to the date and time displayed by the detection date and time information included in the detection information. Color information generation system that performs the process of extracting the object from a color image. The method according to claim 1 or 2,
The image pickup means comprises a plurality of image pickup means,
The detection means includes a plurality of detection means each having a detection range corresponding to an image pickup range of a different image pickup means among the plurality of image pickup means,
Each of the plurality of image capturing means generates image capturing information including a camera number for identifying the image capturing means,
When one of the plurality of detecting means detects the object, the extracting means is adapted in a color image based on color image data generated by the image capturing means for imaging the image of the detection range of the detecting means. Performing the process of extracting the object,
The color information generating means includes: color information for generating color information including a camera number included in image capturing information including color image data corresponding to the color image in which the extraction means performs the process of extracting the object. Generating system. The method according to claim 1 or 2,
And color image capturing information storage means for storing the image capturing information generated by the image capturing means. An apparatus for generating color information,
When the detection means for detecting the object existing in the predetermined image capturing range and generating the detection information including the object type information indicating the type of the detected object detects the object, the image of the predetermined image capturing range is detected. The object is extracted from the color image based on the color image data included in the image capturing information generated by the image capturing means which generates the image capturing information including the image capturing date information and the color image data. Extraction means for performing a process of performing;
Color information generating means for generating color information including the image capturing date and time information corresponding to the color image and the object type information and indicating color of an object or a background image according to the extraction result of the extracting means; And
Color information storage means for storing the color information generated by the color information generating means
/ RTI >
The color information generating means generates color information indicating the color of the object when the extraction means can extract the object, and is prepared in advance when the extraction means cannot extract the object. And color information indicating color of a background image which is a color image of the predetermined image capturing range. The method according to claim 6,
And the color information generating means generates color information indicating a color of a predetermined position in the object extracted by the extracting means or a predetermined position in the background image. As a method of generating color information,
When the detection means for detecting the object existing in the predetermined image capturing range and generating the detection information including the object type information indicating the type of the detected object detects the object, the image of the predetermined image capturing range is detected. The object is extracted from the color image based on the color image data included in the image capturing information generated by the image capturing means which generates the image capturing information including the image capturing date information and the color image data. Performing a process to make;
If the object can be extracted, generating color information indicating the color of the extracted object and including the image capturing date and time information and the object type information corresponding to the color image;
If the object cannot be extracted, the color information indicating the color of the background image which is the color image of the predetermined image capturing range prepared in advance and including the image capturing date and time information and the object type information corresponding to the color image Generating a; And
Storing the generated color information in color information storage means
Color information generation method comprising a. 9. The method of claim 8,
When generating the color information, color information indicating a color of a predetermined position in the extracted object or a predetermined position in the background image is generated. A computer readable recording medium having recorded therein a color information generating program,
The color information generating program causes the computer to
When the detection means for detecting the object existing in the predetermined image capturing range and generating the detection information including the object type information indicating the type of the detected object detects the object, the image of the predetermined image capturing range is detected. The object is extracted from the color image based on the color image data included in the image capturing information generated by the image capturing means which generates the image capturing information including the image capturing date information and the color image data. An extraction process for performing the process of performing;
If the object can be extracted in the extraction process, the color information including the image capturing date and time information and the object type information corresponding to the color image is generated, and the color information representing the color of the extracted object is generated. If it cannot be extracted in the extraction process, the color representing the color of the background image, which is the color image of the predetermined image capturing range, which is previously prepared, includes the image capturing date information and the object type information corresponding to the color image; Color information generating process for generating information; And
A color information storage process for storing the color information generated in the color information generation process in color information storage means;
And a computer readable recording medium.

Images