JP2006139682A - Video search system, video search method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem of degradation of search speed because the database which is accessed when recording a video is identical with that accessed when searching the video. <P>SOLUTION: In the video search system, video recording device 101 which records a video data acquired from a camera is connected to a video search device for searching and reproducing of the video data recorded in the video recording device through a communication network. The video recording device 101 comprises a metadata transmission means 209 which records the metadata of the video data generated based on the image feature quantity extracted from video data and the attribute information in association with the video data while transmits it to the video search device, and a video data transmission means 211 which transmits the video data that meets a specified video search condition to the video search device based on a transmission request from the video search device. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a video search system, a video search method, and a program capable of recording video acquired from a camera in a video recording device and searching the recorded video data.

  In a video monitoring system that monitors and reproduces video captured by a surveillance camera installed in an arbitrary place in real time, the captured video is generally recorded in a video recording device such as a hard disk recorder. This is to prepare for a situation where a past monitoring video is played back for the purpose of verification or the like. In such a case, a desired video can be quickly searched and played even during video recording. preferable.

  Conventionally, various video search systems for efficiently and accurately searching recorded image data have been proposed. Among them, a feature extraction unit that extracts a predetermined feature amount set from image data, a feature amount set, and the like. A feature descriptor generating unit that generates a feature descriptor from the image, an image information storing unit that stores the image data and the feature descriptor in association with each other, and an attribute list generating unit that generates an attribute list from the attribute information attached to the image data An attribute list accumulating unit for accumulating an attribute list, a user interface unit for selecting an image to be searched from a category or key image of image data to be searched, and a search for performing a search process based on a search condition designated by the interface unit There is an image search system including a processing unit, a searched key image, and a display unit for displaying the search image (for example, a patent Document reference 1).

According to the image search system having the above-described configuration, the search based on the feature descriptor is performed after referring to the attribute list, and then the search based on the feature descriptor is performed. Therefore, the image search process can be performed efficiently.
Japanese Patent Laid-Open No. 2001-167095 (page 5-7, FIG. 1)

  However, in the above conventional image search system, although the search itself can be performed efficiently, a database accessed for recording attribute data at the time of video recording and an access for searching for the recorded video are performed. Since the databases are the same, there is a problem that the search speed is lowered particularly when the processing load on the system is high. For example, when monitoring video recording and monitor playback are executed at the same time, when the system is under heavy load, video recording processing is prioritized to prevent data loss of video data, which reduces the search speed. there were.

  An object of the present invention is to provide a video search system, a video search method, and a program capable of speeding up search processing and improving search efficiency.

  In the video search system of the present invention, a video recording apparatus that records video data acquired from a camera and a video search apparatus that searches and reproduces video data recorded in the video recording apparatus are connected via a communication network. The video recording apparatus records the metadata of video data generated based on the image feature amount extracted from the video data and the attribute information attached to the video data, and at the same time Metadata transmission means for transmitting to the video search device; and video data transmission means for transmitting video data that meets a specified video search condition to the video search device based on a transmission request from the video search device. The video search device includes metadata storage means for recording the metadata received from the video recording device, and designated Video search means for searching for metadata by referring to the metadata storage means based on an image search condition, and transmitting a transmission request for video data meeting the video search condition to the image recording apparatus; and the transmission request And a video data receiving means for receiving the video data transmitted from the video recording apparatus. According to this configuration, the video recording and the search of the recorded video are independently performed by another device, so that the processing load of the video recording device is not increased even if the video search is performed during the recording, Video data search can be performed stably and quickly.

  In the video search system of the present invention, the video recording device includes load information transmission means for transmitting system load information of the video recording device to the video search device, and the video search device is connected to the video recording device. Load information acquisition means for acquiring the system load information, wherein the video search means searches the metadata by the video search means based on the system load information acquired by the load information acquisition means, or The video search condition is transmitted to the video recording device, and it is determined whether to search the metadata with reference to metadata generated and recorded by the video recording device. According to this configuration, only the video search means reduces the search time compared to searching for metadata in the video search device in which metadata related to all connected video recording devices is recorded. Search efficiency can be improved.

  ADVANTAGE OF THE INVENTION According to this invention, in the video search system which records a video and searches the recorded video | video, search of video data can be performed stably and rapidly, and search efficiency can be improved.

  Hereinafter, a video search system according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In all the drawings for explaining the embodiments, the same reference numerals are given to those having the same function, and the explanation will not be repeated.

(Embodiment 1)
First, a video search system that performs video recording and recorded video search independently by another apparatus will be described. FIG. 1 is a diagram showing a system configuration of a video search system according to Embodiment 1 of the present invention. The video search system 100 mainly includes a video recording device 101, a video search device 102, and a communication network 103 that connects the video recording device 101 and the video search device 102. In the figure, an example of a system including three video recording apparatuses (101a to 101c) is shown.

  The video recording apparatus 101 records and reproduces video data acquired from the surveillance camera and metadata of the video data. Simultaneously with the recording of the video data, the metadata of the video data is transmitted to the video search device 102. The video recording apparatus 101 may be a monitoring camera composed only of hardware, or a terminal such as a mobile phone or PDA (Personal Digital Assistant) having a software program execution environment, video data transmission means, and the like. Also good.

  The video search device 102 accumulates the metadata of the video data transmitted from the video recording device 101. When the video search condition is acquired from the user, the video search device 102 searches the video data with reference to the metadata of the accumulated video data. The video recording apparatus 101 is requested to distribute video data that meets the video search conditions. The video search device 102 may be a device constituted only by hardware, or may be an execution environment of a software program.

  The communication network 103 is a network that connects at least one video recording apparatus 101 and the video search apparatus 102. If communication between the video recording apparatus 101 and the video search apparatus 102 is possible, a WAN (Wide Area) is used. Any network such as a network), a LAN (Local Area Network), a wireless network, or a network combining them may be used.

  Next, functions of the video recording device and the video search device that constitute the video search system will be described.

  The video recording apparatus 101 performs real-time recording processing of video data acquired from the surveillance camera, extracts image feature amounts from the video data, and based on the extracted image feature amounts and various video data attribute information attached to the video data. Video metadata is generated, and the generated video metadata is recorded and transmitted to the video search apparatus 102 at the same time. Video data recorded in the video recording apparatus 101 is encoded by an encoding method such as JPEG or MPEG. In addition, when receiving the video data acquisition request from the video search device 102, the video recording device 101 transmits the video data requested to be acquired to the video search device 102.

  The video search device 102 receives the video metadata transmitted from the video recording device 101 and records the received video metadata. Further, when the video search device 102 acquires the video search condition from the user, the video search apparatus 102 searches the video data that matches the search condition with reference to the metadata of the stored video data, and the video data that matches the search condition is found. If it exists, the video recording apparatus 101 is requested to transmit the video data. When the video data requested to be transmitted exists in the video recording apparatus 101, the video data transmitted from the video recording apparatus 101 is received, and the received video data is reproduced in real time.

  Here, the metadata will be described. “Metadata” generally means data of data, and here refers to data describing various attribute information and image feature quantities associated with image data. The “metadata” is data that is separated and independent from the “video data”. In the present embodiment, according to a data description language similar to XML (eXtensible Marking Language) or a multimedia description specification such as MPEG7, a file name (identifier), an image size, a recording start time, a recording end time, etc. of video data are set. Describe as metadata.

  Hereinafter, metadata of video data is referred to as “video metadata”. Similarly to video data having metadata, a video file composed of a plurality of video data also has metadata. Therefore, the metadata of the video file is referred to as “video file metadata”.

  Next, the internal configuration of the video recording apparatus will be described.

  FIG. 2 is a diagram showing an internal configuration of the video recording apparatus of the video search system according to Embodiment 1 of the present invention. The video recording apparatus 101 encodes the video data acquired from the video data input unit 202, the video data input unit 202 that holds the video data captured by the monitoring camera 201 in the image memory, and the video data input unit 202 At the same time, video data encoding means 203 for outputting various video data attribute information at the time of encoding processing, and arbitrary image feature amount extraction processing are performed on the video data held in the video data input means 202 to obtain image characteristics. A feature amount extracting unit 204 for extracting a quantity, and an image feature amount extracted by the feature amount extracting unit 204 and various video data attribute information at the time of the encoding process output from the video data encoding unit 203 are shaped into metadata. The metadata generation means 205, video data and metadata recording processing and search processing, and Data management means 206 for performing file management processing, image information storage means 207 for recording the video data encoded by the video data encoding means 203 and video data attribute information associated with the video data in association with each other, metadata From the metadata storage unit 208 that stores the metadata generated by the generation unit 205, the metadata transmission unit 209 that transmits the metadata generated by the metadata generation unit 205 to the video search device 102, and the video search device 102 A video data acquisition unit 210 that instructs the data management unit 206 to acquire the video data requested to be transmitted, a video data transmission unit 211 that transmits the video data to the video search device 102, and a video search Communication control means 212 for controlling communication with the apparatus 102, and a metadata sender And packet data 209 and video data transmission means 211 is output, a communication unit 213 for sending a communication control packet data to the network, in constructed.

  Next, the internal configuration of the video search device will be described.

  FIG. 3 is a diagram showing an internal configuration of the video search device of the video search system according to Embodiment 1 of the present invention. The video search device 102 performs mutual communication with the video recording device 101, communication means 301 that receives image data and metadata transmitted by the video recording device 101, and metadata that receives metadata from the communication means 301. Receiving means 302, metadata managing means 303 for performing metadata recording processing and search processing, metadata storing means 304 for storing metadata, and data input interface means 305 for acquiring video search conditions input by the user. A video search unit 306 that performs metadata search based on the video search condition acquired in the data input interface unit 305 and requests the image recording apparatus 101 to transmit video data that meets the video search condition, and a communication unit 301. Video data receiving means 307 for receiving video data, and video The video data is obtained from the video data receiving means 307, the video data decoding means 308 for decoding the video data, and the video data decoded from the video data decoding means 308 are received, and the video display processing is performed. The video output unit 309 and the communication control unit 310 that performs communication control between the video recording apparatus 101 are configured.

  Next, operations of the video recording apparatus and video search apparatus having the above-described configurations will be described.

  First, video data recording processing, metadata generation processing, and video data transmission processing executed by the video recording apparatus will be described.

  FIG. 4 is a flowchart showing a video data recording processing procedure of the video recording apparatus in the video search system according to Embodiment 1 of the present invention. In the video data recording process, video data output from the monitoring camera 201 is acquired by the video data input unit 202 and recorded in the image information storage unit 207 via the data management unit 206.

  First, video data output at a predetermined frame rate from the monitoring camera 201 is input to the video data input unit 202 (step S401). The video data input unit 202 has a double buffer type image memory, and the video data encoding unit 203 can access the image data captured in the image memory.

  Next, the video data encoding unit 203 acquires the video data held in the video data input unit 202, and performs encoding processing on the image data (step S402). As an encoding method of video data, any encoding method such as intra-frame compression such as JPEG or inter-frame compression such as MPEG may be used.

  Next, the video data encoding unit 203 outputs the encoded video data and various types of video data attribute information at the time of executing the encoding process to the data management unit 206 (step S403). Here, the video data attribute information refers to arbitrary information related to the encoding process, such as the data length of one frame of video data and the time when the encoding process was performed.

  The data management unit 206 associates the video data encoded by the video data encoding unit 203 and the attribute information associated with the video data and stores them in the image information storage unit 207 (step S404). Then, it is determined whether or not a predetermined end condition is satisfied (step S405). If the end condition is not satisfied, the process returns to step S401 and the above procedure is repeated. On the other hand, when the end condition is satisfied, the video recording process is ended. The video data recording process in the video recording apparatus is executed by the above procedure.

  Next, FIG. 5 is a flowchart showing the metadata generation processing procedure of the video recording apparatus in the video search system according to Embodiment 1 of the present invention. In the metadata generation process, metadata is generated from the image feature amount extracted by the feature amount extraction unit 204 and the video data attribute information output from the video data encoding unit 203 and recorded in the metadata storage unit 208. Further, the generated metadata is transmitted to the video search apparatus 102 at the same time.

  First, the video recording apparatus 101 executes a metadata transmission start procedure (step S501). When information indicating that recording of video data is started from outside is input, the data management unit 206 includes data indicating identification information of the device and data indicating identification information of the video file to the video search device 102. Send metadata transmission start information. When receiving the metadata transmission start information from the video recording apparatus 101, the video search apparatus 102 performs a metadata reception preparation process based on the received metadata transmission start information, and when the metadata reception preparation process is completed, A metadata reception preparation completion notification is transmitted to the video recording apparatus 101 (details of the operation of the video search apparatus 102 will be described later). Upon receiving the metadata reception preparation completion notification transmitted from the video search device 102, the data management unit 206 starts a metadata generation process.

  Next, the feature amount extraction unit 204 extracts an image feature amount from the video data held in the video data input unit 202, and outputs the extracted image feature amount to the metadata generation unit 205 (step S502). As an example of feature amount extraction, there is color information of an object to be imaged and movement information thereof. Regarding the color information extraction, after converting the video data into the RGB color space, R (red), G (green), and B (blue) component values indicating the area corresponding to the object to be imaged are extracted. For example, creating a histogram of each extracted R, G, and B component can be considered. In addition, regarding the extraction of motion information, only the motion vectors included in the region corresponding to the object to be imaged are extracted, and the average value for the extracted motion vectors for each horizontal / vertical direction is obtained. This can be considered as an example.

  Next, the video data encoding unit 203 outputs various video data attribute information during the encoding process to the metadata generation unit 205 (step S503). Here, the video data attribute information indicates arbitrary information related to the encoding process, such as the image size (width, height) and the time when the encoding process is executed.

  Next, the metadata generation unit 205 generates metadata corresponding to the video data based on the image feature amount extracted in step S502 and the video data attribute information acquired in step S503, and the generated video metadata. Is output to the data management means 206 (step S504). The video metadata describes information related to the video data, for example, color information and motion information of the object to be imaged, the encoding time of the video data, the identification number of the surveillance camera that has captured the video data, and the like. FIG. 6 is a diagram illustrating an example of items described as video metadata.

  Next, the data management unit 206 stores the video metadata output from the metadata generation unit 205 in the metadata storage unit 208 (step S505). Further, the data management unit 206 generates video management information including data indicating the identification information of the own device and data indicating the recording order of the video data, and searches the video through the metadata transmission unit 209 together with the video metadata. It transmits to the apparatus 102 (step S506).

  After the transmission of the video metadata, the data management unit 206 determines whether or not the metadata generation can be ended based on a predetermined end determination condition (step S507). Here, the end determination condition is a condition related to the number of video metadata transmissions. For example, when the number of transmitted video metadata exceeds a predetermined value, it is determined that the metadata generation is finished. If it is determined that the metadata generation is to end, the process proceeds to the next process for generating the video file metadata. On the other hand, if it is determined not to end the metadata generation, the process returns to step S502 and the same procedure as described above is repeated.

  When the generation of the metadata is completed, the metadata generation unit 205 generates video file metadata based on the information about the video metadata generated so far, and outputs the generated video file metadata to the data management unit 206 ( Step S508). The video file metadata describes information about the video file, for example, recording start time and recording end time, frame rate, number of recording frames, and the like. FIG. 7 is a diagram illustrating an example of items described as video file metadata.

  The data management unit 206 stores the video file metadata output from the metadata generation unit 205 in the metadata storage unit 208 (step S509). Finally, the data management unit 206 transmits the video file metadata generated in step S508 to the video search device 102 via the metadata transmission unit 209 (step S510). The metadata generation process in the video recording apparatus is executed by the above procedure.

  Next, FIG. 8 is a flowchart showing the video data transmission processing procedure of the video recording apparatus in the video search system according to Embodiment 1 of the present invention. In the video data transmission process, video search information transmitted from the video search device 102 is received, video data is searched based on the video search information, and video data that meets the search conditions is transmitted to the video search device 102.

  First, the video recording apparatus 101 executes a video data transmission start procedure (step S601). When the search condition is input, the video search device 102 searches for video data using the metadata stored in the device, and if video data matching the search condition is searched, the video search device 102 Transmission start information for transmitting video data is transmitted to the recording apparatus 101 (details of the operation of the video search apparatus 102 will be described later). The video data acquisition unit 210 of the video recording device 101 receives the transmission start information transmitted from the video search device 102. Here, the transmission start information is information related to the video data requested to be transmitted, and includes, for example, data indicating the identification information of the video file, data indicating the identification information of the first video data, the number of video data to be transmitted, and the like. It is.

  Next, the video data acquisition unit 210 analyzes the received transmission start information and confirms the video data requested by the video search device 102 (step S602). Further, the video data acquisition unit 210 instructs the data management unit 206 to confirm the presence of the video data requested to be transmitted by the video search device 102. In response to the instruction from the video data acquisition unit 210, the data management unit 206 searches the video data stored in the image information storage unit 207 and confirms the presence of the video data (step S603). As a result of confirmation in the data management means 206, when it is determined that video data exists, a transmission start normal response is transmitted to the video search device 102, and the process proceeds to the corresponding video data reading process. On the other hand, if it is determined that there is no video data, a transmission start NG response is transmitted to the video search device 102, and the video data transmission process is terminated.

  If it is determined that the video data exists, the video data acquisition unit 210 instructs the data management unit 206 to read the video data (step S604). In response to an instruction from the video data acquisition unit 210, the data management unit 206 reads the video data from the video data stored in the image information storage unit 207 and writes it to the image memory included in the video data transmission unit 211. Next, the video data transmission unit 211 transmits the video data written in the image memory to the video search device 102 (step S605).

  Finally, the video data acquisition unit 210 determines whether video data transmission can be ended based on a predetermined end determination condition (step S606). Here, the end determination condition is a condition related to the number of video data transmissions. For example, when the number of transmitted video data exceeds a predetermined value, it is determined that video data transmission is finished. If it is determined not to end the video data transmission, the process returns to step S604 and the above procedure is repeated. On the other hand, when it is determined that the video data transmission is to be terminated, the video data transmission process is terminated. The video data transmission process in the video recording apparatus is executed by the above procedure.

  Next, metadata reception processing and video data search / playback processing executed by the video search device will be described.

  FIG. 9 is a flowchart showing the metadata reception processing procedure of the video search apparatus in the video search system according to Embodiment 1 of the present invention. In the metadata reception process, metadata received from the video recording apparatus 101 is received by the metadata receiving unit 302 and stored in the metadata storage unit 304.

  First, the video search apparatus 102 executes a metadata reception start procedure (step S701). The metadata reception unit 302 receives metadata transmission start information transmitted from the video recording apparatus 101 and outputs the received metadata transmission start information to the metadata management unit 303. When the metadata management unit 303 receives the metadata transmission start information from the metadata reception unit 302, the metadata management unit 303 performs reception preparation processing for receiving the video file metadata and the video metadata based on the metadata transmission start information. Here, the reception preparation process includes preparation for storing video file metadata and video metadata in the metadata storage unit 304. When the metadata reception preparation process is completed, the metadata management unit 303 transmits a metadata preparation completion notification to the transmission source video recording apparatus 101.

  Next, the metadata receiving unit 302 receives the video metadata transmitted from the video recording apparatus 101, and outputs the received video metadata to the metadata management unit 303 (step S702). The metadata management unit 303 stores the video metadata output from the metadata reception unit 302 in the metadata storage unit 304 (step S703).

  Further, the metadata management unit 303 determines whether or not the video metadata reception can be ended based on a predetermined end determination condition (step S704). Here, the end determination condition is a condition related to video metadata reception. For example, when the number of received video metadata exceeds a predetermined value, it is determined that the metadata reception is finished. If it is determined that the metadata reception is to end, the process proceeds to the next process of receiving the video file metadata. On the other hand, if it is determined not to end the video metadata reception, the process returns to step S702 and the above procedure is repeated.

  If it is determined that the metadata reception is to be terminated, the metadata reception unit 302 receives the video file metadata transmitted from the video recording apparatus 101 next, and outputs the received video file metadata to the metadata management unit 303. (Step S705). Finally, the metadata management unit 303 stores the video file metadata output from the metadata receiving unit 302 in the metadata storage unit 304 (step S706). When recording video file metadata, link information to the video metadata of the video data located at the head of the video file is also recorded. The metadata reception process in the video search device is executed by the above procedure.

  Next, FIG. 10 is a flowchart showing the video data search / playback processing procedure of the video search device in the video search system according to Embodiment 1 of the present invention. In the video data search process, video metadata that matches the video search information presented by the user is searched, and the video recording apparatus 101 is requested to transmit video data that matches the video search conditions. Also, video data transmitted from the video recording apparatus 101 is reproduced.

  First, the data input interface unit 305 acquires video search information for video data search input by the user, and outputs the acquired information to the video search unit 306 (step S801). As video search information, information described in metadata, for example, video recording time, video recording location conditions, and the like are set.

  Next, the video search unit 306 requests the metadata management unit 303 to search for video file metadata and video metadata that match the video search information (step S802). In response to the metadata search request from the video search unit 306, the metadata management unit 303 first searches all video file metadata stored in the metadata storage unit 304, and the video search acquired in step S801. Select video file metadata that matches the information. In the video file metadata, link information to the video metadata of the video data located at the beginning of the video file is described. By referring to this, the video metadata is traced in order and the search condition is set. If the matching video metadata can be searched, the video metadata is stored in the metadata management means 303.

  Next, the video search unit 306 creates transmission start information based on the video file metadata and video metadata searched by the metadata management unit 303 and transmits the created transmission start information to the video recording apparatus 101 ( Step S803). The transmission destination video recording apparatus determines based on the video management information recorded in association with the video file metadata.

  Next, the video search unit 306 determines a response to the transmission start information transmitted to the video recording apparatus 101 (step S804). If the response is normal, the video search unit 306 proceeds to video data reception processing. On the other hand, in the case of an NG response, the video data search process is terminated.

  In the case of a normal response, the video data receiving unit 307 receives the video data transmitted from the video recording device 101 and outputs the received video data to the video data decoding unit 308 (step S805). Further, the video data decoding unit 308 decodes the video data acquired from the video data receiving unit 307, and the decoded video data is output to the video output unit 309 (step S806). The video data search / playback process in the video search device is executed by the above procedure.

  As described above, according to the video search system of Embodiment 1 of the present invention, the video recording apparatus that records video data and transmits the metadata of the video data at the same time, and the metadata transmitted from the video recording apparatus are referred to. And a video recording device for searching video data, and by independently executing video recording and recorded video search on different devices, the video recording device can perform video search during recording. The video data can be searched quickly without increasing the processing load.

(Embodiment 2)
Next, a video search system will be described in which video recording and recorded video search are independently performed by another device only when the processing load of the video recording device is high. Since the system configuration of the video search system is the same as that of Embodiment 1 (see FIG. 1), description thereof is omitted.

  Next, the internal configuration of the video recording apparatus will be described.

  FIG. 11 is a diagram showing the internal configuration of the video recording apparatus of the video search system according to Embodiment 2 of the present invention. Compared with the video recording apparatus 101 (see FIG. 2) of the first embodiment, the video recording apparatus 103 refers to the metadata storage means 208 in the video recording apparatus 103 and searches for video data 214. And load information transmission means 215 for transmitting the system load information of the own apparatus (video recording apparatus 103) in response to an inquiry from the video search apparatus. Since other configurations are the same as those of the first embodiment, description thereof is omitted.

  Next, the internal configuration of the video search device will be described.

  FIG. 12 is a diagram showing an internal configuration of the video search device of the video search system according to Embodiment 2 of the present invention. Compared with the video search apparatus 102 (see FIG. 3) of the first embodiment, the video search apparatus 104 inquires the connected video recording apparatus about the current processing load status and acquires system load information. The difference is that 311 is added. The video search unit 306 causes the video recording device 102 to execute the metadata search without performing the metadata search in the video search device 104 depending on the inquiry result of the load information acquisition unit 311. Since other configurations are the same as those of the first embodiment, description thereof is omitted.

  Next, operations of the video recording apparatus and video search apparatus having the above-described configurations will be described.

  First, video data search processing executed by the video recording device when the processing load of the video recording device is low will be described.

  FIG. 13 is a flowchart showing the video data search processing procedure of the video recording apparatus in the video search system according to Embodiment 2 of the present invention. In this video data search process, if it is determined that the search process in the video recording apparatus 103 is possible as a result of the inquiry about the system load information performed by the video search apparatus 104, the metadata search for searching the video is performed. It is executed by the recording device 103.

  When it is determined that the video recording device 103 can perform the search process, the video search unit 306 of the video search device 104 transmits a video data search request to the video recording device 103 (the video search device 104 described above). Details of the operation will be described later).

  When receiving the video data search request from the video search device 104 (step S901), the video data acquisition unit 210 of the video recording device 103 outputs the search request to the video search unit 214. The video search unit 214 instructs the data management unit 206 to search for metadata. In response to the metadata search request from the video search unit 214, the data management unit 206 first searches all video file metadata stored in the metadata storage unit 208 and acquires the video acquired from the video search device 104. Video file metadata that matches the search information is selected (step S902). In the video file metadata, link information to the video metadata of the video data located at the beginning of the video file is described. By referring to this, the video metadata is traced in order and the search condition is set. If the suitable video metadata can be searched, the video metadata is stored in the data management means 206. The video search unit 214 acquires the search result and transmits it to the video search device 104 via the communication unit 213 (step S903). The video data search process in the video recording apparatus is executed by the above procedure. The video playback operation after the search is executed by the video search device 104 that transmitted the search request, and will be described later.

  Next, video data search processing executed by the video search device will be described.

  FIG. 14 is a flowchart showing a video data search processing procedure of the video search device in the video search system according to Embodiment 2 of the present invention. In this video data search process, the level of processing load on the video recording apparatus is grasped, and video data is searched after determining whether the metadata search is performed by the video search apparatus or the video recording apparatus.

  First, the data input interface unit 305 acquires video search information for video data search input by the user, and outputs the acquired information to the video search unit 306 (step S1001). As video search information, information described in metadata, for example, video recording time, video recording location conditions, and the like are set.

  Next, the video search unit 306 causes the load information acquisition unit 311 to query the system load information of the video recording device 103 (step S1002).

  When the load information transmission unit 215 of the video recording apparatus 103 receives an inquiry about the system load information from the video search apparatus 104, the load information transmission means 215 responds and transmits the current system load information of the own apparatus to the video search apparatus 104 in response. The system load information includes information on currently operating tasks, for example, the number of tasks during recording operation, the number of tasks during playback operation, and the like.

  Next, the video search unit 306 determines whether or not to perform a metadata search process in the video recording device 103 based on the system load information acquired from the video recording device 103 by the load information acquisition unit 311 (step S1003). ). When it is determined that the processing load on the video recording device 103 is relatively low and the search processing in the video recording device 103 is possible, the video recording device 103 executes metadata search processing (step S1004). On the other hand, when the video search device 104 determines that the search process should be performed, the video search unit 306 instructs the metadata search process (step S1005).

  When the video recording device 103 performs a search process, the video search unit 306 transmits a video data search request to the video recording device 103. Upon receiving the video data search request from the video search device 104, the video recording device 103 executes a search for video file metadata and video metadata that match the video search information, and transmits the search result to the video search device 104. The video search device 104 receives the search result from the video recording device 103.

  On the other hand, when the video search device 104 performs a search process, the video search unit 306 requests the metadata management unit 303 to search for video file metadata and video metadata that match the video search information. In response to the metadata search request from the video search unit 306, the metadata management unit 303 first searches all video file metadata stored in the metadata storage unit 304, and the video search acquired in step S1001. Select video file metadata that matches the information. In the video file metadata, link information to the video metadata of the video data located at the beginning of the video file is described. By referring to this, the video metadata is traced in order and the search condition is set. If the matching video metadata can be searched, the video metadata is stored in the metadata management means 303.

  Next, the video search unit 306 searches the video file metadata and video metadata searched by the video recording device 104 in step S1004 or the video file metadata searched by the metadata management unit 303 of the video search device 104 in step S1005. Transmission start information is created based on the data and the video metadata, and the created transmission start information is transmitted to the video recording device 103 (step S1006). The destination video recording apparatus determines the video based on the video management information recorded in association with the video file metadata.

  Next, the video search unit 306 determines a response to the transmission start information transmitted to the video recording device 103 (step S1007). If the response is normal, the video search unit 306 proceeds to a video data reception process. On the other hand, in the case of an NG response, the video data search process is terminated.

  In the case of a normal response, the video data receiving unit 307 receives the video data transmitted from the video recording device 103, and outputs the received video data to the video data decoding unit 308 (step S1008). Further, the video data decoding unit 308 decodes the video data acquired from the video data receiving unit 307, and the decoded video data is output to the video output unit 309 (step S1009). The video data search process in the video search device is executed by the above procedure.

  As described above, according to the video search system of the second embodiment of the present invention, the load information acquisition unit collects system load information of the video recording device, and the video recording device has a relatively low processing load. The search time is shortened compared to searching for the metadata storage means in the video search device in which the metadata related to all the video recording devices is recorded only by the video search device. Therefore, the search efficiency can be improved. This is particularly effective in a video search system in which a large number of video recording devices are connected.

  The video search system, video search method, and program of the present invention are capable of stably and quickly executing video data search and improving search efficiency in a video search system for recording video and searching recorded video. This is useful as a video search or the like in which video acquired from a camera is recorded in a video recording device and the recorded video data can be searched.

The figure which shows the system configuration | structure of the video search system in Embodiment 1 of this invention. The figure which shows the internal structure of the video recording apparatus of the video search system in Embodiment 1 of this invention. The figure which shows the internal structure of the video search apparatus of the video search system in Embodiment 1 of this invention. The flowchart which shows the video data recording processing procedure of the video recording apparatus of the video search system in Embodiment 1 of this invention. The flowchart which shows the metadata production | generation procedure of a video recording apparatus of the video search system in Embodiment 1 of this invention. The figure which shows the example of the item described as video metadata The figure which shows the example of the item described as video file metadata The flowchart which shows the video data transmission processing procedure of the video recording apparatus of the video search system in Embodiment 1 of this invention. The flowchart which shows the metadata reception processing procedure of the video search apparatus of the video search system in Embodiment 1 of this invention. The flowchart which shows the video data search / reproduction | regeneration processing procedure of the video search apparatus of the video search system in Embodiment 1 of this invention. The figure which shows the internal structure of the video recording apparatus of the video search system in Embodiment 2 of this invention. The figure which shows the internal structure of the video search apparatus of the video search system in Embodiment 2 of this invention. The flowchart which shows the video data search processing procedure of the video recording apparatus of the video search system in Embodiment 2 of this invention. The flowchart which shows the video data search processing procedure of the video search apparatus of the video search system in Embodiment 2 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Image | video search system 101 Image | video recording device 102 Image | video search device 103 Network 201 Monitoring camera 202 Image | video data input means 203 Image | video data encoding means 204 Feature quantity extraction means 205 Metadata generation means 206 Data management means 207 Image information storage means 208 Metadata Storage means 209 Metadata transmission means 210 Video data acquisition means 211 Video data transmission means 212 Communication control means 213 Communication means 214 Video search means 215 Load information transmission means 301 Communication means 302 Metadata reception means 303 Metadata management means 304 Metadata storage Means 305 Data input interface means 306 Video search means 307 Video data receiving means 308 Video data decoding means 309 Video output means 310 Communication control means 311 Load information acquisition means

Claims (8)

A video search system in which a video recording device for recording video data acquired from a camera and a video search device for searching and playing back video data recorded in the video recording device are connected via a communication network,
Metadata transmission means for recording metadata of video data generated based on image feature values extracted from the video data and attribute information attached to the video data, and simultaneously transmitting the metadata to the video search device;
The video recording device comprising: video data transmission means for transmitting video data that meets a specified video search condition to the video search device based on a transmission request from the video search device;
Metadata storage means for recording the metadata received from the video recording device;
Video search means for performing a metadata search with reference to the metadata storage means based on a specified video search condition, and transmitting a transmission request for video data matching the video search condition to the image recording device;
A video search system comprising the video search device comprising video data receiving means for receiving video data transmitted from the video recording device in response to the transmission request. The video recording device comprises load information transmitting means for transmitting system load information of the video recording device to the video search device,
The video search device comprises load information acquisition means for acquiring the system load information from the video recording device,
The video search means searches the metadata by the video search means based on the system load information acquired by the load information acquisition means, or transmits the video search conditions to the video recording device, The video search system according to claim 1, wherein it is determined whether to search for the metadata with reference to metadata generated and recorded by the video recording apparatus. Video search method in video search system in which video recording device for recording video data acquired from camera and video search device for searching and reproducing video data recorded in video recording device are connected via a communication network Because
A metadata transmission step of recording metadata of video data generated based on an image feature amount extracted from the video data and attribute information attached to the video data, and simultaneously transmitting the metadata to the video search device;
A metadata storage step for recording the metadata received from the video recording device;
A video search step of searching for the metadata based on a specified video search condition, and transmitting a transmission request of video data conforming to the video search condition to the image recording device;
Based on the transmission request, a video data transmission step of transmitting video data that meets the video search condition to the video search device;
And a video data receiving step of receiving video data transmitted from the video recording apparatus in response to the transmission request. A load information transmission step of transmitting system load information of the video recording device to the video search device; and a load information acquisition step of acquiring the system load information from the video recording device;
The video search step searches the metadata in the video search step based on the system load information acquired in the load information acquisition step, or transmits the video search condition to the video recording device, The video search method according to claim 3, wherein it is determined whether to search for the metadata with reference to metadata generated and recorded by the video recording apparatus. Video recording apparatus of video search system in which video recording apparatus for recording video data acquired from camera and video search apparatus for searching and reproducing video data recorded in video recording apparatus are connected via a communication network A program for causing a computer to execute each step in
A metadata transmission step of recording metadata of video data generated based on an image feature amount extracted from the video data and attribute information attached to the video data, and simultaneously transmitting the metadata to the video search device;
A program for causing a computer to execute a video data transmission step of transmitting video data matching a specified video search condition to the video search device based on a transmission request from the video search device.   6. The program according to claim 5, which causes a computer to execute a load information transmission step of transmitting system load information of the video recording device to the video search device. Video search device for video search system in which video recording device for recording video data acquired from camera and video search device for searching and reproducing video data recorded in video recording device are connected via a communication network A program for causing a computer to execute each step in
A metadata storage step for recording the metadata received from the video recording device;
A video search step of searching for the metadata based on a specified video search condition, and transmitting a transmission request of video data matching the video search condition to the image recording device;
A program for causing a computer to execute a video data receiving step of receiving video data transmitted from the video recording apparatus in response to the transmission request. The program according to claim 7, wherein a computer executes a load information acquisition step of acquiring the system load information from the video recording device,
The video search step searches the metadata in the video search step based on the system load information acquired in the load information acquisition step, or transmits the video search condition to the video recording device, A program for determining whether to search for the metadata with reference to metadata generated and recorded by the video recording apparatus.

Images