WO2012140834A1 - Information processing device - Google Patents

Information processing device Download PDF

Info

Publication number
WO2012140834A1
WO2012140834A1 PCT/JP2012/001806 JP2012001806W WO2012140834A1 WO 2012140834 A1 WO2012140834 A1 WO 2012140834A1 JP 2012001806 W JP2012001806 W JP 2012001806W WO 2012140834 A1 WO2012140834 A1 WO 2012140834A1
Authority
WO
WIPO (PCT)
Prior art keywords
engine
analysis
information
time width
input data
Prior art date
Application number
PCT/JP2012/001806
Other languages
French (fr)
Japanese (ja)
Inventor
小山 和也
恒久 河又
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2013509749A priority Critical patent/JPWO2012140834A1/en
Publication of WO2012140834A1 publication Critical patent/WO2012140834A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Definitions

  • the present invention relates to an information processing apparatus, and more particularly to an information processing apparatus that manages analysis processing performed using an analysis engine.
  • analysis engines that perform analysis processing on various data have been developed.
  • various analysis engines exist such as generating position information for tracing a human flow line from moving image data, specifying a person from still image data, and generating text data from audio data.
  • the analysis engine as described above sets the analysis target as media data such as image data and audio data.
  • analysis processing such as monitoring and search for such media data can be performed by using a related database.
  • a related database Unlike structural data, it is difficult. For example, media data has a large gap with conditions requested by users, and it is difficult to describe conditions and process them.
  • analysis processing such as search for media data may be performed by a method of adding meta information to the media data and performing a search using conditions for the metadata.
  • media data is used as a search condition itself when searching for media data. For example, as shown in Patent Document 1, a search target similar image is searched from a video to be analyzed.
  • each analysis engine has different information such as features used in the analysis process depending on the requirements for the analysis target data. For this reason, in order to respond to various requests, it is necessary to save all input data to the analysis engine and perform analysis processing using necessary input data according to the request. However, if all of the input data is stored so as to correspond to any analysis engine, there arises a problem that the processing load and storage cost according to the request increase.
  • an object of the present invention is to provide an information processing apparatus that improves the versatility of the analysis engine used for the analysis processing, which is the above-described problem, and suppresses the data storage cost.
  • An information processing apparatus An engine information storage unit that stores engine information including time width information that is set in advance for each analysis engine and represents the time width of input data necessary for analysis processing by the analysis engine; An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When, Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine.
  • An accumulation management unit to It has the structure of having.
  • An information processing apparatus An engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine that is set in advance for each analysis engine, An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request.
  • An accumulation rule generating means for setting an accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
  • the program which is the other form of this invention is: An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request
  • Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine.
  • An accumulation management unit to It is a program for realizing.
  • the program which is the other form of this invention is: An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request.
  • An accumulation rule generating means for setting an accumulation rule representing a time width of the input data to hold the input data input to the analysis engine based on the engine information; It is a program for realizing.
  • an information processing method includes: In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine. Input of input data to the analysis engine and acquisition of output data from the analysis engine according to an engine control rule representing a processing procedure using the analysis engine in which the engine control unit can output a result for a predetermined processing request.
  • the accumulation management unit has input data that the engine control unit inputs to the analysis engine in accordance with the engine control rule within a time width range specified by the time width information included in the engine information of the analysis engine. It takes the structure of controlling to hold.
  • an information processing method includes: In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request.
  • An accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
  • the present invention which is configured as described above, can improve the versatility of the analysis engine used for the analysis processing and can suppress the data storage cost.
  • FIG. 1 is a diagram illustrating a configuration of a data management apparatus
  • FIG. 2 is a diagram illustrating an example of engine information
  • FIG. 3 is a diagram illustrating an example of the engine control rule
  • FIG. 4 is a diagram illustrating the operation of the data management device.
  • FIG. 5 is a diagram illustrating another configuration of the data management apparatus.
  • the information processing system includes a plurality of analysis engines 31, 32, 33, an application 4 installed in the information processing apparatus, and data connected to the plurality of analysis engines and the information processing apparatus. And a management device 1.
  • the analysis engines 31, 32, and 33 are information processing apparatuses that perform analysis processing on analysis target data. For example, media data such as moving image data, still image data, and audio data is analyzed as analysis target data. I do. For example, a person extraction engine that extracts a person image showing a person from image data, a face recognition engine that recognizes a person's face from image data or person image data, and a position where human flow lines are traced from image data There is a flow line extraction engine that generates information.
  • the analysis engines 31, 32, and 33 are not limited to those that perform the above-described analysis processing, and the number thereof is not limited to three as shown in FIG.
  • the application 4 is implemented in an information processing apparatus connected to the data management apparatus 1, and has a function of requesting the data management apparatus 1 for an analysis result using the analysis processing by the analysis engines 31, 32, and 33 described above. Have.
  • the processing request requested from the application 4 to the data management apparatus 1 is a monitoring request for searching or monitoring a specific person from video data that is analysis target data, for example.
  • the application 4 acquires the results analyzed by the analysis engines 31, 32, and 33 from the data management device 1 in response to the processing request described above.
  • the data management device 1 is an information processing device including an arithmetic device and a storage device. As shown in FIG. 1, the data management device 1 is constructed by incorporating a program into an arithmetic device, and includes a monitoring request reception unit 11, an engine control unit 12, an engine control rule management unit 13, and an analysis data management unit. 14, an analysis data monitoring unit 15, a similarity determination rule management unit 16, a monitoring result transmission unit 17, a media data management unit 18, and a rule generation unit 20.
  • the rule generation unit 20 includes an engine information management unit 21, an engine control rule generation unit 22, an accumulation rule generation unit 23, and a monitoring rule generation unit 24.
  • each configuration will be described in detail.
  • the engine information management unit 21 stores and manages engine information preset for each analysis engine in a storage device.
  • the engine information includes an input data format (characteristic information) that represents the data format of input data that can be input to the analysis engine, an output data format (characteristic information) that represents the data format of output data that is an analysis result by the analysis engine, and And time width information representing the time width of the input data required for the analysis processing by the analysis engine.
  • the “input data format” is, for example, information indicating the data type of the input data to be analyzed by the analysis engine, and has values such as “video” and “person video” as an example.
  • the “output data type” is information representing the data type of output data which is an analysis result by the analysis engine, for example.
  • the analysis engine analyzes the gender of the person shown in the video data, the value is “gender”, or the person that the analysis engine shows in the video data In the case of analyzing the feature amount of the face, the value is “face feature amount”.
  • time width information is a value that represents the amount of data along the time series of input data necessary for performing analysis processing by the analysis engine.
  • this time width information when the analysis target data is video data, it is “number of frames” or “video time”.
  • Fig. 2 shows an example of engine information.
  • the analysis engine is an “image face recognition engine” for recognizing a human face from image data
  • the input data format is “image”
  • the output data format is “face feature amount”
  • the input data time width is “1 frame”.
  • the analysis engine is a “video face recognition engine” for recognizing a human face from video data
  • the input data format is “human video”
  • the output data format is “face feature value”
  • the input data time width is “3”.
  • the value is “frame”.
  • the analysis engine is a “person extraction engine” that extracts a person from video data
  • the input data format is “video”
  • the output data format is “person video”
  • the input data time width is “5 frames”. Value.
  • the analysis engine is a “flow line extraction engine” that recognizes the flow line of a person from video data
  • the input data format is “human video”
  • the output data format is “human flow line”
  • the input data time width is “ The value is “
  • the engine information described above may include data representing other characteristics of the analysis engine for each analysis engine, and may be information that can be referred to when generating an engine control rule, as will be described later.
  • the engine control rule generation unit 22 (engine control rule generation means) performs an analysis process corresponding to the process request received from the application 4 and outputs a result corresponding to the process request.
  • An engine control rule representing a processing procedure using 32 and 33 is generated.
  • the engine control rule generation unit 22 firstly, from the content of the processing request, necessary input data, output data representing the requested result itself, or output data necessary for deriving the requested result, Is identified. Then, an analysis engine in which the data format of the specified input data and output data is set is selected with reference to the engine information described above.
  • the engine control rule generation unit 22 selects one analysis engine that can input the input data specified from the processing request, and another analysis engine that uses the output data of this one analysis engine as input data. Is selected.
  • the output data from the other analysis engine only needs to be output data required in response to the processing request. If not, the output data from the other analysis engine is further input to the input data.
  • Another analysis engine is selected. Then, a combination of a plurality of analysis engines that can finally obtain output data corresponding to the processing request is selected, and an engine control rule that is a processing procedure connecting these plurality of analysis engines is generated.
  • the monitoring request which is a processing request from the application 4
  • the monitoring request has the content that “if a person with a face similar to the input photo appears in the monitoring video, the action history of that person is notified”.
  • the similarity determination between the face of the person in the monitoring video and the face of the person in the input photograph is performed by the analysis data monitoring unit 15 without using an analysis engine as will be described later.
  • the engine control rule corresponding to the above (A) specifies “image” as the input data format because the input data is “input photograph”, and as the output data format because the output data is “person's face”.
  • the “face feature amount” is specified.
  • the analysis engine in which the input data format and the output data format are set is selected from the engine information as shown in FIG. Thereby, an engine control rule of a processing procedure using the “image face recognition engine” as shown in FIG.
  • the engine control rule corresponding to the above (B) specifies “video” as the input data format because the input data is “monitoring video”.
  • the output data is “person's face” and “person's flow line”
  • two output data formats, “face feature value” and “person flow line” are specified.
  • the analysis engine in which the input data format and the output data format are set is selected from the engine information as shown in FIG. 2, and from the “video” as the input data format to the “face feature value” as the output data format.
  • the engine control rule described above is not necessarily generated by the data management device 1 (engine control rule generation unit 22).
  • An engine control rule that is manually generated in advance may be registered in the data management device 1.
  • the registered engine control rule is selected by the engine control unit 12 and the engine control rule management unit 13 as will be described later, and the process for the analysis engine 3 is performed according to the engine control rule.
  • the accumulation rule generation unit 23 sets an accumulation rule that represents the time width of input data required when each analysis engine described above performs analysis processing. Specifically, the accumulation rule generation unit 23 inputs the time width specified by the time width information set for each analysis engine included in the engine information to the analysis engine set in the engine control rule. Set as time span. At this time, when one input data is input to a plurality of analysis engines based on the engine control rule described above, the accumulation rule generation unit 23 sets each time width set for each analysis engine based on the engine information. Among these, the value of the longest time width is set as the accumulation rule.
  • the analysis engine to be used is one of “image face recognition engine”.
  • “1 frame”, which is the time width set in this analysis engine is set as the accumulation rule.
  • the analysis engine to be used is one of the “person extraction engine”, and therefore, with reference to the engine information of FIG. A certain “5 frames” is set as an accumulation rule.
  • image face recognition engine and “flow line extraction engine”
  • each of these analysis engines is referred to with reference to the engine information of FIG. “10 frames”, which is the maximum value of “3 frames” and “10 frames”, which are the time widths set in FIG.
  • the monitoring rule generation unit 24 generates a rule for outputting a result corresponding to the monitoring request that is a processing request from the application 4 from the data analyzed by the analysis engine. For example, in the case where the monitoring request has the above-described content, “If a person with a face similar to the input photo appears in the monitoring video, the person's action history is notified”, the analysis shown in FIG. A face similar to the “human face in the input photo” that is the analysis processing result shown in FIG. 3A is detected from the “human face in the monitoring video” that is the processing result, and the above-described figure of the detected person A monitoring rule for notifying “person flow line”, which is the analysis processing result shown in FIG.
  • the monitoring request receiving unit 11 receives a monitoring request that is a processing request input from the application 4 and passes it to the rule generating unit 20.
  • the engine control unit 12 and the engine control rule management unit 13 input input data and analysis results to the analysis engines 31, 32, and 33 in accordance with the engine control rules generated by the engine control rule generation unit 22 described above. Is obtained and output to the analysis data management unit 14 or the like.
  • engine control rules are registered in advance, the registered engine control rules are selected, and processing for each analysis engine 3 is performed according to the engine control rules.
  • the analysis data management unit 14 (accumulation management unit) manages input data input to each analysis engine 31, 32, 33 and output output data via the engine control 12 described above.
  • the analysis data management unit 14 inputs the input data input to each analysis engine 31, 32, 33 within the time range set by the accumulation rule generated by the accumulation rule generation unit 23 described above.
  • control is performed so that the data is stored in the storage area installed in the data management device 1.
  • the accumulation of input data will be described with a specific example.
  • the accumulation rule for input data input to the analysis engine is set to “3 frames”.
  • image data d0, d1, d2, and d3 to be input to the analysis engine arrive in the order of times t0, t1, t2, and t3.
  • the analysis processing is executed in three frames of the image data d0, d1, d2 together with the stored image data d0, d1, and the processed image data d2 is Accumulated according to the accumulation rule.
  • the image data d2 is added, the number of accumulated data (the number of frames) reaches “3”, so the old image data d0 is discarded (accumulated data: d1, d2).
  • recognition is performed on the three frames of the image data d1, d2, d3 together with the stored image data d1, d2, and the processed image data d3 is stored. Accumulated by rules.
  • the image data d3 is added, the number of accumulated data (number of frames) reaches “3”, so the old image data d1 is discarded (accumulated data: d2, d3).
  • the analysis data management unit 14 accumulates input data to the analysis engine based on the accumulation rule generated by the accumulation rule generation unit 23, but analyzes the engine information as shown in FIG.
  • the data management unit 14 may directly refer to the information on the time width set for each analysis engine, and the input data may be accumulated as described above based on the time width.
  • the analysis data monitoring unit 15 monitors the output data from each analysis engine 31, 32, 33 in accordance with the monitoring rules generated by the monitoring rule generation unit 24 described above. For example, in the above-described example, a monitoring process is performed in which a face similar to “a person's face in the input photo” is detected from “a person's face in the monitoring video” and a “person flow line” of the detected person is notified. . At this time, the process of detecting a face similar to the “face of the person in the input photo” from the “face of the person in the monitoring video” compares each “face feature amount” output from each analysis engine and determines the similarity. It is determined whether or not they are similar according to a similarity determination rule set in advance in the rule management unit 16, and a face similar to the face of the input photo is detected from the monitoring video.
  • the analysis data monitoring unit 15 outputs a result corresponding to the monitoring request from the application 4 to the monitoring result transmission unit 17. Accordingly, the monitoring result transmission unit 17 transmits the monitoring result output from the analysis data monitoring unit 15 to the application 4.
  • the media data management unit 18 performs management such as inputting a monitoring image to be monitored and an input image input together with a monitoring request from the application 4 to each analysis engine via the engine control unit 12.
  • step S ⁇ b> 1 the data management apparatus 1 receives it at the monitoring request reception unit 11 (step S ⁇ b> 1) and passes it to the rule generation unit 20.
  • the rule generation unit 20 generates an engine control rule that is a processing procedure capable of outputting a result corresponding to the received monitoring request with reference to the engine information in the engine control rule generation unit 22 (step S2). .
  • the accumulation rule generation unit 23 refers to the engine information, and generates an accumulation rule for input data to each analysis engine included in the generated engine control rule (step S3).
  • the monitoring rule generation unit 24 generates a monitoring rule that outputs a monitoring result corresponding to the received monitoring request, using the analysis result of the analysis engine (step S4).
  • the data management apparatus 1 performs analysis processing on the monitoring video according to the engine control rule and the accumulation rule, and performs monitoring processing on the analysis result according to the monitoring rule (step S4). That is, the data management device 1 inputs input data to a specific analysis engine according to the processing procedure represented by the engine control rule, and receives the analysis result. At this time, the data management device 1 controls the amount of input data retained for each analysis engine according to the accumulation rule, and does not retain input data exceeding the range set in the accumulation rule. Then, the monitoring result output by the analysis and monitoring process is output to the application 4.
  • the data management device 1 includes the engine control unit 12, the analysis data management unit 14 and the like, and performs analysis processing and monitoring processing on the monitoring video according to the generated engine control rules, accumulation rules, and the like.
  • Functions for performing analysis processing and management processing, such as the engine control unit 12 and the analysis data management unit 14, may be provided in another information processing apparatus. That is, the data management device 1 may have only the rule generation unit 20 and may be equipped with only a function for generating engine control rules, accumulation rules, and monitoring rules.
  • the application 4 does not need to understand how to use each analysis engine, and can obtain a desired monitoring result only by transmitting a processing request. It is possible to improve the general versatility of the system using and the convenience of the user. At this time, the storage of input data suitable for each analysis engine to be used is realized, so that the data storage cost can be suppressed.
  • the data management device 1 according to the present invention may be configured as shown in FIG.
  • the data management device 1 shown in FIG. 5 includes a monitoring state management unit 19 constructed by reading a program into the equipped arithmetic device, and other configurations are the same as those in the first embodiment.
  • the monitoring state management unit 19 changes the engine control rule, the accumulation rule, and the monitoring rule to be used according to the monitoring result by the analysis data monitoring unit 15. Thereby, the contents to be monitored can be changed according to the change in the status of the monitoring video.
  • the monitoring request is the above-mentioned content “if a person with a face similar to the input photo appears in the monitoring video, the subsequent action history of the person is notified” (1) “person in the input photo”
  • the “person extraction engine” analyzes the “monitoring video” and outputs the “person video”.
  • the “person video” is input to the “video face recognition engine” and the “facial features”
  • An analysis process is performed according to an engine control rule that “amount” is output, and a specific person is detected.
  • the “person image extraction engine” analyzes the “monitoring video” as the second stage and outputs “person video”.
  • the analysis process is performed by changing the engine control rule that “video” is input to “flow line extraction engine” and “human flow line” is output, and the “human flow line” that is the analysis result is notified.
  • the analysis engine to be used is different in accordance with the change of the engine control rule, it is changed to the accumulation rule and the monitoring rule corresponding to each.
  • the present invention can cope with analysis processing expressed by various engine control rules, and can improve versatility.
  • An engine information storage unit 101 that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine;
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request 102, Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine.
  • a storage management unit 103 for An information processing apparatus 100 comprising:
  • (Appendix 2) An information processing apparatus according to attachment 1, wherein When the engine control rule includes a processing procedure in which output data from one analysis engine is input data to another analysis engine, the accumulation management unit outputs the output data from the one analysis engine to the other analysis. As input data of the engine, control is performed so as to be held within the range of the time width specified by the time width information included in the engine information of the other analysis engine. Information processing device.
  • Appendix 3 An information processing apparatus according to appendix 1 or 2,
  • the accumulation management unit when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each time included in each engine information corresponding to each of the plurality of analysis engines. Controlling to hold input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information, Information processing device.
  • Appendix 4 An information processing apparatus according to any one of appendices 1 to 3, Based on the engine information, comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule, The accumulation management unit controls to hold input data to be input to the analysis engine within a time range set by the accumulation rule. Information processing device.
  • An information processing apparatus comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule,
  • the accumulation rule generating means when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule,
  • the accumulation management unit controls to hold input data to be input to the analysis engine within a time range set by the accumulation rule.
  • Information processing device comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule.
  • the engine information stored in the engine information storage unit includes input data characteristic information that can be input to the analysis engine, and output data characteristic information that is an analysis result by the analysis engine, Based on the engine information, the engine control rule generating means for selecting the analysis engine capable of outputting the result corresponding to the processing request and generating the engine control rule representing the processing procedure using the analysis engine.
  • Information processing device includes input data characteristic information that can be input to the analysis engine, and output data characteristic information that is an analysis result by the analysis engine.
  • the engine control unit changes the engine control rule to another engine control rule based on output data acquired from the analysis engine according to the engine control rule, and inputs data to the analysis engine according to the other engine control rule. Input and acquisition of output data from the analysis engine,
  • the accumulation management unit has input data to be input to the analysis engine according to the changed other engine control rule within a time width range specified by time width information included in the engine information of the analysis engine. Control to hold in, Information processing device.
  • the engine information storage unit 201 stores engine information including time width information that is set in advance for each analysis engine and represents the time width of input data necessary for analysis processing by the analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request.
  • An accumulation rule generating unit 202 configured to set an accumulation rule representing a time width of the input data holding the input data input to the analysis engine based on the engine information; Information processing apparatus 200.
  • Appendix 9 An information processing apparatus according to appendix 8, wherein The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule.
  • Information processing device when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule.
  • An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When, Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine.
  • An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request.
  • An accumulation rule generating means for setting an accumulation rule representing a time width of the input data to hold the input data input to the analysis engine based on the engine information;
  • an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • the accumulation management unit has input data that the engine control unit inputs to the analysis engine in accordance with the engine control rule within a time width range specified by the time width information included in the engine information of the analysis engine.
  • an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
  • An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request.
  • An accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
  • the program is stored in a storage device or recorded on a computer-readable recording medium.
  • the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)

Abstract

This information processing device is provided with: an engine information storage unit for storing engine information set for individual analysis engines, the engine information including time width information representing the time width of input data necessary for an analysis process by the analysis engine; an engine controller for inputting input data into the analysis engine and acquiring output data from the analysis engine in accordance with an engine control rule representing a processing procedure in which an analysis engine capable of outputting a result with respect to a predetermined processing request is used; and an accumulation management unit for controlling input data, which is inputted into the analysis engine by the engine controller in accordance with the engine control rule, so as to be held within a range of time width specified by the time width information included in the engine information for the analysis engine.

Description

情報処理装置Information processing device
 本発明は、情報処理装置にかかり、特に、解析エンジンを用いて行う解析処理を管理する情報処理装置に関する。 The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus that manages analysis processing performed using an analysis engine.
 近年、情報処理技術の発達に伴い、様々なデータに対する解析処理を行う解析エンジンの開発が行われている。例えば、動画像データから人間の動線をトレースする位置情報を生成する、静止画像データから人物を特定する、音声データからテキストデータを生成するなど、様々な解析エンジンが存在している。 In recent years, with the development of information processing technology, analysis engines that perform analysis processing on various data have been developed. For example, various analysis engines exist such as generating position information for tracing a human flow line from moving image data, specifying a person from still image data, and generating text data from audio data.
 そして、上述したような解析エンジンは、解析対象を画像データや音声データといったメディアデータとしているが、このようなメディアデータに対する監視や検索といった解析処理を行うことは、関連データベースを用いて蓄積・検索する構造データなどとは異なり困難である、という問題があった。例えば、メディアデータは、利用者が要求する条件とのギャップが大きく、条件記述及びその処理が困難である。 The analysis engine as described above sets the analysis target as media data such as image data and audio data. However, analysis processing such as monitoring and search for such media data can be performed by using a related database. Unlike structural data, it is difficult. For example, media data has a large gap with conditions requested by users, and it is difficult to describe conditions and process them.
 このような状況において、メディアデータに対する検索等の解析処理は、当該メディアデータにメタ情報を付与し、かかるメタデータに対する条件を用いて検索を行う、といった方法にて行うものがある。また、メディアデータに対する検索を行う際に、検索条件自体にメディアデータを用いる、という方法もある。例えば、特許文献1に示すように、解析対象となる映像から、検索対象の類似画像を検索する、ということが行われている。 In such a situation, analysis processing such as search for media data may be performed by a method of adding meta information to the media data and performing a search using conditions for the metadata. There is also a method in which media data is used as a search condition itself when searching for media data. For example, as shown in Patent Document 1, a search target similar image is searched from a video to be analyzed.
特開2010-257449号公報JP 2010-257449 A
 一方で、各解析エンジンは、解析対象データに対する要求条件に応じて、解析処理時に用いる特徴などの情報は異なる。このため、種々の要求に対応するためには、解析エンジンに対する入力データを全て保存しておき、要求に応じて必要な入力データを用いて解析処理を行う必要がある。しかしながら、あらゆる解析エンジンに対応すべく入力データを全て保存しておくこととなると、要求に応じた処理負荷や保存コストが増大する、という問題が生じる。 On the other hand, each analysis engine has different information such as features used in the analysis process depending on the requirements for the analysis target data. For this reason, in order to respond to various requests, it is necessary to save all input data to the analysis engine and perform analysis processing using necessary input data according to the request. However, if all of the input data is stored so as to correspond to any analysis engine, there arises a problem that the processing load and storage cost according to the request increase.
 このため、本発明の目的は、上述した課題である、解析処理に用いる解析エンジンに対する汎用性の向上を図ると共に、データ保存コストを抑制した情報処理装置を提供することにある。 Therefore, an object of the present invention is to provide an information processing apparatus that improves the versatility of the analysis engine used for the analysis processing, which is the above-described problem, and suppresses the data storage cost.
 本発明の一形態である情報処理装置は、
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部と、
 所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部と、
 前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する蓄積管理部と、
を備えた、という構成をとる。
An information processing apparatus according to one aspect of the present invention
An engine information storage unit that stores engine information including time width information that is set in advance for each analysis engine and represents the time width of input data necessary for analysis processing by the analysis engine;
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When,
Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine. An accumulation management unit to
It has the structure of having.
 また、本発明の他の形態である情報処理装置は、
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えると共に、
 処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する蓄積ルール生成手段を備えた、
という構成をとる。
An information processing apparatus according to another aspect of the present invention
An engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine that is set in advance for each analysis engine,
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule generating means for setting an accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
The configuration is as follows.
 また、本発明の他の形態であるプログラムは、
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置に、
 所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部と、
 前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する蓄積管理部と、
を実現させるためのプログラムである。
Moreover, the program which is the other form of this invention is:
An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When,
Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine. An accumulation management unit to
It is a program for realizing.
 また、本発明の他の形態であるプログラムは、
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置に、
 処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する蓄積ルール生成手段、
を実現させるためのプログラムである。
Moreover, the program which is the other form of this invention is:
An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule generating means for setting an accumulation rule representing a time width of the input data to hold the input data input to the analysis engine based on the engine information;
It is a program for realizing.
 また、本発明の他の形態である情報処理方法は、
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置にて、
 エンジン制御部が、所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うと共に、
 蓄積管理部が、前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する
という構成をとる。
In addition, an information processing method according to another aspect of the present invention includes:
In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
Input of input data to the analysis engine and acquisition of output data from the analysis engine according to an engine control rule representing a processing procedure using the analysis engine in which the engine control unit can output a result for a predetermined processing request As well as
The accumulation management unit has input data that the engine control unit inputs to the analysis engine in accordance with the engine control rule within a time width range specified by the time width information included in the engine information of the analysis engine. It takes the structure of controlling to hold.
 また、本発明の他の形態である情報処理方法は、
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置にて、
 処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する、
という構成をとる。
In addition, an information processing method according to another aspect of the present invention includes:
In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
The configuration is as follows.
 本発明は、以上のように構成されることにより、解析処理に用いる解析エンジンに対する汎用性の向上を図ると共に、データ保存コストを抑制することができる。 The present invention, which is configured as described above, can improve the versatility of the analysis engine used for the analysis processing and can suppress the data storage cost.
本発明の実施形態1におけるデータ管理装置の構成を示す機能ブロック図である。It is a functional block diagram which shows the structure of the data management apparatus in Embodiment 1 of this invention. 図1に開示したデータ管理装置に記憶されたエンジン情報の一例を示す図である。It is a figure which shows an example of the engine information memorize | stored in the data management apparatus disclosed in FIG. 図1に開示したデータ管理装置にて生成したエンジン制御ルールの一例を示す図である。It is a figure which shows an example of the engine control rule produced | generated with the data management apparatus disclosed in FIG. 図1に開示したデータ管理装置の動作を示すフローチャートである。3 is a flowchart illustrating an operation of the data management device disclosed in FIG. 1. データ管理装置の他の構成を示す機能ブロック図である。It is a functional block diagram which shows the other structure of a data management apparatus. 本発明の付記1における情報処理装置の構成を示すブロック図である。It is a block diagram which shows the structure of the information processing apparatus in attachment 1 of this invention. 本発明の付記7における情報処理装置の構成を示すブロック図である。It is a block diagram which shows the structure of the information processing apparatus in attachment 7 of this invention.
 本発明の第1の実施形態を、図1乃至図5を参照して説明する。図1は、データ管理装置の構成を示す図であり、図2は、エンジン情報の一例を示す図である。図3は、エンジン制御ルールの一例を示す図であり、図4は、データ管理装置の動作を示す図である。図5は、データ管理装置の他の構成を示す図である。 A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram illustrating a configuration of a data management apparatus, and FIG. 2 is a diagram illustrating an example of engine information. FIG. 3 is a diagram illustrating an example of the engine control rule, and FIG. 4 is a diagram illustrating the operation of the data management device. FIG. 5 is a diagram illustrating another configuration of the data management apparatus.
 [構成]
 本発明における情報処理システムは、図1に示すように、複数の解析エンジン31,32,33と、情報処理装置に搭載されたアプリケーション4と、複数の解析エンジン及び情報処理装置に接続されたデータ管理装置1と、を備えて構成されている。
[Constitution]
As shown in FIG. 1, the information processing system according to the present invention includes a plurality of analysis engines 31, 32, 33, an application 4 installed in the information processing apparatus, and data connected to the plurality of analysis engines and the information processing apparatus. And a management device 1.
 上記解析エンジン31,32,33は、解析対象データに対してそれぞれ解析処理を行う情報処理装置であり、例えば、動画像データや静止画像データ、音声データなどのメディアデータを解析対象データとして解析処理を行う。一例をあげると、映像データから人物が映っている人物映像を抽出する人物抽出エンジン、画像データや人物映像データから人物の顔を認識する顔認識エンジン、映像データから人間の動線をトレースする位置情報を生成する動線抽出エンジンなどがある。但し、解析エンジン31,32,33は、上述した解析処理を行うものに限定されず、また、その数も図1に示した3つであることに限定されない。 The analysis engines 31, 32, and 33 are information processing apparatuses that perform analysis processing on analysis target data. For example, media data such as moving image data, still image data, and audio data is analyzed as analysis target data. I do. For example, a person extraction engine that extracts a person image showing a person from image data, a face recognition engine that recognizes a person's face from image data or person image data, and a position where human flow lines are traced from image data There is a flow line extraction engine that generates information. However, the analysis engines 31, 32, and 33 are not limited to those that perform the above-described analysis processing, and the number thereof is not limited to three as shown in FIG.
 上記アプリケーション4は、データ管理装置1に接続された情報処理装置に実装されており、上述した解析エンジン31,32,33による解析処理を利用した解析結果を、データ管理装置1に要求する機能を有する。本実施形態において、アプリケーション4からデータ管理装置1に対して要求される処理要求は、例えば、解析対象データである映像データ内から特定の人物を検索したり監視する、という監視要求である。 The application 4 is implemented in an information processing apparatus connected to the data management apparatus 1, and has a function of requesting the data management apparatus 1 for an analysis result using the analysis processing by the analysis engines 31, 32, and 33 described above. Have. In the present embodiment, the processing request requested from the application 4 to the data management apparatus 1 is a monitoring request for searching or monitoring a specific person from video data that is analysis target data, for example.
 監視要求の一例として、「監視映像に、入力写真に似た顔が映ったら通知する」、「監視映像に、入力写真に似た顔の人が映ったら、その人の行動履歴を通知する」、「監視映像に、入力写真に似た顔、服装、性別、荷物の人が映ったら通知する」、という要求があげられる。 As an example of a monitoring request, “Notify when a face similar to the input photo appears in the monitoring video”, “If a person with a face similar to the input photo appears in the monitoring video, notify the action history of the person” , “Notify me when a face, clothes, gender, or a person with luggage appears in the surveillance video.”
 また、アプリケーション4は、上述した処理要求に応じて、解析エンジン31,32,33にて解析された結果を、データ管理装置1から取得する。 Further, the application 4 acquires the results analyzed by the analysis engines 31, 32, and 33 from the data management device 1 in response to the processing request described above.
 次に、データ管理装置1について説明する。データ管理装置1は、演算装置と記憶装置とを備えた情報処理装置である。そして、データ管理装置1は、図1に示すように、演算装置にプログラムが組み込まれることで構築された、監視要求受付部11、エンジン制御部12、エンジン制御ルール管理部13、解析データ管理部14、解析データ監視部15、類似性判定ルール管理部16、監視結果送信部17、メディアデータ管理部18、ルール生成部20、を備えている。そして、上記ルール生成部20は、エンジン情報管理部21、エンジン制御ルール生成部22、蓄積ルール生成部23、監視ルール生成部24、を備えている。以下、各構成について詳述する。 Next, the data management device 1 will be described. The data management device 1 is an information processing device including an arithmetic device and a storage device. As shown in FIG. 1, the data management device 1 is constructed by incorporating a program into an arithmetic device, and includes a monitoring request reception unit 11, an engine control unit 12, an engine control rule management unit 13, and an analysis data management unit. 14, an analysis data monitoring unit 15, a similarity determination rule management unit 16, a monitoring result transmission unit 17, a media data management unit 18, and a rule generation unit 20. The rule generation unit 20 includes an engine information management unit 21, an engine control rule generation unit 22, an accumulation rule generation unit 23, and a monitoring rule generation unit 24. Hereinafter, each configuration will be described in detail.
 上記エンジン情報管理部21(エンジン情報記憶部)は、各解析エンジンについて予め設定されたエンジン情報を記憶装置に記憶管理している。エンジン情報は、解析エンジンに対して入力可能な入力データのデータ形式を表す入力データ形式(特性情報)と、解析エンジンによる解析結果である出力データのデータ形式を表す出力データ形式(特性情報)と、解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報と、を含んでいる。 The engine information management unit 21 (engine information storage unit) stores and manages engine information preset for each analysis engine in a storage device. The engine information includes an input data format (characteristic information) that represents the data format of input data that can be input to the analysis engine, an output data format (characteristic information) that represents the data format of output data that is an analysis result by the analysis engine, and And time width information representing the time width of the input data required for the analysis processing by the analysis engine.
 ここで、上記「入力データ形式」とは、例えば、解析エンジンの解析対象データとなる入力データのデータ種類を表す情報であり、一例としては、「映像」や「人物映像」といった値である。また、上記「出力データ型」とは、例えば、解析エンジンによる解析結果である出力データのデータ種類を表す情報である。この出力データ形式の一例としては、解析エンジンが映像データに映し出された人物の性別を解析するものである場合には、「性別」という値であったり、解析エンジンが映像データに映し出された人物の顔の特徴量を解析するものである場合には、「顔特徴量」という値である。 Here, the “input data format” is, for example, information indicating the data type of the input data to be analyzed by the analysis engine, and has values such as “video” and “person video” as an example. The “output data type” is information representing the data type of output data which is an analysis result by the analysis engine, for example. As an example of this output data format, if the analysis engine analyzes the gender of the person shown in the video data, the value is “gender”, or the person that the analysis engine shows in the video data In the case of analyzing the feature amount of the face, the value is “face feature amount”.
 また、上記「時間幅情報」とは、解析エンジンにて解析処理を行うために必要な入力データの時系列に沿ったデータ量を表す値である。この時間幅情報の一例としては、解析対象データが映像データである場合には、「フレーム数」や「映像時間」である。 In addition, the “time width information” is a value that represents the amount of data along the time series of input data necessary for performing analysis processing by the analysis engine. As an example of this time width information, when the analysis target data is video data, it is “number of frames” or “video time”.
 図2に、エンジン情報の一例を示す。解析エンジンが画像データから人物の顔を認識する「画像顔認識エンジン」である場合には、入力データ形式は「画像」、出力データ形式は「顔特徴量」、入力データ時間幅は「1フレーム」、という値である。解析エンジンが映像データから人物の顔を認識する「映像顔認識エンジン」である場合には、入力データ形式は「人物映像」、出力データ形式は「顔特徴量」、入力データ時間幅は「3フレーム」、という値である。解析エンジンが映像データからから人物を抽出する「人物抽出エンジン」である場合には、入力データ形式は「映像」、出力データ形式は「人物映像」、入力データ時間幅は「5フレーム」、という値である。解析エンジンが映像データから人物の動線を認識する「動線抽出エンジン」である場合には、入力データ形式は「人物映像」、出力データ形式は「人物動線」、入力データ時間幅は「10フレーム」、という値である。 Fig. 2 shows an example of engine information. When the analysis engine is an “image face recognition engine” for recognizing a human face from image data, the input data format is “image”, the output data format is “face feature amount”, and the input data time width is “1 frame”. ". When the analysis engine is a “video face recognition engine” for recognizing a human face from video data, the input data format is “human video”, the output data format is “face feature value”, and the input data time width is “3”. The value is “frame”. When the analysis engine is a “person extraction engine” that extracts a person from video data, the input data format is “video”, the output data format is “person video”, and the input data time width is “5 frames”. Value. If the analysis engine is a “flow line extraction engine” that recognizes the flow line of a person from video data, the input data format is “human video”, the output data format is “human flow line”, and the input data time width is “ The value is “10 frames”.
 なお、上述したエンジン情報は、解析エンジン毎に解析エンジンの他の特性を表すデータを含んでいてもよく、後述するように、エンジン制御ルールを生成する際に参照できる情報であるとよい。 The engine information described above may include data representing other characteristics of the analysis engine for each analysis engine, and may be information that can be referred to when generating an engine control rule, as will be described later.
 また、上記エンジン制御ルール生成部22(エンジン制御ルール生成手段)は、アプリケーション4から受け付けた処理要求に対応した解析処理を行って、当該処理要求に対応した結果を出力できるよう、解析エンジン31,32,33を用いた処理手順を表すエンジン制御ルールを生成する。具体的に、エンジン制御ルール生成部22は、まず、処理要求の内容から、必要な入力データと、要求された結果自体を表す出力データあるいは要求された結果を導き出すために必要な出力データと、を特定する。そして、特定された入力データと出力データのデータ形式が設定されている解析エンジンを、上述したエンジン情報を参照して選定する。 The engine control rule generation unit 22 (engine control rule generation means) performs an analysis process corresponding to the process request received from the application 4 and outputs a result corresponding to the process request. An engine control rule representing a processing procedure using 32 and 33 is generated. Specifically, the engine control rule generation unit 22 firstly, from the content of the processing request, necessary input data, output data representing the requested result itself, or output data necessary for deriving the requested result, Is identified. Then, an analysis engine in which the data format of the specified input data and output data is set is selected with reference to the engine information described above.
 但し、処理要求に対応する結果に必要な出力データを1つの解析エンジンから得られない場合には、複数の解析エンジンを連結して必要な出力データを出力すべく、複数の解析エンジンを選定する。この場合に、エンジン制御ルール生成部22は、処理要求から特定された入力データを入力可能な一の解析エンジンを選定すると共に、この一の解析エンジンの出力データを入力データとする他の解析エンジンを選定する。そして、この他の解析エンジンによる出力データが、処理要求に対応して必要とされる出力データとなっていればよいが、そうでない場合には、さらに上記他の解析エンジンによる出力データを入力データとするさらに別の解析エンジンを選定する。そして、最終的に処理要求に対応する出力データを得ることができる複数の解析エンジンの組み合わせを選定して、これら複数の解析エンジンを連結した処理手順であるエンジン制御ルールを生成する。 However, if the output data necessary for the result corresponding to the processing request cannot be obtained from one analysis engine, a plurality of analysis engines are selected to connect the plurality of analysis engines and output the necessary output data. . In this case, the engine control rule generation unit 22 selects one analysis engine that can input the input data specified from the processing request, and another analysis engine that uses the output data of this one analysis engine as input data. Is selected. The output data from the other analysis engine only needs to be output data required in response to the processing request. If not, the output data from the other analysis engine is further input to the input data. Another analysis engine is selected. Then, a combination of a plurality of analysis engines that can finally obtain output data corresponding to the processing request is selected, and an engine control rule that is a processing procedure connecting these plurality of analysis engines is generated.
 ここで、エンジン制御ルール生成部22によるエンジン制御ルールの生成例を、図3を参照して説明する。例えば、アプリケーション4からの処理要求である監視要求が、「入力写真に似た顔の人が、監視映像に映ったら、その人の行動履歴を通知する」という内容であるとする。この場合には、まず、(A)入力写真の人物の顔、を解析することと、(B)監視映像の人物の顔、及び、人物の動線、を解析する必要がある。なお、監視映像の人物の顔と入力写真の人物の顔との類似判断は、後述するように解析エンジンを用いずに、解析データ監視部15にて行われる。 Here, an example of engine control rule generation by the engine control rule generation unit 22 will be described with reference to FIG. For example, it is assumed that the monitoring request, which is a processing request from the application 4, has the content that “if a person with a face similar to the input photo appears in the monitoring video, the action history of that person is notified”. In this case, first, it is necessary to analyze (A) the person's face in the input photograph and (B) analyze the person's face and the person's flow line in the monitoring video. Note that the similarity determination between the face of the person in the monitoring video and the face of the person in the input photograph is performed by the analysis data monitoring unit 15 without using an analysis engine as will be described later.
 上記(A)に対応するエンジン制御ルールは、入力データが「入力写真」であることから入力データ形式として「画像」を特定し、出力データが「人物の顔」であることから出力データ形式として「顔特徴量」を特定する。そして、これら入力データ形式と出力データ形式が設定された解析エンジンを、図2に示すようなエンジン情報から選定する。これにより、図3(A)に示すような「画像顔認識エンジン」を用いた処理手順のエンジン制御ルールを生成する。 The engine control rule corresponding to the above (A) specifies “image” as the input data format because the input data is “input photograph”, and as the output data format because the output data is “person's face”. The “face feature amount” is specified. Then, the analysis engine in which the input data format and the output data format are set is selected from the engine information as shown in FIG. Thereby, an engine control rule of a processing procedure using the “image face recognition engine” as shown in FIG.
 また、上記(B)に対応するエンジン制御ルールは、入力データが「監視映像」であることから入力データ形式として「映像」を特定する。一方、出力データは「人物の顔」と「人物の動線」であるため、出力データ形式として「顔特徴量」と「人物動線」の2つを特定する。そして、これら入力データ形式と出力データ形式が設定された解析エンジンを、図2に示すようなエンジン情報から選定するが、入力データ形式である「映像」から出力データ形式である「顔特徴量」と「人物動線」とを直接解析できる解析エンジンがないため、入力データ形式が「映像」の解析エンジンと、出力データ形式が「顔特徴量」と「人物動線」である解析エンジンを、それぞれ選定する候補とする。 Also, the engine control rule corresponding to the above (B) specifies “video” as the input data format because the input data is “monitoring video”. On the other hand, since the output data is “person's face” and “person's flow line”, two output data formats, “face feature value” and “person flow line”, are specified. Then, the analysis engine in which the input data format and the output data format are set is selected from the engine information as shown in FIG. 2, and from the “video” as the input data format to the “face feature value” as the output data format. There is no analysis engine that can directly analyze the "person flow" and the analysis engine whose input data format is "video", and the analysis engine whose output data format is "facial feature" and "human flow" Each candidate is selected.
 すると、入力データ形式が「映像」である解析エンジンとして、「人物抽出エンジン」があり、その出力データ形式は「人物映像」である。そして、「人物抽出エンジン」の出力データ形式である「人物映像」を入力データ形式とする「映像顔認識エンジン」と「動線抽出エンジン」があり、これらの出力データ形式はそれぞれ「顔特徴量」と「人物動線」である。従って、図3(A)に示すように、まず、「人物抽出エンジン」で「監視映像」の解析を行って「人物映像」を出力し、この「人物映像」をそれぞれ「映像顔認識エンジン」と「動線抽出エンジン」に入力して解析を行って、「顔特徴量」と「人物動線」とを出力する、という処理手順のエンジン制御ルールを生成することができる。 Then, there is a “person extraction engine” as an analysis engine whose input data format is “video”, and its output data format is “human video”. Then, there are “Video Face Recognition Engine” and “Flow Line Extraction Engine” with “Human Video”, which is the output data format of “Human Extraction Engine”, as input data formats. "And" personal flow line ". Therefore, as shown in FIG. 3A, first, the “monitor video” is analyzed by the “person extraction engine” to output the “person video”, and each “person video” is converted to the “video face recognition engine”. And “flow line extraction engine” are input and analyzed, and an engine control rule having a processing procedure of outputting “face feature amount” and “person flow line” can be generated.
 なお、上述したエンジン制御ルールは、必ずしもデータ管理装置1(エンジン制御ルール生成部22)にて生成されることに限定されない。予め手動で生成されたエンジン制御ルールをデータ管理装置1内に登録しておいてもよい。この場合には、登録されているエンジン制御ルールが、後述するようにエンジン制御部12及びエンジン制御ルール管理部13にて選択され、このエンジン制御ルールに従って解析エンジン3に対する処理が行われる。 The engine control rule described above is not necessarily generated by the data management device 1 (engine control rule generation unit 22). An engine control rule that is manually generated in advance may be registered in the data management device 1. In this case, the registered engine control rule is selected by the engine control unit 12 and the engine control rule management unit 13 as will be described later, and the process for the analysis engine 3 is performed according to the engine control rule.
 また、上記蓄積ルール生成部23(蓄積ルール生成手段)は、上述した各解析エンジンが解析処理を行う際に必要な入力データの時間幅を表す蓄積ルールを設定する。具体的に、蓄積ルール生成部23は、エンジン情報に含まれる解析エンジン毎に設定された時間幅情報にて特定される時間幅を、エンジン制御ルールに設定された解析エンジンに入力する入力データの時間幅として設定する。このとき、蓄積ルール生成部23は、上述したエンジン制御ルールに基づいて1つの入力データが複数の解析エンジンに入力される場合には、エンジン情報に基づいて各解析エンジンに設定された各時間幅のうち、最も長い時間幅の値を蓄積ルールとして設定する。 Also, the accumulation rule generation unit 23 (accumulation rule generation means) sets an accumulation rule that represents the time width of input data required when each analysis engine described above performs analysis processing. Specifically, the accumulation rule generation unit 23 inputs the time width specified by the time width information set for each analysis engine included in the engine information to the analysis engine set in the engine control rule. Set as time span. At this time, when one input data is input to a plurality of analysis engines based on the engine control rule described above, the accumulation rule generation unit 23 sets each time width set for each analysis engine based on the engine information. Among these, the value of the longest time width is set as the accumulation rule.
 例えば、図3を参照して説明したエンジン制御ルールの場合、まず、図3(A)の例では、使用する解析エンジンが「画像顔認識エンジン」の1つであるため、図2のエンジン情報を参照して、この解析エンジンに設定された時間幅である「1フレーム」を蓄積ルールとして設定する。また、図3(B)の例の前段では、使用する解析エンジンが「人物抽出エンジン」の1つであるため、図2のエンジン情報を参照して、この解析エンジンに設定された時間幅である「5フレーム」を蓄積ルールとして設定する。一方、図3(B)の後段では、使用する解析エンジンが「映像顔認識エンジン」と「動線抽出エンジン」の2つであるため、図2のエンジン情報を参照して、これら各解析エンジンに設定された時間幅である「3フレーム」と「10フレーム」の最大値である「10フレーム」を蓄積ルールとして設定する。 For example, in the case of the engine control rule described with reference to FIG. 3, first, in the example of FIG. 3A, the analysis engine to be used is one of “image face recognition engine”. Referring to FIG. 4, “1 frame”, which is the time width set in this analysis engine, is set as the accumulation rule. Further, in the first stage of the example of FIG. 3B, the analysis engine to be used is one of the “person extraction engine”, and therefore, with reference to the engine information of FIG. A certain “5 frames” is set as an accumulation rule. On the other hand, in the latter part of FIG. 3B, since there are two analysis engines to be used, “image face recognition engine” and “flow line extraction engine”, each of these analysis engines is referred to with reference to the engine information of FIG. “10 frames”, which is the maximum value of “3 frames” and “10 frames”, which are the time widths set in FIG.
 また、上記監視ルール生成部24は、解析エンジンにて解析処理されたデータから、アプリケーション4からの処理要求である監視要求に対応した結果を出力するためのルールを生成する。例えば、監視要求が上述した「入力写真に似た顔の人が、監視映像に映ったら、その人の行動履歴を通知する」という内容である場合には、上記図3(B)に示す解析処理結果である「監視映像の人物の顔」から、上記図3(A)に示す解析処理結果である「入力写真の人物の顔」に類似する顔を検出すると共に、検出した人の上記図3(B)に示す解析処理結果である「人物動線」を通知する、という監視ルールを生成する。 The monitoring rule generation unit 24 generates a rule for outputting a result corresponding to the monitoring request that is a processing request from the application 4 from the data analyzed by the analysis engine. For example, in the case where the monitoring request has the above-described content, “If a person with a face similar to the input photo appears in the monitoring video, the person's action history is notified”, the analysis shown in FIG. A face similar to the “human face in the input photo” that is the analysis processing result shown in FIG. 3A is detected from the “human face in the monitoring video” that is the processing result, and the above-described figure of the detected person A monitoring rule for notifying “person flow line”, which is the analysis processing result shown in FIG.
 また、上記監視要求受付部11は、アプリケーション4から入力された処理要求である監視要求を受け付けて、ルール生成部20に渡す。 The monitoring request receiving unit 11 receives a monitoring request that is a processing request input from the application 4 and passes it to the rule generating unit 20.
 また、上記エンジン制御部12及びエンジン制御ルール管理部13は、上述したエンジン制御ルール生成部22にて生成されたエンジン制御ルールに従って、各解析エンジン31,32,33に対する入力データの入力や解析結果の出力を取得して解析データ管理部14等に出力するなどの処理を行う。なお、エンジン制御ルールが予め登録されている場合には、当該登録されているエンジン制御ルールを選択して、このエンジン制御ルールに従って各解析エンジン3に対する処理を行う。 The engine control unit 12 and the engine control rule management unit 13 input input data and analysis results to the analysis engines 31, 32, and 33 in accordance with the engine control rules generated by the engine control rule generation unit 22 described above. Is obtained and output to the analysis data management unit 14 or the like. When engine control rules are registered in advance, the registered engine control rules are selected, and processing for each analysis engine 3 is performed according to the engine control rules.
 また、上記解析データ管理部14(蓄積管理部)は、上述したエンジン制御12を介して、各解析エンジン31,32,33に入力する入力データや出力された出力データを管理する。特に、解析データ管理部14は、各解析エンジン31,32,33に対して入力する入力データを、上述した蓄積ルール生成部23にて生成された蓄積ルールにて設定された時間幅の範囲内で、データ管理装置1に装備された記憶領域に保持するよう制御する。 The analysis data management unit 14 (accumulation management unit) manages input data input to each analysis engine 31, 32, 33 and output output data via the engine control 12 described above. In particular, the analysis data management unit 14 inputs the input data input to each analysis engine 31, 32, 33 within the time range set by the accumulation rule generated by the accumulation rule generation unit 23 described above. Thus, control is performed so that the data is stored in the storage area installed in the data management device 1.
 例えば、図3を参照して説明したエンジン制御ルールの場合、まず、図3(A)の例では、「画像顔認識エンジン」に入力する「入力写真」を最新の「1フレーム」のみ、データ管理装置1内に保持する。また、図3(B)の例では、前段では「人物抽出エンジン」に入力する「監視映像」を最新の「5フレーム」のみをデータ管理装置1内に蓄積し、それ以前のフレームは破棄する。また、図3(B)の後段では、「人物抽出エンジン」から出力され、「映像顔認識エンジン」と「動線抽出エンジン」に入力する「人物映像」を、最新の「10フレーム」のみをデータ管理装置1内に蓄積し、それ以前のフレームは破棄する。 For example, in the case of the engine control rule described with reference to FIG. 3, first, in the example of FIG. 3A, only the latest “1 frame” of “input photo” input to the “image face recognition engine” is data. It is held in the management device 1. In the example of FIG. 3B, in the previous stage, only the latest “5 frames” of “monitoring video” input to the “person extraction engine” are stored in the data management apparatus 1 and the previous frames are discarded. . Further, in the latter part of FIG. 3B, only the latest “10 frames” are output from the “human face extraction engine” and the “human face video” input to the “video face recognition engine” and the “flow line extraction engine”. It accumulates in the data management device 1 and discards previous frames.
 ここで、さらに、入力データの蓄積について具体例を上げて説明する。なお、ここでは、解析エンジンに入力する入力データの蓄積ルールが「3フレーム」であると設定されていることとする。そして、時間t0,t1,t2,t3という順番で、解析エンジンに入力する画像データd0,d1,d2,d3が到着するとする。 Here, the accumulation of input data will be described with a specific example. Here, it is assumed that the accumulation rule for input data input to the analysis engine is set to “3 frames”. Assume that image data d0, d1, d2, and d3 to be input to the analysis engine arrive in the order of times t0, t1, t2, and t3.
 上記の場合に、まず、画像データd0が解析エンジンに到着すると、それ以前の蓄積データはないので、画像データd0だけで解析処理が実行され、処理が終わった画像データd0は、蓄積ルールにより蓄積される(蓄積データ:d0)。続いて、画像データd1が解析エンジンに到着すると、蓄積されている画像データd0と合わせて画像データd0,d1で解析処理が実行され、処理が終わった画像データd1は蓄積ルールにより蓄積される(蓄積データ:d0,d1)。続いて、画像データd2が解析エンジンに到着すると、蓄積されている画像データd0,d1と合わせて画像データd0,d1,d2の3フレームで解析処理が実行され、処理が終わった画像データd2は蓄積ルールにより蓄積される。但し、画像データd2を追加すると、蓄積データ数(フレーム数)が「3」に達するので、古い画像データd0が捨てられる(蓄積データ:d1,d2)。続いて、画像データd3が解析エンジンに到着すると、蓄積されている画像データd1,d2と合わせて画像データd1,d2,d3の3フレームで認識が実行され、処理が終わった画像データd3は蓄積ルールにより蓄積される。但し、画像データd3を追加すると、蓄積データ数(フレーム数)が「3」に達するので、古い画像データd1が捨てられる(蓄積データ:d2,d3)。 In the above case, first, when image data d0 arrives at the analysis engine, there is no previous accumulated data, so analysis processing is executed with only image data d0, and the processed image data d0 is accumulated according to the accumulation rule. (Accumulated data: d0). Subsequently, when the image data d1 arrives at the analysis engine, analysis processing is executed on the image data d0 and d1 together with the stored image data d0, and the processed image data d1 is stored according to the storage rule ( Accumulated data: d0, d1). Subsequently, when the image data d2 arrives at the analysis engine, the analysis processing is executed in three frames of the image data d0, d1, d2 together with the stored image data d0, d1, and the processed image data d2 is Accumulated according to the accumulation rule. However, when the image data d2 is added, the number of accumulated data (the number of frames) reaches “3”, so the old image data d0 is discarded (accumulated data: d1, d2). Subsequently, when the image data d3 arrives at the analysis engine, recognition is performed on the three frames of the image data d1, d2, d3 together with the stored image data d1, d2, and the processed image data d3 is stored. Accumulated by rules. However, when the image data d3 is added, the number of accumulated data (number of frames) reaches “3”, so the old image data d1 is discarded (accumulated data: d2, d3).
 なお、解析データ管理部14は、蓄積ルール生成部23にて生成された蓄積ルールに基づいて、解析エンジンへの入力データの蓄積を行っているが、図2に示したようなエンジン情報を解析データ管理部14が直接参照して、各解析エンジンに設定された時間幅の情報を読み出して、かかる時間幅に基づいて上述したように入力データの蓄積を行ってもよい。 The analysis data management unit 14 accumulates input data to the analysis engine based on the accumulation rule generated by the accumulation rule generation unit 23, but analyzes the engine information as shown in FIG. The data management unit 14 may directly refer to the information on the time width set for each analysis engine, and the input data may be accumulated as described above based on the time width.
 また、上記解析データ監視部15は、上述した監視ルール生成部24にて生成された監視ルールに従って、各解析エンジン31,32,33からの出力データを監視する。例えば、上述した例では、「監視映像の人物の顔」から「入力写真の人物の顔」に類似する顔を検出し、検出した人の「人物動線」を通知する、という監視処理を行う。このとき、「監視映像の人物の顔」から「入力写真の人物の顔」に類似する顔を検出する処理は、各解析エンジンから出力された各「顔特徴量」を比較し、類似性判定ルール管理部16に予め設定されている類似性判定ルールに従って類似か否かを判定し、監視映像中から入力写真の顔に類似する顔を検出する。 Further, the analysis data monitoring unit 15 monitors the output data from each analysis engine 31, 32, 33 in accordance with the monitoring rules generated by the monitoring rule generation unit 24 described above. For example, in the above-described example, a monitoring process is performed in which a face similar to “a person's face in the input photo” is detected from “a person's face in the monitoring video” and a “person flow line” of the detected person is notified. . At this time, the process of detecting a face similar to the “face of the person in the input photo” from the “face of the person in the monitoring video” compares each “face feature amount” output from each analysis engine and determines the similarity. It is determined whether or not they are similar according to a similarity determination rule set in advance in the rule management unit 16, and a face similar to the face of the input photo is detected from the monitoring video.
 そして、解析データ監視部15は、アプリケーション4からの監視要求に対応した結果を、監視結果送信部17に出力する。これに伴い、監視結果送信部17は、解析データ監視部15から出力された監視結果をアプリケーション4に送信する。 Then, the analysis data monitoring unit 15 outputs a result corresponding to the monitoring request from the application 4 to the monitoring result transmission unit 17. Accordingly, the monitoring result transmission unit 17 transmits the monitoring result output from the analysis data monitoring unit 15 to the application 4.
 また、上記メディアデータ管理部18は、監視対象となる監視映像やアプリケーション4から監視要求と共に入力された入力画像を、エンジン制御部12を介して各解析エンジンに入力するなど、管理を行う。 Further, the media data management unit 18 performs management such as inputting a monitoring image to be monitored and an input image input together with a monitoring request from the application 4 to each analysis engine via the engine control unit 12.
 [動作]
 次に、上述したデータ管理装置1の動作を、図4のフローチャートを参照して説明する。まず、アプリケーション4から監視要求が入力されると、データ管理装置1は監視要求受付部11にて受け取り(ステップS1)、ルール生成部20に渡す。
[Operation]
Next, the operation of the data management apparatus 1 described above will be described with reference to the flowchart of FIG. First, when a monitoring request is input from the application 4, the data management apparatus 1 receives it at the monitoring request reception unit 11 (step S <b> 1) and passes it to the rule generation unit 20.
 ルール生成部20は、エンジン制御ルール生成部22にて、エンジン情報を参照して、受け付けた監視要求に対応した結果を出力することができる処理手順であるエンジン制御ルールを生成する(ステップS2)。また、蓄積ルール生成部23にて、エンジン情報を参照して、生成したエンジン制御ルールに含まれる各解析エンジンへの入力データの蓄積ルールを生成する(ステップS3)。さらに、監視ルール生成部24にて、解析エンジンによる解析結果を用いて、受け付けた監視要求に対応した監視結果を出力する監視ルールを生成する(ステップS4)。 The rule generation unit 20 generates an engine control rule that is a processing procedure capable of outputting a result corresponding to the received monitoring request with reference to the engine information in the engine control rule generation unit 22 (step S2). . Further, the accumulation rule generation unit 23 refers to the engine information, and generates an accumulation rule for input data to each analysis engine included in the generated engine control rule (step S3). Further, the monitoring rule generation unit 24 generates a monitoring rule that outputs a monitoring result corresponding to the received monitoring request, using the analysis result of the analysis engine (step S4).
 その後、データ管理装置1は、エンジン制御ルール、蓄積ルールに従って、監視映像に対して解析処理を行い、その解析結果に対して、監視ルールに従って監視処理を行う(ステップS4)。つまり、データ管理装置1は、エンジン制御ルールにて表される処理手順に従って、特定の解析エンジンに入力データを入力して、解析結果を受け取る。このとき、データ管理装置1は、蓄積ルールに従って、各解析エンジンに対する入力データの保持量を制御し、蓄積ルールに設定された範囲を超える入力データは保持しない。そして、解析及び監視処理により出力された監視結果を、アプリケーション4に出力する。 Thereafter, the data management apparatus 1 performs analysis processing on the monitoring video according to the engine control rule and the accumulation rule, and performs monitoring processing on the analysis result according to the monitoring rule (step S4). That is, the data management device 1 inputs input data to a specific analysis engine according to the processing procedure represented by the engine control rule, and receives the analysis result. At this time, the data management device 1 controls the amount of input data retained for each analysis engine according to the accumulation rule, and does not retain input data exceeding the range set in the accumulation rule. Then, the monitoring result output by the analysis and monitoring process is output to the application 4.
 なお、上記では、データ管理装置1がエンジン制御部12や解析データ管理部14等を備えており、生成したエンジン制御ルールや蓄積ルール等に従って監視映像に対する解析処理や監視処理を行っているが、エンジン制御部12や解析データ管理部14等の解析処理や管理処理を行う機能は、別の情報処理装置に備えられていてもよい。つまり、データ管理装置1は、ルール生成部20のみを有し、エンジン制御ルール、蓄積ルール、監視ルールを生成する機能のみを装備していてもよい。 In the above, the data management device 1 includes the engine control unit 12, the analysis data management unit 14 and the like, and performs analysis processing and monitoring processing on the monitoring video according to the generated engine control rules, accumulation rules, and the like. Functions for performing analysis processing and management processing, such as the engine control unit 12 and the analysis data management unit 14, may be provided in another information processing apparatus. That is, the data management device 1 may have only the rule generation unit 20 and may be equipped with only a function for generating engine control rules, accumulation rules, and monitoring rules.
 本発明は、以上のように構成されることで、アプリケーション4側は各解析エンジンの使い方などを理解する必要はなく、処理要求を送信するだけ所望の監視結果を得ることができるため、解析エンジンを利用したシステムの汎用性の向上と、利用者の利便性の向上を図ることができる。そしてこのとき、使用する各解析エンジンに適した入力データの保存が実現されるため、データ保存コストを抑制することができる。 Since the present invention is configured as described above, the application 4 does not need to understand how to use each analysis engine, and can obtain a desired monitoring result only by transmitting a processing request. It is possible to improve the general versatility of the system using and the convenience of the user. At this time, the storage of input data suitable for each analysis engine to be used is realized, so that the data storage cost can be suppressed.
 また、解析エンジンを追加する際には、図2に示したようなエンジン情報に、追加する解析エンジンの入力データ形式、出力データ形式、入力データ時間幅、を追加することで、エンジン制御ルールや蓄積ルールの生成に利用することができる。 Also, when adding an analysis engine, by adding the input data format, output data format, and input data time width of the analysis engine to be added to the engine information as shown in FIG. It can be used to generate accumulation rules.
 なお、本発明におけるデータ管理装置1は、図5に示すような構成を取っていてもよい。図5に示すデータ管理装置1は、装備された演算装置にプログラムが読み込まれることで構築された監視状態管理部19を備えており、その他の構成は実施形態1と同様である。そして、監視状態管理部19は、解析データ監視部15による監視結果に応じて、使用するエンジン制御ルール、蓄積ルール、監視ルールを変更する。これにより、監視映像の状況の変化に応じて、監視する内容を変更することができる。 Note that the data management device 1 according to the present invention may be configured as shown in FIG. The data management device 1 shown in FIG. 5 includes a monitoring state management unit 19 constructed by reading a program into the equipped arithmetic device, and other configurations are the same as those in the first embodiment. The monitoring state management unit 19 changes the engine control rule, the accumulation rule, and the monitoring rule to be used according to the monitoring result by the analysis data monitoring unit 15. Thereby, the contents to be monitored can be changed according to the change in the status of the monitoring video.
 例えば、監視要求が上述した「入力写真に似た顔の人が監視映像に映ったら、その人のその後の行動履歴を通知する」という内容である場合には、(1)「入力写真の人物の顔」に類似する顔を「監視映像の人物の顔」から検出した場合に、(2)その人の「人物動線」を解析する、という2段階の解析処理となる。つまり、まず1段階目として、「人物抽出エンジン」で「監視映像」の解析を行って「人物映像」を出力し、この「人物映像」を「映像顔認識エンジン」に入力して「顔特徴量」を出力する、というエンジン制御ルールにて解析処理を行って、特定人物の検出を行う。そして、この1段階目の解析処理結果により特定の人物が検出されると、2段階目として「人物抽出エンジン」で「監視映像」の解析を行って「人物映像」を出力し、この「人物映像」を「動線抽出エンジン」に入力して「人物動線」を出力する、というエンジン制御ルールに変更して解析処理を行って、その解析結果である「人物動線」を通知する。このとき、エンジン制御ルールの変更に伴い使用する解析エンジンが異なるため、それぞれに対応した蓄積ルールや監視ルールに変更される。 For example, if the monitoring request is the above-mentioned content “if a person with a face similar to the input photo appears in the monitoring video, the subsequent action history of the person is notified” (1) “person in the input photo” When a face similar to “the face of the person” is detected from “the face of the person in the monitoring video”, this is a two-stage analysis process of (2) analyzing the “person flow line” of that person. In other words, as the first step, the “person extraction engine” analyzes the “monitoring video” and outputs the “person video”. The “person video” is input to the “video face recognition engine” and the “facial features” An analysis process is performed according to an engine control rule that “amount” is output, and a specific person is detected. When a specific person is detected based on the result of the first stage analysis process, the “person image extraction engine” analyzes the “monitoring video” as the second stage and outputs “person video”. The analysis process is performed by changing the engine control rule that “video” is input to “flow line extraction engine” and “human flow line” is output, and the “human flow line” that is the analysis result is notified. At this time, since the analysis engine to be used is different in accordance with the change of the engine control rule, it is changed to the accumulation rule and the monitoring rule corresponding to each.
 以上のようにすることにより、本発明は、様々なエンジン制御ルールにて表される解析処理に対応することができ、汎用性の向上を図ることができる。 By doing as described above, the present invention can cope with analysis processing expressed by various engine control rules, and can improve versatility.
 <付記>
 上記実施形態の一部又は全部は、以下の付記のようにも記載されうる。以下、本発明における情報処理装置の構成の概略を、図6,7を参照して説明すると共に、本発明のプログラム、情報処理方法の構成の概略を説明する。但し、本発明は、以下の構成に限定されない。
<Appendix>
Part or all of the above-described embodiment can be described as in the following supplementary notes. Hereinafter, the outline of the configuration of the information processing apparatus according to the present invention will be described with reference to FIGS. 6 and 7, and the outline of the configuration of the program and the information processing method of the present invention will be described. However, the present invention is not limited to the following configuration.
(付記1)
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部101と、
 所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部102と、
 前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する蓄積管理部103と、
を備えた情報処理装置100。
(Appendix 1)
An engine information storage unit 101 that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine;
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request 102,
Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine. A storage management unit 103 for
An information processing apparatus 100 comprising:
(付記2)
 付記1に記載の情報処理装置であって、
 前記蓄積管理部は、前記エンジン制御ルールが一の前記解析エンジンによる出力データを他の前記解析エンジンの入力データとする処理手順を含む場合に、前記一の解析エンジンによる出力データを前記他の解析エンジンの入力データとして、当該他の解析エンジンの前記エンジン情報に含まれる前記時間幅情報にて特定される時間幅の範囲内で保持するよう制御する、
情報処理装置。
(Appendix 2)
An information processing apparatus according to attachment 1, wherein
When the engine control rule includes a processing procedure in which output data from one analysis engine is input data to another analysis engine, the accumulation management unit outputs the output data from the one analysis engine to the other analysis. As input data of the engine, control is performed so as to be held within the range of the time width specified by the time width information included in the engine information of the other analysis engine.
Information processing device.
(付記3)
 付記1又は2に記載の情報処理装置であって、
 前記蓄積管理部は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅の範囲内で、前記複数の解析エンジンに対して入力する入力データを保持するよう制御する、
情報処理装置。
(Appendix 3)
An information processing apparatus according to appendix 1 or 2,
The accumulation management unit, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each time included in each engine information corresponding to each of the plurality of analysis engines. Controlling to hold input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information,
Information processing device.
(付記4)
 付記1乃至3のいずれかに記載の情報処理装置であって、
 前記エンジン情報に基づいて、前記エンジン制御ルールにて表される処理手順に含まれる前記解析エンジンが行う解析処理に必要な入力データの時間幅を表す蓄積ルールを設定する蓄積ルール生成手段を備え、
 前記蓄積管理部は、前記蓄積ルールにて設定された時間幅の範囲内で、前記解析エンジンに対して入力する入力データを保持するよう制御する、
情報処理装置。
(Appendix 4)
An information processing apparatus according to any one of appendices 1 to 3,
Based on the engine information, comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule,
The accumulation management unit controls to hold input data to be input to the analysis engine within a time range set by the accumulation rule.
Information processing device.
(付記5)
 付記3に記載の情報処理装置であって、
 前記エンジン情報に基づいて、前記エンジン制御ルールにて表される処理手順に含まれる前記解析エンジンが行う解析処理に必要な入力データの時間幅を表す蓄積ルールを設定する蓄積ルール生成手段を備え、
 前記蓄積ルール生成手段は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定し、
 前記蓄積管理部は、前記蓄積ルールにて設定された時間幅の範囲内で、前記解析エンジンに対して入力する入力データを保持するよう制御する、
情報処理装置。
(Appendix 5)
An information processing apparatus according to attachment 3, wherein
Based on the engine information, comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule,
The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule,
The accumulation management unit controls to hold input data to be input to the analysis engine within a time range set by the accumulation rule.
Information processing device.
(付記6)
 付記1乃至5のいずれかに記載の情報処理装置であって、
 前記エンジン情報記憶部に記憶された前記エンジン情報は、前記解析エンジンに対して入力可能な入力データの特性情報と、当該解析エンジンによる解析結果である出力データの特性情報と、を含んでおり、
 前記エンジン情報に基づいて、処理要求に対応した結果を出力可能な前記解析エンジンを選定して当該解析エンジンを用いた処理手順を表す前記エンジン制御ルールを生成するエンジン制御ルール生成手段を備えた、
情報処理装置。
(Appendix 6)
An information processing apparatus according to any one of appendices 1 to 5,
The engine information stored in the engine information storage unit includes input data characteristic information that can be input to the analysis engine, and output data characteristic information that is an analysis result by the analysis engine,
Based on the engine information, the engine control rule generating means for selecting the analysis engine capable of outputting the result corresponding to the processing request and generating the engine control rule representing the processing procedure using the analysis engine.
Information processing device.
(付記7)
 付記1乃至6のいずれかに記載の情報処理装置であって、
 前記エンジン制御部は、前記エンジン制御ルールに従って前記解析エンジンから取得した出力データに基づいて、前記エンジン制御ルールを他のエンジン制御ルールに変更し、当該他のエンジン制御ルールに従って前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行い、
 前記蓄積管理部は、変更した前記他のエンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する、
情報処理装置。
(Appendix 7)
An information processing apparatus according to any one of appendices 1 to 6,
The engine control unit changes the engine control rule to another engine control rule based on output data acquired from the analysis engine according to the engine control rule, and inputs data to the analysis engine according to the other engine control rule. Input and acquisition of output data from the analysis engine,
The accumulation management unit has input data to be input to the analysis engine according to the changed other engine control rule within a time width range specified by time width information included in the engine information of the analysis engine. Control to hold in,
Information processing device.
(付記8)
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部201を備えると共に、
 処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する蓄積ルール生成手段202を備えた、
情報処理装置200。
(Appendix 8)
The engine information storage unit 201 stores engine information including time width information that is set in advance for each analysis engine and represents the time width of input data necessary for analysis processing by the analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule generating unit 202 configured to set an accumulation rule representing a time width of the input data holding the input data input to the analysis engine based on the engine information;
Information processing apparatus 200.
(付記9)
 付記8に記載の情報処理装置であって、
 前記蓄積ルール生成手段は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定する、
情報処理装置。
(Appendix 9)
An information processing apparatus according to appendix 8, wherein
The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule.
Information processing device.
(付記10)
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置に、
 所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部と、
 前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する蓄積管理部と、
を実現させるためのプログラム。
(Appendix 10)
An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When,
Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine. An accumulation management unit to
A program to realize
(付記11)
 付記10に記載のプログラムであって、
 前記蓄積管理部は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅の範囲内で、前記複数の解析エンジンに対して入力する入力データを保持するよう制御する、
ことを実現させるためのプログラム。
(Appendix 11)
The program according to attachment 10, wherein
The accumulation management unit, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each time included in each engine information corresponding to each of the plurality of analysis engines. Controlling to hold input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information,
A program to make things happen.
(付記12)
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置に、
 処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する蓄積ルール生成手段、
を実現させるためのプログラム。
(Appendix 12)
An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule generating means for setting an accumulation rule representing a time width of the input data to hold the input data input to the analysis engine based on the engine information;
A program to realize
(付記13)
 付記12に記載のプログラムであって、
 前記蓄積ルール生成手段は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定する、
ことを実現させるためのプログラム。
(Appendix 13)
The program according to attachment 12, wherein
The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule.
A program to make things happen.
(付記14)
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置にて、
 エンジン制御部が、所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うと共に、
 蓄積管理部が、前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する
情報処理方法。
(Appendix 14)
In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
Input of input data to the analysis engine and acquisition of output data from the analysis engine according to an engine control rule representing a processing procedure using the analysis engine in which the engine control unit can output a result for a predetermined processing request As well as
The accumulation management unit has input data that the engine control unit inputs to the analysis engine in accordance with the engine control rule within a time width range specified by the time width information included in the engine information of the analysis engine. Information processing method for controlling to hold in
(付記15)
 付記14に記載の情報処理方法であって、
 前記蓄積管理部が、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅の範囲内で、前記複数の解析エンジンに対して入力する入力データを保持するよう制御する、
情報管理方法。
(Appendix 15)
The information processing method according to attachment 14, wherein
Each of the times included in each of the engine information corresponding to each of the plurality of analysis engines when the accumulation management unit includes a processing procedure for inputting the same input data to the plurality of analysis engines in the engine control rule. Controlling to hold input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information,
Information management method.
(付記16)
 解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置にて、
 処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する、
情報処理方法。
(Appendix 16)
In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
Information processing method.
(付記17)
 付記16に記載の情報処理方法であって、
 前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定する、
情報処理方法。
(Appendix 17)
The information processing method according to attachment 16, wherein
When the engine control rule includes a processing procedure for inputting the same input data to a plurality of analysis engines, it is specified by each time width information included in each engine information corresponding to each of the plurality of analysis engines. The longest time width among the time widths to be set as the accumulation rule,
Information processing method.
 なお、上記各実施形態においてプログラムは、記憶装置に記憶されていたり、コンピュータが読み取り可能な記録媒体に記録されている。例えば、記録媒体は、フレキシブルディスク、光ディスク、光磁気ディスク、及び、半導体メモリ等の可搬性を有する媒体である。 In each of the above embodiments, the program is stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.
 以上、上記各実施形態を参照して本願発明を説明したが、本願発明は、上述した実施形態に限定されるものではない。本願発明の構成や詳細には、本願発明の範囲内で当業者が理解しうる様々な変更をすることができる。 Although the present invention has been described with reference to the above embodiments, the present invention is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
 なお、本発明は、日本国にて2011年4月11日に特許出願された特願2011-086940の特許出願に基づく優先権主張の利益を享受するものであり、当該特許出願に記載された内容は、全て本明細書に含まれるものとする。 The present invention enjoys the benefit of the priority claim based on the patent application of Japanese Patent Application No. 2011-086940 filed on April 11, 2011 in Japan, and is described in the patent application. The contents are all included in this specification.
1 データ管理装置
11 監視要求受付部
12 エンジン制御部
13 エンジン制御ルール管理部
14 解析データ管理部
15 解析データ監視部
16 類似性判定ルール管理部
17 監視結果送信部
18 メディアデータ管理部
19 監視状態管理部
20 ルール生成部
21 エンジン情報管理部
22 エンジン制御ルール生成部
23 蓄積ルール生成部
24 監視ルール生成部
31,32,33 解析エンジン
4 アプリケーション
100,200 情報処理装置
101,201 エンジン情報記憶部
102 エンジン制御部
103 蓄積管理部
202 蓄積ルール生成部
 
DESCRIPTION OF SYMBOLS 1 Data management apparatus 11 Monitoring request reception part 12 Engine control part 13 Engine control rule management part 14 Analysis data management part 15 Analysis data monitoring part 16 Similarity determination rule management part 17 Monitoring result transmission part 18 Media data management part 19 Monitoring state management Unit 20 Rule generation unit 21 Engine information management unit 22 Engine control rule generation unit 23 Accumulation rule generation unit 24 Monitoring rule generation unit 31, 32, 33 Analysis engine 4 Application 100, 200 Information processing device 101, 201 Engine information storage unit 102 Engine Control unit 103 Accumulation management unit 202 Accumulation rule generation unit

Claims (17)

  1.  解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部と、
     所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部と、
     前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する蓄積管理部と、
    を備えた情報処理装置。
    An engine information storage unit that stores engine information including time width information that is set in advance for each analysis engine and represents the time width of input data necessary for analysis processing by the analysis engine;
    An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When,
    Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine. An accumulation management unit to
    An information processing apparatus comprising:
  2.  請求項1に記載の情報処理装置であって、
     前記蓄積管理部は、前記エンジン制御ルールが一の前記解析エンジンによる出力データを他の前記解析エンジンの入力データとする処理手順を含む場合に、前記一の解析エンジンによる出力データを前記他の解析エンジンの入力データとして、当該他の解析エンジンの前記エンジン情報に含まれる前記時間幅情報にて特定される時間幅の範囲内で保持するよう制御する、
    情報処理装置。
    The information processing apparatus according to claim 1,
    When the engine control rule includes a processing procedure in which output data from one analysis engine is input data to another analysis engine, the accumulation management unit outputs the output data from the one analysis engine to the other analysis. As input data of the engine, control is performed so as to be held within the range of the time width specified by the time width information included in the engine information of the other analysis engine.
    Information processing device.
  3.  請求項1又は2に記載の情報処理装置であって、
     前記蓄積管理部は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅の範囲内で、前記複数の解析エンジンに対して入力する入力データを保持するよう制御する、
    情報処理装置。
    The information processing apparatus according to claim 1 or 2,
    The accumulation management unit, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each time included in each engine information corresponding to each of the plurality of analysis engines. Controlling to hold input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information,
    Information processing device.
  4.  請求項1乃至3のいずれかに記載の情報処理装置であって、
     前記エンジン情報に基づいて、前記エンジン制御ルールにて表される処理手順に含まれる前記解析エンジンが行う解析処理に必要な入力データの時間幅を表す蓄積ルールを設定する蓄積ルール生成手段を備え、
     前記蓄積管理部は、前記蓄積ルールにて設定された時間幅の範囲内で、前記解析エンジンに対して入力する入力データを保持するよう制御する、
    情報処理装置。
    The information processing apparatus according to claim 1,
    Based on the engine information, comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule,
    The accumulation management unit controls to hold input data to be input to the analysis engine within a time range set by the accumulation rule.
    Information processing device.
  5.  請求項3に記載の情報処理装置であって、
     前記エンジン情報に基づいて、前記エンジン制御ルールにて表される処理手順に含まれる前記解析エンジンが行う解析処理に必要な入力データの時間幅を表す蓄積ルールを設定する蓄積ルール生成手段を備え、
     前記蓄積ルール生成手段は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定し、
     前記蓄積管理部は、前記蓄積ルールにて設定された時間幅の範囲内で、前記解析エンジンに対して入力する入力データを保持するよう制御する、
    情報処理装置。
    The information processing apparatus according to claim 3,
    Based on the engine information, comprising an accumulation rule generating means for setting an accumulation rule that represents a time width of input data required for the analysis processing performed by the analysis engine included in the processing procedure represented by the engine control rule,
    The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule,
    The accumulation management unit controls to hold input data to be input to the analysis engine within a time range set by the accumulation rule.
    Information processing device.
  6.  請求項1乃至5のいずれかに記載の情報処理装置であって、
     前記エンジン情報記憶部に記憶された前記エンジン情報は、前記解析エンジンに対して入力可能な入力データの特性情報と、当該解析エンジンによる解析結果である出力データの特性情報と、を含んでおり、
     前記エンジン情報に基づいて、処理要求に対応した結果を出力可能な前記解析エンジンを選定して当該解析エンジンを用いた処理手順を表す前記エンジン制御ルールを生成するエンジン制御ルール生成手段を備えた、
    情報処理装置。
    An information processing apparatus according to any one of claims 1 to 5,
    The engine information stored in the engine information storage unit includes input data characteristic information that can be input to the analysis engine, and output data characteristic information that is an analysis result by the analysis engine,
    Based on the engine information, the engine control rule generating means for selecting the analysis engine capable of outputting the result corresponding to the processing request and generating the engine control rule representing the processing procedure using the analysis engine.
    Information processing device.
  7.  請求項1乃至6のいずれかに記載の情報処理装置であって、
     前記エンジン制御部は、前記エンジン制御ルールに従って前記解析エンジンから取得した出力データに基づいて、前記エンジン制御ルールを他のエンジン制御ルールに変更し、当該他のエンジン制御ルールに従って前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行い、
     前記蓄積管理部は、変更した前記他のエンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する、
    情報処理装置。
    An information processing apparatus according to any one of claims 1 to 6,
    The engine control unit changes the engine control rule to another engine control rule based on output data acquired from the analysis engine according to the engine control rule, and inputs data to the analysis engine according to the other engine control rule. Input and acquisition of output data from the analysis engine,
    The accumulation management unit has input data to be input to the analysis engine according to the changed other engine control rule within a time width range specified by time width information included in the engine information of the analysis engine. Control to hold in,
    Information processing device.
  8.  解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えると共に、
     処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する蓄積ルール生成手段を備えた、
    情報処理装置。
    An engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine that is set in advance for each analysis engine,
    An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule generating means for setting an accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
    Information processing device.
  9.  請求項8に記載の情報処理装置であって、
     前記蓄積ルール生成手段は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定する、
    情報処理装置。
    The information processing apparatus according to claim 8,
    The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule.
    Information processing device.
  10.  解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置に、
     所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部と、
     前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する蓄積管理部と、
    を実現させるためのプログラム。
    An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
    An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a predetermined processing request When,
    Control that the engine control unit holds input data input to the analysis engine according to the engine control rule within a range of time width specified by the time width information included in the engine information of the analysis engine. An accumulation management unit to
    A program to realize
  11.  請求項10に記載のプログラムであって、
     前記蓄積管理部は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅の範囲内で、前記複数の解析エンジンに対して入力する入力データを保持するよう制御する、
    ことを実現させるためのプログラム。
    The program according to claim 10,
    The accumulation management unit, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each time included in each engine information corresponding to each of the plurality of analysis engines. Controlling to hold input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information,
    A program to make things happen.
  12.  解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置に、
     処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する蓄積ルール生成手段、
    を実現させるためのプログラム。
    An information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
    An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule generating means for setting an accumulation rule representing a time width of the input data to hold the input data input to the analysis engine based on the engine information;
    A program to realize
  13.  請求項12に記載のプログラムであって、
     前記蓄積ルール生成手段は、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定する、
    ことを実現させるためのプログラム。
    A program according to claim 12,
    The accumulation rule generating means, when the engine control rule includes a processing procedure for inputting the same input data to the plurality of analysis engines, each of the engine information corresponding to each of the plurality of analysis engines Of each time width specified by the time width information, the longest time width is set as the accumulation rule.
    A program to make things happen.
  14.  解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置にて、
     エンジン制御部が、所定の処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うと共に、
     蓄積管理部が、前記エンジン制御部が前記エンジン制御ルールに従って前記解析エンジンに対して入力する入力データを、当該解析エンジンの前記エンジン情報に含まれる時間幅情報にて特定される時間幅の範囲内で保持するよう制御する
    情報処理方法。
    In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
    Input of input data to the analysis engine and acquisition of output data from the analysis engine according to an engine control rule representing a processing procedure using the analysis engine in which the engine control unit can output a result for a predetermined processing request As well as
    The accumulation management unit has input data that the engine control unit inputs to the analysis engine in accordance with the engine control rule within a time width range specified by the time width information included in the engine information of the analysis engine. Information processing method for controlling to hold in
  15.  請求項14に記載の情報処理方法であって、
     前記蓄積管理部が、前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅の範囲内で、前記複数の解析エンジンに対して入力する入力データを前記エンジン制御部が保持するよう制御する、
    情報管理方法。
    The information processing method according to claim 14,
    Each of the times included in each of the engine information corresponding to each of the plurality of analysis engines when the accumulation management unit includes a processing procedure for inputting the same input data to the plurality of analysis engines in the engine control rule. The engine control unit controls the input data to be input to the plurality of analysis engines within the range of the longest time width among the time widths specified by the width information.
    Information management method.
  16.  解析エンジン毎に予め設定された、当該解析エンジンによる解析処理に必要な入力データの時間幅を表す時間幅情報を含むエンジン情報が記憶されたエンジン情報記憶部を備えた情報処理装置にて、
     処理要求に対する結果を出力可能な前記解析エンジンを用いた処理手順を表すエンジン制御ルールに従って、前記解析エンジンに対する入力データの入力、及び、当該解析エンジンからの出力データの取得を行うエンジン制御部が、前記解析エンジンに入力される入力データを保持する当該入力データの時間幅を表す蓄積ルールを、前記エンジン情報に基づいて設定する、
    情報処理方法。
    In an information processing apparatus including an engine information storage unit that stores engine information including time width information that represents a time width of input data necessary for analysis processing by the analysis engine, which is set in advance for each analysis engine.
    An engine control unit that inputs input data to the analysis engine and acquires output data from the analysis engine according to an engine control rule that represents a processing procedure using the analysis engine that can output a result for a processing request. An accumulation rule that represents a time width of the input data that holds the input data input to the analysis engine is set based on the engine information.
    Information processing method.
  17.  請求項16に記載の情報処理方法であって、
     前記エンジン制御ルールが同一の入力データを複数の前記解析エンジンに入力する処理手順を含む場合に、前記複数の解析エンジンにそれぞれ対応する各前記エンジン情報に含まれる各前記時間幅情報にて特定される各時間幅のうち、最も長い時間幅を前記蓄積ルールとして設定する、
    情報処理方法。
     
    An information processing method according to claim 16, comprising:
    When the engine control rule includes a processing procedure for inputting the same input data to a plurality of analysis engines, it is specified by each time width information included in each engine information corresponding to each of the plurality of analysis engines. The longest time width among the time widths to be set as the accumulation rule,
    Information processing method.
PCT/JP2012/001806 2011-04-11 2012-03-15 Information processing device WO2012140834A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2013509749A JPWO2012140834A1 (en) 2011-04-11 2012-03-15 Information processing device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-086940 2011-04-11
JP2011086940 2011-04-11

Publications (1)

Publication Number Publication Date
WO2012140834A1 true WO2012140834A1 (en) 2012-10-18

Family

ID=47009029

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/001806 WO2012140834A1 (en) 2011-04-11 2012-03-15 Information processing device

Country Status (2)

Country Link
JP (1) JPWO2012140834A1 (en)
WO (1) WO2012140834A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019103087A1 (en) * 2017-11-27 2019-05-31 日本電気株式会社 Information processing device, information processing method, and recording medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006053167A (en) * 2004-07-14 2006-02-23 Rarugo:Kk Electronic musical instrument device and playing method of virtual musical instrument and program for performance processing of virtual musical instrument and recording medium recored with its program
JP2006133937A (en) * 2004-11-04 2006-05-25 Fuji Xerox Co Ltd Behavior identifying device
JP2007124526A (en) * 2005-10-31 2007-05-17 Hitachi Ltd Image monitoring recording device and system therefor
JP2011070576A (en) * 2009-09-28 2011-04-07 Toshiba Corp Image processor and image processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006053167A (en) * 2004-07-14 2006-02-23 Rarugo:Kk Electronic musical instrument device and playing method of virtual musical instrument and program for performance processing of virtual musical instrument and recording medium recored with its program
JP2006133937A (en) * 2004-11-04 2006-05-25 Fuji Xerox Co Ltd Behavior identifying device
JP2007124526A (en) * 2005-10-31 2007-05-17 Hitachi Ltd Image monitoring recording device and system therefor
JP2011070576A (en) * 2009-09-28 2011-04-07 Toshiba Corp Image processor and image processing method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019103087A1 (en) * 2017-11-27 2019-05-31 日本電気株式会社 Information processing device, information processing method, and recording medium
JPWO2019103087A1 (en) * 2017-11-27 2020-09-24 日本電気株式会社 Information processing equipment, information processing methods and programs
US11195025B2 (en) 2017-11-27 2021-12-07 Nec Corporation Information processing device, information processing method, and storage medium for temporally dividing time-series data for analysis

Also Published As

Publication number Publication date
JPWO2012140834A1 (en) 2014-07-28

Similar Documents

Publication Publication Date Title
US9384197B2 (en) Automatic discovery of metadata
RU2701508C1 (en) Method and system of content recommendations based on user behavior information
JP2016076073A (en) Data processing device, data processing method, and computer program
US20140379346A1 (en) Video analysis based language model adaptation
US9380257B2 (en) Portable electronic equipment and method of recording media using a portable electronic equipment
WO2019137391A1 (en) Method and apparatus for performing categorised matching of videos, and selection engine
JP2009536390A (en) Apparatus and method for annotating content
US11537636B2 (en) System and method for using multimedia content as search queries
JP6142533B2 (en) Information processing device
US20130191368A1 (en) System and method for using multimedia content as search queries
KR20100018070A (en) Method and apparatus for automatically generating summaries of a multimedia file
US20150030260A1 (en) Analysis system
JP6075287B2 (en) Analysis engine controller
WO2012140834A1 (en) Information processing device
TW201435627A (en) System and method for optimizing search results
US11640426B1 (en) Background audio identification for query disambiguation
US20220188304A1 (en) Method and system for handling query in iot network
KR20190031829A (en) Electric terminal and method for controlling the same
JP5672307B2 (en) Information processing device
US20150066840A1 (en) Analysis system
KR102568143B1 (en) Method and device for providing customized service mode
JP2016535341A (en) Media content ordering system and method for ordering media content
JP2014002336A (en) Content processing device, content processing method, and computer program
KR20190076621A (en) Electronic device and method for providing service information associated with brodcasting content therein
US20150036880A1 (en) Analysis system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12771607

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013509749

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12771607

Country of ref document: EP

Kind code of ref document: A1