JP2008283726A - Monitoring apparatus, monitoring system and filter setting method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily and correctly perform a broad range of setups. <P>SOLUTION: The monitoring apparatus is provided with: a video data acquiring section for acquiring video data from a monitoring camera; a meta-data acquiring section for acquiring meta-data indicating information on a monitoring target from the monitoring camera; a display unit for displaying a setup screen on which a plurality of filters can be set; filter setting sections C3-1 to C3-3 for configuring filters using meta-data information; and a combination setting section C1 for setting combinations of the filters. In this apparatus, the filter setting sections C3-1 to C3-3 and the combination setting section C1 are provided on the same setup screen. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention acquires video data and data (metadata) related to the video data from the surveillance camera, performs a filtering process on the metadata, and outputs a monitoring result based on the filtering process result obtained by the filtering process. The present invention relates to a monitoring apparatus, a monitoring system, and a filter setting method in the monitoring apparatus.

  Conventionally, a monitoring system in which a monitoring camera and a control device are connected via a network has been used. In such a monitoring system, the monitoring camera transmits captured video data to the control device via the network. The control device records the received video data, detects the occurrence of abnormality by analyzing the video data, and outputs an alarm. The monitor can perform monitoring while confirming the monitoring video displayed on the monitor and the content of the alarm output from the control device.

  Moreover, recent surveillance cameras not only transmit captured video data to a control device, but also generate metadata (eg, alarm information, temperature information, camera angle-of-view information) regarding the captured video data, and control devices Has a function of transmitting metadata. In such a monitoring system using a monitoring camera, the control device passes the metadata supplied from the monitoring camera through a metadata filter in which a specific condition for outputting an alarm is set, and if the condition is met, an alarm is generated. Output. In the metadata filter, for example, conditions for detecting an intrusion of a suspicious object at a certain place or a moving object (object) passing through a certain boundary line as an abnormality are set.

  Patent Document 1 describes a technique in which video data of a monitoring video is supplied from a monitoring terminal (monitoring camera) to a monitoring device via a network, and the monitoring video is confirmed by the monitoring device when an abnormality occurs.

JP 2003-274390 A

  By the way, in a monitoring system that combines a monitoring camera that generates metadata and a control device that detects an abnormality by generating a metadata filter and generates an alarm, a plurality of metadata filters are successively used using metadata information. When combining and setting so as to be evaluated, it is necessary to create a setting for combining each metadata filter on a separate screen after creating each metadata filter separately.

  In addition, it takes time to confirm the effect of the metadata filter and to correct the setting of the metadata filter.

  In addition, it was necessary to enter numerical values for the detailed settings of the metadata filter. It was difficult to properly specify the size and moving speed of the object.

  The present invention has been made in view of such a point, and an object thereof is to allow various settings to be easily and accurately performed.

In order to solve the above problems, the present invention provides a video data acquisition unit that acquires video data from a monitoring camera, a metadata acquisition unit that acquires metadata indicating information related to a monitoring target from the monitoring camera, and a plurality of filter settings. The same setting screen in a monitoring apparatus including a display unit that displays a setting screen that can be used, a filter setting unit that sets a filter using metadata information, and a combination setting unit that sets a combination of a plurality of filters It is characterized in that a filter setting unit and a combination setting unit are provided.

  According to the above configuration, since the filter setting unit and the combination setting unit are provided in one setting screen, the filter setting process and the combination setting process can be performed simultaneously in one screen, and the operability of the setting work and Work efficiency is improved.

One aspect of the present invention is characterized in that the combination setting unit is a switching unit for switching a combination type of a plurality of filters provided in a setting screen displayed on the display unit.
An example of a combination of a plurality of filters that can be switched at this time is a parallel mode for outputting an alarm every time the conditions of each filter and the metadata acquired from the monitoring camera match, and the filters in the set order. This is a sequential mode for outputting one alarm when the condition matches the metadata acquired from the monitoring camera.

  According to the above configuration, the combination type, for example, the parallel mode and the sequential mode can be switched by a single operation by operating the combination setting unit.

  According to another aspect of the present invention, the filter setting unit is provided in a part of a setting screen, and sets a filter by drawing a graphic on a screen displaying video data acquired from a surveillance camera. And

  According to the above configuration, the detailed setting of the filter is not input of numerical values, but the graphic is drawn while comparing with the object (moving object) etc. on the GUI (setting screen) while actually checking the video to be monitored. , Can be set visually.

  According to the present invention, there is an effect that various settings can be easily and accurately performed.

  The best mode for carrying out the present invention will be described below with reference to the accompanying drawings. The embodiment described below analyzes metadata obtained from a monitoring camera (metadata generating camera) that generates metadata together with video data obtained by photographing an object to be detected, detects an abnormality, and outputs an alarm. The example is applied to a monitoring system.

  FIG. 1 is a diagram showing a connection configuration of a monitoring system according to an embodiment of the present invention. FIG. 1A is a system in which the management client acquires data output from the metadata generation camera via a network, and FIG. 1B is a system in which the management server acquires data output from the metadata generation camera and sends it to the browsing client. This is a system to supply (server / client system).

  First, the monitoring system 100 shown in FIG. 1A will be described. As shown in FIG. 1, the monitoring system 100 manages one or a plurality of metadata generation cameras. In this example, the number is two. The monitoring system 100 shoots an object to be monitored, generates video data, and generates metadata from the video data, and analyzes and stores the acquired video data and metadata. The management client 3 is configured to output an alarm upon detection of an error, and the network 2 that connects the metadata generation cameras 1a and 1b to the management client 3. The metadata acquired by the management client 3 from the metadata generation cameras 1a and 1b via the network 2 is analyzed via a metadata filter (hereinafter also referred to as “filter”).

  Of course, the number of metadata generation cameras, management clients, management servers, and browsing clients is not limited to this example.

  The management client 3 defines a filter package (hereinafter also referred to as “package”) configured by combining one or a plurality of filters. The management client 3 converts the alarm information from the number of moving objects and moving object conditions that satisfy the conditions of the filter group defined in the filter package by passing metadata through the filter package. Then, the management client 3 supplies the converted alarm information to an analysis processing unit that analyzes data, and analyzes the alarm information. The analysis result of the alarm information is displayed on a display unit including a display monitor. Then, the management client 3 automatically instructs each of the metadata generation cameras 1a and 1b to perform a camera operation (change zoom magnification, sound a buzzer, etc.) based on the analysis result of the alarm information. As described above, the management client 3 controls the optimum camera operation of the respective metadata generation cameras 1a and 1b automatically or as manually set by the user. The filter package and the analysis processing unit will be described in detail later.

  Here, the configuration of video data and metadata will be described. Video data and metadata are each composed of a data body and link information. In the case of video data, the data body is video data of surveillance video captured by the metadata generation cameras 1a and 1b. In the case of metadata, information indicating a monitoring target and attribute information defining a description method of this information are described. On the other hand, the link information describes association information indicating association between video data and metadata, attribute information defining a description method of the content of the information, and the like.

  As the association information, for example, a time stamp or a sequence number for specifying video data is used. The time stamp is information (time information) that gives the generation time of the video data. The sequence number is information (order information) that gives the generation order of content data. When there are a plurality of monitoring videos having the same time stamp, the generation order of the video data having the same time stamp can be identified. Further, as the association information, information for specifying a device that generates video data (for example, a manufacturer name, model name, serial number, etc.) may be used.

  Here, the description of the link information and the metadata main body uses a markup language defined for describing information exchanged on the Web (WWW: World Wide Web). If a markup language is used, information can be easily exchanged via the network 2. Furthermore, by using, for example, XML (Extensible Markup Language) used for exchanging documents and electronic data as a markup language, it is possible to easily exchange video data and metadata. When XML is used, the attribute information defining the information description method uses, for example, an XML schema.

  Video data and metadata generated by the metadata generation cameras 1a and 1b may be supplied to the management client 3 as one stream. The video data and metadata may be supplied to the management client 3 asynchronously in separate streams.

  As shown in FIG. 1B, even if the server function and the client function are divided and applied to a monitoring system constituted by the management server 11 and the browsing client 12, the same functions and effects as those in the example of FIG. Obtainable. By dividing the server function and the client function, a large amount of data can be processed by the management server 11 having high processing performance, and the processing result can be exclusively viewed by the browsing client 12 having low processing performance. By distributing the functions in this way, there is an effect that the monitoring system 100 having more flexibility can be constructed.

  Next, the detailed configuration of the management client 3 shown in FIG. 1A will be described with reference to the functional block diagram of FIG. However, each functional block of the management client 3 may be configured by hardware or may be configured by software.

  The management client 3 includes a metadata recording system 7 that stores and reproduces metadata and video data, and an analysis processing unit 5 that analyzes the metadata. First, a configuration example of the metadata recording system 7 will be described. The metadata recording system 7 includes a video buffer unit 42 that acquires video data from the metadata generation cameras 1a and 1b, a metadata buffer unit 41 that acquires metadata from the metadata generation cameras 1a and 1b, and a filtering process. A filter setting database 55 for storing filter settings, a metadata filter unit 38 for filtering metadata, a rule switching unit 35 for notifying the metadata generation cameras 1a and 1b of setting changes, and storing video data. A video data storage database 56, a metadata storage database 57 for storing metadata, a video data playback unit 39 for playing back video data, a metadata playback unit 40 for playing back metadata, and metadata and video data A playback synchronization unit 36 that synchronizes playback and video data, etc. And a Shimesuru display unit.

  The video buffer unit 42 acquires video data from the metadata generation cameras 1a and 1b, and performs a decoding process on the encoded video data. The video buffer unit 42 holds the obtained video data in a buffer (not shown) provided in the video buffer unit 42. Furthermore, the video buffer unit 42 also performs a process of sequentially supplying video data held in a buffer (not shown) to the display unit 6 that displays an image. By holding the video data in a buffer (not shown) as described above, the video data can be sequentially supplied to the display unit 6 regardless of the reception timing of the video data from the metadata generation cameras 1a and 1b. In addition, the video buffer unit 42 stores the stored video data in the video data storage database 56 based on a recording request signal supplied from a rule switching unit 35 described later. The encoded video data may be stored in the video data storage database 56 and decoded by the video data reproduction unit 39 described later.

  The metadata buffer unit 41 holds metadata acquired from the metadata generation cameras 1a and 1b in a buffer (not shown) provided in the metadata buffer unit 41. Further, the metadata buffer unit 41 sequentially supplies the held metadata to the display unit 6. Further, processing for supplying metadata held in a buffer (not shown) to a metadata filter unit 38 to be described later is also performed. By holding the metadata in a buffer (not shown) as described above, the metadata can be sequentially supplied to the display unit 6 regardless of the reception timing of the metadata from the metadata generation cameras 1a and 1b. Further, the metadata can be supplied to the display unit 6 in synchronization with the video data. Further, the metadata buffer unit 41 stores the metadata acquired from the metadata generation cameras 1 a and 1 b in the metadata storage database 57. Here, when storing metadata in the metadata storage database 57, time information of video data synchronized with the metadata is added. In this way, it is possible to read out metadata at a desired time from the metadata storage database 57 using the added time information without reading the contents of the metadata and determining the time. Become.

  The filter setting database 55 accumulates filter settings corresponding to filter processing performed by the metadata filter unit 38 described later, and supplies the filter settings to the metadata filter unit 38. This filter setting refers to, for each piece of information related to the monitoring target included in the metadata, the criteria for determining whether or not it is necessary to switch the output of the alarm or the like and the imaging operation of the metadata generation cameras 1a and 1b. It is a setting to show. By performing the metadata filtering process using this filter setting, it is possible to indicate the filtering process result for each piece of information related to the monitoring target. The filter processing result indicates that an alarm or the like needs to be output and that the imaging operation of the metadata generation cameras 1a and 1b needs to be switched.

  The metadata filter unit 38 performs filtering processing of metadata using the filter settings stored in the filter setting database 55, and determines whether or not to generate an alarm. Then, the metadata filter unit 38 performs a filtering process on the metadata acquired by the metadata buffer unit 41 or the metadata supplied from the metadata accumulation database 57, and the filter processing result is compared with the rule switching unit 35 and a filter described later. The package unit 33 is notified.

  The rule switching unit 35 generates a setting change signal based on the filter processing result notified from the metadata filter unit 38, and notifies the metadata generation cameras 1a and 1b of the setting change. For example, on the basis of the filter processing result obtained from the metadata filter unit 38, the operations of the metadata generation cameras 1a and 1b are switched so that a monitoring video suitable for monitoring is obtained. In addition, the rule switching unit 35 supplies a recording request signal to the video data storage database 56 based on the filter processing result, and stores the video data acquired by the video buffer unit 42 in the video data storage database 56. In addition, the rule switching unit 35 can select a video data accumulation mode. As the accumulation mode, for example, either the dynamic search mode or the minimum mode can be selected.

  When the dynamic search mode is selected by the user, the rule switching unit 35 displays the video data acquired by the video buffer unit 42 as a video data storage database when the filtering process result indicates that a moving object is detected. 56. When the dynamic search mode is selected, video data when a moving object is detected is accumulated. Therefore, if the stored video data is played back by the video data playback unit 39, which will be described later, and the metadata that is synchronized with the played back video data is filtered with a desired filter setting, Video data satisfying this filter setting can be searched.

  When the minimum mode is selected, the rule switching unit 35 determines the video data acquired by the video buffer unit 42 as video data when it is determined that a state of outputting a warning or an alarm has occurred according to the filter processing result. Accumulate in the accumulation database 56. When the minimum mode is selected, it is possible to easily and quickly reproduce video data in a state in which a warning or alarm is output. In addition, the amount of video data to be stored can be reduced.

  The video data storage database 56 stores video data acquired by the video buffer unit 42. The metadata accumulation database 57 accumulates the metadata acquired by the metadata buffer unit 41.

  The video data playback unit 39 performs playback processing of video data stored in the video data storage database 56. That is, the video data playback unit 39 sequentially reads video data from the playback position specified by the user, and supplies the read video data to the display unit 6. Further, the video data playback unit 39 supplies the playback position (playback time) of the video data being played back to the playback synchronization unit 36.

  A reproduction synchronization unit 36 that synchronizes reproduction of metadata and video data uses the reproduction position supplied from the video data reproduction unit 39 and the metadata accumulated in the metadata accumulation database 57 by the metadata reproduction unit 40. A synchronization control signal is supplied to the metadata reproduction unit 40 so that the reproduction position at the time of reproduction is synchronized, and the operation of the metadata reproduction unit 40 is controlled.

  The metadata playback unit 40 performs playback processing of metadata stored in the metadata storage database 57. That is, the metadata reproduction unit 40 sequentially reads metadata from the reproduction position designated by the user, and supplies the read metadata to the metadata filter unit 38 and the display unit 6. When reproducing both video data and metadata, the metadata reproduction unit 40 controls the reproduction operation based on the synchronization control signal supplied from the reproduction synchronization unit 36 as described above, and synchronizes with the video data. Output the generated metadata.

  The display unit 6 includes live (raw) video data supplied from the video buffer unit 42, reproduced video data supplied from the video data playback unit 39, and live metadata and metadata supplied from the metadata buffer unit 41. The reproduction metadata supplied from the reproduction unit 40 is displayed. The display unit 6 is based on the filter processing result using one of the monitoring video, the video of the metadata, the video of the filter setting, or the synthesized video based on the filter setting from the metadata filter unit 38. A video showing the monitoring result is displayed.

  The display unit (display module) 6 also functions as a graphical user interface (GUI). The user can define packages and filters by selecting a filter setting menu displayed on the display unit 6 using an operation key, a mouse, a remote controller, etc. (not shown), and information on each processing unit (module). In addition, the analysis result of the package and alarm information can be displayed on the GUI.

  When the display unit 6 functions as a GUI, it functions as a filter setting unit that sets a filter using metadata information and a combination setting unit that sets a combination of a plurality of filter settings set by the filter setting unit. Have. For example, when defining a package, the display unit 6 newly creates a filter setting by the GUI function according to a user's instruction or edits the filter setting stored in the filter setting database 55, and then the package setting, that is, the filter The combination mode is set. In this embodiment, individual filter settings are stored in the filter setting database 55, and package settings (such as filter combinations) are stored in the package setting database 53. The filter setting database 55 and the package setting database 53 may be configured as one database.

  The monitoring system 100 according to the present embodiment includes an analysis process, a filter package unit 33 that determines whether an alarm is generated by combining a plurality of filters, filter information in the filter package, and association between the filters. A package setting database 53 for storing (logical settings), an alarm information analysis unit 34 for analyzing alarm information output from the filter package unit 33 based on setting values of an analysis rule setting database 54 described later, and a schedule monitoring A schedule setting unit 31 for setting a specified analysis rule, a package, and an action (operation instruction for an external device) in a specified time zone; a schedule setting database 51 for recording a package and an action; various cameras and peripheral devices Direct action An action setting section 32 is characterized by comprising a action setting database 52 for recording the setting action.

  Hereinafter, functional examples of each unit and database will be described in detail.

The filter package unit 33 determines the occurrence of an alarm output by the package for a more detailed situation by combining a plurality of types of alarm information obtained from the metadata filter unit 38. The optimum camera operation can be preset by the user in units of filters or packages. For example, it is assumed that the user has set five types of filters (filter A to filter E) in a certain package. There are, for example, the following seven types of filters that can be set. Of these, any filter type can be selected.
Appearance: A filter for determining whether an object exists in an area.
Disappearance: A filter used to determine whether an object appears in an area and is out of the area.
Passing: A filter to determine whether an object has crossed a certain boundary line
Capacity (object limit): A filter to determine whether the number of objects in a certain area has exceeded a specified value.
Loitering: A filter for determining whether or not an object has stayed in an area over a specified time
Unattended: A filter for determining whether or not there is an object that has entered a certain area and has not moved beyond a predetermined time.
Removed: A filter to detect that an object that existed in an area has been removed.

  Package setting is either when alarm information is output when all filter conditions are met, when filter A and filter B settings are met, or when filter C and filter D settings are met You can set any combination of logic between filters, such as outputting alarm information. For example, the package alarm information is only displayed when a person enters a certain place (filter A “existence” is true in one place) and a guard is not in a predetermined place (filter B “disappearance” in another place is true). And so on.

The package setting database 53 is a database that can store a package defined in the filter package unit 33. Examples of information that the database should have are described below.
1. Package number (or package name): Uniquely identifies the filter package.
2. Filter number (or filter name): Uniquely identifies the filter alarm information. If a filter alarm number is assigned for each camera, the camera number may also be required.
3. Inter-filter logic: The logic of how filters are combined. It consists of a logical product (AND or sequential) combination and a logical sum (OR or parallel) combination.

  The alarm information analysis unit 34 analyzes the alarm information obtained from the filter package unit 33, causes the camera or peripheral device to perform an optimal operation, and gives information to the display unit 6. Analysis type is “Continuous time” (If the alarm continues for the specified time, even if it is an impulse wave alarm, it is considered as a square wave alarm), “Frequency” (more than the specified number of alarm information can be obtained within the specified time) ), “Occupied area” (an object having a specified ratio or more exists in the specified range), etc., and the user can newly define it. Based on the analysis result, the package is reselected, various actions are executed, and the schedule is changed.

The analysis rule setting database 54 is a database that can store analysis rules defined in the alarm information analysis unit 34. Examples of information that the database should have are described below.
1. Analysis rule number (or analysis rule name): Uniquely identifies alarm analysis information.
2. Package number (or package name): A package used for alarm analysis is uniquely identified.
3. Analysis type: Analysis type such as “continuous time”, “occurrence frequency”, “occupied area”.
4). Detailed analysis settings: Operations when conditions are satisfied, such as detailed setting items required for the analysis type (such as time and threshold frequency), action execution, package changes, analysis rule changes, etc.

  The schedule setting unit 31 changes the analysis rule according to the time zone. For example, it is possible to assume usage such as analyzing the “occurrence frequency” rule during business hours to determine the situation such as an automatic door being pinched, and switching to an “intrusion” alarm after closing the store to determine the alarm status by the intrusion itself.

The schedule setting database 51 is a database that can store the schedule defined in the schedule setting unit 31. Examples of information that the database should have are described below.
1. Schedule number (or schedule name): The schedule information is uniquely identified.
2. Start time: Year / month / day / hour / minute / second at which the schedule starts.
3. End time: Year, month, day, hour, minute and second when the schedule ends.
4). Analysis rule number: A number for identifying an analysis rule to be applied in the schedule.

  The action setting unit 32 executes the specified action based on the alarm information analysis result. If movements such as “tracking”, “zoom”, and “light on” are designated, the zoom magnification and pan / tilt angle are automatically designated based on the number of moving objects and position information included in the alarm information. You can also set detailed actions manually. In addition, camera settings can be changed. In addition to changing camera settings, when there is a moving object, the video is recorded and the filter is dynamically changed later to search for the corresponding video, and the filter is applied. It is possible to switch between the minimum recording mode and the two recording modes in which recording is performed only at the time of recording.

The action setting database 52 is a database that can store action settings. Examples of information that the database should have are described below.
1. Action number (or action name): Uniquely identifies action setting information.
2. Action type: “Pan / Tilt”, “Zoom”, “Light ON”, etc.
3. Detailed settings: Set the detailed information for manual settings.

<Description of operation>
Next, a processing example of each unit of the management client 3 will be described.

  First, a processing example of the filter package unit 33 will be described with reference to FIG. The filter package unit 33 creates a package by logically connecting a plurality of filters, and performs a notification process. First, the filter package unit 33 acquires alarm information of a related filter from the metadata buffer unit 41 (step S1). Next, the filter package unit 33 processes the alarm information using the package setting database 53 used by each package (step S2).

  When the filter package unit 33 processes the alarm information, the filter package unit 33 determines whether the alarm information analysis unit 34 needs to be notified (step S3). If it is determined that notification is not necessary, the filter package unit 33 returns to the process of step S1. On the other hand, if it is determined that notification is necessary, the filter package unit 33 creates notification contents combining the filter alarm and the package alarm (step S4). The filter package unit 33 notifies the alarm information analysis unit 34 of the notification content (step S5).

  Next, the filter package unit 33 determines whether or not there is a package setting change request (step S6). If it is determined that there is no setting change request, the filter package unit 33 returns to the process of step S1. On the other hand, when determining that there is a setting change request, the filter package unit 33 changes the setting of the package (step S7).

  Then, the filter package unit 33 determines whether there is an end request (step S8). If it is determined that there is no termination request, the filter package unit 33 returns to the process of step S1. On the other hand, if it is determined that there is an end request, the filter package unit 33 ends the process.

  Next, a processing example of the alarm information analysis unit 34 will be described with reference to FIG. The alarm information analysis unit 34 analyzes the acquired alarm information and performs processing for instructing execution of an action, change of a schedule, and change of a package. First, the alarm information analysis unit 34 acquires alarm information of a related filter from the filter package unit 33 (step S11). Next, the alarm information analysis unit 34 processes the alarm information using the analysis rule setting database 54 (step S12).

  When the alarm information analysis unit 34 processes the alarm information, the alarm information analysis unit 34 determines whether an action needs to be executed (step S13). When determining that the execution of the action is not necessary, the alarm information analysis unit 34 returns to the process of step S11. On the other hand, when it is determined that the action needs to be executed, the alarm information analysis unit 34 creates notification contents describing the action to be executed (step S14). And the alarm information analysis part 34 notifies the notification content to the action setting part 32 (step S15).

  Next, the alarm information analysis unit 34 determines whether or not there is a schedule change request (step S16). If it is determined that there is no schedule change request, the process returns to step S11. On the other hand, when it is determined that there is a schedule change request, the alarm information analysis unit 34 creates notification contents describing the schedule contents to be set (step S17). And the alarm information analysis part 34 notifies the notification content to the schedule setting part 31 (step S18).

  Next, the alarm information analysis unit 34 determines whether or not there is a package change request (step S19). If it is determined that there is no package change request, the process returns to step S11. On the other hand, if it is determined that there is a package change request, the alarm information analysis unit 34 creates notification contents describing the package contents to be set (step S20). Then, the alarm information analysis unit 34 notifies the notification content to the filter package setting unit 33 (step S21).

  Then, the alarm information analysis unit 34 determines whether there is an end request (step S22). If it is determined that there is no termination request, the alarm information analysis unit 34 returns to the process of step S11. On the other hand, when determining that there is an end request, the alarm information analysis unit 34 ends the process.

  Next, a processing example of the schedule setting unit 31 will be described with reference to FIG. The schedule setting unit 31 performs a process of creating a schedule and executing an analysis rule specified within the schedule period. First, the schedule setting unit 31 processes the schedule information for each schedule using the schedule setting database 51 (step S31).

  When the schedule setting unit 31 processes the schedule information, the schedule setting unit 31 determines whether it is within the schedule (step S32). If it is determined that it is not within the schedule, the schedule setting unit 31 returns to the process of step S31. On the other hand, when determining that it is within the schedule, the schedule setting unit 31 creates a notification content describing the analysis rule (step S33). The schedule setting unit 31 notifies the alarm information analysis unit 34 of the notification content (step S34).

  Then, the schedule setting unit 31 determines whether or not there is a schedule setting change request (step S35). When it is determined that there is no schedule setting change request, the schedule setting unit 31 returns to the process of step S31. On the other hand, when it is determined that there is a schedule setting change request, the schedule setting unit 31 changes the schedule setting using the schedule setting database 51 (step S36).

  Then, the schedule setting unit 31 determines whether or not there is an end request (step S37). When it is determined that there is no termination request, the schedule setting unit 31 returns to the process of step S31. On the other hand, when it is determined that there is an end request, the schedule setting unit 31 ends the process.

  Next, a processing example of the action setting unit 32 will be described with reference to FIG. The action setting unit 32 performs processing for creating an action and causing the camera or peripheral device to execute the action. First, the action setting unit 32 processes each action using the action setting database 52 (step S41).

  After processing the action content, the action setting unit 32 determines whether or not there is an action execution request (step S42). When determining that there is no action execution request, the action setting unit 32 returns to the process of step S41. On the other hand, if it is determined that there is an action execution request, the action setting unit 32 creates notification contents describing actions such as action setting change and pan / tilt (step S43). Then, the action setting unit 32 notifies the notification contents to the camera, peripheral devices, and the like (step S44).

  Then, the action setting unit 32 determines whether or not there is a termination request (step S45). When determining that there is no termination request, the action setting unit 32 returns to the process of step S41. On the other hand, when determining that there is an end request, the action setting unit 32 ends the process.

  Next, an example of related processing between modules will be described.

  First, an example of processing for obtaining one result by applying a package (filter group) to metadata received from a plurality of metadata generation cameras 1a and 1b will be described with reference to FIG. First, the user registers filters such as “exist” and “stay” by using the filter package unit 33 (step S51), and sets the inter-filter logic (step S52). The setting contents are stored in the package setting database 53.

  And the filter package part 33 transmits alarm information to the alarm information analysis part 34 (step S53). The alarm information analysis unit 34 receives the alarm information from the filter package unit 33 (step S54). The received alarm information includes a package alarm from a package that newly matches the inter-filter logic, in addition to the filter alarm from each filter.

  The alarm information analysis unit 34 analyzes the received alarm information based on the analysis rule setting database 54, and performs an operation according to the analysis rule (step S55). Then, the alarm information analysis unit 34 transmits necessary instructions to the action setting unit 32, the filter package unit 33, and the schedule setting unit 31. When executing an action, an action number is designated in the action setting unit 32 (step S56). The action setting unit 32 reads an action based on the specified action number from the action setting database 52 and executes the action. When reselecting the filter or package, the filter package unit 33 is instructed to change the setting (step S56). The filter package unit 33 reads the filter and package from the package setting database 53 and writes the reselected filter and package to the package setting database 53. When changing the schedule, the schedule setting unit 31 is instructed to change the setting (step S58). The schedule setting unit 31 reads the schedule from the schedule setting database 51 and writes the changed schedule into the schedule setting database 51.

  Next, a filter package setting method in the management client 3 will be described. FIG. 8 shows a display example of video data and metadata by the display unit 6 of the management client 3 in the present embodiment.

  As shown in FIG. 8, video data 1001 and metadata 1002 captured by the metadata generation cameras 1 a and 1 b are supplied to the management client 3 via the network 2. The types of metadata generated by the metadata generation cameras 1a and 1b include time, moving body information (for example, position, type, status, etc.) of the video analysis result, the current camera state, and the like. It is also effective when the metadata generation camera is provided with a software module of a management client or management server and operates without a network.

  As described above, the management client 3 acquires, analyzes, and stores the video data 1001 and the metadata 1002 supplied from the metadata generation cameras 1a and 1b. Video data 1001 and metadata 1002 input to the management client 3 are stored in the video data DB 56 and the metadata DB 57. The management client 3 has a filter setting function, sets various filters on a filter setting screen (filter setting menu) displayed on the display unit 6, and stores filter information in the filter setting database 55. In the filter setting display screen 1003 shown in FIG. 8, the boundary line LN and the area PA generated by the filter setting are displayed. An arrow PB indicates a Passing (crossing) direction to be detected with respect to the boundary line LN. Using the filter information set in this way, the objects (moving objects) MB1 to MB3 in the video are detected by the metadata filter unit 38 and displayed as the monitoring video 1004 synchronized with the video data 1001 by the display unit 6. When an object is detected by a certain filter, the monitoring system 100 generates an alarm. For example, moving object frames H1 to H3 are displayed around the detected objects MB1 to MB3, respectively.

  FIG. 9 shows the concept of a filter package configured by combining one or a plurality of filters. As shown in FIG. 9, a plurality of filters for metadata are packaged. In this example, one package is composed of a combination of a maximum of three filters and a maximum of six non-detection areas.

  There are two types of combinations: sequential mode (continuous mode) and parallel mode (parallel mode). In the parallel mode, an alarm as a package is generated each time each filter detects an object. On the other hand, in the sequential mode, one alarm is generated as a package when the filter detects an object within a predetermined combination interval within a set order. The package is set individually for each metadata generation camera.

<Description of setting operation>
FIG. 10 shows an outline of the package setting screen. On this package setting screen, one package can be set by one setting operation.

<Filter overview settings>
1. Filter name In area C2, each of the three filters can be given a name. The default filter names C2-1 to C2-3 are Filter1 to Filter3, respectively.
2. Filter Type Selection Each filter type (Filter Type) for three filters can be selected from the filter type lists C3-1 to C3-3. The filter types that can be selected in this example are, for example, the following seven types.
Appearance / Disappearance / Loitering / Capacity / Passing / Unattended / Removed
3. Enable / disable
With the enable / disable buttons C4-1 to C4-3, it is possible to set whether or not to use each filter. Even if the detailed setting of the filter is performed, it is not used for the filtering process if it is set to the disabled state. Even in the invalid state, the setting is saved, so that it can be easily returned to a usable state. In this example, “A” is displayed when the setting is valid.

  In the example of FIG. 10, since the valid / invalid buttons C4-1 to C4-3 of Filter1 to Filter3 are displayed as “A”, all three filters are valid. If the Filter2 valid / invalid button C4-2 is “invalid”, the package includes Filter1 and Filter2. At this time, the filter package shown in FIG. 9 is configured such that the filter 1 with the filter ID 0 is set first, and the filter 3 with the filter ID 2 is set second.

<Combination settings>
1. Sequential / parallel
The radio button can be used to select the combination setting C1, that is, the sequential mode or the parallel mode. When the parallel mode is selected, if an object is detected in any of the filters from Filter1 to Filter3, the alarm is set for this package. On the other hand, when the sequential mode is selected, an alarm is raised as a package only when objects are detected in the order set from Filter1 to Filter3. In sequential mode, no alarm is generated even if an object of Filter2 is detected before Filter1. When the sequential mode is selected, the sequential mode displays C7-1 and C7-2 with arrows are displayed, and it can be seen that there is a continuous relationship between the filters. When the parallel mode is selected, the arrow is not displayed, so that it can be seen that the filters are set in parallel.

2. Filter order change The filter evaluation order can be changed by the filter change buttons C6-1 and C6-2. The order of Filter1 and Filter2 can be changed by the filter change button C6-1, and the order of Filter2 and Filter3 can be changed by the filter change button C6-2. There is no need to reset the filter for replacement.

3. Filter Evaluation Interval By entering a numerical value in the filter evaluation interval input fields C8-1 and C8-2, the handling of the object detection interval between filters can be changed. Even if an object is continuously detected, such as Filter 1 first and then Filter 2, if the detected time interval exceeds a preset time limit, no alarm is generated as a package.

<Non-detection area setting>
When filtering an object in the non-detection area list C5, an area (non-detection area) where detection is not performed can be set. Up to six can be set for one package. The size of the non-detection area can be changed.

<Filter detection area setting and effect confirmation>
By pressing the filter setting edit C9-1 to C9-3 buttons, the effect of the filter can be confirmed on a screen C16 provided at one corner of the setting screen. Only one button group (C9-1 to C9-3) can be pressed at any time. When the C9-1 to C9-3 buttons are pressed, the buttons are recessed so that you can immediately see which filter is currently set / checked. Further, these buttons do not depend on the states of the valid / invalid buttons C4-1 to C4-3, and it is possible to check the setting of a filter in a disabled state. The filter detection area is set not by numerical values but by drawing graphics. The setting method (graphic drawing method) differs depending on the filter type.

1. Polygon drawing method: Existence / Disappearance / Loitering / Capacity / Unattended / Removed
A region is set by left-clicking the mouse (an example of a pointing device) on screen C16 and specifying the vertex of the polygon. In this example, a maximum of octagonal convex polygons can be set. After determining the start point, the next vertex of the polygon is determined by left-clicking on any point on the screen. The next vertex and the previous vertex are connected by a straight line each time. The vertex can only be hit in one direction, clockwise or counterclockwise. When the eighth vertex is hit, a polygon 1010 is automatically created (FIG. 11). When creating the polygon 1011 with less than 8 points, the point of the point to be closed is selected as the next dot point or double-clicked at the next dot point. Thereby, the inside of the polygon 1011 is set as a filtering area (FIG. 11). The determination of the previous point can be canceled (cancelled) by right-clicking. When a polygon is not created, for example, the largest quadrangle that matches the image size is automatically set as the detection area.

2. Line drawing method with arrows: Passing
Two points on the screen C16 are left-clicked with the mouse to create a line segment 1012 as shown in FIG. An arrow 1013 is drawn at the midpoint of the line segment 1012 perpendicular to the line segment 1012. The direction of the arrow determines whether the Passing filter has passed through the line, and an alarm is generated. The direction of the arrow is changed, for example, by left-clicking near the midpoint of the line segment. The default (initial setting) is bi-directional, and each time it is clicked, it can be switched from bi-directional (to the screen C16 or line segment 1012) rightward (arrow 1014) → leftward (arrow 1015) → bidirectional.

  Regarding the confirmation of the non-detection area setting by the non-detection area setting confirmation button C9-4, the settings from Filter 1 to Filter 3 are also valid for one non-detection area selected from the list, and the setting can be confirmed.

  On the screen C16, the LIVE / PLAYBACK (live / playback) video is always displayed, so you can make settings in real time according to the video and check the setting results.

<Confirmation of filter package effect>
The filter package operation confirmation button C10 can be used to confirm the operation of the filter package. The operation at this time depends on the combination setting C1 and the selection state of the valid / invalid buttons C4-1 to C4-3.

<Detailed filter settings>
Detailed filter settings can be made. When the filter type is selected in the filter type settings C3-1 to C3-3, only options that can be set in each filter can be automatically edited in C11 / C12 / C13. The setting is performed by drawing a rectangle, a polygon or a line segment with the mouse on the screen C16.

1. Maximum / minimum size (max / min size) setting Maximum / minimum size of objects to be filtered can be set with the maximum / minimum size setting buttons C11-1 and C11-2. An object larger than the maximum size set here and an object smaller than the minimum size are not detected.

  This maximum / minimum size setting uses a rectangular drawing method. As shown in FIG. 13, an area is set by dragging an arbitrary point 1020 on the screen C16 with the mouse and specifying the width of the rectangle. By starting dragging with the left button of the mouse pressed, creation of a rectangle with the left button pressing point 1020 as the origin is started. The rectangle 1022 is determined by releasing the left mouse button at an arbitrary point 1021 after dragging. After the rectangle 1022 is determined, the size of the rectangle can be changed by placing the mouse cursor on one of the four vertices of the top, bottom, left, and right sides of the rectangle, and holding down the left mouse button and starting dragging. Is possible. The rectangle can be moved by moving the mouse cursor inside the rectangle and dragging it while holding down the left mouse button. By clicking the maximum size setting button C11-1 or the minimum size setting button C11-2, you can enter the editing mode, and the button is displayed in a recessed state, so you can immediately see which editing mode you are in. Yes. When the rectangle is drawn small (large) so that the maximum (minimum) size setting does not become smaller (larger) than the minimum (maximum) size setting, the minimum (maximum) size setting is automatically made smaller (larger). Regardless of the setting of the drawing position, the horizontal and vertical widths of the rectangle are valid.

2. Maximum / minimum speed (max / min speed) setting Maximum / minimum speed of objects to be filtered can be set with the maximum / minimum speed setting buttons C12-1 and C13-1. Objects that move faster than the maximum speed or objects that move slower than the minimum speed on the screen C16 are not detected.

  This maximum / minimum speed setting uses a line segment drawing method. As shown in FIG. 14, two points on the screen C16 are clicked with the mouse to determine the length of the line segment. The length (for example, 100 pixels) is automatically measured and reflected in the pixel display columns C12-2 and C13-2. The pixel display fields C12-2 and C13-2 are only for display, and the user cannot change the set values. The user designates the speed of the object MB by inputting a numerical value in the second setting column C12-3 and C13-3. The designation method is how many seconds the object MB moves the distance of the line segment drawn on the screen C16. When the maximum speed setting for a line segment is specified as 3 seconds, an object that has passed the same distance as that line segment within 3 seconds in the screen C16 is not detected. Conversely, when the number of seconds is set to 3 seconds in the minimum speed setting, an object that has passed the same distance over 3 seconds is not detected. Only Appearance / Disappearance / Passing can be set for the maximum / minimum speed. Regardless of the setting and position of the drawing, the length of the line segment is effective.

3. Non-detection area setting The polygon detection method is used to set the non-detection area. The inside of the polygon is the non-detection area. Select one from the non-detection area list C5.

4). Option setting The option setting area C15 displays options that can be set according to the filter type. 15A to 15C show examples of option setting screens.
-Number of objects (Capacity)
The number-of-objects setting column C15-1 sets how many objects or more are detected in the Capacity filter and an alarm is generated.
・ Collision
The collision determination setting column C15-2 sets which corner of the moving object frame 1023 of the object MB is to generate an alarm when it completely exceeds the line in the Passing filter (see FIG. 16).
・ Duration
The period setting field C15-3 sets how many seconds an object stays in the Loitering filter to generate an alarm. In addition, the time until the object is recognized as an unmoving object / removed in the Unattended / Removed filter is set.

5. Deletion of setting The drawing figure being edited on the screen C16 can be deleted by a cancel button C14.

<Switching live / playback>
With the live mode selection button C17-1 and the playback mode selection button C17-2, the camera image displayed on the screen C16 can be switched between the playback (LIVE) mode and the playback (PLAYBACK) mode. Thereby, the software controller displayed in area C18 is switched. FIGS. 17A and 17B show examples of soft controllers.

1. Live (LIVE) Mode In the live mode, as shown in FIG. 17A, a pan / tilt button C18-1, a zoom button C18-2, and a preset button C18-3 are displayed. The preset button is a button for registering the initial position of the metadata generation camera in advance, and can be returned to the initial position registered instantaneously by a home position operation. In addition, an enlargement / reduction button or the like may be displayed.
2. Playback (PLAYBACK) Mode In the playback mode, as shown in FIG. 17B, various playback system buttons C18-4, a search button C18-5, and a shooting time C18-6 are displayed. The search is executed based on the date and time, for example. In addition, a timeline indicating the elapsed time from the reference reproduction time may be displayed.

According to the present invention configured as described above, it is possible to simultaneously set a filter and a filter combination (sequential or parallel) within one screen.
Since a predetermined number, for example, three filter setting fields are arranged in order from the beginning when the filter is set, the user can set the filter while paying attention to packaging when setting the sequential filter. In addition, since the operation set for each filter can be confirmed by the filter setting edit buttons C9-1 to C9-3, it is confirmed whether the effective setting is made step by step when setting the sequential filter. can do. The order of filters can be changed with a single click of the filter replacement buttons (C6-1, C6-2), and the valid / invalid buttons (C4-1 to C4-3) for filters that have already been set. The filter function can be disabled while the settings are saved. The filter combination can be switched with a single click, and the combination setting C1 can be easily grasped by displaying the combination setting C1.

  In addition, the detailed setting of the filter is not a numerical value, but is compared with the object information (size, moving speed, etc.) on the GUI (screen C16) while actually watching the image to be monitored, and the figure is displayed on the screen C16. It can be specified by drawing. In the setting method using only numerical values, it is difficult for the user to digitize the actual size and speed of the object, and it is difficult to set the filter appropriately. However, you can visually set the same size, the same speed, and an arbitrary area as the target you want to actually filter by setting the filter by drawing while watching any live video or playback video. A filter with less detection can be set.

  As a filter setting method, it is also possible to set a filter by selecting an object in the video (on the screen C16). In this case, for example, if the maximum / minimum size is set, the same effect as that of drawing an object of the same size can be obtained by clicking an object at an arbitrary moment in the video. Also, when setting the moving speed, you can follow the moving object in the video and click twice to calculate the moving speed in the video from the position and time difference between the first and next clicks. It is. By copying the filter setting information between the cameras, the setting contents can be easily edited by making fine adjustments for the copy destination camera when similar settings are made.

  It should be noted that the detailed filter settings (filter detection area graphic) can be set so that the position and size of the metadata generation camera are dynamically changed according to the pan / tilt operation or zoom-in / zoom-out operation of the metadata generation camera. is there.

  The series of processes in the above-described exemplary embodiment can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing programs that make up the software into a computer built into dedicated hardware, or by installing various programs. For example, a general-purpose personal computer or the like installs and executes a program constituting desired software.

  In addition, a recording medium recording software program codes for realizing the functions of the above-described exemplary embodiments is supplied to a system or apparatus, and a computer (or a control device such as a CPU) of the system or apparatus is stored in the recording medium. Needless to say, this can also be achieved by reading and executing the program code.

  As a recording medium for supplying the program code in this case, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like is used. Can do.

  Further, by executing the program code read by the computer, not only the functions of the above-described exemplary embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs actual processing. In some cases, the functions of the above-described exemplary embodiments are realized by performing part or all of the above.

  Further, in this specification, the step of describing the program constituting the software is not limited to the processing performed in time series according to the described order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  Furthermore, the present invention is not limited to the above-described embodiments, and various other configurations can be taken without departing from the gist of the present invention.

It is a figure which shows the structural example of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the example of an internal structure of the management client which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the filter package part which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the alarm information analysis part which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the schedule setting part which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the action setting part which concerns on one Embodiment of this invention. It is a flowchart chart which shows the process example at the time of applying a package filter to metadata based on one Embodiment of this invention. 4 is a display example of video data and metadata according to an embodiment of the present invention. It is a figure explaining the concept of the filter package which concerns on one Embodiment of this invention. It is a figure which shows an example of the package setting screen which concerns on one Embodiment of this invention. It is a figure where it uses for description of the polygon drawing system which concerns on one Embodiment of this invention. It is a figure where it uses for description of the line drawing system which concerns on one Embodiment of this invention. It is a figure where it uses for description of the maximum / minimum size setting which concerns on one Embodiment of this invention. It is a figure where it uses for description of the maximum / minimum speed setting which concerns on one Embodiment of this invention. It is a figure where it uses for description of the setting screen (filter setting option) which concerns on one Embodiment of this invention. It is a figure where it uses for description of the collision determination which concerns on one Embodiment of this invention. It is a figure with which it uses for description of the setting screen (live / reproduction | regeneration mode switching) which concerns on one Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1a, 1b ... Metadata production | generation camera, 2 ... Network, 3 ... Management client, 11 ... Management server, 12 ... Viewing client, 5 ... Analysis processing part, 6 ... Display part, 7 ... Metadata recording system, 33 ... Filter package 38, metadata filter unit, 39 ... video data reproduction unit, 40 ... metadata reproduction unit, 53 ... package setting database, 54 ... analysis rule setting database, 55 ... filter setting database, 1001 ... video data, 1002 ... meta Data, 1003 ... Filter setting display screen, 1004 ... Monitoring video, H1, H2, H3 ... Moving object frame, LN ... Border line, MBI, MB2, MB3 ... Moving object, PA ... Area, C1 ... Combination setting, C2-1 to C2 -3 ... Filter name, C3-1 to C3-3 ... Filter type list, C4-1 to C4-3 ... Enable / Disable button, C5 ... Non-detection area list , C6-1 to C6-2 ... Filter replacement button, C7-1 to C7-2 ... Sequential mode display, C8-1 to C8-2 ... Filter evaluation interval, C9-1 to C9-3 ... Filter setting edit button, C9-4 ... Non-detection area setting confirmation button, C10 ... Filter package operation confirmation button, C11-1 to C11-2 ... Maximum / minimum size setting button, C12-1, C13-1 ... Maximum / minimum speed setting button, C12 -2, C13-2 ... Pixel display field, c12-3, c13-3 ... Seconds setting field, C15 ... Option setting area, C15-1 ... Object number setting field, C15-2 ... Collision judgment setting field, C15- 3 ... Period setting field, C16 ... Screen, C17-1 ... Playback mode selection button, C17-2 ... Playback mode selection button

Claims (7)

A video data acquisition unit for acquiring video data from the surveillance camera;
A metadata acquisition unit for acquiring metadata indicating information related to a monitoring target from the monitoring camera;
A display unit for displaying a setting screen for setting a plurality of filters;
A filter setting unit for setting a filter using the metadata information;
A combination setting unit for setting a combination of the plurality of filters,
The monitoring apparatus, wherein the filter setting unit and the combination setting unit are provided on the same setting screen. The monitoring apparatus according to claim 1, wherein the combination setting unit is a switching unit for switching a combination type of the plurality of filters provided in a setting screen displayed on the display unit. The combination type of the plurality of filters is a parallel mode for outputting an alarm every time the condition of each filter matches the metadata acquired from the monitoring camera,
The monitoring device according to claim 2, wherein the monitoring device is a sequential mode for outputting one alarm when a filter condition matches metadata acquired from the monitoring camera in a set order. The monitoring device according to claim 1, wherein the filter setting unit is a valid / invalid setting unit for setting whether or not to use the plurality of filters provided in a setting screen displayed on the display unit. . The monitoring apparatus according to claim 1, wherein the filter setting unit is provided in a part of the setting screen and sets a filter by drawing a graphic on a screen on which video data acquired from the monitoring camera is displayed. In a monitoring system configured using a monitoring camera and a monitoring device that generate video data of monitoring video and metadata indicating information on a monitoring target,
The monitoring device
A video data acquisition unit for acquiring video data from the surveillance camera;
A metadata acquisition unit for acquiring metadata indicating information related to a monitoring target from the monitoring camera;
A display unit for displaying a setting screen for setting a plurality of filters;
A filter setting unit for setting a filter using the metadata information;
A combination setting unit for setting a combination of the plurality of filters,
The monitoring system, wherein the filter setting unit and the combination setting unit are provided on the same setting screen. A video data acquisition step of acquiring video data from the surveillance camera;
A metadata acquisition step of acquiring metadata indicating information related to a monitoring target from the monitoring camera;
Displaying a setting screen having a function of setting a plurality of filters and a function of setting a combination of a plurality of filters on a display unit;
Setting a filter using metadata information on the setting screen;
Setting a combination of a plurality of filters on the setting screen.