JP2008016897A - Monitoring apparatus, monitoring system and monitoring method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To grasp the status of a moving object in detail in accordance with various settings of filters. <P>SOLUTION: When monitoring is executed using a monitoring camera for generating video data of a monitoring video image and meta-data indicating information of a monitoring target and a monitoring apparatus; the video data are acquired from the monitoring camera, and the meta-data indicating the information of the monitoring target are acquired from the monitoring camera. Subsequently, a meta-data filter executes filter processing of the meta data using filter settings accumulated in a filter setting accumulator. Then, coordinates of a detecting area PA of the filter and coordinates of a moving object 1010 on the video data are acquired from the meta-data filter, a filter alarm start distance set in the filter setting accumulator is acquired, alarm information corresponding to the distance is generated between the moving object 1010 and the detecting area PA, and a monitoring result is outputted on the basis of the generated alarm information. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention acquires video data and data (metadata) related to the video data from the surveillance camera, performs a filtering process on the metadata, and outputs a monitoring result based on the filtering process result obtained by the filtering process. The present invention relates to a monitoring device, a monitoring system, and a monitoring method.

  Conventionally, a monitoring system in which a monitoring camera and a control device are connected via a network has been used. In such a monitoring system, the monitoring camera transmits captured video data to the control device via the network. The control device records the received video data, detects the occurrence of abnormality by analyzing the video data, and outputs an alarm. The monitor can perform monitoring while confirming the monitoring video displayed on the monitor and the content of the alarm output from the control device.

  Moreover, recent surveillance cameras not only transmit captured video data to a control device, but also generate metadata (eg, alarm information, temperature information, camera angle-of-view information) regarding the captured video data, and control devices Has a function of transmitting metadata. In such a monitoring system using a monitoring camera, the control device passes the metadata supplied from the monitoring camera through a metadata filter in which a specific condition for outputting an alarm is set, and if the condition is met, an alarm is generated. Output. In the metadata filter, for example, conditions for detecting an intrusion of a suspicious object at a certain place or a moving object (object) passing through a certain boundary line as an abnormality are set.

  Patent Document 1 describes a technique in which video data of a monitoring video is supplied from a monitoring terminal (monitoring camera) to a monitoring device via a network, and the monitoring video is confirmed by the monitoring device when an abnormality occurs.

JP 2003-274390 A

  By the way, in a conventional monitoring system that combines a monitoring camera that generates metadata and a control device that detects an abnormality by a metadata filter and generates an alarm, the result of determining whether the detected moving object is an alarm is an alarm. Since it was only possible to recognize the target moving object or determine whether or not it is an alarm target, it was difficult to determine the moving object that was likely to be an alarm target in advance among a plurality of moving objects.

  In addition, there is no means to express stepwise alarms in the process of continuous filter operation when multiple filters are combined to set up only a series of continuous filter operations as an alarm (sequential setting). It was.

  The present invention has been made in view of such a point, and an object thereof is to make it possible to grasp the state of a moving object according to various filter settings.

  In order to solve the above-described problem, an aspect of the present invention provides a video from a monitoring camera when monitoring is performed using a monitoring camera and a monitoring apparatus that generate video data of the monitoring video and metadata indicating information on the monitoring target. While acquiring data, the metadata which shows the information regarding the monitoring object is acquired from this monitoring camera. Next, the metadata filter unit performs metadata filtering using the filter settings stored in the filter setting storage unit. Then, the coordinates of the detection area of the filter and the coordinates of the moving object on the video data are acquired from the metadata filter unit, the filter warning start distance set in the filter setting storage unit is acquired, and the distance between the moving object and the detection area is acquired. According to this, the alarm information corresponding to is generated, and the monitoring result is output based on the generated alarm information.

  According to the said structure, according to the setting of a filter, the present state of the moving body with respect to a filter can be expressed. Accordingly, it is possible to determine a moving object that is predicted to be an alarm from a plurality of moving objects before an alarm is generated.

  In addition, according to another aspect of the present invention, in the above aspect of the present invention, a filter package setting accumulation unit that further accumulates combination information of a plurality of filter settings, and a filter setting and a filter that are accumulated in the filter setting accumulation unit. A filter package unit that performs metadata filtering using the combination setting stored in the package setting storage unit, and the moving object alarm state determination unit is based on the combination information stored in the filter package setting storage unit, Alarm information corresponding to the distance between the moving object and the detection area is generated for each of a plurality of filter settings.

  According to the above configuration, the current state of the moving object with respect to the filter can be expressed according to the setting information of the plurality of filters and the combination information of the plurality of filter settings. As a result, alarm state transitions such as how many moving objects match the current filter condition can be easily visually confirmed.

  According to the present invention, there is an effect that the state of a moving object can be grasped in detail according to various filter settings.

  The best mode for carrying out the present invention will be described below with reference to the accompanying drawings. The embodiment described below analyzes metadata obtained from a monitoring camera (metadata generating camera) that generates metadata together with video data obtained by photographing an object to be detected, detects an abnormality, and outputs an alarm. The example is applied to a monitoring system.

  FIG. 1 is a diagram showing a connection configuration of a monitoring system according to an embodiment of the present invention. FIG. 1A is a system in which the management client acquires data output from the metadata generation camera via a network, and FIG. 1B is a system in which the management server acquires data output from the metadata generation camera and sends it to the browsing client. This is a system to supply (server / client system).

  First, the monitoring system 100 shown in FIG. 1A will be described. As shown in FIG. 1, the monitoring system 100 manages one or a plurality of metadata generation cameras. In this example, the number is two. The monitoring system 100 shoots an object to be monitored, generates video data, and generates metadata from the video data, and analyzes and stores the acquired video data and metadata. The management client 3 is configured to output an alarm upon detection of an error, and the network 2 that connects the metadata generation cameras 1a and 1b to the management client 3. The metadata acquired by the management client 3 from the metadata generation cameras 1a and 1b via the network 2 is analyzed via a metadata filter (hereinafter also referred to as “filter”).

  Of course, the number of metadata generation cameras, management clients, management servers, and browsing clients is not limited to this example.

  The management client 3 defines a filter package (hereinafter also referred to as “package”) configured by combining one or a plurality of filters. The management client 3 converts the alarm information from the number of moving objects and moving object conditions that satisfy the conditions of the filter group defined in the filter package by passing metadata through the filter package. Then, the management client 3 supplies the converted alarm information to an analysis processing unit that analyzes data, and analyzes the alarm information. The analysis result of the alarm information is displayed on a display unit including a display monitor. Then, the management client 3 automatically instructs each of the metadata generation cameras 1a and 1b to perform a camera operation (change zoom magnification, sound a buzzer, etc.) based on the analysis result of the alarm information. As described above, the management client 3 controls the optimum camera operation of the respective metadata generation cameras 1a and 1b automatically or as manually set by the user. The filter package and the analysis processing unit will be described in detail later.

  Here, the configuration of video data and metadata will be described. Video data and metadata are each composed of a data body and link information. In the case of video data, the data body is video data of surveillance video captured by the metadata generation cameras 1a and 1b. In the case of metadata, information indicating a monitoring target and attribute information defining a description method of this information are described. On the other hand, the link information describes association information indicating association between video data and metadata, attribute information defining a description method of the content of the information, and the like.

  As the association information, for example, a time stamp or a sequence number for specifying video data is used. The time stamp is information (time information) that gives the generation time of the video data. The sequence number is information (order information) that gives the generation order of content data. When there are a plurality of monitoring videos having the same time stamp, the generation order of the video data having the same time stamp can be identified. Further, as the association information, information for specifying a device that generates video data (for example, a manufacturer name, model name, serial number, etc.) may be used.

  Here, the description of the link information and the metadata main body uses a markup language defined for describing information exchanged on the Web (WWW: World Wide Web). If a markup language is used, information can be easily exchanged via the network 2. Furthermore, by using, for example, XML (Extensible Markup Language) used for exchanging documents and electronic data as a markup language, it is possible to easily exchange video data and metadata. When XML is used, the attribute information defining the information description method uses, for example, an XML schema.

  Video data and metadata generated by the metadata generation cameras 1a and 1b may be supplied to the management client 3 as one stream. The video data and metadata may be supplied to the management client 3 asynchronously in separate streams.

  As shown in FIG. 1B, even if the server function and the client function are divided and applied to a monitoring system constituted by the management server 11 and the browsing client 12, the same functions and effects as those in the example of FIG. Obtainable. By dividing the server function and the client function, a large amount of data can be processed by the management server 11 having high processing performance, and the processing result can be exclusively viewed by the browsing client 12 having low processing performance. By distributing the functions in this way, there is an effect that the monitoring system 100 having more flexibility can be constructed.

  Next, the detailed configuration of the management client 3 shown in FIG. 1A will be described with reference to the functional block diagram of FIG. However, each functional block of the management client 3 may be configured by hardware or may be configured by software.

  The management client 3 includes a metadata recording system 7 that stores and reproduces metadata and video data, and an analysis processing unit 5 that analyzes the metadata. First, a configuration example of the metadata recording system 7 will be described. The metadata recording system 7 includes a video buffer unit 42 that acquires video data from the metadata generation cameras 1a and 1b, a metadata buffer unit 41 that acquires metadata from the metadata generation cameras 1a and 1b, and a filtering process. A filter setting database 55 for storing filter settings, a metadata filter unit 38 for filtering metadata, a rule switching unit 35 for notifying the metadata generation cameras 1a and 1b of setting changes, and storing video data. A video data storage database 56, a metadata storage database 57 for storing metadata, a video data playback unit 39 for playing back video data, a metadata playback unit 40 for playing back metadata, and metadata and video data A playback synchronization unit 36 that synchronizes playback and video data, etc. And a Shimesuru display unit.

  The video buffer unit 42 acquires video data from the metadata generation cameras 1a and 1b, and performs a decoding process on the encoded video data. The video buffer unit 42 holds the obtained video data in a buffer (not shown) provided in the video buffer unit 42. Furthermore, the video buffer unit 42 also performs a process of sequentially supplying video data held in a buffer (not shown) to the display unit 6 that displays an image. By holding the video data in a buffer (not shown) as described above, the video data can be sequentially supplied to the display unit 6 regardless of the reception timing of the video data from the metadata generation cameras 1a and 1b. In addition, the video buffer unit 42 stores the stored video data in the video data storage database 56 based on a recording request signal supplied from a rule switching unit 35 described later. The encoded video data may be stored in the video data storage database 56 and decoded by the video data reproduction unit 39 described later.

  The metadata buffer unit 41 holds metadata acquired from the metadata generation cameras 1a and 1b in a buffer (not shown) provided in the metadata buffer unit 41. Further, the metadata buffer unit 41 sequentially supplies the held metadata to the display unit 6. Further, processing for supplying metadata held in a buffer (not shown) to a metadata filter unit 38 to be described later is also performed. By holding the metadata in a buffer (not shown) as described above, the metadata can be sequentially supplied to the display unit 6 regardless of the reception timing of the metadata from the metadata generation cameras 1a and 1b. Further, the metadata can be supplied to the display unit 6 in synchronization with the video data. Further, the metadata buffer unit 41 stores the metadata acquired from the metadata generation cameras 1 a and 1 b in the metadata storage database 57. Here, when storing metadata in the metadata storage database 57, time information of video data synchronized with the metadata is added. In this way, it is possible to read out metadata at a desired time from the metadata storage database 57 using the added time information without reading the contents of the metadata and determining the time. Become.

  The filter setting database 55 accumulates filter settings corresponding to filter processing performed by the metadata filter unit 38 described later, and supplies the filter settings to the metadata filter unit 38. This filter setting refers to, for each piece of information related to the monitoring target included in the metadata, the criteria for determining whether or not it is necessary to switch the output of the alarm or the like and the imaging operation of the metadata generation cameras 1a and 1b. It is a setting to show. By performing the metadata filtering process using this filter setting, it is possible to indicate the filtering process result for each piece of information related to the monitoring target. The filter processing result indicates that an alarm or the like needs to be output and that the imaging operation of the metadata generation cameras 1a and 1b needs to be switched.

  The metadata filter unit 38 performs filtering processing of metadata using the filter settings stored in the filter setting database 55, and determines whether or not to generate an alarm. Then, the metadata filter unit 38 performs a filtering process on the metadata acquired by the metadata buffer unit 41 or the metadata supplied from the metadata accumulation database 57, and the filter processing result is compared with the rule switching unit 35 and a filter described later. The package unit 33 is notified.

  The rule switching unit 35 generates a setting change signal based on the filter processing result notified from the metadata filter unit 38, and notifies the metadata generation cameras 1a and 1b of the setting change. For example, on the basis of the filter processing result obtained from the metadata filter unit 38, the operations of the metadata generation cameras 1a and 1b are switched so that a monitoring video suitable for monitoring is obtained. In addition, the rule switching unit 35 supplies a recording request signal to the video data storage database 56 based on the filter processing result, and stores the video data acquired by the video buffer unit 42 in the video data storage database 56. In addition, the rule switching unit 35 can select a video data accumulation mode. As the accumulation mode, for example, either the dynamic search mode or the minimum mode can be selected.

  When the dynamic search mode is selected by the user, the rule switching unit 35 displays the video data acquired by the video buffer unit 42 as a video data storage database when the filtering process result indicates that a moving object is detected. 56. When the dynamic search mode is selected, video data when a moving object is detected is accumulated. Therefore, if the stored video data is played back by the video data playback unit 39, which will be described later, and the metadata that is synchronized with the played back video data is filtered with a desired filter setting, Video data satisfying this filter setting can be searched.

  When the minimum mode is selected, the rule switching unit 35 determines the video data acquired by the video buffer unit 42 as video data when it is determined that a state of outputting a warning or an alarm has occurred according to the filter processing result. Accumulate in the accumulation database 56. When the minimum mode is selected, it is possible to easily and quickly reproduce video data in a state in which a warning or alarm is output. In addition, the amount of video data to be stored can be reduced.

  The video data storage database 56 stores video data acquired by the video buffer unit 42. The metadata accumulation database 57 accumulates the metadata acquired by the metadata buffer unit 41.

  The video data playback unit 39 performs playback processing of video data stored in the video data storage database 56. That is, the video data playback unit 39 sequentially reads video data from the playback position specified by the user, and supplies the read video data to the display unit 6. Further, the video data playback unit 39 supplies the playback position (playback time) of the video data being played back to the playback synchronization unit 36.

  A reproduction synchronization unit 36 that synchronizes reproduction of metadata and video data uses the reproduction position supplied from the video data reproduction unit 39 and the metadata accumulated in the metadata accumulation database 57 by the metadata reproduction unit 40. A synchronization control signal is supplied to the metadata reproduction unit 40 so that the reproduction position at the time of reproduction is synchronized, and the operation of the metadata reproduction unit 40 is controlled.

  The metadata playback unit 40 performs playback processing of metadata stored in the metadata storage database 57. That is, the metadata reproduction unit 40 sequentially reads metadata from the reproduction position designated by the user, and supplies the read metadata to the metadata filter unit 38 and the display unit 6. When reproducing both video data and metadata, the metadata reproduction unit 40 controls the reproduction operation based on the synchronization control signal supplied from the reproduction synchronization unit 36 as described above, and synchronizes with the video data. Output the generated metadata.

  The display unit 6 includes live (raw) video data supplied from the video buffer unit 42, reproduced video data supplied from the video data playback unit 39, and live metadata and metadata supplied from the metadata buffer unit 41. The reproduction metadata supplied from the reproduction unit 40 is displayed. The display unit 6 is based on the filter processing result using one of the monitoring video, the video of the metadata, the video of the filter setting, or the synthesized video based on the filter setting from the metadata filter unit 38. Display (output) video showing the monitoring results.

  The display unit (display module) 6 also functions as a graphical user interface (GUI). The user can define packages and filters by selecting a filter setting menu displayed on the display unit 6 using an operation key, a mouse, a remote controller, etc. (not shown), and information on each processing unit (module). In addition, the analysis result of the package and alarm information can be displayed on the GUI.

  When the display unit 6 functions as a GUI, it functions as a filter setting unit that sets a filter using metadata information and a combination setting unit that sets a combination of a plurality of filter settings set by the filter setting unit. Have. For example, when defining a package, the display unit 6 newly creates a filter setting by the GUI function according to a user's instruction or edits the filter setting stored in the filter setting database 55, and then the package setting, that is, the filter The combination mode is set. In this embodiment, individual filter settings are stored in the filter setting database 55, and package settings (such as filter combinations) are stored in the package setting database 53. The filter setting database 55 and the package setting database 53 may be configured as one database.

  The monitoring system 100 according to the present embodiment includes an analysis process, a filter package unit 33 that determines whether an alarm is generated by combining a plurality of filters, filter information in the filter package, and association between the filters. A package setting database 53 for storing (logical settings), an alarm information analysis unit 34 for analyzing alarm information output from the filter package unit 33 based on setting values of an analysis rule setting database 54 described later, and a schedule monitoring A schedule setting unit 31 for setting a specified analysis rule, a package, and an action (operation instruction for an external device) in a specified time zone; a schedule setting database 51 for recording a package and an action; various cameras and peripheral devices Direct action An action setting section 32 is characterized by comprising a action setting database 52 for recording the setting action.

  Hereinafter, functional examples of each unit and database will be described in detail.

The filter package unit 33 determines the occurrence of an alarm output by the package for a more detailed situation by combining a plurality of types of alarm information obtained from the metadata filter unit 38. The optimum camera operation can be preset by the user in units of filters or packages. For example, it is assumed that the user has set five types of filters (filter A to filter E) in a certain package. There are, for example, the following seven types of filters that can be set. Of these, any filter type can be selected.
Appearance: A filter for determining whether an object exists in an area.
Disappearance: A filter used to determine whether an object appears in an area and is out of the area.
Passing: A filter to determine whether an object has crossed a certain boundary line
Capacity (object limit): A filter to determine whether the number of objects in a certain area has exceeded a specified value.
Loitering: A filter for determining whether or not an object has stayed in an area over a specified time
Unattended: A filter for determining whether or not there is an object that has entered a certain area and has not moved beyond a predetermined time.
Removed: A filter to detect that an object that existed in an area has been removed.

  Package setting is either when alarm information is output when all filter conditions are met, when filter A and filter B settings are met, or when filter C and filter D settings are met You can set any combination of logic between filters, such as outputting alarm information. For example, the package alarm information is only displayed when a person enters a certain place (filter A “existence” is true in one place) and a guard is not in a predetermined place (filter B “disappearance” in another place is true). And so on.

The package setting database 53 is a database that can store a package defined in the filter package unit 33. Examples of information that the database should have are described below.
1. Package number (or package name): Uniquely identifies the filter package.
2. Filter number (or filter name): Uniquely identifies the filter alarm information. If a filter alarm number is assigned for each camera, the camera number may also be required.
3. Inter-filter logic: The logic of how filters are combined. It consists of a logical product (AND or sequential) combination and a logical sum (OR or parallel) combination.

  The moving object alarm state determination unit 8 is used to notify the user of the recognition status of the software with respect to the setting (determination condition) of the filter or the filter package with graphics (including numerals and symbols). That is, the current state of the moving object with respect to the filter or the filter package is determined according to the filter setting and the filter package setting, and information for causing the display unit 6 to perform stepwise expression of the alarm according to the state is output. To do.

  The alarm information analysis unit 34 analyzes the alarm information obtained from the filter package unit 33, causes the camera or peripheral device to perform an optimal operation, and gives information to the display unit 6. Analysis type is “Continuous time” (If the alarm continues for the specified time, even if it is an impulse wave alarm, it is considered as a square wave alarm), “Frequency” (more than the specified number of alarm information can be obtained within the specified time) ), “Occupied area” (an object having a specified ratio or more exists in the specified range), etc., and the user can newly define it. Based on the analysis result, the package is reselected, various actions are executed, and the schedule is changed.

The analysis rule setting database 54 is a database that can store analysis rules defined in the alarm information analysis unit 34. Examples of information that the database should have are described below.
1. Analysis rule number (or analysis rule name): Uniquely identifies alarm analysis information.
2. Package number (or package name): A package used for alarm analysis is uniquely identified.
3. Analysis type: Analysis type such as “continuous time”, “occurrence frequency”, “occupied area”.
4). Detailed analysis settings: Operations when conditions are satisfied, such as detailed setting items required for the analysis type (such as time and threshold frequency), action execution, package changes, analysis rule changes, etc.

  The schedule setting unit 31 changes the analysis rule according to the time zone. For example, it is possible to assume usage such as analyzing the “occurrence frequency” rule during business hours to determine the situation such as an automatic door being pinched, and switching to an “intrusion” alarm after closing the store to determine the alarm status by the intrusion itself.

The schedule setting database 51 is a database that can store the schedule defined in the schedule setting unit 31. Examples of information that the database should have are described below.
1. Schedule number (or schedule name): The schedule information is uniquely identified.
2. Start time: Year / month / day / hour / minute / second at which the schedule starts.
3. End time: Year, month, day, hour, minute and second when the schedule ends.
4). Analysis rule number: A number for identifying an analysis rule to be applied in the schedule.

  The action setting unit 32 executes the specified action based on the alarm information analysis result. If movements such as “tracking”, “zoom”, and “light on” are designated, the zoom magnification and pan / tilt angle are automatically designated based on the number of moving objects and position information included in the alarm information. You can also set detailed actions manually. In addition, camera settings can be changed. In addition to changing camera settings, when there is a moving object, the video is recorded and the filter is dynamically changed later to search for the corresponding video, and the filter is applied. It is possible to switch between the minimum recording mode and the two recording modes in which recording is performed only at the time of recording.

The action setting database 52 is a database that can store action settings. Examples of information that the database should have are described below.
1. Action number (or action name): Uniquely identifies action setting information.
2. Action type: “Pan / Tilt”, “Zoom”, “Light ON”, etc.
3. Detailed settings: Set the detailed information for manual settings.

<Description of operation>
Next, a processing example of each unit of the management client 3 will be described.

  First, a processing example of the filter package unit 33 will be described with reference to FIG. The filter package unit 33 creates a package by logically connecting a plurality of filters, and performs a notification process. First, the filter package unit 33 acquires alarm information of a related filter from the metadata buffer unit 41 (step S1). Next, the filter package unit 33 processes the alarm information using the package setting database 53 used by each package (step S2).

  When the filter package unit 33 processes the alarm information, the filter package unit 33 determines whether the alarm information analysis unit 34 needs to be notified (step S3). If it is determined that notification is not necessary, the filter package unit 33 returns to the process of step S1. On the other hand, if it is determined that notification is necessary, the filter package unit 33 creates notification contents combining the filter alarm and the package alarm (step S4). The filter package unit 33 notifies the alarm information analysis unit 34 of the notification content (step S5).

  Next, the filter package unit 33 determines whether or not there is a package setting change request (step S6). If it is determined that there is no setting change request, the filter package unit 33 returns to the process of step S1. On the other hand, when determining that there is a setting change request, the filter package unit 33 changes the setting of the package (step S7).

  Then, the filter package unit 33 determines whether there is an end request (step S8). If it is determined that there is no termination request, the filter package unit 33 returns to the process of step S1. On the other hand, if it is determined that there is an end request, the filter package unit 33 ends the process.

  Next, a processing example of the alarm information analysis unit 34 will be described with reference to FIG. The alarm information analysis unit 34 analyzes the acquired alarm information and performs processing for instructing execution of an action, change of a schedule, and change of a package. First, the alarm information analysis unit 34 acquires alarm information of a related filter from the filter package unit 33 (step S11). Next, the alarm information analysis unit 34 processes the alarm information using the analysis rule setting database 54 (step S12).

  When the alarm information analysis unit 34 processes the alarm information, the alarm information analysis unit 34 determines whether an action needs to be executed (step S13). When determining that the execution of the action is not necessary, the alarm information analysis unit 34 returns to the process of step S11. On the other hand, when it is determined that the action needs to be executed, the alarm information analysis unit 34 creates notification contents describing the action to be executed (step S14). And the alarm information analysis part 34 notifies the notification content to the action setting part 32 (step S15).

  Next, the alarm information analysis unit 34 determines whether or not there is a schedule change request (step S16). If it is determined that there is no schedule change request, the process returns to step S11. On the other hand, when it is determined that there is a schedule change request, the alarm information analysis unit 34 creates notification contents describing the schedule contents to be set (step S17). And the alarm information analysis part 34 notifies the notification content to the schedule setting part 31 (step S18).

  Next, the alarm information analysis unit 34 determines whether or not there is a package change request (step S19). If it is determined that there is no package change request, the process returns to step S11. On the other hand, if it is determined that there is a package change request, the alarm information analysis unit 34 creates notification contents describing the package contents to be set (step S20). Then, the alarm information analysis unit 34 notifies the notification content to the filter package setting unit 33 (step S21).

  Then, the alarm information analysis unit 34 determines whether there is an end request (step S22). If it is determined that there is no termination request, the alarm information analysis unit 34 returns to the process of step S11. On the other hand, when determining that there is an end request, the alarm information analysis unit 34 ends the process.

  Next, a processing example of the schedule setting unit 31 will be described with reference to FIG. The schedule setting unit 31 performs a process of creating a schedule and executing an analysis rule specified within the schedule period. First, the schedule setting unit 31 processes the schedule information for each schedule using the schedule setting database 51 (step S31).

  When the schedule setting unit 31 processes the schedule information, the schedule setting unit 31 determines whether it is within the schedule (step S32). If it is determined that it is not within the schedule, the schedule setting unit 31 returns to the process of step S31. On the other hand, when determining that it is within the schedule, the schedule setting unit 31 creates a notification content describing the analysis rule (step S33). The schedule setting unit 31 notifies the alarm information analysis unit 34 of the notification content (step S34).

  Then, the schedule setting unit 31 determines whether or not there is a schedule setting change request (step S35). When it is determined that there is no schedule setting change request, the schedule setting unit 31 returns to the process of step S31. On the other hand, when it is determined that there is a schedule setting change request, the schedule setting unit 31 changes the schedule setting using the schedule setting database 51 (step S36).

  Then, the schedule setting unit 31 determines whether or not there is an end request (step S37). When it is determined that there is no termination request, the schedule setting unit 31 returns to the process of step S31. On the other hand, when it is determined that there is an end request, the schedule setting unit 31 ends the process.

  Next, a processing example of the action setting unit 32 will be described with reference to FIG. The action setting unit 32 performs processing for creating an action and causing the camera or peripheral device to execute the action. First, the action setting unit 32 processes each action using the action setting database 52 (step S41).

  After processing the action content, the action setting unit 32 determines whether or not there is an action execution request (step S42). When determining that there is no action execution request, the action setting unit 32 returns to the process of step S41. On the other hand, if it is determined that there is an action execution request, the action setting unit 32 creates notification contents describing actions such as action setting change and pan / tilt (step S43). Then, the action setting unit 32 notifies the notification contents to the camera, peripheral devices, and the like (step S44).

  Then, the action setting unit 32 determines whether or not there is a termination request (step S45). When determining that there is no termination request, the action setting unit 32 returns to the process of step S41. On the other hand, when determining that there is an end request, the action setting unit 32 ends the process.

  Next, an example of related processing between modules will be described.

  First, an example of processing for obtaining one result by applying a package (filter group) to metadata received from a plurality of metadata generation cameras 1a and 1b will be described with reference to FIG. First, the user registers filters such as “exist” and “stay” by using the filter package unit 33 (step S51), and sets the inter-filter logic (step S52). The setting contents are stored in the package setting database 53.

  And the filter package part 33 transmits alarm information to the alarm information analysis part 34 (step S53). The alarm information analysis unit 34 receives the alarm information from the filter package unit 33 (step S54). The received alarm information includes a package alarm from a package that newly matches the inter-filter logic, in addition to the filter alarm from each filter.

  The alarm information analysis unit 34 analyzes the received alarm information based on the analysis rule setting database 54, and performs an operation according to the analysis rule (step S55). Then, the alarm information analysis unit 34 transmits necessary instructions to the action setting unit 32, the filter package unit 33, and the schedule setting unit 31. When executing an action, an action number is designated in the action setting unit 32 (step S56). The action setting unit 32 reads an action based on the specified action number from the action setting database 52 and executes the action. When reselecting the filter or package, the filter package unit 33 is instructed to change the setting (step S56). The filter package unit 33 reads the filter and package from the package setting database 53 and writes the reselected filter and package to the package setting database 53. When changing the schedule, the schedule setting unit 31 is instructed to change the setting (step S58). The schedule setting unit 31 reads the schedule from the schedule setting database 51 and writes the changed schedule into the schedule setting database 51.

  FIG. 8 shows a display example of video data and metadata by the display unit 6 of the management client 3 in the present embodiment.

  As shown in FIG. 8, video data 1001 and metadata 1002 captured by the metadata generation cameras 1 a and 1 b are supplied to the management client 3 via the network 2. The types of metadata generated by the metadata generation cameras 1a and 1b include time, moving body information (for example, position, type, status, etc.) of the video analysis result, the current camera state, and the like. It is also effective when the metadata generation camera is provided with a software module of a management client or management server and operates without a network.

  As described above, the management client 3 acquires, analyzes, and stores the video data 1001 and the metadata 1002 supplied from the metadata generation cameras 1a and 1b. Video data 1001 and metadata 1002 input to the management client 3 are stored in the video data DB 56 and the metadata DB 57. The management client 3 has a filter setting function, sets various filters on a filter setting screen (filter setting menu) displayed on the display unit 6, and stores filter information in the filter setting database 55. In the filter setting display screen 1003 shown in FIG. 8, the boundary line LN and the area PA generated by the filter setting are displayed. An arrow PB indicates a Passing (crossing) direction to be detected with respect to the boundary line LN. Using the filter information set in this way, the objects (moving objects) MB1 to MB3 in the video are detected by the metadata filter unit 38 and displayed as the monitoring video 1004 synchronized with the video data 1001 by the display unit 6. When an object is detected by a certain filter, the monitoring system 100 generates an alarm. For example, moving object frames H1 to H3 are displayed around the detected objects MB1 to MB3, respectively.

  FIG. 9 shows the concept of a filter package configured by combining one or a plurality of filters. As shown in FIG. 9, a plurality of filters for metadata are packaged. In this example, one package is composed of a combination of a maximum of three filters and a maximum of six non-detection areas.

  There are two types of combinations: sequential mode (continuous mode) and parallel mode (parallel mode). In the parallel mode, an alarm as a package is generated each time each filter detects an object. On the other hand, in the sequential mode, one alarm is generated as a package when the filter detects an object within a predetermined combination interval within a set order. The package is set individually for each metadata generation camera.

  Next, the operation of the stepwise expression of alarms in the management client 3 will be described. As described above, the moving object alarm state determination unit 8 (see FIG. 2) of the management client 3 determines the current state of the moving object with respect to the filter or the filter package according to the filter setting and the filter package setting, and the state. In response to this, information for causing the display unit 6 to perform stepwise expression of the alarm is output. The display unit 6 displays the recognition status by graphics (including numbers and symbols) based on the information supplied from the moving object alarm state determination unit 8.

  As an example of the display state of the recognition status, for example, (1) when the moving object is recognized as “a certain state”, the recognition status is transmitted. (2) Or the graphics is changed in accordance with the passage of time after the moving object is recognized as “a certain state” or the change in the state quantity. (3) or indicates that the object is “approaching a certain determination condition”. (4) When there are a plurality of conditions, the determination step is shown. Conventionally, it indicates that the alarm target is detected by the color of a frame surrounding the moving object (called a moving object frame or a detection frame), but the present invention provides additional information such as progress / change status, It is possible to indicate a state other than “detection”.

  Hereinafter, the operation of the stepwise expression of the alarm when the moving object approaches the filter will be described with reference to FIG. FIG. 10 is a diagram illustrating an alarm state display example when a moving object approaches the detection area set by the filter (Appearance).

  In FIG. 10, first, the moving body alarm state determination unit 8 of the management client 3 is activated. Next, the moving object alarm state determination unit 8 acquires the coordinates of the detection area PA and the moving object 1010 set in the filter from the metadata filter unit 38. Subsequently, the moving object alarm state determination unit 8 acquires a preset filter warning start distance from the metadata filter setting database 55. Then, the moving object alarm state determination unit 8 determines whether there is a moving object 1010 at the warning start distance.

  Here, when the moving object 1010 starts to approach the detection area PA of the filter from the warning start distance, the moving object alarm state determination unit 8 displays the display color information R (of the moving object 1010 displayed on the display unit 6 according to the distance. Red (red), G (green), B (blue), for example, from RGB: 0, 255, 0 (in the case of 256 gradation display with 8-bit information), while increasing the amount of R information, decrease the amount of G information The alarm display color of the moving object frame of the moving object 1010 is created. And the display part 6 acquires the display color of the moving body 1010 from the moving body alarm state judgment part 8, and displays a moving body frame on an image | video. In this example, when the moving body 1010 is far from the warning start distance with respect to the detection area PA, the moving body frame HG is displayed in green. When the moving body 1010 approaches the warning start distance, the moving body frame HY is displayed in yellow, and the moving body 1010 is displayed in the detection area PA. If it enters the inside, the moving body frame HR is displayed in red to warn the user.

  A case where a filter package (formed from three filters as an example) is configured with sequential filter setting will be described with reference to FIG. Fig. 11 shows an alarm when a moving object is applied to each of the sequential filter settings when passing the boundary line (Passing), entering the detection area (Appearance), and exiting the detection area (Disappearance). It is a figure which shows the example of a state display.

  In FIG. 11, first, the moving body alarm state determination unit 8 of the management client 3 is activated. Next, the moving object alarm state determination unit 8 sets predetermined coordinates and sequential information (combination information, combination interval, etc.) set to the filter from the metadata filter unit 38 and the filter package unit 33, the coordinates of the moving object 1010, the moving object 1010 Get the status for the filter. Subsequently, the moving object alarm state determination unit 8 determines a transition identification number to be displayed attached to the moving object 1010 according to the state of the moving object 1010 with respect to the filter boundary line LN, the detection area PA, and the like. The display unit 6 acquires the transition identification number of the moving object 1010 and the type of each filter from the moving object alarm state determination unit 8, and displays the number and the type of filter in (or outside) the moving object frame.

  In this example, when the moving object 1010 crosses the boundary line LN, the filter type “Passing” is displayed together with the transition identification number “1”. Here, the moving body frame HG is green. When it is detected that the moving body 1010 has entered the detection area PA, the filter type “Appearance” is displayed together with the transition identification number “2”. The moving body frame HG is displayed in green. Thereafter, when it is detected that the moving body 1010 has left the detection area PA, the filter type “Disappearance” is displayed together with the transition identification number “3”. The moving body frame HR at this time is displayed in red. That is, since each filter detected the moving body 1010 in the set order, one alarm is finally generated as a package. In the example of FIG. 11, it is displayed that it has been counted by three sequential filters.

  Furthermore, with reference to FIG. 12, an example of alarm state display in the case where the waving detection (Loitering event) is performed when a plurality of moving objects exist in the detection area will be described. In this example, the detection period threshold is set to 60 seconds, for example.

  In FIG. 12, first, the moving object alarm state determination unit 8 of the management client 3 is activated. Next, the moving object alarm state determination unit 8 acquires from the metadata filter unit 38 the detection area PA set in the filter, the coordinates of each of the moving objects 1011 to 1014, and the threshold value for the detection period of the scale detection. Subsequently, the moving body alarm state determination unit 8 determines whether there is a moving body 1010 in the detection area PA, and if so, how long the staying time of the moving body is. The display unit 6 displays the dwell time from the moving object alarm state determination unit 8 within (or outside) the moving object frame of the moving object 1010.

  In this example, the moving bodies 1011 to 1013 have a residence time of 10 seconds, 25 seconds, and 30 seconds, respectively, and have a detection period threshold value of 60 seconds, so they are displayed in a green moving body frame HG. The moving body 1014 staying for 50 seconds has approached the staying period threshold value of 60 seconds and is displayed in a yellow moving body frame HY. Further, for a moving body 10105 whose residence time is 65 seconds and exceeds the threshold value of 60 seconds, the moving body frame HR is displayed in red to warn the user.

  Further, an alarm state display example (history display) of a moving object will be described with reference to FIG. In FIG. 13, the moving body 1010 enters the detection area PA and shows the state. At this time, the total number of intrusions, for example, “3” is described in a predetermined part of the moving body frame HR. By doing in this way, the user can know the state of the moving object 1010 retroactively.

In addition to the examples described above, the following can be considered as display patterns displayed on the display unit 6. For example,
-Display an icon near the moving object-Display an animated icon near the moving object-Change the line type of the moving object-Change the moving object frame to a broken line and add animation to the moving line-Flash the moving object frame・ Change the line thickness of the moving object frame. ・ The moving object frame and its inside may blink.

  According to the present invention configured as described above, the current state of the moving object with respect to the filter can be expressed in accordance with the setting of the filter and the setting of the filter combination (sequential or parallel). Accordingly, it is possible to determine a moving object that is predicted to be an alarm from a plurality of moving objects before an alarm is generated. In addition, when multiple filters are set sequentially with a filter combination, it is possible to determine at a glance the alarm state transitions such as how many moving objects currently exceed the filter conditions. It is possible to prevent an alarm by making a first move, such as a warning sound for the moving object.

  In addition, by using alarms that do not depend only on numbers and letters, it is not necessary to read and understand the alarms, and the contents of the alarms can be quickly viewed.

  The series of processes in the above-described exemplary embodiment can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing programs that make up the software into a computer built into dedicated hardware, or by installing various programs. For example, a general-purpose personal computer or the like installs and executes a program constituting desired software.

  In addition, a recording medium recording software program codes for realizing the functions of the above-described exemplary embodiments is supplied to a system or apparatus, and a computer (or a control device such as a CPU) of the system or apparatus is stored in the recording medium. Needless to say, this can also be achieved by reading and executing the program code.

  As a recording medium for supplying the program code in this case, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like is used. Can do.

  Further, by executing the program code read by the computer, not only the functions of the above-described exemplary embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs actual processing. In some cases, the functions of the above-described exemplary embodiments are realized by performing part or all of the above.

  Further, in this specification, the step of describing the program constituting the software is not limited to the processing performed in time series according to the described order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  Furthermore, the present invention is not limited to the above-described embodiments, and various other configurations can be taken without departing from the gist of the present invention.

It is a figure which shows the structural example of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the example of an internal structure of the management client which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the filter package part which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the alarm information analysis part which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the schedule setting part which concerns on one Embodiment of this invention. It is a flowchart which shows the process example of the action setting part which concerns on one Embodiment of this invention. It is a flowchart chart which shows the process example at the time of applying a package filter to metadata based on one Embodiment of this invention. 4 is a display example of video data and metadata according to an embodiment of the present invention. It is a figure explaining the concept of the filter package which concerns on one Embodiment of this invention. It is a figure which shows the example of an alarm state display when a moving body approaches the detection area. It is a figure which shows the example of an alarm state display when a moving body has applied to each of the several filter set sequentially. It is a figure which shows the example of an alarm state display in case a some moving body exists in a detection area. It is a figure which shows the alarm state display example (history display) of a moving body.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1a, 1b ... Metadata production | generation camera, 2 ... Network, 3 ... Management client, 11 ... Management server, 12 ... Viewing client, 5 ... Analysis processing part, 6 ... Display part, 7 ... Metadata recording system, 8 ... Moving body alarm State determination unit 33... Filter package unit 38 38 Metadata filter unit 39 Video data reproduction unit 40 Metadata reproduction unit 53 Package setting database 54 Analysis rule setting database 55 Filter setting database DESCRIPTION OF SYMBOLS 100 ... Surveillance system, 1001 ... Video data, 1002 ... Metadata, 1003 ... Filter setting display screen, 1004 ... Surveillance video, H1, H2, H3 ... Moving body frame, LN ... Borderline, MB1, MB2, MB3 ... Moving body, PA ... Detection area

Claims (6)

A video data acquisition unit for acquiring video data from the surveillance camera;
A metadata acquisition unit for acquiring metadata indicating information related to a monitoring target from the monitoring camera;
A filter setting storage unit that stores the filter settings;
A metadata filter unit that performs filtering of the metadata using the filter settings stored in the filter setting storage unit;
The coordinates of the detection area of the filter and the coordinates of the moving object on the video data are acquired from the metadata filter unit, the filter warning start distance set in the filter setting storage unit is acquired, and the moving object and the detection are acquired. A moving object alarm state determination unit that generates alarm information according to the distance to the area;
An output unit that outputs a monitoring result based on alarm information of the moving object alarm state determination unit. The monitoring apparatus according to claim 1, wherein the alarm information is information indicating a change in a display pattern related to the moving object according to a distance between the moving object and the detection area. The monitoring apparatus according to claim 1, wherein the alarm information is information indicating a change in a display pattern related to the moving object according to a time during which the moving object stays in the detection area. A filter package setting storage unit that stores combination information of a plurality of filter settings;
A filter package unit that performs filter processing of the metadata using a filter setting stored in the filter setting storage unit and a combination setting stored in the filter package setting storage unit;
The moving object alarm state determination unit generates alarm information according to the distance between the moving object and the detection area for each of the plurality of filter settings based on the combination information stored in the filter package setting storage unit. The monitoring device according to claim 1, characterized in that: In a monitoring system configured using a monitoring camera and a monitoring device that generate video data of monitoring video and metadata indicating information on a monitoring target,
The monitoring device
A video data acquisition unit for acquiring video data from the surveillance camera;
A metadata acquisition unit for acquiring metadata indicating information related to a monitoring target from the monitoring camera;
A filter setting storage unit that stores the filter settings;
A metadata filter unit that performs filtering of the metadata using the filter settings stored in the filter setting storage unit;
The coordinates of the detection area of the filter and the coordinates of the moving object on the video data are acquired from the metadata filter setting storage unit, the filter warning start distance set in the filter setting storage unit is acquired, and the moving object A moving object alarm state determination unit that generates alarm information according to the distance from the detection area;
An output unit that outputs a monitoring result based on alarm information of the moving object alarm state determination unit. Obtaining video data from a surveillance camera;
Obtaining metadata indicating information related to a monitoring target from the monitoring camera;
The metadata filter unit using the filter settings stored in the filter setting storage unit to filter the metadata;
Obtaining the coordinates of the detection area of the filter and the coordinates of the moving object on the video data from the metadata filter unit, and obtaining the filter warning start distance set in the filter setting storage unit;
Generating alarm information according to the distance between the moving object and the detection area;
And a step of outputting a monitoring result based on the generated alarm information.