JP2014007709A - Event notification device, event notification system and event notification program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a notification system capable of notifying the user of each mobile device of a notification message of a detected event, in an image processing system for detecting an event to be notified by processing an image captured by means of a camera, and transmitting the notification message of a detected event to a previously registered mobile device.SOLUTION: A smart terminal 13 includes an event search area setting function for storing the position information of own terminal, as a movement locus, while updating periodically, recognizing the travel speed and travel direction of own device based on the movement locus, and setting an event search area spreading in the direction of travel according to the speed and direction, and a notification function for selecting an event notification message that the place of occurrence of an event is within the event search area, registering the event notification message in a notification list, determining the notification priority of the event notification message registered in the notification list, and selecting an event notification message having a highest notification priority as a notification object.

Description

  The present invention relates to an event notification processing device, an event notification system, and an event notification processing program using position information.

  When building a system that detects camera events and detects specific events and notifies all mobile devices (smart terminals) connected to the network, the detected events are uniquely notified to all devices. A system configuration in which all notifications of detected events are ranked in time series and notified to the user can be considered. However, in a system configuration that uniquely notifies all devices of detected events, it is necessary for each user to individually dispose of desired event information that is currently required, which places an excessive burden on the user. become. In addition, in a system configuration in which all notifications of detected events are ranked in chronological order and notified to the user, the notification message that occurred most recently is displayed with priority, and the user individually There arises a problem that desired desired event information cannot be obtained easily and quickly.

  Conventionally, as a network system using this kind of camera image, a store information display system that searches for and displays stores that exist within a predetermined range centering on a moving point of a mobile terminal (see cited reference 1), a portable communication device When the emergency communication is received from the owner of the mobile phone, the surveillance camera system that searches for the nearest physical surveillance camera from the current position of the portable communication device and activates the camera to receive the video (see Reference 2) ), When an emergency signal is received from a portable wireless terminal, there is a surveillance camera system (see cited reference 3) that controls the shooting direction of the camera based on the position information and displays the obtained video on a display device .

JP 2002-163267 A JP 2007-329757 A JP 2006-014206 A

  As described above, when building a system that detects specific events by image processing camera images and notifies all mobile devices connected to the network, the detected events are uniquely assigned to all devices. In the system configuration to notify, there is a problem of overloading the user because each user individually needs to dispose of the desired event information that is currently required, and all of the detected events In the system configuration in which the notifications are ranked in chronological order and notified to the user, the most recently generated notification message is preferentially displayed, and the desired event information that the user currently needs individually There is a problem that it cannot be obtained easily and quickly.

  The present invention has been made in view of the above circumstances, and in an image processing system that detects an event to be notified by processing an image captured by a camera, and transmits a notification message of the detected event to a pre-registered mobile device. An object of the present invention is to provide an event notification processing device, an event notification system, and an event notification processing program capable of efficiently notifying a user of each mobile device of a notification message of a detected event.

  An embodiment of the present invention detects an event to be notified by processing an image captured by a camera, and for the detected event, an event including an event name that identifies the event and camera position information that identifies an event occurrence location An event notification processing apparatus applied to a network system including an image processing apparatus that transmits a notification message to a device registered in advance and a mobile device that is registered in the image processing apparatus and receives the event notification message. The device automatically updates the position information of the reception point that receives the event notification message and stores it as a movement locus, and uses the movement locus each time the position information is accumulated in the storage means. Recognizes the movement speed and direction of the device, and recognizes the movement speed and movement method An event search area setting processing means for setting an event search area that expands in the direction of travel, and receiving the event notification message, identifying the event occurrence location based on the camera position information for the received event notification message, Registration processing means for registering an event notification message where the event occurs in the event search area in a notification list prepared in advance, and whenever the event notification message is registered in the notification list, the movement locus is set. Notification priority processing means for determining the notification priority of the event notification message using a parameter; notification determination processing means for determining whether notification is possible according to the notification priority for the event notification message registered in the notification list; It is characterized by comprising.

  According to the embodiment of the present invention, an event to be notified by processing an image captured by a camera is detected and detected in an image processing system that transmits a notification message of the detected event to a pre-registered mobile device. It is possible to provide an event notification processing apparatus and an event notification processing program that can efficiently notify an event notification message to a user of each mobile device.

The block diagram which shows the structure of the notification system which concerns on embodiment of this invention. The block diagram which shows the function structure of the image processing apparatus which concerns on the said embodiment. The block diagram which shows the function structure of the smart terminal which concerns on the said embodiment. The transition diagram which shows the notification processing procedure of the notification system which concerns on the said embodiment. 5 is a flowchart showing a processing procedure of the image processing apparatus according to the embodiment. The flowchart which shows the process sequence of the smart terminal which concerns on the said embodiment. The flowchart which shows the process sequence of the smart terminal which concerns on the said embodiment. Setting explanatory drawing of the event search area which concerns on the said embodiment. The figure which shows the nonlinear (normal distribution) probability density distribution in case the speed (v) is high used as a dynamic parameter for setting the priority evaluation value of the event notification message in the event search area according to the embodiment. The figure which shows the nonlinear probability density distribution in case the said speed (v) is standard. The figure which shows the nonlinear probability density distribution in case the said speed (v) is slow. The figure which shows the linear probability density distribution according to elapsed time used as a fixed parameter for setting the priority evaluation value of the said event notification message.

  The embodiment of the present invention processes an image captured by a camera (a monocular camera for monitoring), detects an event to be notified, and transmits the detected event to a registered mobile device via a wireless communication network. An image processing apparatus that is provided at a plurality of points, each having a monocular camera, and a mobile device (smart terminal) that receives the event notification message from the image processing apparatus and is a notification target of the image processing apparatus. An event notification processing apparatus that constructs an event notification system on a network, and calculates an evaluation value for an event by using the movement direction and speed of the device and the elapsed time from the occurrence of the event. An event to notify the highest value. In addition, the event evaluation value based on the search range and position of the event is variable according to the moving direction and moving speed, and dynamically calculating and determining the evaluation value does not impair the currently required event. It became possible to give priority notification.

  The event notification system according to the present embodiment uses the position information of the camera and the position information of the mobile device to be notified, and notifies the user of PUSH notification (actively acquiring information and notified from the server side) Notification function). The push notification function using this position information detects a specific event (event) by image processing, and uses the position information (GPS information) of the camera and the position information (GPS information) of the mobile device to be notified. This is a function for determining whether to notify the device of information notified from the image processing server. Note that the camera position information (GPS information) is static information as information to be registered when setting a processing target for image processing. The location information (GPS information) of the mobile device is dynamic information that is changed in real time at the location of the device.

  An event notification system that realizes a PUSH notification function using this position information is a system configuration in which an event is notified from an image processing device to a mobile device via an external server, or a mobile device from the image processing device via a wireless LAN. The present invention can be implemented in any wireless communication network having a system configuration for notifying an event.

  In the notification system, the following preparation for system use is required.

・ Setting of image processing device (preparation for system use 1)
In the image processing apparatus, image processing parameters for performing image processing are set. In the setting of the camera, the camera name for specifying the monitoring camera in the notification system and the camera position information (GPS information) indicating the installation position of the camera for specifying the detection target event (event) occurrence position are set. In the detection event setting, an event name is set.

  The uniqueness of the notification can be identified by the host name of the image processing apparatus and the CH number of the image processing CH (channel).

-Notification registration settings from mobile devices that receive notifications (Preparation for system use 2)
The mobile device that receives the notification can register whether or not to perform notification to the device that performs image processing, and can determine whether the notification is possible on the image processing apparatus side. Manage setting values.

・ Camera information distribution to mobile devices receiving notifications (Preparation for system use 3)
Each mobile device sets a connection destination in order to refer to live video and event information of the image processing apparatus, and information on the camera (including position information) of the image processing apparatus at the time of setting the connection destination Event information is distributed to the mobile device, and each piece of information is received and managed by the mobile device.

-Notification processing to the mobile device in the image processing apparatus When an event to be notified occurs as a result of the image processing, it is determined whether the notification can be made to the registered mobile device (refer to registration information), and a message Implement notifications.

-Notification determination processing on mobile devices The location information of the device itself is periodically updated and managed inside the device. When a notification message (including an event name and camera position information) is received via the image processing apparatus or an external server, whether or not notification is possible is determined according to an algorithm described later using the position information of the camera and the position information of the own device. Display alerts.

  In order to realize this notification determination processing function, each of the above devices periodically stores location information of a reception point that receives the event notification message and accumulates it as a movement locus, and the location information is accumulated in this storage unit. Event search area setting processing means for recognizing the movement speed and movement direction of its own device each time using a movement trajectory, and setting an event search area that expands in the traveling direction based on the recognized movement speed and movement direction, and an event A notification list prepared by receiving a notification message, identifying an event occurrence location based on camera position information for the received event notification message, and selecting an event notification message in which the event occurrence location is in the event search area Registration processing means to register with the event notification message in the notification list A notification priority processing means for determining the notification priority of the event notification message using the movement trajectory and the set parameter every time recording is performed, and notification of event notification messages registered in the notification list according to the notification priority. Notification determination processing means for determining availability. Each processing will be described later with reference to flowcharts shown in FIGS.

  The event search area setting processing means changes the setting range of the event search area in the traveling direction according to the moving speed of the own device. This process will be described later with reference to FIG. The notification priority processing means prepares a probability density distribution for decreasing the evaluation value according to the elapsed time (as the elapsed time becomes longer) as a fixed parameter included in the above parameters for the event notification message registered in the notification list. Processing means for calculating a priority evaluation value for a notification using a parameter and determining the notification priority using the priority evaluation value is provided. Processing using this fixed parameter will be described later with reference to FIG.

  Furthermore, the notification priority processing means sets, as a dynamic parameter included in the parameter, a non-linear probability density distribution that extends in a traveling direction as the moving speed of the device increases, and the parameter including the dynamic parameter and the parameter Processing means for calculating a priority evaluation value for notification using the latest position information and moving speed included in the movement locus and determining the notification priority using the priority evaluation value is provided. Processing using this dynamic parameter will be described later with reference to FIGS.

  As shown in FIG. 8, the event search area has a search length (L) that is longer as the moving speed of the device is faster and shorter as it is slower, and a search angle (θ that is narrower and slower as the moving speed is faster). ) And a dynamic variable region that expands in a divergent shape in the traveling direction according to the speed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this embodiment, for an event notification processing device that constructs an event notification system on a network, a mobile device that implements the device is referred to as a smart terminal.

  FIG. 1 shows a configuration of a notification system according to an embodiment, an image processing apparatus that implements the notification system, and a smart terminal. Although the above-described wireless communication network is interposed between the image processing apparatus and the smart terminal, here, the system configuration of the network is omitted.

  As illustrated in FIG. 1, the notification system according to the embodiment includes an image processing device 12 including a camera 11 and a smart terminal 13 including a display unit 14.

  The camera 11 includes a lens unit and an image sensor (for example, a CCD solid-state image sensor or a CMOS image sensor) provided at an imaging position of the lens unit, and is installed at a predetermined road monitoring position, for example. An image for a screen is output in a predetermined pixel unit (for example, one frame of 1280 × 960 pixels).

  The image processing apparatus 12 can communicate with a smart terminal 13 registered in advance as a notification destination via a wireless communication network (not shown).

  The image processing apparatus 12 detects an event to be notified by processing an image captured by the camera 11, and for the detected event, an event including an event name that identifies the event and camera position information that identifies an event occurrence location A notification message is transmitted to the smart terminal 13 registered in advance as a notification destination.

This image processing device 12 is provided with a camera at a plurality of points around a main road and its branch lines, or a plurality of points around a passage or facility where congestion is expected, depending on the notification target. An event or a congestion state is detected as a notification target, and the detected event (event) is transmitted to the smart terminal 13 registered in advance. A specific configuration example of the image processing apparatus 12 will be described later with reference to FIG. The processing will be described later with reference to FIGS.

  The smart terminal 13 periodically updates the position information of its own terminal, accumulates it as a movement locus, recognizes the movement speed and movement direction of its own device based on the movement locus, and expands in the traveling direction according to the speed and direction. Event search area setting processing function to set the search area and the event location based on the camera location information for the received event notification message, and select the event notification message where the event occurrence location is in the event search area And a notification processing function for determining a notification priority for an event notification message registered in the notification list and selecting an event notification message having the highest notification priority as a notification target. .

  The event search area setting processing function recognizes the moving speed and moving direction of the terminal itself, sets an event searching area that expands in the traveling direction shown in FIG. 8 based on the recognized moving speed and moving direction, and a notification processing function. Then, select the event notification message with the camera position in the event search area as the notification processing target, register it in the notification list, perform priority processing for notification determination, and notify the event with the highest priority from the notification list Processing for selecting a message and providing it to the user via the display unit 14 or a voice output unit (not shown) is performed. A specific configuration example of the smart terminal 13 will be described later with reference to FIG. The process will be described later with reference to FIG. 4, FIG. 6, and FIG.

  In the notification system shown in FIG. 1, the image processing apparatus 12 includes a capture unit 121, an image processing buffer memory 12M, a preprocessing unit 122, a detection processing unit 123, a tracking processing unit 124, and a notification transmission processing unit 125. It is comprised and comprises.

  The capture unit 121 has a processing function of capturing a frame-by-frame image captured by the camera 11 as a processing target image (input image) and holding it in the image processing buffer memory 12M. The image processing buffer memory 12M includes an image buffer memory area for recording, in time series, video in frame units captured by the capture unit 121 as a processing target image of the detection processing unit 123, and a detection result buffer used for processing of the detection processing unit. It has various processing buffer areas, parameter setting areas, and the like. The pre-processing unit 122 performs pre-processing such as smoothing processing and edge processing, which are determined in advance, on the frame-by-frame images held in the image processing buffer memory 12M.

The detection processing unit 123 captures a camera image captured by the capture unit 121 and corrected by the preprocessing unit 122 as a processing target image, and uses a current image and a past image as a detection target ( Event) detection processing. For example, processing for detecting reverse transport, fire, collision accidents, traffic jams, and the like on a highway as a monitoring target, or processing for detecting congestion, peculiar behavior, and the like in a sidewalk, a plaza, a facility, etc. as monitoring targets is performed.
The tracking processing unit 124 tracks the event detected by the detection processing unit 123 for a set number of frames, and performs a process of determining that the detected event is a notification target.

  The communication transmission processing unit 125 sends an event notification message including an event name that identifies the event and a camera position information that identifies the occurrence location of the event (event) that the tracking processing unit 124 has determined to be a notification target. It has a processing function of creating and transmitting the event notification message to each smart terminal 13 registered in advance as a notification destination via a predetermined communication network.

  In the notification system shown in FIG. 1, the smart terminal 13 includes a processing buffer memory 13M, a position information update processing unit 131, a speed / direction calculation processing unit 132, a notification area / evaluation value update processing unit 133, and a notification reception. A processing unit 134, a notification list update processing unit 135, and an event notification message display processing unit 136 are provided.

  The position information update processing unit 131 uses the GPS function of the smart terminal 13 to set the position information of the reception point that receives the event notification message of the terminal itself, that is, the position information (GPS position information) by the GPS of the smart terminal 13. Periodic updating is performed periodically, and processing for accumulating in the processing buffer memory 13M as a movement locus is performed.

  Each time GPS position information is accumulated in the processing buffer memory 13M, the speed / direction calculation processing unit 132 recognizes the moving speed and the moving direction of the terminal using the moving trajectory stored in the processing buffer memory 13M. A process of acquiring information on the current position (x · y) and speed (v) is performed.

  The notification area / evaluation value update processing unit 133 uses the position information of the movement trajectory including the current position (x · y) acquired by the speed / direction calculation processing unit 132 and the information on the velocity (v) and the progress of the terminal itself. Implement the process of setting an event search area that expands in the direction. The event search area set by the notification area / evaluation value update processing unit 133 is a dynamically variable area that expands in a divergent shape in the traveling direction according to the speed, and details thereof will be described later with reference to FIG. Further, the notification area / evaluation value update processing unit 133 obtains information on dynamic parameters and fixed parameters (to be described later) for determining the evaluation value of the event notification message, and information on the speed (v) calculated by the speed / direction calculation processing unit 132. And processing for updating the evaluation value of the event notification message registered in the notification list. The dynamic parameters and fixed parameters used here will be described later with reference to FIGS.

  The notification reception processing unit 134 is realized by the data reception function of the data transmission / reception device, and has a processing function of receiving an event notification message and image data transmitted from the image processing device 12 via a wireless communication network (not shown). .

  The notification list update processing unit 135 is an event search area in which the position indicated by the camera position information included in the event notification message received by the notification reception processing unit 134 is set by the notification area / evaluation value update processing unit 133 If it is within the event search area, a process of registering the event notification message in a notification list previously formatted on the processing buffer memory 13M is performed. For event notification messages that are registered in the notification list, the notification priority processing described later is performed, and the priority evaluation value for determining the notification priority is less than the set threshold value. A notification list management function is provided for deleting an event notification message out of the search area from the notification list.

  The event notification message display processing unit 136 determines whether or not the message with the highest notification priority has been updated (changed) for the event notification message in the notification list managed by the notification list update processing unit 135, and notifies the current notification. When a new event notification message with a notification priority higher than the notification priority of the current event notification message appears, it is determined that a new event notification message can be notified instead of the currently notified event notification message, and the notification Event information according to the determined event notification message is output to the display unit 14 to notify (provide) new event information to the user.

  FIG. 2 and FIG. 3 show functional configurations realized by the image processing apparatus 12 and the smart terminal 13 shown in FIG. Here, not only the delivery of an event notification message from the image processing apparatus 12 to the smart terminal 13 but also a delivery function of image data in accordance with a request from the smart terminal 13 is included.

  As shown in FIG. 2, the image processing apparatus 12 includes a data transmission / reception unit 200, an image buffer memory 211, an image processing unit 212, a detection result buffer memory 213, a notification determination processing unit 214, an event data transmission unit 215, a resizing unit 216, It has components such as a transmission image buffer memory 217, a video distribution processing unit 218, an image data transmission unit 219, and an image distribution request reception unit 220.

  The data transmission / reception unit 200 realizes the processing function of the communication transmission processing unit 125 illustrated in FIG. 1 and the image data transmission function. The data transmission / reception unit 200 transmits an event notification message (MA) to the smart terminal 13 registered in advance as a notification target, and also transmits a live video or a recorded video immediately after the occurrence of the event to the requested smart terminal 13. It has a transmission / reception function for transmitting image data (VI) to be serviced.

  The image buffer memory 211 is provided in the image processing buffer memory 12M shown in FIG. 1 together with the detection result buffer memory 213 and the transmission image buffer memory 217, and the frame-by-frame video captured by the capture unit 121 is captured in time series. Store with.

  The image processing unit 212 has the processing functions of the preprocessing unit 122 and the detection processing unit 123 shown in FIG. 1, makes a read request (R) to the image buffer memory 211, and sends the current image and the past from the image buffer memory 211. A detection result buffer memory that acquires an image, compares the acquired images with each other, detects an event to be detected as a notification event in accordance with a processing parameter set in advance in order to detect an event to be detected. A write request (w) is made to 213, and processing for accumulating the contents of the processing result in the detection result buffer memory 213 for a predetermined frame is performed.

  The detection result buffer memory 213 stores the content of the detection processing result in response to a write request (w) from the image processing unit 212, accumulates the content of the detection processing result for a predetermined frame, and outputs from the notification determination processing unit 214. In response to the read request (R), a process of delivering the contents of the accumulated detection processing result to the notification determination processing unit 214 is performed.

  The notification determination processing unit 214 realizes the processing function of the tracking processing unit 124 shown in FIG. 1 together with the detection result buffer memory 213, and every time the detection processing result of the image processing unit 212 is stored in the detection result buffer memory 213. When a read request (R) is made to the detection result buffer memory 213 and an event to be detected is detected as a notification event for a predetermined number of frames, the detected event is determined as a notification event, and event data The transmission unit 215 is instructed to create an event notification message.

  The event data transmission unit 215 realizes the processing function of the communication transmission processing unit 125 shown in FIG. 1 together with the data transmission function of the data transmission / reception unit 200. When receiving an instruction to create an event notification message from the notification determination processing unit 214, An event notification message (MA) having an event name that identifies an event (event) determined to be a notification event and camera position information (GPS information) for specifying an event occurrence location is created, and the event notification A process of sending a message (MA) to the data transmitting / receiving unit 200 and transmitting it to the smart terminal 13 registered in advance as a notification destination is performed.

  The resizing unit 216, the transmission image buffer memory 217, the video distribution processing unit 218, the image data transmission unit 219, and the image distribution request reception unit 220 are components provided for performing an image data distribution service. is there.

  The resizing unit 216 performs a process of resizing the image data stored in the image buffer memory 211 into a frame having a pixel configuration that matches the screen size of the smart terminal 13 and buffering it in the transmission image buffer memory 217. The transmission image buffer memory 217 stores the image data resized by the write request (w) from the resizing unit 216 and the image data stored by the read request (R) from the video distribution processing unit 218. To send.

  The image distribution request receiving unit 220 performs a process of receiving an image distribution request transmitted from the smart terminal 13 via a wireless communication network (not shown) and the data transmission / reception unit 200 and passing it to the video distribution processing unit 218.

  The video distribution processing unit 218 reads image data according to the image distribution request received by the image distribution request receiving unit 220 from the transmission image buffer memory 217, and sends it to the image data transmission unit 219 via the data transmission / reception unit 200 and a wireless communication network (not shown). Perform the process to send.

  As shown in FIG. 3, the smart terminal 13 registered as a notification target in the image processing apparatus 12 includes a device position information acquisition unit 311, a position information buffer memory 312, a movement speed / direction calculation unit 313, and a notification area calculation unit 314. , Notification area / notification list buffer memory 315, message display unit 316, user output device 317, evaluation value calculation unit 318, user input device 320, image distribution transmission unit 321, image data reception unit 322, event data reception unit 323, data It has components such as a transmission / reception device 330.

  The device location information acquisition unit 311 implements the processing function of the location information update processing unit 131 shown in FIG. 1 together with the location information buffer memory 312, and uses the GPS function of the own terminal to send an event notification message of the own terminal. The position information of the reception point to be received, that is, the position information (GPS position information) by the GPS of the terminal itself is periodically updated at a set cycle, and a process of accumulating in the position information buffer memory 312 as a movement locus is performed.

  The position information buffer memory 312 is provided in the processing buffer memory 13M shown in FIG. 1 together with the notification area / notification list buffer memory 315. The position information buffer memory 312 receives the write request (w) from the device position information acquisition unit 311. A certain amount of (GPS position information) is accumulated as a movement locus, and the accumulated position information in response to a read request (R) from the movement speed / direction calculation unit 313 is sent to the movement speed / direction calculation unit 313 as a movement locus.

  The movement speed / direction calculation unit 313 implements the processing function of the speed / direction calculation processing unit 132 shown in FIG. 1. Each time position information is written in the position information buffer memory 312 and the movement locus is updated, The movement locus is read from the position information buffer memory 312, the movement direction and speed of the terminal are calculated based on the movement locus information, and the calculated movement direction and speed information are sent to the notification area calculation unit 314. Perform the process.

  The notification area calculation unit 314 realizes the notification area update processing function of the notification area / evaluation value update processing unit 133 shown in FIG. 1 together with the notification area / notification list buffer memory 315, and is stored in the position information buffer memory 312. Each time the movement trajectory is updated, based on the movement direction and speed information acquired from the movement speed / direction calculation unit 313 and the setting parameters, the following equations (1) and (2) are used. The event search area of the own terminal shown in FIG. 8 is set, and processing for holding the setting image information of the event search area in the notification area buffer area of the notification area / notification list buffer memory 315 is performed.

  As shown in FIG. 8, the event search area calculated and set by the notification area calculation unit 314 includes the position information and speed of the moving track including the current position (x · y) acquired by the speed / direction calculation processing unit 132. Based on each information of (v), the traveling direction (Φ) of the terminal is recognized, and the event search length (event searching length; the length of which changes in the traveling direction (Φ) according to the speed (v); The search range (search area) is defined by L) and the event search angle (θ) whose range angle centering on the traveling direction changes according to the speed (v) and the traveling direction (Φ). In other words, the event search area is longer as the moving speed (v) is faster and shorter as the moving speed (v) is shorter, and the event search angle (θ) is narrower as the moving speed (v) is faster and wider as the moving speed (v) is slower. Is a dynamic variable region that expands in a divergent shape in the traveling direction according to the speed. The event search area setting process will be described later with reference to FIG.

  The notification area / notification list buffer memory 315 has a notification area buffer area and a notification list buffer area, holds the event search area set by the notification area calculation unit 314 in the notification area buffer area, and the evaluation value calculation unit 318. By this area determination process, the event notification message determined to be within the event search area is held in the notification list buffer area, and a notification list is created in the notification list buffer area.

  The evaluation value calculation unit 318 realizes the processing function of the notification area / evaluation value update processing unit 133 shown in FIG. 1, and the event occurrence location based on the camera position information of the event notification message acquired from the event data reception unit 323 Is in the event search area held in the notification area buffer area of the notification area / notification list buffer memory 315, and the event notification message determined to be in the event search area is sent to the notification area / notification A process of registering in the notification list created in the notification list buffer area of the list buffer memory 315 is performed. Further, the evaluation value calculation unit 318 calculates the evaluation value for determining the notification priority of the event notification message registered in the notification list, as shown in FIG. 9 to FIG. The process of updating the evaluation value of the event notification message registered in the notification list is performed using the fixed parameter indicating the above and information on the moving speed (v) calculated by the moving speed / direction calculating unit 313. The dynamic parameters and fixed parameters used here will be described later with reference to FIGS.

  The message display unit 316 implements the processing function of the event notification message display processing unit 136 shown in FIG. 1, and is registered in the notification list created in the notification list buffer area of the notification area / notification list buffer memory 315. It is determined whether or not the message with the highest notification priority has been updated (whether there has been a change in the priority order of the notification target message), and is currently output to the user output device 317 When a new event notification message with a notification priority higher than the notification priority of the existing event notification message appears, it is determined that a new event notification message can be notified instead of the currently notified event notification message, and the notification is possible Notify event information according to the event notification message determined as Output to a user output device 317 to.

  The user output device 317 corresponds to the display unit 14 shown in FIG. 1 and forms a tablet input / output terminal together with the user input device 320 here.

  The user input device 320, the image distribution transmitting unit 321 and the image data receiving unit 322 are components provided for receiving an image data distribution service.

  For the notification event currently output to the user output device 317, the image distribution transmission unit 321 is an image that specifies a real-time image of the current event occurrence point or a recorded image immediately after the occurrence of the event, which is input from the user input device 320. It has a transmission processing function for receiving a distribution request and transmitting an image distribution request to the image processing apparatus 12 that has transmitted the notification event message via the data transmission / reception device 330.

  The image data receiving unit 322 receives the image data (VI) from the image processing apparatus 12 that has received the image distribution request via the data transmission / reception device 330, buffers the frame data in units of frames, and receives the received data as display data to the user output device 317. Has a processing function to pass.

  The event data reception unit 323 has a processing function of receiving an event notification message (MA) from the image processing apparatus 12 registered as a notification destination via the data transmission / reception device 330 and passing it to the evaluation value calculation unit 318.

  The data transmission / reception device 330 performs transmission / reception processing with a predetermined communication protocol with the image processing apparatus 12 via a wireless communication network (not shown), and receives an event notification message (MA) from the registered image processing apparatus 12. The communication processing on the network is performed, receiving the image distribution request to the image processing apparatus 12 and receiving the image data (VI) from the image processing apparatus 12 that has transmitted the image distribution request.

  The event notification message setting process will be described with reference to FIG.

  In the event search area calculated by the notification area calculation unit 314 and set in the notification area buffer area of the notification area / notification list buffer memory 315, the moving speed / direction calculation unit 313 has a position information buffer memory 312 as shown in FIG. The traveling direction (Φ) of the own terminal is recognized based on the position information of the movement locus including the current position (x · y) acquired from the above and the information on the velocity (v), and the following equation (1), (2 ), The event search length (L) whose length changes in the traveling direction (Φ) according to the speed (v), and the traveling direction as the center according to the speed (v) and the traveling direction (Φ) The event search angle (θ) at which the range angle changes is calculated. Each parameter value defining the event search length (L) and the event search angle (θ) is held in the notification area buffer area of the notification area / notification list buffer memory 315.

Event search length (L) = coefficient (kl) × v (1) Formula / event search angle (θ) = 360 ° −coefficient (kt) × v (2) Formula where coefficients (kl, kt) Are dynamic parameters that can be set from the outside, and the minimum and maximum values are fixed parameters.

  The event search area (SA) set here is an event search length (L) that is longer as the moving speed (v) is faster and shorter as the moving speed (v) is shorter, and an event that is narrower and slower as the moving speed (v) is faster. This is a dynamic variable region that is defined by the search angle (θ) and expands in the traveling direction according to the speed. In this embodiment, the event search angle (θ) is set to 360 degrees when the moving speed (v) is lower than a predefined speed minimum value (for example, 10 km / h or less).

  The dynamic parameters and fixed parameters used for calculating the evaluation value for determining the notification priority will be described with reference to FIGS.

  The dynamic parameter density distribution for calculating an evaluation value for determining the notification priority of the event notification message registered in the notification list provided in the notification list buffer area of the notification area / notification list buffer memory 315 is shown in FIGS. FIG. 12 shows the density distribution of fixed parameters.

  As shown in FIGS. 9 to 11, the dynamic parameter used for calculating the evaluation value has a density distribution (probability density) that varies depending on the event search length (L) whose length is defined according to the moving speed (v) ( The event search length (L) is an average value and the variance value is changed according to the moving speed (v)). The higher the moving speed (v) (the longer the event search length (L)), the probability density distribution (L The evaluation value accompanying V: is extended in the advancing direction, and the probability density distribution in the neighboring area (evaluation value accompanying V: Vlen) is increased as the moving speed (v) becomes slower (the event search length (L) becomes shorter). It is a nonlinear (normal distribution) probability density distribution. That is, as the moving speed (v) increases, the evaluation value (Vlen) associated with the event search length (L) is extended in the traveling direction, and as the moving speed (v) decreases, the evaluation value (Vlen) of the neighboring area is increased. Parameter characteristics.

  As shown in FIG. 12, the fixed parameter used to calculate the evaluation value is a linear value based on elapsed time that reduces the probability density (Vtime) due to elapsed time with respect to the event notification message registered in the notification list. It is a probability density distribution, and is a parameter characteristic that lowers the evaluation value as the elapsed time increases for event notification messages registered in the notification list.

  Using this fixed parameter, the evaluation value is updated by the following equation (3).

Evaluation value v (t) = previous evaluation value v (t−1) × time evaluation value (Vtime) (3) Expression All event notifications registered in the notification list using this evaluation value v (t) Update the evaluation value for the message (update the evaluation value in the notification list).

  When v (t) becomes very small, the event notification message is deleted from the notification list.

  Here, referring to the data transition diagram of the notification system shown in FIG. 4, the processing flow of the image processing device 12 shown in FIG. 5, and the processing flow of the smart terminal 13 shown in FIGS. The processing operation of the notification system will be described.

  As described in the above-described preparation for using the system (preparation for using the system 1, 2, and 3), the image processing apparatus 12 having the cameras 11 provided at a plurality of points is used as the advance setting process. Processing parameters, event names, camera names, camera position information, etc. are set in advance. The camera information such as the camera name and the camera position information is transmitted as the setting information of the notification system to the smart terminal 13 that can be arbitrarily registered as the notification destination (B1 in FIG. 4). The smart terminal 13 stores this setting information as information used for a request for distributing image data (VI). When there is a notification destination designation request from the smart terminal 13 (FIG. 4 C1), the image processing apparatus 12 registers the smart terminal 13 that has made the designation request as a notification destination.

  The camera 11 shooting the monitoring location for monitoring the notification target outputs a monitoring image in units of frames at a constant cycle.

  The image processing device 12 captures the monitoring video in units of frames output from the camera 11, captures it in the image processing buffer memory 12 </ b> M together with the camera position information, and uses the preset detection target parameters, the current image and the past image As a result of the comparison, a detection process of an event to be notified in the detection target (event) is performed (FIGS. 4A1 and B1, FIG. 5 steps S11 and S12).

  In this detection process, when an event to be notified is detected, an event notification message (in a predetermined format) having an event name specifying the event and camera position information specifying the occurrence location of the event is detected for the detected event. MA) and the event notification message (MA) is transmitted to all of the smart terminals 13 registered in advance as notification destinations (B3 in FIG. 4, steps S13 to S18 in FIG. 5).

  The smart terminal 13 registered as the notification destination calculates the movement speed and movement direction of its own terminal using the information of the movement locus up to now, and sets the event search area (SA) based on the calculation information ( FIG. 4 C2, steps S21 to S24 in FIG. 6). Further, in accordance with the setting of the event search area (SA), the evaluation value in the notification list is updated (step S25 in FIG. 6).

  Upon receiving the event notification message (MA) from the image processing device 12, the smart terminal 13 determines whether the event occurrence location is within the event search area (SA) based on the camera position information of the event notification message (MA). If it is within the event search area (SA), the event notification message (MA) is registered in the notification list (step S26 in FIG. 6).

  Further, each time an event notification message (MA) is registered in the notification list, the smart terminal 13 performs an evaluation value calculation process for all event notification messages (MA) registered in the notification list, and notifies the notification. A notification priority selection process is performed for the event notification message (MA) registered in the list (steps S27 to S31 in FIG. 6).

  In this process, it is determined that the event notification message (MA) having the highest notification priority can be notified, and event information according to the event notification message (MA) determined to be applicable is notified (presented) to the user (step S32 in FIG. 6). , S33). On the other hand, in the notification priority selection process, the event notification message (MA) whose evaluation value is equal to or less than the threshold is deleted from the notification list (steps S34 to S36 in FIG. 6). In the notification priority selection process, when an event notification message (MA) having a higher notification priority than the event notification message (MA) that is the source of the event information currently notified to the user appears, Instead of the event information that has been notified until, event information according to the event notification message (MA) is notified (presented) to the user.

  By repeatedly performing this notification processing (steps S37 (No) to S21... In FIG. 6), it is possible to always give priority to the information that the user currently needs (C3 in FIG. 4).

  In addition, the user who has received the notification of the event uses the user input device 320 to relate to the notified event information, a live video at the event occurrence point, a recorded video immediately after the event occurrence at the event occurrence point, or an event occurrence. When it is desired to acquire image data (VI) such as live video around the point, an image distribution request specifying the image is transmitted to the image processing device 12, and the requested image data (VI) is acquired from the image processing device 12. The image relating to the event occurrence point can be recognized (FIGS. 4C4 and B4). On the screen to notify the user, in addition to the live video of the event occurrence point or the recorded video immediately after the event occurrence at the event occurrence point, the event occurrence location, the occurrence time, information preset according to the event, etc. are simultaneously presented can do.

  As described above, in the image processing system that detects an event to be notified by processing an image captured by a camera and sends a notification message of the detected event to a pre-registered mobile device, notification of the detected event A notification system capable of efficiently notifying a user of each smart terminal (each mobile device) of a message can be provided.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, as for the dynamic parameter and fixed parameter used for calculating the evaluation value for determining the notification priority shown in the embodiment, a parameter having an arbitrary characteristic corresponding to the detected event is used regardless of the parameter characteristic of the embodiment. Is possible. In addition, system components can be increased or decreased arbitrarily. Further, the method described in the above embodiment can be stored and distributed in a storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory as a program that can be executed by a computer. In addition, an OS (operating system) running on a computer based on an instruction of a program installed in the computer from a storage medium, MW (middleware) such as database management software, network software, and the like realize the above-described embodiment. A part of each process may be executed. Furthermore, the storage medium in the present invention is not limited to a medium independent of a computer, and may be a storage medium in which a program transmitted via a LAN, the Internet, or the like is downloaded and stored or temporarily stored.

  DESCRIPTION OF SYMBOLS 11 ... Camera, 12 ... Image processing apparatus, 13 ... Smart terminal, 14 ... Display part, 121 ... Capture part, 12M ... Image processing buffer memory, 122 ... Pre-processing part, 123 ... Detection processing part, 124 ... Tracking processing part, 125 ... Notification transmission processing unit, 13M ... Processing buffer memory, 131 ... Position information update processing unit, 132 ... Speed / direction calculation processing unit, 133 ... Notification area / evaluation value update processing unit, 134 ... Notification reception processing unit, 135 ... Notification list update processing unit, 136 ... Event notification message display processing unit, 200 ... Data transmission / reception unit, 211 ... Image buffer memory, 212 ... Image processing unit, 213 ... Detection result buffer memory, 214 ... Notification determination processing unit, 215 ... Event data transmission unit, 216 ... resizing unit, 217 ... transmission image buffer memory, 218 ... video distribution processing unit, 219 Image data transmission unit, 220 ... Image distribution request reception unit, 311 ... Device position information acquisition unit, 312 ... Position information buffer memory, 313 ... Movement speed / direction calculation unit, 314 ... Notification area calculation unit, 315 ... Notification area and notification List buffer memory, 316 ... Message display unit, 317 ... User output device, 318 ... Evaluation value calculation unit, 320 ... User input device, 321 ... Image distribution transmission unit, 322 ... Image data reception unit, 323 ... Event data reception unit, 330: Data transmission / reception device, SA: Event search area, MA: Event notification message, VI: Image data.

Claims (15)

An event to be notified by processing an image captured by a camera is detected, and an event notification message including an event name for identifying the event and camera position information for identifying an occurrence location of the event is registered in advance. An event notification processing device applied to an image processing system that transmits to a device,
The device is
Storage means for periodically updating the location information of the reception point for receiving the event notification message and storing it as a movement locus;
Each time the position information is accumulated in the storage means, the movement speed and movement direction of the device is recognized using the movement locus, and the recognized movement speed and movement direction are determined based on the recognized movement speed and movement direction. An event search area setting processing means for setting an event search area in which the area expanding in the traveling direction is changed according to
A notification list that receives the event notification message, identifies an event occurrence location based on camera position information for the received event notification message, and prepares an event notification message in which the event occurrence location is in the event search area Registration processing means for registering with,
An event notification processing apparatus comprising: selecting an event notification message to be notified for an event notification message registered in the notification list. An event to be notified by processing an image captured by a camera is detected, and an event notification message including an event name for identifying the event and camera position information for identifying an occurrence location of the event is registered in advance. An event notification processing device applied to an image processing system that transmits to a device,
The device is
Storage means for periodically updating the location information of the reception point for receiving the event notification message and storing it as a movement locus;
An event search area that recognizes the movement speed and movement direction of its own device using the movement trajectory each time the position information is stored in the storage means and expands in the traveling direction based on the recognized movement speed and movement direction. An event search area setting processing means to be set;
A notification list that receives the event notification message, identifies an event occurrence location based on camera position information for the received event notification message, and prepares an event notification message in which the event occurrence location is in the event search area Registration processing means for registering with,
Each time an event notification message is registered in the notification list, a notification priority processing means for determining a notification priority of the event notification message using the moving locus and a set parameter;
Notification determination processing means for determining whether notification is possible according to the notification priority for the event notification message registered in the notification list;
An event notification processing device comprising: The event search area setting processing means includes:
Change the setting range of the event search area in the traveling direction according to the moving speed,
The notification priority processing means includes:
For the event notification message registered in the notification list, a probability density distribution that lowers the evaluation value according to the elapsed time is prepared as a fixed parameter included in the parameter, and a priority evaluation value for the notification is calculated using the fixed parameter, The event notification processing apparatus according to claim 2, wherein the notification priority is determined using the priority evaluation value. The notification priority processing means includes:
A non-linear probability density distribution that extends in the traveling direction as the moving speed increases is set as a dynamic parameter included in the parameter, the parameter including the dynamic parameter and the latest position information included in the moving trajectory, and The event notification processing apparatus according to claim 3, wherein a priority evaluation value for a notification is calculated using a moving speed, and the notification priority is determined using the priority evaluation value.   The event search area has a speed set by a search length (L) that is longer as the moving speed is faster and shorter as the moving speed is faster, and a search angle (θ) that is narrower and wider as the moving speed is faster. 4. The event notification processing device according to claim 1, wherein the event notification processing device is a dynamic variable region that expands in a divergent shape in the traveling direction.   5. The notification priority processing means includes processing means for deleting an event notification message whose priority evaluation value is less than a set threshold value from the notification list. Event notification processing device.   3. The event notification processing apparatus according to claim 1, wherein the registration processing means includes processing means for deleting an event notification message whose event occurrence location is out of the event search area from the notification list. . The notification determination processing means includes notification means for displaying or outputting the information of the event notification message determined to be notified, and the notification determination processing means is higher than the notification priority of the currently notified event notification message. When a new event notification message having a notification priority appears, it is determined that a new event notification message can be notified instead of the currently notified event notification message, and the information of the event notification message determined to be notification-ready The event notification processing apparatus according to claim 2, wherein notification is provided to the outside by notification means.   Using the event name and camera position information, a process for acquiring a live video at the event occurrence point or a recorded video immediately after the event from the device that has sent the event notification message determined to be notified by the notification determination processing unit The event notification processing device according to claim 2, comprising means.   2. The apparatus according to claim 1, further comprising means for designating whether or not event notification is required for each device that sends the event notification message, and receiving the event notification message from a device that specifies the event notification key. Or the event notification processing apparatus of 2. An event to be notified by processing an image captured by a camera is detected, and an event notification message including an event name that identifies the event and camera position information that identifies the location where the event has occurred is detected in advance as a notification target. An image processing apparatus for transmitting to a registered mobile device;
It is registered as a notification target in the image processing apparatus, and can transmit and receive information via the wireless communication line with the image processing apparatus.
Storage means for periodically updating the location information of the reception point for receiving the event notification message and storing it as a movement locus;
An event search area that recognizes the movement speed and movement direction of its own device using the movement trajectory each time the position information is stored in the storage means and expands in the traveling direction based on the recognized movement speed and movement direction. An event search area setting processing means to be set;
A notification list that receives the event notification message, identifies an event occurrence location based on camera position information for the received event notification message, and prepares an event notification message in which the event occurrence location is in the event search area Registration processing means for registering with,
Each time an event notification message is registered in the notification list, a notification priority processing means for determining a notification priority of the event notification message using the moving locus and a set parameter;
Notification determination processing means for determining whether notification is possible according to the notification priority for the event notification message registered in the notification list;
A mobile device comprising:
An event notification system comprising: An event to be notified by processing an image captured by a camera is detected, and an event notification message including an event name for identifying the event and camera position information for identifying an occurrence location of the event is registered in advance. An event notification processing program applied to the device in an image processing system for transmitting to the device,
A function of periodically updating the location information of the reception point that receives the event notification message and storing it as a movement trajectory,
Each time the position information is accumulated, the movement trajectory is used to recognize the movement speed and movement direction of the device, and an event search area that expands in a fan shape in the traveling direction based on the recognized movement speed and movement direction is set. Function and
A notification list that receives the event notification message, identifies an event occurrence location based on camera position information for the received event notification message, and prepares an event notification message in which the event occurrence location is in the event search area With the ability to register with
Each time an event notification message is registered in the notification list, a function for determining a notification priority of the event notification message using the movement locus and a set parameter;
A function for determining whether notification is possible according to the notification priority for the event notification message registered in the notification list;
An event notification processing program for causing a computer to realize the above.   The event search area is set by a search length that is longer as the moving speed is faster and shorter as the moving speed is faster, and a search angle that is narrower and wider as the moving speed is faster. The event notification processing program according to claim 12, wherein the event notification processing program is a dynamically variable area that extends into   The function of determining the notification priority of the event notification message is prepared as a fixed parameter included in the parameter, a probability density distribution for decreasing the evaluation value according to the elapsed time for the event notification message registered in the notification list, The event notification processing program according to claim 12, wherein a priority evaluation value for notification is calculated using a parameter, and the notification priority is determined based on the priority evaluation value.   The function of determining the notification priority of the event notification message sets, as a dynamic parameter included in the parameter, a non-linear probability density distribution that extends in the traveling direction as the moving speed increases, and includes the dynamic parameter The priority evaluation value for notification is calculated using the parameter and the latest position information and moving speed included in the movement locus, and the notification priority is determined based on the priority evaluation value. Event notification processing program described in 1.

Images