JP6301062B2 - Abnormal behavior monitoring system, program, and monitoring method on road - Google Patents

Description

  The present invention relates to monitoring abnormal behavior on a road.

  Patent Document 1 discloses a technique of a monitoring system that irradiates a subject with infrared light, captures the reflected near-infrared light, outputs a monochrome image, and inputs the image to a recording apparatus.

JP 2012-65312 A

  However, since the technique described above captures the reflected light of the irradiated infrared light, only the subject within the range where the reflected light reaches can be monitored. For this reason, when the subject is so far away that the reflected light does not reach, it does not function effectively and the scenes that can be utilized are limited. The present invention has been made in view of the above, and an object thereof is to enable a wider range of monitoring.

For example, an abnormal behavior monitoring system on a road according to the present invention includes an image acquisition unit that detects thermal infrared rays that are electromagnetic waves having a wavelength of 8 to 15 micrometers emitted by a subject, and detects a plurality of abnormalities in the image. An abnormality detection unit that detects, when the abnormality detection unit detects any abnormality, a notification unit that performs predetermined notification according to the abnormality, and an analysis range on the image that corresponds to the plurality of abnormalities to be detected And a storage unit that stores the detected object in association with each other, and the abnormality detecting unit detects an abnormality when detecting the detected object for the analysis range on the image corresponding to the detected abnormality. , characterized in that.

  In the abnormal behavior monitoring system on the road, the image acquisition unit detects black body radiation radiated from the subject.

  In the abnormal behavior monitoring system on the road, the notification unit transmits a part of the image in which the abnormality is detected to another device via a network.

  Further, in the abnormal behavior monitoring system on the road, when the notification unit transmits a part of the image, the notification unit displays the image so as to satisfy a data capacity limit predetermined for each of the other devices. Compressed and transmitted.

  Further, in the abnormal behavior monitoring system on the road, the notification unit transmits information referring to a part of the image where the abnormality is detected from another device via a network to the other device. It is characterized by that.

Further, in the abnormal behavior monitoring system on the road, the storage unit includes a vehicle as an object to be detected, and the abnormality detection unit detects reverse running in violation of the vehicle regulations as an abnormality. It is characterized by.

In the abnormal behavior monitoring system on the road, the storage unit includes a pedestrian as a detection target, and the abnormality detection unit detects the presence of the pedestrian as an abnormality. To do.

The abnormal behavior monitoring system on the road further includes a visible light image acquisition unit that detects visible light and acquires an image of visible light, and the notification unit is connected to another device via a network. A part of the visible light image is transmitted.

Further, for example, the program according to the present invention is a program that causes a computer to execute a procedure for monitoring abnormal behavior on a road, and the computer is connected to a control unit and a plurality of abnormal behaviors to be detected on an image . An image that acquires an image by causing the control unit to function as a storage unit that associates and stores an analysis range and a detection target, and detects thermal infrared rays that are electromagnetic waves having a wavelength of 8 to 15 micrometers emitted from the subject. An abnormality detection procedure for acquiring an image from the acquisition unit and detecting a plurality of abnormalities in the image, and a notification procedure for performing predetermined notification in response to any abnormality detected by the abnormality detection procedure In the abnormality detection procedure, the detection object is detected in the analysis range on the image corresponding to the abnormality to be detected. , Is detected as abnormal, wherein the.

Further, for example, the abnormal behavior monitoring method for roads according to the present invention is an abnormal behavior monitoring method for monitoring abnormal behaviors on a road using a computer. The computer includes a control unit and a wavelength of 8-15 microns emitted by a subject. An image acquisition unit that detects thermal infrared rays that are electromagnetic waves of a meter and acquires an image; and a storage unit that stores an analysis range on the image corresponding to the plurality of abnormal behaviors to be detected and a detection target in association with each other. The abnormality detection step for detecting a plurality of abnormalities in the image, and a notification step for performing a predetermined notification in response to any abnormality detected by the abnormality detection step. If, performed, the abnormal detecting step, upon detecting the detection object for analysis range on the image said abnormal response to detecting abnormal Detecting and, characterized in that.

  By applying the present invention, a wider range of monitoring can be performed. Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

It is a figure which shows the outline | summary of the monitoring system of this embodiment. It is a figure which shows the functional block of the abnormality detection apparatus of this embodiment. It is a figure which shows the data structure of the imaging | photography information storage part of this embodiment. It is a figure which shows the data structure of the alerting | reporting destination memory | storage part of this embodiment. It is a figure which shows the data structure of the detection rule memory | storage part of this embodiment. It is a figure which shows the data structure of the alerting | reporting information storage part of this embodiment. It is a figure which shows the functional block of the monitoring terminal of this embodiment. It is a figure which shows the data structure of the alerting | reporting reception information storage part of this embodiment. It is a figure which shows the data structure of the abnormality detection apparatus information storage part of this embodiment. It is a figure which shows the functional block of the radio | wireless monitoring terminal of this embodiment. It is a figure which shows the hardware structure of the abnormality detection apparatus of this embodiment. It is a figure which shows the hardware structure of the monitoring terminal of this embodiment. It is a figure which shows the hardware structure of the radio | wireless monitoring terminal of this embodiment. It is a figure which shows the processing flow of the abnormality detection process of this embodiment. It is a figure which shows the processing flow of the picked-up image reference process of this embodiment. It is a figure which shows the example of the picked-up image reference screen of this embodiment. It is a figure which shows the outline | summary of the monitoring system of another embodiment.

  Embodiments of the present invention will be described below with reference to FIGS.

  FIG. 1 is a diagram showing an overview of a monitoring system 1 which is an example of an embodiment of the present invention. The monitoring system 1 is a monitoring target that mainly requires monitoring of dangerous behavior / abnormal behavior, such as predetermined intruders outdoors (for example, pedestrians entering a car-only road) such as car-only roads, expressway roads, and general roads. 2 monitoring system. The monitoring system 1 is connected to the monitoring destination facility 100 provided at the monitoring point and the monitoring destination facility 100 via the network 10 such as the Internet, and is provided at the point where the monitoring person 3 who performs monitoring performs the monitoring. The monitoring source equipment 300 is included.

  The monitoring destination facility 100 includes an infrared thermal camera 110 that keeps the monitoring target 2 within the angle of view, an abnormality detection device 200, and a wireless communication device 120. The infrared thermal camera 110 is a heat ray imaging apparatus that detects infrared rays (black body radiation) emitted from an object (that is, a subject) and outputs image information. The infrared thermal camera 110 only needs to include an infrared detection element, and preferably detects thermal infrared radiation, which is an electromagnetic wave having a wavelength of about 8-15 micrometers, and outputs an image based on the amount of heat generated by the element. Either a thermal type sensor that outputs or an quantum type sensor that outputs an image based on the power generation amount of the element may be used. Therefore, with regard to the monitoring system 1 according to the present embodiment, it can be said that the image is hardly obscured depending on the illuminance of external visible light, temperature, humidity, a large amount of disturbance due to oblique light or backlight, and the presence or absence of shielding such as smoke.

  The abnormality detection apparatus 200 is an apparatus that receives and analyzes information on a heat ray image output from the infrared thermal camera 110 and detects an abnormality. When the information of the heat ray image violates a predetermined rule, the abnormality detection device 200 detects an abnormality and transmits a message to the monitoring source facility 300 according to the violated rule.

  FIG. 2 is a block diagram showing an outline of the configuration of the abnormality detection apparatus 200. The abnormality detection device 200 includes a control unit 210, a storage unit 220, and a communication device interface unit 230. The control unit 210 includes a photographing information processing unit 211, a detection rule processing unit 212, a notification information creation unit 213, a notification unit 214, and a video reproduction unit 215.

  The imaging information processing unit 211 converts a video signal output from the infrared thermal camera 110 into digital image information. At that time, the imaging information processing unit 211 stores the video signal in the storage unit 220 as file information by dividing the video signal at a predetermined time.

  The detection rule processing unit 212 determines whether all or part of the digital image information converted by the photographing information processing unit 211 satisfies a condition defined by a preset detection rule. If there is a detection rule that satisfies the condition, it is detected as an abnormality, and information that can identify the occurrence of the abnormality is associated with the digital image information and stored in the storage unit 220.

  The notification information creation unit 213 creates information for performing notification when an abnormality occurs. For example, data collection and processing for transmitting an e-mail attached with image information at the time of occurrence of an abnormality to a predetermined address is performed. Alternatively, the notification information creation unit 213 creates message information for notifying the monitoring terminal 400. Note that the notification information creation unit 213 performs processing for compressing captured video data attached to an e-mail or the like to a predetermined file size.

  The notification unit 214 transmits to the wireless monitoring terminal 500 and the monitoring terminal 400 the electronic mail and message information at the time of occurrence of the abnormality generated by the notification information generation unit 213, respectively.

  When the video playback unit 215 receives a playback request for a captured video from another device via the network 10, the video playback unit 215 streams the captured video stored in the storage unit 220.

  The storage unit 220 includes a photographing information storage unit 221, a notification destination storage unit 222, a detection rule storage unit 223, and a notification information storage unit 224.

  FIG. 3 is a diagram showing a data structure of the photographing information storage unit 221. As shown in FIG. The shooting information storage unit 221 includes a shooting video ID 221A that identifies a shot video, a recording start time 221B that specifies a time when recording of the video identified by the shooting video ID 221A is started, and a video that is identified by the shooting video ID 221A. A recording end time 221C for specifying the time when the recording of the recording is completed, and a notification message ID 221D for specifying the message when an abnormality is found in the video identified by the captured video ID 221A. ,including.

  FIG. 4 is a diagram illustrating a data structure of the notification destination storage unit 222. The notification destination storage unit 222 includes a rule ID 222A, a notification method 222B, a notification destination 222C, a transmission capacity limit 222D, and a notification message prefix 222E.

  The rule ID 222A is information for identifying a rule for detecting an abnormality to be notified. The notification method 222B is information for specifying a method for performing notification when the rule identified by the rule ID 222A is violated. For example, as a notification method, “e-mail” that transmits information in an e-mail format to a mailbox identified by an e-mail address, or a receivable message object is transmitted to the monitoring terminal 400 “ Message object transmission "is included.

  The notification destination 222C is information for specifying a notification destination to be notified when the rule identified by the rule ID 222A is violated. For example, the notification destination includes address information such as an e-mail address that can be referred to from the wireless monitoring terminal 500 and a URL (Uniform Resource Locator) that identifies the monitoring terminal 400.

  The transmission capacity limit 222D is information for specifying a limit amount when there is a limit on the data capacity to be transmitted regarding a method of performing notification when the rule identified by the rule ID 222A is violated.

  The notification message prefix 222E is information for specifying a prefix character to be attached to a message used when notification is made when the rule identified by the rule ID 222A is violated. For example, the prefix includes a predetermined character string that identifies the device that issued the report.

  FIG. 5 shows information indicating the data structure of the detection rule storage unit 223. The detection rule storage unit 223 includes a rule ID 223A, an analysis range 223B, and a detection target 223C.

  The rule ID 223A is information for identifying a rule for detecting an abnormality to be notified. The analysis range 223B is information for specifying a range on the video to be analyzed as a determination target when determining whether or not the rule identified by the rule ID 223A is violated. The detection target 223C is information for specifying a target on the video to be analyzed as a determination target when determining whether or not the rule identified by the rule ID 223A is violated. For example, the detection object 223C includes predetermined types such as “pedestrians” that detect pedestrians, “vehicles” that detect vehicles that run backward in violation of laws and regulations, and “bicycles” that detect bicycles. The detection object is included. The detection target set for the detection target 223C uses predetermined parameters such as pattern matching on the image, detection of the moving direction / speed, and change in the temperature of the target according to the detection target. , And is specified by the detection rule processing unit 212.

  FIG. 6 shows information indicating the data structure of the notification information storage unit 224. The notification information storage unit 224 includes a message ID 224A, a notification date and time 224B, a notification destination 224C, a notification method 224D, and a notification shooting video ID 224E.

  The message ID 224A is information that identifies the issued message. The notification date and time 224B is information that specifies the date and time when the message specified by the message ID 224A was issued. The notification destination 224C is information for specifying a notification destination to which the message specified by the message ID 224A is issued. The notification method 224D is information for specifying a method for issuing the message specified by the message ID 224A. The notification video image ID 224E is information for specifying a video image related to the message specified by the message ID 224A.

  Returning to the description of FIG. The communication device interface unit 230 performs communication with the wireless communication device 120. Specifically, information to be transmitted is transferred to the wireless communication apparatus 120, the transmission process is transferred, and a reception process for receiving the information received by the wireless communication apparatus 120 is performed.

  The above is the configuration of the abnormality detection apparatus 200. The wireless communication device 120 is a terminal device of a wireless communication service connected to the Internet or the like, for example, and wirelessly relays information transmission / reception between the abnormality detection device 200 and the monitoring terminal 400 or the wireless monitoring terminal 500.

  The monitoring source equipment 300 includes either or both of the monitoring terminal 400 and the wireless monitoring terminal 500.

  The monitoring terminal 400 is an information processing apparatus such as a so-called PC (Personal Computer) or a workstation, and can communicate with the abnormality detection apparatus 200 or the like via the network 10. Further, the monitoring terminal 400 can receive the broadcast information transmitted from the abnormality detection device 200 as a message object in a predetermined format, and can request the abnormality detection device 200 to request a stream reproduction request for a detailed captured video to reproduce the stream. it can.

  FIG. 7 is a block diagram showing an outline of the configuration of the monitoring terminal 400. The monitoring terminal 400 includes a control unit 410, a storage unit 420, a communication device interface unit 430, an input reception unit 440, and an output unit 450. The control unit 410 includes a notification information processing unit 411, a detection rule creation unit 412, and a video information reference unit 413.

  The notification information processing unit 411 receives and analyzes the message object that notifies the abnormality issued from the abnormality detection device 200, identifies the content of the abnormality, and displays the abnormality.

  The detection rule creation unit 412 supports creation / editing of a detection rule that defines an abnormality to be detected by the abnormality detection device 200. Specifically, the detection rule creation unit 412 receives input for designating an analysis range and a detection target on a predetermined screen, assigns a message ID, and instructs the abnormality detection apparatus 200 to store the detection rule as a detection rule. Send.

  When the video information reference unit 413 receives an input of a captured video playback request to another device via the network 10, the video information reference unit 413 requests the other device to stream the captured video, and streams the received captured video. To do.

  The storage unit 420 includes a notification reception information storage unit 421 and an abnormality detection device information storage unit 422.

  FIG. 8 shows information indicating the data structure of the notification reception information storage unit 421. The notification reception information storage unit 421 includes a message ID 421A, a notification date and time 421B, a notification source 421C, and a captured video ID 421D.

  The message ID 421A is information that identifies the issued message. The notification date and time 421B is information that specifies the date and time when the message specified by the message ID 421A was issued. The notification source 421C is information that specifies the anomaly detection device 200 that is the notification source that issued the message specified by the message ID 421A. The photographed video ID 421D is information that identifies a photographed video associated with the message identified by the message ID 421A.

  FIG. 9 shows information indicating the data structure of the abnormality detection device information storage unit 422. The abnormality detection device information storage unit 422 includes an arrangement area 422A, arrangement point identification information 422B, an abnormality detection device ID 422C, and an access URL 422D.

  The arrangement area 422A and the arrangement point identification information 422B are information for specifying geographical information regarding the point where the monitoring destination facility 100 is arranged. In other words, the location area 422A stores information that identifies the location area, for example, information that identifies a prefecture or state, a region that is a set of a plurality of prefectures or states, and the like. Further, the arrangement point identification information 422B is information for specifying in detail the point where the monitoring destination equipment 100 is arranged. For example, the location point identification information 422B stores information specifying the coordinates, address, building name, and the like where the monitoring destination equipment 100 is placed.

  The abnormality detection device ID 422C is information for specifying the abnormality detection device 200 arranged at the arrangement position specified by the arrangement area 422A and the arrangement point identification information 422B. The access URL 422D is information for specifying a URL used when requesting the abnormality detection apparatus 200 arranged in the arrangement area 422A and the arrangement point identification information 422B to reproduce the captured video.

  Returning to the description of FIG. The communication device interface unit 430 performs communication between the monitoring terminal 400 and the abnormality detection device 200 via the wireless communication device 120 using a communication device (not shown) that can be connected to the network 10. The input receiving unit 440 receives input from the user or the monitor 3. The output unit 450 outputs screen information such as a notified message and a captured video.

  The above is the configuration of the monitoring terminal 400.

  FIG. 10 is a block diagram showing an outline of the configuration of the wireless monitoring terminal 500. Wireless monitoring terminal 500 includes a control unit 510, a storage unit 520, and a communication unit 530. The wireless monitoring terminal 500 is a so-called mobile phone terminal, smart phone terminal, tablet terminal, PDA (Personal Digital Assistant), notebook computer, or the like.

  The control unit 510 includes an email processing unit 511 and a browser unit 512. The e-mail processing unit 511 downloads, receives, and displays an e-mail transmitted to a mailbox on a predetermined network. In addition, when the captured video data is attached to the email, the email processing unit 511 reproduces the captured video data. The browser unit 512 accesses a URL or the like (including an IP address) indicating the abnormality detection device 200, and downloads captured video data.

  The storage unit 520 includes a mail information storage unit 521. In the mail information storage unit 521, sent and received e-mails are stored in a predetermined format for each mail account identified by a predetermined mail address. The communication unit 530 connects to the network 10 and acquires an e-mail from the abnormality detection apparatus 200 via a predetermined e-mail box connectable from the network 10. The input receiving unit 540 receives an input from the user or the monitor 3. The output unit 550 outputs screen information such as a received electronic mail and a captured video attached to the electronic mail.

  The above is the configuration of the wireless monitoring terminal 500.

  FIG. 11 is a diagram illustrating a hardware configuration of the abnormality detection apparatus 200. In the present embodiment, the abnormality detection device 200 is a computer such as a personal computer (PC), various mobile phone terminals including a workstation, a server device, a smartphone, or the like, or a PDA.

  The abnormality detection device 200 includes an input device 201, an external storage device 202, a calculation device 203, a main storage device 204, a communication device I / F 205, a video input I / F 206, and a bus that connects the devices to each other. 207.

  The input device 201 is a device that receives input from, for example, a keyboard, a mouse, a touch pen, a pressure-sensitive touch sensor, an electrostatic induction touch sensor, and other pointing devices.

  The external storage device 202 is a nonvolatile storage device such as a hard disk device, a flash memory, or an SSD (Solid State Disk).

  The arithmetic device 203 is an arithmetic device such as a CPU (Central Processing Unit).

  The main storage device 204 is a memory device such as a RAM (Random Access Memory).

  The communication device I / F 205 is a device that serves as an interface for communicating with the wireless communication device 120.

  The video input I / F 206 is a device that receives video input information from the infrared thermal camera 110. For example, the video input I / F 206 receives an input of an analog video signal such as NTSC or PAL from the infrared thermal camera 110 or a digital video signal.

  The imaging information processing unit 211, the detection rule processing unit 212, the notification information creation unit 213, the notification unit 214, and the video reproduction unit 215 of the abnormality detection device 200 perform processing on the arithmetic device 203 of the abnormality detection device 200. It is realized by the program to make.

  This program is stored in the main storage device 204 or the external storage device 202, loaded onto the main storage device 204 for execution, and executed by the arithmetic device 203.

  Further, the storage unit 220 of the abnormality detection device 200 is realized by the external storage device 202 and the main storage device 204 of the abnormality detection device 200.

  Also, the communication device interface unit 230 of the abnormality detection device 200 is realized by the communication device I / F 205.

  The hardware configuration of the abnormality detection apparatus 200 has been described above.

  FIG. 12 is a diagram illustrating a hardware configuration of the monitoring terminal 400. In this embodiment, the monitoring terminal 400 is a computer such as a personal computer (PC), various mobile phone terminals including a workstation, a server device, a smartphone, and the like, and a PDA.

  The monitoring terminal 400 includes an input device 401, an external storage device 402, an arithmetic device 403, a main storage device 404, a communication device I / F 405, and a bus 407 that connects the devices to each other.

  The input device 401 is a device that receives input from, for example, a keyboard, a mouse, a touch pen, a pressure-sensitive touch sensor, an electrostatic induction touch sensor, and other pointing devices.

  The external storage device 402 is a nonvolatile storage device such as a hard disk device, a flash memory, or an SSD.

  The arithmetic device 403 is an arithmetic device such as a CPU.

  The main storage device 404 is a memory device such as a RAM.

  The communication device I / F 405 is a device serving as an interface for communicating with other devices on the network 10.

  The notification information processing unit 411, the detection rule creation unit 412, and the video information reference unit 413 of the monitoring terminal 400 are realized by a program that causes the arithmetic device 403 of the monitoring terminal 400 to perform processing.

  This program is stored in the main storage device 404 or the external storage device 402, loaded onto the main storage device 404 for execution, and executed by the arithmetic device 403.

  The storage unit 420 of the monitoring terminal 400 is realized by the external storage device 402 and the main storage device 404 of the monitoring terminal 400.

  Further, the communication device interface unit 430 of the monitoring terminal 400 is realized by the communication device I / F 405.

  Further, the input receiving unit 440 of the monitoring terminal 400 is realized by the input device 401. The output unit 450 of the monitoring terminal 400 is realized by a display device or the like connected to the monitoring terminal 400 (not shown). The above is the hardware configuration of the monitoring terminal 400.

  FIG. 13 is a diagram illustrating a hardware configuration of the wireless monitoring terminal 500. In the present embodiment, the wireless monitoring terminal 500 is easy to carry, for example, various mobile phone terminals including a smartphone or the like, a PDA, and a notebook PC, and can communicate with devices connected to the network 10 wirelessly. It is a calculator.

  The wireless monitoring terminal 500 includes an input device 501, an external storage device 502, an arithmetic device 503, a main storage device 504, a communication I / F 505, an output device 506, and a bus 507 that connects the respective devices to each other. Have

  The input device 501 is a device that receives input from, for example, a pressure-sensitive touch sensor, an electrostatic induction touch sensor, other pointing devices, a touch pen, a keyboard, or a mouse.

  The external storage device 502 is a nonvolatile storage device such as a flash memory or an SSD.

  The arithmetic device 503 is an arithmetic device such as a CPU.

  The main storage device 504 is a memory device such as a RAM, for example.

  The communication I / F 505 is a device that serves as an interface for communicating with other devices on the network 10.

  The output device 506 is a digital information display device such as a liquid crystal display or an organic EL (ElectroLuminescence) display.

  The e-mail processing unit 511 and the browser unit 512 of the wireless monitoring terminal 500 are realized by a program that causes the arithmetic device 503 of the wireless monitoring terminal 500 to perform processing.

  This program is stored in the main storage device 504 or the external storage device 502, loaded onto the main storage device 504 for execution, and executed by the arithmetic device 503.

  The storage unit 520 of the wireless monitoring terminal 500 is realized by the external storage device 502 and the main storage device 504 of the wireless monitoring terminal 500.

  Further, the communication unit 530 of the wireless monitoring terminal 500 is realized by the communication I / F 505.

  Further, the input receiving unit 540 of the wireless monitoring terminal 500 is realized by the input device 501. The output unit 550 of the wireless monitoring terminal 500 is realized by the output device 506. The hardware configuration of the wireless monitoring terminal 500 has been described above.

<Description of processing>
Next, the abnormality detection process of the abnormality detection apparatus 200 will be described.

  FIG. 14 is a diagram illustrating a process flow of the abnormality detection process. The abnormality detection process is started when the abnormality detection device 200 is powered on and activated.

  First, the imaging information processing unit 211 receives a video signal (step S001). Specifically, the imaging information processing unit 211 receives an NTSC or PAL video signal transmitted from the infrared thermal camera 110, performs sampling with a predetermined sampling period, creates digital information of the captured video, and stores it. Stored in the unit 220. In addition, the shooting information processing unit 211 stores information about the stored digital information of the shot video in the shooting information storage unit 221. Specifically, the shooting information processing unit 211 assigns a shooting video ID to associate with the digital information of the shooting video, stores the numbered shooting video ID in the shooting video ID 221A, and starts recording the shooting video. The recording time is stored in the recording start time 221B, and the recording video recording end time is stored in the recording end time 221C. Note that the imaging information processing unit 211 may store the video signals for a predetermined period (for example, 1 minute) in a buffer and digitize them together.

  And the detection rule process part 212 detects a violation by applying a rule (step S002). Specifically, the detection rule processing unit 212 sets the detection target 223C within the analysis range 223B for each of the rules stored in the detection rule storage unit 223 for the digital information of the captured video created in step S001. It is determined whether or not it is detected, and if it is detected, it is detected that the rule is violated. That is, it can be said that the detection rule processing unit 212 detects an abnormality in the analysis range with the detection content corresponding to the abnormality, with a predetermined region of the image corresponding to the abnormality to be detected as the analysis range. Note that the detection rule processing unit 212 performs display processing such as superimposing a line surrounding the detection target with a red frame on a predetermined region on the image on which the detected detection target is displayed.

  Then, the detection rule processing unit 212 determines whether there is a violated rule (step S003). Specifically, the detection rule processing unit 212 determines whether there is one or more rules that have been violated in step S002. If there is no violated rule, the imaging information processing unit 211 returns the control to step S001.

  When there are one or more rules that have been violated (in the case of “Yes” in step S003), the notification information creation unit 213 reports, for each of the violated rules, a notification destination, a notification method, a transmission capacity limit, and a notification message. The prefix information is specified (step S004). Specifically, the notification information creation unit 213 refers to the record corresponding to the rule ID that the rule ID 222A of the notification destination storage unit 222 violates, and notifies the notification method 222B, the notification destination 222C, the transmission capacity limit 222D, and the notification message. Read the prefix 222E.

  Then, the notification information creation unit 213 compresses the digital information of the captured video so as to meet the transmission capacity limit (step S005). Specifically, the notification information creation unit 213 generates information obtained by compressing the digital information of the captured video so as to be smaller than any of the information of the transmission capacity limitation 222D read in step S004.

  And the alerting | reporting part 214 alert | reports to an alerting | reporting destination (step S006). Specifically, the notification unit 214 violates the information of the notification message prefix 222E by generating information according to a predetermined format corresponding to the notification method 222B for each notification destination 222C identified in step S004. A message ID obtained by combining the rule ID is added and transmitted via the communication device interface unit 230. In addition, the notification unit 214 records information on the notified message in a corresponding column of the notification information storage unit 224. In addition, the notification unit 214 stores a message ID in the notification message ID 221D of the shooting information storage unit 221 for the shot video that has been notified. If the notification method 222B is an e-mail, the notification unit 214 transmits an e-mail including the digital information of the photographed video compressed in step S005 as an attached file. If the notification method 222B is message object transmission, the notification unit 214 may transmit a photographed video ID that identifies the photographed video attached to the message object without attaching digital information of the photographed video. Then, the imaging information processing unit 211 returns the control to step S001.

  The above is the process flow of the abnormality detection process. By performing the abnormality detection process, a heat ray image of the monitoring target 2 is acquired by the infrared thermal camera 110, the presence / absence of the abnormality is determined, and if there is an abnormality, it can be notified to the notification destination by a predetermined method. Also, when the notification destination is an e-mail address, the e-mail processing unit 511 reproduces the digital information of the attached captured video in the wireless monitoring terminal 500, and the video including the time point when the abnormality is detected is converted into a moving image. Can be output. Therefore, since the supervisor 3 can grasp the situation at the time of occurrence of the abnormality using the wireless monitoring terminal 500 as soon as the abnormality is detected, it can start a quick response.

  Next, a captured video reference process performed by the monitoring terminal 400 will be described.

  FIG. 15 is a diagram illustrating a processing flow of the captured video reference processing. The captured image reference process is started when the monitoring operation is instructed by the supervisor 3 when the monitoring terminal 400 is in the activated state.

  First, the video information reference unit 413 receives a message ID to be referred to and a captured video ID (step S101). Specifically, the video information reference unit 413 specifies the message ID and the captured video ID included in the message received by the notification information processing unit 411.

  Then, the video information reference unit 413 specifies the URL of the abnormality detection device 200 (step S102). Specifically, the video information reference unit 413 refers to the message ID 421A of the notification reception information storage unit 421, identifies the record corresponding to the message ID included in the message received by the notification information processing unit 411, and determines the notification source. Read 421C. Then, the video information reference unit 413 refers to the abnormality detection device ID 422C of the abnormality detection device information storage unit 422, identifies the record corresponding to the notification source read from the notification source 421C, and reads the access URL 422D.

  Then, the video information reference unit 413 transmits a request to the URL of the abnormality detection device 200 (step S103). Specifically, the video information reference unit 413 transmits an HTTP request specifying the access URL 422D of the abnormality detection device 200 identified in step S102 to the network 10 via the communication device interface unit 430. The video reproduction unit 215 of the abnormality detection apparatus 200 that has received the request reads out the digital information of the captured video corresponding to the captured video ID from the storage unit 220 and outputs the stream.

  The video information reference unit 413 receives and reproduces the digital information stream of the output captured video (step S104).

  The above is the process flow of the captured video reference process.

  According to the captured video reference process, the supervisor 3 can refer to the captured video including the time point when the abnormality is detected by operating the monitoring terminal 400 that has received the message object. Therefore, it is possible to quickly and accurately grasp the detailed information about the abnormality, warn the user etc. who caused the abnormality, or contact the violation control organization such as the police and submit it as evidence. it can.

  For example, when the anomaly detection device 200 detects a pedestrian who has entered an automobile-only road that is prohibited from entering by a pedestrian, the anomaly that the rule is violated is detected, and the captured video is displayed on the monitoring terminal 400 or Reference can be made from the wireless monitoring terminal 500.

  FIG. 16 is a diagram illustrating an example of a captured video output screen 600 output in the captured video reference process. The output screen example 600 includes an abnormality detection device display unit 610 that displays information for specifying the abnormality detection device 200 that has performed shooting, a captured image display area 620 that displays the captured video, and the date and time when the captured video was captured. A shooting date / time display area 630 for displaying information to be specified and an operation area for receiving operation instructions such as rewind 640, pause 650, and fast-forward 660 are included.

  The above is the first embodiment according to the present invention. According to the first embodiment, even a subject at a distance where it is difficult for visible light to reach can be easily detected, so that it is possible to provide a monitoring system with a wide range of effective use. In addition, because objects that violate the prescribed rules can be detected, it can be used to detect reverse running of automobiles and motorcycles on outdoor roads, roads dedicated to automobiles, expressways, etc. On the other hand, detection with extremely high accuracy can be performed. In other words, the monitoring system 1 can detect a detection target with high accuracy by reducing over-detection / over-notification and insufficient detection / notification as an abnormal behavior monitoring system on a road whose target is a road.

  In addition, the monitoring system 1 according to the present invention may be used, for example, for a traffic survey on an automobile exclusive road, an expressway, a general road, or the like. Specifically, the abnormality detection apparatus 200 detects a vehicle that has passed through a preset analysis range on the video using predetermined parameters such as pattern matching on the image, a moving direction, and a moving speed. A cumulative result of the number of vehicles detected within a period (for example, several weeks to several months) is calculated. Note that the abnormality detection apparatus 200 may transmit the cumulative number of vehicles to the monitoring terminal 400, the wireless monitoring terminal 500, and the like after a predetermined period.

  In this way, when the monitoring system 1 is used as a system for conducting a traffic volume survey, it is possible to easily detect even a subject at a distance where visible light is difficult to reach. It is possible to detect a traveling vehicle such as an automobile-only road or a high-speed automobile road with high accuracy. In particular, the monitoring system 1 is less susceptible to the influence of external visible light illuminance, temperature, humidity, oblique light and backlighting, and shielding such as smoke, so the probability of false detection can be reduced. A traveling vehicle can be detected with high accuracy.

  The present invention is not limited to this, and various modifications can be made without departing from the scope of the invention. For example, as shown in FIG. 17, an abnormality detection that detects an abnormality using a visible light camera 710 that captures visible light and near-infrared light and an image photographed by the visible light camera 710 while keeping the object to be monitored 2 at an angle of view. The apparatus 720 may coexist so that the situation can be confirmed from the monitoring terminal 400 using both the image of the infrared thermal camera 110 and the image of the visible light camera 710 when an abnormality is detected. By doing in this way, since a more suitable image can be obtained according to whether or not a clear optical image can be obtained, the situation can be grasped more accurately.

  In the above embodiment, the infrared thermal camera 110 is used, but the present invention is not limited to this. For example, a camera capable of photographing near infrared rays may be used. By doing so, it is possible to construct a monitoring system with reduced costs.

  In addition, the monitoring system 1 in the above embodiment is not only a transaction target as a monitoring system, but can also be a transaction target in units of program parts that realize the operation of a device having the same effect as the abnormality detection apparatus 200. is there.

DESCRIPTION OF SYMBOLS 1 ... Monitoring system, 2 ... Monitoring object, 3 ... Monitoring person, 10 ... Network, 100 ... Monitoring destination equipment, 120 ... Wireless communication apparatus, 300 ... Monitoring origin equipment , 400 ... monitoring terminal, 500 ... wireless monitoring terminal

Claims (10)

An image acquisition unit that detects thermal infrared rays that are electromagnetic waves having a wavelength of 8 to 15 micrometers emitted by a subject and acquires an image;
An abnormality detection unit for detecting a plurality of abnormalities in the image;
When any abnormality is detected by the abnormality detection unit, a notification unit that performs a predetermined notification according to the abnormality,
A storage unit that associates and stores an analysis range on the image corresponding to the plurality of abnormalities to be detected and a detection target;
The abnormality detection unit detects an abnormality when detecting the detection object for an analysis range on the image corresponding to the abnormality to be detected,
An abnormal behavior monitoring system on the road characterized by this. The abnormal behavior monitoring system according to claim 1,
The image acquisition unit detects blackbody radiation emitted from the subject;
An abnormal behavior monitoring system characterized by this. The abnormal behavior monitoring system according to claim 1 or 2,
The notification unit transmits a part of the image in which the abnormality is detected to another device via a network.
An abnormal behavior monitoring system characterized by this. The abnormal behavior monitoring system according to claim 3,
The notification unit, when transmitting a part of the image, compresses and transmits the image so as to satisfy a predetermined data capacity limit for each of the other devices,
An abnormal behavior monitoring system characterized by this. The abnormal behavior monitoring system according to any one of claims 1 to 4,
The notification unit transmits information referring to a part of the image in which the abnormality is detected from another device via a network to the other device;
An abnormal behavior monitoring system characterized by this. The abnormal behavior monitoring system according to any one of claims 1 to 5,
The storage unit includes a vehicle as a detection object,
The abnormality detection unit detects reverse running in violation of the vehicle regulations as an abnormality,
An abnormal behavior monitoring system characterized by this. The abnormal behavior monitoring system according to any one of claims 1 to 6,
The storage unit includes a pedestrian as a detection object,
The abnormality detection unit detects the presence of the pedestrian as an abnormality,
An abnormal behavior monitoring system characterized by this. The abnormal behavior monitoring system according to any one of claims 1 to 7, further comprising:
A visible light image acquisition unit that detects visible light and acquires an image of visible light,
The notification unit transmits a part of the visible light image to another device via a network.
An abnormal behavior monitoring system characterized by this. A program for causing a computer to execute a procedure for monitoring abnormal behavior on a road,
The computer is caused to function as a storage unit that stores a control unit and an analysis range on the image corresponding to the plurality of abnormal behaviors to be detected and a detection target in association with each other,
Abnormality in which a plurality of abnormalities in the image are detected by acquiring an image from an image acquisition unit that detects thermal infrared rays that are electromagnetic waves having a wavelength of 8-15 micrometers emitted from the subject to the control means. Detection procedure;
When any abnormality is detected by the abnormality detection procedure, a notification procedure for performing a predetermined notification according to the abnormality;
And execute
In the abnormality detection procedure, when the detection object is detected for the analysis range on the image corresponding to the abnormality to be detected, the abnormality is detected.
A program characterized by that. An abnormal behavior monitoring method for monitoring abnormal behavior on a road using a computer,
The computer
A control unit, an image acquisition unit that acquires an image by detecting thermal infrared rays that are electromagnetic waves having a wavelength of 8-15 micrometers emitted by the subject, and an analysis range and detection on the image according to the plurality of abnormal behaviors to be detected A storage unit that associates and stores the object,
The controller is
An abnormality detection step of detecting a plurality of abnormalities in the image;
When any abnormality is detected by the abnormality detection step, a notification step of performing a predetermined notification according to the abnormality is performed,
In the abnormality detection step, when the detection object is detected for an analysis range on the image corresponding to the abnormality to be detected, it is detected as an abnormality.
An abnormal behavior monitoring method characterized by that.

Images