JP2016039450A - Monitoring system and monitoring method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the burden of running costs such as communication expenses and management expenses for recorded data at a monitoring place.SOLUTION: In one aspect, a monitoring system comprises: an imaging device for obtaining recorded data at a monitoring place; an information processing device for controlling the record of the recorded data; and an external storage device for storing the recorded data. The imaging device transmits a profile, an evaluation value, a detection value by a first sensor, and a detection value by a second sensor in the recorded data as verification data to the information processing device. If the information processing device detects abnormality at the monitoring place, it transmits a transmission instruction on the recorded data to the imaging device on the basis of the profile.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a monitoring system and a monitoring method.

  Conventionally, monitoring work is performed based on monitored recording data acquired by a plurality of imaging devices. For example, Patent Document 1 discloses a technique for easily detecting a moving object from recorded data acquired by a plurality of photographing devices.

  Also, in recent years, technology has been used to manage data on other information processing devices that can communicate with each other via a network without performing data management such as software update and file backup in individual information processing devices. Has been. Also in monitoring work, management of image data to be monitored has begun to be performed in a data center using these technologies.

JP 2006-067139 A

  Due to the characteristic of monitoring work that continuously shoots a monitoring place by a plurality of photographing devices, the amount of recorded data generated in the monitoring work becomes enormous. For this reason, when recording data related to monitoring work is managed in the above data center, the burden of running costs such as communication costs related to transmission of monitored recording data and management costs related to recording data management becomes large. There is a problem of end.

  Therefore, the present invention has been made in view of the above, and an object of the present invention is to provide a monitoring system and a monitoring method that reduce the burden of running costs such as communication costs and management costs of recorded data at a monitoring location as much as possible. To do.

  In order to solve the above-described problems and achieve the object, a monitoring system according to the present application includes, as one aspect, an imaging device that acquires recording data of a monitoring location, and an information processing device that controls recording of the recording data And an external storage device that stores the recording data, wherein the imaging device includes a first sensor and a second sensor that detect a non-physical quantity of the monitoring location, and the recording A calculation unit for calculating an evaluation value according to a change in the data size by comparing data sizes between frames constituting the data; and the evaluation corresponding to the recording data, the profile of the recording data, and the recording data Value, a detection value of the first sensor corresponding to the recording data, and a detection value of the second sensor corresponding to the recording data are stored in association with each other. And storing the profile, the evaluation value, the detection value of the first sensor, and the detection value of the second sensor from the recorded data as verification data in the information processing apparatus. When receiving the recording data transmission unit to be transmitted and the recording data transmission instruction from the information processing apparatus, the recording data is acquired from the storage unit based on the profile included in the transmission instruction and acquired. A recorded data transmission unit that transmits the recorded data to the information processing device, and the information processing device compares the evaluation value and the threshold value included in the verification data received from the imaging device, Comparison result between the detection value of the first sensor and the threshold value included in the verification data, and comparison between the detection value of the second sensor and the threshold value included in the verification data An event detection unit that detects an abnormality of the monitoring location based on a result, and a recording data storage unit that stores the recording data received from the imaging device in the external storage device, and the event detection unit includes: When an abnormality in the monitoring location is detected, an instruction to transmit the recording data is transmitted to the photographing apparatus based on the profile.

  In order to solve the above-described problems and achieve the object, a monitoring method according to the present application includes, as one aspect, a photographing device that acquires recorded data at a monitoring location, and an information processing device that controls recording of the recorded data. And a monitoring method executed by a monitoring system including an external storage device for storing the recorded data, wherein the imaging device detects a non-physical quantity at the monitoring location; A step of calculating an evaluation value according to a change in the data size by comparing data sizes between frames constituting the recording data, a profile of the recording data, the evaluation value corresponding to the recording data, The detection value of the first sensor corresponding to the recording data and the detection value of the second sensor corresponding to the recording data are associated with each other. And storing the profile, the evaluation value, the detection value of the first sensor, and the detection value of the second sensor as verification data from the recorded data. And when receiving an instruction to transmit the recording data from the information processing apparatus, the recording data is acquired from the storage unit based on the profile included in the transmission instruction, and the acquired recording data is Transmitting to the information processing apparatus, and causing the information processing apparatus to compare the evaluation value included in the verification data received from the imaging apparatus with a threshold value, and to include the first data included in the verification data. Based on the comparison result between the detection value of the first sensor and the threshold value, and the comparison result between the detection value of the second sensor and the threshold value included in the verification data A step of detecting an abnormality of the monitoring location; a step of transmitting an instruction to transmit the recording data to the imaging device based on the profile when an abnormality of the monitoring location is detected; and a reception from the imaging device Storing the recorded data in the external storage device.

  The monitoring system and the monitoring method according to the present application have an effect that the burden of running costs such as the communication cost and the management cost of the recording data of the monitoring place can be reduced as much as possible.

FIG. 1 is a diagram illustrating a conceptual configuration of a monitoring system. FIG. 2 is a block diagram illustrating a functional configuration of the photographing apparatus. FIG. 3 is a diagram illustrating an example of a file structure of recorded data. FIG. 4 is a diagram illustrating an example of a file structure of verification data. FIG. 5 is a diagram illustrating an example of a file structure of recorded data corresponding to an emergency. FIG. 6 is a block diagram illustrating functional configurations of the information processing apparatus and the external storage device. FIG. 7 is a flowchart illustrating the flow of the scene change amount calculation process according to the first embodiment. FIG. 8 is a flowchart illustrating the flow of the event detection process according to the first embodiment. FIG. 9 is a flowchart illustrating the flow of the event detection process according to the first embodiment. FIG. 10 is a flowchart illustrating the flow of the offset value update process according to the first embodiment. FIG. 11 is a flowchart illustrating a flow of event detection processing according to the second embodiment. FIG. 12 is a diagram illustrating an example of the determination result of the event detection process according to the second embodiment.

  Hereinafter, embodiments of a monitoring system and a monitoring method according to the present application will be described in detail with reference to the drawings. The monitoring system and the monitoring method according to the present application are not limited by the embodiments described below. Furthermore, the matters described in the following embodiments include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those that are so-called equivalent ranges. The matters described in the following examples relate to recorded video data to be monitored acquired by a photographing device installed in an office building, business park, shopping center, fashion building, park, amusement facility, high-tech park, residential facility, etc. Applies to processing.

[System configuration]
FIG. 1 is a diagram illustrating a conceptual configuration of a monitoring system. As shown in FIG. 1, a monitoring system according to an embodiment described below includes an imaging device 100, an information processing device 200, an external storage device 300, and a user terminal 400. The imaging device 100, the information processing device 200, and the user terminal 400 are connected via the network 1 in a communicable state. The imaging device 100 is a device that acquires recorded data at a monitoring location, and corresponds to, for example, a digital camera that records recorded data as digital data. The information processing apparatus 200 is an apparatus that controls recording of recording data acquired by the imaging apparatus 100, and corresponds to, for example, a server. The external storage device 300 is a device that stores recording data acquired by the imaging device 100. The user terminal 400 is a terminal used by a user. The network 1 includes a public telephone network, an Internet network, a carrier network, and the like. The network 1 can transmit and receive data using a predetermined communication protocol via communication devices such as a hub, router, bridge, and proxy server that constitute the network.

[Configuration of Shooting Device]
FIG. 2 is a block diagram illustrating a functional configuration of the image capturing apparatus 100. As illustrated in FIG. 2, the imaging apparatus 100 includes an image sensor 106, a capture unit 107, encoding units 108 a to 108 c, a time unit 109, an input processing unit 110, a human sensor 111, and a sound pressure sensor 112. A thermal sensor 113, a communication unit 114, a recording memory 115, and a control unit 120.

  The image sensor 106 converts the received light into an electrical signal. The image sensor 106 corresponds to, for example, an image sensor such as a complementary metal-oxide semiconductor (CMOS), a MOS, and a charge-coupled device (CCD).

  The capture unit 107 processes the electrical signal generated by the image sensor 106 and synthesizes a digital image for each frame from the electrical signal.

  The encoding units 108a to 108c convert the format of the digital image synthesized by the capture unit 107 into various formats. The encoding unit 108a converts the format of the digital image synthesized by the capture unit 107 into a format of NTSC (National Television Standards Committee) which is a standard method of terrestrial analog television broadcasting. The encoding unit 108a sends the data after the format conversion to the analog television monitor. The encoding unit 108b converts the format of the digital image synthesized by the capture unit 107 into an H.264 format that is a compression encoding method for moving image data. To H.264 format. The encoding unit 108b sends the data after the format conversion to the control unit 120. The encoding unit 108c converts the format of the digital image synthesized by the capture unit 107 into a JPEG (Joint Photograph Experts Group) format that is a still image data compression scheme. The encoding unit 108c sends the data after the format conversion to the control unit 120. Each of the format conversion methods used in the encoding units 108a to 108c is an example, and a method other than those described above may be applied.

  The time device 109 measures time. The time device 109 sends the measured time data to the control unit 120.

  The input processing unit 110 sends measurement values measured by the human sensor 111, the sound pressure sensor 112, and the heat detection sensor 113 to the control unit 120. The human sensor 111 detects the presence of a person at a monitoring location based on infrared rays, visible light, ultrasonic waves, and the like. The human sensor 111 sends the number of times of detection of the presence of a person (number of times of sensor reaction) to the input processing unit 110. The sound pressure sensor 112 detects the sound pressure at the monitoring location. The sound pressure sensor 112 sends the number of detections of the sound pressure above the predetermined level at the monitoring location (the number of sensor reactions) to the input processing unit 110. The heat sensor 113 detects that the monitoring place is in an abnormally high temperature state due to a fire or the like. The heat detection sensor 113 sends a corresponding signal to the input processing unit 110 when the temperature of the monitoring place exceeds a certain temperature. The human sensor 111 and the sound pressure sensor 112 are an example of a first sensor and a second sensor.

  The communication unit 114 transmits and receives various data exchanged with the information processing apparatus 200. The communication unit 114 performs wired or wireless communication based on a predetermined communication protocol.

  The recording memory 115 stores the recording data 115a of the monitoring place acquired by the photographing apparatus 100. The recording memory 115 is a non-volatile memory such as a flash memory (a storage medium that can only be read such as a CD-ROM), a volatile memory such as a RAM (Random Access Memory), or a combination thereof. Composed. The recording data 115a is stored in a state in which the recording data of the monitoring place, the profile of the recording data, and the detection values of the human sensor 111 and the sound pressure sensor 112 corresponding to the recording data are collected based on the time. FIG. 3 is a diagram illustrating an example of a file structure of recorded data. As shown in FIG. 3, the recording data 115a includes a profile (time, recording condition) 11, a video KEY frame 12, a video difference frame 13, a scene change amount 14, human sensor data 15, sound pressure sensor data 16, and heat. Each data of the sensing sensor data 17 is configured as one file that is synchronized based on the time measured by the time counter 109.

  The profile 11 includes the installation location of the photographing apparatus 100, time data measured by the time unit 109, and recording condition data set by the administrator of the photographing apparatus 100. The video KEY frame 12 is composed of data after format conversion by the encoding unit 108c. The video difference frame 13 is composed of data after format conversion by the encoding unit 108b. The scene change amount 14 includes data based on a processing result in the control unit 120 described later. The human sensor data 15 is constituted by a detection value by the human sensor 111. The sound pressure sensor data 16 is constituted by a value detected by the sound pressure sensor 112. The heat sensor data 17 is composed of data based on the detection result of the heat sensor 113.

  The control unit 120 includes hardware resources such as a CPU (Central Processing Unit) 121 that is an arithmetic device and a program memory 122 that is a storage device, and programs stored in the program memory 122 using these hardware resources. Various processes are realized by executing. The arithmetic processing unit may include a SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), a coprocessor, and the like, but is not limited thereto.

  The program memory 122 stores data and programs necessary for various processes executed by the control unit 120. The program memory 122 is configured by a non-volatile memory such as a flash memory, a volatile memory such as a RAM (Random Access Memory), or a combination thereof. The program memory 122 also functions as a working memory when the control unit 120 executes various programs. In addition to the program memory 122, a working memory may be separately installed. The program memory 122 stores, for example, a frame data size 122d that is the latest data size among the data sizes of the video difference frame 13 as one of data necessary for various processes executed by the control unit 120.

  As shown in FIG. 2, the program memory 122 stores a scene change amount detection program 122a, a data storage program 122b, a data transmission program 122c, and a frame data size 122d. Processing related to the digital image synthesized by the capture unit 107 is sequentially executed by the scene change amount detection program 122a, and each data related to the digital image synthesized by the capture unit 107 is predetermined by the data storage program 122b and the data transmission program 122c. Processing is performed at regular intervals (for example, every minute) in a form that is combined into one file having a file structure. The time for collecting digital images may be arbitrarily changed.

  The scene change amount detection program 122a provides a function for calculating the value of the scene change amount 14 according to the change in the data size by comparing the data sizes between the frames constituting the recording data. Specifically, the following process is realized by executing the scene change amount detection program 122a. The latest video difference frame 13 is acquired, the data size of the video difference frame 13 received immediately before from the program memory 122 is acquired, and the data size difference between the current frame and the immediately previous frame is calculated. If the calculated difference exceeds the threshold value, the value of the scene change amount is incremented (+1), and the data size of the current frame is overwritten as the data size of the immediately preceding frame. If the calculated difference does not exceed the threshold value, the value of the scene change amount is not incremented, and the data size of the current frame is overwritten as the data size of the previous frame. The scene change amount detection program 122a is an example of a calculation unit. The value of the scene change amount calculated by the scene change amount detection program 122a is an example of an evaluation value.

  The data storage program 122b correlates each data of the profile 11, the video key frame 12, the video difference frame 13, the scene change amount 14, the human sensor data 15, the sound pressure sensor data 16, and the heat sensor data 17. A function is provided for storing in the recording memory 115 as recording data 115a collected in one file. Specifically, the following processing is realized by executing the data storage program 122b. A video difference KEY frame 12 and a video difference frame 13 are acquired. A profile is generated based on the time measured by the time unit 109 and the preset recording conditions. Image key frame 12, image difference frame 13, motion sensor data 15, sound pressure sensor data 16, and heat sensing acquired during a predetermined time (for example, 1 minute) after the first image difference frame 13 is acquired Sensor data 17 is collected. Each data of the scene change amount 14 calculated by the scene change amount detection program 122a is collected during a predetermined time (for example, 1 minute) after the first video difference frame 13 is acquired. Video key frame 12, video differential frame 13, scene change amount 14, human sensor data 15, sound pressure sensor data collected during a predetermined time (for example, 1 minute) after the first video differential frame 13 is acquired. 16 and the heat sensor data 17 are collected into one file as synchronized data and stored in the recording memory 115. After the data is stored, the above process is executed every time the video difference KEY frame 12 and the video difference frame 13 are acquired. When the data is collected as a single file as data to be synchronized, a mark such as a sequence number or a flag corresponding to the video difference frame 13 may be assigned to each data, and the data may be collected based on the mark. The data storage program 122b is an example of a data storage unit.

  The data transmission program 122c transmits each data of the profile 11, the scene change amount 14, the human sensor data 15, and the sound pressure sensor data 16 from the recorded data 115a to the information processing apparatus 200 as verification data. Provides the functionality of Specifically, the following processing is realized by executing the data transmission program 122c. From the recorded data 115 a, the profile 11, scene change amount 14, human sensor data 15, and sound pressure sensor data 16 are extracted, and the extracted data are transmitted as verification data via the communication unit 114. It is transmitted to the information processing apparatus 200. FIG. 4 is a diagram illustrating an example of a file structure of verification data. As shown in FIG. 4, the file structure of the verification data includes each of profile (time, recording condition) 11, scene change amount 14, human sensor data 15 and sound pressure sensor data 16 from the recorded data 115a. It is configured as one file containing data. The data transmission program 122c is an example of a data transmission unit.

  In addition, when the data transmission program 122c receives an instruction to transmit the recording data 115a from the information processing apparatus 200, the data transmission program 122c acquires the recording data 115a from the recording memory 115 based on the profile 11 included in the transmission instruction, and acquires the acquired recording A function for transmitting the data 115a to the information processing apparatus 200 is provided. Specifically, the following processing is realized by executing the data transmission program 122c. Based on the profile 11 (for example, time, installation location, etc.) included in the transmission instruction, the recording data that matches the data in the profile 11 is acquired from the recording data stored in the recording memory 115 and acquired. Recorded data is transmitted to the information processing apparatus 200. Note that all data included in the file of the recording data 115a is transmitted to the information processing apparatus 200. The data transmission program 122c is an example of a recorded data transmission unit.

  If the data transmission program 122c determines that the monitoring location is in an abnormally high temperature state based on the signal transmitted from the thermal sensor 113, the data transmission program 122c receives an instruction to transmit the recorded data 115a from the information processing apparatus 200. Even if not, a function for automatically transmitting the recorded data 115a to the information processing apparatus 200 is provided. FIG. 5 is a diagram illustrating an example of a file structure of recorded data corresponding to an emergency. As shown in FIG. 5, it is basically the same as the file structure of the recorded data shown in FIG. 3, except that data indicating an emergency is inserted into the profile 11.

  The file structure of the recording data transmitted to the information processing apparatus 200 may be the same as the file structure of the recording data 115a as long as it can be processed by the information processing apparatus 200. If the information processing apparatus 200 does not have a structure that can be processed, the data transmission program 122c may be changed to a structure that can be processed by the information processing apparatus 200.

[Configuration of information processing device]
FIG. 6 is a block diagram illustrating functional configurations of the information processing apparatus 200 and the external storage device 300.

  The external storage device 300 illustrated in FIG. 6 stores a scene change amount offset value 300a, a human sensor offset value 300b, a sound pressure sensor offset value 300c, a video database 300d, and an operation history database 300e.

  The scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c are used for processing in the information processing apparatus 200. The scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c are updated by the information processing apparatus 200 according to the installation location and the time zone of the imaging apparatus 100. In a stage before the processing of the information processing apparatus 200 is started, predetermined initial values are set as the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c.

  The video database 300d is a database in which the recording data 115a of the monitoring place received from the photographing apparatus 100 is recorded. The operation history database 300e stores an access history (log) to the external storage device 300 by an administrator of the information processing device 200 and the external storage device 300. The access history (log) is used for detecting unauthorized access to the external storage device 300.

  An information processing apparatus 200 illustrated in FIG. 6 includes a communication unit 210 and a control unit 220.

  The communication unit 210 transmits and receives various data exchanged with the imaging device 100, the external storage device 300, and the user terminal 400. The communication unit 210 performs wired or wireless communication based on a predetermined communication protocol.

  The control unit 220 includes hardware resources such as a CPU (Central Processing Unit) 221 that is an arithmetic device and a program memory 222 that is a storage device, and programs stored in the program memory 222 using these hardware resources. Various processes are realized by executing. The arithmetic processing unit may include a SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), a coprocessor, and the like, but is not limited thereto.

  The program memory 222 stores data and programs necessary for various processes executed by the control unit 220. The program memory 222 is configured by a non-volatile memory such as a flash memory, a volatile memory such as a RAM (Random Access Memory), or a combination thereof. The program memory 222 also functions as a working memory when the control unit 220 executes various programs. The program memory 222 stores, for example, verification data 222e received from the photographing apparatus 100 as one of data necessary for various processes executed by the control unit 220.

  As shown in FIG. 6, the program memory 222 stores an event detection program 222a, a data storage program 222b, an offset value update program 222c, offset value update reference data 222d, verification data 222e, and administrator information 222f. .

  The event detection program 222a compares the value of the scene change amount 14 included in the verification data 222e received from the image capturing apparatus 100 with the threshold value, the value of the human sensor data 15 included in the verification data 222e, and the threshold value. Based on the comparison result and the comparison result between the value of the sound pressure sensor data 16 included in the verification data 222e and the threshold value, a function for executing a process of detecting an abnormality (event) of the monitoring place is provided. The event detection program 222a is an example of an event detection unit.

  Specifically, the following processing is realized by executing the event detection program 222a. When the verification data 222e is received, the scene change amount offset value 300a is acquired from the external storage device 300, and the scene change amount offset value 300a is subtracted from the scene change amount value included in the verification data. It is determined whether the value of the scene change amount after subtracting the scene change amount offset value 300a is 1 or more. If it is determined that the value is 1 or more, a mail is transmitted to the registration manager (user terminal 400). . Subsequently, a recording data transmission instruction corresponding to the received verification data 222 e is transmitted to the imaging apparatus 100. On the other hand, when the scene change amount value after the scene change amount offset value 300a is subtracted is not 1 or more, the human sensor offset value 300b is acquired from the external storage device 300 and included in the verification data 222e. The human sensor offset value 300b is subtracted from the value of the human sensor data 15. Whether or not the value of the human sensor data 15 after the human sensor offset value 300b is subtracted is determined to be 1 or more, and if it is determined to be 1 or more, an e-mail is sent to the registration manager (user terminal 400). Sent. Subsequently, a recording data transmission instruction corresponding to the received verification data 222 e is transmitted to the imaging apparatus 100. On the other hand, if the value of the human sensor data 15 after the human sensor offset value 300b is subtracted is not 1 or more, the sound pressure sensor offset value 300c is acquired from the external storage device 300, and is stored in the verification data 222e. The sound pressure sensor offset value 300c is subtracted from the value of the sound pressure sensor data 16 included. It is determined whether the value of the sound pressure sensor data 16 after the sound pressure sensor offset value 300c is subtracted is 1 or more. If it is determined that the value is 1 or more, an e-mail is sent to the registration manager (user terminal 400). Sent. Subsequently, a recording data transmission instruction corresponding to the received verification data 222 e is transmitted to the imaging apparatus 100. On the other hand, when the value of the sound pressure sensor data 16 after the sound pressure sensor offset value 300c is subtracted is not 1 or more, the process for the corresponding verification data 222e is ended. The transmission instruction includes the profile 11 included in the verification data 222e. In the photographing apparatus 100, the recorded data 115a corresponding to the transmission instruction is searched based on the information (for example, time, installation location, etc.) of the profile 11 included in the transmission instruction.

  The data storage program 222b provides a function for executing a process of storing the recording data 115a received from the photographing apparatus 100 in the external storage device 300. Specifically, the following processing is realized by executing the data storage program 222b. In response to the transmission instruction of the recording data 115a transmitted to the imaging apparatus 100 by the event detection program 222a, the recording data 115a at the corresponding time (the time included in the profile 11 of the verification data 222e) is received. Recorded data is stored in the external storage device 300. When the recording data 115 a corresponding to an emergency is received from the imaging device 100, the received recording data is stored in the external storage device 300. The data storage program 222b is an example of a recorded data storage unit.

  The offset value update program 222c has a function for executing processing for updating the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c based on the offset value update reference data 222d. provide. Specifically, the following processing is realized by executing the offset value update program 222c. When the update of the offset value is determined, initial values of the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c are acquired from the external storage device 300. An adjustment value corresponding to the installation location and time included in the profile 11 of the verification data 222e is acquired from the offset value update reference data 222d. The offset value is updated by setting the value obtained by multiplying the initial value of each of the scene change amount, the human sensor, and the sound pressure sensor by the corresponding adjustment value to the offset value in the corresponding time zone. The The initial value of the offset value is obtained in advance from the sum of the average values of the non-physical quantities included in the verification data 222e. The value of the scene change amount, the detection value of the human sensor, and the detection value of the sound pressure sensor are examples of non-physical quantities. For example, the offset value of the scene change amount corresponding to 12:00 is an adjustment value corresponding to the installation location and the time zone of the photographing apparatus 100 with respect to the total sum of the scene change amounts for 30 minutes before and after 12:00. Calculated by multiplication. The offset value of the human sensor and the offset value of the sound pressure sensor are also calculated by the same method as the above-described update method of the scene change amount offset value.

  The offset value update reference data 222d is used for offset value update processing by the offset value update program 222c. In the offset value update reference data 222d, for example, an adjustment value (magnification) corresponding to the installation location and time zone of the imaging apparatus 100 is set. For example, an adjustment value such as 3 to 5 times is set for a commercial building from 11:00 to 16:00 and a time zone from 18:00 to 22:00 for a commercial building is set to double. The adjustment value used when calculating the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c may be the same regardless of the data type, or for each data type. Different values may be used.

  The verification data 222e is data transmitted from the imaging apparatus 100 at regular intervals. The verification data 222e may be deleted from the program memory 222 each time the processing by the event detection program 222a is completed, or may be deleted all at once.

  The administrator information 222f includes information on the mail address of the user terminal 400 for reporting the occurrence of an abnormality (event) at the monitoring location.

[Processing according to Example 1]
A processing flow according to the first embodiment will be described with reference to FIGS. FIG. 7 is a flowchart illustrating the flow of the scene change amount calculation process according to the first embodiment. 8 and 9 are flowcharts illustrating the flow of event detection processing according to the first embodiment. FIG. 10 is a flowchart illustrating the flow of the offset value update process according to the first embodiment.

[Scene change calculation processing]
First, the flow of the scene change amount calculation process executed in the photographing apparatus 100 will be described with reference to FIG. The scene change amount calculation process shown in FIG. 7 is realized by the CPU 121 executing the scene change amount detection program 122a.

  As shown in FIG. 7, the imaging device 100 determines whether the latest video difference frame 13 has been acquired (step S101). When the latest video difference frame 13 is acquired as a result of the determination (step S101, Yes), the imaging apparatus 100 acquires the data size of the video difference frame 13 received immediately before from the working memory 122 (step S102). .

  Subsequently, the imaging apparatus 100 calculates the difference between the data size of the latest video difference frame 13 (current frame) acquired in step S101 and the data size of the immediately previous frame acquired in step S102 (step S103).

  Subsequently, the imaging apparatus 100 determines whether the difference calculated in step S103 exceeds a threshold value (step S104).

  As a result of the determination, if the difference calculated in step S103 exceeds the threshold value (step S104, Yes), the imaging apparatus 100 increments (+1) the value of the scene change amount 14 (step S105). Subsequently, the imaging apparatus 100 updates the data size of the current frame as the data size of the immediately previous frame (step S106).

  In step S104, if the result of determination is that the difference calculated in step S103 does not exceed the threshold value (No in step S104), the image capturing apparatus 100 does not increment the value of the scene change amount 14 and performs step S106 described above. Move on to the processing procedure.

  Subsequently, the imaging device 100 determines whether the processing has been completed for all the video difference frames 13 to be processed (step S107). For example, when a 30-frame digital image is acquired from the encoding unit 108b per second, it is determined whether the processing for the 30-frame digital image is completed.

  If the result of determination is that the processing has been completed for all video difference frames 13 to be processed (step S107, Yes), the imaging apparatus 100 ends the processing shown in FIG. On the other hand, if the result of determination is that the processing has not been completed for all video difference frames 13 to be processed (No at step S107), the imaging apparatus 100 returns to the processing procedure at step S101. .

  In step S101, if the result of determination is that the latest video difference frame 13 is not acquired (No in step S101), the imaging apparatus 100 proceeds to the processing procedure in step S107.

[Event detection processing (Example 1)]
Subsequently, a flow of event detection processing executed in the information processing apparatus 200 will be described with reference to FIGS. 8 and 9. The event detection process shown in FIGS. 8 and 9 is realized by the CPU 221 executing the event detection program 222a.

  As illustrated in FIG. 8, the information processing apparatus 200 determines whether the verification data 222e has been received (step S201).

  As a result of the determination, when the verification data 222e is received (step S201, Yes), the information processing apparatus 200 acquires the scene change amount offset value 300a (step S202).

  Subsequently, the information processing apparatus 200 subtracts the scene change amount offset value 300a from the value of the scene change amount 14 included in the verification data 222e (step S203). Subsequently, the information processing apparatus 200 determines whether the subtraction result in step S203 is 1 or more (step S204).

  If the subtraction result is 1 or more as a result of the determination (step S204, Yes), the information processing apparatus 200 determines that an abnormality has been detected at the monitoring location, and sends an e-mail to the registration manager (user terminal 400). Is transmitted (step S205). Subsequently, the information processing apparatus 200 transmits a recording data transmission instruction at the corresponding time (time included in the profile 11 of the verification data 222e) to the imaging apparatus 100 (step S206). The information processing apparatus 100 determines whether recording data has been received (step S207).

  As a result of the determination, if the recording data is not received (No at Step S207), the information processing apparatus 200 stands by until the recording data is received, and repeats the determination at Step S207.

  On the other hand, if the result of determination is that the recording data has been received (step S207, Yes), the information processing apparatus 200 stores the received recording data in the external storage device 300 (step S208), and ends the event detection process. .

  In step S204, when the subtraction result is not 1 or more as a result of the determination (step S204, No), the information processing apparatus 200 acquires the human sensor offset value 300b (step S209).

  Subsequently, the information processing apparatus 200 subtracts the human sensor offset value 300b from the value of the human sensor data 15 included in the verification data 222e (step S210). Subsequently, the information processing apparatus 200 determines whether the subtraction result in step S210 is 1 or more (step S211).

  If the subtraction result is 1 or more as a result of the determination (step S211, Yes), the information processing apparatus 200 proceeds to the processing procedure of step S205. On the contrary, if the subtraction result is not 1 or more as a result of the determination (step S211, No), the information processing apparatus 200 acquires the sound pressure sensor offset value 300c (step S212).

  Subsequently, the information processing apparatus 200 subtracts the sound pressure sensor offset value 300c from the value of the sound pressure sensor data 16 included in the verification data 222e (step S213). Subsequently, the information processing apparatus 200 determines whether the subtraction result in step S213 is 1 or more (step S214).

  If the subtraction result is 1 or more as a result of the determination (step S214, Yes), the information processing apparatus 200 proceeds to the processing procedure of step S205. On the contrary, if the subtraction result is not 1 or more as a result of the determination (No in step S214), the information processing apparatus 200 ends the event detection process.

  In step S201, when the information processing apparatus 200 has not received the verification data 222e as a result of the determination (step S201, No), the event detection process ends.

  In the example illustrated in FIG. 8, the case where mail is transmitted to the registration manager (step S <b> 205) has been described, but the processing procedure for transmitting mail may not be included. In the example shown in FIGS. 8 and 9, the example in which the process is performed in the order of the scene change amount 14, the human sensor data 15, and the sound pressure sensor data 16 has been described. The order of processing of the sensory sensor data 15 and the sound pressure sensor data 16 may be changed.

[Offset value update processing]
Subsequently, the flow of the offset value update process executed in the information processing apparatus 200 will be described with reference to FIG. The offset value update process shown in FIG. 10 is realized by the CPU 221 executing the offset value update program 222c.

  As illustrated in FIG. 10, the information processing apparatus 200 determines whether to update the offset value (step S301). For example, the information processing apparatus 200 determines whether or not the currently set offset value should be updated based on the time recorded in the profile 11 of the verification data 222e.

  As a result of the determination, the information processing apparatus 200 acquires the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c when updating the offset value (step S301, Yes). (Step S302). Subsequently, the information processing apparatus 200 acquires reference data 222d at the time of offset value update (step S303).

  The information processing apparatus 200 updates the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c based on the offset value update reference data 222d (step S304).

  Subsequently, the information processing apparatus 200 determines whether to end the offset value update process (step S305).

  As a result of the determination, when the offset value update process is ended (step S305, Yes), the information processing apparatus 200 initially sets the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor offset value 300c. The value is returned (step S306), and the offset value update process is terminated. On the contrary, if the information processing apparatus 200 does not end the offset value update process as a result of the determination (No at Step S305), the information processing apparatus 200 returns to the process procedure at Step S301.

[Effects of Example 1]
As described above, in the first embodiment, when the information processing apparatus 200 detects an abnormality in the monitoring location, the information processing apparatus 200 transmits an instruction to transmit the recording data of the monitoring location to the imaging apparatus 100 and receives the recording received from the imaging apparatus 100. Data is stored in the external storage device 300. For this reason, according to the first embodiment, it is possible to record only the recording data when there is an abnormality in the monitoring location, so that the running costs such as the communication cost and the management cost of the recording data at the monitoring location are reduced as much as possible. be able to.

  In the first embodiment, the information processing apparatus 200 instructs the transmission of the recording data of the monitoring location when an abnormality of the monitoring location is detected from at least one data of the scene change amount, the human sensor, and the sound pressure sensor. Is transmitted to the photographing apparatus 100. For this reason, according to the first embodiment, when there is a change in the situation of the monitoring place, the recorded data can be stored as much as possible.

  In the first embodiment, the information processing apparatus 200 executes processing for detecting an abnormality in the monitoring location based on a value obtained by subtracting the corresponding offset value from the scene change amount, the human sensor, and the sound pressure sensor. For this reason, according to the first embodiment, it is possible to detect a change in the situation of the monitoring place as accurately as possible.

  In the first embodiment, when an abnormality of the monitoring location is detected from at least one data of the scene change amount, the human sensor, and the sound pressure sensor, an instruction to transmit the recording data of the monitoring location is transmitted to the photographing apparatus 100. The example to do was explained. However, the present invention is not limited to this example. When an abnormality in the monitoring location is detected based on all data of the scene change amount, the human sensor, and the sound pressure sensor, an instruction to transmit the recording data of the monitoring location is issued. May be transmitted to the photographing apparatus 100. In the following second embodiment, processing according to the second embodiment will be described with reference to FIGS. 11 and 12. FIG. 11 is a flowchart illustrating a flow of event detection processing according to the second embodiment. FIG. 12 is a diagram illustrating an example of the determination result of the event detection process according to the second embodiment.

[Event detection processing (Example 2)]
As illustrated in FIG. 11, the information processing apparatus 200 determines whether the verification data 222e has been received (step S401).

  As a result of the determination, when the verification data 222e is received (step S401, Yes), the information processing apparatus 200 acquires the scene change amount offset value 300a (step S402).

  Subsequently, the information processing apparatus 200 subtracts the scene change amount offset value 300a from the value of the scene change amount 14 included in the verification data 222e (step S403). Subsequently, the information processing apparatus 200 acquires the human sensor offset value 300b (step S404), and subtracts the human sensor offset value 300b from the value of the human sensor data 15 included in the verification data 222e (step S405). ). Subsequently, the information processing apparatus 200 acquires the sound pressure sensor offset value 300c (step S406), and subtracts the sound pressure sensor offset value 300c from the value of the sound pressure sensor data 16 included in the verification data 222e (step S407). ).

  Subsequently, the information processing apparatus 200 adds the values calculated in step S403, step S405, and step S407 (step S408).

  Subsequently, the information processing apparatus 200 determines whether or not the summation result of step S408 is 1 or more (step S409).

  If the result of determination is that the summation result of step S408 is 1 or more (step S409, Yes), the information processing apparatus 200 proceeds to the processing procedure of step S205 shown in FIG. The information processing device 200 subtracts the scene change amount offset value 300 a from the scene change amount 14 value, the human sensor data 15 value from the human sensor offset value 300 b, and the sound pressure sensor data 16. If the sum of the values obtained by subtracting the sound pressure sensor offset value 300c from the value exceeds 1, a determination result that there is an abnormality in the monitoring location is derived. FIG. 12 shows scene change amounts 14, human sensor data 15 and sound pressure sensor data 16 corresponding to each time from 1 to 24:00, scene change amount offset value 300a corresponding to each time, human sensor. An example of a correspondence relationship between the offset value 300b and the sound pressure sensor offset value 300c and the determination result corresponding to each time is shown. For example, the scene change amount offset value 300a, the human sensor offset value 300b, and the sound pressure sensor corresponding to 1 o'clock are calculated from the sum of the values of the scene change amount 14, human sensor data 15 and sound pressure sensor data 16 corresponding to 1 o'clock. The value obtained by subtracting each value of the offset value 300c is “−2” and normalized to “0”, but does not exceed “1”, so that a determination result that there is no abnormality in the monitoring location is derived. On the other hand, for example, the scene change amount offset value 300a, the human sensor offset value 300b, and the sound corresponding to 23:00 are calculated from the sum of the values of the scene change amount 14, human sensor data 15 and sound pressure sensor data 16 corresponding to 23:00. Since the value obtained by subtracting each value of the pressure sensor offset value 300c is “2” and exceeds “1”, a determination result that there is an abnormality in the monitoring location is derived. In the example shown in FIG. 12, as a result of the above determination, for example, a determination result that there is an abnormality in the monitoring place is derived at “23:00” and “24:00”.

  As a result of the determination, if the sum of the results of step S408 is not 1 or more (step S409, No), the information processing apparatus 200 ends the event detection process.

  In step S401, when the information processing apparatus 200 has not received the verification data 222e as a result of the determination (step S401, No), the event detection process ends.

[Effects of Example 2]
As described above, in the second embodiment, the information processing apparatus 200 detects the monitoring location when the monitoring location abnormality is detected based on all the data of the scene change amount, the human sensor, and the sound pressure sensor. A recording data transmission instruction is transmitted to the imaging apparatus 100. For this reason, according to the second embodiment, it is possible to provide more space for detection of abnormality in the monitoring place than the event detection processing described in the first embodiment, such as communication cost and management cost of the recording data of the monitoring place. The burden of running costs can be further reduced.

  In the embodiment described above, the information processing apparatus 200 may instruct the imaging apparatus 100 to transmit recording data in response to a request received from the user apparatus 400. Specifically, when the information processing apparatus 200 receives a recording data transmission request from the user terminal 400, the information processing apparatus 200 transmits a recording data transmission instruction corresponding to the transmission request to the imaging apparatus 100. When the information processing apparatus 200 receives the recording data from the user apparatus 400, the information processing apparatus 200 stores the received recording data in the external storage device 300 and transmits a message to the user terminal 400 that the recording data can be viewed. .

  In addition, the aspect of this invention shown by said Example can be arbitrarily changed in the range which does not deviate from the summary of this invention. For example, the program shown in the above embodiment may be divided into a plurality of modules or may be integrated with other programs. Further, the functions of the information processing apparatus 200 may be appropriately distributed among a plurality of apparatuses.

DESCRIPTION OF SYMBOLS 1 Network 100 Image pick-up device 106 Image pick-up element 107 Capture part 108a-108c Encoding part 109 Timepiece 110 Input processing part 111 Human sensor 112 Sound pressure sensor 113 Thermal sensor 114 Communication part 115 Recording memory 120 Control part 121 CPU
122 program memory 200 information processing apparatus 210 communication unit 220 control unit 221 CPU
222 Program memory 300 External storage device 400 User terminal

Claims (5)

A monitoring system configured to include an imaging device that acquires recording data of a monitoring location, an information processing device that controls recording of the recording data, and an external storage device that stores the recording data;
The imaging device
A first sensor and a second sensor for detecting a non-physical quantity of the monitoring place;
A calculation unit that calculates an evaluation value according to a change in the data size by comparing data sizes between frames constituting the recording data;
The recorded data, the profile of the recorded data, the evaluation value corresponding to the recorded data, the detected value of the first sensor corresponding to the recorded data, and the detected value of the second sensor corresponding to the recorded data A data storage unit that associates and stores them in the storage unit,
A verification data transmission unit that transmits the profile, the evaluation value, the detection value of the first sensor, and the detection value of the second sensor from the recorded data to the information processing apparatus as verification data; ,
When receiving a recording data transmission instruction from the information processing apparatus, the recording data is acquired from the storage unit based on the profile included in the transmission instruction, and the acquired recording data is stored in the information processing apparatus. A recording data transmission unit for transmission, and
The information processing apparatus includes:
Comparison result between the evaluation value and threshold value included in the verification data received from the imaging device, comparison result between the detection value of the first sensor and threshold value included in the verification data, and the verification data An event detection unit that detects an abnormality of the monitoring location based on a comparison result between a detection value of the second sensor and a threshold value included in
A recording data storage unit for storing the recording data received from the photographing device in the external storage device;
The event detection unit, when detecting an abnormality in the monitoring location, transmits an instruction to transmit the recording data to the imaging device based on the profile.   The event detection unit detects an abnormality of the monitoring place based on a comparison result between the evaluation value and the threshold value included in the verification data received from the imaging device, and compares the evaluation value and the threshold value. If no abnormality of the monitoring location is detected based on the result, then the abnormality of the monitoring location is subsequently determined based on the comparison result between the detection value of the first sensor and the threshold value included in the verification data. In the case where no abnormality of the monitoring location is detected based on the comparison result between the detection value of the first sensor and the threshold value, subsequently, the second included in the verification data is performed. The monitoring system according to claim 1, wherein abnormality of the monitoring place is detected based on a comparison result between a detection value of the sensor and a threshold value.   The event detection unit performs all of the comparison between the evaluation value and the threshold value, the comparison between the detection value of the first sensor and the threshold value, and the comparison of the detection value of the second sensor and the threshold value. The monitoring system according to claim 1, wherein an abnormality of the monitoring place is detected based on a comparison result. The external storage device is
Storing an offset value corresponding to each of the evaluation value, the detection value of the first sensor, and the detection value of the second sensor;
The event detection unit obtains an offset value corresponding to each of the detection value of the first sensor and the detection value of the second sensor from the external storage device, and the evaluation value and the first sensor. 4. The monitoring system according to claim 2, wherein after the corresponding offset value is subtracted from each of a detection value and a detection value of the second sensor, a comparison with a threshold value is executed. 5. A monitoring method executed by a monitoring system including an imaging device that acquires recording data of a monitoring location, an information processing device that controls recording of the recording data, and an external storage device that stores the recording data. And
In the photographing device,
Detecting a non-physical quantity of the monitoring location;
Calculating an evaluation value according to a change in the data size by comparing data sizes between frames constituting the recording data;
The recorded data, the profile of the recorded data, the evaluation value corresponding to the recorded data, the detected value of the first sensor corresponding to the recorded data, and the detected value of the second sensor corresponding to the recorded data Storing them in the storage unit in association with each other;
Transmitting the profile, the evaluation value, the detection value of the first sensor, and the detection value of the second sensor from the recorded data to the information processing apparatus as verification data;
When receiving a recording data transmission instruction from the information processing apparatus, the recording data is acquired from the storage unit based on the profile included in the transmission instruction, and the acquired recording data is stored in the information processing apparatus. Execute the sending step and
In the information processing apparatus,
Comparison result between the evaluation value and threshold value included in the verification data received from the imaging device, comparison result between the detection value of the first sensor and threshold value included in the verification data, and the verification data Detecting an abnormality of the monitoring location based on a comparison result between a detection value of the second sensor and a threshold value included in
When detecting an abnormality in the monitoring location, transmitting a recording data transmission instruction to the imaging device based on the profile;
Storing the recorded data received from the imaging device in the external storage device.

Images