JP6872963B2 - Surveillance camera system - Google Patents

Description

The present invention relates to a surveillance camera system that confirms the status of a building to be monitored from a remote location using an image captured by a surveillance camera.

In recent years, surveillance systems using surveillance cameras have been widely used. For example, a surveillance camera is placed near the entrance of a building or a door to constantly record the appearance of a visitor, and when an abnormality such as an intrusion occurs, the detailed situation is confirmed later.

In such a surveillance system, moving image data captured by a surveillance camera is recorded and stored in a recorder or the like installed at the site. Therefore, in order to check the image when the abnormality occurs, the building manager needs to go to the building where the abnormality has occurred. However, in small and medium-sized buildings, the manager is often not resident, and the manager may be delayed in noticing the occurrence of the abnormality.

Therefore, the video data captured by the surveillance camera is sent to the server and saved as an image file, and the server compares the video data with the reference value to determine an abnormality, and if there is an abnormality, a trigger signal is sent to the mobile terminal. A monitoring system has been proposed in which a mobile terminal receives an image file of a server in response to a trigger signal when transmitted (see, for example, Patent Document 1). According to this monitoring system, the building manager can check the image of the site from a remote place when an abnormality occurs.

Japanese Unexamined Patent Publication No. 2013-101559

By the way, abnormalities such as intrusion often occur at night. In this case, the image of the surveillance camera may be difficult to discriminate due to its low visibility, and even if the image of the surveillance camera is transmitted to the mobile terminal as in the prior art described in Patent Document 1, the image of the surveillance camera is to be monitored. It may not be easy to check the status of the building.

Therefore, an object of the present invention is to easily confirm the state of the monitored building from a remote location by using the image captured by the surveillance camera.

The surveillance camera system of the present invention is a communication device that communicates with an image storage device that stores moving image data captured by the surveillance camera, a server, and the image storage device, and transmits the moving image data from the image storage device to the server. A surveillance camera system including a mobile terminal that communicates with the server , the image storage device stores the moving image data captured by the monitoring camera, and stores the moving image data captured by the monitoring camera. When the analysis is performed and an abnormality is detected, an alarm signal including an abnormality occurrence time is generated, and when the communication device receives the alarm signal from the image storage device, the moving image data stored in the image storage device is generated. The data for the set time before and after the abnormality occurrence time is received from the image storage device as recorded moving image data, and the server receives the alarm signal and the recorded moving image data from the communication device and receives the data. and said transmitted the abnormality detecting contact mail based on the alarm signal to the mobile terminal, and storing the recording video data received, upon receiving the recording video request signal from said mobile terminal, said Symbol of Rokudo image data received One still image is selected as a representative image from the set time before and after the abnormality occurrence time, the representative image is analyzed to extract an image feature index value, and the recorded moving image data is obtained from the extracted image feature index value. It is characterized in that it is corrected and the corrected recorded moving image data is transmitted to the mobile terminal.

In the surveillance camera system of the present invention, the image feature index value is an image brightness range defined by the maximum and minimum values of the brightness of the representative image, and a local dispersion value of brightness indicating a variation in brightness within a predetermined range. May include either or both of the average values of.

In the surveillance camera system of the present invention, the image storage device stores the imaging setting information when the moving image is captured together with the moving image data, and the communication device stores the imaging setting information together with the recorded moving image data. The server may store the received image pickup setting information together with the recorded moving image data, and correct the recorded moving image data based on the image feature index value and the imaging setting information.

The surveillance camera system of the present invention includes an intrusion prevention device that communicates with the communication device and generates an intrusion occurrence signal including an intrusion occurrence time when an intrusion occurs, and the communication device is said to invade from the intrusion prevention device. upon receiving a generation signal, received from said image storage apparatus setting time of data that put before and after the penetration occurrence time of said video data stored in the image storage device as an intrusion recording video data The server receives the intrusion occurrence signal and the intrusion record moving image data from the communication device, transmits an intrusion occurrence detection notification mail to the mobile terminal based on the received intrusion occurrence signal, and receives the intrusion. When the recorded moving image data is saved and the intrusion recording moving image request signal is received from the mobile terminal, one still image is selected as the representative image from the received intrusion recording moving image data from the set time before and after the intrusion occurrence time. Then, the representative image may be analyzed to extract an image feature index value, the intrusion record moving image data may be corrected by the extracted image feature index value, and the corrected intrusion recording moving image data may be transmitted to the mobile terminal. ..

According to the present invention, the condition of the building to be monitored can be easily confirmed from a remote location by the image captured by the surveillance camera.

It is a system diagram which shows the structure of the surveillance camera system in embodiment of this invention. It is explanatory drawing which shows the image storage time of the 1st memory and the 2nd memory in the image storage part of the surveillance camera system shown in FIG. It is explanatory drawing which shows the image analysis operation of the image analysis part of the surveillance camera system shown in FIG. It is a sequence diagram which shows the operation process of the surveillance camera system shown in FIG. It is a sequence diagram which shows other operation processing of the surveillance camera system shown in FIG. 4 is a flowchart showing the operation of the communication device in the operation processing shown in FIGS. 4 and 5. It is a continuation of the flowchart shown in FIG. 6A. 4 is a flowchart showing the operation of the server in the operation processing shown in FIGS. 4 and 5. It is a sequence diagram which shows other operation processing of the surveillance camera system shown in FIG. It is a flowchart which shows the operation of the recorder in the operation process shown in FIG. It is a flowchart which shows the operation of the communication apparatus in the operation process shown in FIG. It is a flowchart which shows the operation of the server in the operation process shown in FIG. It is a continuation of the flowchart shown in FIG. 11A. It is a system diagram which shows the structure of the surveillance camera system in another embodiment of this invention. It is a sequence diagram which shows the operation process of the surveillance camera system shown in FIG. It is a flowchart which shows the operation of the controller of the intrusion prevention device in the operation process shown in FIG. It is a flowchart which shows the operation of the recorder of the intrusion prevention device in the operation process shown in FIG. It is a flowchart which shows the operation of the communication apparatus in the operation process shown in FIG. It is a flowchart which shows the operation of the server in the operation process shown in FIG. It is a continuation of the flowchart shown in FIG. 17A.

Hereinafter, the surveillance camera system 100 of the embodiment will be described with reference to the drawings. As shown in FIG. 1, the surveillance camera system 100 includes an image storage device 10 that stores video data captured by the surveillance camera 11, a server 40 that stores video data, and an image storage device 10 via a remote communication network 35. It includes a communication device 30 that exchanges signals and video data between the user and the server 40, and a mobile terminal 50 that exchanges signals, video data, and mail between the server 40 and the server 40 via the communication network 36. .. In the following description, the surveillance camera system 100 captures an image of the inside of the building to be monitored by the surveillance camera 11, and based on this image, an abnormality in the building such as an intrusion of a suspicious person or an occurrence of a disaster occurs. Although described as a system for monitoring the occurrence, the surveillance camera system 100 can be applied to other buildings such as hospitals, schools, factories, and the like.

The image storage device 10 is a device installed in a building to be monitored, and includes a plurality of surveillance cameras 11 for capturing an image of the inside of the building to be monitored and a recorder 12 for storing moving image data. The recorder 12 is connected to the surveillance camera 11 to store the moving image data captured by the surveillance camera 11, and the recorder 12 is connected to the image storage unit 13 to analyze the moving image data captured by the surveillance camera 11 in the building. It includes an image analysis unit 16 that analyzes whether or not an abnormality has occurred, and an alarm signal generation unit 17 that receives an abnormality signal from the image analysis unit 16 and generates an alarm signal. The recorder 12 is a computer composed of a CPU that internally performs arithmetic processing, data, and a storage device that stores programs. In the image storage unit 13, the image analysis unit 16, and the alarm signal generation unit 17, the CPU programs the programs. It is a functional block composed by executing.

The image storage unit 13 of the recorder 12 has two moving image data storage areas, a first memory 14 and a second memory 15. As shown in FIG. 2, the first memory 14 stores the long-term moving image data captured by the surveillance camera 11 for one day, several days, or one week while updating it. For example, when storing moving image data for one day, the moving image data from the present time to one day ago is saved in the first memory 14, and the moving image data before that is sequentially erased. The same applies when saving video data for several days or a week. The moving image data stored in the first memory 14 contains the imaging time. As shown in FIG. 2, the second memory 15 stores one or more short-term moving image data for a set time before and after a certain time t from the moving image data stored in the first memory 14. Is. The set time may be, for example, 30 seconds, 1 minute, or 5 minutes. The image storage unit 13 is configured to be able to output the moving image data stored in the first memory 14 or the second memory 15 to the outside when an image request signal is input from the outside.

The image analysis unit 16 analyzes the moving image captured by the surveillance camera 11 and detects the occurrence of an abnormality. The analysis of moving images and the detection of abnormalities will be briefly described by taking as an example the case where the entrance door 22 of the building is monitored by the surveillance camera 11 with reference to FIG.

When the entrance door 22 of the building is locked, the image analysis unit 16 stores an image of the entrance door 22 in the closed state as shown in FIG. 3A as a reference image of the entrance door 22 of the building. There is. The image analysis unit 16 compares the image input from the surveillance camera 11 with the reference image shown in FIG. 3A, and if there is no difference between the two, it is determined that no abnormality has occurred. On the other hand, when an image in a state where the entrance door 22 is opened is input from the surveillance camera 11 as shown in FIG. 3 (b), a difference occurs between this image and the reference image shown in FIG. 3 (a). In this way, when a difference occurs between the image input from the surveillance camera 11 and the reference image, the image analysis unit 16 determines that there is a possibility that an abnormality has occurred in the entrance door 22.

Next, the image analysis unit 16 recognizes a person entering through the entrance door 22, as shown in FIG. 3 (b). Then, the clothes worn by the person are compared with the uniform of the guard, which is stored as a reference image in advance, and it is determined whether or not the person is a guard. If the person who entered through the entrance door 22 is a security guard, the image analysis unit 16 determines that the intrusion from the entrance door 22 has not occurred. On the other hand, if the person entering through the entrance door 22 is not a security guard, it is determined that the entrance door 22 has been invaded. Then, the fact that an abnormality has occurred is output to the alarm signal generation unit 17.

When the alarm signal generation unit 17 receives the signal of the occurrence of the abnormality from the image analysis unit 16, the alarm signal generation unit 17 generates an alarm signal including the time of occurrence of the abnormality. The alarm signal is, for example, a signal composed of an abnormality type such as "intrusion occurrence" and "first floor A zone", an abnormality occurrence location, and an abnormality occurrence time. As for the type of abnormality, for example, a code such as "0010" having four digits may be used.

The server 40 stores image data that stores a part of short-term moving image data stored in the second memory 15 of the recorder 12 or long-term moving image data stored in the first memory 14 of the recorder 12. A unit 43, a user data storage unit 45 that stores email addresses, addresses, telephone numbers, etc. of building managers, owners, etc. who are users of the surveillance camera system 100, and an image storage device 10 or a user's mobile terminal 50. Controls the sending and receiving of signals, video data, and emails between them, selects a representative image from the video data, analyzes the representative image to extract the image feature index value, and corrects the video data with the extracted image feature index value. It includes a calculation unit 42 and a communication unit 41 that communicates signals, moving image data, and mail. The server 40 may be, for example, a server device on the cloud or a server device installed in a data center or the like in a remote location away from the building to be monitored, as long as it is connected to the network.

The communication device 30 is a gateway device that connects the LAN line in the building to which the image storage device 10 is connected and the remote communication network 35 that ensures security.

The mobile terminal 50 is a smartphone, tablet terminal or the like owned by a building administrator, owner or the like who is a user of the surveillance camera system 100 and capable of sending / receiving e-mails, receiving and viewing moving image data. The mobile terminal 50 may be located at a remote location away from the building to be monitored.

Next, the operation of the surveillance camera system 100 will be described with reference to FIGS. 4 to 7. As shown in FIG. 4, the moving image data of the moving image captured by the surveillance camera 11 is sent to the recorder 12. The recorder 12 stores the moving image data received from the surveillance camera 11 in the first memory 14.

As shown in step S101 of FIGS. 4 and 6A, the server 40 outputs a signal requesting the communication device 30 to transmit the moving image captured by the surveillance camera 11. As shown in step S201 of FIGS. 4 and 7, when the communication device 30 receives the moving image request signal from the server 40, it determines YES in step S201 of FIG. 7, proceeds to step S202 of FIG. 7, and proceeds to the recorder 12 Of the moving image data stored in the first memory 14, a signal requesting the moving image data for a predetermined time is output. The predetermined time may be, for example, one day before the present time or 12 hours before the present time. As shown in FIG. 4, when the recorder 12 receives the signal requesting the moving image, the recorder 12 transmits the moving image data to the communication device 30. When the communication device 30 receives the moving image data from the recorder 12 as shown in step S203 of FIG. 7, the communication device 30 transmits the moving image data acquired from the recorder 12 to the server 40 as shown in step S204 of FIG. As shown in step S102 of FIG. 6A, when the server 40 receives the moving image data from the communication device 30, the server 40 stores the moving image data in the image data storage unit 43.

Next, as shown in step S104 of FIG. 6A, the calculation unit 42 of the server 40 selects a representative image to be image-analyzed from the moving image data stored in the image data storage unit 43. The moving image data is a collection of a large number of still images, and the representative image is one of the many still images constituting the moving image. The representative image may be, for example, the last still image of the moving image data for a predetermined time received from the recorder 12.

After selecting the representative image, the calculation unit 42 analyzes the representative image as shown in step S105 of FIG. 6A, and sets the image brightness range defined by the maximum and minimum values of the brightness of the representative image and a predetermined range. The average value of the local variance values obtained by averaging the local variance values of the brightness indicating the variation in the brightness in is extracted. The image luminance range is defined by extracting the luminance distribution of the representative image from a histogram or the like and extracting the minimum and maximum levels in the extracted luminance distribution. Further, the average value of the local variance value of the brightness is the variation of the brightness in the local region centered on the pixel having the representative image, that is, the local variance value of the brightness is extracted and the local dispersion value of the extracted brightness is averaged. You may ask.

After the calculation unit 42 extracts the image luminance range and the average value of the local variance values of the brightness, which are the image feature index values, the process proceeds to step S106 of FIG. 6A, and the average value of the image luminance range and the local variance values of the brightness is obtained. Determine if each is within a predetermined range. Then, in step S106 of FIG. 6A, when the average value of the image brightness range and the local dispersion value of the brightness is within the predetermined ranges, the calculation unit 42 indicates that the surveillance camera 11 is normal within the predetermined time and the recorder. It is determined that the moving image data for the predetermined time received from No. 12 is normal, and the process proceeds to step S107 of FIG. 6A, and the process waits until the moving image viewing request is received from the mobile terminal 50.

When a moving image viewing request is input from the mobile terminal 50, the calculation unit 42 determines YES in step S107 of FIG. 6A, proceeds to step S108 of FIG. 6A, and carries a confirmation signal as to whether or not correction of the moving image data is necessary. Send to terminal 50. Then, when the signal of the need for correction of the moving image data is received from the mobile terminal 50, the calculation unit 42 determines YES in step S109 of FIG. 6A and proceeds to step S110 of FIG. 6B. In step S110 of FIG. 6B, the calculation unit 42 performs an image pickup period to be viewed included in the video viewing request from the mobile terminal 50, for example, a moving image of a period defined by an image pickup date and time when browsing starts and an image pickup date and time when browsing ends. The data is read from the image data storage unit 43, and as shown in step S110 of FIG. 6B, a representative image is selected from the read moving image data. In this case, the representative image may be, for example, the first still image of the imaging period to be viewed included in the moving image viewing request, that is, the still image of the imaging date and time when viewing is started.

After selecting the representative image, the calculation unit 42 proceeds to step S111 of FIG. 6B to extract the image feature index value. Here, the image feature index value is an average value of the image luminance range and the local variance value of the luminance, as described above.

The calculation unit 42 proceeds to step S112 of FIG. 6B to correct the moving image data. The correction of the moving image data is, for example, an image brightness range conversion process in which the brightness range of each frame of the moving image data read from the image data storage unit 43 is extended and mapped based on the image brightness range data extracted in step S111 of FIG. 6B. For example, image enhancement processing for increasing the image enhancement level such as contrast, noise reduction processing, and the like.

Further, the image storage device 10 stores the imaging setting information such as the shutter speed, gain, and exposure amount when the moving image is captured together with the moving image data, and the communication device 30 transmits the imaging setting information together with the moving image data to the server 40. When the image data storage unit 43 of the server 40 stores the imaging setting information together with the moving image data, the calculation unit 42 may correct the moving image data based on the image feature index value and the imaging setting information. ..

After the correction of the moving image data is completed, the calculation unit 42 transmits the corrected moving image data to the mobile terminal 50 as shown in step S113 of FIG. 6B. Since the corrected moving image with high visibility is displayed on the mobile terminal 50, the manager or the like of the building to be monitored can easily see the situation inside the building to be monitored from a remote location by using the image captured by the surveillance camera 11. You can check.

Further, when the calculation unit 42 receives a signal from the mobile terminal 50 that the correction of the moving image data is unnecessary, the calculation unit 42 determines NO in step S109 of FIG. 6A and proceeds to step S114 of FIG. 6B. In step S114 of FIG. 6B, the calculation unit 42 performs an imaging period to be viewed included in the moving image viewing request from the mobile terminal 50, for example, a moving image of a period specified by an imaging date and time when browsing starts and an imaging date and time when viewing ends. The data is read from the image data storage unit 43, and the uncorrected moving image data is transmitted to the mobile terminal 50. In this way, the manager of the building to be monitored can check the uncorrected video from a remote location.

The manager of the building to be monitored can request the correction of the moving image data from the mobile terminal 50 after confirming the moving image that has not been corrected. In this case, the calculation unit 42 corrects the moving image data as shown in steps S110 to S112 of FIG. 6B, and transmits the corrected moving image data to the mobile terminal 50 as shown in step S113 of FIG. 6B.

On the other hand, as a result of analyzing the representative image, when the average value of the image brightness range and the local dispersion value of the brightness is not within the predetermined ranges and is determined to be NO in step S106 of FIG. 6A, the calculation unit 42 within the predetermined time. It is determined that an abnormality has occurred in the surveillance camera 11 and that the moving image data for a predetermined time received from the recorder 12 includes the abnormal one. For example, there are cases where the surveillance camera 11 is out of order and the moving image cannot be acquired, or the lens of the surveillance camera 11 is dirty. In this case, inspection, repair, etc. of the surveillance camera 11 are required. Therefore, if the calculation unit 42 determines NO in step S106 of FIG. 6A, the calculation unit 42 proceeds to step S115 of FIG. 6A, and the user data storage unit 45 sends the e-mail address of the administrator of the monitored building or the user such as the owner. Is read, and a surveillance camera abnormality occurrence email is sent to the email address informing that an abnormality has occurred in the surveillance camera 11 (see FIG. 5).

After transmitting the surveillance camera abnormality occurrence email, the calculation unit 42 proceeds to step S116 of FIG. 6A and waits until the moving image viewing request is received from the mobile terminal 50.

When the moving image viewing request is input from the mobile terminal 50, the calculation unit 42 determines YES in step S116 of FIG. 6A and proceeds to step S117 of FIG. 6A. In step S117 of FIG. 6A, the calculation unit 42 includes an imaging period to be viewed included in the moving image viewing request from the mobile terminal 50, for example, a moving image of a period specified by an imaging date and time when browsing starts and an imaging date and time when viewing ends. The data is read from the image data storage unit 43, and the moving image data is transmitted to the mobile terminal 50. The calculation unit 42 determines NO in step S106 of FIG. 6A, an abnormality has occurred in the surveillance camera 11 within a predetermined time, and the moving image data for the predetermined time received from the recorder 12 includes the abnormal one. Therefore, when there is a request for viewing a moving image, the moving image data read from the image data storage unit 43 is transmitted to the mobile terminal 50 as it is without correcting the moving image data.

The manager or the like of the building to be monitored can check the image captured by the surveillance camera 11 on the mobile terminal 50 in a remote location and easily determine whether maintenance, inspection, replacement, etc. of the surveillance camera 11 is necessary. ..

As described above, the surveillance camera system 100 of the present embodiment determines whether the surveillance camera 11 is normal or abnormal, and if the surveillance camera 11 is normal, corrects the moving image data and transmits it to the mobile terminal 50. Therefore, the corrected moving image having high visibility is displayed on the mobile terminal 50, and the manager or the like of the monitored building can easily check the situation inside the monitored building from a remote location by using the image captured by the surveillance camera 11. You can check. Further, when an abnormality occurs in the surveillance camera 11, a surveillance camera abnormality occurrence mail is sent to the mobile terminal 50, and uncorrected moving image data is transmitted to the mobile terminal 50. The occurrence status of the abnormality of the surveillance camera 11 can be easily confirmed from a remote location.

In the above description, the image storage device 10 has been described as being composed of a plurality of surveillance cameras 11 and a recorder 12, but the surveillance camera 11 is provided with a CPU and a memory, whereby the image storage unit 13 and the image storage unit 13 are provided. It may be configured by a surveillance camera device having an image pickup function capable of performing the operations of the image analysis unit 16 and the alarm signal generation unit 17, and an image data storage, analysis, and alarm signal generation function.

Next, another operation of the surveillance camera system 100 shown in FIG. 1 will be described with reference to FIGS. 8 to 11B. As shown in FIG. 8, the moving image data captured by the surveillance camera 11 is sent to the recorder 12. As shown in step S301 of FIG. 9, the recorder 12 stores the moving image data received from the surveillance camera 11 in the first memory 14. Further, as shown in step S302 of FIG. 9, the image analysis unit 16 of the recorder 12 compares and analyzes the moving image data and the reference data by the method described above, and detects the occurrence of an abnormality. If no abnormality is detected, the recorder 12 returns to step S301 of FIG. 9 and repeatedly executes the storage of the moving image data of the surveillance camera 11 and the detection operation of the abnormality.

On the other hand, the communication device 30 polls the recorder 12 as shown in step S401 of FIG. Polling may be performed at a frequency of, for example, once / minute.

Then, when the image analysis unit 16 detects the occurrence of an abnormality in step S303 of FIG. 9, the image analysis unit 16 transmits the signal for detecting the occurrence of the abnormality to the alarm signal generation unit 17. The alarm signal generation unit 17 generates an alarm signal composed of an abnormality type, an abnormality occurrence location, and an abnormality occurrence time based on the signal transmitted from the image analysis unit 16.

After the recorder 12 generates the alarm signal, it receives the polling from the communication device 30 as shown in step S305 of FIG. 9, and then the alarm signal generated by the alarm signal generation unit 17 as shown in step S306 of FIG. Is transmitted to the communication device 30.

When the communication device 30 receives the alarm signal from the recorder 12 as shown in step S402 of FIG. 10, the communication device 30 proceeds to step S403 of FIG. 10 and outputs the recorded moving image data request signal to the recorder 12.

As shown in step S307 of FIG. 9, the recorder 12 waits until the recorded moving image data request signal is received from the communication device 30. Then, when the recorder 12 receives the recorded moving image data request signal from the communication device 30, the recorder 12 has an abnormality occurrence time specified by the image analysis unit 16 among the moving image data stored in the first memory 14 as shown in FIG. The moving image data for the set time before and after is written to the second memory 15 as the recorded moving image data. Then, as shown in step S308 of FIG. 9, the recorder 12 transmits the recorded moving image data written in the second memory 15 to the communication device 30.

As shown in step S404 of FIG. 10, the communication device 30 waits until the recorded moving image data is received from the recorder 12, and when the recorded moving image data is received, proceeds to step S405 of FIG. To send.

As shown in step S501 of FIG. 11A, the server 40 waits until the alarm signal is received from the communication device 30, and when the alarm signal is received, records to the communication device 30 as shown in step S502 of FIG. 11A. Send a video data request signal.

As shown in step S406 of FIG. 10, the communication device 30 waits until it receives the recorded video data request signal from the server 40, and when it receives the recorded video data request signal, proceeds to step S407 of FIG. 10 to record the video data. To the server 40.

As shown in step S503 of FIG. 11A, the server 40 waits until the recorded moving image data is received, and after receiving the recorded moving image data, proceeds to step S504 of FIG. 11A and stores the recorded moving image data in the image data storage unit 43. ,save.

After saving the recorded moving image data in the image data storage unit 43, the server 40 proceeds to step S505 of FIG. 11A, reads the e-mail address of the user such as the administrator or the owner of the monitored building from the user data storage unit 45, and reads the e-mail address thereof. Send an anomaly detection notification email to inform you that an error has been detected in your email address.

When a user such as the administrator of the building to be monitored confirms the abnormality detection notification mail sent to the mobile terminal 50 and wants to confirm the recorded image, the user accesses the server 40 from the mobile terminal 50 and records the moving image. Send a data request signal.

After transmitting the abnormality detection notification mail, the server 40 waits until the recorded moving image data request signal is received from the mobile terminal 50, as shown in step S506 of FIG. 11A. Upon receiving the recorded moving image data request signal, the calculation unit 42 of the server 40 proceeds to step S507 of FIG. 11A and transmits a confirmation signal as to whether or not the recorded moving image data needs to be corrected to the mobile terminal 50. Then, when receiving a signal from the mobile terminal 50 that the recorded moving image data needs to be corrected, the calculation unit 42 determines YES in step S508 of FIG. 11A, proceeds to step S509 of FIG. 11B, and selects a representative image. In this case, the representative image may be a still image at the time when the abnormality occurs.

After selecting the representative image, the calculation unit 42 proceeds to step S510 of FIG. 11B to analyze the representative image and extract the image feature index value. Here, the image feature index value is an average value of the image luminance range and the local variance value of the luminance, as described above.

The calculation unit 42 proceeds to step S511 of FIG. 11B to correct the recorded moving image data. The correction of the recorded moving image data includes, for example, an image brightness range conversion process for extending and mapping the brightness range of each frame of the recorded moving image data based on the image brightness range data extracted in step S510 of FIG. 11B, an image such as contrast, and the like. Image enhancement processing that increases the enhancement level of the image, noise reduction processing, and the like.

Further, the image storage device 10 stores imaging setting information such as shutter speed, gain, and exposure amount when the moving image is captured together with the moving image data, and the communication device 30 transmits the imaging setting information together with the recorded moving image data to the server 40. When the image data storage unit 43 of the server 40 stores the imaging setting information together with the recorded moving image data, the calculation unit 42 corrects the recorded moving image data based on the image feature index value and the imaging setting information. May be good.

After the correction of the recorded moving image data is completed, the calculation unit 42 transmits the corrected recorded moving image data to the mobile terminal 50 as shown in step S512 of FIG. 11B.

When the recorded moving image data is transmitted from the server 40, the manager of the building to be monitored displays the image on the display of the mobile terminal 50 and confirms it. Since the corrected recorded video with high visibility is displayed on the mobile terminal 50, the manager of the building to be monitored can easily check the situation inside the building to be monitored from a remote location by using the image captured by the surveillance camera 11. Can be confirmed in.

When the calculation unit 42 receives a signal from the mobile terminal 50 that the recorded moving image data does not need to be corrected, the calculation unit 42 determines NO in step S508 of FIG. 11A and proceeds to step S513 of FIG. 11B. In step S513 of FIG. 11B, the calculation unit 42 transmits the uncorrected recorded moving image data to the mobile terminal 50. In this way, the manager or the like of the building to be monitored can confirm the recorded video that has not been corrected from a remote location.

The manager or the like of the building to be monitored can request the correction of the recorded moving image data from the mobile terminal 50 after confirming the recorded moving image that has not been corrected. In this case, the calculation unit 42 corrects the recorded moving image data as shown in steps S509 to S511 of FIG. 11B, and transmits the corrected recorded moving image data to the mobile terminal 50 as shown in step S512 of FIG. 11B. ..

As described above, since the surveillance camera system 100 of the present embodiment corrects the recorded moving image data and transmits it to the mobile terminal 50, the corrected recorded moving image having high visibility is displayed on the mobile terminal 50 and monitored. The manager or the like of the target building can easily confirm the situation inside the target building from a remote location by the image captured by the surveillance camera 11.

Further, the surveillance camera system 100 of the present embodiment accurately detects the occurrence of an abnormality because the image storage device 10 installed in the building to be monitored analyzes the moving image captured by the surveillance camera 11 to detect the occurrence of an abnormality. be able to. Further, since the surveillance camera system 100 transmits moving image data for a set time before and after the abnormality occurrence time as recorded moving image data from the communication device 30 to the server 40 and stores and stores the moving image data in the server 40, it is described in Patent Document 1. The amount of data communication between the communication device 30 and the server 40 is larger than the case where the moving image data captured by the surveillance camera 11 is transmitted to the server 40 for image analysis and abnormality detection as in the conventional surveillance system. Can be reduced. Further, since it is sufficient to store and store the recorded video data which is the video data for the set time before and after the abnormality occurrence time in the image data storage unit 43 of the server 40, the data storage storage capacity of the server 40 can be reduced. it can.

In the surveillance camera system 100 of the embodiment described above, the recorded moving image data is specified by the image analysis unit 16 among the moving image data stored in the first memory 14 when the recorded moving image data request signal is received from the communication device 30. Although it has been described that the moving image data for the set time before and after the abnormal occurrence time is written to the second memory 15 as the recorded moving image data, the present invention is not limited to this. For example, when the image storage unit 13 receives a signal in which an abnormality is detected by the image analysis unit 16, video data for a set time before and after the abnormality occurrence time specified by the image analysis unit 16 is recorded as video data in the second memory. You may write to 15. In this case, since the recorded moving image data is written to the second memory 15 before the recorder 12 receives the recorded moving image data request signal from the communication device 30 in step S307 of FIG. 9, the recorder 12 is shown in FIG. When the recorded moving image data request signal is received in step S307, the recorded moving image data stored in the second memory 15 is transmitted to the communication device 30.

Next, the surveillance camera system 200 of another embodiment will be described with reference to FIGS. 12 to 17B. The surveillance camera system 200 is a system in which the intrusion prevention device 20 is connected to the LAN line in the monitored building of the surveillance camera system 100 described with reference to FIGS. 1 to 11B. The same parts as those described with reference to FIGS. 1 to 11B are designated by the same reference numerals, and the description thereof will be omitted. In the following description, the building to be monitored will be described as an office building in which a company resides, but the surveillance camera system 200 can be applied to other types of buildings such as hospitals, schools, factories, and the like. Further, a surveillance camera 11 is arranged in the vicinity of the entrance door 22 in order to capture an image of the entrance door 22 monitored by the intrusion prevention device 20.

The intrusion prevention device 20 includes a card reader 21 attached near the entrance door 22 of the building, a door locking device 23 for unlocking and locking the key of the entrance door 22, and a controller 24. The controller 24 includes an intrusion detection unit 25 that detects intrusion based on the signals of the card reader 21 and the door locking device 23, and an intrusion generation signal generation unit 26 that generates an intrusion generation signal when an intrusion occurs. .. The controller 24 is a computer composed of a CPU that internally performs arithmetic processing, data, and a storage device that stores programs, and the intrusion detection unit 25 and the intrusion generation signal generation unit 26 are such that the CPU executes a program. It is a functional block that is composed.

The card reader 21 reads the data of the ID card possessed by the employee of the company occupying the building to be monitored. The door locking device 23 unlocks and locks the key of the entrance door 22 of the building according to a command from the controller 24.

The intrusion prevention device 20 transmits the ID card data read by the card reader 21 to the controller 24, and the controller 24 is an employee of a company in which the ID card holder is permitted to enter the building from the ID card data. When it is determined that the member is a member, the entrance door 22 is unlocked by the door locking device 23 according to the command of the controller 24. Further, the intrusion prevention device 20 does not unlock the entrance door 22 unless the controller 24 allows the holder of the ID card to enter the building. As a result, the intrusion prevention device 20 prevents a person who has not received permission to enter the building from entering the building.

The intrusion detection unit 25 of the controller 24 is an employee who has forcibly unlocked the entrance door 22 or has already entered the building even though the ID card data is not input from the card reader 21. Intrusion is detected when another person enters the room with the same ID card as. The intrusion detection unit 25 outputs the detection of the intrusion to the intrusion generation signal generation unit 26.

When the intrusion generation signal generation unit 26 receives the signal for detecting the intrusion from the intrusion detection unit 25, the intrusion generation signal generation unit 26 generates an intrusion generation signal including the intrusion occurrence time. The intrusion occurrence signal is a signal composed of information such as the location of the intrusion occurrence such as "intrusion occurrence from the 5th door on the 1st floor" and the intrusion occurrence time.

Next, the operation of the surveillance camera system 200 will be described with reference to FIGS. 13 to 15. The image storage device 10 of the surveillance camera system 200 acquires video data from the surveillance camera 11 and stores the video data for a predetermined period such as one day in the first memory 14 while updating the video data as needed.

As shown in FIG. 13, the ID card data and the opening / closing status data of the entrance door 22 are sent from the card reader 21 and the door locking device 23 to the controller 24. As shown in step S601 of FIG. 14, the intrusion detection unit 25 of the controller 24 detects the occurrence of intrusion from the data of the ID card and the data of the open / closed status of the entrance door 22. If the intrusion occurrence is not detected, the controller 24 returns to step S601 of FIG. 14 to repeatedly acquire the ID card data and the opening / closing status data of the entrance door 22 and execute the intrusion detection operation.

On the other hand, the communication device 30 polls the controller 24 as shown in step S701 of FIG. Polling may be performed at a frequency of, for example, once / minute.

Then, when the intrusion detection unit 25 detects the intrusion occurrence in step S602 of FIG. 14, the intrusion detection unit 25 transmits the signal for detecting the intrusion occurrence to the intrusion generation signal generation unit 26. As shown in step S603 of FIG. 14, the intrusion generation signal generation unit 26 generates an intrusion generation signal composed of information such as an intrusion occurrence location and an intrusion occurrence time based on the signal transmitted from the intrusion detection unit 25. Generate.

After the controller 24 generated the intrusion occurrence signal, it received the poll from the communication device 30 as shown in step S604 of FIG. 14, and then the intrusion occurrence signal generation unit 26 generated it as shown in step S605 of FIG. The intrusion occurrence signal is transmitted to the communication device 30.

As shown in step S702 of FIG. 16, when the communication device 30 receives the intrusion occurrence signal from the controller 24, the communication device 30 proceeds to step S703 of FIG. Is output.

As shown in step S611 of FIG. 15, the recorder 12 waits until the intrusion recording moving image data request signal is received from the communication device 30. Then, when the recorder 12 receives the intrusion recording moving image data request signal from the communication device 30, the recorder 12 sets before and after the intrusion occurrence time included in the intrusion recording moving image data request signal among the moving image data stored in the first memory 14. The data for the time is written to the second memory 15 as the intrusion recording moving image data. Then, as shown in step S612 of FIG. 15, the recorder 12 transmits the intrusion recording moving image data written in the second memory 15 to the communication device 30.

As shown in step S704 of FIG. 16, the communication device 30 waits until the intrusion record moving image data is received from the recorder 12, and after receiving the intrusion recording moving image data, proceeds to step S705 of FIG. 16 to the server 40. Send an intrusion occurrence signal.

As shown in step S801 of FIG. 17A, the server 40 waits until the intrusion occurrence signal is received from the communication device 30, and when the intrusion occurrence signal is received, the server 40 is referred to the communication device 30 as shown in step S802 of FIG. 17A. Intrusion recording video data request signal is transmitted.

As shown in step S706 of FIG. 16, the communication device 30 waits until it receives the intrusion recording video data request signal from the server 40, and when it receives the intrusion recording video data request signal, proceeds to step S707 of FIG. 16 to invade. The recorded video data is transmitted to the server 40.

As shown in step S803 of FIG. 17A, the server 40 waits until it receives the intrusion recording moving image data, and when it receives the intrusion recording moving image data, proceeds to step S804 of FIG. 17A and enters the image data storage unit 43 of the intrusion recording moving image. Store and save data.

After saving the intrusion record moving image data in the image data storage unit 43, the server 40 proceeds to step S805 of FIG. 17A to read the e-mail address of the user such as the administrator or the owner of the monitored building from the user data storage unit 45. An intrusion detection notification email is sent to the email address to notify that an intrusion has been detected.

When a user such as the administrator of the building to be monitored confirms the intrusion detection notification email sent to the mobile terminal 50 and wants to confirm the intrusion record image, the user can check the intrusion record video from the mobile terminal 50 to the server 40. Send a data request signal.

After transmitting the intrusion occurrence detection notification mail, the server 40 waits until the intrusion record video data request signal is received from the mobile terminal 50, as shown in step S806 of FIG. 17A, and when the intrusion record video data request signal is received, the server 40 is the server. The calculation unit 42 of 40 proceeds to step S807 of FIG. 17A and transmits a confirmation signal as to whether or not correction of the intrusion recorded moving image data is necessary to the mobile terminal 50. Then, when receiving a signal from the mobile terminal 50 that the intrusion recorded moving image data needs to be corrected, the calculation unit 42 determines YES in step S808 of FIG. 17A, proceeds to step S809 of FIG. 17B, and selects a representative image. In this case, the representative image may be a still image at the intrusion occurrence time.

After selecting the representative image, the calculation unit 42 proceeds to step S810 of FIG. 17B to analyze the representative image and extract the image feature index value. Here, the image feature index value is an average value of the image luminance range and the local variance value of the luminance, as described above.

The calculation unit 42 proceeds to step S811 of FIG. 17B to correct the intrusion recorded moving image data. The correction of the intrusion recording video data includes, for example, an image brightness range conversion process for extending and mapping the brightness range of each frame of the intrusion recording video data based on the image brightness range data extracted in step S810 of FIG. 17B, contrast, and the like. Image enhancement processing for increasing the image enhancement level, noise reduction processing, and the like.

Further, the image storage device 10 stores the imaging setting information such as the shutter speed, gain, and exposure amount when the moving image is captured together with the moving image data, and the communication device 30 transmits the imaging setting information together with the intrusion recording moving image data to the server 40. When the image data storage unit 43 of the server 40 stores the imaging setting information together with the intrusion recording moving image data, the calculation unit 42 corrects the intrusion recording moving image data based on the image feature index value and the imaging setting information. You may do so.

After the correction of the intrusion record moving image data is completed, the calculation unit 42 transmits the corrected intrusion recording moving image data to the mobile terminal 50 as shown in step S812 of FIG. 17B.

When the intrusion record video data is transmitted from the server 40, the administrator of the building to be monitored displays the image on the display of the mobile terminal 50 to confirm it. Since the corrected intrusion recording video with high visibility is displayed on the mobile terminal 50, the situation inside the building to be monitored can be easily confirmed from a remote location by the image captured by the surveillance camera 11.

As described above, since the surveillance camera system 200 of the present embodiment corrects the intrusion record video data and transmits it to the mobile terminal 50, the corrected intrusion record video with high visibility is displayed on the mobile terminal 50. , The situation inside the building to be monitored can be easily confirmed from a remote location by the image captured by the surveillance camera 11.

When the calculation unit 42 receives a signal from the mobile terminal 50 that the correction of the intrusion recorded moving image data is unnecessary, the calculation unit 42 determines NO in step S808 of FIG. 17A and proceeds to step S813 of FIG. 17B. In step S813 of FIG. 17B, the calculation unit 42 transmits the uncorrected intrusion recording moving image data to the mobile terminal 50. In this way, the manager or the like of the building to be monitored can confirm the uncorrected intrusion record video from a remote location.

The administrator of the building to be monitored can request the correction of the intrusion record video data from the mobile terminal 50 after confirming the intrusion record video that has not been corrected. In this case, the calculation unit 42 corrects the intrusion record video data as shown in steps S809 to S811 of FIG. 17B, and transfers the corrected intrusion record video data to the mobile terminal 50 as shown in step S812 of FIG. 17B. Send.

Further, the surveillance camera system 200 of the present embodiment has the same functions and effects as the surveillance camera system 100 described above, and the intrusion prevention device 20 detects the occurrence of intrusion and records the moving images before and after the intrusion occurrence time. Since it is transmitted and stored as moving image data to the server 40, when it is difficult for the image storage device 10 to detect an abnormality, for example, when another person wearing a security guard's uniform invades the monitored building at midnight. However, it is possible to accurately detect the occurrence of an intrusion, store the moving image data before and after the intrusion occurrence time as a record, and provide it to the user of the surveillance camera system 200.

In the surveillance camera system 200 described above, when the recorder 12 receives the intrusion recording video data request signal from the communication device 30, the intrusion recorded video data request signal included in the intrusion recording video data request signal among the video data stored in the first memory 14 Although it has been described that the moving image data for the set time before and after the occurrence time is written to the second memory 15 as the intrusion recording moving image data, the present invention is not limited to this. For example, the recorder 12 enables the intrusion occurrence signal to be received from the controller 24 through the LAN in the building, and when the intrusion occurrence signal from the controller 24 is received, the intrusion occurrence time in the moving image data stored in the first memory 14 is set. The moving image data for the set time before and after may be written to the second memory 15 as the intrusion recording moving image data. In this case, the intrusion recording video data is written to the second memory 15 before the recorder 12 receives the intrusion recording video data request signal from the communication device 30 in step S611 of FIG. When the intrusion recording video data request signal is received in step S611 of step 15, the intrusion recording video data stored in the second memory 15 is transmitted to the communication device 30.

In the above description, the surveillance camera system 200 has been described as detecting the occurrence of an intrusion by the intrusion prevention device 20 and transmitting and storing the moving images before and after the intrusion occurrence time as the intrusion recording moving image data to the server 40. Similar to the operation of the surveillance camera system 100 described with reference to FIG. 11B, the image storage device 10 analyzes the moving image captured by the surveillance camera 11 to detect the occurrence of an abnormality, and for the set time before and after the time of occurrence of the abnormality. The moving image data may be transmitted and saved as recorded moving image data to the server 40.

10 Image storage device, 11 Surveillance camera, 12 Recorder, 13 Image storage unit, 14 1st memory, 15 2nd memory, 16 Image analysis unit, 17 Alarm signal generator, 20 Intrusion prevention device, 21 Card reader, 22 Entrance door , 23 door locking device, 24 controller, 25 intrusion detection unit, 26 intrusion occurrence signal generation unit, 30 communication device, 35 remote communication network, 36 communication network, 40 server, 41 communication unit, 42 calculation unit, 43 image data storage unit , 45 user data storage, 50 mobile terminals, 100, 200 surveillance camera system.

Claims (4)

An image storage device that stores video data captured by surveillance cameras,
With the server
A communication device that communicates with the image storage device and transmits the moving image data from the image storage device to the server.
A surveillance camera system including a mobile terminal that communicates with the server.
The image storage device stores the moving image data captured by the surveillance camera, analyzes the moving image data captured by the surveillance camera, and generates an alarm signal including an abnormality occurrence time when an abnormality is detected.
When the communication device receives the alarm signal from the image storage device, the communication device records data for a set time before and after the abnormality occurrence time in the moving image data stored in the image storage device as recorded moving image data. Received from the image storage device
The server receives the alarm signal and the recorded moving image data from the communication device, transmits an abnormality detection notification mail to the mobile terminal based on the received alarm signal, and stores the received recorded moving image data. the After receiving a recording video request signal from the mobile terminal, select one still image from the set time before and after the abnormal occurrence time from among the Symbol Rokudo image data received as a representative image, analyzing the representative image Then, the image feature index value is extracted, the recorded moving image data is corrected by the extracted image feature index value, and the corrected recorded moving image data is transmitted to the mobile terminal.
Surveillance camera system featuring. The surveillance camera system according to claim 1.
The image feature index value is either one of the image brightness range defined by the maximum value and the minimum value of the brightness of the representative image and the average value of the local dispersion values of the brightness indicating the variation in the brightness in the predetermined range. Including both,
Surveillance camera system featuring. The surveillance camera system according to claim 1 or 2.
The image storage device stores the imaging setting information when the moving image is captured together with the moving image data.
The communication device receives the imaging setting information from the image storage device together with the recorded moving image data, and receives the image pickup setting information from the image storage device.
The server stores the received image pickup setting information together with the recorded moving image data, and corrects the recorded moving image data based on the image feature index value and the imaging setting information.
Surveillance camera system featuring. The surveillance camera system according to claim 1 or 2.
It is provided with an intrusion prevention device that communicates with the communication device and generates an intrusion occurrence signal including an intrusion occurrence time when an intrusion occurs.
The communication device, upon receiving the intrusion occurrence signal from the intrusion preventing device, the setting time of the data that put before and after the penetration occurrence time of said video data stored in the image storage device Received from the image storage device as intrusion recording video data,
The server receives the intrusion occurrence signal and the intrusion record moving image data from the communication device, transmits an intrusion occurrence detection notification mail to the mobile terminal based on the received intrusion occurrence signal, and receives the intrusion record. When the moving image data is saved and the intrusion recording video request signal is received from the mobile terminal, one still image is selected as the representative image from the received intrusion recording moving image data from the set time before and after the intrusion occurrence time. , Analyzing the representative image, extracting an image feature index value, correcting the intrusion record moving image data with the extracted image feature index value, and transmitting the corrected intrusion recording moving image data to the mobile terminal.
Surveillance camera system featuring.

Images